Research Article

Validation of the Turkish version of the Quality of Life in Patients with Anal Fistula Questionnaire

10.4274/tjcd.galenos.2023.2023-11-1

  • Mehmet Ali Koç
  • Kerem Özgü
  • Derya Gökmen
  • Mehmet Süha Sevinç
  • Şiyar Ersöz
  • Cihangir Akyol

Received Date: 11.11.2023 Accepted Date: 29.11.2023 Turk J Colorectal Dis 2023;33(4):124-130

Aim:

This study aimed to examine the psychometric properties of the Turkish version of the Quality of Life in Patients with Anal Fistula Questionnaire (QoLAF-Q), recently introduced to the literature, in line with the principle that every disease should have its own quality of life (QoL) scale. The 14-question QoLAF-Q has not been validated in Turkey and was validated in this study for use in practice with Turkish individuals by assessing whether it yields similar results to the Short Form-12 Health Survey (SF-12).

Method:

This was an observational cross-sectional study to facilitate the development and validation of the QoLAF-Q and was conducted between 2020 and 2023.

Results:

All questions passed the 0.35 threshold in confirmatory factor analysis (CFA). The Tucker-Lewis Index value was 0.979 (>0.90 acceptable, >0.95 perfect). The comparative fit index was 0.983 (>0.90 acceptable, >0.95 perfect), and the root mean square error of approximation was 0.075 (<0.08 acceptable, <0.05 perfect) based on the 14-question, two-factor CFA result. The Physical Component Summary (PCS) and Mental Component Summary (MCS) scores of the SF-12, as well as the PCS and MCS scores of the QoLAF-Q, had a significant relationship (p>0.05).

Conclusion:

As demonstrated in a previous Spanish study, the QoLAF-Q is a valuable measurement tool that possesses sufficient psychometric properties for assessing general health status and health-related QoL in clinical practice and scientific research in Turkey.

Keywords: Questionnare, validation, QoLAF-Q

Introduction

The concept of being healthy is one that continually evolves. In 1947, the World Health Organization defined health as “a state of complete physical, mental, and social well-being and not merely the absence of disease or infirmity”.1 Physicians have strived to align their treatments with this definition, with efforts to comprehend the meaning of health first initiated in the 1960s.2 Although treatments benefit the afflicted, they can also have unintended consequences, such as antibiotic resistance in response to treating infections. This has prompted physicians to contemplate the ethical boundaries of these treatments.

In 1966, the Annals of Internal Medicine articulated the desire of every physician for their patients, young or old, as not merely the absence of death but a life imbued with the vitality associated with youthful vigor.3

In this context, health-related quality of life (HRQoL) tools have been developed to assess patients’ well-being. With the advent of customized treatments for specific ailments, the need for tailored HRQoL tools has grown.4 However, customized HRQoL assessment tools for patients with anal fistula (AF) are lacking.5,6

AF presents with common symptoms such as suppuration, hemorrhage, and pain, often following the drainage of a perianal abscess, considerably affecting patients’ quality of life (QoL).5-8 Various surgical procedures are available to treat AF, but they come with a potential recurrence risk ranging from approximately 10% to 60%. Moreover, surgical complications, including incontinence, abscesses, and the necessity for multiple interventions, can further impact patients’ QoL.5,9,10 Therefore, colorectal surgeons typically consider patient QoL when determining the most appropriate treatment approach and evaluating its effectiveness.10

A literature review revealed that the assessment instruments employed to evaluate QoL in patients diagnosed with AF were originally developed for assessing general HRQoL. These instruments include the Short Form-12 Health Survey (SF-12) and the SF-36.11 In particular, the SF-12v2, a 12-item self-rated scale, has been validated in numerous languages and for various medical conditions.4

In this study, we utilized the Quality of Life in Patients with Anal Fistula Questionnaire (QoLAF-Q), recently introduced to the literature by Ferrer-Márquez et al.5, in line with the principle that every disease should have its own QoL scale. The purpose of this research was to examine the psychometric properties of the Turkish version of the QoLAF-Q and validate it for the Turkish population by comparing its results to those of the SF-12.


Materials and Methods

Study Design

The current investigation employed an observational cross-sectional design to facilitate the development and validation of the QoLAF-Q. This study was conducted between 2020 and 2023. The inclusion criteria for participation were age ≥18 years and a diagnosis of cryptoglandular AF. The exclusion criteria for participation were as follows: 1) patients whose native language was not Turkish; 2) patients with comprehension and speech disorders due to cognitive problems; 3) patients with anovaginal fistula; 4) a history of radiotherapy; and 5) the presence of anal cancer. The study procedures were approved by the Ankara University Human Research Ethics Committee (approval number: İ01-32-23, date: 23.01.2023). Prior to participating in this research, volunteers completed an informed consent form. Demographic data, including age, sex, and prior anal surgery, were collected using the personal information form included with the questionnaire. The questionnaires were administered on postoperative days 15 and 30. Concurrently, the SF-12 was also administered to the patients.

SF-12

Ware et al.12 developed a more practical and concise version of the SF-36 in 1995, resulting in the SF-12, which includes the same subscales as the SF-36 but with a reduced number of questions. The advantage of the SF-12 is its ability to yield the same component summary scores as the SF-36, and it takes less time to administer due to its reduced item count. The reliability of the scale, evaluated by calculating Cronbach’s alpha, was 0.73 for the Physical Component Summary (PCS) and 0.72 for the Mental Component Summary (MCS). The SF-12 has been validated in multiple languages.

QoLAF-Q

The initial version of the QoLAF-Q was developed in Spanish. The answers were based on a 5-point Likert scale. Fourteen questions were validated in the Spanish version of the QoLAF-Q. The reliability of the QoLAF-Q was assessed by calculating Cronbach’s alpha, which was 0.908.

The researchers involved in the creation of the QoLAF-Q, including manuel Ferrer-Márquez, were contacted, and the necessary permissions were obtained.

During the translation process, the questionnaire was initially translated into Turkish by two native English speakers. The translated version was then reviewed by two colorectal surgeons (CA, MAK), who are native Turkish speakers and proficient in English (Supplement Table 1). This process resulted in a version of the questionnaire that was in a common language and easily understood.

Statistical Analysis

Internal Construct Validity

Two-factor confirmatory factor analysis (CFA) was conducted using categorical data in MPlus to assess the dimensionality of the “Anal Fistula Scale”.13 Factor loadings that were positive and/or above 0.35 were retained in the scale. The Tucker-Lewis Index [(TLI); >0.90, considered acceptable; >0.95, considered excellent], Comparative Fit Index [(CFI); >0.90, considered acceptable; >0.95, considered excellent], and root mean square error of approximation [(RMSEA); <0.08, considered acceptable; <0.05, considered excellent] were used as measures of goodness-of-fit.14

Known-Group Validity

The scale’s ability to discern expected differences based on patient age, sex, and anal surgery history was examined. The disparities in subdimension scores based on sex and anal surgery history were analyzed using the Mann-Whitney U test, and the correlation with age was assessed using Spearman’s correlation coefficient.

External Construct Validity

In the context of external construct validity, the relationship between the scores obtained from the Anal Fistula Scale and those of the SF-12 was evaluated using Spearman’s correlation coefficient.

Reliability

Following the confirmation of internal and external construct validity, reliability was assessed for both internal consistency and test–retest reliability. Internal consistency was evaluated using Cronbach’s alpha coefficient and test-retest reliability was measured using the intraclass correlation coefficient along with its associated confidence interval.15,16


RESULTS

Patient Demographics

A total of 100 individuals participated in our study. The sample had an average age of 43.3 years, ranging from 18 to 72 years. Twenty-four percent of the participants were female, and 76% of the participants had no history of anal surgery.

Understandability

Independent native Turkish speakers reported no difficulties when reading and completing the QoLAF-Q. Furthermore, the mean completion time was less than 5 minutes, ranging from 4 to 6 minutes.

Internal Construct Validity

Following the CFA conducted on the 14 questions with a 2-factor structure, goodness-of-fit statistics slightly below acceptable limits were observed. In response, two modifications recommended by the program were applied to improve the fit. Specifically, the error values of “How often do you experience discharge (suppuration) from the fistula?” were correlated with the error values of “How much discharge (suppuration) from the fistula do you experience?”, and the error values of “How often do you experience uncontrollable flatulence (farting) since having the fistula?” were correlated with the error values of “What is the amount of unintentional stool loss that you usually experience since having the fistula?." These adjustments aimed to address errors related to the questions. Following these modifications, the TLI was 0.979, the CFI was 0.983, and the RMSEA was 0.075, according to the 14-question, two-factor CFA result. The factor loadings of the questions based on the factors are presented in Table 1.

Known-Group Validity

The scale’s ability to disclose the expected differences based on the age, sex, and previous anal surgery of the patients was assessed, and the results are presented in Table 2.

Statistically significant differences in the known groups, including age, sex, and previous anal surgery, were not determined.

External Construct Validity

In terms of external construct validity, the relationship between the scores obtained from the QoLAF-Q and the SF-12 was evaluated using Spearman’s correlation coefficient, and the results are presented in Table 3.

The MCS and PCS scores of both the SF-12 and QoLAF-Q exhibited a statistically significant correlation. The QoLAF-Q and SF-12 demonstrated moderate consistency in correlation coefficients.

Reliability

Reliability was tested for both internal consistency and test-retest reliability, and the results are presented in Table 4.


Discussion

It is of crucial importance to not only treat patients with AF but also evaluate their QoL after necessary treatment methods have been applied. This is partly to understand the negative impact of AF complications (e.g., incontinence, hemorrhage, and disease recurrence) on patients’ QoL and partly to assess the effectiveness of applied treatment methods. To date, general health questionnaires such as the SF-12 have been used to evaluate the QoL of patients with AF in Turkey. However, there was no previously designed, validated, and published specific tool for assessing the QoL in Turkish patients with AF.

The properties of the QoLAF-Q must be understood in terms of its ability to accurately evaluate psychometric qualities, what it truly measures, and its practicality for daily use. Psychometric analysis conducted on these properties demonstrated that the internal consistency and stability of the QoLAF-Q are adequate. Such qualities can be considered evidence of the reliability and repeatability of the evaluation tool. Moreover, having an average completion time of 5 minutes can be associated with understandability and practicality. The results of external construct validity showed that, even though the correlation between these questionnaires was moderate, the QoLAF-Q is still as effective as the SF-12 in measuring HRQoL (Table 3). Therefore, both the SF-12 and QoLAF-Q can be used to evaluate HRQoL in patients with AF.

The known-group analysis involved age, sex, and prior anal surgery. It was anticipated that anal sphincter tone would be influenced by these factors, subsequently impacting the QoL of patients with AF. However, the investigation revealed that a statistically significant difference between the known groups themselves was not established in the QoLAF-Q. In a study conducted in Korea by Kim et al.17, it was observed that age is related to worsening anorectal functions due to lower anal resting and squeezing pressure, anal sphincter denervation, increased anal compliance, and decreased anal senses. A separate study conducted in Spain by Pla-Martí et al.18 evaluated the relationship among previous anal surgery, incontinence, and QoL. In our study, we also analyzed the known groups, including previous anal surgery, sex, and age groups. However, a statistically significant difference was not determined.

When internal consistency was analyzed, the Cronbach’s alpha value for the physical component was 0.721 and the biopsychosocial component value was 0.893. This indicates that the QoLAF-Q assesses the physical and biopsychosocial components collectively, concurrently, and intentionally. According to the scale, these values are considered to represent “good” consistency.19 Similarly, in other studies (e.g., the original QoLAF-Q study, an Iranian validation study, and a Nigerian validation study), the determined values ranged between good and excellent.20,21 Notably, a Chinese survey revealed relatively low values (0.67 for the PCS and 0.60 for the MCS).22

The intraclass correlation coefficient value for the physical component was 0.663, and the biopsychosocial value was 0.681. These satisfactory values were obtained from the evaluation of the consistency coefficients and the reliability coefficient re-evaluation, which was conducted 2 weeks later. These values indicate the stability of the QoLAF-Q, signifying that similar scores were and will be obtained in measurements taken at different times. This also supports the reliability of the Turkish version of the QoLAF-Q.

Study Limitations

In our study, we included only patients with cryptoglandular AF. Patients with Crohn’s disease were not included, which is considered a limitation of our research. Therefore, our study does not provide information regarding the properties of the QoLAF-Q related to Crohn’s disease. This subject can be further evaluated in future studies. It is also important to note that female patients accounted for only 24% of the participants. This does not align with the sex distribution of the general population and can be considered another limitation. Therefore, a future study with a more homogeneous and larger sample size can be conducted to address these limitations.


Conclusion

As demonstrated in the previous Spanish study, the QoLAF-Q is a valuable measurement tool. It possesses sufficient psychometric properties for assessing general health status and health-related QoL in clinical practice and scientific research in Turkey. The introduction of a Turkish HRQoL measurement tool for patients with AF that is both easily understandable and allows for quick QoL assessment is expected to facilitate the expansion of applications and research in the field of AF.

Ethics

Ethics Committee Approval: The study procedures were approved by the Ankara University Human Research Ethics Committee (approval number: İ01-32-23, date: 23.01.2023).

Informed Consent: Prior to participating in this research, volunteers completed an informed consent form.

Peer-review: Externally peer-reviewed.

Authorship Contributions

Surgical and Medical Practices: M.A.K., Ş.E., C.A., Concept: M.A.K., C.A., Design: K.Ö., C.A., Data Collection or Processing: M.A.K., K.Ö., M.S.S., Analysis or Interpretation: K.Ö., D.G., Literature Search: M.S.S., Ş.E., Writing: K.Ö., M.S.S.

Conflict of Interest: No conflict of interest was declared by the authors.

Financial Disclosure: The authors declared that this study received no financial support.


  1. Post MW. Definitions of quality of life: what has happened and how to move on. Top Spinal Cord Inj Rehabil 2014;20:167-180.
  2. World Health Organization. Health Promotion Glossary of Terms 2021. Geneva: World Health Organization, 2021.
  3. Elkinton JR. Medicine and the quality of life. Ann Intern Med 1966;64:711-714.
  4. Soysal Gündüz Ö, Mutlu S, Aslan Basli A, Gül C, Akgül Ö, Yilmaz E, Aydemir Ö. Validation of the Turkish form of short form-12 health survey version 2 (SF-12v2). Arch Rheumatol 2021;36:280-286.
  5. Ferrer-Márquez M, Espínola-Cortés N, Reina-Duarte A, Granero-Molina J, Fernández-Sola C, Hernández-Padilla JM. Design and psychometric evaluation of the quality of life in patients with anal fistula questionnaire. Dis Colon Rectum 2017;60:1083-1091.
  6. Abcarian H. Anorectal infection: abscess-fistula. Clin Colon Rectal Surg 2011;24:14-21.
  7. Yamana T. Japanese practice guidelines for anal disorders II. Anal fistula. J Anus Rectum Colon 2018;2:103-109.
  8. Madoff RD, Melton-Meaux GB. Diseases of the Rectum and Anus. In: Goldman L, Schafer A, (editors). Goldman-Cecil Medicine. 26th edn. Philadelphia; Elsevier 2019:933-939.e2.
  9. Tabry H, Farrands PA. Update on anal fistulae: surgical perspectives for the gastroenterologist. Can J Gastroenterol 2011;25:675-680.
  10. Göttgens KW, Smeets RR, Stassen LP, Beets G, Breukink SO. Systematic review and meta-analysis of surgical interventions for high cryptoglandular perianal fistula. Int J Colorectal Dis 2015;30:583-593.
  11. Soylu C, Kütük B. Reliability and validity of the Turkish version of SF-12 health survey. Turk Psikiyatri Derg 2022;33:108-117.
  12. Ware JE, Kosinski M, Keller SD. SF-12: How to Score the SF-12 Physical and Mental Health Summary Scales. In: Ware JE, (editor). 2nd ed. Boston: The Health Institute, New England Medical Center; 1995.
  13. Muthén LK, Muthén BO. Mplus User’s Guide. In: Muthén LK, Muthén BO, editors. Mplus User’s Guide. 5th ed. Los Angeles: Muthén & Muthén; 2007. p. 49-87.
  14. Pai AL, Mullins LL, Drotar D, Burant C, Wagner J, Chaney JM. Exploratory and confirmatory factor analysis of the child uncertainty in illness scale among children with chronic illness. J Pediatr Psychol 2007;32:288-296.
  15. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951;16:297-334.
  16. Ateş C, Öztuna D, Genç Y. The use of intraclass correlation coefficient (ICC) in medical research: review. Turkiye Klinikleri J Biostat 2009;1:59-64 (Turkish).
  17. Kim PJ, Kumar A, Elmarsafi T, Lehrenbaum H, Anghel E, Steinberg JS, Evans KK, Attinger CE. Comparison of completion rates for SF-36 compared with SF-12 quality of life surveys at a tertiary urban wound center. J Foot Ankle Surg 2017;56:1031-1035.
  18. Pla-Martí V, Martín-Arévalo J, Martí-Fernández R, Moro-Valdezate D, García-Botello S, Espí-Macías A, Mínguez-Pérez M, Ruiz-Carmona MD, Roig-Vila JV. Long-term evolution of continence and quality of life after sphincteroplasty for obstetric fecal incontinence. Ann Coloproctol 2022;38:13-19.
  19. Taber KS. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ 2018;48:1273-1296.
  20. Keramati MR, Yazd SMM, Omidi M, Keshvari A, Shahriarirad S, Shahriarirad R, Ahmadi-Tafti SM, Behboudi B, Kazemeini A, Sahebi L, Fazeli MS. Translation, cross-cultural adaptation, and psychometric evaluation of the persian (Farsi) version of the QoLAF (quality of life in patients with anal fistula) questionnaire. PLoS One 2023;18:e0277170.
  21. Ibrahim AA, Akindele MO, Ganiyu SO, Kaka B, Abdullahi BB, Sulaiman SK, Fatoye F. The Hausa 12-item short-form health survey (SF-12): translation, cross-cultural adaptation and validation in mixed urban and rural Nigerian populations with chronic low back pain. PLoS One 2020;15:e0232223.
  22. Lam ET, Lam CL, Fong DY, Huang WW. Is the SF-12 version 2 health survey a valid and equivalent substitute for the SF-36 version 2 health survey for the Chinese? J Eval Clin Pract 2013;19:200-208.