Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Reliability and validity of the ESRD Symptom Checklist – Transplantation Module in Norwegian kidney transplant recipients

BMC Nephrology volume 7, Article number: 17 (2006) Cite this article

Abstract

Background

The aim of the study was to validate the Norwegian version of a self-administered 43-item questionnaire designed to assess quality of life in kidney transplant recipients, the End-Stage Renal Disease Symptom Checklist – Transplantation Module (ESRD-SCL).

Methods

In total, 53 kidney transplant recipients from one university-affiliated hospital responded to a questionnaire including the ESRD-SCL and the Short Form 36 (SF-36). We assessed internal consistency reliability and test-retest reliability with 2 weeks between assessments. Construct validity was assessed by correlations of the ESRD-SCL subscales with related and unrelated SF-36 scales, demographic, and clinical characteristics.

Results

Subscales of the ESRD-SCL showed good internal consistency reliability (Cronbach's = 0.72–0.81) and for the aggregate total scale α was 0.94. Test-retest reliability median 14 days apart was excellent with intraclass coefficients ranging from 0.87 to 0.95. The pattern of correlations of the ESRD-SCL scales with related and unrelated scales SF-36 scales and demographic and clinical characteristics gave support to the construct validity of the ESRD-SCL.

Conclusion

The Norwegian translation of the ESRD-SCL showed satisfactory internal consistency reliability, test-retest reliability and construct validity, at the level of the original German version.

Peer Review reports

Background

Kidney transplantation has a positive impact on survival and morbidity of patients with end-stage renal disease. Recently, there has been increasing attention to health-related quality of life (HRQoL) as an important consideration in evaluating the impact of kidney transplantation. Kidney transplant recipients have better HRQoL than transplant candidates maintained on hemodialysis [1, 2], and they experience an improvement of HRQoL in the first months after transplantation [3, 4].

The HRQoL in kidney transplantation can be evaluated using generic tools, such as the Sickness Impact Profile (SIP), the Nottingham Health Profile (NHP) or the Short Form 36 (SF-36) [5]. Some disease-specific tools for evaluation of HRQoL in relationship to renal transplantation have been developed, including the Kidney Transplant Questionnaire [6], and the ESRD symptom checklist – transplantation module (ESRD-SCL) questionnaire [7]. Also, the Kidney Disease-Quality of Life (KDQOL) questionnaire is commonly used [8–10], although it was not developed specifically for the evaluation of transplantation.

To conduct studies on HRQoL outcomes in kidney transplant patients, it is necessary to adapt relevant questionnaires and tools to the appropriate language and assess the psychometric properties of the questionnaires in relevant populations. Based on content analysis and available documentation, we identified the ESRD-SCL as a feasible questionnaire for use in kidney transplantation, in particular to evaluate the effects of immunosuppressant medication [11].

The objective of the present study was to assess the reliability and construct validity of a Norwegian version of the ESRD-SCL in renal transplant recipients.

Methods

Subjects and study design

Kidney transplantation in Norway is centralized to Rikshospitalet University Hospital, Oslo; however, follow up is decentralized and performed in several hospitals. In the present study we aimed at including all consecutive kidney transplant recipients in a population of about 65 recipients, who regularly visits the nephrology outpatient clinic at Akershus University Hospital, irrespective of medication and time since transplantation. During an outpatient visit, the attending physician asked the patients to participate and to give their written informed consent. The participants received a package of self-administered questionnaires to be filled in at home and mailed to the study organizers. About 2 weeks after returning the questionnaires, the respondents received another identical questionnaire by mail. We contacted eight of the participants by telephone, as a reminder after the first questionnaire administration. No reminders were used for the retest.

We aimed at including 60 subjects in order to have data from 50 subjects for analysis. In total 59 patients accepted to participate; 53 returned the first questionnaire (90%), and 48 the second questionnaire (81%). The Regional committee for medical research ethics, Health Region East (REK Øst) approved the study, and the participants signed a declaration of informed consent.

Questionnaires

The package of questionnaires contained the following instruments:

The ESRD symptom checklist – transplantation module (ESRD-SCL)

The ESRD-SCL was developed in Essen, Germany to assess quality of life after renal transplantation, focusing on transplantation-specific symptoms, side effects of immunosuppressive therapy and psychological distress [7]. It is available in German, English and Turkish versions [12]. The reliability, validity and responsiveness of this questionnaire have been assessed in a German population of renal transplantation patients [7, 13], and the questionnaire has been used to compare HRQoL of patients using tacrolimus and ciclosporin-microemulsion [11].

The cultural and language adaptation of the ESRD-SCL was done according to a recommended procedure [14]. Two Norwegian physicians fluent in German in parallel translated the questionnaire into from German into Norwegian. A group with the two translators and two other members discussed the translations and agreed on a consensus version. This consensus version then was backtranslated into German by a physician fluent in Norwegian, but with German as his native language. The backtranslated version was compared with the original and discussed with the authors of the original version. The questionnaires were considered conceptually and linguistically equivalent. Before using the questionnaire, it was pilot-tested in some patients with kidney failure and found to be acceptable. The final Norwegian version of the questionnaire is presented as an appendix [see Additional file 1].

Short Form 36 (SF-36)

The general health status questionnaire SF-36 intends to assess aspects of health important to all patients. The SF-36 is developed in the U.S., contains eight scales [15, 16], and two component summary scales, and has been extensively validated; however with limited experience in kidney transplant recipients. We used the Norwegian standard SF-36 version 1.2 [17], assessing health status during the past four weeks. The scales were scored from 0 (lowest level of functioning) to 100 (highest level of functioning). The SF-36 has previously been used in Norwegian kidney transplant recipients [18], and its psychometric properties have been demonstrated in Norwegian patients and scores for a normal population presented [17, 19].

Demographic and clinical variables

At study entry, the attending physician recorded information on the patients's renal disease, previous transplantations, time since transplantation, current medication, data from the most recent physical examination including height, weight, blood pressure, and comorbidity using Charlson's comorbidity index, and some laboratory tests (Hemoglobin, S-creatinine). In the self-administered questionnaire, the patients reported some supplementary demographic data, such as marital status, education, and employment status.

Statistical analysis

Descriptive statistics are presented using the mean (SD), median (range) or numbers (%). Internal consistency reliability was assessed using Cronbach's α [20]. Test-retest reliability was assessed over 2 weeks with an intraclass correlation coefficient (ICC), using the average of raters in a two-way mixed model ICC with absolute agreement definition.

Construct validity for the ESRD-SCL subscales was assessed by comparing actual correlations with the SF-36 scales with apriori predicted correlations. Based on previous literature [7, 21] and content analysis of the items of the scales, we hypothesized that:

(1) The two ESRD-SCL dimensions Limited cognitive capacity and Transplantation-associated psychological distress would have the highest correlations with the SF-36 scale Mental health.

(2) The correlation of the ESRD-SCL dimension Cardiac and renal dysfunction would be highest with the SF-36 scale Physical functioning.

(3) The correlations between the two scales measuring medication side effects and the SF-36 scales would be weak.

(4) Associations with sociodemographic and clinical data would be highest for employment, age, sex, time since transplantation, and comorbidity, possibly in the range 0.08–0.30 roughly equivalent to an incremental R2 of 0.006–0.09 [7]. For comorbidity we used the Charlson comorbidity index (range 2–8) [22]. We also investigated the association with Hemoglobin, S-creatinine and immunosuppressive regimen (tacrolimus/prednisolone vs. ciclosporin/prednisolone), possibly being able to capture the characteristic side effects of ciclosporin of gum and hair growth.

For correlations between the ESRD-SCL and SF-36 scales we used Pearson's correlation coefficient. For correlations of the ESRD-SCL scales with demographic and clinical variable we used Spearman's rank correlations, because of the ordinal nature of some of the data and the dichotomy of some variables.

Finally, we assessed the capacity of the questionnaire subscales subscales to discriminate between two known groups, as defined by: (1) immunosuppressive regimen, comparing tacrolimus/prednisolone (n = 9) with ciclosporin/prednisolone (n = 39); (2) Age below/above the sample median of 57.87 years; (3) comorbidity, using Charlson comorbidity index above/below the median (≤2 vs >2). These or similar variables have been associated with HRQoL following renal transplantation in previous studies [7, 21]. In this analysis we used analysis of variance/covariance, adjusting for age, sex and comorbidity (Charlson comorbidity index ≤2 vs >2), where appropriate.

Sample size for test-retest analysis was planned to about 50 patients, which is commonly used in the literature. However, formal sample size calculation for test-retest analysis or correlation analysis is rarely done and was not carried out in the present study. We chose a 5% significance level, using two-sided tests. The SPSS statistical software version 12.0 (SPSS Inc., Chicago, IL) was used for all analyses.

Results

The characteristics of the 59 respondents are shown in Table 1. ESRD-SCL and SF-36 scores are shown in Table 2, including the percentage of respondents giving lowest (floor) and highest possible score (ceiling). The ESRD-SCL scores did not concentrate at the ceiling for any subscale. However, scores concentrated at the floor for the Limited cognitive capacity, Side effects of corticosteroids, and Increased growth of gum and hair subscales (Table 2). For the SF-36 scales role – physical 30% of respondents scored the lowest possible value (floor). There were marked ceiling effects on the SF-36 scales role – physical (40%), bodily pain (25%), social functioning (50%), and role – emotional (67%) scales (Table 2).

Table 1 Respondents' characteristics (n = 53), mean (SD) unless otherwise stated
Full size table
Table 2 Health-related quality of life scores and relaibility assessments
Full size table

The Cronbach's α was high for all dimensions of the ESRD-SCL (α = 0.72–0.81), for the total scale (α = 0.94) (Table 2), and for the scales of the SF-36 (α = 0.80–0.91). In the test-retest the respondents (n = 48) completed questionnaires median 14 days apart (interquartile range 9 to 20 days). In the test-retest, the intraclass correlation coefficients for the different subscales of the ESRD-SCL ranged 0.87 to 0.95, and for the SF-36 from 0.83 to 0.95.

In the assessment of construct validity, the hypothesized associations between scales of the ESRDL-SCL generally were among the highest, largely confirming the hypothesis, although some of the other subscales also correlated well (Table 3). The correlations of the two scales measuring medication side effects with the SF-36 scales were among the weakest pairwise correlations.

Table 3 Multitrait-multimethod correlation matrix. Pearson's correlation coefficients between subscales of the ESRD-SCL and SF-36
Full size table

Among the demographic and clinical variables, employment showed the highest correlation with most of the ESRDL-SCL subscales, although these correlations were all weak and <0.40 (Table 4). Increased growth of gum and hair, a typical side effect of ciclosporin, was moderately associated with a ciclosporin-containing immunosuppressive regimen. With the above exceptions, associations of the ESRDL-SCL subscales with demographic and clinical variables were weak or close to nothing, as hypothesized (Table 4).

Table 4 Spearman's rank correlation coefficients of subscales of the ESRD-SCL with demographic and clinical variables
Full size table

Only the ESRD-SCL subscale Increased growth of gum and hair discriminated between patients with two different immunosuppressive regimens after adjustment for age, sex, and comorbidity (Table 5). Only the two SF-36 scales Role – physical and Bodily pain discriminated between patients below/above the median age in the multivariate model. On the ESRD-SCL subscale Side effects of corticosteroids, younger patients tended indicate more problems than those above the median age, although this difference was statistically not significant (Table 5). The SF-36 physical functioning scale was the only scale that discriminated between patient groups according to Charlson comorbidity index ≤2 vs. >2 (p =< 0.001). The ESRD-SCL subscales Limited physical capacity and Cardiac and renal dysfunction showed differences that were almost statistically significant (Table 5), however, we hypothesized that these scales were associated with the Physical functioning scale of the SF-36.

Table 5 Health-related quality of life scores according to immunosuppressive regimen, age below/above the median and comorbidity below/above the median
Full size table

Discussion

In this cross-sectional study, the Norwegian version of the ESRD-SCL demonstrated high internal consistency reliability for all six subscales, in line with the original German version (α = 0.76–0.85) [7]. Furthermore the test-retest reliability over 2 weeks for all scales was excellent. Reproducibility for the scales of this questionnaire has previously only been assessed over 1 year in stable patients [7]. It has been suggested that HRQoL instruments can be used for comparisons at group level if reliability is above 0.70 [23]. All subscales of both the ESRD-SCL and the SF-36 instruments had higher internal consistency reliability than this. For use at the level of the individual patient, a suggested minimum requirement for reliability is 0.90 while 0.95 is desirable [23] although perhaps too stringent [24].

The pattern of correlations between the two instruments largely confirmed hypothesized associations from literature review and item content analysis, hence supporting convergent and discriminant validity of the ESRD-SCL [25]. Furthermore, the associations of the ESRD-SCL subscales with demographic and clinical variables were in line with expectations. The patients accepted the questionnaire well, as demonstrated by the high completion rates.

We found no difference in HRQoL between a tacrolimus-based and a ciclosporin-based regimen using the SF-36, and no systematic difference on the ESRD-SCL subscales except the Increased growth of gum an hear subscale, however our sample was small. Previous studies have reported comparable effects on global HRQoL of the two regimens, while Tacrolimus has tended to improved the disease-specific HRQoL [11, 26–30].

A previous study has reported lower scores, denoting less side effects, on the Side effects of corticosteroids dimension of the ESRD-SCL and more suffering in the Limited cognitive function and Increased growth of gum and hair dimension among the elderly [7]. In the present study we noted a statistically nonsignificant tendency to lower Side effects of corticosteroids in the elderly, however there was no indication of a difference according to age in the Limited cognitive dimension or Increased growth of gum and hair dimension in the present study.

Some weaknesses of the study should be noted. This study was a cross-sectional study in one hospital with a limited sample size, and all patients were successful renal transplant recipients.

The questionnaire contains items intended to assess side effects of immunosuppressive medication. Hence, the questionnaire can be a useful supplement to other questionnaires in studies of kidney transplantation, in particular in studies of variations in immunosuppressive medication following transplantation.

Conclusion

In summary, we have demonstrated that the psychometric properties of the Norwegian version of the ESRD-SCL were satisfactory and in line with the German original. Hence, the questionnaire can be recommended for use in future studies. The present study was not designed to evaluate responsiveness, which should be assessed in a longitudinal study.

References

  1. Keown P: Improving quality of life – the new target for transplantation. Transplantation. 2001, 72: S67-S74.

    CAS  PubMed  Google Scholar 

  2. Rebollo P, Ortega F, Baltar JM, Badia X, Alvarez-Ude F, Diaz-Corte C, Naves M, Navascues RA, Urena A, Alvarez-Grande J: Health related quality of life (HRQOL) of kidney transplanted patients: variables that influence it. Clin Transplant. 2000, 14: 199-207. 10.1034/j.1399-0012.2000.140304.x.

    Article  CAS  PubMed  Google Scholar 

  3. Ponton P, Rupolo GP, Marchini F, Feltrin A, Perin N, Mazzoldi MA, Giacon B, Baldan N, Rigotti P: Quality-of-life change after kidney transplantation. Transplant Proc. 2001, 33: 1887-9. 10.1016/S0041-1345(00)02737-8.

    Article  CAS  PubMed  Google Scholar 

  4. Jofre RJM, Moreno F, Sanz-Guajardo D, Valderrabano F: Changes in quality of life after renal transplantation. Am J Kidney Dis. 1998, 32: 93-100.

    Article  CAS  PubMed  Google Scholar 

  5. Fiebiger W, Mitterbauer C, Oberbauer R: Health-related quality of life outcomes after kidney transplantation. Health Qual Life Outcomes. 2004, 2: 2-10.1186/1477-7525-2-2.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Laupacis A, Pus N, Muirhead N, Wong C, Ferguson B, Keown P: Disease-specific questionnaire for patients with a renal transplant. Nephron. 1993, 64: 226-31.

    Article  CAS  PubMed  Google Scholar 

  7. Franke GH, Reimer J, Kohnle M, Luetkes P, Maehner N, Heemann U: Quality of life in end-stage renal disease patients after successful kidney transplantation: development of the ESRD symptom checklist – transplantation module. Nephron. 1999, 83: 31-9. 10.1159/000045470.

    Article  CAS  PubMed  Google Scholar 

  8. Hays RD, Kallich JD, Mapes DL, Coons SJ, Carter WB: Development of the kidney disease quality of life (KDQOL) instrument. Qual Life Res. 1994, 3: 329-38. 10.1007/BF00451725.

    Article  CAS  PubMed  Google Scholar 

  9. Green J, Fukuhara S, Shinzato T, Miura Y, Wada S, Hays RD, Tabata R, Otsuka H, Takai I, Maeda K, Kurokawa K: Translation, cultural adaptation, and initial reliability and multitrait testing of the Kidney Disease Quality of Life instrument for use in Japan. Qual Life Res. 2001, 10: 93-100. 10.1023/A:1016630825992.

    Article  CAS  PubMed  Google Scholar 

  10. Molsted S, Heaf J, Prescott L, Eidemak I: Reliability testing of the Danish version of the Kidney Disease Quality of Life Short Form. Scand J Urol Nephrol. 2005, 39: 498-502. 10.1080/00365590500240253.

    Article  PubMed  Google Scholar 

  11. Reimer J, Franke GH, Philipp T, Heemann U: Quality of life in kidney recipients: comparison of tacrolimus and cyclosporine-microemulsion. Clin Transplant. 2002, 16: 48-54. 10.1034/j.1399-0012.2002.00071.x.

    Article  PubMed  Google Scholar 

  12. Franke GH, Yucetin L, Yaman H, Reimer J, Demirbas A: Disease-specific quality of life in Turkish patients after successful kidney transplantation. Transplant Proc. 2006, 38: 457-9. 10.1016/j.transproceed.2005.12.110.

    Article  CAS  PubMed  Google Scholar 

  13. Franke GH, Reimer J, Philipp T, Heemann U: Aspects of quality of life through end-stage renal disease. Qual Life Res. 2003, 12: 103-15. 10.1023/A:1022238707028.

    Article  PubMed  Google Scholar 

  14. Perrin EB, Aaronson NK, Alonso J, Burnham A, Lohr KN, Patrick DL, Roberts J: Scientific advisory committee instrument review criteria. Medical Outcomes Trust Bulletin. 1995, 3: I-IV.

    Google Scholar 

  15. Ware JE, Snow KK, Gandek B: SF-36 health survey. Manual and interpretation guide. 1993, Boston, MA: The Health Institute, New England Medical Center

    Google Scholar 

  16. McHorney CA, Ware JE, Lu JF, Sherbourne CD: The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care. 1994, 32: 40-66. 10.1097/00005650-199401000-00004.

    Article  CAS  PubMed  Google Scholar 

  17. Loge JH, Kaasa S: Short Form 36 (SF-36) health survey: normative data from the general Norwegian population. Scand J Soc Med. 1998, 26: 250-8.

    CAS  PubMed  Google Scholar 

  18. Aasebo W, Midtvedt K, Hartmann A, Stavem K: Predictors of health-related quality of life in hypertensive recipients following renal transplantation. Clin Transplant. 2005, 19: 756-62.

    PubMed  Google Scholar 

  19. Loge JH, Kaasa S, Hjermstad MJ, Kvien TK: Translation and performance of the Norwegian SF-36 Health Survey in patients with rheumatoid arthritis. I. Data quality, scaling assumptions, reliability, and construct validity. J Clin Epidemiol. 1998, 51: 1069-76. 10.1016/S0895-4356(98)00098-5.

    Article  CAS  PubMed  Google Scholar 

  20. Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrica. 1951, 16: 297-334. 10.1007/BF02310555.

    Article  Google Scholar 

  21. Rebollo P, Ortega F, Ortega T, Valdes C, Garcia-Mendoza M, Gomez E: Spanish validation of the "Kidney Transplant Questionnaire": a useful instrument for assessing health related quality of life in kidney transplant patients. Health Qual Life Outcomes. 2003, 1: 56-10.1186/1477-7525-1-56.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987, 40: 373-83. 10.1016/0021-9681(87)90171-8.

    Article  CAS  PubMed  Google Scholar 

  23. Nunnally JC, Bernstein IH: Psychometric theory. 1994, New York: McGraw-Hill, 3

    Google Scholar 

  24. Hays RD, Anderson R, Revicki DA: Psychometric evaluation and interpretation of health-related quality of life data. The international assessment of health-related quality of life: Theory, translation, measurement and analysis. Edited by: Shumaker SA, Berzon R. 1995, Oxford: Rapid Communications, 103-14.

    Google Scholar 

  25. Streiner DL, Norman GR: Health measurement scales. A practical guide to their development and use. 1995, Oxford: Oxford University Press

    Google Scholar 

  26. Reimer J, Franke GH, Luetkes P, Kohnle M, Philipp T, Heemann U: Quality of life after kidney transplantation – the impact of tacrolimus. Transplant Proc. 2001, 33: 1924-6. 10.1016/S0041-1345(00)02714-7.

    Article  CAS  PubMed  Google Scholar 

  27. Shield CF, McGrath MM, Goss TF: Assessment of health-related quality of life in kidney transplant patients receiving tacrolimus (FK506)-based versus cyclosporine-based immunosuppression. FK506 Kidney Transplant Study Group. Transplantation. 1997, 64: 1738-43. 10.1097/00007890-199712270-00020.

    Article  CAS  PubMed  Google Scholar 

  28. Scholler G, Rose M, Neuhaus R, Neuhaus P, Klapp BF: Comparison of cyclosporine A and FK506 with regard to complaints and psychosocial characteristics before and after liver transplantation. Transplant Proc. 1997, 29: 2491-3. 10.1016/S0041-1345(97)00461-2.

    Article  CAS  PubMed  Google Scholar 

  29. Dew MA, Harris RC, Simmons RG, Roth LH, Armitage JM, Griffith BP: Quality-of-life advantages of FK 506 vs conventional immunosuppressive drug therapy in cardiac transplantation. Transplant Proc. 1991, 23: 3061-4.

    CAS  PubMed  Google Scholar 

  30. Felser I, Wagner S, Depee J, Johnson N, Staschak S, Jain A, Fung JJ, Starzl TE: Changes in quality of life following conversion from CyA to FK 506 in orthotopic liver transplant patients. Transplant Proc. 1991, 23: 3032-4.

    CAS  PubMed  PubMed Central  Google Scholar 

Pre-publication history

Download references

Author information

Authors and Affiliations

  1. Medical Department, Akershus University Hospital, Lørenskog, Norway

    Knut Stavem & Rüdiger Ganss

  2. Helse-Øst Health Services Research Centre, Lørenskog, Norway

    Knut Stavem

Authors
  1. Knut Stavem
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rüdiger Ganss
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Knut Stavem.

Additional information

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

KS participated in planning and design of the study, organization of data collection, performed the statistical analysis, drafted and revised the manuscript. RG participated in the planning and design of the study, organization of data collection, and critically reviewed the manuscript. Both authors read and approved the final manuscript.

Electronic supplementary material

12882_2006_75_MOESM1_ESM.doc

Additional file 1: The Norwegian version of the End-Stage Renal Disease Symptom Checklist-Transplantation Module (ESRD-SCL). The additional file shows the Norwegian version of the ESRD-SCL, which was translated and validated in the article. (DOC 26 KB)

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Stavem, K., Ganss, R. Reliability and validity of the ESRD Symptom Checklist – Transplantation Module in Norwegian kidney transplant recipients. BMC Nephrol 7, 17 (2006). https://doi.org/10.1186/1471-2369-7-17

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2369-7-17

Keywords

BMC Nephrology

ISSN: 1471-2369

Contact us