Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Exploring the use of tablet computer-based electronic data capture system to assess patient reported measures among patients with chronic kidney disease: a pilot study

BMC Nephrology volume 18, Article number: 356 (2017) Cite this article

Abstract

Background

Collecting patient reported outcome measures (PROMs) via computer-based electronic data capture system may improve feasibility and facilitate implementation in clinical care. We report our initial experience about the acceptability of touch-screen tablet computer-based, self-administered questionnaires among patients with chronic kidney disease (CKD), including stage 5 CKD treated with renal replacement therapies (RRT) (either dialysis or transplant).

Methods

We enrolled a convenience sample of patients with stage 4 and 5 CKD (including patients on dialysis or after kidney transplant) in a single-centre, cross-sectional pilot study. Participants completed validated questionnaires programmed on an electronic data capture system (DADOS, Techna Inc., Toronto) on tablet computers. The primary objective was to evaluate the acceptability and feasibility of using tablet-based electronic data capture in patients with CKD. Descriptive statistics, Fischer’s exact test and multivariable logistic regression models were used for data analysis.

Results

One hundred and twenty one patients (55% male, mean age (± SD) of 58 (±14) years, 49% Caucasian) participated in the study. Ninety-two percent of the respondents indicated that the computer tablet was acceptable and 79% of the participants required no or minimal help for completing the questionnaires. Acceptance of tablets was lower among patients 70 years or older (75% vs. 95%; p = 0.011) and with little previous computer experience (81% vs. 96%; p = 0.05). Furthermore, a greater level of assistance was more frequently required by patients who were older (45% vs. 15%; p = 0.009), had lower level of education (33% vs. 14%; p = 0.027), low health literacy (79% vs. 12%; p = 0.027), and little previous experience with computers (52% vs. 10%; p = 0.027).

Conclusions

Tablet computer-based electronic data capture to administer PROMs was acceptable and feasible for most respondents and could therefore be used to systematically assess PROMs among patients with CKD. Special consideration should focus on elderly patients with little previous computer experience, since they may require more assistance with completion.

Peer Review reports

Background

Chronic kidney disease (CKD) is a major public health concern that leads to poor health outcomes and substantial disease burden for patients and families. In the past decade, an extended body of studies have highlighted the alarming rate of psychosocial distress within the CKD population, with the prevalence of depression ranging between 14 and 30% in patients with stage 5 CKD [1] and anxiety detected in up to 51% of patients on maintenance dialysis [2, 3]. Depression not only has a negative impact on health-related quality of life [4, 5], but is also associated with poor treatment adherence, hospitalization [6], high morbidity [4] and overall mortality [4, 5, 7,8,9]. Despite these concerning facts, systematic assessment of symptoms (including mental health comorbidities) in the clinical management of CKD is not implemented as a standard of care, and depression and anxiety is often unrecognized and undertreated [10, 11].

There is a growing interest in the use of patient-reported outcome measures (PROMs) for psychosocial distress screening [12], symptom monitoring and management [12], as well as risk stratification among patients with chronic medical conditions [8, 13,14,15]. PROMs include physical symptom lists [16, 17], illness intrusiveness [18,19,20,21], treatment decision making [22,23,24,25], social support [26,27,28,29,30,31,32], psychosocial distress [33,34,35] as well as health-related quality of life [36]. Assessment of the patient’s own perception on functional and psychosocial well-being, quality of life and social support needs, however, is rarely incorporated in routine nephrology practice [37, 38]. This could be done using validated standard questionnaires to regularly collect PROMs to capture various dimensions of the patient’s subjective experience.

Electronic data capture systems offer a sustainable and economical way for the routine assessment of PROMs. Using electronic data capture instead of paper-based questionnaires to assess PROMs may improve the feasibility of assessing PROMs in routine clinical practice. It eliminates the need for subsequent data entry, storage of the questionnaires and reduces the risk of privacy breach. It has the potential for immediate scoring and presentation of results [39,40,41], offers the potential to link PROMs with clinical data in electronic health records [42, 43], enhance communication in multidisciplinary care [44, 45], and facilitate the assessment of PROMs independently from patient provider encounters. Electronic capture of PROMs has been utilized in oncology and palliative care [39, 40, 44, 46]. Schick-Makaroff et al. has shown that there was overall satisfaction with electronic capture of patient reported outcomes among patients receiving home hemodialysis [47, 48]. Computer literacy, however, varies within different patient populations, and less educated, elderly patients may face barriers when offered to use tablet-based questionnaires. Establishing the tablet’s feasibility among patients with CKD is an important first step in incorporating routine use of “ePROMs” in clinical practice.

The purpose of the current pilot study was to assess the acceptability of electronic touch-screen tablet computers in collecting PROMs among patients with advanced CKD, including stage 5 CKD treated with renal replacement therapies (either dialysis or transplant).

Methods

Study population

This is a single-centre, cross-sectional pilot study of patients with CKD at the University Health Network, Toronto, Canada. We recruited a convenience sample of 121 participants from the nephrology and kidney transplant outpatient clinics, in-centre and home hemodialysis units and the kidney transplant in-patient unit between September 2015 and April 2016. Individuals who were 18 years or older with stage 4 or 5 chronic kidney disease (eGFR < 29 mL/min/1.76m2 and eGFR < 15 mL/min/1.76m2, respectively) were eligible, including those with stage 5 CKD treated with renal replacement therapies (either dialysis or transplant). eGFR was determined by the CKD-EPI Equation. Patients who have been on dialysis treatment for more than 90 days have been recruited from the dialysis center of our hospital; in their case eGFR was not assessed as an inclusion criterion. Similarly, kidney transplant recipients by definition have stage 5 CKD(T), therefore eGFR was not used to select those patients either. Finally, pre-dialysis patients were recruited from the “Renal Management Clinic” of our hospital. This clinic provides complex, multidisciplinary management for patients with stage 4 and 5 CKD who are at significant risk of their CKD progressing. Patients are referred to this clinic for modality education and preparation for RRT from general nephrology clinics, where they had been followed for some time. Consequently, the chronic nature of CKD has been well established for all study participants.

Individuals with diagnosis of dementia, severe acute medical conditions, or unable to understand and read English were excluded. The study was approved by the University Health Network Research Ethics Board.

Participants were asked to complete sets of questionnaires on tablet computer devices. The research staff was present at all times to demonstrate the use of the tablet device or help with completing the questionnaires if needed.

Questionnaires

In this study, standard, validated questionnaires were programmed on an electronic data capture system (DADOS, Techna Inc., Toronto). In order to reduce respondent burden, the total questionnaire pool was divided into 4 sets (A - D) each containing a different combination of questionnaires (Table 1). To report the acceptability and the amount of assistance needed for completing the questionnaires, participants answered six questions that provided information about their experience with completing the questionnaires on the tablet computers (Patient Response Questionnaire - PRQ) (Additional file 1). The following questionnaires were used:

Table 1 Questionnaire items and sets used in pilot study
Full size table

Patient response questionnaire (PRQ)

The PRQ was designed to assess participants’ reaction to computer tablets. Participants were asked to complete 6 questions, which explored: 1) tablet acceptability, 2) help required in completing the tablet questionnaire, 3) questionnaire acceptability, 4) whether task of tablet completion was tiring, 5) participant’s previous computer experience, and 6) level of comfort in using computer tablet technology.

Transplant Decision Making Survey (TDMS) provides a validated, theoretically consistent measure of 1) Stages of Change, a measure of readiness to pursue deceased and living donor kidney transplant; 2) Decisional Balance, a weighted assessment of the pros and cons of deceased and living donor kidney transplant (DDKT and LDKT); and 3) Self-Efficacy, a measure of patient confidence in pursuing DDKT or LDKT in difficult circumstances [22]. These measures are based on the Transtheoretical Model of Behaviour Change [23], which has been successfully applied to assess transplant decision making [24, 25].

Distress Assessment and Response Tool (DART) [49] .consists of validated instruments for assessing psychosocial distress: 1) Patient Health Questionnaire-9 (PHQ-9) for depression [33, 34]; 2) Generalized Anxiety Disorder-7 item (GAD-7) for anxiety [35], 3) Edmonton Symptom Assessment System-revised (ESAS-r) to assess symptom burden [16, 17], 4) the Social Difficulties Inventory (SDI) for practical problems [26]; and 5) the Canadian Problem Checklist (CPC) for problems frequently encountered by patients with chronic disease [50]. DART has been implemented as part of routine clinical care in the cancer center of our hospital [49]

Experiences in Close Relationship Scale - Short Form (ECR-Short Form) is used to assess adult attachment style. The ECR yields validated scales for attachment anxiety and attachment avoidance [27,28,29].

Relationship Questionnaire (RQ) consists of four brief paragraphs describing the four adult attachment patterns, including secure, dismissing, preoccupied and fearful. The four attachment patterns are rated on a 7-point Likert scale [30, 31].

Short Literacy Survey (SLS) is composed of three self-reported screening questions that are effective in predicting low and moderate subjective health literacy in both general medicine and surgical clinics [51].

Medical Outcomes Study (MOS) Social Support Survey assesses various dimensions of social support, including emotional/informational, tangible, affectionate support, and positive social interaction. The 19 items on the survey are rated on a Likert scale [32].

Illness Intrusiveness Rating Scale (IIRS) measures the perceived intrusiveness of chronic disease and its treatment into one’s valued life domains. The theoretical framework has been tested, and the questionnaire has been validated in patients with different medical conditions, including CKD [18,19,20,21].

Kidney Disease Quality of Life Questionnaire-Short Form (KDQOL-SF™) has been the most widely used quality of life measure for patients with renal diseases. The KDQOL-SF™ includes the Medical Outcomes Study Short Form-36 generic core (SF-36) and several multi-item scales targeted at quality of life concerns of special relevance for patients with CKD [36].

Socio-demographic characteristics, including age, gender, family composition, education level, employment status and ethno-cultural background were also collected from the participant. Clinical characteristics, including etiology of kidney disease, comorbidities, duration of CKD and dialysis modality were collected from paper charts and electronic medical records.

Exposure variables

The exposure variables considered in the analysis includes age, gender, ethnicity, income, education, previous experience with computer technology, and self-reported health literacy. These variables were collected through socio-demographics, short literacy survey, and patient response questionnaires, and were selected for analysis based on both clinical experience and current literature.

Outcome variables

The three outcome variables were collected from the patient response questionnaire: 1) “Did you find the task of completing the questionnaires on the tablet computer acceptable” (yes/no); 2) “Did you need someone’s help to complete the questionnaire” (none – little/some - a lot); and 3) “Did you find the task of completing the questionnaires on the tablet computer too difficult or tiring” (yes/no).

Statistical analysis

All statistical analyses were performed using STATA 14.0 (StataCorp, College Station, TX). All results were described using appropriate descriptive statistics. Categorical variables were summarized using frequencies and percentages, while continuous variables were described using mean and standard deviation (SD).

Fischer’s exact test was employed to examine univariable associations between categorical exposure and outcome variables. Age was dichotomized using 70 years as cut-off. Self-reported income was used to describe socio-economic status, and categorized into low-middle (≤$70,000) and middle-high (>$70,000), based on the 2015 Ontario Income Tax Bracket. Education level was divided into low (none to high school diploma) and high (college degree or more). Multivariable associations between the exposure and outcome were explored using logistic regression models. Given the small number of patients who found the electronic data capture not acceptable or tiring, we used the “Penalized Maximum Likelihood Estimation” method proposed by Firth to reduce the consequent small-sample bias [52]. A two-sided P value of <0.05 was considered statistically significant in all analyses.

Results

We approached a convenience sample of 168 potentially eligible patients, of whom 121 consented to participate, with an overall response rate of 72% (Fig. 1). The demographic and clinical characteristics of the study participants were summarized in Table 2. Mean (±SD) age was 58 (±14) years, 55% were male, and 49% were Caucasian. The most common cause of end stage renal disease was hypertension (37%), followed by glomerulonephritis (31%), and diabetes mellitus (26%). Seven percent of the patients were in the pre-dialysis stage, 47% were undergoing maintenance hemodialysis, while 45% were transplant recipients. Seventy four percent of participants reported average or above average experience with computer technology, and only a small fraction of participants answered “uncomfortable” (12%) when it comes to comfort with tablet technology. The average time needed to complete one of the four questionnaire sets (Table 1) varied between 25 and 45 min.

Fig. 1
figure 1

Flow Diagram of Patient Recruitment from September 2015 to April 2016

Full size image
Table 2 Demographic and clinical characteristics of study sample
Full size table

Overall, the vast majority, 92% of participants found the task of completing the questionnaires on the tablet acceptable (Table 3). Lower levels of acceptance was observed among participants of older age (older vs. younger than 70 years; 75% vs. 95%; p = 0.011) and among the ones with little previous experience with computers (81% v. 96%; p = 0.050). In multivariable analysis, only previous computer experience (OR 6.19, 95% CI 1.06, 36.21) was significantly associated with acceptance of the electronic data capture systems (Table 6).

Table 3 Participant response on “Did you find the task of completing the questionnaires on the tablet computer acceptable”
Full size table

Overall, the majority of patients required none to very little help (79%) with the completion of questionnaires on electronic data capture system (Table 4). Greater level of assistance was more frequently required by patients who were older (45% vs. 15%; p = 0.009), had lower income (30% vs. 3%; p < 0.001), as well as lower levels of education (33% vs. 14%; p = 0.027). Moreover, patients with lower health literacy (Fig. 2) and less computer experience (Figure 3) also required more help with tablet use. In multivariable analysis, low health literacy (OR 8.65, 95% CI 1.77, 42.40) and low level of previous experience with computers (OR 5.17, 95% CI 1.34, 19.97), but not age, income, or education, were significantly associated with higher need for assistance (Table 6).

Table 4 Participant response on “Did you need someone’s help to complete the questionnaire”
Full size table
Fig. 2
figure 2

Association between health literacy and 1) finding the task of completing the questionnaires on tablet computer acceptable; 2) requiring help to complete the questionnaire; and 3) finding the task of completing questionnaires too difficult or tiring. Low health literacy was associated with needing more help with completion (p < 0.001) and finding the task too tiring or difficult (p = 0.019)

Full size image
Fig. 3
figure 3

Association between computer experience and 1) finding the task of completing the questionnaires on tablet computer acceptable; 2) requiring help to complete the questionnaire; and 3) finding the task of completing questionnaires too difficult or tiring. Low computer experience is associated with lower acceptance (p = 0.05), needing more help with completion (p < 0.001), and finding the task too tiring or difficult (p = 0.037)

Full size image

A great majority of patients (92%) indicated that they did not find the task of completing tablet questionnaires tiring (Table 5). Participants with low income (12% vs. 0%; p = 0.044), low health literacy (31% vs. 6%; p = 0.019) and low levels of computer experience (20% vs. 4%; p = 0.037) were more likely to find the task difficult or tiring. However, these univariable associations did not reach significance after adjustment in multivariable models (Table 6).

Table 5 Participant response on “Did you find the task of completing the questionnaires on the tablet computer too difficult or tiring”
Full size table
Table 6 Multivariable logistic regression model for tablet acceptance, help needed for questionnaire completion, and finding tablet questionnaires tiring
Full size table

Discussion

Our main finding is that the tablet computer-based electronic data capture system was acceptable for the overwhelming majority of the enrolled patients with CKD. Although a majority of the study sample responded to the tablets positively, it appears that patients who are older (>70 years) with low health literacy and little previous experience with computers required more assistance while completing the questionnaires on the computer tablet.

Our results are qualitatively similar to the findings reported by Schick-Makaroff et al. [47, 48] whose study demonstrated that the electronic capture was overall positively received and viewed by patients. Similarly, studies from Harrington et al. [53] suggested that tablet computer platform is a feasible solution for monitoring and optimizing care of patients undergoing continuous ambulatory peritoneal dialysis [53]. In another study, tablet technology was also acceptable for nutrition monitoring, to support diet and fluid intake self-management, and medication inquiry in patients with CKD [54].

Although patients included in this study have CKD, similarly to the above studies, the severity of the condition and the different treatment modalities constitute an important difference. Patients on maintenance, in centre hemodialysis treatment are usually older, have more comorbidities and may be less educated than kidney transplant recipients or patients who are treated with home dialysis. Our patient population is also different from oncology patients, as we have older patient population groups and those with lower education. The chronicity if CKD/ESKD is also an important difference between many groups of oncology patients and our patient population. With psychosocial distress being a very frequent, currently largely neglected factor determining overall well-being of the patients, effective and reliable routine measurement of PROMs has the potential of detecting distress among patients with CKD and providing appropriate, tailored support when needed.

In our manuscript we provided data about the acceptability of tablet based collection of PROMs in in-centre dialysis patients and in kidney transplant patients. In addition to the papers of Schick-Makaroff, we used multiple questionnaire batteries in a heterogeneous patient population and found high acceptance and completion rates. At our institution the electronic data capture platform we used has already been linked to the electronic patient record system, providing opportunities for future clinical implementation. In our future work we will design specific implementation studies to establish the platform used in this pilot study for clinical use.

When considering electronic data capture to systematically assess patient reported outcome measures for either research or for clinical use it is important that there seems to be equivalency between completing questionnaires on touch-screen electronic capture platforms and paper-and-pencil administrations, at least for several of the instruments studies [48, 53, 54].

The study is the first of its kind to investigate different patient populations with CKD, and also patients undergoing maintenance in center hemodialysis and kidney transplant recipients. In this pilot study we explored the use of multiple patient report instruments that assess various aspects of psychosocial characteristics of the patients. There was no meaningful difference in the acceptability of the various questionnaires in our study. Although the study was conducted in an academic teaching hospital, the patient population we encountered was diverse, both geographically and culturally.

An important first step in the routine incorporation of “ePROMs” in clinical practice is the establishment of the feasibility of tablet use among patients with CKD. Collection of ePROMs has the potential to increase physician patient communication [42, 44], integrate health-related quality of life (HRQOL) data into electronic patient records [41], screen for psychosocial distress and social difficulties [49], and promote the use of tailored educational materials specific to the needs of the patient at any given time [39, 42].

Several factors may have contributed to the high level of patient satisfaction. First of all, the research staff played an essential role in facilitating tablet use. Approximately one quarter of the participants reported none or very little computer experience, and required initial demonstration of the use of the tablet from the research staff. As tablet technologies become commonly used even by older people, we anticipate that patients will require less assistance given the greater familiarity with electronic devices. Second, in order to decrease respondent burden, the ePROM questionnaires were broken down into subsets with an average completion time of about 30 min. For many individuals with advanced medical illness, choosing select ePROM surveys tailored to the patient’s specific concerns could significantly reduce the response burden. Furthermore, utilizing electronic data capture platforms on handheld devices to assess PROMs will enable the use of computer adaptive testing algorithms, like the ones developed by patient-reported outcomes measurement information system (PROMIS), to increase measurement accuracy while decreasing patient response burden [55].

Our study has several limitations. This was a single centre study with convenience sampling and relatively few participants; this may limit generalizability of our results. Patients with language barrier, acute medical conditions or cognitive impairments were excluded from our study. Furthermore, participants with physical difficulties or visual impairments required assistance from the research staff in completing the questionnaires. With the diverse levels of disabilities, patients’ comfort towards technology will vary across different populations. If incorporated into routine clinical practice, appropriate support (from the clinical team or from trained volunteers) will be necessary to make this system feasible. In this pilot we did not use a control group to compare the acceptance of paper based versus electronic data collection. In fact, we wanted to assess if the electronic data capture platform is acceptable, feasible in the target patient population, in preparation for clinical implementation studies. Furthermore, we did not use qualitative methods to assess patient (or provider) attitudes and response to the tablet based electronic data capture system; we only wanted to focus on general acceptance of the system and difficulties with tablet use. We will include qualitative process evaluation methods in our future clinical implementation pilots of tablet based assessment of patient reported measures.

In addition, our sample size was small. Findings will need to be confirmed within a larger studies in the future. Finally, systematic assessment of patient PROMs in the clinical setting will necessitate an appropriate response system [49].

Results from this study suggested that the use of the tablet computer based electronic data capture system is acceptable for most patients and could be utilized to measure PROs among patients with CKD, both in hemodialysis and post-transplant clinics. Future studies will be needed to assess the larger scale, systematic use of such systems in routine clinical practice. In addition, individualized support and personal guidance should be emphasized among elderly patients and those with a visual or physical disability to assist with their functionality in using the tablet computer device. This practical and feasible approach could greatly enhance standard symptom monitoring and symptom management (including self-management) to improve quality of life and other clinical outcomes of patients as well as provide data for research and quality improvement to enhance care in any patient populations.

Conclusion

Tablet-based electronic data capture system was an acceptable and feasible means of assessing PROMs among patients with chronic kidney disease. Patients who were elderly, or had little computer experience expressed lower acceptability for tablet-based technologies, and special consideration should be given in these populations.

Abbreviations

CI:

Confidence interval

CKD:

Chronic kidney disease

CPC:

Canadian problem checklist

DART:

Distress assessment and response tool

DDKT:

Deceased donor kidney transplantation

ECR:

Experience in close relationship

ESAS:

Edmonton symptom assessment system

GAD:

Generalized anxiety disorder

GFR:

Glomerular filtration rate

IIRS:

Illness intrusiveness rating scale

KDQoL-SF:

Kidney disease quality of life – short form

LDKT:

Living donor kidney transplantation

MOS:

Medical Outcomes Study

OR:

Odds ratio

PHQ:

Patient health questionnaire

PROM:

Patient reported outcome measure

PROMIS:

Patient-reported outcomes measurement information system

PRQ:

Patient response questionnaire

RQ:

Relationship questionnaire

SDI:

Social difficulties inventory

SLS:

Short literacy survey

TDMS:

Transplant decision making survey

References

  1. Devins GM. Using the illness intrusiveness ratings scale to understand health-related quality of life in chronic disease. J Psychosom Res. 2010;68(6):591–602.

    Article  PubMed  Google Scholar 

  2. Cukor D, Coplan J, Brown C, Friedman S, Cromwell-Smith A, Peterson RA, Kimmel PL. Depression and anxiety in urban hemodialysis patients. Clin J Am Soc Nephrol. 2007;2(3):484–90.

    Article  PubMed  Google Scholar 

  3. Cukor D, Coplan J, Brown C, Peterson RA, Kimmel PL. Course of depression and anxiety diagnosis in patients treated with hemodialysis: a 16-month follow-up. Clin J Am Soc Nephrol. 2008;3(6):1752–8.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Hedayati SS, Bosworth HB, Kuchibhatla M, Kimmel PL, Szczech LA. The predictive value of self-report scales compared with physician diagnosis of depression in hemodialysis patients. Kidney Int. 2006;69(9):1662–8.

    Article  CAS  PubMed  Google Scholar 

  5. Young BA, Von Korff M, Heckbert SR, Ludman EJ, Rutter C, Lin EHB, Ciechanowski PS, Oliver M, Williams L, Himmelfarb J. Association of major depression and mortality in stage 5 diabetic chronic kidney disease. Gen Hosp Psychiatry. 2010;32(2):119–24.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Palmer SC, Vecchio M, Craig JC, Tonelli M, Johnson DW, Nicolucci A, Pellegrini F, Saglimbene V, Logroscino G, Hedayati SS. Association between depression and death in people with CKD: a meta-analysis of cohort studies. Am J Kidney Dis. 2013;62(3):493–505.

    Article  PubMed  Google Scholar 

  7. Kimmel PL, Cukor D, Cohen SD, Peterson RA. Depression in end-stage renal disease patients: a critical review. Adv Chronic Kidney Dis. 2007;14(4):328–34.

    Article  PubMed  Google Scholar 

  8. Novak M, Molnar MZ, Szeifert L, Kovacs AZ, Vamos EP, Zoller R, Keszei A, Mucsi I. Depressive symptoms and mortality in patients after kidney transplantation: a prospective prevalent cohort study. Psychosom Med. 2010;72(6):527–34.

    Article  PubMed  Google Scholar 

  9. Zalai D, Szeifert L, Novak M: Psychological distress and depression in patients with chronic kidney disease. In: 2012: Wiley Online Library: 428–438.

  10. Novak M, Mucsi I, Mendelssohn DC. Screening for depression: only one piece of the puzzle. Nephrol Dial Transplant. 2013;28(6):1336–40.

    Article  CAS  PubMed  Google Scholar 

  11. Hedayati SS, Yalamanchili V, Finkelstein FO. A practical approach to the treatment of depression in patients with chronic kidney disease and end-stage renal disease. Kidney Int. 2012;81(3):247–55.

    Article  PubMed  Google Scholar 

  12. Snyder CF, Aaronson NK. Use of patient-reported outcomes in clinical practice. Lancet. 2009;374(9687):369–70.

    Article  PubMed  Google Scholar 

  13. Eton DT, Fairclough DL, Cella D, Yount SE, Bonomi P, Johnson DH, Eastern Cooperative Oncology G. Early change in patient-reported health during lung cancer chemotherapy predicts clinical outcomes beyond those predicted by baseline report: results from eastern cooperative oncology group study 5592. J Clin Oncol. 2003;21(8):1536–43.

    Article  PubMed  Google Scholar 

  14. Gotay CC, Kawamoto CT, Bottomley A, Efficace F. The prognostic significance of patient-reported outcomes in cancer clinical trials. J Clin Oncol. 2008;26(8):1355–63.

    Article  PubMed  Google Scholar 

  15. Molnar-Varga M, Molnar MZ, Szeifert L, Kovacs AZ, Kelemen A, Becze A, Laszlo G, Szentkiralyi A, Czira ME, Mucsi I et al. Health-Related Quality of Life and Clinical Outcomes in Kidney Transplant Recipients. Am J Kidney Dis. 2011;58(3):444-52.

  16. Bagha SM, Macedo A, Jacks LM, Lo C, Zimmermann C, Rodin G, Li M. The utility of the Edmonton symptom assessment system in screening for anxiety and depression. Eur J Cancer Care. 2013;22(1):60–9.

    Article  CAS  Google Scholar 

  17. Watanabe SM, Nekolaichuk C, Beaumont C, Johnson L, Myers J, Strasser F. A multicenter study comparing two numerical versions of the Edmonton symptom assessment system in palliative care patients. J Pain Symptom Manag. 2011;41(2):456–68.

    Article  Google Scholar 

  18. Devins GM, Mandin H, Hons RB, Burgess ED, Klassen J, Taub K, Schorr S, Letourneau PK, Buckle S. Illness intrusiveness and quality of life in end-stage renal disease: comparison and stability across treatment modalities. Health Psychol. 1990;9(2):117–42.

    Article  CAS  PubMed  Google Scholar 

  19. Devins GM. Illness intrusiveness and the psychosocial impact of lifestyle disruptions in chronic life-threatening disease. Adv Ren Replace Ther. 1994;1(3):251–63.

    Article  CAS  PubMed  Google Scholar 

  20. Devins GM, Edworthy SM, Paul LC, Mandin H, Seland TP, Klein G, Costello CG, Shapiro CM. Restless sleep, illness intrusiveness, and depressive symptoms in three chronic illness conditions: rheumatoid arthritis, end-stage renal disease, and multiple sclerosis. J Psychosom Res. 1993;37(2):163–70.

    Article  CAS  PubMed  Google Scholar 

  21. Novak M, Mah K, Molnar MZ, Ambrus C, Csepanyi G, Kovacs A, Vamos E, Zambo M, Zoller R, Mucsi I, et al. Factor structure and reliability of the Hungarian version of the illness intrusiveness ratings scale invariance across north American and Hungarian dialysis patients. J Psychosom Res. 2005;58(1):103–10.

    Article  PubMed  Google Scholar 

  22. Hall KL, Robbins ML, Paiva A, Knott JE, Harris L, Mattice B. Donation intentions among African American college students: decisional balance and self-efficacy measures. J Behav Med. 2007;30(6):483–95.

    Article  PubMed  Google Scholar 

  23. Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol. 1983;51:390.

    Article  CAS  PubMed  Google Scholar 

  24. Waterman AD, Rodrigue JR, Purnell TS, Ladin K, Boulware LE. Addressing racial and ethnic disparities in live donor kidney transplantation: priorities for research and intervention. Semin Nephrol. 2010;30(1):90–8.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Waterman AD, Dew MA, Davis CL, McCabe M, Wainright JL, Forland CL, Bolton L, Cooper M. Living-donor follow-up attitudes and practices in U.S. kidney and liver donor programs. Transplantation. 2013;95(6):883–8.

    Article  PubMed  Google Scholar 

  26. Wright EP, Kiely M, Johnston C, Smith AB, Cull A, Selby PJ. Development and evaluation of an instrument to assess social difficulties in routine oncology practice. Qual Life Res. 2005;14(2):373–86.

    Article  CAS  PubMed  Google Scholar 

  27. Wei M, Russell DW, Mallinckrodt B, Vogel DL. The experiences in close relationship scale (ECR)-short form: reliability, validity, and factor structure. J Pers Assess. 2007;88(2):187–204.

    Article  PubMed  Google Scholar 

  28. Haggerty G, Hilsenroth MJ, Vala-Stewart R. Attachment and interpersonal distress: examining the relationship between attachment styles and interpersonal problems in a clinical population. Clin. Psychol. Psychother. 2009;16(1):1–9.

    Article  PubMed  Google Scholar 

  29. Ravitz P, Maunder R, Hunter J, Sthankiya B, Lancee W. Adult attachment measures: a 25-year review. J Psychosom Res. 2010;69(4):419–32.

    Article  PubMed  Google Scholar 

  30. Bartholomew K, Horowitz LM. Attachment styles among young adults: a test of a four-category model. J Pers Soc Psychol. 1991;61(2):226–44.

    Article  CAS  PubMed  Google Scholar 

  31. Fowler JC, Groat M, Ulanday M. Attachment style and treatment completion among psychiatric inpatients with substance use disorders. Am J Addict. 2013;22(1):14–7.

    Article  PubMed  Google Scholar 

  32. Sherbourne CD, Stewart AL: Medical Outcomes Study Social Support Survey. In.; 1991.

  33. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. Spitzer RL, Williams JB, Kroenke K, Hornyak R, McMurray J. Validity and utility of the PRIME-MD patient health questionnaire in assessment of 3000 obstetric-gynecologic patients: the PRIME-MD patient health questionnaire obstetrics-gynecology study. Am J Obstet Gynecol. 2000;183(3):759–69.

    Article  CAS  PubMed  Google Scholar 

  35. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–7.

    Article  PubMed  Google Scholar 

  36. Mapes DL, Bragg-Gresham JL, Bommer J, Fukuhara S, McKevitt P, Wikström B, Lopes AA. Health-related quality of life in the dialysis outcomes and practice patterns study (DOPPS). Am. J. Kidney Dis. 2004;44(5 Suppl 2):54–60.

    Article  PubMed  Google Scholar 

  37. Gorodetskaya I, Zenios S, McCulloch CE, Bostrom A, Hsu C-Y, Bindman AB, Go AS, Chertow GM. Health-related quality of life and estimates of utility in chronic kidney disease. Kidney Int. 2005;68(6):2801–8.

    Article  PubMed  Google Scholar 

  38. Kalantar-Zadeh K, Unruh M. Health related quality of life in patients with chronic kidney disease. Int Urol Nephrol. 2005;37(2):367–78.

    Article  PubMed  Google Scholar 

  39. Abernethy AP, Ahmad A, Zafar SY, Wheeler JL, Reese JB, Lyerly HK. Electronic patient-reported data capture as a foundation of rapid learning cancer care. Med Care. 2010;48(6 Suppl):S32–8.

    Article  PubMed  Google Scholar 

  40. Chang Y-J, Chang C-H, Peng C-L, Wu H-C, Lin H-C, Wang J-Y, Li T-C, Yeh Y-C, Liang W-M. Measurement equivalence and feasibility of the EORTC QLQ-PR25: paper-and-pencil versus touch-screen administration. Health Qual Life Outcomes. 2014;12:23.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Holzner B, Giesinger JM, Pinggera J, Zugal S, Schöpf F, Oberguggenberger AS, Gamper EM, Zabernigg A, Weber B, Rumpold G. The computer-based health evaluation software (CHES): a software for electronic patient-reported outcome monitoring. BMC Med. Inform. Decis. Mak. 2012;12:126.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Bennett AV, Jensen RE, Basch E. Electronic patient-reported outcome systems in oncology clinical practice. CA Cancer J Clin. 2012;62(5):337–47.

    Article  PubMed  Google Scholar 

  43. Snyder CF, Aaronson NK, Choucair AK, Elliott TE, Greenhalgh J, Halyard MY, Hess R, Miller DM, Reeve BB, Santana M. Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations. Qual Life Res. 2012;21(8):1305–14.

    Article  PubMed  Google Scholar 

  44. Smith SK, Rowe K, Abernethy AP. Use of an electronic patient-reported outcome measurement system to improve distress management in oncology. Palliat Support Care. 2014;12(01):69–73.

    Article  PubMed  Google Scholar 

  45. Dupont A, Wheeler J, Herndon JE, Coan A, Zafar SY, Hood L, Patwardhan M, Shaw HS, Lyerly HK, Abernethy AP. Use of tablet personal computers for sensitive patient-reported information. J Support Oncol. 2009;7(3):91–7.

    PubMed  Google Scholar 

  46. Espallargues M, Valderas JM, Alonso J. Provision of feedback on perceived health status to health care professionals: a systematic review of its impact. Med Care. 2000;38(2):175–86.

    Article  CAS  PubMed  Google Scholar 

  47. Schick-Makaroff K, Molzahn A. Brief communication: patient satisfaction with the use of tablet computers: a pilot study in two outpatient home dialysis clinics. Can. J. Kidney Health Dis. 2014;1(1):22.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Schick-Makaroff K, Molzahn A. Strategies to use tablet computers for collection of electronic patient-reported outcomes. Health Qual Life Outcomes. 2015;13:2.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Li M, Macedo A, Crawford S, Bagha S, Leung YW, Zimmermann C, Fitzgerald B, Wyatt M, Stuart-McEwan T, Rodin G. Easier said than done: keys to successful implementation of the distress assessment and response tool (DART) program. J. Oncol. Pract. 2016;12(5):e513–26.

    Article  PubMed  Google Scholar 

  50. Ashbury FD, Findlay H, Reynolds B, McKerracher K. A Canadian survey of cancer patients’ experiences. J Pain Symptom Manag. 1998;16(5):298–306.

    Article  CAS  Google Scholar 

  51. Dageforde LA, Petersen AW, Feurer ID, Cavanaugh KL, Harms KA, Ehrenfeld JM, Moore DE. Health literacy of living kidney donors and kidney transplant recipients. Transplantation. 2014;98(1):88.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Firth D. Bias reduction of maximum likelihood estimates. Biometrika. 1993;80:27–38.

    Article  Google Scholar 

  53. Harrington DM, Myers L, Eisenman K, Bhise V, Nayak KS, Rosner MH. The use of a tablet computer platform to optimize the care of patients receiving peritoneal dialysis: a pilot study. Blood Purif. 2014;37(4):311–5.

    Article  PubMed  Google Scholar 

  54. Dowell SA, Welch JL. Use of electronic self-monitoring for food and fluid intake: a pilot study. Nephrol Nurs J. 2006;33(3):271–7.

    PubMed  Google Scholar 

  55. Cella D, Riley W, Stone A, Rothrock N, Reeve B, Yount S, Amtmann D, Bode R, Buysse D, Choi S, et al. The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63(11):1179–94.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the patients and the staff in the participating units of the University Health Network for their help with this study.

Funding

Start-up grant to I.M. from the Department of Medicine and Multi-Organ Transplant Program, University Health Network (Toronto, ON).

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Author information

Author notes

    Authors and Affiliations

    1. Division of Nephrology, Multi-Organ Transplant Program, University Health Network and University of Toronto, Toronto, Canada

      Dorothy Wong, Shen Cao, Heather Ford, Candice Richardson, Dmitri Belenko, Evan Tang, Luca Ugenti, Eleanor Warsmann, Amanda Sissons, Yalinie Kulandaivelu, Nathaniel Edwards & Istvan Mucsi

    2. Centre for Mental Health, University Health Network and Department of Psychiatry, University of Toronto, Toronto, Canada

      Marta Novak

    3. Department of Supportive Care, Princess Margaret Hospital, Toronto, ON, Canada

      Madeline Li

    4. Multi-Organ Transplant Program, Toronto General Hospital, University Health Network, 585 University Avenue, 11-PMB-188, Toronto, ON, M5G 2N2, Canada

      Istvan Mucsi

    Authors
    1. Dorothy Wong
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Shen Cao
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Heather Ford
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Candice Richardson
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Dmitri Belenko
      View author publications

      You can also search for this author in PubMed Google Scholar

    6. Evan Tang
      View author publications

      You can also search for this author in PubMed Google Scholar

    7. Luca Ugenti
      View author publications

      You can also search for this author in PubMed Google Scholar

    8. Eleanor Warsmann
      View author publications

      You can also search for this author in PubMed Google Scholar

    9. Amanda Sissons
      View author publications

      You can also search for this author in PubMed Google Scholar

    10. Yalinie Kulandaivelu
      View author publications

      You can also search for this author in PubMed Google Scholar

    11. Nathaniel Edwards
      View author publications

      You can also search for this author in PubMed Google Scholar

    12. Marta Novak
      View author publications

      You can also search for this author in PubMed Google Scholar

    13. Madeline Li
      View author publications

      You can also search for this author in PubMed Google Scholar

    14. Istvan Mucsi
      View author publications

      You can also search for this author in PubMed Google Scholar

    Contributions

    Research idea and study design: IM, DW, HF, MN, ML; data acquisition: DW, HF, SC, CR, DB, ET, LU, EW, AS, YK; data analysis/interpretation: SC, DW, ET, NE; statistical analysis: SC, DW, IM; supervision and mentorship: IM. All authors read and approved the final manuscript.

    Corresponding author

    Correspondence to Istvan Mucsi.

    Ethics declarations

    Ethics approval and consent to participate

    All research activity was performed in adherence to the principles of the Declaration of Helsinki and the Tri-Council Policy Statement on Ethical Conduct for Research Involving Humans. Approval from the University Health Network Research Ethics Board was obtained prior to study initiation (Study ID: 15–8773-AE). Informed written consent was obtained from all study participants who agreed to enroll in the research study.

    Consent for publication

    Not applicable.

    Competing interests

    The authors declare that they have no competing interests.

    Publisher’s Note

    Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

    Additional file

    Additional file 1:

    Patient response questionnaire (DOCX 18 kb)

    Rights and permissions

    Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

    Reprints and permissions

    About this article

    Check for updates. Verify currency and authenticity via CrossMark

    Cite this article

    Wong, D., Cao, S., Ford, H. et al. Exploring the use of tablet computer-based electronic data capture system to assess patient reported measures among patients with chronic kidney disease: a pilot study. BMC Nephrol 18, 356 (2017). https://doi.org/10.1186/s12882-017-0771-7

    Download citation

    • Received:

    • Accepted:

    • Published:

    • DOI: https://doi.org/10.1186/s12882-017-0771-7

    Keywords

    BMC Nephrology

    ISSN: 1471-2369

    Contact us