Skip to main content
Download PDF

Predicting the survival of kidney transplantation: design and evaluation of a smartphone-based application

BMC Nephrology volume 23, Article number: 219 (2022) Cite this article

Abstract

Background

Prediction of graft survival for Kidney Transplantation (KT) is considered a risky task due to the scarcity of donating organs and the use of health care resources. The present study aimed to design and evaluate a smartphone-based application to predict the survival of KT in patients with End-Stage Renal Disease (ESRD).

Method

Based on the initial review, a researcher-made questionnaire was developed to assess the information needs of the application through urologists and nephrologists. By using information obtained from the questionnaire, a checklist was prepared, and the information of 513 patients with kidney failure was collected from their records at Sina Urological Research Center. Then, three data mining algorithms were applied to them. The smartphone-based application for the prediction of kidney transplant survival was designed, and a standard usability assessment questionnaire was used to evaluate the designed application.

Results

Three information elements related to the required data in different sections of demographic information, sixteen information elements related to patient clinical information, and four critical capabilities were determined for the design of the smartphone-based application. C5.0 algorithm with the highest accuracy (87.21%) was modeled as the application inference engine. The application was developed based on the PhoneGap framework. According to the participants’ scores (urologists and nephrologists) regarding the usability evaluation of the application, it can be concluded that both groups participating in the study could use the program, and they rated the application at a "good" level.

Conclusion

Since the overall performance or usability of the smartphone-based app was evaluated at a reasonable level, it can be used with certainty to predict kidney transplant survival.

Peer Review reports

Background

Chronic Kidney Disease (CKD) is a gradual loss of kidney function that can occur due to diabetes, high blood pressure, recurrent infections, and urinary tract obstruction [1]. Unlike acute renal failure, which progresses rapidly and is potentially reversible, CKD is a long-term disease in which kidney damage is permanent and progressive [2]. Based on the 2010 Global Burden of Disease (GBD) investigation, CKD was ranked 27th in the list of the causes of deaths worldwide in 1990, but it was ascended to rank 18th in 2010 report [3]. This disease can progress to ESRD, which is fatal without dialysis or KT [4].

Nowadays, KT is the most effective treatment for advanced and irreversible renal failure [5]. According to the investigation done on the WHO data (2008) in 104 countries accounting for 90% of all transplantations across the world, about 100,800 organ transplants have been performed in these countries, and there have been 69,400 cases of KT (over 68% of all transplants in the world, from which 46% have been carried out with the live donors), [6]. This procedure is remarkably cost-effective and imposes fewer complications on patients compared to dialysis [7]. Kidney graft rejection has many consequences, such as re-transplantation or even death [8]. The problem of graft rejection is mainly attributed to chronic allograft rejection associated with dysfunctional donor-recipient matching [9]. Based on the literature, kidney graft survival prediction is essential for the transplant success, since it both increases the effective use of healthcare system's resources and the utility of available organs [9,10,11].

The increasing use of new data mining techniques, especially to discover unique patterns, has become widespread in the medical industry [12, 13]. These methods could be applied as adjunct tools to predict survival of graft transplantation [14]. Along with the use of data-based algorithms, Information Communication Technology (ICT) has revolutionized the e-health industry. Among the various ICT tools, wireless and smartphone-based technologies offer opportunities to reduce costs and raise access to health services, which improve the effectiveness of healthcare delivery process [15]. Thus, the integration of wireless technologies, data mining and machine learning approaches leads to effective delivery of care and provision of unique diagnostic services to individuals [16].

Previous studies have established several effective prediction data-driven models to identify kidney post-transplantation graft survival rates [9, 10, 17]. Our previous study dealt with data and modeling to predict post-transplantation graft survival among kidney transplant recipients using data mining algorithms [18]. In the present study, C5.0 algorithm with the highest accuracy (96.77%) was the chosen model for predicting patients' kidney transplant survival. In this way, the output of these results can be monitored through a smartphone or a tablet application that is easily accessible. Appropriate medical decisions can also be made based on these results. Thus, the main purpose of this study was to design and evaluate a smartphone-based application to predict the survival of KT for specialists and patients. To evaluate the application's usability, we used a standard questionnaire. In the implementation phase, the beneficiaries of this application included urologists, nephrologists, and kidney transplant patients. The primary use of the smartphone-based application is to help professionals predict the survival of KT. Also, there are facilities in this software through which, patients can use the existing reminders for appointments and set the new version of the reminders for suppressive drugs and post-transplant care instructions.

Implementation

This is an applied-developmental study that was conducted by Tehran University of Medical Sciences. This study was conducted in three main phases:

First phase of the study

The initial parameters in predicting post-transplantation graft survival among kidney transplant recipients were determined by reviewing specialized textbooks and consulting with supervisors and a clinical consultant. Based on the initial review, a researcher-made questionnaire was developed to assess the information needs of the application through urologists and nephrologists. This questionnaire was distributed among specialists (three urologists and four nephrologists) working at Sina Hospital. Participants were asked about data items and the capabilities required by an application to predict kidney transplant survival. The convenience sampling method was used to select the research sample. Each of the required data items was considered essential if an average of 50% of the respondents recognized it as necessary, which was then used in the application design. The reliability of the questionnaire was measured by test–retest method so that, after a short time, the questionnaire was given to the same people to be completed by them again. The scores obtained from the two tests were examined and the correlation coefficient of 92% was obtained. The questionnaire helped to prepare a checklist by which, further extraction of information was performed. Using this checklist, the medical records of 513 kidney transplant patients at Sina Urological Research Center were reviewed and main features were identified.

Second phase of the study

After collecting the input data items related to each patient by checklists, and also modifying the data to reduce the modeling error, useful features were extracted to predict the survival of KT. The predictive models such as C5.0, C&R, and neural network algorithms were used. The details and results of training and testing processes have been provided in our previous study [19]. In order to design and implement a multi-level smartphone application for predicting the survival of KT, the PhoneGap framework was used, which was responsible for communicating with the hardware and smartphone operating system. After installing the PhoneGap framework, Android and iOS platforms were run on it. The coding of programs’ display was done by Hypertext Markup Language (HTML) and Cascading Style Sheets (CSS), which included the formatting and components of the application’s pages. Also, JavaScript and its more advanced codes, such as jQuery, were employed.

Third phase of the study

In the last phase, a standard questionnaire was used to evaluate the usability of the final version of the application [20]. The chosen standard questionnaire was the Questionnaire for User Interface Satisfaction (QUIS), which elicits users’ opinions and evaluates users’ acceptance of the application interface. Validity of the questionnaire was confirmed by face validity and also taking into account the opinions of five specialists, thus its reliability was reported at ɑ = 0.94. Figure 1 shows different phases of the study separately.

Fig. 1
figure 1

Phases of the study at a glance (the figure is illustrated by the authors)

Full size image

Results

Information elements, main features and models’ performance

The frequency distribution of responses from urologists and nephrologists regarding the required data elements (in the researcher-made questionnaire) are presented in supplement Table S1. Based on the results of the questionnaire, a checklist was created by which data were extracted from the records of patients (513 cases). We reached the compelling features that were utilized to predict the survival of KT, which are presented in Table 1.

Table 1 Features used for predicting kidney transplant survival in applied algorithms
Full size table

The three predictive data mining models of C5.0 Decision Tree, neural network, and C&R Tree were analyzed and modeled, using IBM SPSS Modeler 14.2. Data of the database were randomly divided into two parts; 70% (360 cases) for training and 30% (153 cases) for testing. Details of the training/testing results of the algorithms have been given in the previous study [18].

In summary, the accuracy of C&R Tree and neural network models for the training dataset were estimated at 83.7% and 79.5%, respectively. Also, the accuracy of survival rate reached to 96.77% by C5.0. Additionally, the performance metrics of the predictive models for testing dataset, sensitivity, specificity, and accuracy are provided in the supplement Table S2. The highest accuracy rate belonged to the C5.0 model (87.21%).

Designing the application

The PhoneGap framework was used to design a multi-level smartphone application for predicting kidney transplant survival. In this section, the rules of C5.0 model algorithm, which has the highest accuracy among other models in evaluating data mining models, were used for coding. This application has various sections. Some of these sections are presented below:

The main pages of the application are depicted in supplement Figs. 1 and 2.

Fig. 2
figure 2

Prediction of kidney transplant survival using C5.0 algorithm (the figure is illustrated by the authors)

Full size image

The third button shows the main goal of the research, which is used to predict kidney transplant survival, and its target users are the specialists (Fig. 2). The prediction result is numerically shown to the specialist, which is between 1 and 7 years.

Usability evaluation of the application

We used QUIS for evaluating the usability of the application. Figure 3 shows the average responses of the participants (urologists and nephrologists) regarding the usability evaluation of designed application.

Fig. 3
figure 3

Average responses of the participants in regard to usability evaluation of the application

Full size image

As seen in the figure above, considering the mean scores obtained for the overall performance, terminology and information used in the app, screen capabilities, and general functionality, which are in the category of 6–9, it can be concluded that both groups participating in the study were able to use the program, and they rated the application at a "good" level.

Discussion

To create an application for predicting kidney transplant survival, information needs and vital capabilities of the application were extracted. Regarding patients' personal information, only three items of full name, address, and telephone number were included in the checklists to contact patients and inform them about the survival rate of KT if needed. On the other hand, results of the questionnaire completed by the nephrologists and urologists showed that in terms of the patient clinical information, the most important parameters influencing the survival of kidney transplant included; cause of kidney failure, body mass index, type of dialysis, age of the kidney recipient, height of the kidney recipient, weight of the kidney recipient, gender of the kidney recipient, duration of preoperative dialysis, panel test, history of transplantation, previous diseases such as kidney stones, the relationship between donor and recipient, and gender and age of the kidney donor.

In a study to predict the survival of KT, patients' blood samples were used and 18 laboratory variables were analyzed among 108 patients with end-stage renal disease [21]. Also, to predict chronic allograft kidney disease, 23 laboratory variables in the blood and urine of 80 transplant patients were analyzed six months after the transplantation [22]. However, clinical-laboratory items were deleted in our study and were not used in our study after consulting with a clinical consultant.

In the present study, after creating an application to predict the survival of KT, the usability test and assessment of user satisfaction were performed. The usability evaluation in this study was carried out by the standard Chin test [23]. In line with our study, in some studies, the users were asked to indicate the capabilities needed in the smartphone application to predict transplant survival, and their ideas were applied in the design of the application [2, 24,25,26].

In a study entitled: “The decision tree in the follow-up of kidney transplantation”, the survival or rejection of a kidney transplantation was predicted using binary tree at four levels, and also the sensitivity and data of the Greco tree questionnaire were estimated to be 88.2% and 73.8%, respectively [11]. However, in the present study, a graft survival prediction model was developed using division and regression tree or C&R, and a weight was given to each of the input factors. Thus, with the production of 20 C&R trees and the combination of connections between these models, the optimal model with an accuracy of 83.7% was estimated.

In our research, to evaluate the application, seven people were surveyed and the mean scores obtained by them indicated that they evaluated the program at a "good" level. In general, it can be said that there are standard questionnaires and different methods for assessing the usability of applications [27], which are used depending on the type of research and the opinion of researcher [25]. A mHealth program was designed to help the early detection of CKD and self-monitoring according to quality characteristics, such as safety, efficacy, and usability. KaPA value of 0.7119 showed a high agreement between the program and the three neurologists, and also the level of usability of the program was evaluated at a good level [26].

One of the strengths of this study is the surveying of specialists in the first phase of the study to identify the information elements/features and capabilities of the application. This can increase the generalization of our work. This app can help urologists and nephrologists, because its main use is to help professionals predict transplant survival. On the other hand, there are other features in this application through which patients can utilize the reminders for clinical appointments and also receive a newer version of the reminder, suppressive drugs prescription, and post-transplant care instructions.

One of the limitations of this study is that, the application was designed based on data obtained from only one hospital. It is suggested to use the data of other research centers in future studies and compare the results. On the other hand, the geographical area in which the research institute is located is significantly important, because factors such as level of well-being, social class, and employment of the donor and recipient of the kidney can affect the survival of KT. However, such factors were not considered in this study, as such information was not available. In this study, one of the most important limitations is that due to the time and budget constrain, we could not evaluate the patients’ perspective in the usability evaluation phase, and only entered the specialists’ perspective in the evaluation phase. The usability evaluation of the designed application by patients is suggested in future studies.

Conclusion

In this study, information items and software capabilities were identified, and the application was designed to predict post-transplantation graft survival among kidney transplant recipients. The main parts of the application included post-transplant care, reminder, survival prediction, about us, setting, and log out. The button of “survival prediction” is used to predict kidney transplant survival, and its target users are the specialists. Based on the average scores obtained for the overall performance, terminology and information used in the app, screen capabilities, and general functionality, the app was rated by the participants at a "good" level.

Availability of data and materials

The dataset used and analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ESRD:

End-Stage Renal Disease

CKD:

Chronic Kidney Disease

KT:

Kidney Transplantation

HTML:

Hypertext Markup Language

CSS:

Cascading Style Sheets

ICT:

Information Communication Technology

QUIS:

Questionnaire for User Interface Satisfaction

C&R:

Classification and Regression

ENT:

Ears, Nose and Throat

K.U.B:

Kidney, Ureter, and Bladder

VCUG:

Voiding Cystourethrogram

BMI:

Body Mass Index

GI:

Glycemic Index

References

  1. El Nahas AM, Bello AK. Chronic kidney disease: the global challenge. The lancet. 2005;365(9456):331–40.

    Article  Google Scholar 

  2. Lucas GM, Lau B, Atta MG, Fine DM, Keruly J, Moore RD. Chronic kidney disease incidence, and progression to end-stage renal disease, in HIV-infected individuals: a tale of two races. J Infect Dis. 2008;197(11):1548–57.

    Article  Google Scholar 

  3. Cheng H-T, Xu X, Lim PS, Hung K-Y. Worldwide epidemiology of diabetes-related end-stage renal disease, 2000–2015. Diabetes Care. 2021;44(1):89–97.

    Article  Google Scholar 

  4. Parikh NI, Hwang S-J, Larson MG, Levy D, Fox CS. Chronic kidney disease as a predictor of cardiovascular disease (from the Framingham Heart Study). Am J Cardiol. 2008;102(1):47–53.

    Article  Google Scholar 

  5. Danovitch GM, editor. Handbook of kidney transplantation. Lippincott Williams & Wilkins; 2009.

  6. Chan CT, Blankestijn PJ, Dember LM, Gallieni M, Harris DC, Lok CE, et al. Dialysis initiation, modality choice, access, and prescription: conclusions from a Kidney Disease: Improving Global Outcomes (KDIGO) Controversies Conference. Kidney Int. 2019;96(1):37–47.

    Article  Google Scholar 

  7. Montgomery JR, Berger JC, Warren DS, James N, Montgomery RA, Segev DL. Outcomes of ABO-incompatible kidney transplantation in the United States. Transplantation. 2012;93(6):603.

    CAS  Article  Google Scholar 

  8. Gander JC, Zhang X, Ross K, Wilk AS, McPherson L, Browne T, et al. Association between dialysis facility ownership and access to kidney transplantation. JAMA. 2019;322(10):957–73.

    Article  Google Scholar 

  9. Topuz K, Zengul FD, Dag A, Almehmi A, Yildirim MB. Predicting graft survival among kidney transplant recipients: A Bayesian decision support model. Decis Support Syst. 2018;106:97–109.

    Article  Google Scholar 

  10. Badrouchi S, Ahmed A, Bacha MM, Abderrahim E, Abdallah TB. A machine learning framework for predicting long-term graft survival after kidney transplantation. Expert Syst Appl. 2021;182: 115235.

    Article  Google Scholar 

  11. Greco R, Papalia T, Lofaro D, Maestripieri S, Mancuso D, Bonofiglio R, editors. Decisional trees in renal transplant follow-up. Transplantation proceedings; 2010: Elsevier.

  12. Zhang J, Williams SO, Wang H. Intelligent computing system based on pattern recognition and data mining algorithms. Sustain Comput-Infor. 2018;20:192–202.

    Google Scholar 

  13. Shahmoradi L, Farzanehnejad AR. Guideline-based clinical decision support systems as an inseparable tool for better cancer care management. Iran J Public Health. 2016;45(7):962.

    PubMed  PubMed Central  Google Scholar 

  14. Hosseini MM, Safdari R, Shahmoradi L, Javaherzadeh M. Better diagnosis of acute appendicitis by using artificial intelligence. ISMJ. 2017;20(4):339–48.

    Google Scholar 

  15. Martínez-Abad F, Gamazo A, Rodríguez-Conde MJ. Big data in education: detection of ICT factors associated with school effectiveness with data mining techniques. Proceedings of the sixth international conference on technological ecosystems for enhancing multiculturality. 2018.

    Book  Google Scholar 

  16. Diamantidis CJ, Becker S. Health information technology (IT) to improve the care of patients with chronic kidney disease (CKD). BMC Nephrol. 2014;15(1):1–6.

    Article  Google Scholar 

  17. Solomon SR, Aubrey MT, Zhang X, Jackson KC, Morris LE, Holland HK, et al. Class II HLA mismatch improves outcomes following haploidentical transplantation with posttransplant cyclophosphamide. Blood Adv. 2020;4(20):5311–21.

    CAS  Article  Google Scholar 

  18. Shahmoradi L, Langarizadeh M, Pourmand G. Comparing three data mining methods to predict kidney transplant survival. Acta Informatica Medica. 2016;24(5):322.

    Article  Google Scholar 

  19. Shahmoradi L, Langarizadeh M, Pourmand G, Fard ZA, Borhani A. Comparing three data mining methods to predict kidney transplant survival. Acta Inform Med. 2016;24(5):322–7.

    Article  Google Scholar 

  20. Alexandru CA. Usability testing and improvement of telemedicine websites. Edinburgh: M Sc diss University of Edinburgh; 2010.

    Google Scholar 

  21. Papaioannou A, Karamanis G, Rigas I, Spanos T, Roupa Z. Determination and modelling of clinical laboratory data of healthy individuals and patients with end-stage renal failure. Cent Euro J Med. 2009;4(1):37.

    Google Scholar 

  22. Lofaro D, Maestripieri S, Greco R, Papalia T, Mancuso D, Conforti D, et al., editors. Prediction of chronic allograft nephropathy using classification trees. Transplantation proceedings; 2010: Elsevier

  23. Chin WSY, Kurowski A, Gore R, Chen G, Punnett L. Use of a mobile app for the process evaluation of an intervention in health care: development and usability study. JMIR Form Res. 2021;5(10): e20739.

    Article  Google Scholar 

  24. Angel-Korman A, Stern L, Sarosiek S, Sloan JM, Doros G, Sanchorawala V, et al. Long-term outcome of kidney transplantation in AL amyloidosis. Kidney Int. 2019;95(2):405–11.

    Article  Google Scholar 

  25. Bitkina OV, Kim HK, Park J. Usability and user experience of medical devices: An overview of the current state, analysis methodologies, and future challenges. Int J Ind Ergon. 2020;76: 102932.

    Article  Google Scholar 

  26. Sobrinho A, da Silva LD, Perkusich A, Pinheiro ME, Cunha P. Design and evaluation of a mobile application to assist the self-monitoring of the chronic kidney disease in developing countries. BMC Med Inform Decis Mak. 2018;18(1):1–14.

    Article  Google Scholar 

  27. Hajavi A, Piri Z, Shahmoradi L, Asadi N, Kheradmandi S, Oveisi M, et al. A survey on completeness of inpatient informed consent forms in the three treatment-teaching centers in Iran University of Medical Sciences (IUMS). Journal of health administration. 2019;11(32):55–62.

    Google Scholar 

Download references

Acknowledgements

Not applicable.

Availability of software to other researchers

The application can be available to any researcher wishing to use it.

Availability and requirements

Project name: Survival of Kidney Transplantation

Project home page: http://kidney.shegerdco.ir/

Operating system(s): Mobile (Android and iOS platforms)

Programming language: Java

Other requirements: -

License: -

Any restrictions to use by non-academics: No license required.

Funding

This research was supported by Tehran University of Medical Sciences & Health Services (TUMS).

Author information

Authors and Affiliations

  1. Department of Health Information Management and Medical Informatics, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran

    Leila Shahmoradi, Alireza Borhani & Sorayya Rezayi

  2. Department of Health Information Management and Medical Informatics, School of Health Management and Information Science, Iran University of Medical Sciences, Tehran, Iran

    Mostafa Langarizadeh

  3. Urology Research Center, Tehran University of Medical Sciences, Tehran, Iran

    Gholamreza Pourmand & Ziba Aghsaei fard

Authors
  1. Leila Shahmoradi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alireza Borhani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mostafa Langarizadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gholamreza Pourmand
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ziba Aghsaei fard
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sorayya Rezayi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Authors LS/ SR/ AB/ GP/ ZA/ ML wrote the first draft of the manuscript. Authors LS/ AB/ SR/ GP/ ZA/ ML performed data collection, analysis and extract main characteristics. All authors LS/ AB/ SR/ GP/ ZA/ ML reviewed, provided critical feedback. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Sorayya Rezayi.

Ethics declarations

Ethics approval and consent to participate

All methods were carried out in accordance with relevant guidelines and regulations. The methodology for this study was approved by the Ethics committee of Tehran University of Medical Sciences. All participants (or their legal guardians) were provided verbal informed consent for all stages of study and the ethics committee approved this procedure.

Consent for publication

Not applicable.

Competing interests

The authors declare that there is no conflict of interest regarding the publication of this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Shahmoradi, L., Borhani, A., Langarizadeh, M. et al. Predicting the survival of kidney transplantation: design and evaluation of a smartphone-based application. BMC Nephrol 23, 219 (2022). https://doi.org/10.1186/s12882-022-02841-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12882-022-02841-4

Keywords

  • Chronic kidney disease
  • Kidney transplant
  • Survival
  • Usability evaluation

BMC Nephrology

ISSN: 1471-2369

Contact us