Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Comparison of automated and retrospectively calculated estimated glomerular filtration rate in electronic health record data

BMC Nephrology volume 19, Article number: 380 (2018) Cite this article

Abstract

Background

Estimated glomerular filtration rate (eGFR) is the clinical standard for assessing kidney function and staging chronic kidney disease. Automated reporting of eGFR using the Modification of Diet in Renal Disease (MDRD) study equation was first implemented within the Department of Veterans Affairs (VA) in 2007 with staggered adoption across laboratories. When automated eGFR are not used or unavailable, values are retrospectively calculated using clinical and demographic data that are currently available in the electronic health record (EHR). Due to the dynamic nature of EHRs, current data may not always match past data. Whether and to what extent the practice of re-calculating eGFR on retrospective data differs from using the automated values is unknown.

Methods

We assessed clinical data for patients enrolled in VA who had their first automated eGFR lab in 2013.We extracted the eGFR value, the corresponding serum creatinine value, and patient race, gender, and date of birth from the EHR. The MDRD equation was applied to retrospectively calculate eGFR. Stage of chronic kidney disease (CKD) was defined using both eGFR values. We used Bland–Altman plots and percent agreement to assess the difference between the automated and calculated values. We developed an algorithm to select the most parsimonious parameter set to explain the difference in values and used chart review on a small subsample of patients to determine if one approach more accurately describes the patient at the time of eGFR measurement.

Results

We evaluated eGFR data pairs from 266,084 patients. Approximately 33.0% (n = 86,747) of eGFR values differed between automated and retrospectively calculated methods. The majority of discordant pairs were classified as the same CKD stage (n = 74,542, 85.93%). The Bland–Altman plot showed differences in the data pairs were centered near zero (mean difference: 0.8 mL/min/1.73m2) with 95% limits of agreement between − 6.4 and 8.0. A change in recorded age explained 95.6% (n = 78,903) of discordant values and 85.02% (n = 9371) of the discordant stages.

Conclusions

Values of retrospectively calculated eGFR can differ from automated values, but do not always result in a significant classification change. In very large datasets these small differences could become significant.

Peer Review reports

Background

Estimated glomerular filtration rate (eGFR) is a standard metric for assessing renal excretory function and staging chronic kidney disease (CKD) in routine clinical practice and is ubiquitously utilized in research settings. Clinically, eGFR can inform therapeutic strategy, disease prognosis, and is predictive of overall patient survival [1,2,3,4,5,6,7,8]. From a research standpoint, eGFR can be used as selection criteria for entry into observational cohorts [9,10,11,12] or clinical trials [13,14,15,16,17], as well as be an exposure, outcome, or covariate of interest [12, 18,19,20,21,22]. The National Kidney Foundation Disease Outcomes Quality Initiative (K-DOQI) and the National Kidney Disease Education Program (NKDEP) recommend that in absence of direct measurement of renal excretory function, eGFR can be calculated from prediction equations based on factors commonly found in the electronic health record (EHR) [1, 4]. One equation is the Modification of Diet in Renal Disease (MDRD) study equation, which derives eGFR from patients’ age, race, and serum creatinine (Scr). This is an older equation that is being slowly phased out in favor of the CKD Epidemiology Collaboration (CKD-EPI) equation, [23] however, real-time calculations in EHRs still use the MDRD equation as do many research groups [9, 19, 20, 24, 25].

Since 2002 the K-DOQI, NKDEP and International Society for Nephrology have encouraged laboratories to automate eGFR reporting [1, 2, 4]. That is, to implement software in clinical laboratories that automatically calculates and reports eGFR in real-time alongside each corresponding Scr value. Although recommended, universal adoption of the automated process has been varied with gradual and incomplete implementation across laboratories in the United States (US) [26, 27]. The NKDEP and the College of American Pathologists’ (CAP) annual surveys determined that only 40–50% of US laboratories used automated eGFR in 2007 and most independent laboratories reported eGFR only when specifically requested by a clinician [26, 27]. Integrated health care systems tend to have higher rates of implementation than independent laboratories. For example, the Alberta Health Services in Alberta, Canada, had 100% implementation in 2004, [28, 29] and the Department of Veterans Affairs (VA), one of the largest integrated health care system in the US, had approximately 68% of its laboratories using automated reporting in 2007 [30].

The VA uses a system-wide EHR, known as the VistA to store patient information dating back to the 1990s. In 2004, the VA National Pathology and Laboratory Service created an eGFR software patch for VistA that enabled each laboratory’s information technology system to automatically calculate eGFR using the isotopic dilution mass spectrometry (IDMS)-traceable MDRD equation and report eGFR values with Scr results [30, 31]. Because each VA laboratory had to independently download the patch, integration was staggered across time.

In research settings, even when automated eGFR is available, it may not be utilized. For one, researchers may not always rely on the automated values and recalculate eGFR themselves using the equation parameters. Second, automated values may not be available for every patient in a cohort during a pre-specified fixed time window (e.g., one year prior to an index date). Limiting the study population to CKD patients with non-missing automated eGFR may result in suboptimal sample sizes and potential loss of statistical power. Alternatively, a researcher can impute missing eGFR values using the MDRD equation. Both of these self-calculation scenarios require that age, gender, race, and Scr are available to the researcher and run on the assumption that the values of these four parameters at the time of study execution accurately reflect the patients’ values at the time point of interest. In some cases, the interval between the time point of interest and study execution date can be decades. Given the dynamic nature of the EHR, the data the researcher uses to impute eGFR values (referred to hereinafter as retrospectively calculated eGFR) may not always match past data in which the imputed value was meant to represent. As such, the retrospectively calculated eGFR value may differ from the automated eGFR value. How often and to what extent the two values can disagree is unknown. The goal of this study therefore was twofold: 1) to quantify the agreement between automated and retrospectively calculated eGFR and 2) determine which equation parameter(s) explain any observed disagreement.

Methods

Data source

To address the research question, we used data available in the VA’s Observational Medical Outcomes Partnership (OMOP) common data model database [32]. VA-OMOP is a transformation of VA’s Corporate Data Warehouse’s (CDW) to the OMOP common data model. The CDW is a nationwide repository, storing all patient-level data recorded from the VA system-wide EHR. It contains historical data dating back to October 1, 1999, including demographic, visit, provider, inpatient and outpatient diagnoses, medication, and lab data [33,34,35]. Data from laboratories that implemented the eGFR software patch are fed into CDW nightly similar to other laboratory data.

Cohort selection and variable creation

We identified patients enrolled in the VA who had their first automated eGFR lab between January 1, 2013 and December 31, 2014. We chose this time period, ten years after the VA first implemented the eGFR software patch, to provide time for clinical practice to potentially adopt the patch and to ensure broad geographical representation of VA laboratories in our study. We identified laboratory values of automated eGFR produced from the patch by a combination of string search in lab test names and verified with clinical review. We extracted the first eGFR value recorded in 2013 and rounded to the nearest tenth decimal place. We then extracted the Scr value (measured enzymatically) that occurred on the same date as the eGFR lab. Lab values of Scr were pulled using Logical Observation Identifier Names and Codes (LOINC) (35203–1, 77,140–2, 21,232–4, 2160–0, 38,483–4, 59,826–8, 14,682–9). In addition to Scr, patient race, gender, and age at Scr (using DOB) documented in the medical record at time of query (September 1, 2017) were applied to the IDMS MDRD equation ((175 × (Scr)-1.154 × (Age)-0.203 × (0.742 if female) × (1.212 if African American)), [36] and eGFR was retrospectively calculated and rounded to the nearest tenth decimal place. For demonstration purposes only and to assess whether differences between the two eGFR values crossed clinically significant boundaries, patients were categorized into CKD groupings according to both automated and retrospectively calculated eGFR (eGFR + 90; eGFR 89–60; Stage 3a = 59–45; Stage 3b = 44–30; Stage 4 = 29–15; Stage 5 = < 15). In clinical practice, Stage 1 and Stage 2 CKD are only diagnosable in the setting of other conditions (e.g., proteinuria, history of kidney transplantation, pathological abnormalities), whereas Stage 3+ can be staged according to eGFR alone [37, 38].

Because demographic data were needed to retrospectively calculate eGFR, any patient missing data on race, DOB, or gender was excluded from subsequent analyses.

Data analysis

Population demographics were assessed using descriptive statistics. Continuous variables are presented as means and standard deviations (SD) and categorical variables as frequencies and percentages.

We used Bland–Altman plots [39] to assess the difference between retrospectively calculated eGFR values and automated eGFR values. We determined each patient’s stage of CKD according to both automated and retrospectively calculated eGFR (mL/min/1.73 m2) and assessed differences in stage assignment using percent agreement and the Kappa (ĸ) coefficient.

We implemented a four-step process to determine if the difference between values could be attributed to a change in one or more MDRD formula parameters in a patient’s EHR over time (Fig. 1). Data presented in Fig. 1 are modeled on actual instances we found in patient records, but do not contain any actual patient data. First, to avoid including pairs that were discordant because of differences in input parameter rounding (i.e., age and Scr), we conservatively selected all patients whose rounded automated eGFR and rounded retrospectively calculated eGFR pairs were not equal (Step 1). In Step 1 for example, the calculated eGFR was rounded from 58.9 to 59.0 and the automated eGFR from 62.7 to 63. We considered this pair discordant and proceeded to Step 2. Had the automated eGFR been 58.9 instead of 62.7 we would have considered both the automated and calculated eGFR to be 59.0 and a concordant pair. We generated all plausible eGFR values rounded to the nearest tenth decimal place resulting in a range from 1.0 to 251.0 mL/min/1.73 m2. Using the MDRD equation, we iteratively determined every combination of age (18–120 years of age), race (black, non-black), Scr (0.10–30.0 mg/dL) and gender (male, female) that could have yielded each generated eGFR value. We then joined the automated value to the generated eGFR value and compared the generated demographics and Scr to the current demographics and Scr used to retrospectively calculate eGFR (Step 2). For each pairwise comparison, we assessed how many variables matched between the generated and current demographics and Scr. We hypothesized a priori, that although possible, it was very unlikely that all equation variables changed in the EHR since the date eGFR was recorded, and further analysis was limited to comparisons with the highest level of matching information (Step 3). From there, we were able to identify the possible equation parameter(s) that explained the discordance (Step 4). In the example presented in Fig. 1 the difference between automated and retrospectively calculated eGFR was explained by age. Frequencies and percentages for each explanatory parameter(s) were separately calculated for discordant eGFR values and CKD stages. We assessed a subset of pairs that were discordant by both eGFR value and CKD stage and identified the possible equation parameter(s) that could explain the disagreement.

Fig. 1
figure 1

Process for determining source of discordant eGFR values

Full size image

Lastly, medical record abstraction was performed by two trained clinical annotators on 20 discordant eGFR dyads to determine if one of the methods was more prone to error than the other. We randomly selected 5 pairs with discordant CKD stage from each explanatory element grouping- age, race, gender, and Scr. We reviewed medical text notes from the time period surrounding the date stamp of the eGFR lab to determine values of age, race, gender, and Scr at the time of automated eGFR. For demographic variables, we then examined all note types surrounding the index date to determine whether the retrospectively calculated demographic value or the automated demographic value more accurately described patient. For example, if race explained the difference between two values and the retrospectively calculated race value did not match the race value in the medical note on the date of the automated eGFR lab we concluded that our algorithm correctly identified the explanatory parameter. If we found the majority of race mentions in the entirety of the medical record to match the retrospectively calculated race we concluded that the retrospectively calculated eGFR was the most appropriate value. Conversely, if we found the opposite to be true, we concluded that the automated eGFR was the most appropriate value. Lastly if the two values differed, and we could not find any evidence in the medical notes to support the explanatory results, the most appropriate value was undeterminable.

Analyses were performed using SAS software, version 9.4 (SAS Institute, Inc. Cary, NC) and R version 3.2.2 (R Foundation for Statistical Computing, Vienna, Austria).

Results

Between January 1, 2013 and December 31, 2014, we identified 307,292 patients with their first eGFR lab in 2013. All 307,292 patients had a Scr lab value on the same day as the eGFR lab, however we excluded 2540 patients whose Scr was part of the comprehensive metabolic panel leaving 304,752 patients. These Scr values were available as unstructured text, but to abstract them through chart review was outside the scope of this study. The non-panel Scr test results were available as structured data. Lastly, we excluded 14,623 patients without a race documented in the medical record at time of query (September 1, 2017). The final analytic cohort consisted of 266,084 patients. The mean age of our overall population was 54.87 (standard deviation = 27). The majority of patients were male (90.33%) and identified as white (79.71%) (Table 1).

Table 1 Characteristics of the study cohort
Full size table

The mean automated eGFR was 84.00 mL/min/1.73m2 and 83.16 mL/min/1.73m2 for retrospectively calculated eGFR, ranging 2 to 250 mL/min/1.73m2 across both methods. Approximately 33.0% (n = 86,747) of patient’s eGFR values differed between automated and retrospectively calculated methods. Patients with discordant eGFR values were slightly younger and comprised more female and black patients than those with concordant eGFR values (Table 1). The Bland-Altman plot showed differences in the data pairs were centered near zero (mean difference: 0.8 mL/min/1.73m2) with 95% limits of agreement between − 6.4 and 8.0 (Fig. 2). The majority of the 86,747 pairs with discordant eGFR values were classified as the same CKD stage (n = 74,542, 85.93%). The mean difference between pairs with discordant values and CKD stage was 7.56 mL/min/1.73m2 and 4.34 mL/min/1.73m2 for pairs with discordant values and concordant CKD stage.

Fig. 2
figure 2

Bland Altman Plot of automated and retrospectively calculated eGFR. Black solid line is drawn at the zero difference in automated and retroactively calculated eGFR. White dashed line (0.8) represents the average difference of automated and retroactively calculated eGFR. Black dashed lines (8.0, −6.4) indicate the 95% limits or +/− 2 standard deviations from the average difference of automated and retroactively calculated eGFR. The average automated eGFR was 83.99 and for retroactively calculated eGFR 83.16. The shapes refer to explanatory factors. Black circles = match, grey circles = 1 demographic, white rectangle = 1 demographic and 1 clinical, triangle = 2 demographics, diamond = 1 clinical

Full size image

According to both retrospectively calculated eGFR and automated eGFR, the most common stage of CKD was eGFR 89–60 (50.65 and 49.13%, respectively) followed closely by eGFR 90+ (36.29 and 38.07%). The least common stage of CKD was Stage 5 as defined by both methods (0.33%). Overall CKD stage discordance between the two methods was 4.60% (n = 12,205). Patients with eGFR 89–60 according to retrospectively calculated eGFR and eGFR 90+ according automated eGFR represented the most common discordant pairs (n = 6495, 2.44%). Extreme stage discordance was rare. For example, only 2 patients were identified as eGFR 90+ by retrospectively calculated eGFR and Stage 5 by automated eGFR. The overall Kappa of 92.41 indicates almost perfect agreement between the two methods [40]. The complete agreement matrix is presented in Table 2.

Table 2 Agreement matrix of CKD stage by retrospectively calculated and automated eGFR values
Full size table

Demographics were the equation parameters most likely to explain discordant eGFR values as well as CKD stage. A change in age, race, gender, or combination explained 99.2% (n = 86,055) of the value differences and 97.7% (n = 11,931) of the stage differences. A change in recorded age explained 95.6% (n = 78,903) of discordant values and 85.02% (n = 9371) of the discordant stages with the absolute median difference in age for these pairs being 18.0 and the median difference in eGFR being 4.00 mL/min/1.73m2. Race alone explained 2.6% and Scr explained 0.6% of conflicting values with the median difference in values being 12.00 and 15.00 mL/min/1.73m2, respectively. The absolute median difference in Scr values was 0.20 mg/dL. Race explained 9.88% and Scr explained 2.18% of conflicting CKD stages with the median difference in values being 16.00 and 12.00 mL/min/1.73m2, respectively. For the pairs that were discordant both in value and CKD stage, race alone explained more of the difference than for pairs discordant in value but concordant in stage (9.88% vs. 1.49%, respectively). See Table 3 for complete results.

Table 3 Explanatory parameters of value and stage discordance
Full size table

Our chart review process revealed that for all 5 discordant pairs explained by a change in Scr, the current Scr was the actual value and the retrospectively calculated eGFR was the preferred method. The notes specifically stated that the original Scr value was erroneous and the incorrect value was changed to the new value. For age and race, we found the preferred method as automated for 2 pairs, retrospectively calculated for 2 pairs and undeterminable for 1 pair. For gender, we found the preferred method as retrospectively calculated for 3 pairs and automated for 2 pairs.

Discussion

We sought to examine whether and to what extent retrospectively calculated eGFR can differ from automated eGFR values. Results illustrated that changes in MDRD equation parameters over time are fairly common in EHR data which can lead to changes in eGFR values and sometimes even changes to CKD stage classification. We found 32.6% discordance between the retrospectively calculated and automated values and approximately 5% of these differences were large enough to result in CKD stage discordance.

Changes in demographic variables largely explained incongruences between retrospectively calculated and automated eGFR with age being the predominate explanatory factor. Changes in Scr accounted for the least number of differences. Our findings make sense intuitively. Age is calculated from date of birth. Due to the self-reporting nature of date of birth at each clinical encounter there is more opportunity for error than there is for a laboratory value. A patient’s day, month, year, or combination can be misreported because of recording or processing errors [41]. Race, though similarly self-reported, explained far less discordance than age. The only race change that could affect eGFR is black to non-black (and vice versa). Any change in race assignment over time that was not a change from black to non-black or from non-black to black would not change eGFR. For example, a white female who is 60-year-old with Scr of 1.1 mg/dL would have the same eGFR as an Asian, Pacific Islander, or Native American female with the same age and Scr.

We found the most common stage discordance between eGFR 90+ and eGFR 89–60 and only 6 instances of stage discordance crossed clinically important boundaries (e.g., eGFR 90+ and Stage 5 or Stage 3a and Stage 4). In all 6 instances either Scr alone or Scr and one demographic accounted for the difference. Since eGFR and Scr are stored as separate data elements, a change to a Scr value does not automatically trigger a change to the corresponding eGFR lab value. After reviewing a small sample of clinical notes, it appears that changes in Scr occur to replace erroneous lab values and historical records are not preserved as structured data. For these instances, the retrospectively calculated eGFR may be the preferred approach to be adopted. However, changes in Scr accounted for < 1% of value discordance and < 3% of stage discordance. There appeared to be no systematic explanations for race, gender, or age changes. In other words, sometimes the automated approach appeared to better reflect the patient’s eGFR and sometimes the retrospectively calculated approach was better. For example, one patient was recorded as white in the note corresponding to the automated eGFR lab, but was recorded as black in every previous and subsequent note as well as in the current structured race field. For this patient, we considered the retrospectively calculated eGFR the preferred approach. Another patient was recorded as male in the note corresponding to the eGFR lab and in the majority of subsequent notes, but the structured gender field was set as female. The most recent medical notes specified that the patient now prefers female pronouns. For this patient, we concluded that the automated eGFR was the preferred approach. With the absence of a gold-standard comparison (e.g., direct measurement of GFR) to determine whether one method was a better reflection of patients’ true GFR, we relied on chart review to determine whether the retrospectively calculated or the automated equation parameter values more accurately described the patient at the time point of interest. A larger chart review study may be warranted to determine if one method is statistically more accurate than the other.

To our knowledge, this is the first study to assess differences between automated and retrospectively calculated eGFR although both are used in research [42]. The VA was an ideal setting for this study as CKD is highly prevalent among Veterans, [42] providing a large national sample. The VA EHR is dynamic, updating and adding data including over 1 million medical notes and reports each night, however findings from this research are generalizable to any dynamic EHR data. Electronic health records can have varying methods of maintaining historical data. Some have destructive replacement practices; meaning when a new entry is made the previous entry for that instance is deleted and replaced. Our findings may also have utility for other measures that are can be similarly retrospectively calculated using EHR data such as body mass index (kilogram/meter2), urine albumin-to-creatinine ratio (urine albumin/ urine creatinine), etc.

In the VA, automated eGFR is calculated using the MDRD equation. There are limitations to this equation and alternative approaches such as the CKD-EPI equation have been proposed. It was designed to match the accuracy of the MDRD equation at GFR < 60 mL/min/1.73m2 and offers greater accuracy at higher GFR, minimizing the over-diagnosis of CKD [38]. The improved accuracy of the CKD-EPI equation may result in the CKD-EPI replacing the MDRD study equation as the preferred tool for CKD screening and risk stratification [23]. Notwithstanding, health systems or researchers that utilize the CKD-EPI equation are prone to the same issues discussed in the present study as it uses the same demographic and clinical variables as the MDRD eq. (141 × min (Scr/κ,1)α × max (Scr/κ, 1)-1.209 × 0.993Age × 1.018 [if female] × 1.159 [if African American]).

Although we observed 33% of differing eGFR values, the differences between values were small and likely not to have much impact in terms of bias on risk estimates such as risk ratios or hazard ratios. However, measurement error has the potential to influence prediction models. Specifically, random error can create instability and error rates in individual predictions and problems with calibration (i.e. agreement between observed and predicted rates) [43]. Aside from the eGFR pairs explained by changes in Scr, it was not apparently clear whether one approach was better than the other. However, the retrospectively calculated eGFR confers some benefits for researchers, as it can significantly improve data completeness and allow for the application of equations not automated through the health system’s EHR (e.g., CKD-EPI in VA). Further, the challenge of automated eGFR is when the preferred method changes over time. Retrospective calculations can use the latest or most preferred equation for all previous values irrespective of the automated equation.

Conclusions

The widespread adoption of EHRs provides much opportunity for secondary-use of clinical data for nephrology research purposes. Study design specifications can warrant retrospective calculation of eGFR using stored demographic and clinical values. However, due to the dynamic nature of most EHRs, record of race, gender, age, and even serum creatine values can change over time and impact eGFR calculated values. In our assessment we found differences between retrospectively calculated eGFR and automated values are common and can result in differences in disease classification. In very large datasets or prediction studies these differences could become significant. It is important to consider the validity of variables used to calculate eGFR when utilizing EHR data.

Abbreviations

CAP:

College of American Pathologists

CDW:

Corporate Data Warehouse

CKD:

Chronic Kidney Disease

CKD-EPI:

Chronic Kidney Disease Epidemiology Collaboration

eGFR:

Estimated Glomerular Filtration Rate

EHR:

Electronic Medical Record

K-DOQI:

National Kidney Foundation Disease Outcomes Quality Initiative

LOINC:

Logical Observation Identifier Names and Codes

MDRD:

Modification of Diet in Renal Disease

NKDEP:

National Kidney Disease Education Program

OMOP:

Observational Medical Outcomes Partnership

Scr :

Serum Creatinine

SD:

Standard Deviation

VA:

Department of Veterans Affairs

References

  1. Levey AS, Coresh J, Bolton K, Culleton B, Harvey KS, Ikizler TA, et al. K/DOQI clinical practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Am J Kidney Dis. 2002;39(2 Suppl 1):S1.

    Google Scholar 

  2. Levey AS, Eckardt KU, Tsukamoto Y, Levin A, Coresh J, Rossert J, et al. Definition and classification of chronic kidney disease: a position statement from kidney disease: improving global outcomes (KDIGO). Kidney Int. 2005;67(6):2089–100.

    Article  Google Scholar 

  3. Levey AS, Coresh J, Balk E, Kausz AT, Levin A, Steffes MW, et al. National Kidney Foundation practice guidelines for chronic kidney disease: evaluation, classification, and stratification. Ann Intern Med. 2003;139(2):137–47.

    Article  Google Scholar 

  4. Myers GL, Miller WG, Coresh J, Fleming J, Greenberg N, Greene T, et al. Recommendations for improving serum creatinine measurement: a report from the laboratory working Group of the National Kidney Disease Education Program. Clin Chem. 2006;52(1):5–18.

    Article  CAS  Google Scholar 

  5. Eknoyan G, Hostetter T, Bakris GL, Hebert L, Levey AS, Parving H-H, et al. Proteinuria and other markers of chronic kidney disease: a position statement of the national kidney foundation (NKF) and the national institute of diabetes and digestive and kidney diseases (NIDDK). Am J Kidney Dis. 2003;42(4):617–22.

    Article  Google Scholar 

  6. Mathew TH, Johnson DW, Jones GR. Chronic kidney disease and automatic reporting of estimated glomerular filtration rate: revised recommendations. Med J Aust. 2007;187(8):459–63.

    PubMed  Google Scholar 

  7. Burden R, Tomson C. Identification, management and referral of adults with chronic kidney disease: concise guidelines. Clinical Medicine. 2005;5(6):635–42.

    Article  Google Scholar 

  8. Nephrology CSo. Care and Referral of Adult Patients with Reduced Kidney Function Position Paper from the Canadian Society of Nephrology. In.; 2006.

  9. Drawz PE, Babineau DC, Rahman M. Metabolic complications are common in elderly patients with chronic kidney disease. J Am Geriatr Soc. 2012;60(2):310–5.

    Article  Google Scholar 

  10. Drawz PE, Goswami P, Azem R, Babineau DC, Rahman M. A simple tool to predict end-stage renal disease within 1 year in elderly adults with advanced chronic kidney disease. J Am Geriatr Soc. 2013;61(5):762–8.

    Article  Google Scholar 

  11. Robinson R, Tait CD, Somov P, Lau MW, Sangar VK, Ramani VAC, et al. Estimated glomerular filtration rate is unreliable in detecting renal function loss during follow-up after cystectomy and urinary diversion. Int Urol Nephrol. 2016;48(4):511–5.

    Article  CAS  Google Scholar 

  12. Rhee CM, Kalantar-Zadeh K, Streja E, Carrero JJ, Ma JZ, Lu JL, et al. The relationship between thyroid function and estimated glomerular filtration rate in patients with chronic kidney disease. Nephrol Dial Transplant. 2015;30(2):282–7.

    Article  CAS  Google Scholar 

  13. Sha S, Devineni D, Ghosh A, Polidori D, Chien S, Wexler D, et al. Canagliflozin, a novel inhibitor of sodium glucose co-transporter 2, dose dependently reduces calculated renal threshold for glucose excretion and increases urinary glucose excretion in healthy subjects. Diabetes Obes Metab. 2011;13(7):669–72.

    Article  CAS  Google Scholar 

  14. Stenlöf K, Cefalu WT, Kim KA, Alba M, Usiskin K, Tong C, et al. Efficacy and safety of canagliflozin monotherapy in subjects with type 2 diabetes mellitus inadequately controlled with diet and exercise. Diabetes Obes Metab. 2013;15(4):372–82.

    Article  Google Scholar 

  15. Cooney D, Moon H, Liu Y, Miller RT, Perzynski A, Watts B, et al. A pharmacist based intervention to improve the care of patients with CKD: a pragmatic, randomized, controlled trial. BMC Nephrol. 2015;16:56.

    Article  Google Scholar 

  16. Chang AR, Evans M, Yule C, Bohn L, Young A, Lewis M, et al. Using pharmacists to improve risk stratification and management of stage 3A chronic kidney disease: a feasibility study. BMC Nephrol. 2016;17(1):168.

    Article  Google Scholar 

  17. Peralta CA, Frigaard M, Rubinsky AD, Rolon L, Lo L, Voora S, et al. Implementation of a pragmatic randomized trial of screening for chronic kidney disease to improve care among non-diabetic hypertensive veterans. BMC Nephrol. 2017;18(1):132.

    Article  Google Scholar 

  18. O'Hare AM, Bertenthal D, Covinsky KE, Landefeld CS, Sen S, Mehta K, et al. Mortality risk stratification in chronic kidney disease: one size for all ages? J Am Soc Nephrol. 2006;17(3):846–53.

    Article  Google Scholar 

  19. O'Hare AM, Batten A, Burrows NR, Pavkov ME, Taylor L, Gupta I, et al. Trajectories of kidney function decline in the 2 years before initiation of long-term dialysis. Am J Kidney Dis. 2012;59(4):513–22.

    Article  Google Scholar 

  20. O'Hare AM, Choi AI, Bertenthal D, Bacchetti P, Garg AX, Kaufman JS, et al. Age affects outcomes in chronic kidney disease. J Am Soc Nephrol. 2007;18(10):2758–65.

    Article  Google Scholar 

  21. Obadan NO, Walker RJ, Egede LE. Independent correlates of chronic kidney disease awareness among adults with type 2 diabetes. J Diabetes Complicat. 2017;31(6):988–91.

    Article  Google Scholar 

  22. Ayansina D, Black C, Hall SJ, Marks A, Millar C, Prescott GJ, et al. Long term effects of gestational hypertension and pre-eclampsia on kidney function: record linkage study. Pregnancy Hypertens. 2016;6(4):344–9.

    Article  CAS  Google Scholar 

  23. Skali H, Uno H, Levey AS, Inker LA, Pfeffer MA, Solomon SD. Prognostic assessment of estimated glomerular filtration rate by the new chronic kidney disease epidemiology collaboration equation in comparison with the modification of diet in renal disease study equation. Am Heart J. 2011;162(3):548–54.

    Article  Google Scholar 

  24. O'Hare AM, Feinglass J, Sidawy AN, Bacchetti P, Rodriguez RA, Daley J, et al. Impact of renal insufficiency on short-term morbidity and mortality after lower extremity revascularization: data from the Department of Veterans Affairs' National Surgical Quality Improvement Program. J Am Soc Nephrol. 2003;14(5):1287–95.

    Article  Google Scholar 

  25. Thakar CV, Christianson A, Freyberg R, Almenoff P, Render ML. Incidence and outcomes of acute kidney injury in intensive care units: a veterans administration study. Crit Care Med. 2009;37(9):2552–8.

    Article  Google Scholar 

  26. Accetta NA, Gladstone EH, DiSogra C, Wright EC, Briggs M, Narva AS. Prevalence of estimated GFR reporting among US clinical laboratories. Am J Kidney Dis. 2008;52(4):778–87.

    Article  Google Scholar 

  27. College of American For Pathol Practices and Recommendations for Reporting Estimated Glomerular Fitration Rate (eGFR). 2013. https://cap.objects.frb.io/documents/2012-current-status-reporting-egfr.pdf. Accessed 09 Apr 2018.

  28. Hemmelgarn BR, Zhang J, Manns BJ, et al. Nephrology visits and health care resource use before and after reporting estimated glomerular filtration rate. JAMA. 2010;303(12):1151–8.

    Article  CAS  Google Scholar 

  29. Jain AK, McLeod I, Huo C, Cuerden MS, Akbari A, Tonelli M, et al. When laboratories report estimated glomerular filtration rates in addition to serum creatinines, nephrology consults increase. Kidney Int. 2009;76(3):318–23.

    Article  CAS  Google Scholar 

  30. Hall RK, Wang V, Jackson GL, Hammill BG, Maciejewski ML, Yano EM, et al. Implementation of automated reporting of estimated glomerular filtration rate among veterans affairs laboratories: a retrospective study. BMC Med Inform Decis Mak. 2012;12:69.

    Article  Google Scholar 

  31. Wang V, Maciejewski ML, Hammill BG, Hall RK, Van Scoyoc L, Garg AX, et al. Recognition of CKD after the introduction of automated reporting of estimated GFR in the veterans health administration. Clin J Am Soc Nephrol. 2014;9(1):29–36.

    Article  Google Scholar 

  32. Stang PE, Ryan PB, Racoosin JA, Overhage JM, Hartzema AG, Reich C, et al. Advancing the science for active surveillance: rationale and design for the observational medical outcomes partnership. Ann Intern Med. 2010;153(9):600–6.

    Article  Google Scholar 

  33. Patel TG, Pogach LM, Barth RH. CKD screening and management in the veterans health administration: the impact of system organization and an innovative electronic record. Am J Kidney Dis. 2009;53(3 Suppl 3):S78–85.

    Article  Google Scholar 

  34. Perlin JB, Kolodner RM, Roswell RH. The veterans health administration: quality, value, accountability, and information as transforming strategies for patient-centered care. Am J Manag Care. 2004;10(11 Pt 2):828–36.

    PubMed  Google Scholar 

  35. Payne TH, Savarino J. Development of a clinical event monitor for use with the veterans affairs computerized patient record system and other data sources. Proc AMIA Symp. 1998:145–9.

  36. Levey AS, Bosch JP, Lewis JB, Greene T, Rogers N. Roth D. a more accurate method to estimate glomerular filtration rate from serum creatinine: a new prediction equation. Modification of diet in renal disease study group. Ann Intern Med. 1999;130(6):461–70.

    Article  CAS  Google Scholar 

  37. Renal Association. The UK eCKD Guide. 2018. https://renal.org/information-resources/the-uk-eckd-guide/stages-1-2-ckd. Accessed 09 Apr 2018.

  38. Cole NI, Liyanage H, Suckling RJ, Swift PA, Gallagher H, Byford R, et al. An ontological approach to identifying cases of chronic kidney disease from routine primary care data: a cross-sectional study. BMC Nephrol. 2018;19(1):85.

    Article  Google Scholar 

  39. Giavarina D. Understanding bland Altman analysis. Biochemia Medica. 2015;25(2):141–51.

    Article  Google Scholar 

  40. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.

    Article  CAS  Google Scholar 

  41. Mason KO, Cope LG. Sources of age and date-of-birth misreporting in the 1900 U.S. census. Demography. 1987;24(4):563–73.

    Article  CAS  Google Scholar 

  42. Fung E, Chang TI, Chertow GM, Thomas IC, Asch SM, Kurella Tamura M. Receipt of nephrology care and clinical outcomes among veterans with advanced CKD. Am J Kidney Dis. 2017;70(5):705–14.

    Article  Google Scholar 

  43. Rosella LC, Corey P, Stukel TA, Mustard C, Hux J, Manuel DG. The influence of error on calibration, discrimination, and overall estimation of a risk prediction model. Popul Health Metrics. 2012;10:20.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was supported using resources and facilities at the VA Informatics and Computing Infrastructure (VINCI), VA HSR RES 13–457. The funding source had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available due the Department of Veteran Affairs’ data use and privacy policies.

Author information

Authors and Affiliations

  1. VA Informatics and Computing Infrastructure (VINCI), VA Salt Lake City Health Care System, Salt Lake City, UT, USA

    Kristine E. Lynch, Ji won Chang, Olga Efimova, Gregorio Coronado & Scott L. DuVall

  2. Division of Epidemiology, Department of Internal Medicine, University of Utah, Salt Lake City, UT, USA

    Kristine E. Lynch, Ji won Chang, Olga Efimova, Gregorio Coronado & Scott L. DuVall

  3. Geriatrics Research Education and Clinical Care Center, Tennessee Valley Healthcare System, Nashville, TN, USA

    Michael E. Matheny

  4. Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA

    Michael E. Matheny

  5. Beth Israel Deaconess Medical Center, Boston, MA, USA

    Alexander Goldfarb

  6. Harvard Medical School, Boston, MA, USA

    Alexander Goldfarb

Authors
  1. Kristine E. Lynch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ji won Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael E. Matheny
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alexander Goldfarb
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Olga Efimova
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Gregorio Coronado
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Scott L. DuVall
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KEL conceived the project, planned the methodology, contributed to the analysis and writing of the manuscript. JC completed the data analysis and contributed to the writing of the manuscript. MEM made substantial contributions to the design of the study, interpretation of data, and contributed to the drafting and revision of manuscript. AG contributed to the acquisition of the data and critically revised the manuscript for important clinical and intellectual content. OE and GC contributed to the interpretations of the data and made critical revisions to the manuscript. SLD contributed to the design of the project and made significant contributions to the writing of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kristine E. Lynch.

Ethics declarations

Ethics approval and consent to participate

This work was conducted under the approval of the University of Utah’s Institutional Review Board, Salt Lake City, UT (Assurance FWA00003745, IRB_00092652) and was performed with an approved Waiver of Consent.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lynch, K.E., Chang, J.w., Matheny, M.E. et al. Comparison of automated and retrospectively calculated estimated glomerular filtration rate in electronic health record data. BMC Nephrol 19, 380 (2018). https://doi.org/10.1186/s12882-018-1179-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12882-018-1179-8

BMC Nephrology

ISSN: 1471-2369

Contact us