Development of an erythropoietin prescription simulator to improve abilities for the prescription of erythropoietin stimulating agents: Is it feasible?
© Gabutti et al; licensee BioMed Central Ltd. 2011
Received: 22 April 2010
Accepted: 18 February 2011
Published: 18 February 2011
The increasing use of erythropoietins with long half-lives and the tendency to lengthen the administration interval to monthly injections call for raising awareness on the pharmacokinetics and risks of new erythropoietin stimulating agents (ESA). Their pharmacodynamic complexity and individual variability limit the possibility of attaining comprehensive clinical experience. In order to help physicians acquiring prescription abilities, we have built a prescription computer model to be used both as a simulator and education tool.
The pharmacokinetic computer model was developed using Visual Basic on Excel and tested with 3 different ESA half-lives (24, 48 and 138 hours) and 2 administration intervals (weekly vs. monthly). Two groups of 25 nephrologists were exposed to the six randomised combinations of half-life and administration interval. They were asked to achieve and maintain, as precisely as possible, the haemoglobin target of 11-12 g/dL in a simulated naïve patient. Each simulation was repeated twice, with or without randomly generated bleeding episodes.
The simulation using an ESA with a half-life of 138 hours, administered monthly, compared to the other combinations of half-lives and administration intervals, showed an overshooting tendency (percentages of Hb values > 13 g/dL 15.8 ± 18.3 vs. 6.9 ± 12.2; P < 0.01), which was quickly corrected with experience. The prescription ability appeared to be optimal with a 24 hour half-life and weekly administration (ability score indexing values in the target 1.52 ± 0.70 vs. 1.24 ± 0.37; P < 0.05). The monthly prescription interval, as suggested in the literature, was accompanied by less therapeutic adjustments (4.9 ± 2.2 vs. 8.2 ± 4.9; P < 0.001); a direct correlation between haemoglobin variability and number of therapy modifications was found (P < 0.01).
Computer-based simulations can be a useful tool for improving ESA prescription abilities among nephrologists by raising awareness about the pharmacokinetic characteristics of the various ESAs and recognizing the factors that influence haemoglobin variability.
The recent development of long-acting erythropoietin stimulating agents (ESA), and the clinical trend to increase ESA administration intervals, have markedly changed the ESA prescription profile in nephrology. Thus, from a half-life of 19.4 ± 2.4 hours for erythropoietin alpha  and 24.2 ± 2.6 hours for erythropoietin beta  after subcutaneous administration, and a recommendation to administer these agents up to three times per week, we are now using compounds such as darbepoetin  -and, recently, CERA- that have a much longer half-life (48.8 ± 5.2 hours and 139 ± 20 hours, [4, 5] respectively), with the suggestion to lengthen the administration interval up to once monthly. However, the correct application of the new strategies implies that users are well aware of the pharmacological characteristics and risks of the newer long-acting molecules.
Although these assumptions have probably not been met, prescribers seem to have quickly and spontaneously adapted to the new conditions, but numerous observations document important - and sometimes cyclical - fluctuations in the haemoglobin values of chronically-treated patients. This has led to numerous questions, which the current clinical, pharmacokinetic and pharmacodynamic knowledge has been able to answer only in part [6–18]. With respect to haemoglobin cycling in particular, the prescription strategy, especially considering frequent and sudden adjustments in erythropoietin dosage, has been considered a possible triggering factor [19–21], while so far no direct effect of a longer administration interval on haemoglobin stability has been noted. The debate on the causes of haemoglobin variability would be purely academic if the stability of haemoglobin were not to be within a therapeutic margin that, in these last few years, has become narrower, and if the haemoglobin fluctuations had not been associated with a greater morbidity .
In order to help physicians acquire prescription ability, and with the hope of reducing haemoglobin variability, we felt it was relevant to build a pharmacokinetic computer model to be used as an ESA prescription simulator. The aim of this simulator is to raise awareness among ESA users about the implications of recent changes in erythropoietin half-life and prescription intervals. For this purpose, we have built a simulator that asks users to prescribe various ESAs for a naïve patient and to adjust the dose as precisely as possible in a 12-week equilibration or balance phase followed by a 20-week maintenance phase (haemoglobin target 11-12 g/dL). The epoetin half-life and the interval of administration will be assigned to the user at the start of the exercise, while the initial haemoglobin and the patient's erythropoietin sensitivity are randomly generated by the software.
Although such a simulator, contrary to other models based, for instance, on Artificial Neural Networks or Bayesian Adaptive Control , is not a prediction tool applicable to clinical practice, we feel that it could be a good way to improve the physicians' ability to prescribe ESAs. Moreover, the simulator should enable us to answer the following questions: (1) Is the ability to keep haemoglobin within the target (primary end point) and haemoglobin stability (secondary end point) influenced by the erythropoietin half-life and administration interval and/or by the use of the simulator (learning effect)? (2) Does the number of changes in ESA dosing correlate with the fluctuations in haemoglobin values and administration interval (secondary end point)? (3) Is the intra-patient delta haemoglobin a more sensitive indicator of haemoglobin stability compared to the standard deviation (secondary end point)?
The "epoietin prescription simulator" was developed in Visual Basic on Excel. The version used in the study is annexed to this document (see Additional File 1 named The Epoetin Prescription Simulator). The user's manual as well as the formulae, including a mono-exponential one that relates the erythropoietin half-life selected for the simulation to ESA's concentration and its effect on the production of new red blood cells, are detailed in the Additional File 2 named Appendix 1.
The simulator randomly defines, for an ESA naïve patient, the starting haemoglobin (Hb), with 0.1 g/dL increments, in a range between 7.0 and 8.0 g/dL. To better adjust to clinical practice, it automatically includes, for the duration of the simulation, incidental fluctuations in Hb with an absolute magnitude between -0.5 and +0.5 g/dL . The subject's sensitivity to epoetin is randomly assigned, making sure that the population's average weekly need for epoetin in order to reach the pre-established haemoglobin target of 11-12 g/dL  is at approximately 6,000 units. The mean red blood cell (RBC) lifespan in the initial configuration is always set at 61.2 days, and will fluctuate during the simulation according to the erythrocyte age distribution. The amount of weekly epoetin needed, the initial RBC lifespan and the pre-erythrocyte kinetics are simulated according to the data of the literature [26–32].
The home page contains a window with the half-life selected for the test (restricted to 24, 48 and 138 hours), another with the current haemoglobin, an active window where the epoetin dosage can be entered (initially weekly or biweekly and, after 8 weeks, weekly or monthly as predetermined), and finally one showing the statistics of the test in progress from the first week.
Statistics are automatically updated during the simulation and summarise the following parameters: mean Hb with SD, variability based on the delta Hb (average of the difference between consecutive values), mean RBC lifespan, percentage of Hb values < 11, >12 and >13 g/dL, and a score ("ability score") starting from 1 (meaning that 100% of the values are outside the target range); the score increases with the decrease of Hb values outside the predetermined optimal range of 11-12 g/dL (a haemoglobin value above 13 g/dl is counted as a double error: one point for Hb > 12 and another for Hb > 13 g/dL; see appendix 1 for details). The model also includes the possibility of randomly adding an acute bleeding episode with depletion of blood volume between 0% and 30%.
Considering that the software is annexed to the paper, we remind those users who are outside the current study that, taking into account the simplification of the biological process on which the design was based, and the fact that pharmacodynamic data for erythropoietin are incomplete and affected by significant differences among individuals, the model cannot be used to compare erythropoietin products currently on the market or to prescribe erythropoietin in clinical practice.
Selected population and procedure
In order to meet the study's needs, we asked two independent groups of 25 nephrologists (both graduates or still pursuing their degree) selected during a national-level meeting to participate by completing the 6 predetermined simulations in random order (erythropoietin with 24, 48 or 138 hours of half-life combined with weekly or monthly administration interval). Each group's participation was planned to be separated by nine months.
The first session was scheduled during CERA's premarketing stage and was designed to be carried out with candidates without experience with the new molecule; the second one was the opposite, taking place after CERA had entered the market. In the first session (simulation A), in order to double the number of equilibration events to which each candidate was subjected, and to analyse the learning curve, an acute bleeding episode (0-30% of blood volume) was randomly introduced into the model between weeks 18 and 24. During the second session (simulation B) we exposed each candidate to the six predetermined simulations but without acute bleeding episodes. In each simulation, candidates were asked to enter an erythropoietin dosage, taking into account the erythropoietin half-life and administration interval already entered with the purpose of reaching as fast as possible and with the maximum precision the Hb target (between 11 and 12 g/dL), adapting the dosage in the following weeks/months as if it was a patient on haemodialysis.
Statistical analyses were performed using a statistical software package (SPSS 12.0; SPSS Inc., Chicago, IL, USA). Results were expressed as mean ± SD. Intra-patient  haemoglobin variability other than SD was estimated from the average of the absolute value of the differences between consecutive parameters defined in the text "delta Hb". The haemoglobin target was selected with a narrow margin (11-12 g/dL) to improve the likelihood of finding differences between the groups. Comparisons between parameters were carried out with a paired t-test, while Hb profiles as a function of time were compared using a trapezoidal estimation of the area under the curves followed by a Wilcoxon Signed Ranks test. Percentages were compared using a Fisher Exact test. In all cases, a P ≤ 0.05 was considered statistically significant; P was expressed as ns (not significant), 0.05, <0.05, <0.01 and <0.001.
Haemoglobin variability in simulation A
Mean Hb (g/dL)
Haemoglobin values and ability score; simulation B
Haemoglobin (g/dL) Mean
Haemoglobin values <11 g/dL (%)
Haemoglobin values >12 g/dL (%)
Haemoglobin values >13 g/dL (%)
Table 2 shows the percentage of values outside the target during the 32 weeks of the simulation for each modality, comparing monthly to weekly administration. Monthly administration is characterised by a lower percentage of Hb values at the target of 11-12 g/dL (18.4 vs. 26.8%; P < 0.05), but there are also fewer values above 12 or 13 g/dL (11.8 vs. 25.3%; P < 0.01 and 4.3 vs. 13.0; P < 0.05). With respect to the ability score, the only modality that stands out from the rest in a significant way is that associating the short half-life (24 hours) with the weekly administration (1.52 ± 0.70 vs. 1.24 ± 0.37; P < 0.05) (primary end point).
The purpose of this study was to develop a new tool to improve the physicians' ability to prescribe erythropoietin stimulating agents in dialysis patients and hence to raise awareness on the pharmacological consequences resulting from the use of ESAs with a very long half-life over longer administration intervals. Our two simulations (A and B), performed before and after CERA's marketing, enable us to conclude that the simulator is user-friendly and that its use is associated with learning (less dispersion of Hb values and improvement of the ability to respect the predetermined target).
Simulation modality A was tested with a group of nephrologists who had never used erythropoietins with half-lives longer than 48 hours, showing that the first approach with a prolonged half-life (138 hours) and a monthly administration interval could have overshooting as a consequence. Nevertheless, the risk of overshooting is quickly corrected thanks to the learning, and the prescriber is already able to avoid the administration of an excessive dose in the second equilibration phase of the same simulation.
Interestingly, in simulation B, performed after CERA's marketing with a group of nephrologists being aware of its long half-life (about 139 hours), overshooting tendencies were not observed. The same simulation, compared with the first one, allowed a more detailed analysis of the maintenance phase following the initial equilibration phase. Surprisingly, the simulation has shown that nephrologists have been more careful and conservative with prescriptions when faced with an administration interval of 4 weeks. The result was that monthly administration has been translated into a significantly lower average Hb value (10.3 vs. 11.1 g/dL; P < 0.01), as well as a lower percentage of Hb values at the target of 11-12 g/dL (18.4 vs. 26.8%; P < 0.05). Accordingly, with the type of ESA and the administration interval mostly used at the time the study was carried out, the only modality that was characterised with a prescription ability (calculated by indexing the percentage of parameter values on target, below target, above target, and above the safety Hb value of 13 g/dL) that was statistically superior compared to the others (primary end point) was the combination of the shortest half-life (24 hours) with weekly administration (ability score 1.52 vs. 1.24; P < 0.05). The smaller adjustments needed, regarding the mean ESA dose, between the equilibration and maintenance phases using the monthly administration interval (9.1 vs. 14.5%; P < 0.05) was probably due to the lower mean Hb value at the end of the equilibration phase when the monthly interval was used; so it should not be interpreted as better prescription ability but as more prudence when faced with long half-lives.
As can be observed when comparing Figures 2 and 3, the weekly Hb value shows larger variability when using monthly compared to weekly administration (only the monthly values as shown in Figure 2 were visible to the prescriber). The greatest variability in the model is generated by red blood cell sub-populations of different ages (a fact shown by the curve behaviour in Figure 3 as well as by the significant difference in the fluctuation of red blood cell lifespan during the simulation summarised in Figure 8), caused by the single monthly dose of erythropoietin that has resulted in a non-homogeneous generation and elimination of red blood cells over time.
Hb variability analysis enables a critical evaluation of the meaning of standard deviation (average distance of individual values from the mean) compared to delta Hb (average of the absolute value of the difference between consecutive measurements). In the particular case of the simulation, delta Hb is in fact the parameter that best translates incidental changes in Hb values.
Using a monthly instead of a weekly administration interval, the number of modifications to the erythropoietin dose is significantly lower (4.9 vs. 8.2; P < 0.001). As suggested in the literature  and demonstrated with the significant direct correlation between Hb variability and number of epoetin dose adjustements (Figure 7), this fact could have favourable consequences on Hb stability.
In conclusion, bearing in mind the limitations of our model, the results obtained with our simulator could be used as a path for further experimental studies. An ESA prescription simulator can be a useful educational tool to raise awareness about the possible consequences of changing the medication's half-life or its administration interval. The first time users were faced with an erythropoietin compound with a half-life of 138 hours and a monthly administration interval, they were exposed to a risk of overshooting, which was corrected by the training on the simulator. With respect to possible consequences, very long half-lives and monthly administration intervals translate into a conservative prescription that maintains Hb values below the desired level. As a consequence the shortest half-life (24 hours) with the weekly administration interval is associated with the better prescription ability. The monthly prescription interval however, as suggested in the literature, is accompanied by less therapeutic adjustments; in this regard a direct correlation between Hb variability and number of therapy modifications has been demonstrated. In our simulations, the delta Hb has proven to be a better tool for evaluating intra-patient Hb variability than standard deviation.
Computer-based simulation tools can be particularly useful for improving prescription patterns and for testing new working hypotheses such as determining the factors that influence Hb variability. Additional knowledge on the pharmacodynamic of ESAs is necessary to fine-tune the models and bring them closer to the level of regular clinical experience. However, the research of possible consequences of half-life and administration interval for ESAs that are currently marketed with respect to the Hb stability will require specific targeted clinical trials.
This work was funded by a grant from the Fondazione Ettore Balli, Locarno, Switzerland. The study sponsors had no role in study design, data collection, data analysis, data interpretation, and/or writing of the report.
- Halstenson CE, Macres M, Katz SA, Schnieders JR, Watanabe M, Sobota JT, Abraham PA: Comparative pharmacokinetics and pharmacodynamics of epoetin alfa and epoetin beta. Clin Pharmacol Ther. 1991, 50: 702-712. 10.1038/clpt.1991.210.View ArticlePubMedGoogle Scholar
- Macdougall IC, Gray SJ, Elston O, Breen C, Jenkins B, Browne J, Egrie J: Pharmacokinetics of novel erythropoiesis stimulating protein compared with epoetin alfa in dialysis patients. J Am Soc Nephrol. 1999, 10: 2392-2395.PubMedGoogle Scholar
- Macdougall IC: Optimizing the use of erythropoietic agents - pharmacokinetic and pharmacodynamic considerations. Nephrol Dial Transplant. 2002, 17: 66-70. 10.1093/ndt/17.suppl_5.66.View ArticlePubMedGoogle Scholar
- Macdougall IC, Robson R, Opatrna S, Liogier X, Pannier A, Jordan P, Dougherty FC, Reigner B: Pharmacokinetics and pharmacodynamics of intravenous and subcutaneous continuous erythropoietin receptor activator (C.E.R.A.) in patients with chronic kidney disease. Clin J Am Soc Nephrol. 2006, 1: 1211-1215. 10.2215/CJN.00730306.View ArticlePubMedGoogle Scholar
- Macdougall IC: CERA (Continuous Erythropoietin Receptor Activator): a new erythropoiesis-stimulating agent for the treatment of anemia. Curr Hematol Rep. 2005, 4: 436-440.PubMedGoogle Scholar
- Minutolo R, Chiodini P, Cianciaruso B, Pota A, Bellizzi V, Avino D, Mascia S, Laurino S, Bertino V, Conte G, De Nicola L: Epoetin therapy and hemoglobin level variability in nondialysis patients with chronic kidney disease. Clin J Am Soc Nephrol. 2009, 4: 552-559. 10.2215/CJN.04380808.View ArticlePubMedPubMed CentralGoogle Scholar
- Fernández Fresnedo G, De Francisco AL, Ruiz JC, Gómez Alamillo C, Arias M: Hemoglobin level variability in renal transplant patients treated with erythropoiesis stimulating agents. Transplant Proc. 2008, 40: 2919-2921.View ArticlePubMedGoogle Scholar
- Spiegel DM, Gitlin M, Mayne T: Factors affecting anemia management in hemodialysis patients: a single-center experience. Hemodial Int. 2008, 12: 336-341. 10.1111/j.1542-4758.2008.00278.x.View ArticlePubMedGoogle Scholar
- De Francisco AL, Piñera C: Insights in anemia management. Hemodial Int. 2008, 12: 336-341. 10.1111/j.1542-4758.2008.00278.x.View ArticleGoogle Scholar
- Brooks D: Frequent assessment of longitudinal laboratory trends: a key to minimizing hemoglobin variability in patients on dialysis. Nephrol Nurs J. 2007, 34: 435-439.PubMedGoogle Scholar
- Walker R, Pussel BA, Australian Renal Anaemia Group: Fluctuations in haemoglobin levels in haemodialysis patients receiving intravenous epoetin alfa or intravenous darbepoetin alfa. Nephrology (Carlton). 2007, 12: 448-451. 10.1111/j.1440-1797.2007.00802.x.View ArticleGoogle Scholar
- Ebben JP, Gilbertson DT, Foley RN, Collins AJ: Hemoglobin level variability: associations with comorbidity, intercurrent events, and hospitalizations. Clin J Am Soc Nephrol. 2006, 1: 1205-1210. 10.2215/CJN.01110306.View ArticlePubMedGoogle Scholar
- Deray G: Hemoglobin variability in patients with chronic renal insufficiency. Nephrol Ther. 2008, 4: 549-552.View ArticlePubMedGoogle Scholar
- Krzyzanski W, Perez-Ruixo JJ, Vermeulen A: Basic pharmacodynamic models for agents that alter the lifespan distribution of natural cells. J Pharmacokinet Pharmacodyn. 2008, 35: 349-377. 10.1007/s10928-008-9092-6.View ArticlePubMedPubMed CentralGoogle Scholar
- Pérez-Ruixo JJ, Krzyanski W, Hing J: Pharmacodynamic analysis of recombinant human erythropietin effect on reticulocyte production rate and age distribution in healthy subjects. Clin Pharmacokinet. 2008, 47: 399-415.View ArticlePubMedPubMed CentralGoogle Scholar
- McGowan T, Vaccaro NM, Beaver JS, Massarella J, Wolfson M: Pharmacokinetic and pharmacodynamic profiles of extended dosing of epoetin alfa in anemic patients who have chronic kidney disease and are not on dialysis. Clin J Am Soc Nephrol. 2008, 3: 1006-1014. 10.2215/CJN.05671207.View ArticlePubMedPubMed CentralGoogle Scholar
- Woo S, Krzyzanski W, Jusko WJ: Target-mediated pharmacokinetic and pharmacodynamic model of recombinant human erythropoietin (rHuEPO). J Pharmacokinet Pharmacodyn. 2007, 34: 849-868. 10.1007/s10928-007-9074-0.View ArticlePubMedGoogle Scholar
- Krzyzanski W, Perez-Ruixo JJ: An assessment of recombinant human erythropoietin effect on reticulocyte production rate and lifespan distribution in healthy subjects. Pharm Res. 2007, 24: 758-772. 10.1007/s11095-006-9195-y.View ArticlePubMedGoogle Scholar
- Fishbane S, Berns JS: Hemoglobin cycling in hemodialysis patients treated with recombinatn human erythropoietin. Kidney Int. 2005, 68: 1337-1343. 10.1111/j.1523-1755.2005.00532.x.View ArticlePubMedGoogle Scholar
- Singh AK, Milford E, Fishbane S, Keithi-Reddy SR: Managing anemia in dialysis patients: hemoglobin cycling and overshoot. Kidney Int. 2008, 74: 679-683. 10.1038/ki.2008.59.View ArticlePubMedGoogle Scholar
- Fishbane S, Berns JS: Evidence and implications of haemoglobin cycling in anemia management. Nephro Dial Transplant. 2007, 22: 2129-2132. 10.1093/ndt/gfm384.View ArticleGoogle Scholar
- Yang W, Israni RK, Brunelli SM, Joffe MM, Fishbane S, Feldman HI: Hemoglobin Variability and Mortality in ESRD. J Am Soc Nephrol. 2007, 18: 3164-3170. 10.1681/ASN.2007010058.View ArticlePubMedGoogle Scholar
- Gabutti L, Lötscher N, Bianda J, Marone C, Mombelli G, Burnier M: Would artificial neural networks implemented in clinical wards help nephrologists in predicting epoetin responsiveness?. BMC Nephrol. 2006, 7: 13-10.1186/1471-2369-7-13.View ArticlePubMedPubMed CentralGoogle Scholar
- Berns JS, Elzein H, Lynn RI, Fishbane S, Meisels IS, Deoreo PB: Hemoglobin variability in epoetin-treated hemodialysis patients. Kidney International. 2003, 64: 1514-1521. 10.1046/j.1523-1755.2003.00229.x.View ArticlePubMedGoogle Scholar
- Locatelli F, Covic A, Eckardt KU, Wiecek A, Vanholder R, ERA-EDTA ERBP Advisory Board: Anaemia management in patients with chronic kidney disease: a position statement by the Anaemia Working Group of European Renal Best Practice (ERBP). Nephrol Dial Transplant. 2009, 24: 2288-10.1093/ndt/gfp202.View ArticleGoogle Scholar
- Port FK, Pisoni RL, Bommer J, Locatelli F, Jadoul M, Eknoyan G, Kurokawa K, Canaud BJ, Finley MP, Young EW: Improving outcomes for dialysis patients in the international Dialysis Outcomes and Practice Patterns Study. Clin J Am Soc Nephrol. 2006, 1: 246-255. 10.2215/CJN.01050905.View ArticlePubMedGoogle Scholar
- Uehlinger DE, Gotch FA, Sheiner LB: A pharmacodynamic model of erythropoietin therapy for uremic anemia. Clin Pharmacol Ther. 1992, 51: 76-89.Google Scholar
- Pérez-Ruixo JJ, Krzyzanski W, Hing J: Pharmacodynamic Analysis of Recombinant Human Erythropoietin Effect on Reticulocyte Production Rate and Age Distribution in Healthy Subjects. Clin. Pharmacokinet. 2008, 47: 399-415.View ArticlePubMedPubMed CentralGoogle Scholar
- Krzyzanski W, Pérez-Ruixo JJ: An Assessment of Recombinant Human Erythropoietin Effect on Reticulocyte Production Rate and Lifespan Distribution in Healthy Subjects. Pharmaceutical Research. 2007, 24: 758-772. 10.1007/s11095-006-9195-y.View ArticlePubMedGoogle Scholar
- Wiczling P, Ait-Oudhia S, Krzyzanski W: Flow Cytometric Analysis of Reticulocyte Maturation After Erythropoietin Administration in Rats. Cytometry A. 2009, 75: 584-592.View ArticlePubMedGoogle Scholar
- Ramakrishnan R, Cheung WK, Wacholtz MC, Minton N, Jusko WJ: Pharmacokinetic and Pharmacodynamic Modeling of Recombinant Human Erythropoietin After Single and Multiple Doses in Healthy Volunteers. J Clin Pharmacol. 2004, 44: 991-1002. 10.1177/0091270004268411.View ArticlePubMedGoogle Scholar
- Pradella M, Cavill I, D'Onofrio G: Assessing erythropoiesis and the effect of erythropoietin therapy in renal disease by reticulocyte counting. Clin Lab Haematol. 1996, 18: 35-37.PubMedGoogle Scholar
- Arneson TJ, Zaun D, Peng Y, Solid CA, Dunning S, Gilbertson DT: Comparison of methodologies to characterize haemoglobin variability in the US Medicare haemodialysis population. Nephrology Dialysis Transplantation. 2009, 24: 1378-1383. 10.1093/ndt/gfp018.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2369/12/11/prepub