Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

The risk of bleeding for antiplatelet agents in Haemodialysis patients: a Meta-analysis

BMC Nephrology volume 21, Article number: 106 (2020) Cite this article

Abstract

Background

The safety of antiplatelet therapy in haemodialysis (HD) patients remains controversial. we conducted the first meta-analysis to evaluate the bleeding risk with antiplatelet agents in these populations.

Methods

The relevant literature was searched using the following electronic databases without any language restrictions: the Cochrane Library, EMBASE, Global Health, MEDLINE, PubMed, and the Chinese Biomedical Database.

Results

Seven randomized controlled trials (RCTs) and 2 prospective cohort studies, consisting of 1131 patients, were identified for detailed evaluation. The meta-analysis suggested that the use of double antiplatelet agents increased the risk of bleeding in HD patients [odds ratio (OR) = 2.78; 95% confidence interval (CI) 1.63 to 4.76; I2 = 0], and antiplatelet agents increased the risk of bleeding in 7 RCTs [odds ratio (RR) = 1.40, 95% CI 1.08 to 1.79; I2 = 23%,]; however, the use of a single antiplatelet agent was not found to significantly increase the risk of bleeding (RR = 0.88; 95% CI 0.51 to 1.50; I2 = 0).

Conclusion

The results suggested that the use of double antiplatelet agents increased the risk of bleeding in HD patients.

Peer Review reports

Background

More than 2 million people require maintenance haemodialysis (HD) globally, and this number is increasing by approximately 10% each year [1]. At least half of all patients starting dialysis therapy have overt cardiovascular disease (CVD) [2]. Antiplatelet agents, especially aspirin, have been used as primary and secondary prevention for CVD. Further, antiplatelet agents in haemodialysis patients are also used as a routine treatment to prevent ischaemic events after percutaneous intervention and are prescribed to prevent arteriovenous graft thrombosis [3]. HD patients are generally believed to have an increased risk of haemorrhage due to platelet dysfunction and altered platelet-vessel wall interactions, in addition to the factors that inhibit normal platelet adhesion and aggregation [4,5,6]. The risk of bleeding is especially high in HD patients because of the use of heparin during dialysis. Moreover, long-term therapy with aspirin is associated with a significant increase in the risk of haemorrhage [7].

Studies on antiplatelet agents evaluating the bleeding risk for HD patients have produced inconsistent results. Several cohort studies [8,9,10] showed that the risk of bleeding among antiplatelet agents remained unchanged in HD patients. In contrast, Eduardo et al. [11] found that antiplatelet agents were correlated with a significantly increased risk of bleeding. Although there has been no meta-analysis on the use of antiplatelet agent therapy for HD patients thus far, a systematic review by Hiremath et al. [12] suggested that the risks and benefits of antiplatelet agent treatment in HD patients remain poorly defined. In addition, the risk of bleeding in HD patients appears to be related to the number of antiplatelet agents used.

Therefore, we conducted the first meta-analysis to evaluate the bleeding risk of HD patients treated with antiplatelet agents, which specially aimed to explore the impact of the combined use of antiplatelet agents on bleeding risk in HD patients.

Literature search

Relevant articles were collected using the following electronic databases: the Cochrane Library, EMBASE, Global Health, MEDLINE, PubMed, and the Chinese Biomedical Database from the building time of the database to July 2018. Keywords included: “anticoagulants” or “anticoagulation agents” or “anticoagulant agents” or “anticoagulant drugs” and “hemodialysis” or “hematodialysis” or “dialysis” or “dialyze” or “dialyse” or “dialys” and “bleeding” or “hemorrhage”. Abstracts, citation titles and the related research references were independently reviewed at the same time.

Study criteria

The studies were included if they met the following criteria: (a) the study design should be a clinical cohort or prospective cohort that included thirty or more haemodialysis patients, (b) studies had three or more follow-up months to ensure that bleeding rates were related to antiplatelet exposure, and (c) studies also had to have assessed bleeding risk with antiplatelet agent treatment. The exclusion criteria were: (a) duplication, (b) studies of patients with peritoneal dialysis or who had recovered renal function and had transferred out of the dialysis programme, and (c) studies such as systemic reviews, meta-analyses, comments, retrospective studies, case reports, and animal experimental studies.

Data extraction

Two evaluators (QW and XX) independently extracted the data. We searched all potentially eligible citations to identify studies that met the criteria. Discrepancies were settled by a meeting consensus. Disagreements regarding the extracted data were solved through debate to reach a consensus. The details of the selection process are shown in Fig. 1a. Data extraction included the first author’s last name, year of publication, the control group, intervention measures, bleeding events (definition of bleeding events and number of bleeding events), number of patients, study duration and study quality.

Fig. 1
figure 1

a. Flow diagram of the search results and selection of studies; b. Risk of bias summary

Full size image

Assessment of study quality

A Review Manager (version 5.3) risk-of-bias assessment to evaluate study quality for the randomized controlled trials (RCTs) was conducted and included four sections: selection, performance/detection, attrition and reporting bias (Fig. 1b). The Newcastle–Ottawa quality assessment scale (range 0 to 9 stars) was used to evaluate the prospective study quality (Table 1). Stars were awarded for cohort studies after evaluation of selection, comparability and outcomes. A study could be given a maximum of two stars for comparability. No more than one star could be awarded for selection and exposure categories [22].

Table 1 Included studies of antiplatelet use in HD patients: Study design, treatments, intervention, bleeding events (A: Aspirin P: Placebo S: Sulfinpyrazone C: Control Cl: Clopidogrel A + Cl: Aspirin + Clopidogrel D: Dipyramidole A + D Aspirin + Dipyramidole)
Full size table

Statistical analysis

The data were calculated by Review Manager (version 5.3) and STATA statistical software (version 12.0). Estimations of effect were summarized by forest plots, which data was expressed as risk ratios (RRs) with 95% confidence intervals (CIs) for dichotomous outcomes. Heterogeneity was estimated by using Q statistic and I2 tests (I2 > 50, 25% < I2 < 50%, and I2 < 25% represent high heterogeneity, moderate, and mild, respectively) [22]. A random-effects model was applied to process data with light heterogeneity in the results, whereas a fixed-effects model was adopted to process data in poor heterogeneity. In all statistical tests, a P ≤ 0.05 was used to indicate significance. We performed sensitivity and subgroup analyses to investigate the sources of heterogeneity. Publication bias and the differences in the studies were explored by using Begg’s and Egger’s funnel plots. Meta-regression was applied to test the variables such as the study design and the number of antiplatelet agents used. When zero occurrs in the counting data, in RevMan 5.3 software the automatic default is 0.5, which does not affect the results of RR and risk difference (RD) [23].

Results

Characteristics and quality of the included studies

Nine clinical trials [13–21] with 1131 patients ultimately met the inclusion criteria (Fig. 1a). These included 7 RCTs [13–17, 20, 21] and 2 prospective cohort studies [18, 19]. Two of the RCTs had a crossover design, and one of them (Kaegi) occurred the bleeding events only in the initial phase before crossover. The other study (Kooistra) had a one-week washout period. Single antiplatelet agents (including aspirin, ticlopidine, clopidogrel, sulfinpyrazone or dipyridamole) were used in 7 studies [13, 14, 16–20]. Double antiplatelet agents were used as an intervention group in 3 studies [15, 20, 21]. The methodological quality and characteristics of all the included studies are shown in Table 1.

Antiplatelet use with the bleeding risk

A total of 628 out of 1131participants in 9 studies received antiplatelet agents. There was statistical heterogeneity between the studies (I2 = 49%, P = 0.03, Fig. 2a); thus, a random-effects model was selected. The results indicated that the use of antiplatelet drugs and the risk of bleeding were not statistically significant (RR = 1.18, 95% CI 0.73 to 1.91; P = 0.50). A total of 455 out of 673 participants in 7 RCTs [13–17, 20, 21] received antiplatelet agents. There was no statistical heterogeneity between the included studies (I2 = 23%, P = 0.24, Fig. 2b); thus, a fixed-effects model was selected. The results indicated that the use of antiplatelet agents increased the risk of bleeding (RR = 1.40, 95% CI 1.08 to 1.79; P = 0.009). Subgroup analysis was necessary to clarify the source of the high heterogeneity that we identified and to increase the reliability of the results.

Fig. 2
figure 2

a. Forest plots of all 9 studies showing the bleeding risk of antiplatelet agent use in HD patients; b. Forest plots of 7 RCTs showing the bleeding risk of antiplatelet agent use in HD patients

Full size image

Subgroup analysis of antiplatelet agents

A subgroup analysis based on the number of antiplatelet agents (Fig. 3a) found that the use of double antiplatelet agents increased the risk of bleeding in HD patients (RR = 2.78; 95% CI 1.63 to 4.76; I2 = 0), while use of a single antiplatelet agent was not significantly associated with the risk of increased bleeding [RR = 1.08; 95% CI 0.53 to 2.19; I2 = 62]. Another subgroup analysis based on the number of antiplatelet agents in 7 RCTs (Fig. 3b) demonstrated that the use of double antiplatelet agents increased the risk of bleeding in HD patients (RR = 1.69; 95% CI 1.28 to 2.25; I2 = 0), while the use of a single antiplatelet agent and the risk of bleeding were not statistically significant (RR = 0.88; 95% CI 0.51 to 1.50; I2 = 0). An additional subgroup meta-analysis of aspirin monotherapy vs placebo (Fig. 3c) found that aspirin monotherapy and the risk of bleeding was not statistically significant (RR = 0.82; 95% CI 0.39 to 1.37; I2 = 50). Moreover, when all studies other than Kauffman 2003 were considered, antiplatelet agents and the risk of bleeding were still not statistically significant (RR = 1.05; 95% CI 0.62 to 1.79; I2 = 30, Fig. 4a). Additionally, antiplatelet agents and the risk of bleeding were not statistically significant (RR = 1.05; 95% CI 0.65 to 1.72; I2 = 7, Fig. 4b) in 6 RCTs when Kaufman 2003 was excluded.

Fig. 3
figure 3

a. Subgroup analysis of the use of a single antiplatelet agent or two antiplatelet agents and the risk of stroke in haemodialysis patients in all 9 studies; b. Subgroup analysis of the use of a single antiplatelet agent or two antiplatelet agents and the risk of bleeding in haemodialysis patients in 7 RCTs; c. Subgroup analysis of aspirin monotherapy and the risk of bleeding in haemodialysis patients

Full size image
Fig. 4
figure 4

a. Subgroup analysis of the use of antiplatelet agents and the risk of bleeding in haemodialysis patients when all studies other than Kauffman 2003 were considered; b. Subgroup analysis of the use of antiplatelet agents and the risk of bleeding in haemodialysis patients in 6 RCTs when Kaufman 2003 was excluded

Full size image

Sensitivity analyses and publication bias

Sensitivity analyses were carried out considering the bleeding risk in haemodialysis patients. There were significant effects on the results of the HR and 95% CI when the Kaufman et al. [15] study was excluded (Fig. 5a), indicating that this study had high sensitivity and poor stability. To detect publication bias, Egger’s and Begg’s test funnel plots were used (Fig. 5b). There was no evidence of substantial publication bias according to Egger’s linear regression test (P > 0.987) and Begg’s rank correlation test (Pr > |z| = 0.243) in this meta-analysis.

Fig. 5
figure 5

a. Sensitivity analyses of the bleeding risk of antiplatelet agent use in haemodialysis

patients; b. Publication bias according to Egger’s and Begg’s test funnel plots.

Full size image

Sources of heterogeneity and meta-regression

Meta-regression was performed to explore the sources of heterogeneity. The relationship between antiplatelet agents and the risk of bleeding was not influenced by study design (P = 0.654, Fig. 6a). However, the number of antiplatelet agents used showed impact on the bleeding risk in HD patients (P = 0.021, Fig. 6b).

Fig. 6
figure 6

a. Meta-regression based on study design about the association between antiplatelet use and the risk of bleeding; b. Meta-regression based on the number of antiplatelet agents used and the association between antiplatelet use and the risk of bleeding

Full size image

Discussion

The type of antiplatelet agen and the prescribed number of antiplatelet agents appear to be related to the bleeding risk for HD patients [12]. In HD patients, antiplatelet agents may lead to more bleeding events because of platelet dysfunction and differences in haemodynamic stability [24]. More importantly,the standard of care for patients with acute coronary syndrome and undergoing percutaneous coronary intervention is the combination of two antiplatelet agents, partially because of the results of the CURE study [25, 26]. This meta-analysis included 9 articles involving 1131 hemodialysis patients, we found that HD patients have an increased risk of bleeding due to the use of double antiplatelet agents However, while the point estimate for the studies (aspirin + dipyramidole) suggests risk, they contributed only 12.5% of the weight to the meta-analysis. Thus, aspirin + clopidogrel confers a bleeding risk, and aspirin + dipyramidole might also confer a bleeding risk. Furthermore, use of a single antiplatelet agent did not appear to be associated with bleeding risk in the subgroup analysis.

To explore the sources of the heterogeneity, we performed the subgroup analysis based on the study design and the number of antiplatelet agents. The former was not statistically significant, but the latter was statistically significant. Second, Kaufman et al. [15] might be one of the main sources of heterogeneity. Because Kaufman et al. [15] had the best scientific rigor, we posit that the source of heterogeneity was dosage and the combination of antiplatelet agents. Egger’s and Begg’s test funnel plots showed no publication bias in this meta-analysis. Finally, the meta-regression included two variables that study design and number of platelet agents. Study design was not heterogenous, but the number of platelet agents could affect the heterogeneity. Moreover, regarding the high heterogeneity, the type of antiplatelet agent might affect the heterogeneity.

There were several limitations to our study. First, the classes of antiplatelet agents and intensities of platelet inhibition were different. Second, the definition of bleeding complications was not consistent in the included studies, which might lead to the different bleeding risk in HD patients. Third, there was lack of large randomized clinical trials in our research, which should be further explored and confirmed. Fourth, patients on dialysis treated with heparin may have increased the bleeding risk.

Conclusion

In conclusion, we performed the first meta-analysis assessing the bleeding risk associated with the use of antiplatelet agents in HD patients. The results suggested that double antiplatelet agents should not be recommended for routine treatment in HD patients, especially the combination of aspirin + clopidogrel. In contrast, single antiplatelet agents were not found to significantly increase the risk of bleeding.

Availability of data and materials

All data generated and analysed during this study are included in this published article.

Abbreviations

HD:

Haemodialysis

RCTs:

Randomized controlled trials

OR:

Odds ratio

RR:

Risk ratio

CI:

Confidence interval

CVD:

Cardiovascular disease

RD:

Risk difference

References

  1. Grassmann A, Gioberge S, Moeller S, Brown G. ESRD patients in 2004: global overview of patient numbers, treatment modalities and associated trends. Nephrol Dial Transplant. 2005;20(12):2587–93.

    Article  Google Scholar 

  2. Foley RN, Parfrey PS, Sarnak MJ. Clinical Epidemiology of Cardiac Disease in Dialysis Patients: Left Ventricular Hypertrophy, Ischemic Heart Disease, and Cardiac Failure. Semin Dial. 2003;16(2):111–7.

    Article  Google Scholar 

  3. Coleman CI, Tuttle LA, Teevan C, et al. Antiplatelet agents for the prevention of arteriovenous fistula and graft thrombosis: a meta analysis. Int J Clin Pract. 2010;64(9):1239.

    Article  CAS  Google Scholar 

  4. Bigger J, Remmers A Jr, Glassford D. The risk of anticoagulation in hemodialysis patients. Nephron. 1977;18:109–13.

    Article  Google Scholar 

  5. McMahan DA, Smith DM, Carey MA, Zhou XH. Risk of major hemorrhage for outpatients treated with warfarin. J Gen Intern Med. 1998;13:311–6.

    Article  CAS  Google Scholar 

  6. Sachdev GP, Ohlrogge KD, Johnson CL. Review of the fifth American College of Chest Physicians Consensus Conference on antithrombotic therapy: outpatient management for adults. Am J Health Syst Pharm. 1999;56:1505–14.

    Article  CAS  Google Scholar 

  7. Derry S, Loke YK. Risk of gastrointestinal haemorrhage with long term-use of aspirin: meta analysis. BMJ. 2000;321:1183–7.

    Article  CAS  Google Scholar 

  8. Wasse H, Gillen DL, Ball AM, Kestenbaum BR, Seliger SL, Sherrard D, Stehman-Breen CO. Risk factors for upper gastrointestinal bleeding among end-stage renal disease patients. Kidney Int. 2003;64:1455–61.

    Article  Google Scholar 

  9. Abdul-Rahman IS, Al-Howaish AK. Warfarin versus aspirin in prevention tunneled hemodialysis catheter thrombosis: a prospective randomized study. Hong Kong J Nephrol. 2007;9:23–30.

    Article  CAS  Google Scholar 

  10. Trimarchi H, Young P, Forrester M, Schropp J, Pereyra H, Freixas E. Clopidogrel diminishes hemodialysis access graft thrombosis. J Vasc Access. 2005;6:29–33.

    Article  CAS  Google Scholar 

  11. Lanas A, Bajador E, Serrano P, Fuentes J, Carreno S, Guardia J, et al. Nitrovasodilators, low-dose aspirin, other nonsteroidal antiinflammatory drugs, and the risk of upper gastrointestinal bleeding. N Engl J Med. 2000;343:834–9.

    Article  CAS  Google Scholar 

  12. Hiremath S, Holden RM, Fergusson D, Zimmerman DL. Antiplatelet medications in hemodialysis patients: a systematic review of bleeding rates. Clin J Am Soc Nephrol. 2009;4(8):1347–55. https://doi.org/10.2215/CJN.00810209.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Harter HR, Burch JW, Majerus PW, Stanford N, Delmez JA, Anderson CB, Weerts CA. Prevention of thrombosis in patients on hemodialysis by low-dose aspirin. N Engl J Med. 1979;301:577–9.

    Article  CAS  Google Scholar 

  14. Kaegi A, Pineo GF, Shimizu A, Trivedi H, Hirsh J, Gent M. The role of sulfinpyrazone in the prevention of arteriovenous shunt thrombosis. Circulation. 1975;52:497–9.

    Article  CAS  Google Scholar 

  15. Kaufman JS, O’Connor TZ, Zhang JH, Cronin RE, Fiore LD, Ganz MB, Goldfarb DS, Peduzzi PN. Veterans affairs cooperative study group on hemodialysis access graft thrombosis: for the veterans affairs cooperative study group on hemodialysis access graft thrombosis Randomized controlled trial of clopidogrel plus aspirin to prevent hemodialysis access graft thrombosis. J Am Soc Nephrol. 2003;14:2313–21.

    Article  CAS  Google Scholar 

  16. Kobayashi K, Maeda K, Koshikawa S, Kawaguchi Y, Shimizu N, Naito C. Antithrombotic therapy with ticlopidine in chronic renal failure patients on maintenance hemodialysis-A multicenter collaborative double blind study. Thromb Res. 1980;20:255–61.

    Article  CAS  Google Scholar 

  17. Kooistra MP, van Es A, Marx JJ, Hertsig ML, Struyvenberg A. Low-dose aspirin does not prevent thrombovascular accidents in low-risk hemodialysis patients during treatment with erythropoietin. Nephrol Dial Transplant. 1994;9:1115–20.

    Article  CAS  Google Scholar 

  18. Jun L, Pan Y, Chen L, Qiao QY, Wang J, Pan LH, et al. Low-dose aspirin for prevention of cardiovascular disease in patients on hemodialysis: a 5-y prospective cohort study. Hemodial Int. 2016;20(4):548.

    Article  Google Scholar 

  19. Obialo CI, Conner AC, Lebon LF. Maintaining patency of tunneled hemodialysis catheters. Scand J Urol Nephrol. 2003;37:172–6.

    Article  Google Scholar 

  20. Sreedhara R, Himmelfarb J, Lazarus JM, Hakim RM. Antiplatelet therapy in graft thrombosis: Results of a prospective, randomized, double-blind study. Kidney Int. 1994;45:1477–83.

    Article  CAS  Google Scholar 

  21. Pouya T, Gholamhosein K, Azin B, Hassan R. Effect of low dose aspirin and dipyridamole on primary patency of arteriovenous grafts in hemodialysis patients: a randomized double-blind placebo-controlled trial. Electron Physician. 2018;10(1):6135–9.

    Article  Google Scholar 

  22. Higgins JP, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ. 2003;327:557–60.

    Article  Google Scholar 

  23. Friedrich JO, Adhikari NKJ, Beyene J. Inclusion of zero total event trials in meta-analyses maintains analytic consistency and incorporates all available data. BMC Med Res Methodol. 2007;7:5.

    Article  Google Scholar 

  24. Daimon S, Terai H. Influence of antiplatelet medications on bleeding events in hemodialysis patients. Ther Apher Dial. 2011;15:454–9.

    Article  CAS  Google Scholar 

  25. Becker RC, Meade TW, Berger PB, Ezekowitz M, O’Connor CM, Vorchheimer DA, Guyatt GH, Mark DB, Harrington RA. American College of Chest Physicians: The primary and secondary prevention of coronary artery disease: American college of chest physicians evidence-based clinical practice guidelines. Chest. 2008;133:776–814.

    Article  Google Scholar 

  26. Casterella PJ, Tcheng JE. Review of the 2005 American college of cardiology, American heart association, and society for cardiovascular interventions guidelines for adjunctive pharmacologic therapy during percutaneous coronary interventions: Practical implications, new clinical data, and recommended guideline revisions. Am Heart. 2008;J155:781–90.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was supported by the National Natural Science Foundation of China (No. H0517/81560132), The National Natural Science Foundation of China (No. 81970583), the Supporting Project for the Foregoers of Main Disciplines of Jiangxi Province (No. 20162BCB22023), the Nature Science Foundation of Jiangxi Province (No. 20181BAB205016), and the “5511” Innovative Drivers for Talent Teams of Jiangxi Province (No. 20165BCB18018). None of the funders participated in or influenced the design of the study or collection, analysis and interpretation of data or writing of the manuscript.

Author information

Author notes

  1. Qi Wang and Xiaojie Xie contributed equally to this work.

Authors and Affiliations

  1. Department of Nephrology, the Second Affiliated Hospital of Nanchang University, No. 1, Minde Road, Donghu District, Nanchang, 330006, People’s Republic of China

    Qi Wang & Gaosi Xu

  2. Department of Nephrology, 908 Hospital of People’s Liberation Army, Yingtan, China

    Xiaojie Xie

Authors
  1. Qi Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaojie Xie
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gaosi Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

QW performed the literature search, reviewed articles, completed the data analysis and wrote the manuscript. XX reviewed the articles and provided secondary reviews during the manuscript preparation. GX designed the analysis and revised the manuscript. All authors have read and approved this information before submission.

Corresponding author

Correspondence to Gaosi Xu.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, Q., Xie, X. & Xu, G. The risk of bleeding for antiplatelet agents in Haemodialysis patients: a Meta-analysis. BMC Nephrol 21, 106 (2020). https://doi.org/10.1186/s12882-020-01757-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12882-020-01757-1

Keywords

BMC Nephrology

ISSN: 1471-2369

Contact us