Methodological quality of systematic reviews on orally administered Chinese herbal medicine published in Chinese between 2021 and 2022: A cross-sectional study

Abstract

Objective:This cross-sectional study assessed the methodological quality of systematic reviews (SRs) of Chinese herbal medicine (CHM) published in Chinese between Jan 2021 and Sep 2022.

Methods:Chinese language CHM SRs were identified through literature searches across 3 international and 4 Chinese databases. Methodological quality was appraised using A MeaSurement Tool to Assess systematic Reviews 2. Logistic regressions were used to explore associations between bibliographical characteristics and quality.

Results:Analyses of methodological quality found that among the 213 sampled SRs, 69.5% were of critically low quality, 30.5% were of low quality, and none achieved high or moderate quality. Common shortcomings included the failure to identify the studies excluded from the analysis, failure to disclose funding sources, and limited evaluation of the potential impact of bias on conclusions. Logistic regressions revealed that SRs led by corresponding authors affiliated with universities or academic institutions tended to be of lower quality than SRs led by authors affiliated with hospitals or clinical facilities.

Conclusion:Recent Chinese language CHM SRs exhibited limited methodological quality, making them unlikely to support the development of clinical practice guidelines. Urgent initiatives are needed to enhance training for researchers, peer-reviewers and editors involved in the preparation and publication of SRs. Adoption of Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines in Chinese language journals is crucial to improve the relevance of SRs for Chinese medicine development. Addressing deficiencies in methodology and reporting is essential for promoting evidence-based practices and informed clinical decisions in Chinese medicine. Please cite this article as: Jiang Y, Zhong CC, Wang BH, Xu SS, Ho FF, Kwong MH, Ho L, Zhou JHS, Lam KC, Liu JP, Zhang BT, Chung VCH. Methodological quality of systematic reviews on orally administered Chinese herbal medicine published in Chinese between 2021 and 2022: A cross-sectional study. J Integr Med. 2025; 23(5):492-501.

Key words: Chinese herbal medicine, Systematic review, Randomized control trials, Methodology, Quality, Clinical practice guideline

Yue Jiang, Claire Chenwen Zhong, Betty Huan Wang, Shan-Shan Xu, Fai Fai Ho, Ming Hong Kwong, Leonard Ho, Joson Hao-Shen Zhou, K C Lam, Jian-Ping Liu, Bao-Ting Zhang, Vincent Chi Ho Chung. Methodological quality of systematic reviews on orally administered Chinese herbal medicine published in Chinese between 2021 and 2022: A cross-sectional study. Journal of Integrative Medicine, 2025, 23(5): 492-501.

/ / Recommend

Add to citation manager EndNote| Reference Manager|ProCite|BibTeX|RefWorks

URL: http://www.jcimjournal.com/EN/

http://www.jcimjournal.com/EN/Y2025/V23/I5/492

[1]	Meng-qi Li, Yan Li, Winsome Lam, Wing Fai Yeung, Yuen Shan Ho, Jia-ying Li, Tsz Ching Sun, Sam Yuen, Yu-le Hu, Jannelle Yorke. Home-based acupressure for managing constipation and subjective well-being in spinal cord injury survivors: A randomized controlled trial. Journal of Integrative Medicine, 2025, 23(6): 660-669.
[2]	Xin-ran Du, Meng-yi Wu, Mao-can Tao, Ying Lin, Chao-ying Gu, Min-feng Wu, Yi Cao, Da-can Chen, Wei Li, Hong-wei Wang, Ying Wang, Yi Wang, Han-zhi Lu, Xin Liu, Xiang-fei Su, Fu-lun Li. Clinical practice guidelines for the diagnosis and treatment of atopic dermatitis with integrative traditional Chinese and Western medicine. Journal of Integrative Medicine, 2025, 23(6): 641-653.
[3]	Hong-jun Kuang, Hui-sheng Yang, Yi-xuan Feng, Han Tang, Qi Fan, Yu-qin Xu, Shuo Cui, Richard Musil, Hedi Luxenburger, Yi-xuan Zhang, Hong Zhao, Yu-qing Zhang. Efficacy and safety of acupuncture therapies for adult patients with mild and moderate major depressive disorder: A systematic review and meta-analysis. Journal of Integrative Medicine, 2025, 23(5): 471-491.
[4]	Wei Song Seetoh, Rachel Qin Rui Lim, Run-bing Xu, Ming-xun Sun, Peng Zhang, Mi-na Wang. Advancements and challenges of acupuncture randomized controlled trials. Journal of Integrative Medicine, 2025, 23(4): 333-343.
[5]	Jia Wen Chin, Rafidah Abdullah, Benjamin Wei Wang Tan, Koh Wei Wong, Ban-Hock Khor. Prevalence and patterns of complementary and alternative medicine usage among adults with chronic kidney disease: A systematic review and meta-analysis. Journal of Integrative Medicine, 2025, 23(4): 370-381.
[6]	Miranda Sin-Man Tsang, Iris Wenyu Zhou, Anthony Lin Zhang, Charlie Changli Xue. Chinese herbal medicine for dyspnea and persistent symptoms of long COVID: A systematic review and meta-analysis of randomized controlled trials. Journal of Integrative Medicine, 2025, 23(2): 126-137.
[7]	Han-yu Xu, Lin-na Wu, Yuan Zhang, Te Ba, Xiao-feng Zhao. Efficacy and safety of electroacupuncture for insomnia: A systematic review and meta-analysis. Journal of Integrative Medicine, 2024, 22(4): 459-472.
[8]	Betty H Wang, Ya-li Lin, Yin-yan Gao, Jin-lu Song, Lang Qin, Ling-qi Li, Wen-qi Liu, Claire CW Zhong, Mary Y Jiang, Chen Mao, Xiao-bo Yang, Vincent CH Chung, Irene XY Wu. Trial characteristics and treatment effect estimates in randomized controlled trials of Chinese herbal medicine: A meta-epidemiological study. Journal of Integrative Medicine, 2024, 22(3): 223-234.
[9]	Jia-jia Wu, Tian-yi Zhang, Ying-hui Qi, Min-yan Zhu, Yan Fang, Chao-jun Qi, Li-ou Cao, Ji-fang Lu, Bo-han Lu, Lu-min Tang, Jian-xiao Shen, Shan Mou. Efficacy and safety of Yiqi Peiyuan granules for improving the short-term prognosis of patients with acute kidney injury: A multicenter, double-blind, placebo-controlled, randomized trial. Journal of Integrative Medicine, 2024, 22(3): 279-285.
[10]	Shi-hao Du, Sheng Chen, Shan-ze Wang, Guan-qun Wang, Shuo Du, Wei Guo, Xiao-long Xie, Bi-hui Peng, Chao Yang, Ji-ping Zhao. Clinical practice guideline for acupuncture and moxibustion: Allergic rhinitis. Journal of Integrative Medicine, 2024, 22(3): 245-257.
[11]	Chao Yang, Shan-ze Wang, Sheng Chen, Shuo Du, Guan-qun Wang, Wei Guo, Xiao-long Xie, Bi-hui Peng, Shi-hao Du, Ji-ping Zhao. Clinical practice guideline for acupuncture and moxibustion: Female urinary incontinence. Journal of Integrative Medicine, 2024, 22(3): 258-269.
[12]	Miguel Faria, Mónica Teixeira, Maria João Pinto, Paulo Sargento. Efficacy of acupuncture on cancer pain: A systematic review and meta-analysis. Journal of Integrative Medicine, 2024, 22(3): 235-244.
[13]	Tian-tian Meng, Ya-ping You, Min Li, Jian-bo Guo, Xin-bin Song, Jing-yi Ding, Xiao-long Xie, An-qi Li, Shang-jin Li, Xiang-jun Yin, Peng Wang, Zhe Wang, Bao-liang Wang, Qing-yong He. Chinese herbal medicine Ginkgo biloba L. preparations for ischemic stroke: An overview of systematic reviews and meta-analyses. Journal of Integrative Medicine, 2024, 22(2): 163-179.
[14]	Zhen-yu Ma, Shu-ping Yang, Ying Li, Tian-tian Xu, Ya-lin Yang, Hui-yong Yang, Heng-bing Li, Le-jin Zhou, Yong Diao, Su-yun Li. Associations between the use of red yeast rice preparations and adverse health outcomes: An umbrella review of meta-analyses of randomized controlled trials. Journal of Integrative Medicine, 2024, 22(2): 126-136.
[15]	Zheng-gang Zhu, Jian-ru Wang, Xiao-yan Pan. Efficacy of scraping therapy on blood pressure and sleep quality in stage I and II essential hypertension: A systematic review and meta-analysis. Journal of Integrative Medicine, 2024, 22(1): 12-21.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 10

[1]	Arthur Yin Fan, Hui Ouyang, Xinru Qian, Hui Wei, David Dehui Wang, Deguang He, Haihe Tian, Changzhen Gong, Amy Matecki, Sarah Faggert Alemi. Discussions on real-world acupuncture treatments for chronic low-back pain in older adults. Journal of Integrative Medicine, 2019, 17(2): 71-76
[2]	Jia Xu, Fu-qing Zhang, Jian Pei, Jun Ji . Acupuncture for migraine without aura: A systematic review and meta-analysis. Journal of Integrative Medicine, 2018, 16(5): 312-321
[3]	Mostafa Araj-Khodaei, Javad Ghazi Sha'rbaf, Somaiyeh Taheri-Targhi, Reza Mohammadinasab. Letter to the editor regarding "Galen's place in Avicenna's The Canon of Medicine: Respect, confirmation and criticism". Journal of Integrative Medicine, 2020, 18(3): 274
[4]	Baoyi Shao, Saiying Hou, Yuenyan Chan, Changchun Shao, Lixing Lao. Remission of new-onset type 2 diabetes mellitus in an adolescent using an integrative medicine approach: A case report. Journal of Integrative Medicine, 2021, 19(1): 85-88
[5]	Chia-Wei Lin, Wei-Chen Hsu, Chien-Lu Lu, Su-Hsing Cheng, Cheng-Pin Chen, Yu-Chang Hou. Integrated therapeutic plasma exchange and traditional Chinese medicine treatment in a patient with severe COVID-19: A case report. Journal of Integrative Medicine, 2022, 20(6): 575-580
[6]	Rosemary Arnold, Jenifer Murphy-Smith, Chee H. Ng, David Mischoulon, Gerard J. Byrne, Chad A. Bousman, Con Stough, Michael Berk, Jerome Sarris. Predictors of the placebo response in a nutraceutical randomized controlled trial for depression. Journal of Integrative Medicine, 2024, 22(1): 46-53
[7]	the Hong Kong Polytechnic University, Hong Kong, China. Abstracts for SAR/RCMI PolyU International Research Conference . Journal of Integrative Medicine, 2024, 22(Virtual Topics): 300
[8]	. Abstracts for SAR/RCMI PolyU International Research Conference. Journal of Integrative Medicine, 2024, 22(3): 303-378
[9]	Mu He, Xue Yee Lim, Jing Li, Ling Li, Tong Zhang. Mechanisms of acupuncture at Zusanli (ST36) and its combinational acupoints for stress gastric ulcer based on the correlation between Zang-fu and acupoints . Journal of Integrative Medicine, 2025, 23(1): 1-11
[10]	Sheng-sheng Zhang, Lu-qing Zhao, Xiao-hua Hou, Zhao-xiang Bian, Jian-hua Zheng, Hai-he Tian, Guan-hu Yang, Won-sook Hong, et al. International clinical practice guideline on the use of traditional Chinese medicine for functional dyspepsia (2025). Journal of Integrative Medicine, 2025, 23(5): 502-518