Search JIM Advanced Search

Journal of Chinese Integrative Medicine ›› 2010, Vol. 8 ›› Issue (4): 301-306.doi: 10.3736/jcim20100401

Special Issue: Traditional Chinese Medicine

• Review •     Next Articles

Real-world study: A potential new approach to effectiveness evaluation of traditional Chinese medicine interventions

Feng Tian , Yan-ming Xie   

  1. Institute of Basic Research in Chinical Medicine, China Academy of Chinese Medical Sciences, Beijing 100700, China
  • Received:2009-11-12 Accepted:2010-03-03 Online:2010-04-20 Published:2010-04-15
  • Contact: Yan-ming Xie

Some conclusions drawn from explanatory randomized controlled trial (ERCT) lack practical value in application under real-world clinical settings, and there are also some limitations on the generalization of pragmatic randomized controlled trial (PRCT) results. In some countries, real-world studies (RWSs) have been conducted to explore the effectiveness and safety of clinical interventions or postmarketing drugs, which is a new tendency in clinical researches. By reviewing some RWSs carried out in Western countries, we sum up the basic characteristics of the research design, and discuss the differences and connections between PRCT and RWS. The design ideas of RWS are different from PRCT. Researchers in RWS tend to perform long-term evaluation based on large quantities of subjects and quite large sample and focus on outcome measures which are clinically meaningful. Strict control on data collection, management and analysis are very important to RWS and PRCT. Owing to the complexity of clinical interventions and evaluation, PRCT is not completely suitable for clinical researches in traditional Chinese medicine (TCM). It is an inevitable tendency to apply RWS in clinical trials of TCM. We can explore the efficacy of TCM interventions through PRCT, and better understand the effectiveness through RWS. RWS will become a powerful approach to TCM clinical trials and postmarketing evaluation of Chinese medicines.

Key words: Real-world study, Randomized controlled trial, Chinese herbal drug, Investigational new drug, Drug evaluation

[1] Sharpe N . Clinical trials and the real world: selection bias and generalisability of trial results[J]. Cardiovasc Drugs Ther, 2002,16(16):75-77
doi: 10.1023/A:1015327801114
[2] Grapow MT, von Wattenwyl R, Guller U, Beyersdorf F, Zerkowski HR . Randomized controlled trials do not reflect reality: real-world analyses are critical for treatment guidelines[J]. J Thorac Cardiovasc Surg, 2006,132(1):5-7
doi: 10.1016/j.jtcvs.2006.03.035
[3] Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M , Seguin R. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity[J]. BMC Med Res Methodol, 2003, 3(): 28
[4] Karanicolas PJ, Montori VM, Devereaux PJ, Schünemann H, Guyatt GH . A new “mechanistic-practical” framework for designing and interpreting randomized trials[J]. J Clin Epidemiol, 2009,62(5):479-484
doi: 10.1016/j.jclinepi.2008.02.009
[5] Fox KAA . An introduction to the global registry of acute coronary events[J]. GRACE. Eur Heart J, 2000,2(Suppl F):F21-F24
[6] Mossello E, Tonon E, Caleri V, Tilli S, Cantini C, Cavallini MC, Bencini F, Mecacci R, Marini M, Bardelli F, Sarcone E, Razzi E, Biagini CA, Masotti G . Effectiveness and safety of cholinesterase inhibitors in elderly subjects with Alzheimer's disease: a “real world” study[J]. Arch Gerontol Geriatr Suppl, 2004,( 9):297-307
[7] Cazzoletti L, Marcon A, Janson C, Corsico A, Jarvis D, Pin I, Accordini S, Almar E, Bugiani M, Carolei A, Cerveri I, Duran-Tauleria E, Gislason D, Gulsvik A, Jogi R, Marinoni A, Martinez-Moratalla J , Vermeire P, de-Marco R. Asthma control in Europe: a real-world evaluation based on an international population-based study[J]. J Allergy Clin Immunol, 2007,120(6):1360-1367
doi: 10.1016/j.jaci.2007.09.019
[8] Gale CP, Manda SOM, Batin PD, Weston CF, Birkhead JS, Hall AS . Predictors of in-hospital mortality for patients admitted with ST-elevation myocardial infarction: a real-world study using the Myocardial Infarction National Audit Project(MINAP) database[J]. Heart, 2008,94(11):1407-1412
doi: 10.1136/hrt.2007.127068
[9] Lasalvia A, Bonetto C, Cristofalo D, Tansella M, Ruggeri M . Predicting clinical and social outcome of patients attending real world mental health services: a 6-year multi-wave follow-up study[J]. Acta Psychiatr Scand Suppl, 2007,( 437):16-30
[10] Gartlehner G, Hansen RA, Nissman D, Lohr KN, Carey TS . A simple and valid tool distinguished efficacy from effectiveness studies[J]. J Clin Epidemiol, 2006,59(10):1040-1048
doi: 10.1016/j.jclinepi.2006.01.011
[11] Fleischhacker WW, Goodwin GM . Effectiveness as an outcome measure for treatment trials in psychiatry[J]. World Psychiatry, 2009,8(1):23-27
doi: 10.1002/wps.2009.8.issue-1
[12] Magliano L, Fiorillo A, Malangone C, Rosa CD, Maj M . Patient functioning and family burden in a controlled, real-world trial of family psychoeducation for schizophrenia[J]. Psychiatr Serv, 2006,57(12):1784-1791
doi: 10.1176/ps.2006.57.12.1784
[13] Vidal JS, Lacombe JM, Dartigues JF, Pasquier F, Robert P, Tzourio C, Alpérovitch A . Memantine therapy for Alzheimer disease in real-world practice: an observational study in a large representative sample of French patients[J]. Alzheimer Dis Assoc Disord, 2008,22(2):125-130
doi: 10.1097/WAD.0b013e31815a9e10
[14] Kraemer HC . “Rules” of evidence in assessing the efficacy and effectiveness of treatments[J]. Dev Neuropsychol, 2003,24(2-3):705-718
doi: 10.1207/S15326942DN242&3_09
[15] GRACE Investigators . Rationale and design of the GRACE(Global Registry of Acute Coronary Events) project: a multinational registry of patients hospitalized with acute coronary syndromes[J]. Am Heart J, 2001,141(2):190-199
doi: 10.1067/mhj.2001.112404
[16] Farahani P, Levine M, Gaebel K, Khalidi N, Wang ECY . Community-based evaluation of etanercept in patients with rheumatoid arthritis[J]. J Rheumatol, 2006,33(4):665-670
[17] Nash JM , McCrory D, Nicholson RA, Andrasik F. Efficacy and effectiveness approaches in behavioral treatment trials[J]. Headache, 2005,45(5):507-512
doi: 10.1111/hed.2005.45.issue-5
[18] Ernst E, Canter PH . Limitations of “pragmatic” trials[J]. Postgrad Med J, 2005,81(954):203
doi: 10.1136/pgmj.2004.026807
[19] Simon G, Wagner E, Vonkorff M . Cost-effectiveness comparisons using “real world” randomized trials: the case of antidepressant drugs[J]. J Clin Epidemiol, 1995,48(3):363-373
doi: 10.1016/0895-4356(94)00141-C
[1] Chiung-Hui Huang, Mei-Ling Yeh, Fang-Pey Chen, Daphne Wu. Low-level laser acupuncture reduces postoperative pain and morphine consumption in older patients with total knee arthroplasty: A randomized placebo-controlled trial. Journal of Integrative Medicine, 2022, 20(4): 321-328.
[2] Maryam Azimi, Hanieh Niayesh, Mahboobeh Raeiszadeh, Sedigheh Khodabandeh-shahraki. Efficacy of the herbal formula of Foeniculum vulgare and Rosa damascena on elderly patients with functional constipation: A double-blind randomized controlled tria. Journal of Integrative Medicine, 2022, 20(3): 230-236.
[3] Ubiratan Cardinalli Adler, Maristela Schiabel Adler, Ana Elisa Madureira Padula, Livia Mitchiguian Hotta, Amarilysde Toledo Cesar, José Nelson Martins Diniz, Helen de Freitas Santos, Edson Zangiacomi Martinez. Homeopathy for COVID-19 in primary care: A randomized, double-blind, placebo-controlled trial (COVID-Simile study). Journal of Integrative Medicine, 2022, 20(3): 221-229.
[4] Xin Wang, Wen-juan Song, Yi Ruan, Bing-chu Li, Can Lü, Nian Huang, Fan-fu Fang, Wei Gu. Core muscle functional strength training for reducing the risk of low-back pain in military recruits: An open-label randomized controlled trial. Journal of Integrative Medicine, 2022, 20(2): 145-152.
[5] Meng-zhu Zhao, Chen Zhao, Shuang-shuang Tu, Xu-xu Wei, Hong-cai Shang. Evaluating the methodology of studies conducted during the global COVID-19 pandemic: A systematic review of randomized controlled trials. Journal of Integrative Medicine, 2021, 19(4): 317-326.
[6] Si-chun Gu, Jie Zhou, Qing Ye, Can-xing Yuan. Pingchan granule for depressive symptoms in Parkinson’s disease: A randomized, double-blind, placebo-controlled trial. Journal of Integrative Medicine, 2021, 19(2): 120-128.
[7] Jie Wu, Shu-wei Duan, Hong-tao Yang, Yue-yi Deng, Wei Li, Ya-ni He, Zhao-hui Ni, Yong-li Zhan, Shan Lin, Zhi-yong Guo, Jun Zhu, Jing-ai Fang, Xu-sheng Liu, Li-hua Wang, Rong Wang, Nian-song Wang, Xiao-hong Cheng, Li-qun He, Ping Luo, Shi-ren Sun s, Ji-feng Sun, Ai-ping Yin, Geng-ru Jiang, Hong-yu Chen, Wen-hu Liu, Hong-li Lin, Meng Liang, Lu Ma, Ming Chen, Li-qun Song, Jian Chen, Qing Zhu, Chang-ying Xing, Yun Li, Ji-ning Gao, Rong-shan Li, Ying Li, Hao Zhang, Ying Lu, Qiao-ling Zhou, Jun-zhou Fu, Qiang He, Guang-yan Cai, Xiang-mei Chen. Efficacy and safety of Shenyankangfu Tablet, a Chinese patent medicine, for primary glomerulonephritis: A multicenter randomized controlled trial. Journal of Integrative Medicine, 2021, 19(2): 111-119.
[8] Xian Wang, Xuan Yin, Xiu-tian Guo, Yan Wang, Wen-qi Jin, Ai-jun Mao, Lixing Lao, Zhang-jin Zhang, Jie Zhang, Shi-fen Xu. Effects of the pestle needle therapy, a type of acupoint stimulation, on post-hemorrhoidectomy pain: A randomized controlled trial. Journal of Integrative Medicine, 2020, 18(6): 492-498.
[9] Sherman Gu, Arthur Yin Fan. Controversial conclusions from two randomized controlled trials for acupuncture's effects on polycystic ovary syndrome or in vitro fertilization support. Journal of Integrative Medicine, 2020, 18(2): 89-91.
[10] Gerli E.G. Herr, Fábio Goulart da Silva, Francisco José Cidral-Filho, Fabricia Petronilho, Lucinéia Gainski Danielski, Mariana Pereira de Souza Goldim, Afonso Shiguemi Inoue Salgado, Franciane Bobinski, Daniel Fernandes Martins, Eliane R. Winkelmann. Effects of the use of bioceramic wraps in patients with lower limb venous ulcers: A randomized double-blind placebo-controlled trial. Journal of Integrative Medicine, 2020, 18(1): 27-.
[11] Xin-yu Yue, Zhuo-qi Feng, Xi-yi Yu, Jia-min Hu, Xiao-Jing He, Shi Shu. Fire-needle acupuncture for upper limb spastic paralysis after stroke: Study protocol for a randomized controlled trial. Journal of Integrative Medicine, 2019, 17(3): 167-172.
[12] Pádraic J.Dunne, Julie Lynch, Lucia Prihodova, Caoimhe O'Leary, Atiyeh Ghoreyshi, Sharee A. Basdeo, Donal J.Cox, Rachel Breen, Ali Sheikhi, Áine Carroll, Cathal Walsh, Geraldine McMahon, Barry White. Burnout in the emergency department: Randomized controlled trial of an attention-based training program. Journal of Integrative Medicine, 2019, 17(3): 173-180.
[13] Ya-ru Huangfu, Wei Peng, Bao-jun Guo, Zhi-fu Shen, Li Li, Shi-wei, Liu, Hui Zheng, You-ping Hu. Effects of acupuncture in treating insomnia due to spleen-stomach disharmony syndrome and its influence on intestinal microbiome: Study protocol for a randomized controlled trial. Journal of Integrative Medicine, 2019, 17(3): 161-167.
[14] J.M. Oliver-Baxter, H.S. Whitford, D.A. Turnbull, M.J. Bond. Effects of vitamin supplementation on inflammatory markers and psychological wellbeing among distressed women: A randomized controlled trial. Journal of Integrative Medicine, 2018, 16(5): 322-328.
[15] Parunkul Tungsukruthai, Preecha Nootim, Wiwan Worakunphanich, Nareerat Tabtong. Efficacy and safety of herbal steam bath in allergic rhinitis: A randomized controlled trial. Journal of Integrative Medicine, 2018, 16(1): 39-44.
Full text



[1] Wei-xiong Liang. Problems-solving strategies in clinical treatment guideline for traditional Chinese medicine and integrative medicine. Journal of Chinese Integrative Medicine, 2008, 6(1): 1-4
[2] Zhao-guo Li. Discussion on English translation of commonly used sentences in traditional Chinese medicine: part one. Journal of Chinese Integrative Medicine, 2008, 6(1): 107-110
[3] Jun Hu, Jian-ping Liu. Non-invasive physical treatments for chronic/recurrent headache. Journal of Chinese Integrative Medicine, 2008, 6(1): 31
[4] Xue-mei Liu, Qi-fu Huang, Yun-ling Zhang, Jin-li Lou, Hong-sheng Liu, Hong Zheng. Effects of Tribulus terrestris L. saponion on apoptosis of cortical neurons induced by hypoxia-reoxygenation in rats. Journal of Chinese Integrative Medicine, 2008, 6(1): 45-50
[5] . Uniform requirements for manuscripts submitted to biomedical journals: Writing and editing for biomedical publication (Chinese version, part two). Journal of Chinese Integrative Medicine, 2010, 8(11): 1001-1005
[6] Daniel Weber, Janelle M Wheat, Geoffrey M Currie. Inflammation and cancer: Tumor initiation, progression and metastasis,and Chinese botanical medicines. Journal of Chinese Integrative Medicine, 2010, 8(11): 1006-1013
[7] Hong Liu , Guo-liang Zhang, Li Shen , Zhen Zeng, Bao-luo Zhou, Cheng-hai Liu, Guang Nie . Application and evaluation of a pseudotyped virus assay for screening herbs for anti-H5Nl avian influenza virus. Journal of Chinese Integrative Medicine, 2010, 8(11): 1036-1040
[8] Zhao-guo Li . A discussion of English translation of 1995 and 1997 Chinese National Standards of Traditional Chinese Medical Terminologies for Clinical Diagnosis and Treatment. Journal of Chinese Integrative Medicine, 2010, 8(11): 1090-1096
[9] Rui Jin, Bing Zhang. A complexity analysis of Chinese herbal property theory: the multiple formations of herbal property (Part 1). Journal of Chinese Integrative Medicine, 2012, 10(11): 1198-1205
[10] Hui-min Liu, Xian-bo Wang, Yu-juan Chang, Li-li Gu. Systematic review and meta-analysis of randomized controlled trials of integrative medicine therapy for treatment of chronic severe hepatitis. Journal of Chinese Integrative Medicine, 2012, 10(11): 1211-1228