Search JIM Advanced Search

Journal of Chinese Integrative Medicine ›› 2010, Vol. 8 ›› Issue (4): 301-306.doi: 10.3736/jcim20100401

Special Issue: Traditional Chinese Medicine

• Review •     Next Articles

Real-world study: A potential new approach to effectiveness evaluation of traditional Chinese medicine interventions

Feng Tian , Yan-ming Xie   

  1. Institute of Basic Research in Chinical Medicine, China Academy of Chinese Medical Sciences, Beijing 100700, China
  • Received:2009-11-12 Accepted:2010-03-03 Online:2010-04-20 Published:2010-04-15
  • Contact: Yan-ming Xie

Some conclusions drawn from explanatory randomized controlled trial (ERCT) lack practical value in application under real-world clinical settings, and there are also some limitations on the generalization of pragmatic randomized controlled trial (PRCT) results. In some countries, real-world studies (RWSs) have been conducted to explore the effectiveness and safety of clinical interventions or postmarketing drugs, which is a new tendency in clinical researches. By reviewing some RWSs carried out in Western countries, we sum up the basic characteristics of the research design, and discuss the differences and connections between PRCT and RWS. The design ideas of RWS are different from PRCT. Researchers in RWS tend to perform long-term evaluation based on large quantities of subjects and quite large sample and focus on outcome measures which are clinically meaningful. Strict control on data collection, management and analysis are very important to RWS and PRCT. Owing to the complexity of clinical interventions and evaluation, PRCT is not completely suitable for clinical researches in traditional Chinese medicine (TCM). It is an inevitable tendency to apply RWS in clinical trials of TCM. We can explore the efficacy of TCM interventions through PRCT, and better understand the effectiveness through RWS. RWS will become a powerful approach to TCM clinical trials and postmarketing evaluation of Chinese medicines.

Key words: Real-world study, Randomized controlled trial, Chinese herbal drug, Investigational new drug, Drug evaluation

[1] Sharpe N . Clinical trials and the real world: selection bias and generalisability of trial results[J]. Cardiovasc Drugs Ther, 2002,16(16):75-77
doi: 10.1023/A:1015327801114
[2] Grapow MT, von Wattenwyl R, Guller U, Beyersdorf F, Zerkowski HR . Randomized controlled trials do not reflect reality: real-world analyses are critical for treatment guidelines[J]. J Thorac Cardiovasc Surg, 2006,132(1):5-7
doi: 10.1016/j.jtcvs.2006.03.035
[3] Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M , Seguin R. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity[J]. BMC Med Res Methodol, 2003, 3(): 28
[4] Karanicolas PJ, Montori VM, Devereaux PJ, Schünemann H, Guyatt GH . A new “mechanistic-practical” framework for designing and interpreting randomized trials[J]. J Clin Epidemiol, 2009,62(5):479-484
doi: 10.1016/j.jclinepi.2008.02.009
[5] Fox KAA . An introduction to the global registry of acute coronary events[J]. GRACE. Eur Heart J, 2000,2(Suppl F):F21-F24
[6] Mossello E, Tonon E, Caleri V, Tilli S, Cantini C, Cavallini MC, Bencini F, Mecacci R, Marini M, Bardelli F, Sarcone E, Razzi E, Biagini CA, Masotti G . Effectiveness and safety of cholinesterase inhibitors in elderly subjects with Alzheimer's disease: a “real world” study[J]. Arch Gerontol Geriatr Suppl, 2004,( 9):297-307
[7] Cazzoletti L, Marcon A, Janson C, Corsico A, Jarvis D, Pin I, Accordini S, Almar E, Bugiani M, Carolei A, Cerveri I, Duran-Tauleria E, Gislason D, Gulsvik A, Jogi R, Marinoni A, Martinez-Moratalla J , Vermeire P, de-Marco R. Asthma control in Europe: a real-world evaluation based on an international population-based study[J]. J Allergy Clin Immunol, 2007,120(6):1360-1367
doi: 10.1016/j.jaci.2007.09.019
[8] Gale CP, Manda SOM, Batin PD, Weston CF, Birkhead JS, Hall AS . Predictors of in-hospital mortality for patients admitted with ST-elevation myocardial infarction: a real-world study using the Myocardial Infarction National Audit Project(MINAP) database[J]. Heart, 2008,94(11):1407-1412
doi: 10.1136/hrt.2007.127068
[9] Lasalvia A, Bonetto C, Cristofalo D, Tansella M, Ruggeri M . Predicting clinical and social outcome of patients attending real world mental health services: a 6-year multi-wave follow-up study[J]. Acta Psychiatr Scand Suppl, 2007,( 437):16-30
[10] Gartlehner G, Hansen RA, Nissman D, Lohr KN, Carey TS . A simple and valid tool distinguished efficacy from effectiveness studies[J]. J Clin Epidemiol, 2006,59(10):1040-1048
doi: 10.1016/j.jclinepi.2006.01.011
[11] Fleischhacker WW, Goodwin GM . Effectiveness as an outcome measure for treatment trials in psychiatry[J]. World Psychiatry, 2009,8(1):23-27
doi: 10.1002/wps.2009.8.issue-1
[12] Magliano L, Fiorillo A, Malangone C, Rosa CD, Maj M . Patient functioning and family burden in a controlled, real-world trial of family psychoeducation for schizophrenia[J]. Psychiatr Serv, 2006,57(12):1784-1791
doi: 10.1176/ps.2006.57.12.1784
[13] Vidal JS, Lacombe JM, Dartigues JF, Pasquier F, Robert P, Tzourio C, Alpérovitch A . Memantine therapy for Alzheimer disease in real-world practice: an observational study in a large representative sample of French patients[J]. Alzheimer Dis Assoc Disord, 2008,22(2):125-130
doi: 10.1097/WAD.0b013e31815a9e10
[14] Kraemer HC . “Rules” of evidence in assessing the efficacy and effectiveness of treatments[J]. Dev Neuropsychol, 2003,24(2-3):705-718
doi: 10.1207/S15326942DN242&3_09
[15] GRACE Investigators . Rationale and design of the GRACE(Global Registry of Acute Coronary Events) project: a multinational registry of patients hospitalized with acute coronary syndromes[J]. Am Heart J, 2001,141(2):190-199
doi: 10.1067/mhj.2001.112404
[16] Farahani P, Levine M, Gaebel K, Khalidi N, Wang ECY . Community-based evaluation of etanercept in patients with rheumatoid arthritis[J]. J Rheumatol, 2006,33(4):665-670
[17] Nash JM , McCrory D, Nicholson RA, Andrasik F. Efficacy and effectiveness approaches in behavioral treatment trials[J]. Headache, 2005,45(5):507-512
doi: 10.1111/hed.2005.45.issue-5
[18] Ernst E, Canter PH . Limitations of “pragmatic” trials[J]. Postgrad Med J, 2005,81(954):203
doi: 10.1136/pgmj.2004.026807
[19] Simon G, Wagner E, Vonkorff M . Cost-effectiveness comparisons using “real world” randomized trials: the case of antidepressant drugs[J]. J Clin Epidemiol, 1995,48(3):363-373
doi: 10.1016/0895-4356(94)00141-C
[1] Sherman Gu, Arthur Yin Fan. Controversial conclusions from two randomized controlled trials for acupuncture's effects on polycystic ovary syndrome or in vitro fertilization support. Journal of Integrative Medicine, 2020, 18(2): 89-91.
[2] Gerli E.G. Herr, Fábio Goulart da Silva, Francisco José Cidral-Filho, Fabricia Petronilho, Lucinéia Gainski Danielski, Mariana Pereira de Souza Goldim, Afonso Shiguemi Inoue Salgado, Franciane Bobinski, Daniel Fernandes Martins, Eliane R. Winkelmann. Effects of the use of bioceramic wraps in patients with lower limb venous ulcers: A randomized double-blind placebo-controlled trial. Journal of Integrative Medicine, 2020, 18(1): 27-.
[3] Xin-yu Yue, Zhuo-qi Feng, Xi-yi Yu, Jia-min Hu, Xiao-Jing He, Shi Shu. Fire-needle acupuncture for upper limb spastic paralysis after stroke: Study protocol for a randomized controlled trial. Journal of Integrative Medicine, 2019, 17(3): 167-172.
[4] Ya-ru Huangfu, Wei Peng, Bao-jun Guo, Zhi-fu Shen, Li Li, Shi-wei, Liu, Hui Zheng, You-ping Hu. Effects of acupuncture in treating insomnia due to spleen-stomach disharmony syndrome and its influence on intestinal microbiome: Study protocol for a randomized controlled trial. Journal of Integrative Medicine, 2019, 17(3): 161-167.
[5] Pádraic J.Dunne, Julie Lynch, Lucia Prihodova, Caoimhe O'Leary, Atiyeh Ghoreyshi, Sharee A. Basdeo, Donal J.Cox, Rachel Breen, Ali Sheikhi, Áine Carroll, Cathal Walsh, Geraldine McMahon, Barry White. Burnout in the emergency department: Randomized controlled trial of an attention-based training program. Journal of Integrative Medicine, 2019, 17(3): 173-180.
[6] J.M. Oliver-Baxter, H.S. Whitford, D.A. Turnbull, M.J. Bond. Effects of vitamin supplementation on inflammatory markers and psychological wellbeing among distressed women: A randomized controlled trial. Journal of Integrative Medicine, 2018, 16(5): 322-328.
[7] Parunkul Tungsukruthai, Preecha Nootim, Wiwan Worakunphanich, Nareerat Tabtong. Efficacy and safety of herbal steam bath in allergic rhinitis: A randomized controlled trial. Journal of Integrative Medicine, 2018, 16(1): 39-44.
[8] Zahra Hajmohammadi, Mojtaba Heydari, Majid Nimrouzi, Pouya Faridi, Mohammad Javad Zibaeenezhad, Gholamhossein Ranjbar Omrani, Mesbah Shams . Rhus coriaria L. increases serum apolipoprotein-A1 and high-density lipoprotein cholesterol levels: A double-blind placebo-controlled randomized clinical trial. Journal of Integrative Medicine, 2018, 16(1): 45-50.
[9] Laura Belland, Laura Rivera-Reyes, Ula Hwang. Using music to reduce anxiety among older adults in the emergency department: A randomized pilot study. Journal of Integrative Medicine, 2017, 15(6): 450-455.
[10] Hilal Yuksel, Yasemin Cayir, Zahide Kosan, Kenan Tastan. Effectiveness of breathing exercises during the second stage of labor on labor pain and duration: A randomized controlled trial. Journal of Integrative Medicine, 2017, 15(6): 456-461.
[11] Yoshiharu Motoo, Takashi Hakamatsuka, Nobuo Kawahara, Ichiro Arai, Kiichiro Tsutani. Standards of Reporting Kampo Products (STORK) in research articles. Journal of Integrative Medicine, 2017, 15(3): 182-185.
[12] Maria T.Chao, AlexandraChang, SanjayReddy, James D.Harrison, JosephAcquah, MiriaToveg, TrilceSantana, Frederick M.Hecht. Adjunctive acupuncture for pain and symptom management in the inpatient setting: Protocol for a pilot hybrid effectiveness-implementation study. Journal of Integrative Medicine, 2016, 14(3): 228-238.
[13] Nouran A. Aleyeidi, Khaled S. Aseri, Shadia M. Matbouli, Albaraa A. Sulaiamani, Sumayyah A. Kobeisy. Effects of wet-cupping on blood pressure in hypertensive patients: A randomized controlled trial. Journal of Integrative Medicine, 2015, 13(6): 391-399.
[14] Maria Sousa Cláudia, Coimbra Daniela, Machado Jorge, J. Greten Henry. Effects of self-administered exercises based on Tuina techniques on musculoskeletal disorders of professional orchestra musicians: A randomized controlled trial. Journal of Integrative Medicine, 2015, 13(5): 314-318.
[15] Marco Gemma, Elisa Nicelli, Luigi Gioia, Elena Moizo, Luigi Beretta, Maria Rosa Calvi. Acupuncture accelerates recovery after general anesthesia: A prospective randomized controlled trial. Journal of Integrative Medicine, 2015, 13(2): 99-104.
Full text



[1] Dong Yang, Yong-ping Du, Qing Shen, Wei Chen, Yan Yu, Guang-lei Chen. Expression of alpha-smooth muscle actin in renal tubulointerstitium in patients with kidney collateral stasis. Journal of Chinese Integrative Medicine, 2008, 6(1): 41-44
[2] Wei Zhang, Xiang-feng Lu, Xiao-mei Zhang, Jian-jun Wu, Liang-duo Jiang. A rat model of pulmonary fibrosis induced by infusing bleomycin quickly through tracheal intubation. Journal of Chinese Integrative Medicine, 2008, 6(1): 60-67
[3] Jin-zhou Tian, Jing Shi, Xin-qing Zhang, Qi Bi, Xin Ma, Zhi-liang Wang, Xiao-bin Li, Shu-li Shen, Lin Li, Zhen-yun Wu, Li-yan Fang, Xiao-dong Zhao, Ying-chun Miao, Peng-wen Wang, Ying Ren, Jun-xiang Yin, Yong-yan Wang, Beijing United Study Group on MCI of the Capital Foundation of Medical Developments. Guiding principles of clinical research on mild cognitive impairment (protocol). Journal of Chinese Integrative Medicine, 2008, 6(1): 9-14
[4] Daniel Weber, Janelle M Wheat, Geoffrey M Currie. Inflammation and cancer: Tumor initiation, progression and metastasis,and Chinese botanical medicines. Journal of Chinese Integrative Medicine, 2010, 8(11): 1006-1013
[5] Xin-jun Wang, Ling-ling Wang . A mechanism of endogenous opioid peptides for rapid onset of acupuncture effect in treatment of depression. Journal of Chinese Integrative Medicine, 2010, 8(11): 1014-1017
[6] Ya-bing Zhou, Jian-er Yu, Jie Wu, Li Bai, Li-li Huo, Xin-guang Zhang, Li-qing Li . Effects of Chinese herbal medicine Bushen Gubiao Recipe on toll-like receptor 4 and CD4 +CD25 +foxp3 +regulatory T cells in mice with recurrent respiratory tract infections. Journal of Chinese Integrative Medicine, 2010, 8(11): 1053-1059
[7] Yang Chen, Jian-hua Huang, You Ning, Zi-yin Shen. Icariin and its pharmaceutical efficacy: Research progress of molecular mechanism. Journal of Chinese Integrative Medicine, 2011, 9(11): 1179-1184
[8] Mei-na Ye, Hong-feng Chen, Yi-qin Cheng, Yan-sheng Zhang, Ping Li, Gang Gui, Li-ying Chen, Hao Chen, Hong-yu Dai. Study protocol for a self-controlled case study to evaluate the safety and standardization for external application of Chinese medicine Jiuyi Powder. Journal of Chinese Integrative Medicine, 2011, 9(11): 1199-1205
[9] Li-fang Wang, Jin-feng Wang, Wei-fang Jin, Hong-fu Wang, Shao-fen Zhang, Jian-jun Gao. Effects of daidzein on steroid receptor coactivator-1 expression in MC3T3-E1 cells and the mechanism. Journal of Chinese Integrative Medicine, 2011, 9(11): 1248-1253
[10] Xin-xiang Wang , Yun-ling Zhang, Qi-fu Huang. Discussion on the main pathogenesis in traditional Chinese medicine and etiology about primary osteoporosis. Journal of Chinese Integrative Medicine, 2010, 8(12): 1119-1123