Search JIM Advanced Search

Journal of Chinese Integrative Medicine ›› 2006, Vol. 4 ›› Issue (5): 455-466.doi: 10.3736/jcim20060504

• Review • Previous Articles     Next Articles

Critical appraisal of clinical studies in Chinese herbal medicine

Simon Dagenais1,2,3,Andrea C. Tricco1,4, Zhao-xiang Bian5,Wen-hua Huang6,David Moher1,2,3   

  1. 1. Chalmers Research Group, Children's Hospital of Eastern Ontario Research Institute, Ottawa, Canada
    2. Department of Pediatrics, Faculty of Medicine, University of Ottawa, Ottawa, Canada
    3. Department of Epidemiology and Community Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Canada
    4. Institute of Population Health, University of Ottawa, Ottawa, Canada
    5. School of Chinese Medicine, Hong Kong Baptist University, Hong Kong SAR, China
  • Online:2006-09-30 Published:2006-09-15

The use of complementary and alternative medicine (CAM) is currently widespread and appears to be growing. As an increasing proportion of the population turns to CAM therapies, whether singly or in combination with allopathic medicine, the need for quality research in this area is reinforced. Much of this research consists of clinical studies aimed primarily at clinicians, yet challenges arising from poor methodological quality will occur when interpreting study findings and their implications. For clinicians to be effective consumers of the scientific literature, familiarization with the principles of evidence-based medicine (EBM) is essential. The goal of this review is to introduce clinicians to the concept of critical appraisal of clinical studies and foster critical thinking when reading research articles in order to best evaluate and incorporate study findings into their daily practice. Topics discussed in this article include: (1) fundamentals of EBM; (2) types of clinical studies; (3) hierarchy of evidence; (4) Consolidated Standard of Randomized Trials (CONSORT) statement to evaluate the quality of reporting in randomized controlled trials (RCTs); (5) methodologic quality rating scales for RCTs; and (6) issues specific to evaluating studies of Chinese herbal medicine.

Key words: Evidence-based medicine, Research design, Randomized controlled trial, Chinese herbal medicine, CONSORT statement

CLC Number: 

  • R-3

"

Study design Descriptive Cohort Controlled
Subtypes Case report
-1 patient
Case series
-several patients
Retrospective
-Data collected from prior patients by reviewing charts
Prospective
-Study designed prior to collecting data from future patients
Non-randomized
-Intervention compared to control
Randomized
-Participants randomized to intervention or control groups
Purpose -Provide extensive information on case(s) selected due to unusual nature of intervention or disease
-Question current thinking and share new clinical observations
-Describe outcome of similar patients who received similar intervention
-Performs initial evaluation of new treatment under ideal conditions
-Assess the efficacy of a treatment compared to a control group in a defined population using rigorous scientific methods
-Confirm or refute findings from other clinical study designs
Typical article format -Presenting complaint
-Examination findings
-Description of treatment
-Results
-Discussion
-Conclusion
-Disease of interest
-Definition of cohort
-Intervention protocol
-Outcome measures
-Follow-up
-Results
-Discussion
-Conclusion
-Disease of interest
-Target population
-Inclusion/exclusion criteria
-Intervention protocol
-Sample size calculation
-Randomization and blinding
-Outcome measures
-Follow-up
-Results
-Discussion
-Conclusion
Advantages -Extensive information provided on single (few) case (s)
-More reflective of day-to-day practice focused on individual patients
-May foster new theories for further investigation
-More standardized approach than case series
-Good starting point for clinical research involving new intervention
-Relatively inexpensive and simple to conduct
-Control group minimizes non-treatment effects observed
-Defined inclusion/exclusion criteria help generalizability
-Randomization ensures baseline comparability
Disadvantages -Few participants
-Non-experimental
-Higher likelihood and more sources of bias
-May not be generalizable
-Patient selection criteria often unclear
-Patients not blinded to treatment
-No control group to compare new treatment to standard of care or natural history
-Often requires numerous participants with long recruitment and screening period
-Randomization and blinding difficult to implement in certain clinical settings
-Requires extensive support from research team and infrastructure
Cost/complexity Low Medium High
Approximate number of
participants
1-10 100 or more 50 to 100 or more

Figure 1

Hierarchy of clinical efficacy study research evidence"

"

Item Section Comments
1 TITLE &
ABSTRACT
Clearly state the population used, intervention studied, trial design, and outcome of interest (e.g. a 20-week randomized controlled trial of estradiol replacement therapy for women aged 70 years and older: Effect on mood, cognition and quality of life).
INTRODUCTION
2 Background Explain past scientific evidence in the field relevant to the trial (i.e. conduct a literature search). The rationale should justify the need to conduct the trial and importance of the trial.
METHODS
3 Participants State the reasons why participants were included in the trial and why others were excluded. Describe the location where the trial was conducted. Report if the trial was independent or part of a larger, multi-center trial.
4 Interventions Clearly state details such as treatments given to each group, how they were administered, and the timing of administration.
5 Objectives Report the aims of the trial as well as any a-priori hypotheses (e.g. our hypothesis is that estradiol is superior to placebo in improving the mood for women aged 70 years and older).
6 Outcomes Describe the primary and secondary outcomes and how they were measured (e.g. the primary outcome is remission from depression rated by a score of 7 or less on the Hamilton Depression Scale and the secondary outcome includes clinical response defined as a 50% decrease on Hamilton Depression scores from baseline). Report methods used to increase the quality of measurements. For example, report if training was provided to assess depression using the Hamilton Depression Scale in the trial.
7 Sample size Report the calculations used to decide the number of participants required for the trial. The sample size is related to the allowable level of a type I error (i.e. declaring that a difference exists when one does not), the incidence or prevalence of the disease being studied, the magnitude of the difference between the treatments to be detected, and the allowable level of a type II error (i.e. declaring that a difference does not exist when one does).
8 Randomization: sequence
generation
Randomization minimizes bias associated with assigning patients to treatment. Clearly describe the method used to generate random allocation (e.g. Participants had an equal probability of assignment to the groups. The randomization code was developed using a computer random number generator). Describe details of restriction, if any were used (e.g. Random permuted blocks were selected. The block lengths were 4, 8, and 10 varied randomly).
9 Allocation concealment Report all methods pertaining to allocation concealment methods. Allocation concealment is the process used to prevent any prior knowledge of group assignment (e.g. capsules were placed in identical-looking, numbered bottles and administered sequentially; sequentially numbered opaque, sealed envelopes were used to conceal treatment allocation). Concealment prior to intervention assignment is preferred.
10 Implementation Provide details about how the trial was executed. This includes who generated the allocation sequence, who enrolled participants, and who assigned participants to their groups.
11 Blinding (masking) Report all blinding processes. Blinding refers to the process in which participants, treatment administrators, and outcome assessors are unaware of the group to which participants are assigned. For example, our study was double-blinded as the participants and the investigators were unaware of which treatment group that the participants were in.
12 Statistical methods Report all methods used to statistically analyze trial results. This includes adjustments, subgroup analyses, and any additional analyses.

"

Item Section Comments
RESULTS
13 Participant flow The participant flow is a description of the flow of participants through each stage of the trial. A diagram is strongly recommended. For each treatment group report the number of participants that were randomly assigned, received the intended treatment, completed study protocol, and analyzed for the primary outcome. Describe and explain any differences between the methods outlined in the protocol and the methods that were actually used in the trial.
14 Recruitment Report the timing of enrollment and the length of patient follow-up. For example, patients were enrolled on September 1, 2005 and followed up until December 23, 2007.
15 Baseline data State the demographics of participants in the trial (e.g. age, gender) and clinical characteristic data collected at the beginning of the study (e.g. blood pressure at the first patient visit with the physician).
16 Numbers analyzed State the total number of participants in each group. Describe whether intention-to-treat analysis was done (i.e. all patients who began the trial are used in the analysis, whether or not treatment was received for the full time period of the trial). State results in absolute numbers if feasible and not in percentages.
17 Outcomes and estimation Report the results of primary and secondary outcomes by treatment group. State the difference between treatments (i.e. effect size; e.g. relative risk) and the degree of uncertainty surrounding the effect size (i.e. 95% confidence interval).
18 Ancillary analyses Describe any additional analyses that were performed (e.g. subgroup analyses, adjusted analyses). Provide information about whether the pre-specified analysis in the trial protocol was followed. Report any additional analyses done for exploratory purposes.
19 Adverse events State all undesirable or unwanted effects of the treatment, even if they were not harmful.
DISCUSSION
20 Interpretation Describe the interpretation of the results and take into account any trial hypotheses. Report limitations of the trial such as sources of bias and multiple analyses, which increases your chances of rejecting the null hypothesis when it was in fact true (i.e., you find that a difference between the interventions exist when they were in fact the same. This is otherwise known as a "type 1" error).
21 Generalizability Generalizability relates to the degree for which the trial results can be inferred to a larger population beyond the trial participants. Another term for generalizability is external validity. Describe the extent of external validity of the trial.
22 Overall evidence Interpret and report the results within the context of the current evidence.

Figure 2

CONSORT flow diagram7 RATING SCALESThe CONSORT Group is committed to continuous improvement through the renewal and updates of their recommendations. The first set of recommendations was published in 1996 and updated in 2001[18,20]. It is now endorsed by international editorial groups, including the International Committee of Medical Jounral Editors, and used by several hundred biomedical journals[21,22,23,24]. The CONSORT Statement has also led to recommendations on the reporting of cluster trials[25], equivalence and non-inferiority trials[26], and harms (e.g. safety and adverse events) in RCTs[27]. Recently, CONSORT has been extended to reporting herbal interventions[28]. Although not intended as an assessment tool, clinicians evaluating RCTs can use the CONSORT statement checklist to assess the number of reported criteria against a standard benchmark. This can help clinicians to determine whether a study report is in fact of high quality."

"

Item Description
1 Was the study described as randomized (this includes the use of words such as randomly, random, and randomization)?
2 Was the study described as double blind?
3 Was there a description of withdrawals and dropouts?
[1] Kessler RC, Davis RB, Foster DF , et al. Long-term trends in the use of complementary and alternative medical therapies in the United States[J]. Ann Intern Med, 2001,135(4):262-268
[2] Tindle HA, Davis RB, Phillips RS , et al. Trends in use of complementary and alternative medicine by US adults: 1997-2002[J]. Altern Ther Health Med, 2005,11(1):42-49
doi: 10.1016/j.jep.2004.10.005 pmid: 15712765
[3] Schulz KF, Chalmers I, Hayes RJ , et al. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials[J]. JAMA, 1995,273(5):408-412
[4] Egger M, Juni P, Bartlett C , et al. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study[J]. Health Technol Assess, 2003,7(1):1-6
[5] Sackett DL, Rosenberg WM, Gray JA , et al. Evidence based medicine: what it is and what it isn't[J]. BMJ, 1996,312(7023):71-72
[6] 6Meinert CL . Clinical trials: Design, conduct, and analysis(1st ed)[M]. New York: Oxford University Press,1986,(1st ed):
[7] Bian ZX, Li YP, Moher D , et al. Improving the quality of randomized controlled trials in chinese herbal medicine, part I: clinical trial design and methodology[J]. Zhong Xi Yi Jie He Xue Bao, 2006,4(2):120-129
[8] Bian ZX, Moher D, Dagenais S , et al. Improving the quality of randomized controlled trials in Chinese herbal medicine, part II: control group design[J]. Zhong Xi Yi Jie He Xue Bao, 2006,4(2):130-136
[9] Evans D . Hierarchy of evidence: a framework for ranking evidence evaluating healthcare interventions[J]. J Clin Nurs, 2003,12(1):77-84
[10] Hulley S, Cumming SR, Browner WS, et al.Designing clinical research( 2nd edt ) [M].Philadelphia: Lippincott Williams & Wilkins, 2001,( 2nd edt):
[11] Mulrow CD . The medical review article: state of the science[J]. Ann Intern Med, 1987,106(13):485-488
doi: 10.7326/0003-4819-106-3-485 pmid: 3813259
[12] Mulrow CD . Rationale for systematic reviews[J]. BMJ, 1994,309(6954):597-599
[13] Cook DJ, Mulrow CD, Haynes RB . Systematic reviews: synjournal of best evidence for clinical decisions[J]. Ann Intern Med, 1997,126(5):376-380
[14] AGREE Collaboration . Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project[J]. Qual Safety Health Care, 2003,12(1):18-23
[15] Gluud LL . Bias in clinical intervention research[J]. Am J Epidemiol, 2006,163(6):493-501
doi: 10.1093/aje/kwj069 pmid: 16443796
[16] Tsay MY, Yang YH . Bibliometric analysis of the literature of randomized controlled trials[J]. J Med Libr Assoc, 2005,93(4):450-458
pmid: 16239941
[17] .[ OTHER].Plint A, Moher D, Altman DG, et al. Does the CONSORT checklist improve the quality of reports of randomized controlled trials? A systematic review. Presented at the 5th International Congress on Peer Review and Biomedical Communication ( Chicago, September 2005).
[18] Begg C, Cho M, Eastwood S , et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement[J]. JAMA, 1996,276(8):637-639
[19] 19Plint AC, Moher D, Morrison A , et al. Does the CONSORT checklist improve the quality of reports of randomized controlled trials: a systematic review[J]. Med J Aust, 2006,185(5):263-267
[20] Moher D, Schulz KF , Altman DG.The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials[J].BMC Med Res Methodol, 2001, 1():2. Epub 2001 Apr 20
[21] Freemantle N, Mason JM, Haines A , et al. CONSORT: an important step towards evidence-based health care. Consolidated Standards of Reporting Trials[J]. Ann Intern Med, 1997,126(1):81-83
[22] Schulz KF . The quest for unbiased research: randomized clinical trials and the CONSORT reporting guidelines[J]. Ann Neurol, 1997,41(5):569-573
[23] Huston P, Hoey J . CMAJ endorses the CONSORT statement. CONsolidation of Standards for Reporting Trials[J]. CMAJ, 1996,155(9):1277-1282
doi: 10.1001/jama.276.8.649 pmid: 8911294
[24] Davidoff F . News from the International Committee of Medical Journal Editors[J]. Ann Intern Med, 2000,133(3):229-231
[25] Campbell MK, Elbourne DR, Altman DG , et al. CONSORT statement: extension to cluster randomised trials[J]. BMJ, 2004,328(7441):702-708
[26] Piaggio G, Elbourne DR, Altman DG , et al. Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement[J]. JAMA, 2006,295(10):1152-1160
[27] Ioannidis JP, Evans SJ, Gotzsche PC , et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement[J]. Ann Intern Med, 2004,141(10):781-788
doi: 10.7326/0003-4819-141-10-200411160-00009 pmid: 15545678
[28] Gagnier JJ, Boon H, Rochon P , et al. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement[J]. Ann Intern Med, 2006,144(5):364-367
[29] Moher D, Jadad AR, Tugwell P . Assessing the quality of randomized controlled trials. Current issues and future directions[J]. Int J Technol Assess Health Care, 1996,12(2):195-208
doi: 10.1017/S0266462300009570 pmid: 8707495
[30] Moher D, Jadad AR, Nichol G , et al. Assessing the quality of randomized controlled trials: an annotated bibliography of scales and checklists[J]. Control Clin Trials, 1995,16(1):62-73
[31] Verhagen AP, de Vet HC, de Bie RA , et al. The art of quality assessment of RCTs included in systematic reviews[J]. J Clin Epidemiol, 2001,54(7):651-654
[32] Jadad AR, Moore RA, Carroll D , et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary?[J]. Control Clin Trials, 1996,17(1):1-12
[33] Pildal J, Chan AW, Hrobjartsson A , et al.Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study[J].BMJ, 2005, 330(7499):1049. Epub 2005 Apr 7
Pildal J, Chan AW, Hrobjartsson A , et al.Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study[J].BMJ, 2005, 330(7499):1049. Epub 2005 Apr 7.
[34] Juni P, Witschi A, Bloch R , et al. The hazards of scoring the quality of clinical trials for meta-analysis[J]. JAMA, 1999,282(11):1054-1060
doi: 10.1001/jama.282.11.1054 pmid: 10493204
[35] Emerson JD, Burdick E, Hoaglin DC , et al. An empirical study of the possible relation of treatment differences to quality scores in controlled randomized clinical trials[J]. Control Clin Trials, 1990,11(5):339-352
[36] Moher D, Pham B, Jones A , et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?[J]. Lancet, 1998,352(9128):609-613
[37] .[ OTHER]. 37Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions 4.2.5. 2005. THER].37Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions 4.2.5. 2005. .37Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions 4.2.5. 2005. THER].37Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions 4.2.5. 2005.
[38] Leung KSY, Bian ZX, Moher D , et al. Improving the quality of randomized controlled trials in Chinese herbal medicine, part Ⅲ: quality control of Chinese herbal medicine used in randomized controlled trials[J]. Zhong Xi Yi Jie He Xue Bao, 2006,4(3):225-232
[1] Sherman Gu, Arthur Yin Fan. Controversial conclusions from two randomized controlled trials for acupuncture's effects on polycystic ovary syndrome or in vitro fertilization support. Journal of Integrative Medicine, 2020, 18(2): 89-91.
[2] Gerli E.G. Herr, Fábio Goulart da Silva, Francisco José Cidral-Filho, Fabricia Petronilho, Lucinéia Gainski Danielski, Mariana Pereira de Souza Goldim, Afonso Shiguemi Inoue Salgado, Franciane Bobinski, Daniel Fernandes Martins, Eliane R. Winkelmann. Effects of the use of bioceramic wraps in patients with lower limb venous ulcers: A randomized double-blind placebo-controlled trial. Journal of Integrative Medicine, 2020, 18(1): 27-.
[3] Xin-yu Yue, Zhuo-qi Feng, Xi-yi Yu, Jia-min Hu, Xiao-Jing He, Shi Shu. Fire-needle acupuncture for upper limb spastic paralysis after stroke: Study protocol for a randomized controlled trial. Journal of Integrative Medicine, 2019, 17(3): 167-172.
[4] Ya-ru Huangfu, Wei Peng, Bao-jun Guo, Zhi-fu Shen, Li Li, Shi-wei, Liu, Hui Zheng, You-ping Hu. Effects of acupuncture in treating insomnia due to spleen-stomach disharmony syndrome and its influence on intestinal microbiome: Study protocol for a randomized controlled trial. Journal of Integrative Medicine, 2019, 17(3): 161-167.
[5] Pádraic J.Dunne, Julie Lynch, Lucia Prihodova, Caoimhe O'Leary, Atiyeh Ghoreyshi, Sharee A. Basdeo, Donal J.Cox, Rachel Breen, Ali Sheikhi, Áine Carroll, Cathal Walsh, Geraldine McMahon, Barry White. Burnout in the emergency department: Randomized controlled trial of an attention-based training program. Journal of Integrative Medicine, 2019, 17(3): 173-180.
[6] J.M. Oliver-Baxter, H.S. Whitford, D.A. Turnbull, M.J. Bond. Effects of vitamin supplementation on inflammatory markers and psychological wellbeing among distressed women: A randomized controlled trial. Journal of Integrative Medicine, 2018, 16(5): 322-328.
[7] Parunkul Tungsukruthai, Preecha Nootim, Wiwan Worakunphanich, Nareerat Tabtong. Efficacy and safety of herbal steam bath in allergic rhinitis: A randomized controlled trial. Journal of Integrative Medicine, 2018, 16(1): 39-44.
[8] Zahra Hajmohammadi, Mojtaba Heydari, Majid Nimrouzi, Pouya Faridi, Mohammad Javad Zibaeenezhad, Gholamhossein Ranjbar Omrani, Mesbah Shams . Rhus coriaria L. increases serum apolipoprotein-A1 and high-density lipoprotein cholesterol levels: A double-blind placebo-controlled randomized clinical trial. Journal of Integrative Medicine, 2018, 16(1): 45-50.
[9] Laura Belland, Laura Rivera-Reyes, Ula Hwang. Using music to reduce anxiety among older adults in the emergency department: A randomized pilot study. Journal of Integrative Medicine, 2017, 15(6): 450-455.
[10] Hilal Yuksel, Yasemin Cayir, Zahide Kosan, Kenan Tastan. Effectiveness of breathing exercises during the second stage of labor on labor pain and duration: A randomized controlled trial. Journal of Integrative Medicine, 2017, 15(6): 456-461.
[11] Yoshiharu Motoo, Takashi Hakamatsuka, Nobuo Kawahara, Ichiro Arai, Kiichiro Tsutani. Standards of Reporting Kampo Products (STORK) in research articles. Journal of Integrative Medicine, 2017, 15(3): 182-185.
[12] Tom Fleischer, Tung-Ti Chang, Hung-Rong Yen. Post-hematopoietic stem cell transplantation in patients with hematologic disorders: Chinese herbal medicine for an unmet need. Journal of Integrative Medicine, 2016, 14(5): 322-335.
[13] Maria T.Chao, AlexandraChang, SanjayReddy, James D.Harrison, JosephAcquah, MiriaToveg, TrilceSantana, Frederick M.Hecht. Adjunctive acupuncture for pain and symptom management in the inpatient setting: Protocol for a pilot hybrid effectiveness-implementation study. Journal of Integrative Medicine, 2016, 14(3): 228-238.
[14] Nouran A. Aleyeidi, Khaled S. Aseri, Shadia M. Matbouli, Albaraa A. Sulaiamani, Sumayyah A. Kobeisy. Effects of wet-cupping on blood pressure in hypertensive patients: A randomized controlled trial. Journal of Integrative Medicine, 2015, 13(6): 391-399.
[15] Maria Sousa Cláudia, Coimbra Daniela, Machado Jorge, J. Greten Henry. Effects of self-administered exercises based on Tuina techniques on musculoskeletal disorders of professional orchestra musicians: A randomized controlled trial. Journal of Integrative Medicine, 2015, 13(5): 314-318.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] Jin-zhou Tian, Jing Shi, Xin-qing Zhang, Qi Bi, Xin Ma, Zhi-liang Wang, Xiao-bin Li, Shu-li Shen, Lin Li, Zhen-yun Wu, Li-yan Fang, Xiao-dong Zhao, Ying-chun Miao, Peng-wen Wang, Ying Ren, Jun-xiang Yin, Yong-yan Wang, Beijing United Study Group on MCI of the Capital Foundation of Medical Developments. Guiding principles of clinical research on mild cognitive impairment (protocol). Journal of Chinese Integrative Medicine, 2008, 6(1): 9-14
[2] Mei-jun Lü, Hui-yong Zhang, Zhe Zhang, Guan-lin Yang. Measurement of health-related quality of life in coronary heart disease: A review. Journal of Chinese Integrative Medicine, 2011, 9(12): 1277-1285
[3] Shuo Zhang , Hong-cai Shang. Correlation between traditional Chinese medicine syndromes and omics: A literature review. Journal of Chinese Integrative Medicine, 2011, 9(12): 1286-1291
[4] Qin-hui Fu, Jian Pei, Jian-rong Hui, Yi Song . Studies on dynamic changes in traditional Chinese medicine syndrome patterns for stroke using data-driven and model-driven approaches: A review. Journal of Chinese Integrative Medicine, 2011, 9(12): 1292-1300
[5] Jia Guo, Li-na Wang, Dong Li. Exploring the effects of Chinese medicine in improving uterine endometrial blood flow for increasing the successful rate of in vitro fertilization and embryo transfer. Journal of Chinese Integrative Medicine, 2011, 9(12): 1301-1306
[6] Liang-ping Hu, Xiao-lei Bao, Xue Guan, Shi-guo Zhou. Estimation of sample size and testing power (Part 3). Journal of Chinese Integrative Medicine, 2011, 9(12): 1307-1311
[7] Jian-sheng Li, Su-yun Li, Xue-qing Yu, Yang Xie. Bufei Yishen Granule combined with acupoint-sticking therapy in patients with stable chronic obstructive pulmonary disease: Study protocol of a multicenter, randomized, double-blind, active-controlled trial. Journal of Chinese Integrative Medicine, 2011, 9(12): 1312-1318
[8] Se-Der Wu, Jen-Tzer Gau, Yuh-Hai Wang. Ryodoraku as a tool monitoring the effects of walking exercise. Journal of Chinese Integrative Medicine, 2011, 9(12): 1319-1325
[9] Li Dong-tao, Li Fu-yu, Wang Jian, Liu Ji-hong, Yan Nan, Cheng Yong-mei, Hu Ai-hua, Jiang Hong-yang, Shi Feng-lei, Zhang Mei-zeng, Li Jie, Wei Ling-bo, Jiang Rong-qin. A study of diagnostic criteria for traditional Chinese medicine syndromes in osteoporosis. Journal of Chinese Integrative Medicine, 2011, 9(12): 1326-1332
[10] Zhi-rong Zhu, Chang-chun Zeng, Li Yang, Han-ping Liu, Song-hao Liu. Influence of brightness value of supranasal point and apex nasi on dominant wavelength and excitation purity in complexion inspection of healthy adults. Journal of Chinese Integrative Medicine, 2011, 9(12): 1333-1338