Updated Saturday, July 21, 2018
 Journal Tools
RSS Feed
Sample Copy
Submit a Manuscript
Contact Us
Thanking Peer Reviewers
 Language Polishing
Journal of Chinese Integrative Medicine: Volume 10, 2012   Issue 3,  Pages: 271-278

DOI: 10.3736/jcim20120305
Review Article
Modern testing theory and its application in the field of health measurement
Da-rong Wu (Applied Clinical Epidemiology Research Unit, the Second Affiliated Hospital (Guangdong Provincial Hospital of Chinese Medicine), Guangzhou University of Chinese Medicine, Guangzhou 510120, Guangdong Province, China E-mail: drdarongwu@gmail.com)
ABSTRACT: This paper briefly introduces item response theory (IRT) as a typical representation of modern testing theory (MTT), and systematically reviews the processes and contents of the application of IRT in the area of health measurement, including, for example, item bank development, scale revision and computerized adaptive testing. The author presents the potential benefits and the notable problems during health measuring by IRT. Then, the author asserts the need for thorough assessment of feasibility when using the IRT in patient-reported outcome research. Further research based on IRT and computerized adaptive testing in health measurement will be carried out in the field of medical care including traditional Chinese medicine and integrative medicine.
Welcome to JIM! You are the number 8422 reader of this article!
Download Article:
[Full Text]      [PDF]      [Previous]      [Next]      [This Issue]
Please cite this article as:
Wu DR. Modern testing theory and its application in the field of health measurement. J Chin Integr Med / Zhong Xi Yi Jie He Xue Bao. 2012; 10(3): 271-278.
1Crocker L, Algina J. Introduction to classical and modern test theory. Translated by Jin Y[M]. Shanghai: East China Normal University Press, 2004. 5, 7-8. Chinese
2DeVellis RF. Classical test theory[J].Med Care, 2006, 44(11 Suppl 3): S50-S59.  
3Embretson SE, Reise SP. Item response theory for psychologists[M]. London: Lawrence Erlbaum Associates, 2000. 15.  
4Baker FB. The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation. 2nd ed. 2001: 1.
5Yuan CY. IRT: the theory and its applications[J].Nan Hua Da Xue Xue Bao She Hui Ke Xue Ban, 2001, 2(4): 69-71. Chinese with abstract in English
6Hays RD, Lipscomb J. Next steps for use of item response theory in the assessment of health outcomes[J].Qual Life Res, 2007, 16(Suppl 1): 195-199.  
7Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B, Ader D, Fries JF, Bruce B, Rose M; PROMIS Cooperative Group. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years[J].Med Care, 2007, 45(5 Suppl 1): S3-S11.  
8Hay R. Promis_w1_final_20110108_executive_summary-Version 1 January 8, 2011. [2011-12-10]. http://www.nihpromis.org/documents/PROMIS_Executive_Summary.pdf.
9Hays RD, Liu H, Spritzer K, Cella D. Item response theory analyses of physical functioning items in the medical outcomes study[J].Med Care, 2007, 45(5 Suppl 1): S32-S38.  
10Kopec JA, Sayre EC, Davis AM, Badley EM, Abrahamowicz M, Sherlock L, Williams JI, Anis AH, Esdaile JM. Assessment of health-related quality of life in arthritis: conceptualization and development of five item banks using item response theory[J].Health Qual Life Outcomes, 2006, 4: 33.  
11Bjorner JB, Kosinski M, Ware JE Jr. Calibration of an item pool for assessing the burden of headaches: an application of item response theory to the headache impact test (HITTM)[J].Qual Life Res, 2003, 12(8): 913-933.  
12Lai JS, Cella D, Dineen K, Bode R, Von Roenn J, Gershon RC, Shevrin D. An item bank was created to improve the measurement of cancer-related fatigue[J].J Clin Epidemiol, 2005, 58(2): 190-197.  
13Lai JS, Dineen K, Reeve BB, Von Roenn J, Shervin D, McGuire M, Bode RK, Paice J, Cella D. An item response theory-based pain item bank can enhance measurement precision[J].J Pain Symptom Manage, 2005, 30(3): 278-288.  
14Lai JS, Cella D, Chang CH, Bode RK, Heinemann AW. Item banking to improve, shorten and computerize self-reported fatigue: an illustration of steps to create a core item bank from the FACIT-Fatigue Scale[J].Qual Life Res, 2003, 12(5): 485-501.  
15Teresi JA, Fleishman JA. Differential item functioning and health assessment[J].Qual Life Res, 2007, 16(Suppl 1): 33-42.  
16Pagano IS, Gotay CC. Ethnic differential item functioning in the assessment of quality of life in cancer patients[J].Health Qual Life Outcomes, 2005, 3: 60.  
17Crane PK, Cetin K, Cook KF, Johnson K, Deyo R, Amtmann D. Differential item functioning impact in a modified version of the Roland-Morris Disability Questionnaire[J].Qual Life Res, 2007, 16(6): 981-990.  
18Noerholm V, Groenvold M, Watt T, Bjorner JB, Rasmussen NA, Bech P. Quality of life in the Danish general population — normative data and validity of WHOQOL-BREF using Rasch and item response theory models[J].Qual Life Res, 2004, 13(2): 531-540.  
19Weinstock LM, Strong D, Uebelacker LA, Miller IW. Differential item functioning of DSM-Ⅳ depressive symptoms in individuals with a history of mania versus those without: an item response theory analysis[J].Bipolar Disord, 2009, 11(3): 289-297.  
20Tsutsumi A, Iwata N, Watanabe N, de Jonge J, Pikhart H, Fernndez-Lpez JA, Xu L, Peter R, Knutsson A, Niedhammer I, Kawakami N, Siegrist J. Application of item response theory to achieve cross-cultural comparability of occupational stress measurement[J].Int J Methods Psychiatr Res, 2009, 18(1): 58-67.  
21Uebelacker LA, Strong D, Weinstock LM, Miller IW. Use of item response theory to understand differential functioning of DSM-Ⅳ major depression symptoms by race, ethnicity and gender[J].Psychol Med, 2009, 39(4): 591-601.  
22Bjorner JB, Petersen MA, Groenvold M, Aaronson N, Ahlner-Elmqvist M, Arraras JI, Brdart A, Fayers P, Jordhoy M, Sprangers M, Watson M, Young T; European Organisation for Research and Treatment of Cancer Quality of Life Group. Use of item response theory to develop a shortened version of the EORTC QLQ-C30 emotional functioning scale[J].Qual Life Res, 2004, 13(10): 1683-1697.  
23Misajon R, Hawthorne G, Richardson J, Barton J, Peacock S, Iezzi A, Keeffe J. Vision and quality of life: the development of a utility measure[J].Invest Ophthalmol Vis Sci, 2005, 46(11): 4007-4015.  
24Atroshi I, Lyrn PE, Gummesson C. The 6-item CTS symptoms scale: a brief outcomes measure for carpal tunnel syndrome[J].Qual Life Res, 2009, 18(3): 347-358.  
25Takegami M, Suzukamo Y, Wakita T, Noguchi H, Chin K, Kadotani H, Inoue Y, Oka Y, Nakamura T, Green J, Johns MW, Fukuhara S. Development of a Japanese version of the Epworth Sleepiness Scale (JESS) based on item response theory[J].Sleep Med, 2009, 10(5): 556-565.  
26Adair CE, Marcoux GC, Cram BS, Ewashen CJ, Chafe J, Cassin SE, Pinzon J, Gusella JL, Geller J, Scattolon Y, Fergusson P, Styles L, Brown KE. Development and multi-site validation of a new condition-specific quality of life measure for eating disorders[J].Health Qual Life Outcomes, 2007, 5: 23.  
27Chiang KS, Green KE, Cox EO. Rasch analysis of the Geriatric Depression Scale-Short Form[J].Gerontologist, 2009, 49(2): 262-275.  
28Wolfe F, Kong SX. Rasch analysis of the Western Ontario MacMaster questionnaire (WOMAC) in 2 205 patients with osteoarthritis, rheumatoid arthritis, and fibromyalgia[J].Ann Rheum Dis, 1999, 58(9): 563-568.  
29Metz SM, Wyrwich KW, Babu AN, Kroenke K, Tierney WM, Wolinsky FD. A comparison of traditional and Rasch cut points for assessing clinically important change in health-related quality of life among patients with asthma[J].Qual Life Res, 2006, 15(10): 1639-1649.  
30Van der Linden WJ, Glas CAW. Computerized adaptive testing: theory and practice. Dordrecht: Kluwer Academic Publishers. 2000: Preface.
31Cook KF, O’Malley KJ, Roddey TS. Dynamic assessment of health outcomes: time to let the CAT out of the bag? Health Ser Res. 2005; 40(5 Pt 2): 1694-1711.
32Ware JE Jr, Kosinski M, Bjorner JB, Bayliss MS, Batenhorst A, Dahlf CG, Tepper S, Dowson A. Applications of computerized adaptive testing (CAT) to the assessment of headache impact[J].Qual Life Res, 2003, 12(8): 935-952.  
33Fliege H, Becker J, Walter OB, Bjorner JB, Klapp BF, Rose M. Development of a computer-adaptive test for depression (D-CAT)[J].Qual Life Res, 2005, 14(10): 2277-2291.  
34Kosinski M, Bjorner JB, Ware JE Jr, Sullivan E, Straus WL. An evaluation of a patient-reported outcomes found computerized adaptive testing was efficient in assessing osteoarthritis impact[J].J Clin Epidemiol, 2006, 59(7): 715-723.  
35Gibbons RD, Weiss DJ, Kupfer DJ, Frank E, Fagiolini A, Grochocinski VJ, Bhaumik DK, Stover A, Bock RD, Immekus JC. Using computerized adaptive testing to reduce the burden of mental health assessment[J].Psychiatr Serv, 2008, 59(4): 361-368.  
36Haley SM, Ni P, Jette AM, Tao W, Moed R, Meyers D, Ludlow LH. Replenishing a computerized adaptive test of patient-reported daily activity functioning[J].Qual Life Res, 2009, 18(4): 461-471.  
37Hart DL, Mioduski JE, Stratford PW. Simulated computerized adaptive tests for measuring functional status were efficient with good discriminant validity in patients with hip, knee, or foot/ankle impairments[J].J Clin Epidemiol, 2005, 58(6): 629-638.  
38Bjorner JB, Kosinski M, Ware JE Jr. The feasibility of applying item response theory to measures of migraine impact: a re-analysis of three clinical studies[J].Qual Life Res, 2003, 12(8): 887-902.  
39Kosinski M, Bjorner JB, Ware JE Jr, Batenhorst A, Cady RK. The responsiveness of headache impact scales scored using ‘classical’ and ‘modern’ psychometric methods: a re-analysis of three clinical trials[J].Qual Life Res, 2003, 12(8): 903-912.  
40Bjorner JB, Kosinski M, Ware JE Jr. Using item response theory to calibrate the Headache Impact Test (HIT) to the metric of traditional headache scales[J].Qual Life Res, 2003, 12(8): 981-1002.  
41Petersen MA, Groenvold M, Aaronson N, Brenne E, Fayers P, Nielsen JD, Sprangers M, Bjorner JB; for the European Organisation for Research and Treatment of Cancer Quality of Life Group. Scoring based on item response theory did not alter the measurement ability of EORTC QLQ-C30 scales[J].J Clin Epidemiol, 2005, 58(9): 902-908.  
42Allison KC, Engel SG, Crosby RD, De Zwaan M, O’Reardon JP, Wonderlich SA, Mitchell JE, West DS, Wadden TA, Stunkard AJ. Evaluation of diagnostic criteria for night eating syndrome using item response theory analysis[J].Eat Behav, 2008, 9(4): 398-407.  
43Wu LT, Pan JJ, Blazer DG, Tai B, Stitzer ML, Brooner RK, Woody GE, Patkar AA, Blaine JD. An item response theory modeling of alcohol and marijuana dependences: a National Drug Abuse Treatment Clinical Trials Network study[J].J Stud Alcohol Drugs, 2009, 70(3): 414-425.  
44Jiang Y, Hesser JE. Using item response theory to analyze the relationship between health-related quality of life and health risk factors[J].Prev Chronic Dis, 2009, 6(1): A30.  
45Chan KS, Orlando M, Ghosh-Dastidar B, Duan N, Sherbourne CD. The interview mode effect on the Center for Epidemiological Studies Depression (CES-D) scale: an item response theory analysis[J].Med Care, 2004, 42(3): 281-289.  
46Hahn EA, Cella D, Dobrez DG, Weiss BD, Du H, Lai JS, Victorson D, Garcia SF. The impact of literacy on health-related quality of life measurement and outcomes in cancer outpatients[J].Qual Life Res, 2007, 16(3): 495-507.  
47Birbeck GL, Kim S, Hays RD, Vickrey BG. Quality of life measures in epilepsy: how well can they detect change over time? Neurology. 2000; 54(9): 1822-1827.
48Hill CD, Edwards MC, Thissen D, Langer MM, Wirth RJ, Burwinkle TM, Varni JW. Practical issues in the application of item response theory: a demonstration using items from the pediatric quality of life inventory (PedsQL) 4.0 generic core scales[J].Med Care, 2007, 45(5 Suppl 1): S39-S47.  
49Masse LC, Heesch KC, Eason KE, Wilson M. Evaluating the properties of a stage-specific self-efficacy scale for physical activity using classical test theory, confirmatory factor analysis and item response modeling[J].Health Educ Res, 2006, 21(Suppl 1): i33-i46.  
50Tao W, Haley SM, Coster WJ, Ni P, Jette AM. An exploratory analysis of functional staging using an item response theory approach[J].Arch Phys Med Rehabil, 2008, 89(6): 1046-1053.  
51Jenkinson C, Fitzpatrick R, Garratt A, Peto V, Stewart-Brown S. Can item response theory reduce patient burden when measuring health status in neurological disorders? Results from Rasch analysis of the SF-36 physical functioning scale (PF-10)[J].J Neurol Neurosurg Psychiatry, 2001, 71(2): 220-224.  
52Van Nispen RM, Knol DL, Langelaan M, de Boer MR, Terwee CB, van Rens GH. Applying multilevel item response theory to vision-related quality of life in Dutch visually impaired elderly[J].Optom Vis Sci, 2007, 84(8): 710-720.  
53Hays RD, Morales LS, Reise SP. Item response theory and health outcomes measurement in the 21st century[J].Med Care, 2000, 38(9 Suppl): II28-II42.  
54Cook KF, Monahan PO, McHorney CA. Delicate balance between theory and practice: health status assessment and item response theory[J].Med Care, 2003, 41(5): 571-574.  
55Zhang MQ, Liu XY. A study on the applying of item response models[J].Xin Li Xue Bao, 1998, 30(4): 436-441. Chinese with abstract in English
56Cook KF, Teal CR, Bjorner JB, Cella D, Chang CH, Crane PK, Gibbons LE, Hays RD, McHorney CA, Ocepek-Welikson K, Raczek AE, Teresi JA, Reeve BB. IRT health outcomes data analysis project: an overview and summary[J].Qual Life Res, 2007, 16(Suppl 1): 121-132.  
57Chang CH. Patient-reported outcomes measurement and management with innovative methodologies and technologies[J].Qual Life Res, 2007, 16(Suppl 1): 157-166.  
58Unlü A. A note on monotone likelihood ratio of the total score variable in unidimensional item response theory[J].Br J Math Stat Psychol, 2008, 61(Pt 1): 179-187.  
59Sinharay S. Bayesian item fit analysis for unidimensional item response theory models[J].Br J Math Stat Psychol, 2006, 59(Pt 2): 429-449.  
60Cai L, Maydeu-Olivares A, Coffman DL, Thissen D. Limited-information goodness-of-fit testing of item response theory models for sparse 2 tables[J].Br J Math Stat Psychol, 2006, 59(Pt 1): 173-194.  
61Meredith W, Teresi JA. An essay on measurement and factorial invariance[J].Med Care, 2006, 44(11 Suppl 3): S69-S77.  
62Fayers PM. Applying item response theory and computer adaptive testing: the challenges for health outcomes assessment[J].Qual Life Res, 2007, 16(Suppl 1): 187-194.  
 Home | Current Issue | Past Issues | SearchRSS
Copyright © 2013-2018 by JIM Editorial Office. All rights reserved. ISSN 2095-4964; CN 31-2083/R. 沪ICP备110264号