TY - JOUR
T1 - Quality Control for Scoring Tests Administered in Continuous Mode
T2 - An NCME Instructional Module
AU - Allalouf, Avi
AU - Gutentag, Tony
AU - Baumer, Michal
N1 - Publisher Copyright:
© 2017 by the National Council on Measurement in Education
PY - 2017/3/1
Y1 - 2017/3/1
N2 - Quality control (QC) in testing is paramount. QC procedures for tests can be divided into two types. The first type, one that has been well researched, is QC for tests administered to large population groups on few administration dates using a small set of test forms (e.g., large-scale assessment). The second type is QC for tests, usually computerized, that are administered to small population groups on many administration dates using a wide array of test forms (CMT—continuous mode tests). Since the world of testing is headed in this direction, developing QC for CMT is crucial. In the current ITEMS module we discuss errors that might occur at the different stages of the CMT process, as well as the recommended QC procedure to reduce the incidence of each error. Illustration from a recent study is provided, and a computerized system that applies these procedures is presented. Instructions on how to develop one's own QC procedure are also included.
AB - Quality control (QC) in testing is paramount. QC procedures for tests can be divided into two types. The first type, one that has been well researched, is QC for tests administered to large population groups on few administration dates using a small set of test forms (e.g., large-scale assessment). The second type is QC for tests, usually computerized, that are administered to small population groups on many administration dates using a wide array of test forms (CMT—continuous mode tests). Since the world of testing is headed in this direction, developing QC for CMT is crucial. In the current ITEMS module we discuss errors that might occur at the different stages of the CMT process, as well as the recommended QC procedure to reduce the incidence of each error. Illustration from a recent study is provided, and a computerized system that applies these procedures is presented. Instructions on how to develop one's own QC procedure are also included.
KW - computer-based testing
KW - continuous mode tests
KW - quality control
KW - scoring
UR - http://www.scopus.com/inward/record.url?scp=85016193383&partnerID=8YFLogxK
U2 - 10.1111/emip.12140
DO - 10.1111/emip.12140
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:85016193383
SN - 0731-1745
VL - 36
SP - 58
EP - 68
JO - Educational Measurement: Issues and Practice
JF - Educational Measurement: Issues and Practice
IS - 1
ER -