Research Reports

Stochastic Programming for Individualized Test Assembly With Mixture Response Time Models (RR 15-01)

Many standardized tests are now administered via computer rather than paper and pencil. The computer-based delivery mode brings with it certain advantages, such as the ability to record not only the test taker’s response to each item (i.e., question), but also the amount of time the test taker spends considering and answering each item. The analysis of response times (RTs) is still a developing area of research.

Early RT research assumed that a test taker would show consistent RTs over the course of a test. Such models may be unrealistic for various reasons—some items require more time than others to answer, a warm-up effect may cause a test taker to respond more quickly after completing the early items, fatigue may cause a test taker to slow down toward the end of a test, or as time runs out the test taker may quickly guess the answers to the last items on a test. To take these variable RTs into account, mixture RT models have recently been investigated.

Until now, mixture RT models have only been applied for post hoc analyses. This research expands the use of these models by exploring their application in the context of test assembly. Various strategies were applied and the strengths and weaknesses of each described. In general, it was concluded that the application of mixture RT models should prove especially useful for tests with a heterogeneous testing population.

Request the full report

Additional reports in this collection

researchers study paperwork and examine charts and figures on a tablet

Evidence to Support Validity Claims for Using LSAT Scores...

Law School Admission Test (LSAT) scores provide a standard measure of an applicant’s proficiency in a well-defined set of important skills associated with success in law school coursework. LSAT scores are also a strong predictor of first-year grades (FYG) and cumulative grade point average (CGPA) in law school. The most recent correlational study of LSAT results (2019) shows that LSAT scores are far superior to undergraduate grade point average (UGPA) in predicting FYG...

Understanding and Interpreting Law School Enrollment Data...

The Law School Admission Council (LSAC) has a long-standing commitment to diversity, equity, and inclusion in legal education and in the legal profession. In line with its mission to promote quality, access, and equity in legal education, LSAC is providing this report, Understanding and Interpreting Law School Enrollment Data: A Focus on Race and Ethnicity, to help law schools, admission professionals, and other legal education stakeholders understand how we are measuring who is the pipeline.