Research Reports

Likelihood-based Estimation Methods for Models for Concurrent Continuous and Discrete Responses (RR 05-04)

Test theory typically deals with categorical responses to test questions (items), for instance, correct/incorrect responses or responses that represent a choice from a finite number of alternatives. Whenever technically possible, it is attractive to collect information on continuous response variables that accompany these responses as a covariate. One obvious example is response time; other examples are information on cursor movement in computer-based testing, eye-tracking information, or physiological information.

In the present report, an item response theory (IRT) model (recall that IRT is a mathematical model that is typically used to analyze test data) is proposed that allows for the simultaneous analysis of categorical and continuous data within a testing situation. To make the model general, we deal with the case of multidimensional abilities as well as items that are presented in testlets (e.g., sets of items that are based on a common text passage).

A method for estimating the necessary parameters for the proposed model is presented and statistical tests of model fit are evaluated. The false positive error rates of the model fit tests were shown to be low, and decreased as sample size and test length were increased. The power of the tests to detect true model misfit decreased as the complexity of the IRT model increased.

Request the full report

Additional reports in this collection

researchers study paperwork and examine charts and figures on a tablet

Evidence to Support Validity Claims for Using LSAT Scores...

Law School Admission Test (LSAT) scores provide a standard measure of an applicant’s proficiency in a well-defined set of important skills associated with success in law school coursework. LSAT scores are also a strong predictor of first-year grades (FYG) and cumulative grade point average (CGPA) in law school. The most recent correlational study of LSAT results (2019) shows that LSAT scores are far superior to undergraduate grade point average (UGPA) in predicting FYG...

Understanding and Interpreting Law School Enrollment Data...

The Law School Admission Council (LSAC) has a long-standing commitment to diversity, equity, and inclusion in legal education and in the legal profession. In line with its mission to promote quality, access, and equity in legal education, LSAC is providing this report, Understanding and Interpreting Law School Enrollment Data: A Focus on Race and Ethnicity, to help law schools, admission professionals, and other legal education stakeholders understand how we are measuring who is the pipeline.