Research Reports

Fit to Testlet Models and Differential Testlet Functioning (RR 12-07)

A set of questions (i.e., items) grouped around a common stimulus is often referred to as a testlet. Law School Admission Test (LSAT) Reading Comprehension and Analytical Reasoning items are presented in a testlet format. Recent research has proposed two potential models for evaluating whether testlet response behavior can be predicted on the basis of various testlet features. This report presents a general method for evaluating the suitability not only of these models, but of the original model from which they are derived.

Differential item functioning and differential testlet functioning pertain to differences in responses to specific items and testlets that can be attributed not only to the proficiency assessed, but also to irrelevant background variables such as, for instance, gender or race/ethnicity. The model evaluation method presented here is further applied to the detection of differential item and testlet functioning, as well as to the evaluation of other statistical assumptions required by the models. The method was applied to two sets of LSAT data, and no serious model violations were detected.

Request the full report

Additional reports in this collection

researchers study paperwork and examine charts and figures on a tablet

Evidence to Support Validity Claims for Using LSAT Scores...

Law School Admission Test (LSAT) scores provide a standard measure of an applicant’s proficiency in a well-defined set of important skills associated with success in law school coursework. LSAT scores are also a strong predictor of first-year grades (FYG) and cumulative grade point average (CGPA) in law school. The most recent correlational study of LSAT results (2019) shows that LSAT scores are far superior to undergraduate grade point average (UGPA) in predicting FYG...

Understanding and Interpreting Law School Enrollment Data...

The Law School Admission Council (LSAC) has a long-standing commitment to diversity, equity, and inclusion in legal education and in the legal profession. In line with its mission to promote quality, access, and equity in legal education, LSAC is providing this report, Understanding and Interpreting Law School Enrollment Data: A Focus on Race and Ethnicity, to help law schools, admission professionals, and other legal education stakeholders understand how we are measuring who is the pipeline.