Research Reports

An Application of the VM-Index for the LSAT (RR 10-02)

From a test security perspective, answer copying is the issue of primary concern for high-stakes paper-and-pencil tests. Answer-copying behavior often results in an unusual agreement between the incorrect answers for a pair of test takers. Each pair consists of a subject (copier) and a source, where the subject copies answers from the source. A common approach to detecting unusual agreement between the incorrect answers of two test takers is the K-Index probability. The K-Index has been used at the Educational Testing Service (ETS) for decades, and its properties have been further explored in the literature. The major advantage of the K-Index is its applicability to any multiple-choice response data. The major disadvantage of the K-Index is a high Type II (i.e., false-negative) error rate when the source has a high score.

This report presents the VM-Index, a new statistic for detecting answer copying. The power of the VM-Index lies in its evaluation of a matrix of distributions of response matches in the variable (unscored) section of the LSAT. Note that the analysis of matches between variable section responses is especially informative, since adjacent test takers will have different variable sections. In a computational study, the VM-Index demonstrates a large decrease in the Type II error rate and a small decrease in the Type I (i.e., false-positive) error rate when compared with the K-Index.

Request the full report

Additional reports in this collection

researchers study paperwork and examine charts and figures on a tablet

Evidence to Support Validity Claims for Using LSAT Scores...

Law School Admission Test (LSAT) scores provide a standard measure of an applicant’s proficiency in a well-defined set of important skills associated with success in law school coursework. LSAT scores are also a strong predictor of first-year grades (FYG) and cumulative grade point average (CGPA) in law school. The most recent correlational study of LSAT results (2019) shows that LSAT scores are far superior to undergraduate grade point average (UGPA) in predicting FYG...

Understanding and Interpreting Law School Enrollment Data...

The Law School Admission Council (LSAC) has a long-standing commitment to diversity, equity, and inclusion in legal education and in the legal profession. In line with its mission to promote quality, access, and equity in legal education, LSAC is providing this report, Understanding and Interpreting Law School Enrollment Data: A Focus on Race and Ethnicity, to help law schools, admission professionals, and other legal education stakeholders understand how we are measuring who is the pipeline.