Wednesday, August 23, 2023
JD-Next: A Valid And Reliable Tool To Predict Diverse Students’ Success In Law School
Jessica Findley, Adriana Cimetta, Heidi Burross, Katherine Cheng, Matt Charles, Cayley Balser, Ran Li & Christopher T. Robertson (Arizona), JD-Next: A Valid and Reliable Tool to Predict Diverse Students’ Success in Law School, 20 J. Empirical Legal Stud. 134 (2023):
Admissions tests have increasingly come under attack by those seeking to broaden access and reduce disparities in higher education. Meanwhile, in other sectors there is a movement towards “work-sample” or “proximal” testing. Especially for underrepresented students, the goal is to measure not just the accumulated knowledge and skills that they would bring to a new academic program, but also their ability to grow and learn through the program.
The JD-Next is a fully-online, non-credit, 7-10 week course to train potential JD students in case reading and analysis skills, prior to their first year of law school. This study tests the validity and reliability of the JD-Next exam as a potential admissions tool for juris doctor programs of education. (In a companion article, we report on the efficacy of the course for preparing students for law school.)
In 2019, we recruited a national sample of potential JD students, enriched for racial/ethnic diversity, along with a sample of volunteers at one university (N=62). In 2020, we partnered with 17 law schools around the country to recruit a cohort of their incoming law students (N=238). At the end of the course, students were incentivized to take and perform well on an exam that we graded with a standardized methodology. We collected first-semester grades as an outcome variable.
We found that the exam was a valid and reliable predictor of law school performance, comparable to legacy exams (LSAT or GRE) now used by law schools. For schools ranked outside the top-50 we found that the legacy exams lacked significant incremental validity in our sample, but the JDNext exam provided a significant advantage. We also replicated known, substantial racial and ethnic disparities on the legacy exam scores, but estimate smaller, non-significant score disparities on the JD-Next exam. Together this research suggests that, as an admissions tool, the JD-Next exam may reduce the risk that capable students will be excluded from legal education and the legal profession.
https://taxprof.typepad.com/taxprof_blog/2023/08/jd-next-a-valid-and-reliable-tool-to-predict-diverse-students-success-in-law-school.html
