Examination of Medical College Admission Test Scores and US Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge Scores Among Students With Disabilities

the between Test (MCAT) and US Examination (USMLE) in this Previous studies were focused on a single site 3 and were performed prior to changes in disability law and increases in disability disclosure. 2,3 Historical literature suggests that students with disabilities (SWD) have lower USMLE pass rates 2 and lower Step 1 and Step 2 Clinical Knowledge (CK) scores. 3 Despite recent attention to differential MCAT performance among students with lower socioeconomic status backgrounds and those identifying as races/ethnicities underrepresented in medicine, 4 disability has been conspicuously absent from these discussions. If the MCAT is to remain a useful tool for assessing the likelihood of success in medical school, data on performance outcomes in diverse cohorts of students are needed. 5 We examined the association of MCAT scores, disability status and category, and performance on Step 1 and Step 2 CK scores in a multisite, multiyear cohort of SWD who matriculated following amendments to the Americans with Disabilities Act. 6 we ran linear mixed models using MCAT, disability group, and the interaction between MCAT and disability group as covariates. Random effects for school and matched were to for clustering. Secondary analyses separated SWD into vs and compared NDC group participants using a 3-group approach. The NDC group was the group for all comparisons. Model assumptions assessed determined A significance determining


Introduction
An increasing number of medical students are disclosing disabilities, 1 yet little is known about the association between Medical College Admission Test (MCAT) and US Medical Licensing Examination (USMLE) performance in this population. Previous studies were focused on a single site 3 and were performed prior to changes in disability law and increases in disability disclosure. 2,3 Historical literature suggests that students with disabilities (SWD) have lower USMLE pass rates 2

and lower
Step 1 and Step 2 Clinical Knowledge (CK) scores. 3 Despite recent attention to differential MCAT performance among students with lower socioeconomic status backgrounds and those identifying as races/ethnicities underrepresented in medicine, 4 disability has been conspicuously absent from these discussions. If the MCAT is to remain a useful tool for assessing the likelihood of success in medical school, data on performance outcomes in diverse cohorts of students are needed. 5 We examined the association of MCAT scores, disability status and category, and performance on Step 1 and Step 2 CK scores in a multisite, multiyear cohort of SWD who matriculated following amendments to the Americans with Disabilities Act. 6

Methods
We conducted a retrospective cohort study of 163 graduating SWD from 11 US medical schools in 2018 and 2019 matched with 2 nondisabled control (NDC) participants by self-reported gender at application and MCAT score, yielding a final sample of 488 students. The University of Michigan Medical School institutional review board approved this study. The requirement for informed consent was waived because data were deidentified. The study followed the American Association for Public Opinion Research (AAPOR) reporting guideline. SWD were dichotomized into 2 groups following previous literature. 3 The cognitive group included students with psychological, learning, and attention deficit disorders; the noncognitive group included all others. Primary outcome measures included scores on USMLE Step 1 and Step 2 CK. To assess the association between MCAT and USMLE scores, we ran linear mixed models using MCAT, disability group, and the interaction between MCAT and disability group as covariates. Random effects for school and matched pairs were included to account for clustering. Secondary analyses separated SWD into those with cognitive vs noncognitive disabilities and compared each with NDC group participants using a 3-group approach. The NDC group was the reference group for all comparisons. Model assumptions included normality of error terms and random effects; both were assessed and determined to be reasonably met. A significance level of P < .05 was used in determining significant associations, and all tests were 2-sided. Statistical analyses were conducted in Stata IC version 15.1 (StataCorp).

Results
The reported noncognitive disabilities, and disabilities for 5 (3.1%) were unknown. Our models showed that MCAT scores were positively associated with USMLE Step 1 and Step 2 CK scores for all students (Table). After adjusting for MCAT score, SWD status was associated with lower mean USMLE scores (B = −11.2; 95% CI, −14.0 to −8.4). Neither model had a significant disability by MCAT interaction, suggesting that changes in MCAT scores were associated with similar changes in USMLE scores regardless of disability status (Figure). Students with noncognitive disabilities had significantly lower Step 1 scores than students in the NDC group (B = −5.8; 95% CI, −10.6 to −1.1) but did not differ significantly from students in the NDC group on Step 2 CK scores (B = −3.4; 95% CI, −7.7 to 0.9).
Students with cognitive disabilities had significantly lower mean scores than both students in the NDC group and those with noncognitive disabilities on both Step 1 (cognitive disability vs NDC: B = −13.3; 95% CI, −16.6 to −10.0; cognitive vs noncognitive disability: B = −7.3; 95% CI, −12.7 to −1.9)  Step 1 score MCAT score Step 1 score Step 2 CK score MCAT score Step 2 CK score Lines indicate unadjusted regression fit lines between MCAT and US Medical Licensing Examination scores for students with disabilities (SWD) and the control group.