April 3, 2017
We are writing to provide you with an update on the AAMC Standardized Video Interview project. As members of the Emergency Medicine Standardized Video Interview (EMSVI) Working Group, we’ve been working in collaboration with the Association of American Medical Colleges (AAMC) on a yearlong research study to explore the initial viability of the Standardized Video Interview in augmenting the residency selection process. We believe the Standardized Video Interview may provide program directors with better information to quickly assess applicants beyond their USMLE scores. It also may benefit applicants by allowing them to share objective, performance-based information about themselves, beyond academic metrics.
The EMSVI Working Group has overseen the work to evaluate this tool, particularly as it relates to: validity and reliability; bias and fairness; the scoring rubric used to rate the interviews; group differences; and correlations with other information provided in the residency application. The results from the research study are promising. Additional information is needed to understand the full scope of the Standardized Video Interview’s effectiveness as an aid in pre-interview selection decision-making. The best way to determine if the tool adds value to the residency selection process is through the operationalization of the tool. We believe strongly that residency leadership teams must have an opportunity to actually use the tool within their selection processes in order to properly assess its viability. Hence, the EMSVI Working Group has agreed to endorse an operational pilot in Emergency Medicine during the upcoming 2017-18 recruitment season.
The operational pilot will allow us to build upon the research study’s findings and continue exploring psychometric properties of the SVI and any possible relationships between the video scores and other selection criteria. Since the pilot is an extension of the research study, the AAMC will underwrite all costs associated with its implementation. We will continue to advise the AAMC on this work and to engage a series of programs to collect a subset of data to evaluate whether the SVI can predict residency performance and outcomes.
Even as we are supporting the pilot, we are looking forward to testing hypotheses and addressing questions. We will continue to work with the AAMC to determine the long-term viability of the Standardized Video Interview beyond the pilot, understand future costs; continue to explore any identified group differences; examine whether scores can be securely shared with applicants; evaluate the tool’s impact on applicants and programs; and ensure that applicants receive adequate resources to prepare for this requirement. We will work with the AAMC to respond to these important questions as well as others that may arise from the pilot.
We encourage you to support this pilot. Additional information can be found on AAMC’s website, Standardized Video Interview . If you have questions we can answer, please don’t hesitate to reach out to your EMSVI Working Group representative.
Richard Wolfe, MD, AACEM
Mary C. Haas, MD, AAEM/RSA
Katherine Hiller, MD, MPH, CDEM
Rahul Patwari, MD, CDEM
Fiona Gallahue, MD, CORD
H. Gene Hern, MD, CORD
Ramnik Dhaliwal, MD, JD, EMRA
Nicole Deiorio, MD, AAMC-GSA
Christopher Woleben, MD, AAMC-GSA
Yolanda C. Haywood, MD, AAMC-GDI
Steven Bird, MD, SAEM
Andra Blomkalns, MD, SAEM