From Prediction to Precision: Leveraging LLMs for Equitable and Data-Driven Writing Placement in Developmental Education
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento · University of Algarve
Abstract
Accurate text classification and placement remain challenges in U.S. higher education, with traditional automated systems like Accuplacer functioning as "black-box" models with limited assessment transparency. This study evaluates Large Language Models (LLMs) as complementary placement tools by comparing their classification performance against a human-rated gold standard and Accuplacer. A 450-essay corpus was classified using Claude, Gemini, GPT-3.5-turbo, and GPT-4o across four prompting strategies: Zero-shot, Few-shot, Enhanced, and Enhanced+ (definitions with examples). Two classification approaches were tested: (i) a 1-step, 3 class classification task, distinguishing DevEd Level 1, DevEd Level 2, and…
Citation impact
- FWCI
- 234.76
- Percentile
- 100%
- References
- 0
Authors
2- DCDa Corte, MiguelCorresponding
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento, University of Algarve
- BJBaptista, Jorge
Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento, University of Algarve
Topics & keywords
- Computer science
- Machine learning
- Classifier (UML)
- Artificial intelligence
- Class (philosophy)
- Process (computing)
- Data mining