preprintDagstuhl Research Online Publication ServerJan 1, 2025GREEN OA

From Prediction to Precision: Leveraging LLMs for Equitable and Data-Driven Writing Placement in Developmental Education

DCDa Corte, MiguelBJBaptista, Jorge

Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento · University of Algarve

Indexed indatacite

Abstract

Accurate text classification and placement remain challenges in U.S. higher education, with traditional automated systems like Accuplacer functioning as "black-box" models with limited assessment transparency. This study evaluates Large Language Models (LLMs) as complementary placement tools by comparing their classification performance against a human-rated gold standard and Accuplacer. A 450-essay corpus was classified using Claude, Gemini, GPT-3.5-turbo, and GPT-4o across four prompting strategies: Zero-shot, Few-shot, Enhanced, and Enhanced+ (definitions with examples). Two classification approaches were tested: (i) a 1-step, 3 class classification task, distinguishing DevEd Level 1, DevEd Level 2, and…

Citation impact

737
total citations
FWCI
234.76
Percentile
100%
References
0
Citations per year

Authors

2
  • DC
    Da Corte, MiguelCorresponding

    Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento, University of Algarve

  • BJ
    Baptista, Jorge

    Instituto de Engenharia de Sistemas e Computadores Investigação e Desenvolvimento, University of Algarve

Topics & keywords

Keywords
  • Computer science
  • Machine learning
  • Classifier (UML)
  • Artificial intelligence
  • Class (philosophy)
  • Process (computing)
  • Data mining
No related works found for this paper.