articleACM Transactions on Knowledge Discovery from DataJan 31, 2025Closed access

Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning

Massey University · Bond University · +1 more institution

Indexed incrossref

Abstract

This research pioneers the use of fine-tuned Large Language Models (LLMs) to automate Systematic Literature Reviews (SLRs), presenting a significant and novel contribution in integrating AI to enhance academic research methodologies. Our study employed advanced fine-tuning methodologies on open sourced LLMs, applying textual data mining techniques to automate the knowledge discovery and synthesis phases of an SLR process, thus demonstrating a practical and efficient approach for extracting and analyzing high-quality information from large academic datasets. The results maintained high fidelity in factual accuracy in LLM responses, and were validated through the replication of an existing PRISMA-conforming SLR.…

Citation impact

48
total citations
FWCI
81.95
Percentile
100%
References
73
Citations per year

Authors

6

Topics & keywords

Keywords
  • Computer science
  • Transparency (behavior)
  • Data science
  • Systematic review
  • Scalability
  • Fidelity
  • Process (computing)
  • Domain (mathematical analysis)
No related works found for this paper.