articleBMC Medical Informatics and Decision MakingMar 10, 2025GOLD OA

Advancing AI-driven thematic analysis in qualitative research: a comparative study of nine generative models on Cutaneous Leishmaniasis data

Université Mohammed VI des Sciences et de la Santé

PubMed
Indexed incrossrefdoajpubmed

Abstract

Background

As part of qualitative research, the thematic analysis is time-consuming and technical. The rise of generative artificial intelligence (A.I.), especially large language models, has brought hope in enhancing and partly automating thematic analysis.

Methods

The study assessed the relative efficacy of conventional against AI-assisted thematic analysis when investigating the psychosocial impact of cutaneous leishmaniasis (CL) scars. Four hundred forty-eight participant responses from a core study were analysed comparing nine A.I. generative models: Llama 3.1 405B, Claude 3.5 Sonnet, NotebookLM, Gemini 1.5 Advanced Ultra, ChatGPT o1-Pro, ChatGPT o1, GrokV2, DeepSeekV3, Gemini 2.0 Advanced with manual expert analysis. Jamovi software maintained methodological rigour through Cohen's Kappa coefficient calculations for concordance assessment and similarity measurement via Python using Jaccard index computations.

Citation impact

43
total citations
FWCI
47.67
Percentile
100%
References
37
Citations per year

Authors

2

Topics & keywords

Keywords
  • Rigour
  • Thematic analysis
  • Qualitative research
  • Computer science
  • Operationalization
  • Grounded theory
  • Artificial intelligence
  • Psychology
No related works found for this paper.