On the assessment of generative AI in modeling tasks: an experience report with ChatGPT and UML
Universidad de Málaga · Software (Spain)
Abstract
Abstract Most experts agree that large language models (LLMs), such as those used by Copilot and ChatGPT, are expected to revolutionize the way in which software is developed. Many papers are currently devoted to analyzing the potential advantages and limitations of these generative AI models for writing code. However, the analysis of the current state of LLMs with respect to software modeling has received little attention. In this paper, we investigate the current capabilities of ChatGPT to perform modeling tasks and to assist modelers, while also trying to identify its main shortcomings. Our findings show that, in contrast to code generation, the performance of the current version of ChatGPT for software…
Citation impact
- FWCI
- 80.04
- Percentile
- 100%
- References
- 12
Authors
4Topics & keywords
- Computer science
- Consistency (knowledge bases)
- Unified Modeling Language
- Software
- Modeling language
- Software engineering
- Generative grammar
- Code (set theory)
- Quality Education