ChatGPT: Jack of all trades, master of none
Wrocław University of Science and Technology · AGH University of Krakow
Abstract
OpenAI has released the Chat Generative Pre-trained Transformer (ChatGPT) and revolutionized the approach in artificial intelligence to human-model interaction. The first contact with the chatbot reveals its ability to provide detailed and precise answers in various areas. Several publications on ChatGPT evaluation test its effectiveness on well-known natural language processing (NLP) tasks. However, the existing studies are mostly non-automated and tested on a very limited scale. In this work, we examined ChatGPT’s capabilities on 25 diverse analytical NLP tasks, most of them subjective even to humans, such as sentiment analysis, emotion recognition, offensiveness, and stance detection. In contrast, the other…
Citation impact
- FWCI
- 24.76
- Percentile
- 100%
- References
- 103
Authors
20- JKJan KocońCorresponding
Wrocław University of Science and Technology, AGH University of Krakow
- ICIgor Cichecki
Wrocław University of Science and Technology, AGH University of Krakow
- OKOliwier Kaszyca
Wrocław University of Science and Technology, AGH University of Krakow
- MKMateusz Kochanek
Wrocław University of Science and Technology, AGH University of Krakow
- DSDominika Szydło
Wrocław University of Science and Technology, AGH University of Krakow
Topics & keywords
- Computer science
- Master data
- Aeronautics
- Database
- Engineering
- Quality Education
Funding
- NCNarodowe Centrum NaukiAward: 2021/41/B/ST6/04471
- MEMinisterstwo Edukacji i Nauki
- PWPolitechnika Wrocławska
- HEHORIZON EUROPE Framework Programme
- EREuropean Regional Development FundAwards: POIR.01.01, POIR.04.02.00-00C002/19, 01-00-0288/22, POIR.01.01.01-00-0288/22
- DODepartment of Artificial Intelligence, Korea University
- HEHORIZON EUROPE Marie Sklodowska-Curie ActionsAward: 101086321
- EREuropean Research Executive Agency