reviewIEEE AccessJan 1, 2024GOLD OA

GPT (Generative Pre-Trained Transformer)— A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directions

SRM University · VIT-AP University · +7 more institutions

Indexed incrossrefdoaj

Abstract

The Generative Pre-trained Transformer (GPT) represents a notable breakthrough in the domain of natural language processing, which is propelling us toward the development of machines that can understand and communicate using language in a manner that closely resembles that of humans. GPT is based on the transformer architecture, a deep neural network designed for natural language processing tasks. Due to their impressive performance on natural language processing tasks and ability to effectively converse, GPT have gained significant popularity among researchers and industrial communities, making them one of the most widely used and effective models in natural language processing and related fields, which…

Citation impact

523
total citations
FWCI
115.90
Percentile
100%
References
211
Citations per year

Authors

12

Topics & keywords

Keywords
  • Computer science
  • Transformer
  • Architecture
  • Natural language understanding
  • Emerging technologies
  • Natural language
  • Generative grammar
  • Artificial intelligence
UN Sustainable Development Goals
  • Quality Education
No related works found for this paper.