What is Generative pre-trained transformer (GPT)?
GPT (generative pre-trained transformer) refers to a series of large language models developed by OpenAI and based on the transformer architecture. The models are first pre-trained on vast amounts of text to predict the next token and then further trained for dialogue and following instructions. The first GPT model appeared in 2018; later generations underpin ChatGPT. In everyday speech, ‘GPT’ is often used for language models in general.