GPT-1 released — OpenAI's first generative pre-trained transformer

OpenAI releases GPT-1 with 117M parameters, demonstrating unsupervised pre-training on large corpora achieves state-of-the-art on diverse NLP tasks with fine-tuning.