Improving Language Understanding by Generative Pre-Training
11 June 2018
GPT-1: pretrain a Transformer decoder on text, then fine-tune. Generative pretraining works.
Sources: AI4U editorial.
11 June 2018
GPT-1: pretrain a Transformer decoder on text, then fine-tune. Generative pretraining works.
Sources: AI4U editorial.