PLUG

Abstract

ExperienceAfter the Great Refining Model, the field of artificial intelligence is entering the era of "Renging Model".Since OpenAI released the ultra-large-scale pre-training language model GPT-3 in the English field last year, the training process of similar models in the Chinese field has received much attention.Today, the Aridal Moral Court released 27 billion parameters, 1TB + training data, the world's largest Chinese pre-training language model PLUG, and refreshed the historical record of the CLUE classification list with a score of 80.614. (autotranslate from Chinese)