Skip to content

People Papers Models Technologies Organizations Events Datasets Benchmarks

C4

October 2019

750GB of filtered Common Crawl text, released with T5.

Also: Colossal Clean Crawled Corpus

Connections

Introduced in 1

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer2019

Models trained on it 1

T52019

Facts

Date: October 2019
Era: Transformers and scale
Also called: Colossal Clean Crawled Corpus

Links

Website

Sources: AI4U editorial.

AI4U Atlas. Built from Wikidata, arXiv, OpenAlex, the Epoch AI notable models dataset (CC BY), the Hugging Face Hub and OpenRouter, plus our own writing.

Timeline · Chat · aheadintofun