Common Crawl

Common Crawl is a non-profit maintaining a free, open repository of web crawl data used to train many large language models and search engines. Researchers and AI developers access petabytes of web text for pre-training and NLP research.

Category: Computers-internet > Artificial-intelligence > Ai-data-and-training > Training-datasets Upgrade Options