Running Featured 1.46k FineWeb: decanting the web for the finest text data at scale 🍷 1.46k Explore the FineWeb dataset and its creation process
Running Featured 78 FinePDFs: Liberating 3T of the finest tokens from PDFs 📄 78 Explore the FinePDFs PDF token dataset
Running on CPU Upgrade 285 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens 📝 285 Explore synthetic data experiments on a bookshelf visualization