Canonical event

RedPajama releases open LLM training dataset

An open 1.2T-token dataset intended to reproduce an important part of the LLaMA training-data stack.

Artifacts

RedPajama 1.2T-token dataset
evidenced_by · open_training_dataset_release

Signals

Open training data, commercially usable model weights and multiple independent foundation-model families formed a more complete reproducible/open alternative model-development stack.
supported inference

View canonical JSON