KletterMix source and mixture-construction data
Candidate pools and mixture buckets used to construct the tokenized Qwen3 and OLMo 3 training corpora. These are provenance artifacts, not a single training mixture.
| Branch | Contents |
|---|---|
fineweb2-de-candidates |
FineWeb2-deu_Latn candidate pool used to construct the 15% and 20% replacement mixtures. |
germanweb-candidates |
GermanWeb candidate pool used to construct the 15% and 20% replacement mixtures. |
olmo3-mixture-buckets |
OLMo 3-tokenized ClimbMix/KletterMix mixture buckets, including the 80% ClimbMix base and incremental KletterMix buckets. |
The branch names are part of the reproducibility interface. The private
KletterMix_Ablations
repository records the local source paths, exact branch commits, and the
submodule mapping. The tokenized data can be consumed by Megatron using the
.bin/.idx prefix in the selected branch.
- Downloads last month
- 26