ByteSpan Tokenisers

non-profit

AI & ML interests

None defined yet.

models 12

ByteSpanTokenisers/fineweb-models

Updated Jun 29, 2025

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalGlobalIncrement_64000

Updated Jun 29, 2025 • 39

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_BPEWP_64000

Updated Jun 23, 2025

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalMonotonicFrequency_64000

Updated Jun 23, 2025

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalCombinedSeeding_64000

Updated Jun 23, 2025

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalCombinedFrequency_64000

Updated Jun 23, 2025

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_fw57M_Surprisal_bytespanP1-0_64000

Updated Jun 23, 2025

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_ByteSpanSurprisalMonotonicSeeding_64000

Updated Jun 23, 2025

ByteSpanTokenisers/tokenizers

Updated Jun 12, 2025

ByteSpanTokenisers/fw57M-tied_finewebedu-20B_BPE_64000

Updated Jun 12, 2025

datasets 2

ByteSpanTokenisers/common-corpus

Viewer • Updated Jun 24, 2025 • 820k • 65

ByteSpanTokenisers/finewebedu-20B

Viewer • Updated Jun 23, 2025 • 162M • 947