cerebras.modelzoo.data_preparation.nlp.slimpajama.split_dataset

Functions

generate_samples
main
write_samples

previous

cerebras.modelzoo.data_preparation.nlp.slimpajama.preprocessing.shuffle_holdout.write_docs

next

cerebras.modelzoo.data_preparation.nlp.slimpajama.split_dataset.generate_samples