modelzoo.transformers.data_processing.slimpajama.split_dataset.write_samples

modelzoo.transformers.data_processing.slimpajama.split_dataset.write_samples(q, dataset, out_dir)

previous

modelzoo.transformers.data_processing.slimpajama.split_dataset.main

next

modelzoo.transformers.data_processing.slimpajama.utils