cerebras.modelzoo.data_preparation.nlp.gptj.split_trc_dataset

Split input src file into multiple files. Number of examples per file is controlled by buffer_len param.

Functions

main

previous

cerebras.modelzoo.data_preparation.nlp.gptj.fine_tuning.continuous_pretraining

next

cerebras.modelzoo.data_preparation.nlp.gptj.split_trc_dataset.main