cerebras.modelzoo.data_preparation.nlp.gpt2.data_processor_utils

Functions

training_data_generator

Generator function used to create input dataset for GPT2Model.

previous

cerebras.modelzoo.data_preparation.nlp.gpt2

next

cerebras.modelzoo.data_preparation.nlp.gpt2.data_processor_utils.training_data_generator