cerebras.modelzoo.data.nlp.t5.T5DynamicDataProcessor

Processor for PyTorch T5 training.

Classes

T5DynamicDataProcessor

Reads text files containing the input text tokens, adds extra ids for language modeling task on the fly.

previous

cerebras.modelzoo.data.nlp.t5

next

cerebras.modelzoo.data.nlp.t5.T5DynamicDataProcessor.T5DynamicDataProcessor