cerebras.modelzoo.data.nlp.transformer.TransformerDynamicDataProcessor

Processor for PyTorch Transformer training.

Classes

TransformerDynamicDataProcessor

Reads text files containing the input text tokens.

previous

cerebras.modelzoo.data.nlp.transformer

next

cerebras.modelzoo.data.nlp.transformer.TransformerDynamicDataProcessor.TransformerDynamicDataProcessor