cerebras.modelzoo.data.nlp.gpt#

DummyDataProcessor

Pytorch Generic Dataloader

DummyIterableDataProcessor

Pytorch Generic Iterable Dataloader

GptHDF5DataProcessor

Pytorch GPT2/3 Dataloader

GptHDF5MapDataProcessor

HuggingFaceDataProcessorEli5

Pytorch HuggingFace Eli5 map-style Dataloader

HuggingFaceIterableDataProcessorEli5

Pytorch HuggingFace Eli5 Iterable Dataloader

InferenceDataProcessor

config

Config classes of T5 data Configs