cerebras.modelzoo.data.nlp.gpt

DummyDataProcessor	Pytorch Generic Dataloader
DummyIterableDataProcessor	Pytorch Generic Iterable Dataloader
GptHDF5DataProcessor	Pytorch GPT2/3 Dataloader
GptHDF5MapDataProcessor
HuggingFaceDataProcessorEli5	Pytorch HuggingFace Eli5 map-style Dataloader
HuggingFaceIterableDataProcessorEli5	Pytorch HuggingFace Eli5 Iterable Dataloader
InferenceDataProcessor

previous

cerebras.modelzoo.data.nlp.dpo.DpoHDF5DataProcessor.DpoHDF5DataProcessor

next

cerebras.modelzoo.data.nlp.gpt.DummyDataProcessor