modelzoo.transformers.pytorch.gpt2.input.GptTextDataProcessor

Classes

GptTextDataProcessor

A text dataset processor for GPT pre-training.

previous

modelzoo.transformers.pytorch.gpt2.input.GptHDF5MapDataProcessor.GptHDF5MapDataProcessor

next

modelzoo.transformers.pytorch.gpt2.input.GptTextDataProcessor.GptTextDataProcessor