cerebras.modelzoo.data.nlp.bert.BertCSVDynamicMaskDataProcessor

Processor for PyTorch BERT training.

Classes

BertCSVDynamicMaskDataProcessor

Reads csv files containing the input text tokens, adds MLM features on the fly.

previous

cerebras.modelzoo.data.nlp.bert.BertCSVDataProcessor.BertCSVDataProcessor

next

cerebras.modelzoo.data.nlp.bert.BertCSVDynamicMaskDataProcessor.BertCSVDynamicMaskDataProcessor