cerebras.modelzoo.data.nlp.bert.BertSumCSVDataProcessor

Processor for PyTorch BERT fine tuning - Summarization.

Functions

create_bertsum_feature

Creates the feature dict for bertsum model after applying padding.

Classes

BertSumCSVDataProcessor

Reads csv file containing the input_token_ids, and label_ids.

previous

cerebras.modelzoo.data.nlp.bert.BertHDF5DataProcessor.BertHDF5DataProcessor

next

cerebras.modelzoo.data.nlp.bert.BertSumCSVDataProcessor.create_bertsum_feature