cerebras.modelzoo.data_preparation.nlp.bert.create_csv

Preprocessed CSV data generator for BERT pretraining from raw text documents.

Functions

create_csv
main
parse_args

previous

cerebras.modelzoo.data_preparation.nlp.bert.bertsum_data_processor.Tokenizer

next

cerebras.modelzoo.data_preparation.nlp.bert.create_csv.create_csv