cerebras.modelzoo.data_preparation.nlp.bert.dynamic_processor

Functions

data_generator

Generator function used to create input dataset for MLM + NSP dataset.

Classes

PreprocessInstance

A single training (sentence-pair) instance.

previous

cerebras.modelzoo.data_preparation.nlp.bert.create_hdf5_files.main

next

cerebras.modelzoo.data_preparation.nlp.bert.dynamic_processor.data_generator