cerebras.modelzoo.data_preparation.data_preprocessing.finetuning_token_generator#

Functions

create_features_finetuning

pad_to_msl

Classes

FinetuningTokenGenerator

previous

cerebras.modelzoo.data_preparation.data_preprocessing.fim_token_generator.FIMTokenGenerator

next

cerebras.modelzoo.data_preparation.data_preprocessing.finetuning_token_generator.create_features_finetuning