modelzoo.transformers.data_processing.huggingface.CSDataCollatorForLanguageModeling

Classes

CSDataCollatorForLanguageModeling

Overrides DataCollatorForLanguageModeling from HF to shift the inputs/labels in the dataloader

previous

modelzoo.transformers.data_processing.huggingface

next

modelzoo.transformers.data_processing.huggingface.CSDataCollatorForLanguageModeling.CSDataCollatorForLanguageModeling