modelzoo.transformers.pytorch.transformer.input.data_processing.split_files

Split input src/tgt file into multiple files. Number of examples per file is controlled by buffer_len param.

Functions

main

previous

modelzoo.transformers.pytorch.transformer.input.data_processing.create_meta.main

next

modelzoo.transformers.pytorch.transformer.input.data_processing.split_files.main