modelzoo.transformers.data_processing.scripts.chunk_preprocessing.utils.dump_result#

modelzoo.transformers.data_processing.scripts.chunk_preprocessing.utils.dump_result(results, json_params_file, eos_id=None, pad_id=None, vocab_size=None)[source]#

Write outputs of execution

previous

modelzoo.transformers.data_processing.scripts.chunk_preprocessing.utils

next

modelzoo.transformers.data_processing.scripts.hdf5_preprocessing