modelzoo.transformers.data_processing.scripts.chunk_preprocessing.create_hdf5_dataset

Script to generate an HDF5 dataset for GPT Models.

Functions

main	Main function for execution.

previous

modelzoo.transformers.data_processing.scripts.chunk_preprocessing.chunk_data_preprocessor.ChunkDataPreprocessor

next

modelzoo.transformers.data_processing.scripts.chunk_preprocessing.create_hdf5_dataset.main