Introduction
Get Started
Prepare your data
Cerebras PyTorch API
cerebras_pytorch
cerebras_pytorch.amp
cerebras_pytorch.optim
cerebras_pytorch.sparse
cerebras_pytorch.metrics
Cerebras Model Zoo
Cerebras Guides
Fundamentals
Support
Classes
H5Reader
Class for reading individual sequences from HDF5 files stored on disk.
Mixture
Mix several map-style datasets according to provided weights.
previous
modelzoo.transformers.data_processing.h5_map_dataset.preprocess_pile.save_run_info
next
modelzoo.transformers.data_processing.h5_map_dataset.readers.H5Reader