Introduction
Get Started
Prepare your data
Cerebras PyTorch API
cerebras_pytorch
cerebras_pytorch.amp
cerebras_pytorch.optim
cerebras_pytorch.sparse
cerebras_pytorch.metrics
Cerebras Model Zoo
Cerebras Guides
Fundamentals
Support
Collect statistics of the dataset.
data_arr (numpy.ndarray) – Numpy array containing the dataset.
args (ValidationArgs) – Arguments for verifying HDF5 dataset.
previous
modelzoo.transformers.data_processing.scripts.hdf5_preprocessing.utils.chunk
next
modelzoo.transformers.data_processing.scripts.hdf5_preprocessing.utils.create_features_auto_lm