Introduction
Get Started
Prepare your data
Cerebras PyTorch API
cerebras_pytorch
cerebras_pytorch.amp
cerebras_pytorch.optim
cerebras_pytorch.sparse
cerebras_pytorch.metrics
Cerebras Model Zoo
Cerebras Guides
Fundamentals
Support
Download The Pile dataset from eye.ai website.
args (argparse namespace) – Arguments for downloading the dataset.
split (str) – The subset of the PILE dataset to download.
previous
modelzoo.transformers.data_processing.scripts.pile.download.debug_or_download_individual_file
next
modelzoo.transformers.data_processing.scripts.pile.download.download_tokenizer_files