Cerebras Wafer-Scale cluster (R2.1.0)
Original Cerebras Installation Documentation (R1.6.1)
Cerebras AI Model Studio Documentation

Introduction

Overview
Weight Streaming Execution

Get Started

Run your first Cerebras job
Beginner Tutorials
- Training and fine-tuning a Large Language Model (LLM)
- Training a UNet for large image segmentation
Cerebras job scheduling and monitoring

Prepare your data

Data Processing and Dataloaders

Cerebras PyTorch API

Cerebras PyTorch API
Writing a Custom Training Loop

Cerebras Model Zoo

Model configuration using Cerebras Model Zoo
Cerebras Model Zoo YAML parameters
Convert checkpoints and model configs
- Work with Cerebras checkpoints
Port model using Cerebras Model Zoo
- Port PyTorch model to Cerebras
Cerebras Model Zoo Supported Operations API
- modelzoo

Cerebras Guides

How-to Guides

Fundamentals

Model Development
For training and evaluating any model
Boosting Model performance

Support

Troubleshooting
Software Release Notes
Documentation Updates
User Authentication on a Cerebras Wafer-Scale cluster
Glossary

modelzoo.transformers.data_processing#

`bert`
`huggingface`
`qa`
`scripts`
`slimpajama`
`tokenizers`
`utils`

previous

Creating Custom Dataloaders

next

modelzoo.transformers.data_processing.bert

© Copyright 2023, Cerebras Systems.

Created using Sphinx 4.4.0.