.. _cerebras-docs: Explore the Documentation ========================= .. raw:: html

This documentation will help you program for the CS system. It covers both basic and advanced topics. Use these docs to accelerate your machine learning training and inference applications on the CS system. Here you will find getting started guides, quickstarts, tutorials, code examples, release notes, and more.

Learn Cerebras basics

Big picture view of a CS system How Cerebras works

Start with this big picture before you dive into your ML development with Cerebras system.

Programming model and the compiler

Get to know how Cerebras separates compile vs execution, and the compiler flow from framework to the executable.

The Cerebras server cluster

How a Cerebras multi-worker configuration differs from a GPU multi-worker configuration.

Weight streaming vs pipelined execution

How to run an extremely large model such as a GPT-3 model (with ~1 billion parameters) or a smaller sized model.

ML workflow on Cerebras Cerebras ML workflow

Whether your framework is TensorFlow or PyTorch, get to know the general ML workflow on Cerebras first.

Quickstarts

But first, a checklist Checklist

Go over this quick checklist to ensure you have access credentials, hostnames, IP address of the CS system and more.

Checkout the reference models

Reference code Cerebras Model Zoo Reference Models

GitHub repo with a partial list of various neural network models currently supported.

Start developing

Dive into developing with TensorFlow and PyTorch

PyTorch or TensorFlow, we got you covered. Start your framework-to-CS journey here.

Optimize your ML code Performance optimization practices

Determine optimal Slurm resources, use the compiler report to enhance input function.

Extensions

Contact For questions and feedback on documentation Contact ``docs@cerebras.net`` via email. For support Contact ``support@cerebras.net`` via email. Cerebras company website Visit `cerebras.net `_. .. toctree:: :maxdepth: 3 :hidden: release-notes/rel-notes-cumulative.rst release-notes/doc-updates.rst .. toctree:: :caption: Cerebras Basics :maxdepth: 2 :hidden: cerebras-basics/how-cerebras-works.rst cerebras-basics/cs-ml-workflow.rst cerebras-basics/cerebras-execution-modes.rst .. toctree:: :caption: Getting Started :maxdepth: 2 :hidden: getting-started/software-dependencies.rst getting-started/checklist-before-you-start.rst getting-started/tensorflow/index.rst getting-started/pytorch/index.rst .. toctree:: :maxdepth: 2 :caption: Reference Samples :hidden: Cerebras Model Zoo .. toctree:: :maxdepth: 2 :caption: General :hidden: general/dataloader/index.rst general/cs-1-data-formats.rst general/dynamic-loss-scaling.rst general/performance-optimization.rst general/multi-replica-data-parallel-training.rst .. toctree:: :maxdepth: 2 :caption: Scripts and Templates :hidden: scripts-and-templates/run-py-template.rst scripts-and-templates/csrun-cpu.rst scripts-and-templates/csrun-wse.rst scripts-and-templates/cs-input-analyzer.rst .. toctree:: :maxdepth: 2 :caption: Develop with TensorFlow :hidden: tensorflow-docs/cs-tf-workflow.rst tensorflow-docs/porting-tf-to-cs/index.rst tensorflow-docs/preparing-tf-input/index.rst tensorflow-docs/tf-dynamic-loss-scaling.rst tensorflow-docs/compile-on-cpu/validate-and-compile-on-cpu.rst tensorflow-docs/running-a-model/train-eval-predict.rst tensorflow-docs/early-stopping.rst tensorflow-docs/multiple-models/index.rst tensorflow-docs/tf-vsl.rst tensorflow-docs/tuning-tf-for-cs/using-tensorboard.rst tensorflow-docs/tuning-tf-for-cs/best-practices-tf.rst tensorflow-docs/tf-layers/index.rst .. toctree:: :maxdepth: 2 :caption: Develop with PyTorch :hidden: pytorch-docs/pytorch-cs-workflow.rst pytorch-docs/adapting-pytorch-to-cs.rst pytorch-docs/pytorch-custom-runner.rst pytorch-docs/pytorch-vts.rst pytorch-docs/cbtorch-limitations.rst pytorch-docs/pytorch-ops/index.rst .. toctree:: :maxdepth: 2 :caption: Compiler Reports :hidden: compiler-reports/input-function-report.rst compiler-reports/compile-report.rst compiler-reports/incremental-compile.rst .. toctree:: :caption: Extensions :maxdepth: 2 :hidden: software-guides/adding-custom-pkgs-to-cbcore-container.rst