cerebras.modelzoo.common#

checkpoint_utils

Various utility functions related to checkpoint saving and loading.

dump_context

Provides DumpContext, a debug utility for dumping activations and gradients on a CPU/GPU run, and setting up debug names for dumped WSE activations to be automatically correlated.

half_dtype

Module which provides utilities for selecting 16-bit floating point representation.

input_utils

mlops

model_utils

optim_utils

Helper functions related to configuration of the Optimizer.

pytorch_utils

General purpose Pytorch Utilities.

registry

This is registry for the cerebras modelzoo

registry_cli

run_bigcode_eval_harness

Single flow BigCode Eval Harness run script.

run_cstorch_flow

Generic run scripts build using the cstorch API.

run_eleuther_eval_harness

Eval Harness run script.

run_gpt_inference

GPT Inference script built using the cstorch API

run_utils

Utilities for running Cerebras Pytorch Models.

train_and_eval

Generic run scripts build using the cstorch API.

utils