cerebras.modelzoo.common.input_utils.validate_streaming_and_micro_batch_size#

cerebras.modelzoo.common.input_utils.validate_streaming_and_micro_batch_size(batch_size: int, micro_batch_size: Union[None, int, Literal['explore', 'auto'], Dict[str, Dict[str, int]]], num_csx: int) → None[source]#

Validates the streaming and micro batch sizes.

Parameters

  • batch_size – The global batch size of the model.

  • micro_batch_size – The micro batch size of the model.

  • num_csx – The number of CSX in the cluster.

previous

cerebras.modelzoo.common.input_utils.get_streaming_batch_size

next

cerebras.modelzoo.common.input_utils.PaddingSample