cerebras.modelzoo.common.pytorch_utils.IterableDatasetSampler#

class cerebras.modelzoo.common.pytorch_utils.IterableDatasetSampler(*args, **kwargs)[source]#

Bases: torch.utils.data.IterableDataset

This sampler can be used with a multi-worker distributed dataloader. All workers on all nodes get a copy of the IterableDataset but only yield samples according to the world size and their rank.

Methods

previous

cerebras.modelzoo.common.pytorch_utils.BufferedShuffleDataset

next

cerebras.modelzoo.common.pytorch_utils.RunConfigParamsValidator