modelzoo.transformers.data_processing.h5_map_dataset.samplers#

Classes

BaseSampler

Handle shuffling and skipping

BatchSampler

A slight modification of the PyTorch batch sampler such that any samples not yielded at the end of an epoch when drop_last=True will be yielded at the start of the next epoch.

CBSampler

A sampler to handle sharding, batching, and skipping of map style datasets intended for use on CSX.

Sharder