modelzoo.common.pytorch.model_utils.checkpoint_converters.streaming_checkpoints#
Functions
Converts a size expressed as a string with digits and unit (like "5MB") to an integer (in bytes). |
|
Returns the size (in bytes) occupied by one parameter of type dtype. |
Classes
Marks checkpoint keys that can be directly loaded from/saved to the H5 checkpoint. |
|
Writes a Cerebras H5 checkpoint in a streaming (incremental) manner rather than accumulating the full checkpoint into memory and then writing all weights at the end. |
|
StreamingCSWriterView allows for checkpoints with arbitrarily nested dictionaries/lists to be written in a streaming (incremental) manner by offering a "view" into a StreamingCSWriter. |
|
Allows sharded HuggingFace checkpoints to be read in a streaming manner rather than loading all shards into memory all at once. |
|
Writes a HuggingFace sharded checkpoint in a streaming manner rather than accumulating the full checkpoint into memory and then writing all shards at the end. |