cerebras.modelzoo.common.optim_utils.partition_params_group_with_tags#
- cerebras.modelzoo.common.optim_utils.partition_params_group_with_tags(param_group, optimizer_params)[source]#
Splits a single param group into multiple param groups based on glob patterns found in optimizer_params. Patterns are expected to be located under the key
params
which contains a list of patterns and tags following this format:params: - params: "glob-pattern-1" tag: "tag1" - params: "glob-pattern-2" tag: "tag2"
- Parameters
param_group (dict) – a single param group containing a list of name-param pairs under the
params
key.optimizer_params (dict) – optimizer parameters.