cerebras.modelzoo.common.optim_utils.partition_params_group_with_tags#

cerebras.modelzoo.common.optim_utils.partition_params_group_with_tags(param_group, optimizer_params)[source]#

Splits a single param group into multiple param groups based on glob patterns found in optimizer_params. Patterns are expected to be located under the key params which contains a list of patterns and tags following this format:

params:
    - params: "glob-pattern-1"
      tag: "tag1"
    - params: "glob-pattern-2"
      tag: "tag2"
Parameters

  • param_group (dict) – a single param group containing a list of name-param pairs under the params key.

  • optimizer_params (dict) – optimizer parameters.

previous

cerebras.modelzoo.common.optim_utils.flatten_optimizer_params

next

cerebras.modelzoo.common.pytorch_utils