cerebras.modelzoo.common.utils.model.lora.get_lora_config_for_module#

cerebras.modelzoo.common.utils.model.lora.get_lora_config_for_module(lora_params: Union[cerebras.modelzoo.common.utils.model.lora.LoraConfig, List[cerebras.modelzoo.common.utils.model.lora.LoraConfig]], module_names: List[str]) → Optional[cerebras.modelzoo.common.utils.model.lora.LoraConfig][source]#

Gets lora parameters for a particular module

Parameters

  • lora_params – LoRA top-level config.

  • module_names – Hierarchical list of module names.

Returns

lora parameters (LoraConfig) for the given module if applicable or None if the module is not targeted.

previous

cerebras.modelzoo.common.utils.model.lora.disable_lora_merge_weights

next

cerebras.modelzoo.common.utils.model.lora.make_model_lora