cerebras.modelzoo.common.utils.model.lora.LoRALayer

class cerebras.modelzoo.common.utils.model.lora.LoRALayer(r, lora_alpha, lora_dropout, merge_weights)

Bases: object

Base LoRA layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.

Methods

previous

cerebras.modelzoo.common.utils.model.lora.make_model_lora_helper

next

cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding