cerebras.modelzoo.common.utils.model.lora.LoRA_Linear#

class cerebras.modelzoo.common.utils.model.lora.LoRA_Linear(*args, **kwargs)[source]#

Bases: torch.nn.Linear, cerebras.modelzoo.common.utils.model.lora.LoRALayer

LoRA linear layer From https://github.com/microsoft/LoRA/blob/main/loralib/layers.py.

Methods

`forward`
`reset_parameters`
`train`

previous

cerebras.modelzoo.common.utils.model.lora.LoRA_Embedding

next

cerebras.modelzoo.common.utils.model.lora.LoraConfig