#qlora
- 4 Mar 2026 · Study
LLMs · QLoRA
QLoRA keeps the frozen base model in 4-bit NormalFloat (NF4) and trains LoRA adapters on top; building blockwise 4-bit quantisation by hand and comparing NF4 with plain 4-bit on normal-shaped weights.
QLoRA keeps the frozen base model in 4-bit NormalFloat (NF4) and trains LoRA adapters on top; building blockwise 4-bit quantisation by hand and comparing NF4 with plain 4-bit on normal-shaped weights.