#peft

• 25 Feb 2026 · Study

  LLMs · Fine-tuning with LoRA

  LoRA freezes the pretrained weights and learns a low-rank update BA; a LoRA layer written from scratch, then PEFT applied to GPT-2 to count how few parameters are trained.

• 23 Jun 2025 · Paper summary

  Paper summary: Drag-and-Drop LLMs: Zero-Shot Prompt-to-Weights

  Drag-and-Drop LLMs train a generator that maps a few unlabelled task prompts straight to LoRA weights, specialising an LLM for a new task in seconds without any gradient-based fine-tuning on it.