Tag: PEFT

Prompt-Tuning vs Prefix-Tuning: Lightweight LLM Control Guide

Discover the key differences between prompt-tuning and prefix-tuning for LLMs. Learn when to use each lightweight PEFT method to save compute resources while maintaining high accuracy.

Adapter Layers and LoRA for Efficient Large Language Model Customization

LoRA and adapter layers let you customize large language models with minimal resources. Learn how they work, when to use each, and how to start fine-tuning on a single GPU.