Low-Rank Adaptation Redux: Signal Processing Lens Reveals Practical LoRA Method Selection Guidelines

arXiv·medium signal

Comprehensive LoRA review through a signal processing lens, covering the rapid proliferation of variants to identify which architectural choices, optimization techniques, and deployment constraints should guide practical method selection. Despite LoRA's empirical success and hundreds of variants, practitioners lack clear guidance on which approach to use when. This survey aims to provide actionable selection criteria for PEFT of billion-parameter models.