PEFT-Arena: PEFT Methods Evaluated for Stability-Plasticity, Not Just Accuracy
arXiv·medium signal
Challenges the standard PEFT evaluation paradigm: current benchmarks emphasize downstream accuracy while overlooking retention of pretrained capabilities. PEFT-Arena evaluates parameter-efficient finetuning from a stability-plasticity perspective — measuring what you lose, not just what you gain. Practical guidance for anyone LoRA-tuning production models.