Influcoder: distilling decoder gradient-influence rankings into an encoder for data attribution

arXiv·medium signal

Influcoder distills the gradient-influence rankings of decoder LLMs into a lightweight encoder, making data attribution cheap enough to filter and curate high-quality training datasets at scale. Practical for teams doing data-centric model improvement who can't afford full gradient-influence computation per sample.