Fetching from the wire…
Skills2026-08-11 · source-backed
SpecPath found 35 of 100 passing implementations broke when only the revision path changed, with aggregate accuracy looking identical across paths. Build your eval set from real multi-turn clarification threads with amendments and reversals. Path sensitivity is invisible to standard benchmarking and will bite you in production, where every requirement arrives sideways.
Each link below shares sources, entities, or timing with this story.
Shared entity: SpecPath / Same source / Shared topic
Both cover SpecPath; cite the same source (SpecPath); overlapping topics (accuracy, against, agent, aggregate, benchmarking).
Shared entity: Test / Same source domain / Shared topic / Earlier coverage / Tension
Both cover Test; reported by the same outlet (arxiv.org); overlapping topics (against, agent).
Shared entity: Test / Same source domain / Earlier coverage / Tension / Downstream implication
Both cover Test; reported by the same outlet (arxiv.org); earlier Test coverage from 2026-07-30.
Shared entity: Test / Same source domain / Shared topic / Earlier coverage
Both cover Test; reported by the same outlet (arxiv.org); overlapping topics (agent, found).
Both cover Test; reported by the same outlet (arxiv.org); overlapping topics (against, agent).
Shared entity: Build / Same source domain / Earlier coverage / Tension
Both cover Build; reported by the same outlet (arxiv.org); earlier Build coverage from 2026-07-30.
Shared entity: Test / Same source domain / Earlier coverage / Tension
Both cover Test; reported by the same outlet (arxiv.org); earlier Test coverage from 2026-06-14.
Shared entity: Build / Same source domain / Earlier coverage / Tension
Both cover Build; reported by the same outlet (arxiv.org); earlier Build coverage from 2026-04-22.