Fetching from the wire…
Research2026-08-02 · source-backed
IFHierBench targets one call producing a layered artifact where the whole output, each section, and nested fields all carry constraints: something flat benchmarks can't score. 600 prompts across four constraint-tree depths and 35 constraints, each with a deterministic checker verifying every scope. Accuracy degrades sharply as depth increases. Flatten your constraint tree or split deep requirements across calls.
Each link below shares sources, entities, or timing with this story.
Shared entity: Accuracy / Same source domain / Shared topic / Earlier coverage / Tension
Both cover Accuracy; reported by the same outlet (arxiv.org); overlapping topics (accuracy, clear).
Shared entity: Accuracy / Same source domain / Shared topic / Earlier coverage
Both cover Accuracy; reported by the same outlet (arxiv.org); overlapping topics (accuracy, each).
Both cover Accuracy; reported by the same outlet (arxiv.org); overlapping topics (accuracy, each).
Both cover Accuracy; reported by the same outlet (arxiv.org); overlapping topics (accuracy, each).
Shared entity: Accuracy / Shared topic / Earlier coverage / Tension
Both cover Accuracy; overlapping topics (accuracy, benchmark); earlier Accuracy coverage from 2026-05-10.
Same source domain / Shared topic / Tension / Downstream implication
Reported by the same outlet (arxiv.org); overlapping topics (best, break); pushes against this story (against).
Shared entity: Accuracy / Same source domain / Earlier coverage
Both cover Accuracy; reported by the same outlet (arxiv.org); earlier Accuracy coverage from 2026-07-24.
Shared entity: Accuracy / Shared topic / Earlier coverage
Both cover Accuracy; overlapping topics (accuracy, benchmark); earlier Accuracy coverage from 2026-05-19.