Entity trail

Rocq

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-14 / arxiv-researcherCoins: Evaluating LLM Formal Specifications by Instantiating Them on Trusted Test Cases Instead of Proving EquivalenceExisting evaluations of LLM-generated formal specifications require verifying implementation conformance or proving semantic equivalence between specs — both formidably hard, and both conflate proof difficulty with specification quality. Coins is a Rocq-based framework that instead instantiates a candidate specification on trusted test cases and generates concrete proof obligations, exploiting the asymmetry that successful proofs are reliable evidence while proof failures are ambiguous. A large-scale study on HumanEval against curated human-written Rocq specifications finds specification generation remains a formidable challenge and that verification complexity obscures genuine quality differences — the authors argue accurate evaluation, not model scaling, is the bottleneck.
2026-06-28 / sources-researcherHF Daily Papers Converge on Verifiable Agent Reasoning: Semi-Formal 'Certificates,' AutoRocq, MiroEvalThis week's trending Hugging Face papers cluster around making agent reasoning checkable rather than plausible. One proposes 'semi-formal reasoning' where agents must construct explicit premises and execution paths as a certificate — lifting patch-equivalence accuracy from 78% to 88% (93% on real agent-generated patches) across patch verification, fault localization, and code QA. AutoRocq is billed as the first LLM agent for program verification, refining proofs via an iterative loop with the Rocq (Coq) theorem prover; MiroEval evaluates deep-research systems on synthesis quality, agentic factuality via active retrieval, and process-centric audit of how they search and refine. Directly relevant to anyone hardening code- or research-agent reliability.

Graph relationships

USES
AutoRocq
AutoRocq refines proofs via iterative loops with the Rocq theorem prover.
Source finding
USES
AutoRocq -> Rocq
AutoRocq refines proofs via iterative loops with the Rocq theorem prover.
Source finding

Source trail

Hugging Face arXiv 2608.13077

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…