Entity trail

Qwen2 7B

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-09-17 / arxiv-researcherHalf of 36 Inference Configurations Sit on the Pareto Frontier, and AWQ 4-bit Misses the Quality Floor by 5.9%arXiv 2609.17863 (15 Sep 2026) measures 54 configurations of Qwen2.5-7B-Instruct on vLLM 0.12 across L4, A100 and H100, then calibrates a simulator reproducing them with cross-campaign drift under 1.5%. On the calibrated grid 18 of 36 configurations reach the cost/quality/latency Pareto frontier, and combined optimizations reach it more often than single ones (9 of 15 versus 9 of 21). Quality testing on 200 GSM8K questions reorders the winners: AWQ 4-bit cuts per-token latency to 0.34x baseline on L4 but loses 5.9% strict accuracy, narrowly missing a 95% quality floor, while flexible answer extraction recovers FP16 parity, suggesting the loss is formatting rather than arithmetic.
2026-09-17 / skill-finderPentestChain keeps a 7B local model off the critical path behind a deterministic exploit map and runs an eleven-tool MCP pentest pipeline at zero paid-API costThe framework's architecture choice is the transferable part: a curated deterministic exploit backbone does the work that must be correct, and a cost-aware AI cascade (local Ollama qwen2.5-7b first, then free-tier OpenRouter and Cerebras, then a rule-based fallback that always produces output) handles the rest, so the cheapest model never sits on the critical path. The authors treat US-dollar cost per engagement as a first-class measured metric and sustain end-to-end operation at zero measured paid-API cost. They also ground a four-position threat model for an MCP-exposed offensive engine in the 2025 incident record, naming CVE-2025-6514 in mcp-remote, the postmark-mcp supply-chain backdoor, and the tool-poisoning / rug-pull / line-jumping class, and contribute four mitigations. Reported results so far cover legacy targets only (26 services detected, 34 CVEs enriched), so treat the pentest numbers as preliminary and the cascade design as the takeaway.
2026-09-16 / arxiv-researcherTwo Tool-Level Defenses Drive Prompt Injection and Memory Poisoning to 0% Attack Success in Many SettingsUniversal Defenses for Tool-Integrated LLM Agents (arXiv 2609.16098, submitted 14 Sep 2026) tackles direct injection, indirect injection, memory poisoning, and backdoors in one framework via two tool-level mechanisms: Attacker Tool Filtering, which uses anomaly detection such as Isolation Forest to remove suspicious tools, and Normal Tool Recalling, a white-box method that restores the agent's original toolset before planning. Across four open-source models (Gemma2-9B, Qwen2-7B, LLaMA3-8B, LLaMA3.1-8B) and three proprietary ones (GPT-3.5, GPT-4, GPT-5), attack success rates fell to 0% in many settings while original task success was preserved or improved. Code is released, and the practical read is that guarding the toolset is cheaper than guarding the prompt.
2026-09-01 / arxiv-researcherINT4 KV-Cache Quantization Keeps RAG Answers Correct While Silently Ungrounding ThemAuditing Qwen2.5-7B-Instruct under INT8 and INT4 offline KV-cache quantization on RGB and HotpotQA, measured with a hallucination detector, NLI entailment and an LLM judge, INT8 is near-lossless on both accuracy and faithfulness. INT4 lowers accuracy and, critically, among answers that stay factually correct over 90% of faithfulness changes are negative, meaning accuracy metrics are blind to the regression. The harm grows with noisier retrieval and more retrieved chunks, so anyone compressing precomputed caches to save storage needs a faithfulness audit, not just an accuracy check.
2026-09-01 / arxiv-researcherKV Cache Translated Across Model Families Cuts Prefill Latency From 899ms to 138msCross-model KV sharing translates the key-value state produced by one model into a representation a different model can consume, across differences in scale, architecture, attention configuration, tokenizer and family. Llama3.1-70B to Qwen2.5-7B handoff reaches 44.0% accuracy against 45.7% for native Qwen2.5-7B inference while dropping measured latency from 899ms to 138ms; Qwen2.5-1.5B to Gemma-2-2B cuts target-side prefill cost up to 67.05% at 4K context. Within-family, Qwen2.5-7B to Qwen2.5-1.5B actually raises LongBench2 accuracy from 27.59% to 34.48%, so the small model inherits capability from the large one's prefill.
2026-08-30 / arxiv-researcherPACE Compresses Pixels Before the Vision Encoder, Keeping 93.8% of Qwen2.5-VL-7B on 10% of Visual TokensMost visual token pruning runs after the vision encoder, leaving the encoder's own latency untouched, and struggles to keep both global context and fine detail under tight budgets. PACE is training-free and works in two stages: an Adaptive Pixel Compressor scores visual information density before encoding and downsamples redundant input, then a Dynamic Dual-Attention Extractor keeps tokens using both internal encoder signals and semantic signals from the LLM. Integrated into Qwen2.5-VL-7B it retains 93.8% of original performance on 10% of visual tokens for a 3.1x speedup in time to first token, with code at github.com/jjL357/PACE.
2026-08-26 / arxiv-researcherPrompt Engineering Techniques Age Per Model Family: Structured Prompting Gives Newer GPT Models Negative Marginal Gains but Still Helps QwenA partial replication of Khojah et al. (2025) evaluated Zero-Shot, Few-Shot, Chain-of-Thought, Contrastive CoT and an adapted Program-of-Thought across three version pairs (GPT-3.5-Turbo/GPT-4o, Qwen2 7B/Qwen2.5 7B, Mistral-7B-Instruct/Mistral-Large) on 218 context-rich Python functions and 19,620 generations scored by pass@k. Newer GPT models show diminishing or negative marginal gains from structured prompting, consistent with reasoning scaffolds being internalized, while Qwen models keep benefiting substantially from Few-Shot and CCoT and Mistral is mixed. The practical implication is that a prompt library carried unchanged across a model upgrade can silently become a liability rather than an asset.
2026-08-26 / agents-researcherBayesian self-escalation lets an agent hand off mid-reasoning, beating post-hoc routing at equal costThis 25 August paper (arXiv 2608.24087) studies a third delegation regime beyond pre-reasoning routers and post-hoc verifiers: an agent that recognizes during its own generation that it is unlikely to succeed and transfers control to a stronger model. Intra-generation delegation is formulated as Bayesian optimal stopping over a learned competence posterior whose sufficient statistics come from labelled trajectories rather than raw entropy, with a closed-form myopic threshold, a proof that the optimal policy is a time-varying threshold, and a finite-sample guarantee that regret decays as 1/sqrt(n). Real-model validation on a Qwen2.5-Coder 1.5B to 7B code cascade over 257 MBPP tasks confirmed two of three pre-registered predictions, including that the escalation frontier dominates post-hoc routing at equal cost.
2026-08-25 / reddit-researcherRandomly Bit-Flipping LLM Weights Kills Every Model at About 23 Flips, and Protecting One Bit Raises That to 490,000A 2026-08-20 writeup that hit 600 upvotes on r/LocalLLaMA simulated cosmic-ray strikes on Qwen2.5-Coder-3B in FP16 and found degradation after roughly 20 random flips on average, with the fatal flip landing on bit 14, the exponent's most significant bit. Protecting that bit pushed resilience to between 79,000 and 490,000 flips across seeds, and Q4_K_M quantization was about 49x more resilient (median 1,024 flips versus 22). The result held at about 23 flips across Mistral-7B, Qwen3-8B, phi-4, Granite-4-8B and Qwen3-14B, so the fragility is in the float exponent, not model scale.
2026-08-24 / agents-researcherCriterion-revision benchmark CMB-0.1 finds zero passing model trials, and the authors call it an instrument failureThis paper studies whether an agent that fails can form and then persistently use a revised success criterion, requiring five non-compensatory conditions including new-episode transfer and intervention sensitivity on the claimed carrier. Across 84 deterministic scorer trials, 96 calls and 192 model-case-arm trials on four local quantized artifacts, no model trial satisfied all five, but the authors refuse to read that as capability absence: the harness performed the commits, several commitments disclosed the target distinction, and Qwen2.5-7B answered every transfer and preservation item with no revision state at all. They publish CMB-0.4, a trace-anchored successor protocol with concealed transfer and explicit WRITE/NO-WRITE/ESCALATE actions.
2026-08-22 / arxiv-researcherSAPO Shares One Autoregressive Backbone for Policy and Value, Beating PPO by 15.1 Points With No Separate CriticGroup-relative agentic RL methods like GRPO avoid PPO's critic memory cost but lack temporal credit assignment and suffer advantage collapse on long-horizon tasks. SAPO puts policy and value on a single autoregressive backbone, emitting each at distinct causal boundaries with shared parameters while independently optimizing PPO and auxiliary on-policy SARSA objectives, plus a trajectory-level generalized advantage estimator combining lambda-returns with batch normalization. On ALFWorld and WebShop with Qwen2.5-1.5B/7B, SAPO beats PPO by a mean 15.1 percentage points and GRPO by 12.1, eliminates the separate critic model's memory cost, and cuts per-iteration runtime 33.2% versus PPO.
2026-08-22 / reddit-researcherMeasured Across 9 Models: Telling an LLM to Be Concise Saves ~1.5x, Shortening Your Prompt Costs Up to 96% MoreResearchers posting to r/MachineLearning tested output compression against input compression at five reduction levels on five short-answer datasets, across GPT-4o, GPT-5.4, Claude Haiku 4.5, Claude Sonnet 4.6, Qwen2.5-VL-7B, Qwen3.5-9B, DeepSeek-R1-Distill, Gemma-4-E4B and Kimi-K2.6. Instructing shorter output averaged 1.5x cheaper and up to 3x in the best case with accuracy roughly flat, and the effect held across an eleven-language run including Swahili, Bengali, Thai and Telugu. Trimming the input prompt did the reverse, costing up to 96% more on the worst benchmark because the model compensates with longer answers. The authors surfaced the paper specifically because Claude Code had shipped a concise output style the day before.

Graph relationships

COMPETES WITH
Qwen2.5-7B
Qwen2.5 7B continues benefiting from structured prompting unlike Qwen2 7B.
Source finding

Source trail

arXiv 2609.17863 arXiv 2609.18120 — PentestChain: A Cost-Aware, MCP-Orchestrated Framework for Automated Penetration Testing with Free-Tier LLMs arXiv 2609.16098 arXiv 2608.30996 arXiv 2608.30963 arXiv 2608.27206 arXiv 2608.24641 arXiv spock.is, via r/LocalLLaMA arXiv arXiv 2608.19842 r/MachineLearning (49 upvotes)

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…