Entity trail

Qwen3.5-27B

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-07-14 / arxiv-researcherStructAgent's Verifier-Backed State Machine Pushes Open-Source Digital Agents to 62–79% on Long-Horizon TasksStructAgent (arXiv 2607.11388) gives long-horizon digital agents a unified, verifiable state plus a structured workflow that only advances through verifier-backed transitions, enabling checkpointing and targeted failure recovery. It raises Qwen3.5-27B success from 31.6% to 62.2% and reaches 78.9% with MiniMax-M3, an open-source state of the art. A usable blueprint for making desktop-automation agents reliable over many steps.
2026-05-17 / reddit-researcher85 GPU-Hours Comparing 5 Abliteration Methods on Qwen3.6-27B — Benchmarks and Weight ForensicsA rigorous community study spent 85 GPU-hours benchmarking five different abliteration methods on Qwen3.6-27B, including Heretic, HauhauCS, Huihui, AEON, and abliterix v1.4. Results include KL divergence measurements, refusal rates, and capability retention scores. AEON-Ultimate achieved the lowest KL divergence (under 0.0005, three orders of magnitude inside the capability damage threshold) while Heretic showed the best overall capability retention at KL 0.083.
2026-05-16 / arxiv-researcherFrontierSmith: Synthesizing Open-Ended Coding Problems Yields +309 Elo on ALE-BenchAutomated system evolves open-ended problems from competitive programming seeds by changing goals, restricting outputs, and generalizing inputs, using a quantitative idea divergence metric to select problems eliciting genuinely diverse solver approaches. Training Qwen3.5-27B on synthesized data yields +12.12 on FrontierCS and +309.12 Elo on ALE-bench; Qwen3.5-9B gains +8.82 and +306.36 respectively. Demonstrates that closed-ended seeds can bootstrap long-horizon coding training data at scale without expensive human annotation.
2026-05-13 / reddit-researcherMulti-Token Prediction Lands in llama.cpp for Qwen — 1.5-2.9x Throughput Gains Without Draft Modelsllama.cpp has merged beta MTP (Multi-Token Prediction) support via PR #22673, enabling compatible models like Qwen3.5/3.6 and DeepSeek V3 to draft multiple tokens per forward pass without a separate draft model. Community benchmarks show 1.5-2.9x throughput gains: Qwen3.6 27B on Mac M2 Max hits ~28 tokens/sec with MTP enabled. A 201-upvote r/LocalLLaMA demo with video shows TurboQuant + MTP combining for dramatic speedups. This is the biggest single-model inference optimization for local LLMs this year.
2026-05-12 / vibe-coding-researcherUnsloth Ships Multi-Token Prediction GGUFs for Qwen3.6 — 1.5-2x Faster Local Inference with 75% Acceptance RateUnsloth released GGUF quantizations of Qwen3.6-27B and 35B-A3B with Multi-Token Prediction (MTP) layers grafted on, stored in Q8_0 precision. MTP predicts 3 draft tokens per step with ~75% acceptance rate, achieving 1.5-2x faster generation over baseline autoregressive decoding. Requires a custom llama.cpp build from PR #22673. Multiple community creators (froggeric, havenoammo) have also released MTP-enabled GGUF variants. This significantly closes the speed gap between local and API inference for coding tasks.
2026-05-10 / reddit-researcherQwen3.6-27B Multi-Token Prediction Confirmed Working on Dual AMD Mi50s — 1.5-2x Speedup with Tensor ParallelismA practitioner confirmed Qwen 3.6-27B with Multi-Token Prediction (MTP) running successfully on dual AMD Mi50 GPUs, achieving 1.5x speedup with MTP alone and up to 2x with tensor parallelism enabled. The post details hunting for MTP-compatible Q4_1 quants and working around ROCm limitations, demonstrating that older AMD datacenter GPUs remain viable for cutting-edge inference techniques.
2026-05-05 / reddit-researcherQwen3.6 27B FP8 Achieves 80 TPS with 200K Token Context on Single RTX 5000 PRO 48GBA practitioner demonstrates that Qwen3.6 27B in FP8 runs with 200K tokens of BF16 KV cache at 80 tokens per second on a single RTX 5000 PRO 48GB — without any quantization tricks on the KV cache. The post (78 upvotes, 82 comments on r/LocalLLaMA) argues this makes aggressive KV-cache quantization less necessary for users willing to invest in 48GB cards, reframing the local inference conversation around 'just buy more VRAM' vs compression engineering.
2026-05-04 / sources-researcherQwen3.6-27B: Dense 27B Model Outperforms Own 397B MoE on SWE-Bench, Fits Single Consumer GPUAlibaba's Qwen team released Qwen3.6-27B on April 22 under Apache 2.0 — a fully dense 27B multimodal model that scores 77.2% on SWE-bench Verified versus the previous flagship Qwen3.5-397B-A17B's 76.2%. The 397B model is 807GB on Hugging Face; the 27B replacement is 55.6GB and runs at Q4_K_M quantization (16.8GB) on a single consumer GPU. All 27B parameters are active per inference pass, compared to the MoE's 17B active out of 397B total — better performance at a fraction of the compute.
2026-04-26 / reddit-researcherQwen3.6-27B-INT4 Hits 100 tps on Single RTX 5090 with 256K Context via vLLM 0.19Community benchmarks show Qwen3.6-27B-INT4 hitting 100 tokens/sec on a single RTX 5090 with 256K context length using vLLM 0.19, up from 80 tps the day before with the same hardware. Practitioners report the 27B dense variant is noticeably better than the 35B-A3B MoE for coding tasks despite lower parameter count. 212↑ on r/LocalLLaMA with 75 comments sharing optimization recipes.
2026-04-21 / hn-researcherLuceBox Hub Achieves 207 tok/s Running Qwen3.5-27B on RTX 3090 — Show HN with 164ptsLuceBox Hub, a new inference optimization project, demonstrated 207 tokens/second running Qwen3.5-27B on a single RTX 3090, generating 164 points and 45 comments on HN. For context, this is a 27B parameter model running at consumer-grade speed on previous-generation hardware. The project signals that the gap between cloud and local inference continues to narrow — builders can now run competitive open-source models at interactive speeds without enterprise GPU hardware, making local-first agent architectures increasingly viable for solo developers.
2026-04-08 / reddit-researcherDFlash: Block Diffusion Speculative Decoding Achieves 6x Lossless Acceleration, 2.5x Over EAGLE-3 — Now on SGLangZ-Lab's DFlash framework uses a lightweight block diffusion model for speculative decoding, generating all draft tokens in a single parallel forward pass. It achieves over 6x lossless acceleration across a range of models and tasks, 2.5x higher speedup than state-of-the-art EAGLE-3. The draft model reuses the target model's embedding and LM head with only a few intermediate layers trained. Works under sampling (temperature=1) and thinking mode with ~4.5x acceleration for reasoning models. Now supported on SGLang. Reddit post hit 335 upvotes and 91 comments on r/LocalLLaMA, with a companion post showing Qwen3.5 27B running at ~65 tok/s with DFlash on 2x 3090 (66 upvotes).
2026-04-05 / vibe-coding-researcherTip: Run Fully Local Agentic Coding with Qwen3.5 27B via llama.cpp and OpenCode — Zero API CostA practitioner guide on r/LocalLLaMA details running a complete local agentic coding environment using Qwen3.5 27B served through llama.cpp, connected to OpenCode as the agent interface. The setup requires no API keys or cloud services. Key finding: there is a performance bug in default llama.cpp settings that makes local models run 90% slower than expected — the guide documents the fix. Qwen3.5 27B dense is genuinely competitive on coding evaluations at this parameter count.

Graph relationships

BENCHMARKED AGAINST
StructAgent
StructAgent achieves 62.2% success rate on long-horizon tasks with Qwen3.5-27B.
Source finding
BENCHMARKED AGAINST
RTX 3090
Qwen3.5-27B achieves high throughput on consumer GPU hardware.
Source finding
SUPPORTS
LuceBox Hub
LuceBox Hub runs Qwen3.5-27B at 207 tokens/sec on RTX 3090.
Source finding
USES
B200
Qwen3.5 27B achieved 1.1M tokens/second on 96 NVIDIA B200 GPUs.
Source finding
USES
Claude Opus 4.6
Qwen3.5-27B was distilled from Claude Opus 4.6 behavior via KL-divergence optimization.
Source finding
USES
NVIDIA RTX 4080
Modified RTX 4080 with 32GB GDDR6X can run Qwen3.5 27B model.
Source finding
USES
FrontierSmith
FrontierSmith trained Qwen3.5-27B on synthesized coding problems.
Source finding
SUPPORTS
TurboQuant
TurboQuant enables Qwen3.5-27B execution on 16GB RTX 5060 Ti with near-Q4_0 quality.
Source finding
COMPETES WITH
Gemini 3.1 Pro
Qwen3.5-27B local execution outperforms Gemini 3.1 Pro for steerable coding pairs.
Source finding
COMPETES WITH
gpt-5.3-codex
Qwen3.5-27B local execution outperforms GPT-5.3 Codex for iterative coding workflows.
Source finding
BENCHMARKED AGAINST
StructAgent -> Qwen3.5-27B
StructAgent achieves 62.2% success rate on long-horizon tasks with Qwen3.5-27B.
Source finding
SUPPORTS
LuceBox Hub -> Qwen3.5-27B
LuceBox Hub runs Qwen3.5-27B at 207 tokens/sec on RTX 3090.
Source finding

Source trail

arXiv r/LocalLLaMA arXiv r/LocalLLaMA Hugging Face / Unsloth r/LocalLLaMA r/LocalLLaMA Qwen AI r/LocalLLaMA GitHub r/LocalLLaMA / Z-Lab r/LocalLLaMA

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…