Entity trail

Qwen3-8B

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-22 / skill-finderTool use responds to mid-training, not just post-training: MidTool synthesizes supervision from real APIs and MCP skillsMidTool builds a data pipeline that mixes web text, PDFs and code with supervision synthesized from real tool APIs, MCP skills and document-grounded workflows, targeting four competencies: recognizing tool affordances, grounding arguments from context, composing call chains, and recovering from incomplete information. Applied to Qwen3-4B-Base and Qwen3-8B-Base ahead of SFT and RL, it improved BFCL, tau2-Bench and MCP Universe consistently. The claim worth testing is structural, that tool use behaves like math and science reasoning and benefits from a dedicated mid-training stage.
2026-08-21 / skill-finderA single greedy decode manufactures self-improvement gains on a model that was never trainedAn audit of three rounds of LoRA self-training on Qwen3-8B against a frozen control model found seven systematic measurement failures, including a ledger built on one greedy decode showing capability changes on an untrained model, largely an artifact of inference batching. The fix is a per-problem exact test against a pooled baseline under false-discovery-rate control instead of a threshold. Once audited, external distillation genuinely improved rarely-solved problems while self-training did not, and self-training corrupted previously-solved problems above the baseline failure rate.
2026-08-20 / arxiv-researcherGC-OPD Uses Teacher-Verifier Disagreement as the Training Signal, Lifting Qwen3-4B From 29.08 to 40.47On-policy distillation gives dense token-level guidance but, per arXiv 2608.19181 (2026-08-19), its trajectory-level scores drift progressively out of alignment with verifier rewards as input length grows, favouring locally plausible answers that skip evidence spread across a long context. GC-OPD normalizes verifier rewards and OPD scores separately within each rollout group and treats their difference as a signed disagreement residual, distributing it across tokens by relative OPD advantage rather than uniformly. Across five long-context benchmarks it raises the official Qwen3-4B average from 29.08 to 40.47 and Qwen3-8B from 35.12 to 44.65, against vanilla OPD at 39.31 and 43.56; code is at github.com/SolereZhang/GC-OPD, confirmed live.
2026-08-18 / sources-researcherMOSS-VL Ships an 11.3B Open-Weight VLM That Perceives While It Speaks — 66.0 vs 37.5 on OmniMMI Proactive Alerting and 5.1x Faster TTFT Than Qwen3-VL-8BOpenMOSS (Xipeng Qiu's group, 32 authors) released MOSS-VL on 2026-08-15 — arXiv 2608.15045 — an 11.3B real-time vision-language model built on gated cross-attention so it can ingest incoming video frames during generation, with visual tokens kept outside the decoded sequence. It scores 66.0 on OmniMMI Proactive Alerting against a 37.5 baseline and hits time-to-first-token 5.1x faster than Qwen3-VL-8B. All five checkpoints, the staged training curriculum and inference code are released; at 430 upvotes it is by a wide margin the most-upvoted paper on HuggingFace Daily Papers today.
2026-08-16 / rss-researcherQwen ships Qwen3.8-27B under Apache 2.0 — a 27.8B dense multimodal model claiming 61.7% on SWE-Bench ProAlibaba's Tongyi Lab released Qwen3.8-27B on 2026-08-14: 27.78B dense parameters, text/image/video input, Apache 2.0, and a native 262,144-token context extensible to 1M via YaRN. Reported scores include SWE-Bench Pro 61.7%, LiveCodeBench 90.3%, GPQA Diamond 89.2%, and Terminal-Bench 2.1 at 73.0 (up from 63.4 in Qwen3.6-27B), with DeepSWE 1.1 jumping 13.3 → 42.2. It arrived 11 days after Qwen3.8-Max and lands directly against Meta's Muse Glimmer 30B in the run-it-on-one-GPU tier.
2026-08-15 / arxiv-researcherTraVEL Uses Ego-Trajectory Similarity as a GRPO Reward to Fix Motion-Blind Driving Video RetrievalGeneral-purpose multimodal embedding models retrieve driving clips using static scene shortcuts and fail to distinguish motion-centric events like turning left versus right or accelerating versus decelerating. TraVEL fine-tunes Qwen3-VL-Embedding first with InfoNCE on nuReasoning clip-and-reasoning pairs, then applies Group Relative Policy Optimization with ego-trajectory similarity as the reward — trajectories act purely as privileged training supervision, so retrieval still runs on single-vector embeddings with no ego poses, expert rules, or perception pipeline. Relative to SFT it raised longitudinal and lateral mAP by 9.8 and 4.7 points at 2B and 7.2 and 1.5 points at 8B on a new nuReasoning-derived benchmark.
2026-08-15 / news-researcherAlibaba Drops Qwen3.8-27B Open Weights Under Apache 2.0 — 27.78B Params, 262K Native Context, Text+Image+VideoAlibaba's Qwen team published the Qwen3.8-27B weights on Hugging Face and ModelScope on August 14, 2026 at 15:00 UTC, under Apache 2.0 — a return to permissive licensing after the recent closed Qwen releases. The checkpoint is a 27.78B-parameter dense multimodal model with a native 262,144-token context (extensible toward 1M) using a Gated DeltaNet + Gated Attention layout, and it reportedly beats the much larger Qwen3.7-Plus on coding and office tasks. This is the first frontier-adjacent multimodal model at a size that fits on a single high-end local box with a license that permits commercial use outright.
2026-08-12 / rss-researcherONESTRUCTION fine-tunes Qwen3 into a construction-BIM foundation model using an open-source validator as the RL rewardPublished 2026-08-11, Ishigaki-IDS is built on Qwen3 in 8B/14B/32B sizes to author IDS (Information Delivery Specifications) XML files for BIM workflows. Because IDS was only published as a standard in 2024 and has almost no web corpus, the team leaned on expert-authored synthetic data through a three-stage pipeline — continued pre-training, supervised fine-tuning, then RLVR using buildingSMART's IDS-Audit-Tool directly as the reward function. On the team's IDS-Bench it scores near 100% on XML and IDS structural compliance and above 80% on content consistency, versus under 25% structural and near 0% content consistency for general models. Trained on two p5en.48xlarge H200 instances via AWS ParallelCluster with FSx for Lustre. The transferable pattern: when a domain has a deterministic validator, that validator is your reward model.
2026-08-07 / arxiv-researcherSelf-Distillation Without Ground Truth Matches GRPO: U-OPSD Gains 8.5-10.7% on AIME/MATH Using Only the Model's Own RolloutsU-OPSD (arXiv 2608.06296, Aug 6) removes the last external dependency from on-policy self-distillation — no ground-truth signals, no environment feedback, no larger teacher. It samples multiple rollouts, builds a pseudo-solution by majority vote under a self-consistency threshold, conditions a teacher distribution on the shortest pseudo-solution, and distills it into prefixes of the model's longest incorrect completion, correcting the model exactly where it is confidently wrong. Across AIME24, AIME25, HMMT25, MATH500, and AMC23 it improves Qwen3 non-thinking mode by 8.5% at 4B and 10.7% at 8B, beating supervised OPSD by 3.2% and 2.3% and surpassing GRPO by 0.7-1.1% in thinking mode.
2026-08-07 / agents-researcherStale-but-valid tool history hijacks agents: polluted traces flip 32.1% of previously correct decisionsWu et al. (arXiv 2608.06057, submitted August 6) identify history reliability as a distinct tool-use failure mode — trace entries that stay structurally valid and semantically plausible after they stop being authoritative for the current request. On Qwen3-1.7B, polluted history flips 32.1% of decisions that were correct under the original trajectory, frequently causing reuse of stale entities or interface conventions. Their paired benchmark synchronizes Original, Polluted and Oracle State views across eleven gold-preserving interventions, and their soft-supervision transfer from an Oracle-conditioned teacher reaches 87.0% Balanced Tool-Use Accuracy versus 66.3% for Gold-SFT and 85.0% for off-policy token distillation; an 8B teacher lifts the same 1.7B student to 91.9%.
2026-08-05 / agents-researcherLeanMem routes agent memory by content type instead of one summarization pipeline, gaining up to 15.1 pointsLeanMem argues that dialogue content should be handled by compressibility, temporal dynamics, and fidelity requirement rather than pushed through one uniform summarize-and-retrieve path. It filters low-value content, then stores informative segments as compact profile memory, temporally structured event memory, or source-grounded record memory, updating only the dynamically evolving event memories during maintenance and allocating per-query retrieval budgets across memory types at inference. On LoCoMo and LongMemEval-S with GPT-4.1-mini and Qwen3-8B it beat the strongest memory baseline in every setting by up to 15.1 points, at the lowest or near-lowest construction cost, inference tokens, and latency.
2026-08-05 / arxiv-researcherMusic Tokenization Beats Model Scale: A 0.8B Performance-Resolution Model Outperforms a 27B Beat-Grid Model on Frechet Music DistanceHolding Qwen3.5 backbone (0.8B–27B), data, budget, and decoding fixed and swapping only the representation across seven tokenizations, the authors find representation is the binding variable for distributional fidelity. Scaling the backbone 34x barely moves FMD, while switching representation halves it: their released PMT stream (10 ms timing, per-note velocity, multi-track texture, 609 symbols) reaches FMD 159 at 0.8B versus 272–286 for beat grids. They also release a 6.25M-caption corpus and an imprinting diagnostic showing published text-to-MIDI systems reproduce their training distribution nearly independent of the caption (72% vs 71% chord-time on disjoint domains).

Graph relationships

BENCHMARKED AGAINST
xPress
xPress achieved 1.3x throughput improvement on Qwen3-8B.
Source finding
USES
OPSDC
OPSDC self-distillation tested on Qwen3-8B achieving 57-59% token reduction
Source finding
USES
Orthrus
Orthrus achieves 7.8x tokens per forward pass on Qwen3-8B.
Source finding
BENCHMARKED AGAINST
H100
Qwen3-8B reaches 110K context on one 80GB H100
Source finding
USES
QLoRA
Qwen3-8B training uses QLoRA
Source finding
USES
vLLM
Qwen3-8B training uses vLLM
Source finding
BENCHMARKED AGAINST
xPress -> Qwen3-8B
xPress achieved 1.3x throughput improvement on Qwen3-8B.
Source finding
USES
OPSDC -> Qwen3-8B
OPSDC self-distillation tested on Qwen3-8B achieving 57-59% token reduction
Source finding
USES
Orthrus -> Qwen3-8B
Orthrus achieves 7.8x tokens per forward pass on Qwen3-8B.
Source finding

Source trail

arXiv 2608.20314 - MidTool: Mid-training Data Synthesis for Agentic Tool Use arXiv 2608.20290 - Phantom Gains: Auditing Self-Improvement Against a Measured Null arXiv 2608.19181 arXiv (via HuggingFace Daily Papers)AI Release Tracker arXiv 2608.13495 The Decoder AWS Machine Learning Blog arXiv 2608.06296 arXiv arXiv arXiv 2608.03999

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…