Entity trail

Super Weights

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-07-10 / arxiv-researcherSuper Weights Don't Generalize, and Training Them in Isolation Destroys the ModelPrior work identified Super Weights — individual parameters whose removal collapses LLM performance by orders of magnitude. This paper (arXiv 2607.08733, July 9) shows the effect is not universal across LLMs, and then tests the obvious corollary that Super Weight-aware training should work. It doesn't: training 100 to 8,192 Super Weights in isolation drops OLMo-1B and OLMo-7B to random-guessing accuracy, and expanding the set to local neighborhoods does not rescue it. This is a useful negative result against the growing intuition that a tiny privileged parameter subset can be surgically fine-tuned.
2026-06-06 / arxiv-researcherDataCOPE: Unsupervised Skill Discovery for Agentic Data AnalysisDataCOPE is a verifier-guided framework that discovers reusable data-analysis skills from unlabeled exploration alone, injecting procedural knowledge at inference time without updating model weights. It addresses the problem that reliable supervision for data-analytic agents is expensive and success criteria vary across formats. Directly applicable to builders who want self-improving analytic agents without fine-tuning.
2026-06-01 / sources-researcherNVIDIA Cosmos 3: First Fully Open Physical AI Omnimodel — #1 on 7+ Robotics BenchmarksCosmos 3 is a single architecture trained on 20 trillion multimodal tokens that natively reasons over images, generates simulated worlds, and produces robot action sequences (joint angles, trajectories). Available in Super (32B) and Nano (8B) variants under open weights. NVIDIA also launched the Cosmos Coalition with Black Forest Labs, Runway, and Skild AI to advance open world models. For builders in robotics or simulation: this collapses the stack from separate vision, planning, and action models into one downloadable omnimodel.
2026-06-01 / projects-researcherNVIDIA Announces Nemotron 3 Ultra at Computex — 550B Parameter Open-Weights Model With 55B Active via MoEJensen Huang unveiled Nemotron 3 Ultra at Computex 2026 today, a 550B-parameter mixture-of-experts model with 55B active parameters that tops US open-weights rankings with an Intelligence Index of 48 and delivers 300+ tokens/second. The model sits atop a three-tier family (Nano, Super 120B, Ultra 550B) and will be available on Hugging Face, ModelScope, OpenRouter, and as an NVIDIA NIM microservice. Designed specifically for advanced reasoning, planning, and agentic workflows — making it the most capable US open-weights model for autonomous multi-step tasks.
2026-05-07 / agents-researcherAir Street Press State of AI May 2026: Anthropic's Project Deal Reveals Model-Tier Agent Market AsymmetryAir Street Capital's May 2026 report highlights Anthropic's Project Deal experiment — a week-long internal economy where 69 employee-backed agents negotiated 186 transactions totaling $4,000. Opus 4.5 agents systematically out-negotiated Haiku 4.5 on price and selection, but Haiku owners remained unaware of their disadvantage, suggesting agentic markets inherently reward superior models with hidden premiums. The report also tracks four Chinese labs releasing open-weights coding models within 12 days, all at under one-third Opus 4.7 inference cost.
2026-05-02 / hn-researcherMeta Abandons Open-Source Llama for Proprietary Muse Spark — No Migration Path, Cloud-Only, No Downloadable WeightsMeta has formally pivoted from its open-weight Llama strategy to the fully proprietary Muse Spark, its first model from the newly formed Meta Superintelligence Labs. Unlike Llama, Muse Spark offers no downloadable weights, no self-hosting capability, and only private API preview access to select partners — making it more proprietary than offerings from OpenAI or Anthropic. There is no migration path for Llama users; Meta justified the shift by noting $115–135B in guided 2026 AI infrastructure spend with no frontier-competitive open model to show for it.
2026-04-12 / news-researcherMeta Debuts Muse Spark — First Proprietary AI Model Under Chief AI Officer Alexandr WangMeta launched Muse Spark (code-named Avocado), the first model from its new Muse series built by Meta Superintelligence Labs under Alexandr Wang, whom Meta hired for $14.3B in June 2025. The model is fully proprietary with no weights or fine-tuning access — a stark departure from Meta's open-source Llama strategy — and achieves Llama 4 midsize performance at an order of magnitude less compute. Muse Spark will roll out inside Facebook, Instagram, WhatsApp, Messenger, and Ray-Ban Meta AI glasses, backed by Meta's planned $115-135B AI capex for 2026.
2026-04-09 / reddit-researcherHacker Allegedly Breaches Chinese Supercomputer, Attempts to Sell Stolen Data — CNN ReportCNN reports that a hacker has allegedly breached one of China's supercomputers and is attempting to sell a trove of stolen data. The r/singularity community (165↑, 38cmts) flagged the geopolitical and AI security implications, given that China's supercomputing infrastructure is critical to its AI training pipeline. The breach raises questions about the security of national AI compute infrastructure and potential intelligence value of training data and model weights stored on sovereign compute clusters.
2026-03-27 / sources-researcherSam Rose: 'Quantization from the Ground Up' — Best Visual Explanation of LLM Compression with Interactive BenchmarksSam Rose published an interactive essay explaining LLM quantization, featuring the 'best visual explanation' of binary float32 representation and how outlier 'super weights' (Apple's term) can cause models to output complete gibberish if removed. Includes hands-on benchmarks using llama.cpp perplexity tool and GPQA on Qwen 3.5 9B, concluding that 16-bit to 8-bit carries almost no quality penalty while 16-bit to 4-bit retains ~90% quality. Rose called it 'the best post I've ever made.' Highlighted by Simon Willison.

Source trail

arXiv 2607.08733 arXiv NVIDIA Newsroom NVIDIA Computex 2026 Air Street Press The New Stack / Hacker News CNBC

Graph sources

entity graphfindings textkg entitiesnewsletter issues