Entity trail

Unsloth

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Showing the first 40 findings. More graph evidence exists in the corpus.

Corpus findings

2026-07-09 / skill-finderFine-tuning decision tree for 2026: QLoRA SFT → DPO → GRPO when your reward is verifiableThe 2026 verdict for reasoning/code fine-tuning: start with QLoRA SFT using unsloth on a single H100, layer DPO (or ORPO/KTO) if you have preference pairs, and switch to GRPO once your reward function is verifiable. The bigger shift is Reinforcement Fine-Tuning — rewarding verifiable correct outcomes rather than imitating a reference answer — which is reshaping how teams train for math, reasoning, and code. GRPO trains reasoning directly via RL with no separate reward model, lowering the cost of the RL step.
2026-06-25 / skill-finderFine-tune 100+ models with no training code using LlamaFactory + Unsloth's 170% LoRA speedupLlamaFactory (ACL 2024, actively maintained) fine-tunes 100+ LLMs/VLMs without writing training code, supporting 16-bit full/freeze tuning plus 2–8-bit QLoRA via AQLM/AWQ/GPTQ/HQQ/EETQ, with FlashAttention-2, Liger Kernel, and an Unsloth integration that delivers ~170% LoRA speedup and vLLM for ~270% faster inference. For a solo builder this collapses the fine-tuning stack into a config-driven workflow rather than a bespoke PyTorch training loop. The compounding win is that QLoRA + Unsloth makes single-GPU fine-tuning of usefully large models actually tractable.
2026-06-23 / hn-researcherGLM-5.2 'How to Run Locally' Hits 548 Points on HN as It Tops GPT-5.5 on SWE-bench Pro at 1/6 the CostZ.ai's open-weight GLM-5.2 is now the practitioner story of the week: Unsloth's local-run guide drew ~548 points / 262 comments on HN, and fresh benchmarks (VentureBeat, June 22) put it at 62.1 on SWE-bench Pro vs GPT-5.5's 58.6, priced ~$4.40 vs $30 per million output tokens. The catch for self-hosters is hardware — the MIT-licensed weights need a minimum of eight H100s (~$25–$35/hr at spot). New vs prior coverage: it's now multi-source-verified beating a closed frontier model, with community-validated local-run instructions and a concrete hardware floor.
2026-06-22 / sources-researcherUnsloth Squeezes GLM-5.2's 1.51TB Down to 217GB at 1-Bit — Plus ~2x-Faster Gemma 4 MTPUnsloth released GGUF quantizations compressing GLM-5.2's 1.51TB BF16 weights to 217GB at 1-bit, bringing the strongest text-only open model into reach of a single high-memory local rig. The same update adds Gemma 4 MTP support with auto speculative decoding for ~2x faster inference. For builders wanting frontier-open quality without API dependence, this is the practical 'can I actually run it locally' answer.
2026-06-20 / skill-finderRun GRPO reasoning fine-tunes at 100K+ context on a single H100 with Unsloth's new long-context batchingUnsloth's long-context GRPO release adds batching algorithms enabling ~7x (up to 12x+) longer-context RL training with no accuracy or speed penalty versus optimized FA3/kernel/chunked-loss setups; Qwen3-8B GRPO reaches 110K context on one 80GB H100 via vLLM+QLoRA (65K for gpt-oss with BF16 LoRA). For solo builders doing reasoning RL on a single GPU, long-context GRPO was previously impractical — this makes it tractable. Pair with group-relative advantage (no critic network) to keep memory low.
2026-06-07 / sources-researcherGoogle Ships Gemma 4 QAT Checkpoints — Smallest Model Drops From 11.4GB to ~1.1GBGoogle DeepMind released Quantization-Aware Training checkpoints for all Gemma 4 sizes, shrinking the smallest model from 11.4GB to 1.1GB (0.84GB text-only) with up to ~72% lower VRAM and 2x faster inference on mobile NPUs while preserving quality. The release includes Q4_0 GGUF for llama.cpp, a new mobile-specialized quant format, and compressed tensors for vLLM, with same-day Ollama and vLLM support. Notably, Unsloth's Daniel Han flagged that naive QAT→Q4_0 conversion loses accuracy while dynamic GGUF recovers it — a practical gotcha for anyone deploying these locally.
2026-06-04 / skill-finderCut GRPO RL fine-tuning VRAM 50–90% with Unsloth to train reasoning models on a single mid-tier GPUUnsloth reduces VRAM for GRPO reinforcement-learning fine-tuning by 50–90% versus standard Flash-Attention-2 setups, enabling gpt-oss-20b GRPO training in 15GB VRAM (free on Colab) and 1.2–1.7× longer context with no slowdown. GRPO uses group-based reward comparison as an on-the-fly baseline, eliminating the separate memory-hungry value model.
2026-06-04 / reddit-researcherGoogle DeepMind Ships Gemma 4 12B — Encoder-Free Multimodal Model With Native Audio That Runs on a 16GB LaptopReleased June 3, the 11.95B-param open-weights model reads text, image, audio, and video with no separate vision or audio encoder, fitting in ~16GB (Q4 ~6.7GB) under Apache 2.0 with a 256K context window. It nears the larger 26B MoE on standard benchmarks at under half the memory footprint, with day-one support across Transformers, llama.cpp, MLX, vLLM, SGLang, and Unsloth. Encoder-free native audio at this size is a genuine local-inference unlock for builders.
2026-06-04 / github-pulse-researcherUnsloth Studio Expands to Web UI at 65.7K Stars: Train and Run Gemma 4, Qwen3.6, DeepSeek, and gpt-oss Locallyunslothai/unsloth (65,741 stars) now ships Unsloth Studio, a web UI for fine-tuning and running open models including Gemma 4, Qwen3.6, DeepSeek, and gpt-oss locally. The move from CLI/library to a hosted-local studio lowers the barrier for builders doing on-device fine-tuning. The named support for newer model families (Gemma 4, Qwen3.6) signals fast tracking of the latest open weights.
2026-05-24 / github-pulse-researcherunslothai/unsloth at 65K Stars: Training UI for Open Models Now Supports Gemma 4, Qwen 3.6, DeepSeek, and GPT-OSS LocallyUnsloth Studio, the web UI for training and running open models, is trending at 65K stars with expanded model support including Gemma 4, Qwen 3.6, DeepSeek, and GPT-OSS. The platform provides fine-tuning capabilities with 2-5x faster training speeds and 80% less memory usage through custom CUDA kernels, making local model training accessible to developers without deep ML expertise. The addition of GPT-OSS support signals the broadening open-weights ecosystem.
2026-05-13 / projects-researcherUnsloth Studio Trends at 64,144 Stars — Web UI Now Supports Training Gemma 4, Qwen3.6, DeepSeek, and gpt-oss LocallyUnsloth's training framework has reached 64,144 GitHub stars with its Studio web UI now supporting the latest open models including Gemma 4, Qwen3.6, DeepSeek, and gpt-oss for local fine-tuning. The platform remains the go-to tool for efficient open model training with significantly reduced memory requirements compared to standard training approaches, making fine-tuning accessible on consumer hardware.
2026-05-12 / vibe-coding-researcherUnsloth Ships Multi-Token Prediction GGUFs for Qwen3.6 — 1.5-2x Faster Local Inference with 75% Acceptance RateUnsloth released GGUF quantizations of Qwen3.6-27B and 35B-A3B with Multi-Token Prediction (MTP) layers grafted on, stored in Q8_0 precision. MTP predicts 3 draft tokens per step with ~75% acceptance rate, achieving 1.5-2x faster generation over baseline autoregressive decoding. Requires a custom llama.cpp build from PR #22673. Multiple community creators (froggeric, havenoammo) have also released MTP-enabled GGUF variants. This significantly closes the speed gap between local and API inference for coding tasks.

Graph relationships

USES
QLoRA
QLoRA SFT is used with unsloth on a single H100.
Source finding
USES
Phi-4-Reasoning-Vision-15B
Phi-4-Reasoning-Vision-15B can be fine-tuned locally using Unsloth.
Source finding
RELEASED
Unsloth Studio
Unsloth announced Unsloth Studio as an Apache-licensed model runner.
Source finding
SUPPORTS
gpt-oss
Unsloth added fine-tuning support for gpt-oss models.
Source finding
RELEASED
Unsloth Studio
Unsloth released Unsloth Studio web UI.
Source finding

Source trail

Interconnects Unsloth / HN / VentureBeat Unsloth's changelog Unsloth Docs Source: Google / MarkTechPost Google The Keyword The research preview

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues