←
Unsloth AI831 posts
Unsloth AI avatar

Unsloth AI

@UnslothAI

Run and train models locally with the Unsloth Desktop app. 🦥 github.com/unslothai/unsloth

◷ Joined November 2023▧ 304 Photos and videos
Unsloth AI avatar
Unsloth AI@UnslothAI·Aug 11

Introducing Unsloth Desktop 🦥 The first desktop app to run and train models locally. • Open-source. Runs on Mac, Windows and Linux • Supports MLX, diffusion image/video, audio, GGUF • Connect Claude Code and Codex to local LLMs • 50% more accurate, self-healing tool calls + sandboxed code exec • Works for CPU + multiGPU setups - NVIDIA, AMD, Intel, Mac • Train models 2× faster with 70% less VRAM • Private web search, deep research, RAG, MCP and exports (NVFP4, GGUF) • Use Unsloth’s OpenAI-compatible API and cloud models • Securely deploy LLMs remotely and access anywhere Unsloth Desktop is now available on unsloth.ai and GitHub. GitHub: github.com/unslothai/unsloth Blog and Guide: unsloth.ai/docs/desktop

0:47
Unsloth AI avatar
Unsloth AI@UnslothAI·Nov 16

Qwen4 GGUFs will use a new version of Unsloth Dynamic 3.1 for the best performance on Terminal Bench, DeepSWE & more agentic benchmarks.

Today, we're releasing the highest accuracy Qwen3.8-27B GGUFs. Our new Dynamic V3.1 GGUFs lead by 5–10% on average across Terminal Bench, DeepSWE & more. We’re working on even better version for Qwen4 Run on 12GB RAM. GGUF: huggingface.co/unsloth/Qwen3… Blog: unsloth.ai/docs/models/qwen3…

Post attachment
Unsloth AI avatar
Unsloth AI@UnslothAI·Nov 16

Qwen announces smaller Qwen4 models will be released soon! 🔥 Qwen4-27B will run on 16GB RAM setups.

📢 Meet Qwen4-Max, your new AI teammate for work, creativity, and discovery! Qwen4-Max is built on a new MoE architecture with native vision and a 1M-token context window. Highlights: - Outperforms Qwen3.8-Max with up to ~50% fewer tokens, while average cost per task drops over 60% in our internal evaluation. - Advances real-world productivity through greater proficiency with professional tools, stronger long-horizon execution, and higher-quality deliverables. - Handles real tasks, including 3D modeling, game development, manufacturing, finance, law, healthcare, and frontier scientific discovery. - $1.5/M tokens for input, $4.5/M tokens for output, and $0.075/M tokens for implicit caching — all lower than Qwen3.8-Max, with implicit caching down by 70%. The API is live on QwenCloud. You can also try Qwen4-Max on Qwen Studio, QwenWork and Qoder. Start building today! 🚀 - Blog: qwen.ai/blog?id=qwen4-max - API: qwencloud.com/models/qwen4-m… - Token Plan: qwencloud.com/pricing/token-… More to come! The open weights of smaller Qwen4 models will be released. Stay tuned. 👀

Post attachment
Unsloth AI avatar
Unsloth AI@UnslothAI·Nov 11

We also released Dynamic v3.1 GGUFs for Qwen3.8-Flash-Next and DeepSeek-V4.1-Flash. UD v3.1 delivers even more prominent performance gains on these models across agentic benchmarks at 512K context.

Post attachmentPost attachment
Unsloth AI avatar
Unsloth AI@UnslothAI·Nov 6

Qwen3.8-Flash-Next GGUFs now run faster with less thinking and less token use. Unsloth Dynamic V3.1 GGUFs bring thinking & token use to match 95% of full precision Qwen3.8-Flash. Results: 50% fewer tokens + 15% higher accuracy vs same size quants. GGUF: huggingface.co/unsloth/Qwen3…

Post attachment

We’re releasing new Qwen3.8-Flash-Next GGUFs with 15% higher accuracy. Unsloth Dynamic V3.1 outperforms others by >15% on Terminal Bench, DeepSWE & more benchmarks (256K context). Run on 32GB+ RAM setups. GGUF: huggingface.co/unsloth/Qwen3… Blog: unsloth.ai/docs/models/qwen3…

Post attachment
Unsloth AI avatar
Unsloth AI@UnslothAI·Nov 2

We benchmarked DeepSeek-V4.1-Flash-1017 GGUFs on Terminal Bench, DeepSWE & more on 512K context. Unsloth ranks highest overall. 1-bit Unsloth GGUF scores 68.1 on DeepSWE, 72.2 on Terminal-Bench, 52.7 on AutomationBench. >10% ahead of other quants. GGUF: huggingface.co/unsloth/DeepS…

Post attachment

We’re releasing new DeepSeek-V4.1-Flash-1017 GGUFs, ranking highest across benchmarks. Dynamic V3.1 leads across nearly all benchmarks: GPQA Diamond, AIME25, LiveCodeBench v6, MMLU-Pro, Aider & more. Run on 64GB+ RAM. GGUF: huggingface.co/unsloth/DeepS… Blog: unsloth.ai/docs/models/deeps…

Post attachment
Niko Veit avatar
⟳ Unsloth AI retweeted
Niko Veit@coldniko·Oct 31

Unsloths support for Deepseek is here! 👀 + Improvements on Strix + Improvements on parallel requests + Improvements on DGX Spark + Improvements on Intel B-series See more at: github.com/Niko1221/Strata/r…

Post attachment
Unsloth AI avatar
Unsloth AI@UnslothAI·Oct 30

We’re releasing new DeepSeek-V4.1-Flash-1017 GGUFs, ranking highest across benchmarks. Dynamic V3.1 leads across nearly all benchmarks: GPQA Diamond, AIME25, LiveCodeBench v6, MMLU-Pro, Aider & more. Run on 64GB+ RAM. GGUF: huggingface.co/unsloth/DeepS… Blog: unsloth.ai/docs/models/deeps…

Post attachment

🚀 DeepSeek-V4.1-Flash-1017 is here! Stronger benchmark performance, faster task completion, and shorter outputs than the previous version—a Pareto improvement in performance and cost. Now live on our website, app, and API. 🛠️ Optimized for @DeepSeekHarness, Tencent CodeBuddy, WorkBuddy, and more. Upgrade to DeepSeek Harness v0.2.1-rc.1 or later for the best experience with the new model. 1/4

Post attachmentPost attachment
Unsloth AI avatar
Unsloth AI@UnslothAI·Oct 29

Mistral Le Chonk can now run locally! The 1 trillion parameter model runs on a Mac Studio with our 1-bit GGUF which retains 91% top-1 accuracy. Le Chonk is the strongest Western open model to date. GGUF: huggingface.co/unsloth/Mistr… Guide: unsloth.ai/docs/models/mistr…

Post attachment

Today, we release the weights of a new and improved Le Chonk, advancing the open frontier for agentic coding and cybersecurity. 💻 Built to build: Le Chonk ranks #1 on @cognition’s FrontierCode among open models, and sets a new benchmark for Pareto efficiency on @artificialanalysis. 🛡 Built to defend: State-of-the-art in cyberdefense, put through the paces by the world's leading cyber vendors, including @CrowdStrike, @cloudflare, @rubrik, @zscaler, and others. Built for sovereignty: Make it yours. Download the weights on @huggingface , customize it with Mistral Forge, and deploy it wherever you need it. Read more from our team and customers 👇:

Post attachment
MiniMax (official) avatar
⟳ Unsloth AI retweeted
MiniMax (official)@MiniMax_AI·Oct 26

MiniMax M3.1 Flash meets the @UnslothAI community. 🐙🦥✨ Unsloth’s Dynamic GGUFs bring our 428B MoE model to a 143.9GB 2-bit footprint, with 91.5% top-1 token agreement in their evaluation across seven domains. That means a lower memory barrier to self-hosting, deployment through Unsloth Desktop and llama.cpp, and an OpenAI-compatible API for existing apps and agents. With 78K+ GitHub stars and over 500M model downloads on Hugging Face, Unsloth gives M3.1 Flash a path into an established community of developers running, evaluating and building with open models. Open weights. Local control. More ways to build.

Post attachment

MiniMax-M3.1-Flash can now run locally! We made 2-bit GGUF retain 91.5% top 1 accuracy while being 45% smaller. Run on 150GB RAM. MiniMax-M3.1-Flash is the strongest open model for its size & among the best overall. GGUF: huggingface.co/unsloth/MiniM… Guide: unsloth.ai/docs/models/minim…

Post attachment
NVIDIA RTX Spark avatar
⟳ Unsloth AI retweeted
NVIDIA RTX Spark@NVIDIARTXSpark·Oct 26

Getting started with @UnslothAI on RTX Spark? Just run the .exe. @danielhanchen and @NaderLikeLadder got hands-on with NVIDIA RTX Spark to talk about running and training AI models locally, exploring reinforcement learning, and making it easier to start building with Unsloth.

0:52
Unsloth AI avatar
Unsloth AI@UnslothAI·Oct 26

MiniMax-M3.1-Flash can now run locally! We made 2-bit GGUF retain 91.5% top 1 accuracy while being 45% smaller. Run on 150GB RAM. MiniMax-M3.1-Flash is the strongest open model for its size & among the best overall. GGUF: huggingface.co/unsloth/MiniM… Guide: unsloth.ai/docs/models/minim…

Post attachment

MiniMax M3.1 Flash: Space Performance + Bunny Speed 🚀🐰 Yes, Space Bunny - which has topped global leaderboards with 200T+ tokens - was an earlier version of M3.1 Flash. 💰Redefining the performance economics of agentic AI. M3.1 Flash achieves frontier-level intelligence across key tasks such as Cowork (Automation-Bench: 62%; ALE: 30%), Coding (DeepSWE: 74%) and Visual Reasoning (BabyVision: 91%), at 1/3 the cost of M3 and 3x the speed. API pricing (flat rate): $0.15 / $0.60 per 1M input/output tokens, with cache reads at $0.015 / 1M tokens. Model weights will arrive on Oct 23. API: platform.minimax.io M Plan: minimax.io/m-plan MiniMax Code for desktop: agent.minimax.io/download

Post attachment
Unsloth AI avatar
Unsloth AI@UnslothAI·Oct 23

NVIDIA releases Nemotron-3.5-Bolt-E4B, a new model that runs locally on 6GB RAM. 💚 Bolt-E4B can run on edge devices like phones and delivers top-tier performance for its size. Trained on Gemma 4, it supports vision. GGUF: huggingface.co/unsloth/NVIDI… Guide: unsloth.ai/docs/models/nemot…

Post attachment

Available now: NVIDIA Nemotron 3.5 Bolt E4B 4GB ⚡️ Our newest small open model is built for local assistants, interactive characters and robots that can carry on a conversation and use tools to get things done. Watch Reachy Mini chat and move, with Bolt handling conversation and NVIDIA Cosmos handling vision. Both models run locally on Jetson Orin Nano 8GB. Learn more: research.nvidia.com/labs/nem…

0:25