←
Halogen19 posts
Halogen avatar

Halogen

@halogenengine

halogen™ is local inference that behaves like a frontier API. Strix Halo + NPU, OpenAI & Anthropic APIs on one port.

◷ Joined October 2026▧ 4 Photos and videos
Halogen avatar
Halogen@halogenengine·10h

Halogen 0.20.7 for @AIatAMD Ryzen AI Halo: • Concurrency mode is now the default, with no single-request slowdown • Single requests decode ~4–6% faster • 2–16 requests at once: up to 29% more throughput on code • New, faster draft head github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 16

Halogen 0.20.6 for Ryzen AI Halo: • Images read ~4x faster • New draft head: ~4% faster generation • Opt-in concurrency mode: up to 20% more throughput • @liquidai's own 4-bit LFM3-1.7B on the NPU, ~48 tok/s • Multi-agent & shared-prompt fixes github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 15

Halogen 0.20.5 for Ryzen AI Halo: • Faster decoding with parallel requests • Hindi, Thai & Indic prompts read as trained • LFM3 from @liquidai on the @AIatAMD NPU: ~2x faster on long prompts • Fixes incl. structured output & Claude Code tool changes github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 12

Halogen 0.20.4 is out for Strix Halo • Short follow-up messages read 15–50% faster in cached conversations • ~10–20% more combined throughput at 16 requests at once (>8 slots) • Fix: tool_choice “none” respected after earlier tool calls github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 11

Halogen 0.20.2 and 0.20.3 are out for Strix Halo • @vllm_project’s d3-lite 14–18% faster on the @AIatAMD NPU, d3-nano 7–9%, both using less energy • Up to ~4% sooner first token on long conversations • NPU decisions on long prompts start sooner github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 9

Halogen 0.20.1 is out for Strix Halo • Faster follow-up turns: first token in 0.19s vs 0.60s on a code-edit session • An answer even when the model ends its turn mid-reasoning • Quieter logs on long sessions github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 8

Halogen 0.20.0 is out for Strix Halo • OvisOCR3 document parsing on the @AIatAMD NPU (your own weights) • OCRBench 85.7 vs 85.3 upstream • ROCm 10.1: ~9–15% less energy, same speed • 2–6% faster prompt reading on Qwen3.8-Flash-Next github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 6

Halogen 0.19.1 for Strix Halo: • XRT now in the image: NPU needs only the host driver and firmware • Malformed tool schemas get a 400 instead of locking up generation slots • Faster first token when a /v1/completions prompt extends a recent one github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 5

Halogen 0.19.0 for @AIatAMD Strix Halo: • Preview: Halogen Spotter, an opt-in NPU agent guard that checks tool results • Whole-file rewrites by coding agents ~30% faster • NPU stability fixes Spotter: peonist.ai/halogen/docs/agen… Changelog: github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Nov 4

Halogen Flash is now a backend in @lemonade_server from @AIatAMD, just merged for Strix Halo: • Runs Qwen3.8-Flash-Next with v2 quants • Pinned to the Halogen 0.18.22 release • Tested in CI on the full model Thanks, Lemonade! github.com/lemonade-sdk/lemo…

Halogen avatar
Halogen@halogenengine·Nov 3

Halogen 0.18.23: the LFM3 family from @liquidai now runs on the Strix Halo NPU • LFM3-VL-2B: pictures and video • LFM3-Audio-2B: speech in and speech out • LFM3-Omni-2B: every medium on one model • Fix: replies no longer invent a user turn github.com/peonist-ai/haloge…

Halogen avatar
Halogen@halogenengine·Oct 30

Halogen 0.18.20 for Strix Halo is out. • 2 requests at once ~20% faster, 3 at once ~9% • JSON schemas now work on requests with images • Strict tools enforced with images too • Clear NPU error on old XRT github.com/peonist-ai/haloge…