
AMDots is my preview for an AMD powered local agent, still in early development. Running entirely on AMD Ryzen AI Halo 395. Before sharing the new AMDots demo, a few corrections to my October 23 video. The generated explainer had errors I should have caught before posting: The product name is AMD Ryzen AI Halo. “Gordon Halo” was incorrect. The specifications mixed two configurations. The Max+ 395 system used in that demo has 128 GB of unified memory and an NPU rated up to 50 TOPS, rather than the spoken “5 TOPS.” The newer Max+ PRO 495 Halo has 192 GB and up to 55 NPU TOPS. AMD specifications. The software name is ROCm. The narration mispronounced it and garbled several numbers, including “one hundred ninety-two gigabytes.” The output fell short of the primary-source checking I requested and missed the requested animated diagrams. The earlier voice stack used both CPU and NPU; the agent model ran on the Radeon GPU. The narration errors were problems in my software’s output and my review of it. Since then, I’ve kept building. The new demo introduces an upgraded LFM3 voice stack and CIRU’s optimized Qwen3.8-Flash-Next as the agent model: -125B parameters+51B n-gram embeddings, with 6B active per token with a 4b MTP drafter -256K native model context -CIRU’s compact weights and custom runtime optimized for AMD Strix Halo -Qwen architecture specifications · CIRU model and runtime Better voice, more capable agents, and better research, from talking through a task to following sources and producing something useful. This is what keeps me excited about the Ryzen AI Max+ 395: its unified memory and Radeon GPU give a compact desktop room for a substantial local AI workflow, with the large embedding table paged from local NVMe. I’m excited to show you how far AMDots has come. New demo below. 👇 AMD provided the Ryzen AI Halo used for this project.
We can have our own entirely local AI assistants for research and work. This is CIRU AMDots: a voice interface for a general-purpose agent team, with the AI running locally on one AMD Ryzen AI Halo. AMDots is your own little AI crew, brought to life as colorful dots. Give the main one an idea and watch its workers spring into action, exploring, researching and creating together. Keep chatting while they work, then see what they’ve made, from useful discoveries to a narrated video. The brain is MiniCPM 4.7 Ultra , CIRU HALO AGENT, my custom Q8 conversion and optimized serving stack built on OpenBMB’s vision-language MoE: 35 billion total parameters / 3 billion active per token 262,144-token model context limit Custom Ciru vLLM + AMD ROCm+DSpark On the 395: ~1,969 prompt tokens/sec and 40.5 generated tokens/sec with a roughly 64K-token prompt 122.8 aggregate generated tokens/sec across eight concurrent vision/tool requests Those are separate model-serving benchmarks; the eight-request figure is combined throughput across requests. Model, runtime and benchmark details. The voice stack uses the rest of the hardware too: GPU: conversation and worker-model inference CPU: Moonshine Small Streaming English speech recognition, 123M parameters CPU + NPU: Pocket TTS, 100M parameters, with recurrent feed-forward operations offloaded to the XDNA 2 NPU Speech synthesis stays off the GPU, leaving that compute available for the agents. Voice and workers share the language model, with live conversation taking priority. Local model inference, a visual agent workspace, and research that can become something you can watch and hear. All on a small AMD desktop. AMD provided the Ryzen AI Halo system used for this project.


















