←
Inco AI87 posts
Inco AI avatar✓

Inco AI ✓

@inco_ai

Inference, reimagined for the agentic era

◷ Joined May 2026▧ 16 Photos and videos
Inco AI avatar
Inco AI@inco_ai·Nov 16

Infer/Con is today 🧡 10:55am, Room B: our co-founder @zhijianliu is on the "KV Cache as a Distributed Systems Problem" panel at #InferCon, convened by @datadoghq. At the speaker lunch, he's also hosting a lunch table on speculative decoding and inference for agents. Come join us!

Post attachment
Inco AI avatar
Inco AI@inco_ai·Nov 13

Our co-founder @zhijianliu worked with @jmtang42 and team on PEAR, an open 27B model that learned to use a robot from its own tries in sim, with no demos. It runs locally at 221 tok/s on one RTX 5090 with our DFlash 2 drafter, and 52 tok/s on an M5 Max in Splash ⚡

0:31
Zhijian Liu avatar
⟳ Inco AI retweeted
Zhijian Liu@zhijianliu·Nov 11

Our DFlash 2 just got its driver's license 🚗 @NVIDIADRIVE's new Alpamayo 2 Edge uses it to think faster, right inside the car. Huge congrats! Want to drive even faster? Check out FlashDrive, our #CoRL2026 paper 👇

0:05
LMSYS Org avatar
⟳ Inco AI retweeted
LMSYS Org@lmsysorg·Nov 9

Zhijian Liu (@inco_ai) on DFlash and the other optimizations behind Inco’s open-model endpoints. A look at its block-diffusion drafter, now in SGLang, and where the rest of the speed comes from.

Post attachment
Zhijian Liu avatar
⟳ Inco AI retweeted
Zhijian Liu@zhijianliu·Nov 8

Cooking up something cool for Splash 👀 Join the community at discord.gg/ZVwTWWyb6h and get a sneak peek before release.

0:26
Inco AI avatar
Inco AI@inco_ai·Nov 5

Our co-founder @zhijianliu on why the drafter becomes the bottleneck in speculative decoding, and how parallel drafting gets past it ⚡ DFlash 2 builds on this: about one more accepted token per verification pass (+21%), for just 1.3% more cycle latency.

0:59
Inco AI avatar
Inco AI@inco_ai·Nov 4

Inco AI is heading to Infer/Con in San Francisco on Nov 16th, 2026, convened by #Datadog! Our co-founder @zhijianliu is speaking at #InferCon, alongside researchers and engineers building AI systems and tackling the challenges of inference at scale. Building with open models or working on inference? Let’s connect and swap notes on latency, cost, and scaling AI systems. Apply at infercon.ai

Post attachment
Inco AI avatar
⟳ Inco AI retweeted
Inco AI@inco_ai·Oct 26

Inco is going to #SGLangSummit 2026 🧡 Our open-model endpoints run several times faster than most providers on @ArtificialAnlys. Our co-founder @ZhijianLiu will lead a breakout session on #DFlash and what it takes to build inference for the agentic era, at scale. 🎙️ DFlash and Beyond: How Inco Runs the Fastest Open-Model Endpoints 📍 Nov 12–13, SF 🎟️ luma.com/sglang-summit Coming to the summit? Stop by, say hi, and let's talk about your inference stack.

Post attachment
Zhijian Liu avatar
⟳ Inco AI retweeted
Zhijian Liu@zhijianliu·Oct 16

Congrats @reflection_ai on shipping Beam! Glad to see DFlash 2 powering it from day one. It makes the model decode up to 3× faster with zero quality loss.

Post attachment
Inco AI avatar
Inco AI@inco_ai·Oct 7

Splash is open source under Apache-2.0: github.com/incoai/splash You'll need an M3 or newer and macOS 26.4 or later. To upgrade, run brew upgrade incoai/tap/splash and restart the server. Try it and tell us which Mac you're on and how long your first token takes.