←
LocalAI1,550 posts
LocalAI avatar

LocalAI

@LocalAI_API

OpenAI Open Source alternative. LocalAI is a community, drop-in replacement API compatible with OpenAI for local CPU/GPU inferencing

◷ Joined April 2023▧ 131 Photos and videos
LocalAI avatar
LocalAI@LocalAI_API·Aug 5

LocalAI 4.8 is out. We just crossed 48.3k stars! - `local-ai chat` is a TUI agent harness now. - image to 3D, audio-driven talking avatars - voice cloning first-class in the UI - vLLM's serving architecture in C++20, no Python 386 PRs, 22 days, 25 contributors, 11 new👇

0:22
LocalAI avatar
LocalAI@LocalAI_API·Nov 13

We will miss you. You helped so much to shape what Local AI is today! Thanks for your strong leadership and supporting continously the community.

For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-W…

Post attachmentPost attachmentPost attachment
Ettore Di Giacinto avatar
⟳ LocalAI retweeted
Ettore Di Giacinto@mudler_it·Oct 29

Just landed in @LocalAI_API with VAD, tool support, and barge-in, directly wired in the realtime API. github.com/mudler/LocalAI/pu…

Rushing to get this great model on @LocalAI_API , gonna make realtime assistants go brr!

Geekus avatar
⟳ LocalAI retweeted
Geekus@GeekusFr·Oct 18

LocalAI fait tourner texte, voix, image et vidéo en local, sans carte graphique obligatoire. Une seule API compatible OpenAI, Anthropic et ElevenLabs. Le lancement tient en une commande Docker. cc @LocalAI_API geekus.fr/x/localai

Post attachment
Ettore Di Giacinto avatar
⟳ LocalAI retweeted
Ettore Di Giacinto@mudler_it·Oct 13

Runs out of the box on parakeet.cpp! Trying it out right now and adding it to @LocalAI_API !

We took NVIDIA's Parakeet and made it better. Introducing Fluid Speech Mini: the best Open Source Model purpose-built for Dictation 🚀 With SOTA performance under 300 MB Run it on your iPhone, Mac, or PC. No cloud, no internet. Dictation shouldn't need a server. Your voice should be yours and we will make sure of that. Open weights and more info below!

0:46
Ettore Di Giacinto avatar
⟳ LocalAI retweeted
Ettore Di Giacinto@mudler_it·Oct 6

Wow the locate-anything models just reached almost 11M download, and are in the most downloaded models of @huggingface , in the first page ! Thanks @fabiolalli for telling me, I didn't notice 😅 Now, I don't know about the download stats and how that's calculated, but, in any case, happy to see community is using my locate anything port to @ggml_org ! you can also use it in @LocalAI_API in a couple of clicks away, published for all platforms we support. In any case, I'm happy to contribute to the Open source community! Let's push Open source Local AI!

Post attachment
Ettore Di Giacinto avatar
⟳ LocalAI retweeted
Ettore Di Giacinto@mudler_it·Oct 12

A huge thanks to @niels_gron for supporting @LocalAI_API with a brand new M5 Max MacBook Pro! Generous support like this helps drive open-source forward. Excited to start optimizing and making all our projects work natively for Apple Silicon!

Post attachmentPost attachment
LocalAI avatar
LocalAI@LocalAI_API·Oct 4

LocalAI 4.11.0 is out - You can now transcribe recordings with speaker labels and detect sounds alongside speech - New Decisions API - Model failover - text-to-animation with Kimodo - Much more, check links below Thanks to everyone who contributed, tested, and reported issues!

Post attachment
Ettore Di Giacinto avatar
⟳ LocalAI retweeted
Ettore Di Giacinto@mudler_it·Oct 4

parakeet-redux is a really interesting beast. You can extract the VAD head and then, you discover that has better recall than Silero. Despite the footprint compared to it, offline might have other uses. @vikhyatk cooked hard here, congrats for the release, and thanks for working in the open! By the way, all Parakeet-redux models are now in parakeet.cpp (links below). And you can use parakeet now as standalone VAD with both.

Post attachment
Ettore Di Giacinto avatar
⟳ LocalAI retweeted
Ettore Di Giacinto@mudler_it·Oct 3

Your local agent can now hear what was said, who said it, and what happened around them. parakeet.cpp transcribes audio, separates speakers, detects 527 sound classes, and now enrolls and remembers named voices across recordings. One pass, local C++.

0:55
Ettore Di Giacinto avatar
⟳ LocalAI retweeted
Ettore Di Giacinto@mudler_it·Sep 30

Nemotron-3-Diarization was just released by @NVIDIAAI , and it runs in parakeet.cpp now, next to Parakeet speech recognition. It runs already on Apple with Metal, CUDA, @AMD and with anything that Vulkan supports. We (@LocalAI_API) also added sound detection in: @Xiaomi's CED models (527 sound classes), ported to C++ sitting alongside it. You can run it with a couple of click via API, all Local and open source. Parakeet.cpp now runs all three in one pass and you get the transcript, who is speaking, and what else you can hear. This scene from Sprite Fright took 2 seconds on a CPU.

0:43
Richard Palethorpe avatar
⟳ LocalAI retweeted
Richard Palethorpe@jichiep·Sep 29

I added full-body-control to my simulation using gem-x.cpp and GEAR SONIC (motion-bricks.cpp). The physically simulated character is controlled by my body movements and SONIC which tries to balance it. Inference is done on @LocalAI_API which takes in video frames and produces reference movements. Note that I don't think I'm getting the best performance here. There are probably some issues to iron between gem-x.cpp and motion-bricks.cpp.

1:36
Ettore Di Giacinto avatar
⟳ LocalAI retweeted
Ettore Di Giacinto@mudler_it·Sep 24

A small update on what's going on in vllm.cpp: - Minimax and LTX 2.5 got Lora support. Now you can Load fused-model, or either make lora load in runtime with prompts in vllm.cpp - Support for Kev (@jaredpalmer), Laya and GLiNER2.5 (@fastinoAI ). Same SystemOne api, so you can switch quickly and have a fast Jev replacement, running locally - Mia-AiLab/Qwen3.8-27B-EXL3-3.5bpw runs at ~53 tok/s at high concurrency (up to c32) with DGX Spark I'm working now on the docs and making this a bit more easy to go, you'll also see all these models popping up in @LocalAI_API for a one-click install. A big shout out our friends at @regolo_ai , for sponsoring us as part of their Builder Program and giving access to their API, thank you 🫶! I've also added them to my agent harness, nib, so you can /login and use their API directly, links👇