
Driving model performance optimization: 2024 highlights baseten.co/blog/driving-mode… via @baseten

Co-founder @basetenco working on ML model performance

Driving model performance optimization: 2024 highlights baseten.co/blog/driving-mode… via @baseten


The future of AI depends on the collective progress of the entire research community. Where will the next gains come from: pre-training, post-training, inference-time compute, or something else? Today we’re bringing together researchers, founders, and engineers at All-Gather, our first research conference, to work through these questions in the open. We’re excited to share what we learn.
Tuhin Srivastava @tuhinone 10h Article All-Gather: Baseten’s first research conference We believe the future of AI hinges on the collective progress of the entire research community: no single lab has the full picture, and no one company should own the science of the frontier. This same



2,000+ people. Two days. The first SGLang Summit. Together, we announced SGLang v1.0, released Miles v0.2, and launched the SGLang Consortium with nine founding members: @nvidia, @AMD, @intel, @Google, @Meta, @thinkymachines, @Cloudflare, @modal, and @radixark. SGLang is now used by 332 organizations. At Meta, it powers production inference for products serving billions of users. Teams from Modal, Cloudflare, LinkedIn, and others shared their production lessons. Across 90+ technical talks and six hands-on workshops, the community explored what comes next for inference, reinforcement learning, and AI agents. To everyone building, deploying, and contributing: thank you for making this possible. Explore the announcements, engineering lessons, and moments from SGLang Summit 2026 in the link below.

Companies are increasingly owning their models. We’ve seen this over the past several months with customers using Baseten Loops to post-train on their own data to create custom, durable intelligence that they control. Today we’re opening this capability up to everyone with Serverless Loops.
Baseten Loops is now GA, and serverless. Teams at @AmbienceAI, @datadoghq, and @LangChain use the Loops SDK for SFT and RL training to build durable intelligence. Serverless Loops includes: - Always-warm infra that eliminates cold starts - Pay-per-token pricing for training and sampling - One-click deployment from your trained checkpoint to production inference - Model-specific numerical validation, with a focus on reducing mismatch between training and sampling You bring the data, reward functions, and training logic. We handle the infrastructure. You always own the weights. Learn more: baseten.co/blog/introducing-…

Serverless Loops is GA today. @datadoghq runs multi-turn agentic RL, @LangChain post-trains on agent traces for LangSmith Engine, and @AmbienceAI tunes models for clinical language and transcription.
Baseten Loops is now GA, and serverless. Teams at @AmbienceAI, @datadoghq, and @LangChain use the Loops SDK for SFT and RL training to build durable intelligence. Serverless Loops includes: - Always-warm infra that eliminates cold starts - Pay-per-token pricing for training and sampling - One-click deployment from your trained checkpoint to production inference - Model-specific numerical validation, with a focus on reducing mismatch between training and sampling You bring the data, reward functions, and training logic. We handle the infrastructure. You always own the weights. Learn more: baseten.co/blog/introducing-…

Baseten Loops is now GA, and serverless. Teams at @AmbienceAI, @datadoghq, and @LangChain use the Loops SDK for SFT and RL training to build durable intelligence. Serverless Loops includes: - Always-warm infra that eliminates cold starts - Pay-per-token pricing for training and sampling - One-click deployment from your trained checkpoint to production inference - Model-specific numerical validation, with a focus on reducing mismatch between training and sampling You bring the data, reward functions, and training logic. We handle the infrastructure. You always own the weights. Learn more: baseten.co/blog/introducing-…

We're doing 3 launches this week, expanding Baseten's inference platform: - Grid: gateway, intelligent router, and guardrails for coding agents (launching on Wednesday) - Sandboxes: stateful, VM-isolated, and co-located with inference (launching on Thursday) - Loops: serverless RL and SFT on frontier open-weight models (GA on Friday) What excites me most is bringing training, inference, routing, and execution onto the same platform and showing what becomes possible when they're built to work together. More to come all week.
Amir Haghighat @amiruci Nov 3 Article The building blocks of the open frontier Every AI product runs on a system: models, the infrastructure that serves them, the training that improves them, and the agents that orchestrate them all. Many teams stitch that system together from


We're proud to be a launch partner for the NVIDIA Open Agent Safety Platform and a member of the Open Secure AI Alliance. Baseten is committed to contributing to the open frontier, including open safety standards and frameworks for inference and training. Two weeks ago, we launched our safety infrastructure research effort with Base Labs. Today, we've contributed to OpenShell and built a template to run it inside our sandboxes. Much more to come.
Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform, bringing together OpenShell and Sentry. Artificial intelligence is extraordinary technology that will advance discovery, productivity, security, health, and prosperity for generations to come. But its full promise can only be realized when people have confidence that AI is being built to be safe and deployed with wisdom and responsibility. This is bigger than a single product. It's the beginning of an open ecosystem to build the trust layer for safe agent systems. Together, we are building the foundation of the AI economy. Trust and innovation are not in conflict. Safety is how trust is earned. We must build not only the most capable AI, but the most trusted AI, so that this extraordinary technology can realize its enormous promise for the world. nvda.ws/4hcoq7m

Our second announcement of the day: Carbon is our newest sandbox infrastructure, built with more capabilities for long-running agents. It has microVM isolation, an IPv6 address per sandbox, and snapshots and forks as first-class features. A sandbox snapshot can go to production within milliseconds; no extra build step needed. Carbon is in private preview; DM me if you want access.
Baseten @baseten Sep 28 Article Securing the open frontier with NVIDIA OpenShell and Blaxel sandboxes Agent safety has become top of mind in recent weeks, specifically focused on where failure modes lie and how to address them. We’re thrilled to support NVIDIA’s Open Agent Safety Platform, which


The open frontier only works if we can make autonomy safe by default. @JensenHuang has done important work here that we're proud to support. Excited to join the Open Secure AI Alliance and to partner with @nvidia on the launch of the Agent Safety Platform.
Today, with over 100 industry partners, we introduced the NVIDIA Open Agent Safety Platform, bringing together OpenShell and Sentry. Artificial intelligence is extraordinary technology that will advance discovery, productivity, security, health, and prosperity for generations to come. But its full promise can only be realized when people have confidence that AI is being built to be safe and deployed with wisdom and responsibility. This is bigger than a single product. It's the beginning of an open ecosystem to build the trust layer for safe agent systems. Together, we are building the foundation of the AI economy. Trust and innovation are not in conflict. Safety is how trust is earned. We must build not only the most capable AI, but the most trusted AI, so that this extraordinary technology can realize its enormous promise for the world. nvda.ws/4hcoq7m

We believe openness to be an advantage for AI safety. Openness provides more visibility into the behavior of models and, most importantly, greater means of turning safety research into actionable and transparent controls than closed-source. This is why Baseten and Base Labs are building a stronger safety and security standard for open models, with the launch of our safety infrastructure. Base Labs will develop and publish methods for training and monitoring open models, and Baseten will integrate that work into its deployment infrastructure, live at runtime, and offer this work as a managed service. This will be a standard that is transparent and built into how our models are trained and deployed. We invite the open-source community to contribute, and are proud to partner with @huggingface and @GoodfireAI to bring this vision to fruition. Together, we are building an ecosystem of open models that are safe and accessible to all.


Notion's AI Meeting Notes run on Baseten, and Baseten's knowledge base runs on Notion. Our teams have been working together closely to push the frontier on both fronts. For AI Meeting Notes, our voice engineers built the fastest, highest-quality, yet lowest-cost solution on the market for speaker-attributed transcripts. We're proud to partner with the @NotionHQ team.
