
What an amazing day! Presented a poster at @PyTorch Conference: how we optimised the RLM paper with pre-fix caching & batched Sub calls with @vllm_project And a full house for our Pytorch Conference talk on running LLMs using Executorch on Android!

AI Architect & Builder - Inference, LLMs, SLMs GSoC Org Admin - Jenkins | Docker Captain | CNCF Ambassador

What an amazing day! Presented a poster at @PyTorch Conference: how we optimised the RLM paper with pre-fix caching & batched Sub calls with @vllm_project And a full house for our Pytorch Conference talk on running LLMs using Executorch on Android!

2,000+ people. Two days. The first SGLang Summit. Together, we announced SGLang v1.0, released Miles v0.2, and launched the SGLang Consortium with nine founding members: @nvidia, @AMD, @intel, @Google, @Meta, @thinkymachines, @Cloudflare, @modal, and @radixark. SGLang is now used by 332 organizations. At Meta, it powers production inference for products serving billions of users. Teams from Modal, Cloudflare, LinkedIn, and others shared their production lessons. Across 90+ technical talks and six hands-on workshops, the community explored what comes next for inference, reinforcement learning, and AI agents. To everyone building, deploying, and contributing: thank you for making this possible. Explore the announcements, engineering lessons, and moments from SGLang Summit 2026 in the link below.

Crazy...this is Kubernetes moment for AI Agents. Run millions of agents on Kubernetes. Idle agents go to sleep and wake up in under 500ms. 10x more agents on the same hardware. 100% Opensource. github.com/agent-substrate/s…

Introducing Wally Code: UNLIMITED coding at ₹1,000 a month for students. Same model, about 12x cheaper than @SarvamAI's API and 21x cheaper than @deepseek_ai's own API, for an agent running all month. Sarvam got picked to build India's own model and launched a per-token API. This is what India deserves, built with no grants and no subsidies.
Sarvam got picked by the government in April 2025 to build India's own foundation model. They got a ₹98.68 crore GPU subsidy for 4,096 H100s and raised $234M at a $1.5B valuation in June. Now they've opened Token Factory to everyone. 8 models on it. 1 is theirs. 6 are Chinese open weights (DeepSeek, Kimi, GLM) and 1 is Google's Gemma. So India's sovereign AI lab is mostly serving Chinese models from Indian GPUs. That's a hosting business, and plenty of companies already run one. I wanted Sarvam to be the lab that ships frontier research out of India. After that much capital and subsidized compute, this is not it.

What an enriching @KubeCon_ NA 2026! From the talks: @kubeflow graduation panel @mesheryio ContribFest to speaking at ArgoCon and BackstageCon on AI-powered self-healing, observability, and agentic AI security, to project booths A packed week in SLC. Here's what I was up to 👇

Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me. I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA. I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation. Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO. Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours. Jensen

GPT-6.2 Astra—a frontier model built for your hardest projects. It sets new highs on evals across professional work and scientific research at less than a third of the cost per task of GPT‑6 Astra. You’ll see the difference in things like slideshows, websites, and 3D designs.

Some of you have been asking very politely. Some of you have just been asking. GPT-6.2 Astra and Sol are now available. Super efficient and built to perform where it counts—the real world. openai.com/index/introducing…


We’re expanding free access to our frontier models for up to 200,000 scientists worldwide, with training and support. Applications open Nov. 23. By default, we don’t use data shared through the program to train our models. openai.com/index/expanding-c…
We’re giving scientists, mathematicians, and engineers free access to our frontier models—starting with 10,000 researchers and expanding to 100,000 through 2027. ChatGPT for Academic Researchers is built to accelerate discovery across disciplines.

Today, we release d1.2 and d1.2-ultra, the state-of-the-art omnimodal decision models. d1.2 and d1.2-ultra both can process text, images, and audio with new output capabilities. > #1 on the @ArtificialAnlys Decision Index (75) > Read a value from the input (text, number or date) > Find every passage of a kind in a text (spans) > Locate things in a picture (box for one, boxes for every instance) > Estimate a number (number with a range) > Pick every option that applies (choice) 1/ 🧵

CNCF Project Booths Beyond the talks, the best part of KubeCon is always the people. Loved catching up with maintainers, contributors, old friends, and meeting new faces at the Meshery, Kubeflow, @Kit_Ops , and KServe booths. So many exciting things happening at the intersection of AI and cloud native. Until the next KubeCon! 🚀

ContribFest - @mesheryio One of my favorite parts of KubeCon is helping more developers get involved in open source. At Meshery ContribFest, we focused on helping contributors get started, understand the project, and work toward their first contributions to Meshery

Kubeflow Maintainer Panel A Decade of AI on Kubernetes: Kubeflow's Journey to CNCF Graduation. Joined fellow community members to reflect on Kubeflow's evolution, the ecosystem we've built, and what graduation means for the future of AI workloads on Kubernetes.

LearnKube Day I gave a lightning talk on Edge AI Inference with llm-d From prefill vs. decode and their different compute requirements to why separating and scaling inference workloads matters. I shared a case study showing @Qualcomm_Dev QAIC with llm-d for routing

BackstageCon Talk with @hrittikhere on Your Agent Shouldn't Log in as You: Identity for MCP in Backstage We explored a critical gap in agentic AI security: an agent acting on your behalf shouldn't automatically inherit all your privileges. We walked through identity, authorization boundaries, and task-scoped permissions.