←
HashtagsPublic conversations
PUBLIC CONVERSATIONS

#serverless

Read the latest public tweets for a hashtag.

20 tweets on this page for “#serverless”

Dr. Ganapathi Pulipaka 🇺🇸 avatar
Dr. Ganapathi Pulipaka 🇺🇸@gp_pulipaka·6h

Buying Tokens vs Building an AI Factory! @samcharrington #bigdata #analytics #ai #machinelearning #datascience #ai #iot #iiot #python #rstats #tensorflow #javascript #reactjs #cloudcomputing #serverless #datascientist #linux #programming #coding #100daysofcode An AI agent can make many model calls to finish a single job. Some need frontier reasoning. Others can run on an open-weight model, and some involve data that has to stay in-house. How do you decide which inference to buy and which to run yourself? Sadeepa Wijesekara, who leads engineering for HPE Private Cloud AI, joins Sam Charrington to discuss how enterprises make those decisions. They get into what it takes to see the cost of individual calls, how teams route work between hosted and local models, and when running your own GPUs makes economic sense. Sadeepa shares how HPE routes coding requests through a single internal endpoint that can send work to a frontier provider or serve it locally. Chapters 00:00 - Intro 01:42 - Why agent workloads are driving up token bills 04:27 - Measuring agent value by business outcome 06:37 - Token budgets and smarter model choices 09:14 - Rule-based versus automated model routing 11:07 - Making token spend visible at the agent and call level 16:06 - Workload placement across hosted and local models 18:11 - Standing up on-prem inference 20:00 - GPU selection, scheduling, and utilization 24:38 - Building your own infrastructure versus buying a platform 26:39 - Layered security for autonomous agents 30:48 - OpenShell, access controls, and hardware attestation 33:25 - Enterprise readiness and agent compliance 37:02 - Inside HPE’s hybrid AI factory 40:27 - Sizing and scaling internal inference capacity 42:15 - Comparing inference costs and protecting sensitive data 48:55 - Customer deployments: sovereignty, manufacturing, and shared inference 54:02 - Moving from token-cost controls to measurable ROI 56:34 - What’s next for agent security - Sam Charrington

Cheaper tokens can still mean a bigger AI bill. An agent can need dozens of model calls to finish one job. Which calls are worth paying a frontier provider for, and which can you run yourself? I get into that with Sadeepa Wijesekara of @HPE on the latest @twimlai episode.

1:45
M.O avatar
M.O@Encrypt_ed·13h

AWS Lambda Managed Instances now scale to zero. Set MinExecutionEnvironments to 0 and Lambda drops idle execution environments on your EC2-backed capacity, then provisions them again when requests arrive. EC2 pricing, no idle floor. #aws #serverless aws.amazon.com/about-aws/wha…

Show more tweets