←
Bob Ippolito17,409 posts
Bob Ippolito avatar

Bob Ippolito

@etrepum

@missionbit board member. Former founder/CTO of Mochi Media and Fig. Sometimes enjoys writing code. he/him mastodon.social/@etrepum & bob.ippoli.to bsky

◷ Joined February 2007▧ 366 Photos and videos
Giulio Canti avatar
⟳ Bob Ippolito retweeted
Giulio Canti@GiulioCanti·Oct 28

I'm sick of being forced to design APIs in TypeScript based on how they affect bundle size rather than how I actually want them to work. Now that we can throw almost unlimited tokens at the problem, can we finally have a truly amazing dead code eliminator?

Tim Sweeney avatar
⟳ Bob Ippolito retweeted
Tim Sweeney@TimSweeneyEpic·Oct 18

When I was writing Unreal Engine 1, my time was divided as follows: - Around 30% went to seriously deep coding on hard problems: assembly language texture mappers, C++ BSP trees, data persistence, object oriented systems design, and networking. - Around 70% was just typing and refactoring large bodies of code needed for a complete engine feature set. This was not hard, and while I was doing it my mind was mostly on the deeper coding topics, thinking and planning for what's next. It didn't feel much different from vibe coding today, except that it was just me typing code on an IBM Model M keyboard rather than prompting it and reviewing the results. So, it has always seemed perfectly logical that we would rely on AI for that 70%, once the AI could do it with a similar quality standard as we could, which has never been perfection. It came as no surprise that, after a few years of AI model evolution, it was able to take the reigns on that 70% and free up programmers' time for more valuable tasks. What's more of a surprise is the emergence of AI as a sort of insta-Carmack able to solve hard technical problems quite cleverly and often cleanly, and that it's able to reason about and work in complex 3D scenes both by operating the tools and by directly understanding the raw data files. I abandoned assembly language in 1998 when out-of-order CPUs made much simpler C/C++ code faster, and never I missed it. If prompting through architectural documents, concept art, and design plans can transcend typing code and tweaking vertices, that will enable developers to spend their time on higher-level, higher value technical and creative tasks. What matters is the end product, whether it's a game or an engine. Anything developers can do to try out more ideas and make better software and games faster is a win for everyone.

Matt Slotnick avatar
⟳ Bob Ippolito retweeted
Matt Slotnick@matt_slotnick·Oct 12

everesting on a mechanical Lyft bike is a level of psycho I can’t even begin to comprehend

Post attachment
james hong avatar
⟳ Bob Ippolito retweeted
james hong@jhong·Oct 11

I make this same post like every 2-3 years, because there's always new data further supporting it. Georges Harik (@gharik) is one of the most prescient people in AI, and definitely the least well known and underappreciated one. In 1999 he joined Google as one of the first employees (like #7 or something) because he thought he could use his AI knowledge to build a better ad system. He and Salar Kamangar built Adwords (Salar later bought YouTube and Georges later was the force behind Google wanting to buy Andy rubin's company to build Android) Georges left Google so he could focus on AI research, which he self funded. He did so with someone he worked with closely at Google, our friend Noam Shazeer (they built the AdSense targeting engine). When Google finally decided to work hard on AI around the time of the deepmind acquisition, they tried to get Georges and Noam to come back. Georges wanted to stay independent, and our friend Noam went on to do great things obviously. This was my good fortune because it led to Georges and I hanging out a lot, because he basically needed a new lunch buddy. Georges at the time was working on language models and despite karpathy saying nobody saw LLMs being so big even in 2017, Georges was telling me they were on the cusp of changing everything in 2013. My wife and I literally changed some of our parenting priorities that year (less tigery) because georges convinced me the world was going to change so much. Later on he and I got involved in a company making CV photo filters called Lambda. They needed to make money to survive so they started building ML boxes which Georges bought a bunch of. But his significant other was mad there were so many loud and hot boxes in the house, she started worrying about fire risk, so Georges told the lambda guys they should build a cloud because in the future, the power density of the systems was going to be too big for even most enterprises to handle. This was like 2017. That's how lambda cloud began, and the premise Georges had was that AI was going to change things so much, demand growth would outpace supply growth, and the value of compute was eventually going to rise and that lambda was effectively going to be a REIT... so we should own as many GPUs as possible. It took the world almost a decade to finally figure out what Georges saw then (see attached tweet). About 5 years ago when pretraining was still the only thing people cared about, Georges started telling me inference was going to be super impt. He was working on research investigating post training as a way to improve reasoning. He found some other guys working on the same idea that had a paper known as the STAR paper, and they worked together to prove it even further with another paper called quietstar. (They all later cofounded the neolab humans&). Georges got some friends to build deepinfra.com to be one of the first inference clouds because he saw it all early. He and the humans& team also smartly used all their money to buy compute knowing it would go up in price and also get harder to obtain. It's kind of amazing to me how he has gotten everything right so far ahead of time. It's also amazing to me how VCs don't really get or believe a lot of the things he says, they often tell me I am wrong whenever I parrot Georges' current thoughts... and then years later they all put out charts and papers reaffirming those same things as if they knew it all along. The founders of Google recognize Georges' brilliance and still talk to him a lot. (Besides being smart, he is a lot of fun to hang out with.) I'm just wondering when the rest of the world figures it out

I can't emphasize enough how important this @a16z chart seems and how few have internalized it.

Post attachment
Bob Ippolito avatar
Bob Ippolito@etrepum·Sep 30

if any bay area startups are looking for a board advisor who is legitimately "too lazy to go work for [competitor]", hmu

Matt Redmond avatar
⟳ Bob Ippolito retweeted
Matt Redmond@mttrdmnd·Sep 17

Got married in the park (in a bicycle parade) last weekend and @peterhartlaub put together such a lovely article about it! sfchronicle.com/totalsf/arti…

Matt Slotnick avatar
⟳ Bob Ippolito retweeted
Matt Slotnick@matt_slotnick·Sep 13

we need more tech sponsorships in pro cycling 1993-1994’s WordPerfect–Colnago–Decca

Post attachment
Bob Ippolito avatar
Bob Ippolito@etrepum·Sep 10

Let me verify the new tests are load-bearing, then run everything: Verified each new test is load-bearing All four load-bearing.

Bob Ippolito avatar
Bob Ippolito@etrepum·Aug 24

Sending an agent to create open source PRs without a human in the loop responding to review comments feels like such a weird and anti-social thing to do. I kinda wish there was something worthwhile for me to spend their tokens on

Rick avatar
⟳ Bob Ippolito retweeted
Rick@rickasaurus·Aug 13

Flash was absolutely amazing, the effort to quality ratio for flash was astounding and only even approximated by what we get now with AI

Dark,Odd,Conspiracy @DarkOddCon Aug 12

Post attachment
Danielle Fong 🔆 avatar
⟳ Bob Ippolito retweeted
Danielle Fong 🔆@DanielleFong·Jul 9

normalize reaching out to old people who are legends in their filed, but retired. they love that shit

Bob Ippolito avatar
Bob Ippolito@etrepum·Jul 4

Fable can be great I guess, but it feels like a less intelligent model because it's so slow. Most of the time it's still writing incorrect code, but with a much slower review loop. If the tokens weren't subsidized I probably wouldn't bother with it.

Mitchell Hashimoto avatar
⟳ Bob Ippolito retweeted
Mitchell Hashimoto@mitchellh·Jun 17

Creator of Sqlite on pull requests: "You say, oh, it's free. No. It's not free. What you're doing is asking me ... to maintain it for you, to to document it for you, to test it for you, to maintain it for you for the next 25 years. That's not free." Yep. Wise words from a wiser man than me. I've told people for the past decade and I have recent posts on here saying the same: the merge button is the easy part. Its the decade+ (Richard says 25 years) that follows where you've accepted the transfer of maintenance thats hard.