←
Michael Timbs24,102 posts
Michael Timbs avatar

Michael Timbs

@michael_timbs

Software Developer, 積読, Que sais-je? building @bourd_dev

◷ Joined November 2015▧ 1,409 Photos and videos
Michael Timbs avatar
Michael Timbs@michael_timbs·9h

training LLMs is tricky because you can focus too much on one objective and destroy performance on another. Astra 6.2 is a good example of this. If you compare general math ability from GPT3 to Astra6.2 there is noticeable improvement, but it came at the cost of 4chan greentext ability. Hard to say if the model got better overall or just different

Michael Timbs avatar
Michael Timbs@michael_timbs·19h

imagine shitposting from here.

Selling Oculus to Facebook in 2014 gave me money for helicopter flight lessons and developing a seastead called SLAB with a 1,000 year design life. The goal was to be cheaper than land and absent state/local laws that cripple critical American industries like metal processing, medical research/treatment, desalination, oil refining, chemical engineering, and more. Me and a few close friends cashed it up at a $1B valuation back in 2017, and while it still has a long way to go, there has been significant progress towards my goal of reviving manifest destiny and westward expansion. At a time when most of the seasteading community wanted to escape the US and smoke pot, this was the one project explicitly designed to make America stronger, a relief valve for ill considered or outdated rules and regulations. I am only talking about it now because a few media outlets got wind of me and some friends topping up the coffers and plan on calling SLAB my new floating AI datacenter project. It is way cooler than that, way older than that, and I hate looking like a hype-chasing consensus loser, so now you have to read this tweet.

Post attachment
Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 17

good video that drives home the point that the purpose of these companies is fraud. they exist to syphon money from the government and everything else is only incidental to that.

WATCH: The U.S. showcased next-generation warfare capabilities during an exercise in Germany, launching a drone swarm from an unmanned ground vehicle.

0:40
Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 17

Quantum computing is one of these things that sounds really complicated and hides behind notation and jargon but is conceptually quite simple to grasp and you only need high school level math to be able to understand what’s happening.

Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 17

argon is a tough model to judge because i gave it one task and its still cooking and i don't know when it will finish but its been several hours now. i dont know whether to just stop it or let it ruin my life at this point

Post attachment
Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 15

the problem with this is computers cannot act autonomously. They can only be wielded and directed by humans. So all "AI alignment" can ever be is human alignment. The only way to "control" AI is to control who has access to it and what they can do with it.

roon@tszzlNov 15

because you’re a monke the threat of other monkes taking power is more legible to you. the threat of computers acting autonomously will never make sense to your emotional mind. you have to be calculating about it

Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 15

Victoria is the greatest place on Earth because you can have 3 people break into your home (regular occurrence in Vic) and then the next day the cops come around and arrest you because one of them died from injuries sustained while robbing you.

Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 15

these API safeguards are getting really tiresome. Any generic science seems to trigger it these days.

Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 13

“under random-matrix-like assumptions on the Hessian, the fraction of critical points that are local minima becomes exponentially small” said frog “But many real fitness landscapes violate that assumption” said toad That is true said frog

Post attachment
roon@tszzl10 Jun 2021

the greatest whitepill of all is that local minima are rare in high dimensional spaces

Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 13

You can fake progress for a pretty long time just moving along the pareto front. You can’t fool everyone though.

Polly Norinco avatar
⟳ Michael Timbs retweeted
Polly Norinco@yesokyeahsure·Nov 11

He got ball cancer while working at Baidu and had his balls removed That’s why he hates China and most of humanity

When I spoke to an Anthropic employee who invited me to their HQ for a "Christian leaders" gathering, they told me that when they hear Dario speak about morality, they often cry. That was one of the key moments I realized I was out. If you watch this man speak and are moved to tears, you probably need to talk to a psychologist. And you should not be in a position of power at any frontier lab, because we need anti-mimetic brakes on the spreading of psychosis.

Michael Timbs avatar
Michael Timbs@michael_timbs·Nov 11

The bear case for formal verification is that "Here is a reusable library of properties/specs you can import in your code" is the default, cargo culting, nonsense that leads to bad software systems in the first place

The bull case for formal verification is "Here is a reusable library of properties/specs you can import in your code" not "Here is a few million LOC of Lean for you to go over, but the model passes!"