←
Alex Alemi67 posts
Alex Alemi avatar

Alex Alemi

@alemi

Machine Learning Researcher

◷ Joined January 2008▧ 4 Photos and videos
Alex Alemi avatar
Alex Alemi@alemi·4 Mar 2025

Recently I've been playing around with a quarter-order-of-magnitude system for simple calculations. It gives better precision than single sig-fig calculations using only four, very intuitive, symbols. blog.alexalemi.com/quarters.…

Post attachment
Noah Constant avatar
⟳ Alex Alemi retweeted
Noah Constant@noahconst·5 Apr 2024

Ever wonder why we don’t train LLMs over highly compressed text? Turns out it’s hard to make it work. Check out our paper for some progress that we’re hoping others can build on. arxiv.org/abs/2404.03626 With @blester125, @hoonkp, @alemi, Jeffrey Pennington, @ada_rob, @jaschasd

Alex Alemi avatar
Alex Alemi@alemi·13 Mar 2023

PaLM 540 Billion, Google's large language model used 4.2 moles of flops to train. 4.2 Moles!

Ravid Shwartz Ziv avatar
⟳ Alex Alemi retweeted
Ravid Shwartz Ziv@ziv_ravid·23 May 2022

A pretty cool paper (and I also hope useful) on using pre-training models to create highly informative priors for downstream tasks. Thanks to all the collaborators, it was a lot of fun!

Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priors. arxiv.org/abs/2205.10279 w/@ziv_ravid, @micahgoldblum, @HosseinSouri8, @snymkpr, @Eiri1114, @ylecun 1/6

Post attachment
Ethan Dyer avatar
⟳ Alex Alemi retweeted
Ethan Dyer@ethansdyer·1 Jul 2022

1/ Super excited to introduce #Minerva 🦉(goo.gle/3yGpTN7). Minerva was trained on math and science found on the web and can solve many multi-step quantitative reasoning problems.

Post attachment
aitor@alewkowycz30 Jun 2022

Very excited to present Minerva🦉: a language model capable of solving mathematical questions using step-by-step natural language reasoning. Combining scale, data and others dramatically improves performance on the STEM benchmarks MATH and MMLU-STEM. goo.gle/3yGpTN7

Post attachment
Chitwan Saharia avatar
⟳ Alex Alemi retweeted
Chitwan Saharia@Chitwan_Saharia·24 May 2022

We are thrilled to announce Imagen, a text-to-image model with unprecedented photorealism and deep language understanding. Explore imagen.research.google and Imagen! A large rusted ship stuck in a frozen lake. Snowy mountains and beautiful sunset in the background. #imagen

Post attachment