
We spent about 13,000 GPU-hours on RSI Arena, tested the models on 20 benchmarks, and collected 3,129 human votes across two rounds. What stayed with me was how much we learned once people tried the models. At Bake AI, we worked with researchers from @huggingface, @NVIDIAAI, @scale_AI, @Stanford, @MIT, @UCLA, @ucsantabarbara, @nyuniversity, @UW, and @NotreDame We gave 10 AI agents the same base model and a shared 64-GPU cluster. They picked the data, wrote the code, and trained their own assistants. People at @COLM_conf and online compared the answers without knowing which model wrote them. We gave the first round’s feedback back to the agents and let them decide what to change. After another training round, eight of ten improved their human ratings relative to NVIDIA Instruct. Those gains did not track benchmark improvements. The agents could do the engineering. People helped show them what needed fixing. That’s what this experiment taught us about RSI. AI can take on more of its own development, but our experience with it still matters. If these systems keep getting better, they should help us work better, live better, and spend more time on what we care about. Otherwise, what is all that compute for? 📄 RSI Arena: Towards Recursive Self-Improvement with Human Feedback

































