1/?) As promised to Sander Dieleman (@sedielem), we’re finally excited to share:
Towards Closing the Autoregressive Gap in Language Modeling via Entropy-Gated Continuous Bitstream Diffusion
We show that continuous diffusion can achieve very strong language modeling performance when operating directly on bitstreams, outperforming masked and uniform diffusion baselines, and essentially matching autoregressive models under our evaluation settings.
re "openness in AI" discussion: there is a lot of talk about the importance of open-weight models. I want to highlight another topic: openness of APIs.
LLM-access APIs were traditionally mapping in a relatively straightforward way to what is actually sent to the LLM: a sequence of messages, each with a different role, and each call specified the exact sequence. this gives both some level of transparency into the underlying model, and also a level of control of our interaction with the LLM.
both Anthropic and OpenAI are attempting to transition into alternative APIs, ones where the session state is managed on the server. currently they support both versions, but i predict a not-so-distance future where they will be deprecating the old APIs and leaving us only with the new ones.
this will add a layer of obfuscation between us (the API users) and "the AI" (no longer just an LLM, we will now communicate with an opaque system). This will be very bad for science, engineering and progress around AI: we (the public, the research community, the builders) will have much less visibility into what is actually being run, and also much less control on where we can intervene. this means research on agentic-harnesses and context management, for example, will be practically impossible.
this is a bad outcome. we should be able to resist it, or at least to loudly signal against it. i think it is as important as supporting open-weight models, if not more.
how do we organize around this cause?
🧵Some people claim autofiction isn't really literature if it describes facts.
Memory is not equal to writing.
Else anyone could write.
There are many facts in the world and life; memory chooses some of them and everyone has different important ones.
1/n
Latent diffusion needs no decoder😵
New paper: DWD, a linear head on DiT predicts pixels directly
• Same or better quality on every tested latent model, less flicker in Wan video
• Even pixel models improve: ImageNet FID 1.55 ➡️ 1.43 (pixel SOTA), photorealistic texture in T2I
Evaluating generative models can be subtle.
Ever more so for domains for which human intuition is less effective, such as tabular data.
We worked on an eval package and benchmark for generative tabular models: we hope these will be helpful for the community.
tabgen-eval : github.com/granica-ai/tabgen…
tabgen-bench : github.com/granica-ai/tabgen…
Excited to share Energy-Based Reasoners (EBRs)!
EBRs reason by taking gradient steps on a learned energy function. When the gradient gets small, it stops. With just 1.8M parameters, it solves 99.9% of Sudoku-Extreme puzzles!
energy-based-reasoners.githu…
Bye bye looped reasoning… and hello Energy-Based Reasoners (EBRs)⚡!
Your looped reasoning model would be better off as an energy-based model (EBM)...
TLDR:
EBRs uses 345x less inference compute and 2.6x fewer training FLOPs than the best baselines
EBRs are 7x-43x more sample efficient than the best looped baselines at inference.
EBRs achieve 99.9% on Sudoku-Extreme
EBRs achieve near 100% accuracy on multi-solution benchmarks
🧵Thread:
I believe the @nvidia board is not acting in the best interest of shareholders nor in a manner consistent with their fiduciary duties.
What we know is that the board fired Jensen or forced his resignation for violating company policy and/or in response to the accusation of an affair with a spy.
They did so without careful consideration of the impact on the company, its customers, its shareholders or other stakeholders.
They rushed to judgment without the benefit of careful due diligence or even with a basic understanding of the facts.
How do we know this?
We know this by how quickly Jensen was fired and how little was known at the time of his firing.
It takes time to convene a board meeting. There was time, maybe, for one Zoom.
And this is a decision that should have been made by a board sitting in person and carefully deliberating the facts once they are known.
And they should have slept on the decision and met again the day after to discuss the facts, the risks and the other implications of their decision.
The timing and lack of information did not allow for careful board deliberation.
While boards can fire a CEO for an inappropriate relationship with a subordinate, it should not be an automatic decision. That is why we have boards comprised of humans and not agents.
A board should consider whether or not such a relationship was consensual or whether it was an abuse of power dynamics. And a board has to consider what the impact of the firing is on all stakeholders.
If I were in this board, I would not have rushed to judgment based on articles in the media. I would have made sure the board had all of the facts so it could make a careful and informed decision.
Boards of Delaware companies have a duty of care which means they must make informed, prudent and good faith decisions. This clearly did not happen here.
What law firm is advising this board?
Or is the board even taken good legal advice?
It doesn’t look like it.
And now the board is compounding its failures by insisting that there is no possibility for Jensen’s return as CEO.
Why is it in the best interest of the company to foreclose the possibility of Jensen’s return and to do so before all of the facts are known? This is yet another breach of their duty of care.
Furthermore, the board has launched an investigation whose scope is unknown. Investigations can be extremely damaging to a company and should be carefully targeted to address whatever facts need to be known rather than be overly broad in scope.
In short, this looks like a series of major governance failures by directors that panicked due to headlines in the media. They likely felt compelled to do something because they were afraid of looking bad in the media, not because it was the right thing for them company.
They couldn’t stand the heat.
The board’s conduct here is shocking for a company of this scale and importance to our country and the world at large, particularly at this moment in history.
Can an image generator learn its own hierarchy of abstractions without a separately trained encoder?
Meet HiT. Trained end to end from pixels, it learns to dynamically group patches across multiple levels—and semantic structure emerges without masks or region labels.
Check our video below: background collapses into a few groups, the main subject gets many, and words light up the regions they refer to!
It also gets 1.48 FID on ImageNet 256, uses 2.4× less training compute than JiT-H/16 at matched quality, and outperforms models with 6× more parameters on average across text-to-image benchmarks.
Website, paper, and code below, followed by how it works and what emerges 🧵
Very very very very VERY important!!!
Jensen is absolutely necessary for open source, for startups/neolabs, and for the world
Of course, mistakes have been made, and im hopeful jensen can learn from these events
but please bring him back!
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me.
I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA.
I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation.
Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.
Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours.
Jensen
We have an open faculty position @EPFL_en joint between Physics and Computer Science. If you are doing outstanding work in any intersecting area (e.g. ML4Science, Quantum Computing, etc etc.) please consider applying! epfl.ch/about/working/joint-…
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me.
I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA.
I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation.
Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.
Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours.
Jensen
I have the feeling that for semi-specified math problems models aren't improving, maybe they are even getting worse.
I am quite disappointed by Astra. It made an absurdly incorrect assumption and then proceeded as if that was the original problem definition.
Fascinating observation from the researchers behind the world record for the fastest matrix multiplication algorithm:
AI struggles to understand its own mathematical reasoning, but becomes much better at building on its ideas when humans simplify them.