←
Column Tax148 posts
Column Tax avatar

Column Tax

@ColumnTax

Building the future of personal income tax APIs. Also hiring: jobs.columntax.com

◷ Joined April 2021▧ 57 Photos and videos
Michael R. Bock avatar
⟳ Column Tax retweeted
Michael R. Bock@michaelrbock·Jul 16

1/ I've been building tax software for >5 years. Here's where AI is still making mistakes filing tax returns: GPT-5.6 Sol (with web search) is the best-scoring model we've tested on TaxCalcBench v2. It calculated 58% of 50 hyper-realistic federal & state tax returns perfectly.

Post attachment
Michael R. Bock avatar
⟳ Column Tax retweeted
Michael R. Bock@michaelrbock·Jul 7

1/ This AI benchmark will decide Intuit's stock price next year. Last year, I released TaxCalcBench, and it moved markets. Here's how:

Post attachment
Michael R. Bock avatar
⟳ Column Tax retweeted
Michael R. Bock@michaelrbock·Jan 7

Claude Opus 4.5 (w/ Claude Code) is known as the best coding model today, but which model is the best at filing taxes? We, at Column Tax, tested the latest crop of frontier models and here's how they stacked up on TaxCalcBench: - GPT-5.2 Pro: 41.18% fully correct returns - Gemini 3 Pro: 36.27% fully correct returns (but strongest at other more-lenient metrics) - Claude Opus 4.5: tied at 36.27% - GPT-5.2 (not Pro): 33.82% Note: today, GPT-5.2 Pro is _very_ slow and _very_ expensive.

Post attachment
Michael R. Bock avatar
⟳ Column Tax retweeted
Michael R. Bock@michaelrbock·16 Dec 2025

1/ After 5 years, I’m proud to share that @ColumnTax has found a new home. We’ve been acquired by @AiwynAI. I couldn’t be more sure this is the right move for our business, tech, and team. These pics are the moments we started & sold the company:

Post attachmentPost attachment
Column Tax avatar
Column Tax@ColumnTax·16 Dec 2025

Big news: Column Tax has officially joined @AiwynAI. Over the past five years, Column has become the fastest-growing tax platform in U.S. history, filing over 1 million returns and powering tax experiences across the country. We started Column Tax to make tax filing easy for all Americans. Joining Aiwyn allows us to scale that vision even further. Aiwyn works with more than 800 of the top accounting & tax firms in the U.S., and together we’ll continue building and expanding the tax engine of the future across the ecosystem. This milestone belongs to a lot of people. To the Column team: thank you for taking on a complex, often invisible problem and building something real and lasting. Your discipline, care, and persistence made this possible. To our partners and customers: thank you for trusting us with one of the most important financial moments in people’s lives. Your feedback shaped the product, and you pushed us to raise the bar every year. To our investors and advisors: thank you for believing in this vision early and supporting us through the many challenges that come with building in this space. We’re excited for what comes next.

Post attachment
Michael R. Bock avatar
⟳ Column Tax retweeted
Michael R. Bock@michaelrbock·18 Nov 2025

It's an amazing time to be working on vertical-specific AI tools: we are at the edge of industry progress and inventing new paradigms. There aren't yet playbooks or standards. For the right type of person, it's a lot of fun! I had a great time sitting down with @AnneliesGamble for this interview about TaxCalcBench and how it generalizes to the AI industry as a whole:

Benchmarks are the operating system for product truth. But most generic evals miss the factors that actually determine success in real-world verticals: domain rules, tool use, multi-step workflows, and the need for auditable, line-item-level correctness. This week, I sat down with @michaelrbock, CTO & co-founder of @ColumnTax, to unpack why vertical benchmarks matter, how they built one for the tax industry (TaxCalcBench), and how other founders can adopt similar playbooks across their own verticals. Some takeaways: ➡️Even top frontier models compute fewer than one-third of tax returns correctly under strict criteria. ➡️Models that look strong in best-of-N settings often become inconsistent when run repeatedly, a sign of how fragile model reasoning still is. ➡️The right benchmark can guide technical strategy, like Column Tax’s decision to double down on developing Iris, their tax-development agent. ➡️Vertical evals compound into moats: they encode data quality, edge cases, domain rules, and institutional knowledge directly into code. As Michael put it, “If you’re building any sort of AI or agent-based functionality, you need an eval – full stop. Building an agent without an eval is like trying to drive a car blindfolded.” Accuracy-critical industries demand proof. Vertical benchmarks are how you build that proof. They are the quality gate every prompt, model, or agent must clear, and the foundation for delivering systems that work consistently in the messy, high-stakes reality of the real world.

Post attachment
Annelies Gamble avatar
⟳ Column Tax retweeted
Annelies Gamble@AnneliesGamble·18 Nov 2025

Benchmarks are the operating system for product truth. But most generic evals miss the factors that actually determine success in real-world verticals: domain rules, tool use, multi-step workflows, and the need for auditable, line-item-level correctness. This week, I sat down with @michaelrbock, CTO & co-founder of @ColumnTax, to unpack why vertical benchmarks matter, how they built one for the tax industry (TaxCalcBench), and how other founders can adopt similar playbooks across their own verticals. Some takeaways: ➡️Even top frontier models compute fewer than one-third of tax returns correctly under strict criteria. ➡️Models that look strong in best-of-N settings often become inconsistent when run repeatedly, a sign of how fragile model reasoning still is. ➡️The right benchmark can guide technical strategy, like Column Tax’s decision to double down on developing Iris, their tax-development agent. ➡️Vertical evals compound into moats: they encode data quality, edge cases, domain rules, and institutional knowledge directly into code. As Michael put it, “If you’re building any sort of AI or agent-based functionality, you need an eval – full stop. Building an agent without an eval is like trying to drive a car blindfolded.” Accuracy-critical industries demand proof. Vertical benchmarks are how you build that proof. They are the quality gate every prompt, model, or agent must clear, and the foundation for delivering systems that work consistently in the messy, high-stakes reality of the real world.

Post attachment
Column Tax avatar
Column Tax@ColumnTax·4 Nov 2025

Taxes will be automated. It’s a matter of time, expertise, data, and effort — and we’re working hard to be the group to do it.

Post attachment
Column Tax avatar
Column Tax@ColumnTax·4 Nov 2025

Now, with the latest breakthroughs in AI and our proprietary tax datasets, we have line of sight to one-click tax filing.

Post attachment
Michael R. Bock avatar
⟳ Column Tax retweeted
Michael R. Bock@michaelrbock·29 Oct 2025

How will we know that AI has really “made it”? The task that most exemplifies our ability to automate knowledge work is “doing your taxes”. At Column Tax we’re now within line of sight to fully automating taxes. We started the company at the perfect moment, with LLMs just on the horizon. And now the combination of the latest AI progress and our expert team & large proprietary eval datasets means we’re the group that can finally fully automate tax filing and save people time & money. We’re so confident that we’re publishing an internal roadmap document: our “secret” master plan to automate tax filing (just between you & me).

Post attachment
Column Tax avatar
Column Tax@ColumnTax·21 Oct 2025

At Column Tax, we believe infrastructure is foundational and helps shape trust, experience, and reliability. At the end of the day, great infrastructure isn’t just about uptime — it’s about helping people have a great experience with the product.