Pleased to announce the release of Splink version 4.0.0 today. It's now:
👩🔬 Easier to use
🚀 Faster
⚡ More scalable
🛠️ Easier to improve
For the uninitiated, Splink is a free library for record linkage and deduplication at scale
See 🧵 for links and more
1/3
A productive day in the big data mines today. Got the Real Journey Time tool working for the whole of England. A year of bus tracking, here's Hull to Bransholme. And what this does to the effective size of the city by public transport.
I don't have a problem with this - code is simply a very efficient mechanism for communicating specific, complex ideas.
But if you do want to use it out-of-the-box, and benefit from continuous improvement, it's here: github.com/moj-analytical-se…
AI is changing the contribution made by open source: the value is shifting away from the code and towards the ideas. The methodological advancements in uk_address_matcher have been adopted quickly, including by commercial tools, but often re-implemented by reference to our code
Ok I hope this will be the most useful conversation you hear about Education this year.
This week’s episode of The Amol Rajan Connection (ARC) with @daisychristo of No More Marking has really struck a chord.
Anyone with kids; or who works in schools, colleges and universities; or who is interested in the very nature of learning and how the mind works; or what technology is doing to us, will enjoy this. That’s not my view alone; it’s the revealed view of the comments flooding in.
We discuss:
+ working memory vs long-term memory
+ the risk of creating a Stupidogenic Society
+ why Knowledge is Freedom
+ schools for the rich and skills for the poor
+ how to optimise vocational education
+ the implications of AI for education
+ what children should learn
+ technology and the classroom
+ Labour’s education policy
Something for your weekend perhaps.
We’d be honoured if you’d others listening to this episode.
Thanks so much for your time - and to Daisy, for a very special contribution to the ARC Universe.
Available on YouTube, Spotify, Apple Podcasts and Amazon Music.
youtu.be/Xcyc3LQkqjY?is=VRY_…
🦆 Announcing DuckDB 2.0.0 LTS “Cinnamon Teal”
We are proud to release DuckDB 2.0.0, named after the cinnamon teal (Spatula cyanoptera), a striking reddish-brown duck found in the western Americas. 🌎
DuckDB 2.0.0 is the biggest DuckDB feature release so far. It ships a polished version of the Quack protocol, which turns DuckDB into a full-fledged server. It improves performance and lowers costs through supporting asynchronous I/O, a first-class VARIANT type, and a dedicated “agent mode”. It also empowers extension developers with a new SQL parser that allows adding new statements, clauses, and keywords, a new API to build on, and a new mechanism to distribute extensions more easily.
In our announcement blog post, we summarize the highlights and then walk through the key changes and give guidance on how to migrate to 2.0. For the complete release notes, see the release page on GitHub.
duckdb.org/2026/10/21/announ…#DuckDB
New blog: Data Science in the Age of AI robinlinacre.com/data_scienc…
LLMs are the biggest shakeup to the profession I've ever experienced. The post uses examples to look at how the job has changed and how to use agents effectively.