←
Sunny Bains @TiDB4,897 posts
Sunny Bains @TiDB avatar

Sunny Bains @TiDB

@sunbains

swe@PingCAP - The company behind TiDB. Oracle/MySQL/InnoDB team lead in a past life

◷ Joined April 2012▧ 184 Photos and videos
Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·53m

This is a 12 year old server, DDR3 RAM, Xeon 2690 V3, the cloud has lowered our expectations.

Post attachment
Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·2h

A good library of basic building blocks pays off. Read every line of it, and make it as correct and performant as you can. Normally you’d just reuse it in other projects. I point the agent at the library and have it pull code and idioms from there to build something new. So far it’s working really well for me.

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·2h

I've always been fascinated by live patching , if I don't try it with the help of LLMs it will be a crime.

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·4h

The Micron NVME-oF work is quite impressive. It's quite illustrating, there is a lot I don't know when I read them.

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·4h

Current performance is 80% of raw/local disk performance. My target is to keep it above 95%. I'm going to combine the two, the backend will be the same, an optimized KV block store with optional direct pass through (TBD), different front end protocols. The iSCSI is already doing real work in my homelab. In hindsight good decision to start using it because I encountered a lot of bugs. I'm sure there are plenty more but this is probably the best way to find and fix them.

TIL iSCSI and NVME-oF are mostly KV block stores once you get past the front end protocol.

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·22h

TIL iSCSI and NVME-oF are mostly KV block stores once you get past the front end protocol.

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·Nov 17

Make it work, make it correct and then make it fast with LLMs becomes make it work and correct in one pass then make it fast. My time is spent mostly in the make it fast.

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·Nov 17

The fun in writing and using your own system software is that you can customize it to your needs. My EBS service over iSCSI seems to work well enough in my preliminary use case. Then I realized I don't need redundancy everywhere, it should start with a single disk and allow me to add or drop disks (if it's safe to do so). And it should be doable from my control plane, works well enough.

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·Nov 16

In my wildest dreams I could not have built a control plane for my EBS service that can do all this. I can even zoom in on hotspots and examine it at sector level detail, auto discovery ... time to put it to serious use.

Post attachment
Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·Nov 15

The only real test for all this vibe coded software is to start replacing the software In my homelab. First candidate that is emerging is the iSCSI (EBS style) storage.

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·Nov 14

I introduced a performance issue before pushing it. There is an unnecessary thread hand off that I added while fixing another issue :-(

Sunny Bains @TiDB avatar
Sunny Bains @TiDB@sunbains·Nov 13

If and a big if I can get it to work reliably I will open source it. I'm guessing it's a common problem. I hate paying cloud providers for shit like this.