paper 3, more LOB trading: RL takes on handcrafted signal execution
i've repeatedly seen the authors names on good papers: Nagy et. al
arxiv.org/abs/2301.08688
the results (vs baseline) were the best i've seen so far
note: both strategies get the same synthetic signal - this tests signal execution
the details🪡:
1/24
Today we are happy to share one of our first open research releases: Latent Sparse Attention (LSA), a step towards subquadratic attention that matches accuracy of full attention at ultra-long context.
Sparse attention attends to only a few tokens per query, but it has to find the right ones. At 10M tokens, that search takes 98% of the attention layer's time. LSA makes sparse attention up to 22.7× faster and full attention 72.4x faster.
With @kubicek_ales@caciolai@PengLiangzu@SukritSumant@Ben_Hoov@FraserGreenlee@RMBattleday@radim_urban@thoefler@jcrwhittington
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weigh…
Samani @samani_ Oct 28 Article 10K+ qualified leads in 47 seconds: Our automated sales pipeline We recently built an AI sales pipeline at Agenix AI that's helped us qualify over 10,000 leads. It can research a new lead, decide whether they're worth pursuing, and initiate a personalised AI phone
running this lil study. was supposed to release the details as an Article (i literally wrote & finished it)
but a minor tweak & the edge still might be in tact - will release it for readers to up-cycle if it's faded
Two weeks ago a life changing amount of money was wired into my bank account from the sale of my business.
Since I'm no longer a competitor in this particular arena, I'm gonna drop some sauce on how I completely mogged an entire industry on meta ads.
I'm going to be vague so I don't dox myself, but here it goes:
been waiting for this news to break for a while
when i heard that Ed had shifted focus from the lab to a venture of his own, i knew it would be smth ridiculous
this one is going to be exciting to follow
Today we’re out of stealth, and we’ve raised a $40m seed round co-led by @creandum and @usv, to bring Instant Robot Learning to life.
For the past few months, we‘ve been busy building a new company.
Machenta.
This follows results from a new kind of robot foundation model we’ve built, which I’m so excited to share with you today!
Usually, it takes hours/days of data collection and training to teach a robot.
We’ve built a model that learns tasks instantly: one demonstration, no further training.
A model trained entirely in simulation, without a single pixel of real-world data.
A model where teaching robots is so quick and easy, it feels like physical vibe coding.
A model for robots that learn like humans do, from someone like you.
Welcome to the era of Instant Robot Learning.
Thank you @Kathi_Wilhelm, @rebeccakaden, @hkanji, @jonno_evans and all of our angels for your support!
@Machenta_
Learn more: machenta.com/blog/instant-ro…
See below for what you can do with Instant Robot Learning!
mech-interp for control - does this field even exist? or is that already covered by the physics-informed ML literature
please send recs if you're aware of anything in this area
takeaways:
>RL might actually be a viable means for trading signal conversion
>PER hurt in this noisy this setting; could priorities separate informative errors from irreducible noise? speculative, but interesting
-Duelling Double arch?👀 ablation on what each part contributes could be interesting
24/24
>comparison vs dedicated algos needed for full picture of advantage gained by using RL
>fees, latency & indirect impact deserve more investigation imo - agent acts suspiciously aggressively
>parameter study required to test sensitivity to them (highly prone?)
23/24
- RL model "skipped" (didnt trade) almost double in a=1.3 compared to a=1.1 (??)
- most sells were at the bid (aggressive). at a=1.3, buys were roughly split between midpoint & ask
these are limit-order choices; some are immediately marketable. not skipping doesn't guarantee an order is placed if inventory constraints block it
6. Improvements:
>more investigation is needed (2 train-test periods not enough?) to test consistency
22/24
- used an APEX-style async setup to collect parallel experience
> uniform sampling worked better than PER here: prioritisation repeatedly focused on highly noisy transitions
- mean episode return & box-plots of trade-turnover provided
21/24