←
Mackross597 posts
Mackross avatar

Mackross

@mackross

close friends & family. technology. investing. taking things from zero to one. the unbeaten path.

◷ Joined April 2009▧ 22 Photos and videos
Mackross avatar
Mackross@mackross·Oct 13

cf-danger: I had my agent write a new cli utility that wraps cf (the new cloudflare cli). The wrapper forces agents to specify mutating production tasks in advance, and then does a lot of best effort checks to ensure that an agent doesn't accidently do something dumb. it uses clef to ensure tasks are well specified. it checks for unseen linked files and gets the agent to give the full context. if it can do a dry-run it does. all outputs are checked and verified by clefs second set of eyes along with common sense rules. if it decides the command is too dangerous, it pushes the agent to check with human , review its approach, or triple verify what its doing (can be disabled).

signüll avatar
⟳ Mackross retweeted
signüll@signulll·Sep 6

modern travel is increasingly flying 10 hours to experience a slightly different version of the same globally optimized lifestyle. same third wave coffee. same natural wine bar. same brutalist menu. same sourdough. same beige hotel. same tasteful ceramics. same instagram lighting. what a ridiculous convergence.

Mackross avatar
Mackross@mackross·Aug 31

blown away by GLM 5.3-flash on local hardware. future is getting weird. also not sending data into us tech co's feels amazing.

Patrick Collison avatar
⟳ Mackross retweeted
Patrick Collison@patrickc·Aug 30

Overall, I’m very surprised at how little media coverage there’s been around the OpenAI / Hugging Face attack. It’s clearly one of the most important things to happen this year.

Mackross avatar
Mackross@mackross·Aug 7

I think it’s probably safest we all assume some portion of our private IMs, emails, recorded calls, search histories, and AI conversations are made public or sold to bad actors in the next few years. #ai #hackz

Mackross avatar
Mackross@mackross·Aug 2

I guess all of us are now strapped on to this one way rocket 🚀 keeping my fingers crossed for humanity

Mackross avatar
Mackross@mackross·Jul 28

The AI catch 22 support loops are hell on earth. Stuck in one with @RobinhoodApp but they’re far from the only company with dead end support processes. When I eventually was able to get escalated from AI to a human, the interaction was just as bad; case was misunderstood and close. Trying computer use this time. Maybe AI-AI will be the default way to get support.

Mackross avatar
Mackross@mackross·Jul 9

New GPT-live is unreal for second language practice. The last version was useful, but this one is phenomenal.

Mackross avatar
Mackross@mackross·Jun 11

Fable is better but still kinda shit at analyzing traces and optimizing prompts. Still completely misreads failure reasons and comes up with stupid fixes.

Mackross avatar
Mackross@mackross·May 26

Little golang package to make deploying cross platform apps with ONNX models a little easier: github.com/mackross/gonnx standing on the shoulders of github.com/shota3506/onnxrun….

Mackross avatar
Mackross@mackross·May 24

Little trick for harness devs that has worked nicely for me, when i need to inject important “pushed” information mid conversation, i create a fake tool call request and result for the pull version of that thing. Like get_modified_files, or get_chat_notifications. Agents seem to trust tools more than injected system messages.

Mackross avatar
Mackross@mackross·May 24

If you’re willing to burn ~30% of a cpu core on a custom semantic VAD and hack through the bugs in gpt-realtime2 you can build something that feels much more responsive and natural than OpenAI semantic VAD and as a bonus it keeps your computers toasty. Stack: WebRTC carries full-duplex opus audio from local server that also connects with WebSocket to GPT Realtime2 with OpenAI VAD disabled. Local server decodes the different PCM/sample-rate paths for all the different detectors+openai and also encodes for browser playback of assistant voice. Server runs local Silero VAD (ML), assistant echo-aware barge-in gating with non word utterance detection and auto continuation. It uses a tuned multi-checkpoint Smart Turn threshold curve (smart turn is a ML model for end of turn detection, but running it 7 times at different times is much better). Server playhead telemetry drives deterministic interrupt, truncate, cancel, and context-repair logic, and works around Realtime API bugs and edge cases.

Mackross avatar
Mackross@mackross·May 11

It’ll be interesting to see whether Android/iOS/someone else is first to figure out voice/textbox + streamed UI components as primary UX going forward. Full blown UI apps have a limited life span.