←
Jeffrey Castellano194 posts
Jeffrey Castellano avatar

Jeffrey Castellano

@CastellanoWorks

Obsessively exploring simulations, graphics, machine learning & AI. This is my demo space & devlog for side projects in WebGPU, WebGL, Metal & MLX/CUDA.

◷ Joined October 2015▧ 34 Photos and videos
Tim Sweeney avatar
⟳ Jeffrey Castellano retweeted
Tim Sweeney@TimSweeneyEpic·Nov 10

It's a new age of game development! This is the Unreal Engine 5.9 preview, consisting of huge improvements to AI acceleration ported from unfinished Unreal Engine 6, plus entirely new support for play inside web browsers.

Ok so. #unrealengine 5.9 is pretty sick. You can build a web browser version of your game, so I built EasyWaterscape's playable demo... and it runs at a rock solid 60fps, @ high settings, in chrome, at 4586x2372. What the heck? #gamedev #delltech #dellproprecision #nvidia

0:25
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Nov 5

Tiny dedicated neural nets are great for real-time.

Cheap cloud scattering approximation using tiny neural networks that I was working on a while back for our engine. iPhone 12, 1080p @60+ fps

0:32
Marek Vana avatar
⟳ Jeffrey Castellano retweeted
Marek Vana@derfcz·Oct 28

I'm building a open source little physics lab in @threejs to experiment with viscous and non-Newtonian fluids. First experiment: runny mud. Playing with surface deformation, flow, and object interactions. Still a work in progress, but it's getting there! #threejs

0:21
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 13

Also, to be clear, I'm not advocating for any particular AI. I just figured if you are going to market this feature heavily that it would be way better.

Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 10

had a few people message me about this already. Just FYI since a lot of folks don't know about this feature -> This is not part of Claude Code & is a custom mod you can make w/ Claude to the Claude Code UI.

Post attachment
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 10

Love that the @claudeai app lets you mod its own UI. My real-time #threejs pathtracer side project needs precise GPU benchmarking while running other sessions. So I built a simple 'GPU Lock' mod with a queue I can reprioritize directly from the UI. Super cool.

Post attachment
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 7

For folks thinking you need a powerful PC/GPU for this, here's the same real-time @threejs meshlet #pathtracer but w/ touch controls, atmosphere + dynamic lighting ...running in Safari on my iPhone 13. Many bad things to fix & barely optimized. #webgpu #gamedev #raytracing

0:57
0:25
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 7

Not going to lie @mrdoob I may have bitten off more than I can chew. My M5 might melt & still not there. Clusters crashing out and systems failing for sure. But Zorah IS pretty. I'll see how far I get. #threejs #pathtracer

0:34
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 6

Neural denoiser v0.61 in threejs meshlet pathtracer with early motion support for handling light movement (wind, small morphs, fire, etc) without refit/rebuild. Not sure if it scales but we'll see.

0:29
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 6

OK @mrdoob its a walk-off then. Zorah is on the queue.

Ported Unity's Megacity (GDC 2019) to Three.js ✅ ~45 fps on a MacBook Air M1 ✅ Full demo compressed down to 75 MB ❌ No live link because of Unity's asset license 😕

4:53
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 3

Quick Correction - Video says meshlet pathtracer. This is not using meshlets, just left the title in by mistake. Two separate renderers but shared methods in many cases hopefully will have them combined at the end.

Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 3

Also I find it handy to set up these scripts in a little tailscale synced socket server so AI can debug issues simultaneously across devices. Just a nice little workflow I found for me at least.

0:09
Jeffrey Castellano avatar
Jeffrey Castellano@CastellanoWorks·Oct 3

Neural denoiser v0.4 is trained + multiple spp frame support lands milestone 2 for my #threejs real-time pathtracer. This version revisits regular meshes. Normal scenes work w/ many moving lights, glass, caustics, mats, skinned mesh, morphs, & GI. Captured w/ settings on 'ultra'.

1:00