Back at it
-
The raytracer is, for now, a no-go on visionOS. It's possible I could throttle it and stay within visionOS' systemwide render budget. But it's probably worth improving the RT performance a bunch on its own first before I come back and try it here. I might run out of steam on this prototype before then.
This entire app project is still in my 'Temp' folder, where throwaway projects live
@stroughtonsmith it’s really impressive and beautiful how this one is coming together.
-
So now that visionOS 26 lets you spawn immersive scenes from UIKit apps, I had Codex implement me an immersive scene using Metal and CompositorServices that mirrors the in-window viewport and lets you live in your scene
It's real frickin cool.
The raytracer might be off limits for visionOS, but there's a lot of interesting stuff to do in other areas
@stroughtonsmith This is getting scary
-
This project, which runs on iPhone, iPad, Mac, and Vision Pro (with Immersive Space), is now 16.5K lines of code
I thought it was finally time to add vertex editing and subdivision. Now it's a 3D modeling tool and not just a raytracer
-
I thought it was finally time to add vertex editing and subdivision. Now it's a 3D modeling tool and not just a raytracer
@stroughtonsmith Boolean solid operations next?
-
@stroughtonsmith Boolean solid operations next?
@juandesant good idea
-
I thought it was finally time to add vertex editing and subdivision. Now it's a 3D modeling tool and not just a raytracer
Some more things to show off here on this iPad mini 6!
• Longpress band gesture
• Multi-select
• Vertex editing
• Subdividing
• My 'generate a Cornell Box' button
• (And the raytracer, of course)There is a lot of really neat stuff in this app. Still using Codex 5.3 Medium, still haven't touched a line of code myself
-
Some more things to show off here on this iPad mini 6!
• Longpress band gesture
• Multi-select
• Vertex editing
• Subdividing
• My 'generate a Cornell Box' button
• (And the raytracer, of course)There is a lot of really neat stuff in this app. Still using Codex 5.3 Medium, still haven't touched a line of code myself
All of this still works great on iPhone too
-
All of this still works great on iPhone too
The touch gestures all work on visionOS too, but on all platforms it has keyboard and mouse support for all your precise selection and modifier key needs
-
The touch gestures all work on visionOS too, but on all platforms it has keyboard and mouse support for all your precise selection and modifier key needs
@stroughtonsmith It’s crazy to see how something like this can evolve. Do you find it weirdly addictive to see what the GPUs will cook up next?
-
@stroughtonsmith It’s crazy to see how something like this can evolve. Do you find it weirdly addictive to see what the GPUs will cook up next?
@brndnsh it's just a string of dopamine hits
-
The touch gestures all work on visionOS too, but on all platforms it has keyboard and mouse support for all your precise selection and modifier key needs
@stroughtonsmith “tsWork ‘26”
-
@brndnsh it's just a string of dopamine hits
@stroughtonsmith So many “one more prompt” moments…
-
The touch gestures all work on visionOS too, but on all platforms it has keyboard and mouse support for all your precise selection and modifier key needs
@stroughtonsmith out of curiosity. Do you use Codex from inside Xcode or do you use the CLI?
My results in generating functional iOS projects with the CLI have been very mixed -
@stroughtonsmith out of curiosity. Do you use Codex from inside Xcode or do you use the CLI?
My results in generating functional iOS projects with the CLI have been very mixed@arno_app this is all using the Codex app, so 'neither' I guess?
-
@arno_app this is all using the Codex app, so 'neither' I guess?
@stroughtonsmith oh wow I was avoiding it since it felt like overkill first. Now you got me curios!
-
@stroughtonsmith oh wow I was avoiding it since it felt like overkill first. Now you got me curios!
@arno_app I avoided it too until I started doing things that were more filesystem based, and I haven't looked back — it feels so much more capable even with the same model
-
@arno_app I avoided it too until I started doing things that were more filesystem based, and I haven't looked back — it feels so much more capable even with the same model
@stroughtonsmith I found the CLI to be a suboptimal startpoint to create new projects so I went back to the built in Xcode agents. However they feel a bit more limited (even though I don't know if they are actually) but I on the other hand they benefit from the built in docs and so on.
After seeing what you built with it I will try the app as well.
-
@stroughtonsmith I found the CLI to be a suboptimal startpoint to create new projects so I went back to the built in Xcode agents. However they feel a bit more limited (even though I don't know if they are actually) but I on the other hand they benefit from the built in docs and so on.
After seeing what you built with it I will try the app as well.
@arno_app so what I do is I create a new project, with my custom Xcode template for UIKit apps (https://github.com/steventroughtonsmith/appleuniversal-xctemplates)
I also drop in a markdown file with my style guide.
Then I give that folder to Codex, and from then on Xcode is basically just a fancy build and run button
-
@arno_app so what I do is I create a new project, with my custom Xcode template for UIKit apps (https://github.com/steventroughtonsmith/appleuniversal-xctemplates)
I also drop in a markdown file with my style guide.
Then I give that folder to Codex, and from then on Xcode is basically just a fancy build and run button
@stroughtonsmith Thanks a lot that’s a helpful starting point.
Seems Xcode project structure is still a hard enough task so that an agent can't solve it completely
-
Recap: I vibecoded (code unseen, no plan) a 3D editor/renderer that has a scene graph, editing controls, primitives and gizmos, materials, procedural terrain and water, and hardware-accelerated Metal raytracing with soft shadows, clouds and bounce lighting, that runs on Mac and iPad.
Tool: Codex 5.3 Medium
Time: About a day's worth of work has gone into it@stroughtonsmith so you did nothing and deserve no credit for it
