[KerrickStaley]

I'm experimenting to see if frontier LLMs can do practical CAD modeling. I'm starting with a single task: designing a wall mount for my bike pump in OpenSCAD or CadQuery (two code-based CAD systems).

None of the frontier LLMs (Gemini, ChatGPT, Claude) produce usable designs when just prompted with some photos of the pump and a written description of the mount. I'm now building a simulator in Mujoco that the LLMs can use to test and iterate on their designs to see if they can do better in this setting.

I'm hoping to make an interesting blog post of it and maybe end up with a usable wall mount design.

[alpfalp]

claude models are sufficiently competent at directly making accurate MJCF files as long as you go part by part. directly trying to port from CAD may cause issues when trying to "close the loop" so to speak because of the kinematic tree approach.