MIT, Google and Northeastern unveil InstructMesh for editing AI‑generated 3D models
InstructMesh is a new interface that lets users generate, edit, and 3D‑print objects with AI assistance. Developed by MIT’s CSAIL, Google, Microsoft’s TRELLIS system and Northeastern University, the tool pairs the text‑and‑image‑aware TRELLIS generator with the reasoning power of GPT‑4. Users can prompt a design—such as glasses or a mug—then highlight parts to refine, with sliders for precise…
Key points
- InstructMesh combines Microsoft TRELLIS 3D generator with GPT‑4 to enable natural‑language editing of AI‑created models
- Nearly 80% of generated models were structurally flawed, but novices fixed them about 90% of the time
- Researchers demonstrated functional items such as a dragon‑handle mug, a shell‑shaped whistle, and a shrimp‑like bristle bot
In tests, the system recreated popular Thingiverse models, finding that nearly 80 percent of the AI‑generated shapes were structurally flawed. Novice participants were able to spot and fix those issues about 90 percent of the time, producing functional items like a dragon‑handle mug, a shell‑shaped whistle, and a “bristle bot” shrimp‑like robot. Researchers see the approach extending to AR‑guided on‑the‑fly printing and physics‑based simulations, though those capabilities are still speculative.
The work was presented at the ACM Symposium on User Interface Software and Technology and was supported in part by Google and the MIT‑HPI Collaborative Research Program.
New tool lets users repair AI-generated 3D models, then fabricate them just the way they want
MIT News on AI · 1 October 2026
Loading the full article…
This text was published by MIT News on AI and written by Alex Shipps | MIT CSAIL. It is reproduced here with attribution so you can read it in full; the rights remain with the publisher. Read it at the source ↗
The headline, key points and digest above were generated by Digest AI's editorial model from the linked sources. Automated summaries can contain errors: the sources are the record. Spotted a mistake? Tell us. Published by Martin K., who runs Digest AI and handles corrections.
More in Agents & Tools
All →- Gemini may delete existing text when asked to append, author reports · 1 src
- Google's Gemini outperforms ChatGPT and Claude as Android assistant · 1 src
- Meta launches Muse AI agent in Mexico, first in Latin America · 11 src
- Meta rolls out real-time voice and expressive avatars for Muse AI in the US · 7 src
- Meta improves Muse and Meta AI with Active Memory and Active Focus · 2 src
Comments
via GitHub Discussions