Before Meta 3D Gen, creating 3D models took hours. The tech giant is reducing the laborious sculpting and texturing process for its users.
Meta’s new 3D Gen model is considered an important step in the field of generative artificial intelligence, which aims to create 3D beings. So, what is Meta 3D Gen, and how does it work? Let’s take a closer look.
Meta 3D Gen: Create detailed designs from text commands
With Meta 3D Gen, you can create completely real 3D models. Have you used a model like this before? Models can have high-quality geometry and textures. Isn’t that great? Many of you know that producing such models takes a lot of time and effort. We couldn’t even do such things before. But with AI permeating every aspect of our lives, seeing things like this is unsurprising. Who knows what we will see in the future…
So, how exactly does this model work? The system uses a two-stage process that combines Meta‘s existing AssetGen and TextureGen technologies. AssetGen creates the 3D structure, while TextureGen focuses on applying high-resolution textures.
This two-step process, detailed in Meta’s official research document, is as follows:
- 3D generation from text: The magic starts with a simple text prompt. When the user enters a description, Meta 3D Gen’s AI model creates a 3D mesh that captures the basic shape and structure specified in the text. This first stage prioritizes creating accurate geometry suitable for physically based rendering (PBR).
- Texture generation from text: Once the 3D mesh is created, the system applies high-resolution textures and material mappings. This step significantly improves the model’s visual quality, making it suitable for real-world uses. Users can adjust the texture style by changing the original text prompt, allowing for easy customization without changing the underlying 3D structure.
The initial results are not very realistic. However, the main takeaway is that Meta’s approach provides high-quality output suitable for various modeling and rendering scenarios. Research conducted by Meta shows that professional 3D artists find the results from 3D Gen superior to those produced with other text-to-3D modeling tools. Furthermore, the process is significantly faster and usually takes less than a minute to complete.
Featured image credit: Meta
