Magic3D From Nvidia Can Create 3D Models From Text

November 22, 2022 By Prelo Con

(Image Credit Google)

Using new AI, anyone may create 3D content; modeling expertise is not necessary. Nvidia researchers introduced Magic3D on Friday, an AI system that can create 3D models from text descriptions. Magic3D builds a 3D mesh model with colored texture in around 40 minutes after receiving a prompt like "A blue poison-dart frog sitting on a water lily." The generated model can be altered and utilized in video games or CGI artwork. Nvidia frames Magic3D as a response to DreamFusion, a text-to-3D model that Google researchers unveiled in September, in its academic article. Magic3D employs a two-stage technique to take a coarse model created in low resolution and optimize it to higher resolution, much as DreamFusion uses a text-to-image model to build a 2D image that is subsequently optimized into volumetric NeRF (Neural radiance field) data. The authors of the research claim that the resulting Magic3D approach can create 3D objects twice as quickly as DreamFusion. Magic3D From Nvidia Can Create 3D Models From Text

Magic3D From Nvidia Can Create 3D Models From Text

3D meshes can also be edited using prompts in Magic3D. A base prompt and a low-resolution 3D model can be used to modify the model by changing the wording. The creators of Magic3D also show how to transform a 3D model into a 2D image that has the appearance of a 2D image, like a cubist painting, and how to maintain the same subject across multiple generations (a practice known as coherence). Nvidia's scholarly study did not include any Magic3D code Today's diffusion models, which use neural networks to create new material after intensive training on a body of data, feel like a natural step to be able to create 3D from text. The development of capable text-to-image models like DALL-E and Stable Diffusion as well as basic text-to-video generators from Google and Meta has just occurred in 2022. The aforementioned text-to-3D model DreamFusion was also introduced by Google two months ago, and since then, people have developed comparable methods to use as an open source model based on Stable Diffusion. The researchers who developed Magic3D believe that technology will make it possible for everyone to create 3D models without the requirement for specialized training. Once developed, the resulting technology would hasten the creation of video games (and virtual reality) and perhaps even find use in special effects for movies and television shows. "We think with Magic3D, we can democratize 3D synthesis and open up everyone's creativity in 3D content production," the authors conclude near the end of their essay.

By Prelo Con

Following my passion by reviewing latest tech. Just love it.

Magic3D From Nvidia Can Create 3D Models From Text

Walmart's GenAI Search Engine: Challenging Google's Dominance in Retail Search

Introducing the MSI Claw Handheld: Your Ultimate Gaming Companion

Uber Increases In-App Ads, Prompting Mixed Reactions from Customers

Apple's iOS 18: A Leap into the AI Era

Google's Regular Pixel 8 Won't Get Gemini Nano AI

MacBook Air M3 Makes Amends for M2's Storage Blunder

Samsung Unveils the Galaxy M15 5G

Elon Musk's xAI to Open-Source Chatbot Grok

Contra: Operation Galuga - A Modern Run-and-Gun Classic

Musk Confirms X's TV App Arrives This Week

Running LLaMA on Raspberry Pi, NPX, and Pixel 6: Exploring the Possibilities of Open Source LLMs

GeiwBot - A tiny robot that opens the door for potential medical applications

Hubble image shows the merging of three galaxies

SpaceX Crew-6 Mission Launch This Week, How You Can Watch?

CAPSTONE satellite of NASA experienced another hiccup but is presently operational

Unknown "spokes" in Saturn's rings are being investigated by Hubble