Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
We create a three-dimensional signed distance field (SDF) and a textured field using two latent codes. DMTet is employed to derive a 3D surface mesh from the SDF, and we sample the texture field at the surface points to obtain color information. Our training incorporates adversarial losses focused on 2D images, specifically utilizing a rasterization-based differentiable renderer to produce both RGB images and silhouettes. To distinguish between genuine and generated inputs, we implement two separate 2D discriminators—one for RGB images and another for silhouettes. The entire framework is designed to be trainable in an end-to-end manner. As various sectors increasingly transition towards the development of expansive 3D virtual environments, the demand for scalable tools that can generate substantial quantities of high-quality and diverse 3D content has become apparent. Our research endeavors to create effective 3D generative models capable of producing textured meshes that can be seamlessly integrated into 3D rendering engines, thereby facilitating their immediate application in various downstream uses. This approach not only addresses the scalability challenge but also enhances the potential for innovative applications in virtual reality and gaming.
Description
This is the formal release of the Shap-E code and model, which allows users to create 3D objects based on textual descriptions or images. You can generate a 3D model by providing a text prompt or a synthetic view image, and for optimal results, it's recommended to eliminate the background from the input image. Additionally, you can load 3D models or trimeshes, produce a series of multiview renders, and encode them into a point cloud, which can then be reverted to a visual format. To utilize these features effectively, ensure that you have Blender version 3.3.1 or a more recent version installed on your system. This opens up exciting possibilities for integrating 3D modeling with AI-driven creativity.
API Access
Has API
No
API Access
Has API
No
Integrations
Blender
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
NVIDIA
Country
United States
Website
nv-tlabs.github.io/GET3D/
Vendor Details
Company Name
OpenAI
Country
United States
Website
github.com/openai/shap-e