Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
SAM 3D consists of a duo of sophisticated foundation models that can transform a typical RGB image into an impressive 3D representation of either objects or human figures. This system features SAM 3D Objects, which accurately reconstructs the complete 3D geometry, textures, and spatial arrangements of items found in real-world environments, effectively addressing challenges posed by clutter, occlusions, and varying lighting conditions. Additionally, SAM 3D Body generates dynamic human mesh models that capture intricate poses and shapes, utilizing the "Meta Momentum Human Rig" (MHR) format for enhanced detail. The design of this system allows it to operate effectively with images taken in natural settings without the need for further training or fine-tuning: users simply upload an image, select the desired object or individual, and receive a downloadable asset (such as .OBJ, .GLB, or MHR) that is instantly ready for integration into 3D software. Highlighting features like open-vocabulary reconstruction applicable to any object category, multi-view consistency, and occlusion reasoning, the models benefit from a substantial and diverse dataset containing over one million annotated images from the real world, which contributes significantly to their adaptability and reliability. Furthermore, the models are available as open-source, promoting wider accessibility and collaborative improvement within the development community.
Description
This is the formal release of the Shap-E code and model, which allows users to create 3D objects based on textual descriptions or images. You can generate a 3D model by providing a text prompt or a synthetic view image, and for optimal results, it's recommended to eliminate the background from the input image. Additionally, you can load 3D models or trimeshes, produce a series of multiview renders, and encode them into a point cloud, which can then be reverted to a visual format. To utilize these features effectively, ensure that you have Blender version 3.3.1 or a more recent version installed on your system. This opens up exciting possibilities for integrating 3D modeling with AI-driven creativity.
API Access
Has API
No
API Access
Has API
No
Integrations
Blender
No
Pricing Details
Free
Free Trial
Yes
Free Version
Yes
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Meta
Founded
2004
Country
United States
Website
ai.meta.com/sam3d/
Vendor Details
Company Name
OpenAI
Country
United States
Website
github.com/openai/shap-e