Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Molmo represents a cutting-edge family of multimodal AI models crafted by the Allen Institute for AI (Ai2). These innovative models are specifically engineered to connect the divide between open-source and proprietary systems, ensuring they perform competitively across numerous academic benchmarks and assessments by humans. In contrast to many existing multimodal systems that depend on synthetic data sourced from proprietary frameworks, Molmo is exclusively trained on openly available data, which promotes transparency and reproducibility in AI research. A significant breakthrough in the development of Molmo is the incorporation of PixMo, a unique dataset filled with intricately detailed image captions gathered from human annotators who utilized speech-based descriptions, along with 2D pointing data that empowers the models to respond to inquiries with both natural language and non-verbal signals. This capability allows Molmo to engage with its surroundings in a more sophisticated manner, such as by pointing to specific objects within images, thereby broadening its potential applications in diverse fields, including robotics, augmented reality, and interactive user interfaces. Furthermore, the advancements made by Molmo set a new standard for future multimodal AI research and application development.
Description
NVIDIA's Isaac GR00T (Generalist Robot 00 Technology) serves as an innovative research platform aimed at the creation of versatile humanoid robot foundation models and their associated data pipelines. This platform features models such as Isaac GR00T-N, alongside synthetic motion blueprints, GR00T-Mimic for enhancing demonstrations, and GR00T-Dreams, which generates novel synthetic trajectories to expedite the progress in humanoid robotics. A recent highlight is the introduction of the open-source Isaac GR00T N1 foundation model, characterized by a dual-system cognitive structure that includes a rapid-response “System 1” action model and a language-capable, deliberative “System 2” reasoning model. The latest iteration, GR00T N1.5, brings forth significant upgrades, including enhanced vision-language grounding, improved following of language commands, increased adaptability with few-shot learning, and support for new robot embodiments. With the integration of tools like Isaac Sim, Lab, and Omniverse, GR00T enables developers to effectively train, simulate, post-train, and deploy adaptable humanoid agents utilizing a blend of real and synthetic data. This comprehensive approach not only accelerates robotics research but also opens up new avenues for innovation in humanoid robot applications.
API Access
Has API
API Access
Has API
Integrations
BLACKBOX AI
Gemma 2
NVIDIA DGX Cloud
NVIDIA Isaac Lab
NVIDIA Omniverse
OpenAI
Phi-3
Qwen2
Integrations
BLACKBOX AI
Gemma 2
NVIDIA DGX Cloud
NVIDIA Isaac Lab
NVIDIA Omniverse
OpenAI
Phi-3
Qwen2
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
Free
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Ai2
Founded
2014
Country
United States
Website
allenai.org/blog/molmo
Vendor Details
Company Name
NVIDIA
Founded
1993
Country
United States
Website
developer.nvidia.com/isaac/gr00t