Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

FauxPilot serves as an open-source, self-hosted substitute for GitHub Copilot, leveraging the SalesForce CodeGen models. It operates on NVIDIA's Triton Inference Server, utilizing the FasterTransformer backend to facilitate local code generation. The installation process necessitates Docker and an NVIDIA GPU with adequate VRAM, along with the capability to distribute the model across multiple GPUs if required. Users must download models from Hugging Face and perform conversions to ensure compatibility with FasterTransformer. This alternative not only provides flexibility for developers but also promotes an independent coding environment.

Description

VMware Private AI Foundation is a collaborative, on-premises generative AI platform based on VMware Cloud Foundation (VCF), designed for enterprises to execute retrieval-augmented generation workflows, customize and fine-tune large language models, and conduct inference within their own data centers, effectively addressing needs related to privacy, choice, cost, performance, and compliance. This platform integrates the Private AI Package—which includes vector databases, deep learning virtual machines, data indexing and retrieval services, and AI agent-builder tools—with NVIDIA AI Enterprise, which features NVIDIA microservices such as NIM, NVIDIA's proprietary language models, and various third-party or open-source models from sources like Hugging Face. It also provides comprehensive GPU virtualization, performance monitoring, live migration capabilities, and efficient resource pooling on NVIDIA-certified HGX servers, equipped with NVLink/NVSwitch acceleration technology. Users can deploy the system through a graphical user interface, command line interface, or API, thus ensuring cohesive management through self-service provisioning and governance of the model store, among other features. Additionally, this innovative platform empowers organizations to harness the full potential of AI while maintaining control over their data and infrastructure.

API Access

Has API

API Access

Has API

Screenshots View All

Screenshots View All

Integrations

Hugging Face
CUDA
CodeGen
Docker
NVIDIA DRIVE
NVIDIA NIM
NVIDIA Triton Inference Server
PostgreSQL
VMware Cloud

Integrations

Hugging Face
CUDA
CodeGen
Docker
NVIDIA DRIVE
NVIDIA NIM
NVIDIA Triton Inference Server
PostgreSQL
VMware Cloud

Pricing Details

Free
Free Trial
Free Version

Pricing Details

No price information available.
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

FauxPilot

Website

github.com/fauxpilot/fauxpilot

Vendor Details

Company Name

VMware

Founded

1998

Country

United States

Website

www.vmware.com/products/cloud-infrastructure/private-ai-foundation-nvidia

Product Features

Alternatives

Alternatives

Tabby Reviews

Tabby

Tabby ML
NVIDIA NIM Reviews

NVIDIA NIM

NVIDIA