Organizations looking to jump-start their AI/ML journey while keeping control over their data are getting some help from Nutanix as they announce Nutanix GPT-in-a-Box. This solution delivers a full-stack software-defined AI-ready platform and services to help size and configure a hardware and software infrastructure suitable to deploy a curated set of large language models (LLMs) using open-source AI and MLOps frameworks on the Nutanix Cloud Platform.
Organizations looking to jump-start their AI/ML journey while keeping control over their data are getting some help from Nutanix as they announce Nutanix GPT-in-a-Box. This solution delivers a full-stack software-defined AI-ready platform and services to help size and configure a hardware and software infrastructure suitable to deploy a curated set of large language models (LLMs) using open-source AI and MLOps frameworks on the Nutanix Cloud Platform.
Customers can easily procure an AI-ready infrastructure they can fine-tune and run generative pre-trained transformers (GPT), including LLMs.
Enterprises struggle with how to take advantage of generative AI and AI/ML applications, especially where data sovereignty and governance are concerned. It’s not hard to see how generative AI can be leveraged to improve customer service, developer productivity, and operational efficiency. Organizations are aware of the AI potential but have concerns regarding intellectual property leakage, and compliance and privacy concerns. Additionally, companies looking to build an AI-ready stack grapple with how to support ML administrators and data scientists. At the same time, the potential for a significant AI investment has stalled enterprises in their AI and ML strategy.
The Nutanix GPT-in-a-Box solution delivers ready-to-use customer-controlled AI infrastructure for the edge or the core data center. It allows customers to run and fine-tune AI and GPT models while maintaining control over their data. Nutanix provides a full suite of security and data protection offerings ideal for AI data protection.
Thomas Cornely, SVP Product Management at Nutanix, explained that “GPT-in-a-Box is an opinionated AI-ready stack that aims to solve the key challenges with generative AI adoption” and will jump-start AI innovation.
The GPT-in-a-Box solution includes:
- Nutanix Cloud Infrastructure, Nutanix Files and Objects storage, and Nutanix AHV hypervisor and Kubernetes platform with NVIDIA GPU acceleration, which can be sized for large to small scale.
- Nutanix services to help customers size their cluster and deploy an opinionated stack with the leading open-source deep learning and MLOps frameworks, an inference server, and a curated set of large language models such as Llama2, Falcon GPT, and MosaicML.
- The ability for data scientists and ML administrators to immediately consume these models with their choice of applications, enhanced terminal UI, or standard CLI.
- The platform can be leveraged to run other GPT models, as well as fine-tune these models supporting internal data hosted on included Nutanix Files or Objects services.
Engage with StorageReview
Newsletter | YouTube | Podcast iTunes/Spotify | Instagram | Twitter | TikTok | RSS Feed
