Home EnterpriseAI Dell Technologies Expands Generative AI Solutions with AMD-Powered Additions

Dell Technologies Expands Generative AI Solutions with AMD-Powered Additions

by Harold Fritts

Dell Technologies expands GenAI solutions with new offerings from the Dell AI Factory tailored for AMD environments.

Dell Technologies has broadened its generative AI (GenAI) solutions portfolio with new offerings from the Dell AI Factory tailored for AMD environments. These latest solutions offer enterprises greater scalability and flexibility in AI capabilities, empowering them to remain competitive.

According to Arthur Lewis, president of the Infrastructure Solutions Group at Dell Technologies, integrating AMD technology into Dell’s latest servers and AI solutions through the Dell AI Factory allows businesses to achieve the performance and efficiencies they require now and in the future. He emphasized that Dell, in collaboration with AMD, is setting new benchmarks in AI performance, delivering powerful and cost-effective solutions that are essential for today’s modern data-driven environments.

Forrest Norrod, executive vice president and general manager of AMD’s Data Center Solutions Group, added that AMD’s latest EPYC processors and Instinct accelerators provide Dell customers with advanced, end-to-end solutions at scale. These technologies help expedite AI deployments and power business-critical IT infrastructure. Norrod highlighted the ongoing collaboration between Dell and AMD, which continues to deliver innovative solutions that enhance operational efficiency, reduce time to value, and foster innovation across highly competitive industries.

Introducing New PowerEdge Servers

The latest additions to Dell’s PowerEdge portfolio are designed to support a wide range of AI use cases and traditional workloads. These platforms simplify server management and security while providing modern enterprises with customizable and efficient solutions for high-performance workloads.

One of the new offerings, the Dell PowerEdge XE7745, is built for enterprise AI workloads. It supports up to eight double-width or 16 single-width PCIe GPUs powered by AMD 5th Generation EPYC processors, all within a 4U air-cooled chassis. The system is designed for AI inferencing, fine-tuning, and high-performance computing. It includes eight additional Gen 5.0 PCIe slots for network connectivity, enabling dense and flexible configurations with double the PCIe GPU capacity.

AMD EPYC Turin 9005 CPU

The Dell PowerEdge R6725 and R7725 servers are optimized for scalability and powered by AMD 5th Generation EPYC processors. Featuring a new DC-MHS chassis, these servers offer enhanced air cooling and dual 500W CPUs to tackle challenging thermal requirements while maintaining power and efficiency. These platforms excel at supporting data analytics and AI workloads, offering configurations optimized for scalability and delivering record-breaking performance in areas such as virtualization, databases, and AI. The R7725 provides up to 66% increased performance and up to 33% improved efficiency, demonstrating top-tier capabilities for enterprise workloads.

AMD EPYC Turin in R6625

All three PowerEdge platforms—XE7745, R6725, and R7725—can support up to 50% more cores, with a 37% increase in performance per core. These performance gains translate into greater efficiency and an improved total cost of ownership (TCO), allowing businesses to consolidate up to seven outdated servers into one unit. This consolidation reduces CPU power consumption by as much as 65%, making it an energy-efficient choice for enterprises.

Additionally, the PowerEdge R6715 and R7715 servers, powered by AMD 5th Generation EPYC processors, provide increased performance and efficiency. These models support up to 37% more drive capacity, improving storage density. These single-socket servers, offered in multiple configurations, support double the memory with 24 DIMM slots and are designed to meet diverse workload requirements. With their compact 1U and 2U chassis, the R6715, in particular, boasts high performance for AI and virtualization tasks.

For customers deploying AI at scale, Dell Technologies continues to support the latest AMD Instinct accelerators across the Dell PowerEdge XE server lineup. IT teams can remotely monitor, manage, and update Dell PowerEdge servers using the enhanced Integrated Dell Remote Access Controller (iDRAC). With an improved processor, additional memory, and a dedicated security co-processor, iDRAC simplifies server management and security, helping IT teams operate more efficiently and reliably.AMD EPYC Turin CPU options

Dell AI Factory

The Dell AI Factory is equipped to handle various AI requirements, offering the world’s most extensive AI solutions portfolio, from desktop environments to data centers and cloud platforms. Dell Generative AI Solutions, powered by AMD and running on the Dell PowerEdge XE9680 server with AMD Instinct MI300X accelerators, support a range of AI applications, including AI inferencing, retrieval augmented generation (RAG), and customization. This integration streamlines AI deployment, enhances security, and enables scalable and modular architectures, reducing time to value by up to 86%. As a result, organizations can optimize their AI investments.

Furthermore, the Dell Enterprise Hub on Hugging Face now supports the PowerEdge XE9680 with AMD Instinct MI300X accelerators. This platform offers custom containers and scripts for the secure and easy deployment of models such as Llama and Mixtral. These containerized models are optimized to boost inferencing performance, leveraging Hugging Face’s Text Generation Inference (TGI) backend.

Dell Professional Services for Generative AI has also expanded to support AMD environments. The new Dell Implementation Services for GenAI Platform with AMD offers a tailored operational platform, including Kubernetes configuration, deployment of advanced AI frameworks, and expert knowledge transfer to maximize return on investment (ROI). Dell professionals provide support throughout the AI lifecycle, from strategy development and data preparation to platform and model implementation and solution scaling, helping customers achieve their business outcomes with AI.

Availability

  • The Dell PowerEdge XE7745 server will be available globally starting in January 2025.
  • The Dell PowerEdge R6715, R7715, R6725, and R7725 servers will be available globally in November 2024.
  • Dell Generative AI Solutions with AMD will be available globally starting in Q4 2024.
  • Dell Enterprise Hub on Hugging Face updates are available globally now.
  • Dell Implementation Services for Generative AI Platform are now available in select countries.

Engage with StorageReview

Newsletter | YouTube | Podcast iTunes/Spotify | Instagram | Twitter | TikTok | RSS Feed