Exciting Dell-Intel AI Updates from Dell Technologies World: The second part of 2024 will see Dell PowerEdge XE9680 servers with Intel Gaudi 3 AI accelerators.
At this year’s Intel Vision conference, Intel CEO Pat Gelsinger introduced the Gaudi 3 AI accelerator. Michael Dell attended Pat’s keynote via livestream to announce that Dell Technologies will release the Intel Gaudi 3 AI Accelerator on the Dell PowerEdge XE9680 server later this year.
Dell PowerEdge XE9680
- Dell Technologies’ Infrastructure Solutions Group President Arthur Lewis reiterated this in his keynote talk at Dell Technologies World last week.
- Dell PowerEdge XE9680 will support Gaudi 3 in the second half of 2024. Before launch, customers can seek quotes from Dell and Dell partners in late June.
With its improved AI acceleration and variety of GPU options, the Dell PowerEdge XE9680 server, which debuted last year, has set the benchmark for purpose-built AI and GenAI computation. Gaudi 3 will improve Dell and Intel’s collaboration by meeting customer infrastructure demands, lowering total cost of ownership, and simplifying deployment when it joins Dell’s server lineup later this year.
This is made possible by an open ecosystem that includes scalable Ethernet-based AI fabrics coupled with AI frameworks tailored for Dell and Gaudi 3.
In order to enable a restricted group of customers to evaluate Intel AI solutions on Dell hardware before implementing them in their data centres, Intel will add Dell PowerEdge XE9680 servers with Intel AI Accelerators to the Intel Developer Cloud prior to the general release of Gaudi 3.
For additional details regarding Dell Technologies’ announcement that the PowerEdge XE9680 series will now include the Gaudi 3.
Best AI session summaries
Check out these featured AI sessions from Dell Technologies World 2024, led by experts. AI tools were used to distil the recap content.
Resolving the Data Conundrum in the AI Era
Discover the advantages of AI with Dell Technologies, Deloitte, and ServiceNow. Learn about data governance, unstructured data, and the moral application of AI.
Adopting a Human First Perspective for AI Innovation
Get advice on promoting AI innovation that is focused on people from Dell Technologies, McLaren Racing, EY, and the City of Amarillo.
How to Use Sustainable IT Strategies to Future Proof Your Business
Discover how AI and sustainability can work together as senior executives from Computacenter, Creative Strategies, and Dell share their go-to tactics.
High-performance servers like the Dell PowerEdge XE9680 are made to withstand the rigorous demands of contemporary data centres, especially those with applications including high-performance computing (HPC), machine learning (ML), and artificial intelligence (AI).
Below are the main attributes and details of the Dell PowerEdge XE9680
Important characteristics
- High Compute Density: Supports up to eight NVIDIA A100 GPUs for AI and HPC computation.
- Processor: Latest Intel Xeon Scalable CPUs provide powerful processing and support for huge memory configurations.
- Memory: Some configurations allow terabytes of RAM for data-intensive applications.
Storage: Offers NVMe, SSDs, and HDDs for various performance and capacity needs.
With many 100GbE ports and other high-speed networking options, can support large-scale computation data flow.
Cooling and Power Efficiency: State-of-the-art cooling techniques to guarantee peak performance and dependability, along with effective power control to minimise running expenses.
XE9680 spec sheet
- Form Factor: Server rack, 4U
- GPUs: Eight NVIDIA A100 GPUs maximum
- CPUs: The most recent generation of Intel Xeon Scalable processors
- Memory: Multiple terabyte capacities are supported, including DDR4 or DDR5 support.
- Storage: NVMe, SSD, and HDD are supported by several disc bays.
- Networking: A number of fast network connectors, including the expansion of 100GbE PCIe slots are available for adding more expansion cards.
Use cases for machine learning and artificial intelligence
- Because of its strong GPU capabilities, the XE9680 is perfect for workloads including training and inference in AI and ML.
- High-Performance Computing: Appropriate for data analytics, scientific simulations, and other HPC applications needing substantial processing power.
- Data Analytics: Able to manage complicated query execution and real-time data processing, among other large-scale data analytics operations.
- Virtualization is a flexible option for combining several workloads on a single server since it supports virtualized environments.
- Management and Security: For remote monitoring and management, use the Integrated Dell Remote Access Controller (iDRAC).
Hardware and firmware security mechanisms are included to prevent unwanted access and guarantee data integrity.
PowerEdge XE9680
High-performance servers like the Dell PowerEdge XE9680 are made to last in today’s data centres, especially for applications involving machine learning (ML), artificial intelligence (AI), and high-performance computing (HPC). The Dell PowerEdge XE9680 offers the following main advantages:
High Performance CPU Power: The PowerEdge XE9680’s potent CPUs offer remarkable processing power that can effectively handle demanding applications.
GPU Acceleration: The multiple GPU support on this server greatly speeds up work related to AI, ML, and data analytics. For jobs requiring parallel processing capability, it’s perfect.
Equilibrium
Modular Design: Organisations may easily scale their servers by adding more processing power or storage as needed thanks to the server’s modular design.
Flexible Configurations: Businesses can customise the server to meet unique workload requirements thanks to support for a variety of configurations.
Improved Storage
High space: With a significant amount of storage space, the XE9680 is a good choice for applications that require a lot of data. Large-scale AI model training, databases, and big data analytics all depend on this.
High-speed Storage Options: The server guarantees quick data access and transfer rates by supporting NVMe SSDs and other high-speed storage technologies.
Expert Networking
High-bandwidth connectivity: In order to facilitate real-time data processing and analysis, the server is built to accommodate high-speed networking solutions. This guarantees quick data transfer and minimal latency.
Multiple Network Interfaces: It provides a number of network interfaces for load balancing and redundancy, which improves the performance and stability of the network.
The Efficiency of Energy
Optimised Power Usage: By reducing power consumption without sacrificing performance, Dell has integrated energy-efficient technologies into the XE9680, helping to cut operational costs.
Characteristics of Sustainability: It is equipped with features that lessen the carbon impact of data centre operations, all with an eye towards sustainability.
Trustworthiness and Safety
Robust Design: With features like redundant power supplies and cooling systems to guarantee uptime, the server is designed to be extremely dependable.
Advanced Security: Dell’s security features, which include secure boot, silicon-based root of trust, and system lockdown capabilities, shield infrastructure and data from online attacks.
Management Ease
Easy-to-use Management Tools: Dell offers a range of tools that make monitoring, maintenance, and server deployment easier. One such product is the Dell EMC OpenManage line, which provides all-inclusive infrastructure management.
Remote Management: Administrators may control the server from any location with integrated remote management capabilities, which eliminates the need for on-site assistance and streamlines processes.
Services and Support
Expert Support: To guarantee that the server stays functional and effective, Dell provides a wide range of support services, including proactive maintenance and prompt issue resolution.
Training and Resources: To assist IT workers in efficiently managing and utilising the server, Dell offers a range of resources, such as training courses and manuals.
In conclusion, the Dell PowerEdge XE9680 is a strong and adaptable server made to fulfil the most exacting performance requirements of contemporary data centres. It is appropriate for a wide range of demanding applications, from AI and ML to HPC and beyond, thanks to its support for numerous high-end GPUs, current generation CPUs, and an abundance of memory and storage options.
