AI Acceleration with NVIDIA and AMD Workstations
NVIDIA and AMD are powering a new line of workstations that are equipped with NVIDIA RTX Ada Generation GPUs and AMD Ryzen Threadripper PRO 7000 WX-Series CPUs. The goal of this collaboration is to make it possible for professionals all around the globe to design and operate AI applications directly from their desktops.
These new platforms allow experts to quickly handle the most resource-intensive, large-scale AI operations locally by bringing together the highest levels of AI computing, rendering, and simulation capabilities.
Bringing Cutting-Edge AI Innovation to Your Workstation
Performance at the level of a data center is often required for more advanced AI jobs. It takes thousands of GPUs operating for weeks to train a large language model that has a trillion parameters, for example, but research is ongoing to minimize model size and allow model training on smaller systems while still retaining high levels of AI model accuracy.
New AI workstations powered by NVIDIA RTX GPUs and AMD CPUs offer the power and speed necessary for training such smaller models, as well as enabling local fine-tuning and contributing to the offloading of data center and cloud resources for AI development activities. Users are able to pick single- or multi-GPU setups for their devices, depending on what is needed by their workloads.
In addition, the utilization of workstations for local inferencing becomes possible with smaller AI models that have been trained. Workstations powered by AMD CPUs and RTX graphics processing units may be customized to run smaller AI models for inference, making them suitable for use by smaller workgroups or departments.
These workstations provide a cost-effective approach to lessen the amount of computing burden that is placed on data centers, since a single NVIDIA RTX GPU may contain up to 48GB of memory. The NVIDIA AI Enterprise software platform offers easy portability of workflows and toolchains whenever it is necessary for professionals to expand training and deployment from these workstations to data centers or the cloud.
Workstations powered by AMD CPUs and RTX graphics processing units allow cutting-edge visual processes. The new workstations, which include increased computational capacity, make it possible to create highly interactive content, to digitalize industries, and to do sophisticated simulation and design.
Unrivaled Strength, Efficiency, and Adaptability in Every Situation
The AMD Ryzen Threadripper PRO 7000 WX-Series processors are the central processing unit platform that is designed for the subsequent generation of labor-intensive tasks. The processors provide a considerable increase in the number of cores per CPU (up to 96 cores per CPU) and the greatest memory bandwidth that is available in a single socket at a level that leads the industry.
The combination of these components with the most recent graphics processing units (GPUs) from NVIDIA’s RTX Ada Generation delivers unequaled power and performance to a workstation. In comparison to the previous generation, the GPUs are capable of achieving up to double the performance in ray tracing, artificial intelligence processing, graphics rendering, and computing workloads.
The RTX 4000 SFF, RTX 4000, RTX 4500, RTX 5000, and RTX 6000 are among of the graphics processing units (GPUs) available for the Ada Generation. They are constructed on the NVIDIA Ada Lovelace architecture and are equipped with as many as 142 RT Cores from the third generation, 568 Tensor Cores from the fourth generation, and 18,176 CUDA cores from the most recent generation.
Professionals in a wide variety of fields, including architecture, manufacturing, media and entertainment, and healthcare, will be able to utilize the new workstations to handle difficult AI computing workloads, in addition to 3D rendering, product visualization, simulation, and scientific computing jobs. These capabilities will be available to them.
Probability of Access
BOXX and HP will be the first system integrators to provide the new workstations beginning the next month. These workstations will be powered by NVIDIA RTX Ada Generation GPUs and the most recent AMD Threadripper Pro CPUs. Other system integrators will soon offer these workstations.
[…] NVIDIA researchers will present two posters in the domains of robotics and reinforcement learning, showcasing breakthroughs that enhance the generalizability of AI across many workloads and situations. […]
[…] Businesses may assure consistent operation and safeguard intellectual property by executing models on-site. For optimizing and implementing an LLM like the Llama 2, the Dell PowerEdge XE9680 is the perfect server. It’s the first server in the market to come pre-installed with eight NVIDIA H100 GPUs and NVIDIA AI software. Moreover, Llama 2 may be set up on a range of Dell systems, such as the PowerEdge R760xa with NVIDIA L40S. […]
[…] NVIDIA Speeds up MLPerf Standards Generative AI Training […]
[…] the help of an unholy mix of Nvidia and AMD technology, Cyberpunk 2077 is able to achieve a framerate that is three times higher than before. […]