Wednesday, April 17, 2024

Qualcomm Cloud AI 100 Ultra Launch : Latest Tech Wonder!

They are very happy to announce the launch of the Qualcomm Cloud AI 100 Ultra in the future

Cloud-based artificial intelligence inferencing with high performance and cost optimization for generative AI

The Qualcomm Cloud AI 100 Ultra is a new addition of our line of cloud artificial intelligence (AI) Inference cards. It was developed specifically for large language models (LLMs) and generative AI. Yesterday, we are pleased to announce its availability.

The Qualcomm Cloud AI 100 Ultra makes advantage of Qualcomm’s industry-leading AI cores to give up to four times the performance of the previous generation. This enables best-in-class performance for each dollar spent on total cost of ownership (TCO). It is able to accommodate 100 billion parameter models on a single 150-watt card, 175 billion parameter models with two cards, and even bigger models via the use of multiple Qualcomm Cloud AI 100 Ultra cards with the help of our Qualcomm AI Stack and Cloud AI SDK.

A programmable AI accelerator, the Qualcomm Cloud AI 100 Ultra is able to accommodate current breakthroughs in AI methodologies as well as data format developments. It does this by using the Qualcomm AI Stack, which enables users to “Train anywhere and Infer on Qualcomm Cloud AI 100 Ultra.” This facilitates the process of porting and improving the users’ models.

The server known as the HPE ProLiant DL380a Gen 11 from Hewlett Packard Enterprise (HPE) will be used to provide support for the Qualcomm Cloud AI 100 Ultra. This particular server was developed for accelerator-optimized generative AI workloads, such as natural language processing (NLP).

The executive vice president and general manager of high-performance cloud computing, artificial intelligence, and laboratories of HPE is named Justin Hotard.

Enterprises will need an AI-native infrastructure that is purpose-built to accommodate any step of their journey, including inferencing, in order to harness the value that can be derived from generative artificial intelligence (AI). We are excited to be working with Qualcomm to provide our clients with a computing solution that is optimized for inference and delivers the performance as well as the power economy required to install and accelerate AI inference at scale.

Cloud AI 100 ultra
image credit to Qualcomm

The Qualcomm Cloud AI 100 Ultra is a revolutionary piece of technology since it enables the deployment of an astounding 100 billion parameter model on a single-width, energy-efficient 150W card. This establishes a new benchmark for the industry.

The solution does this by leveraging the power of the top training technology developed by Cerebras and combining it with the Qualcomm Cloud AI 100 Ultra. The result is a system that achieves the ideal mix between lightning-fast training and unrivaled performance per TCO dollar for inference deployment. Customers that are looking forward in a market that is changing quickly will naturally gravitate toward this high-performance solution, which is encased inside an intelligent and resilient ecosystem.

In cloud and corporate use cases, Qualcomm Cloud AI 100 Ultra provides two to five times the performance per total cost of ownership (TCO) dollar across generative AI workloads such as LLMs, NLP, and computer vision workloads. This enables our clients to optimize their return on investments. Because of its combination of pricing and performance, power-efficiency, scalability, and security, it is the best option for businesses that want to adopt cutting-edge AI and alter their operations while also supporting their sustainability goals.

The following is what Core42 Executive Vice President, Chief Product and Global Partnerships Officer Talal Al Kaissi had to say about the company:

Core42, which is a subsidiary of G42, is a provider of enterprise cloud and AI solutions on a national scale. These solutions are provided by working with global technology giants who are bringing transformative ideas to market. In order to facilitate the development of scalable and long-term AI inference solutions, Qualcomm’s Cloud AI 100 Ultra claims to give excellent performance at a fraction of the power consumption and cost. They are excited to continue collaborating closely with Qualcomm and look forward to expanding our partnership.

Samsung has been leading the way in artificial intelligence for over a decade, and with the Qualcomm Network AI 100 Ultra, the company assurances transformational performance and efficiency.

This solution gives businesses a chance to take advantage of the promise of artificial intelligence (AI) to produce profitable outcomes through the integration of our industry-leading AI cores with our knowledge in low-power architecture. Embrace the future of generative artificial intelligence with the Qualcomm Cloud AI 100 Ultra, a solution that brings together creativity and efficiency.




Please enter your comment!
Please enter your name here

Recent Posts

Popular Post Would you like to receive notifications on latest updates? No Yes