Benefits of Intel Oracle Cloud Partnership
Oracle has just recently issued an announcement on the general availability of the bare metal Compute instance BM.GPU.H100.8 with 4th Generation Intel Xeon Scalable Processors for use in the Oracle Cloud Infrastructure (OCI). In the past, this situation was referred to by its codename, which was Sapphire Rapids. This blog contains statements made by Sagar Rawal, Vice President of Compute Product Management, about himself. These statements are as follows:
This server, which features a graphics processing unit (GPU) crafted by NVIDIA and manufactured by NVIDIA H100, has had two Intel Sapphire Rapids CPUs placed in it. The server now has a total of 112 high-frequency CPU cores, which enables it to perform the preparation of AI training and inference tasks in a timely manner. The server is capable of reaching a maximum turbo rate of 3.8 GHz, with a base speed of 2.0 GHz.
AI Innovations
With the new Intel Sapphire Rapids, the PCIE bandwidth of our previous generation has been raised by a factor of four, and the number of PCIE lanes has been increased by a factor of two. We placed a great amount of attention on minimizing the amount of time it took us to get our product to market. Our project’s development schedule was best accommodated by Intel’s Sapphire Rapids CPU, which also gives exceptional performance when paired with NVIDIA’s H100 GPU. This combination also offers the best overall performance.
Xeon has also been gathering AI proof points across a broad array of industry benchmarks and partner performance testing in addition to this. Intel presented a live demonstration at Oracle CloudWorld 2023 that was centered on the Falcon 7B parameter LLM. During the demonstration, essential technologies that were developed through cooperation between Intel and Hugging Face were utilized.
According to Jeremy Rader, General Manager of Xeon Market Readiness for the Intel DCAI Group, “Intel is working with OCI to evaluate LLMs based on 4th Generation Intel Xeon Scalable processors.” “We look forward to extending our twenty-plus year relationship with Oracle and partnership with OCI to deliver the most choice on the world’s clouds,” said Rader further.
[…] Intel Cloud Optimization on AWS […]