Samsung Intros 9.8 Gbps HBM3E “Shinebolt”, 32 Gbps GDDR7, 7.5 Gbps LPDDR5x Cam2 Memory
During its Memory Tech Day 2023, Samsung formally unveiled its next-generation memory technologies, including HBM3E, GDDR7, LPDDR5x CAMM2, and more.
Samsung Makes a Major Investment in Next-Gen Memory Technologies, Including HBM3E, GDDR7, LPDDR5x, CAMM2, and More
For the newest in artificial intelligence, gaming, and data centre applications, Samsung HBM3E memory dubbed “Shine Bolt” and GDDR7 have already been reported on. These two events can be considered the Memory Tech Day 2023’s two main highlights, but Samsung is undoubtedly hosting a lot more events.
HBM Memory Specifications Comparison
DRAM | HBM1 | HBM2 | HBM2E | HBM3 | HBM3 GEN2 | HBMNEXT (HBM4) |
---|---|---|---|---|---|---|
I/O (Bus Interface) | 1024 | 1024 | 1024 | 1024 | 1024-2048 | 1024-2048 |
Prefetch (I/O) | 2 | 2 | 2 | 2 | 2 | 2 |
Maximum Bandwidth | 128 GB/s | 256 GB/s | 460.8 GB/s | 819.2 GB/s | 1.2 TB/s | 1.5 – 2.0 TB/s |
DRAM ICs Per Stack | 4 | 8 | 8 | 12 | 8-12 | 8-12 |
Maximum Capacity | 4 GB | 8 GB | 16 GB | 24 GB | 24 – 36 GB | 36-64 GB |
tRC | 48ns | 45ns | 45ns | TBA | TBA | TBA |
tCCD | 2ns (=1tCK) | 2ns (=1tCK) | 2ns (=1tCK) | TBA | TBA | TBA |
VPP | External VPP | External VPP | External VPP | External VPP | External VPP | TBA |
VDD | 1.2V | 1.2V | 1.2V | TBA | TBA | TBA |
Command Input | Dual Command | Dual Command | Dual Command | Dual Command | Dual Command | Dual Command |
“Shinebolt” Samsung HBM3E Memory For AI & Data Centres
Samsung today unveiled Shinebolt, its next-generation HBM3E DRAM, building on the company’s experience in commercialising the sector’s first HBM2 and developing the HBM market for high-performance computing (HPC) in 2016. Next-generation AI applications will be powered by Samsung’s Shinebolt, which will lower total cost of ownership (TCO) and hasten inference and training of AI models in the data centre.
The HBM3E can transfer data at rates greater than 1.2 terabytes per second (TBps) thanks to its remarkable 9.8 gigabits per second (Gbps) per pin performance. Samsung has optimised its non-conductive film (NCF) technology to remove gaps between chip layers and maximise thermal conductivity in order to enable higher-layer stacks and improve thermal characteristics. Shinebolt samples are presently being sent to clients, and Samsung’s 8H and 12H HBM3 devices are currently in mass manufacturing.
The business also intends to provide a unique turnkey service that integrates next-generation HBM, cutting-edge packaging technologies, and foundry options, leaning on its position as a whole semiconductor solutions supplier.
GDDR Graphics Memory Evolution:
GRAPHICS MEMORY | GDDR5X | GDDR6 | GDDR6X | GDDR7 |
---|---|---|---|---|
Workload | Gaming | Gaming / AI | Gaming / AI | Gaming / AI |
Platform (Example) | GeForce GTX 1080 Ti | GeForce RTX 2080 Ti | GeForce RTX 4090 | GeForce RTX 5090? |
Number of Placements | 12 | 12 | 12 | 12? |
Gb/s/pin | 11.4 | 14-16 | 19-24 | 32-36 |
GB/s/placement | 45 | 56-64 | 76-96 | 128-144 |
GB/s/system | 547 | 672-768 | 912-1152 | 1536-1728 |
Configuration (Example) | 384 IO (12pcs x 32 IO package) | 384 IO (12pcs x 32 IO package) | 384 IO (12pcs x 32 IO package) | 384 IO (12pcs x 32 IO package)? |
Frame Buffer of Typical System | 12GB | 12GB | 24 GB | 24 GB? |
Average Device Power (pJ/bit) | 8.0 | 7.5 | 7.25 | TBD |
Typical IO Channel | PCB (P2P SM) | PCB (P2P SM) | PCB (P2P SM) | PCB (P2P SM) |
Next-Generation Gaming Graphics With 32 Gbps & 32 Gb DRAM From Samsung
Other products shown at the event include the 32Gb DDR5 DRAM with the greatest capacity in the industry, the first 32Gbps GDDR7 in the market, and the petabyte-scale PBSSD, which significantly improves server application storage capabilities.
Samsung claims that GDDR7 memory will perform 40% better and use 20% less power than the 24 Gbps GDDR6 DRAM currently available, which has a 16 Gb die capacity. A 384-bit bus interface solution will be used to achieve up to 1.5 TB/s of bandwidth with the first devices, which will be rated at transfer speeds of up to 32 Gbps, a 33% improvement over GDDR6 memory.
The bandwidth that the 32 Gbps pin speeds would provide for various bus designs is as follows:
- 2048 GB/s (512 bits) or 2.0 TB/s
- 384-bit, 1.5 TB/s, 1536 GB/s
- 1.3 TB/s, 320-bit, 1280 GB/s
- 1024 GB/s (256 bits) and 1.0 TB/s
- 768 GB/s at 192 bits
- 512 GB/s at 128 bits
The business has also tested early prototypes with speeds of up to 36 Gbps, but we don’t think those will be ready in sufficient bulk quantities to fill the lineups for the next-generation gaming and AI GPUs.
Additionally, GDDR7 memory will be 20% more efficient, which is fantastic given how much power memory uses on high-end GPUs. According to reports, the Samsung GDDR7 DRAM will have technology that is especially suited for high-speed workloads, as well as a low-operating voltage alternative created for applications with careful power consumption, such laptops.
The new memory standard for thermals will make use of an epoxy moulding compound (EMC) with high thermal conductivity, which lowers thermal resistance by up to 70%. Back in August, it was revealed that Samsung was giving NVIDIA samples of their GDDR7 DRAM for an early assessment of its next gaming graphics cards.
Samsung LPDDR5x Reduces Mobile Designs and Next-Gen CAMM2 Modules
Today’s AI technologies are heading towards a hybrid paradigm that divides and distributes workload among cloud and edge devices in order to process data-intensive activities. As a result, Samsung unveiled a selection of memory solutions that support edge computing with high-performance, high-capacity, low-power, and tiny form factors.
The company also displayed its 9.6Gbps LPDDR5X DRAM, LLW DRAM specialised for on-device AI, next-generation Universal Flash Storage (UFS), and the high-capacity Quad-Level Cell (QLC) SSD BM9C1 for PCs, which is anticipated to be a true game changer in the next-generation PC and laptop DRAM market.
GPU Memory Technology Updates
GRAPHICS CARD NAME | MEMORY TECHNOLOGY | MEMORY SPEED | MEMORY BUS | MEMORY BANDWIDTH | RELEASE |
---|---|---|---|---|---|
AMD Radeon R9 Fury X | HBM1 | 1.0 Gbps | 4096-bit | 512 GB/s | 2015 |
NVIDIA GTX 1080 | GDDR5X | 10.0 Gbps | 256-bit | 320 GB/s | 2016 |
NVIDIA Tesla P100 | HBM2 | 1.4 Gbps | 4096-bit | 720 GB/s | 2016 |
NVIDIA Titan Xp | GDDR5X | 11.4 Gbps | 384-bit | 547 GB/s | 2017 |
AMD RX Vega 64 | HBM2 | 1.9 Gbps | 2048-bit | 483 GB/s | 2017 |
NVIDIA Titan V | HBM2 | 1.7 Gbps | 3072-bit | 652 GB/s | 2017 |
NVIDIA Tesla V100 | HBM2 | 1.7 Gbps | 4096-bit | 901 GB/s | 2017 |
NVIDIA RTX 2080 Ti | GDDR6 | 14.0 Gbps | 384-bit | 672 GB/s | 2018 |
AMD Instinct MI100 | HBM2 | 2.4 Gbps | 4096-bit | 1229 GB/s | 2020 |
NVIDIA A100 80 GB | HBM2e | 3.2 Gbps | 5120-bit | 2039 GB/s | 2020 |
NVIDIA RTX 3090 | GDDR6X | 19.5 Gbps | 384-bit | 936.2 GB/s | 2020 |
AMD Instinct MI200 | HBM2e | 3.2 Gbps | 8192-bit | 3200 GB/s | 2021 |
NVIDIA RTX 3090 Ti | GDDR6X | 21.0 Gbps | 384-bit | 1008 GB/s | 2022 |
NVIDIA H100 80 GB | HBM3/E | 2.6 Gbps | 5120-bit | 1681 GB/s | 2022 |
[…] Samsung Honors Innovation with Galaxy Z Flip5 Retro […]