EVGA

Samsung Develops Industry-First 36GB HBM3E 12H DRAM

Author
rjohnson11
EVGA Forum Moderator
  • Total Posts : 102263
  • Reward points : 0
  • Joined: 2004/10/05 12:44:35
  • Location: Netherlands
  • Status: online
  • Ribbons : 84
2024/02/27 01:04:48 (permalink)
https://www.techpowerup.com/319655/samsung-develops-industry-first-36gb-hbm3e-12h-dram
 
Samsung Electronics, a world leader in advanced memory technology, today announced that it has developed HBM3E 12H, the industry's first 12-stack HBM3E DRAM and the highest-capacity HBM product to date. Samsung's HBM3E 12H provides an all-time high bandwidth of up to 1,280 gigabytes per second (GB/s) and an industry-leading capacity of 36 gigabytes (GB). In comparison to the 8-stack HBM3 8H, both aspects have improved by more than 50%.

"The industry's AI service providers are increasingly requiring HBM with higher capacity, and our new HBM3E 12H product has been designed to answer that need," said Yongcheol Bae, Executive Vice President of Memory Product Planning at Samsung Electronics. "This new memory solution forms part of our drive toward developing core technologies for high-stack HBM and providing technological leadership for the high-capacity HBM market in the AI era."
 
The HBM3E 12H applies advanced thermal compression non-conductive film (TC NCF), allowing the 12-layer products to have the same height specification as 8-layer ones to meet current HBM package requirements. The technology is anticipated to have added benefits especially with higher stacks as the industry seeks to mitigate chip die warping that come with thinner die. Samsung has continued to lower the thickness of its NCF material and achieved the industry's smallest gap between chips at seven micrometers (µm), while also eliminating voids between layers. These efforts result in enhanced vertical density by over 20% compared to its HBM3 8H product.

Samsung's advanced TC NCF also improves thermal properties of the HBM by enabling the use of bumps in various sizes between the chips. During the chip bonding process, smaller bumps are used in areas for signaling and larger ones are placed in spots that require heat dissipation. This method also helps with higher product yield.

As AI applications grow exponentially, the HBM3E 12H is expected to be an optimal solution for future systems that require more memory. Its higher performance and capacity will especially allow customers to manage their resources more flexibly and reduce total cost of ownership (TCO) for datacenters. When used in AI applications, it is estimated that, in comparison to adopting HBM3 8H, the average speed for AI training can be increased by 34% while the number of simultaneous users of inference services can be expanded more than 11.5 times.

Samsung has begun sampling its HBM3E 12H to customers and mass production is slated for the first half of this year.
 
That is some really fantastic speed gains for AI memory applications. 

AMD Ryzen 9 7950X,  Corsair Mp700 Pro M.2, 64GB Corsair Dominator Titanium DDR5  X670E Steel Legend, MSI RTX 4090 Associate Code: H5U80QBH6BH0AXF. I am NOT an employee of EVGA

#1

1 Reply Related Threads

    donta1979
    Primarch
    • Total Posts : 15886
    • Reward points : 0
    • Joined: 2007/02/11 19:27:15
    • Location: In the land of Florida Man!
    • Status: offline
    • Ribbons : 72
    Re: Samsung Develops Industry-First 36GB HBM3E 12H DRAM 2024/03/01 22:16:16 (permalink)
    Hopefully this means we will stop getting high end gpu's with janky micron vram.... I am hoping Samsung comes out with DDR5 that is a new type of say b-die that lets modern cpu's run fast ddr5 kits with the cpu IMC at 100% speed. *wishful thinking*

    Heatware   

    Retired from AAA Game Industry
    Jeep Wranglers, English Bulldog Rescue
    USAF, USANG, US ARMY Combat Veteran
    My Build
    Intel Core I9 13900K@6.1ghz, ASUS ROG Ryujin III 360 ARGB, 32gb G.Skill Trident Z5 RGB 7200mhz CL34 DDR5, ASUS Rog Strix Z790-E, ASUS Rog Strix OC 4090, ASUS ROG Wingwall Graphics Card Holder, Seagate limited Edition Cyberpunk 2077 m.2, 2x Samsung 980 m.2 1TB's, 980 & 990 Pro m.2 2TB's, ASUS ROG Hyperion GR701, ASUS ROG Thor 1200W Platinum II, Cablemod RT-Series Pro ModMesh Sleeved 12VHPWR Carbon, ASUS Rog Swift PG35VQ 35", Acer EI342CKR Pbmiippx 34", ROG Harpe Ace Aim Lab Edition mouse, Rog Claymore II keyboard, TCL home entertainment Sound Bar w/Wireless Sub, Steelseries Johnny Silverhand Headset Microsoft Cyberpunk 2077 Xbox controller
    #2
    Jump to:
  • Back to Mobile