AMD Instinct MI300 GPU: 3D die-stacking, HBM3, PCIe 5.0, 600W+ power

AMD's next-gen Instinct MI300: CDNA 3 GPU with 5nm and 6nm + 3D die-stacking + 8 x HBM3 stack memory + PCIe 5.0 + 600W+ of power.

Published Apr 28, 2022 9:49 PM CDT   |   Updated Sat, May 21 2022 2:56 AM CDT
1 minute & 45 seconds read time

AMD has been featured considerably in new leaks from Moore's Law is Dead, with Tom providing some more details on AMD's next-gen Instinct MI300 accelerator.

AMD Instinct MI300 GPU: 3D die-stacking, HBM3, PCIe 5.0, 600W+ power 01

The new AMD Instinct MI300 accelerator will be the next-gen datacenter-focused GPU, where we should see multiple versions of it hitting the market. In the new leaks, the fact is made clear: "the first thing that needs to be made clear is every source tells me (Tom @ MLID) there are many variants of MI300. The one I am detailing today is just one I'm familiar with".

With the most confidence in the leaks, we're being told to expect that each 6nm die has connections for two stacks of HBM3 memory, with 12+ metal layers in total. The 6nm dies were built to "work with multiple products" that can be stacked on top. The MI300 design itself has a bottom layer that should be occupied mostly with a huge interpose (around 2750mm2 which is insane). On top of the interposer is reportedly a "series of rectangular 6nm tiles that house I/O controllers, IP Blocks, "and likely cache" of around 320-360mm2 per 6nm tile according to Tom.

Each of the Compute Dies would measure in at around 110mm2, with the interposer arriving at 2750mm2 -- absolutely mammoth -- with the Compute Dies having around 20,000 connections each. This might not sound like much if you don't know about the die connections, but that's double the connections between the dies than the super-fast new Apple M1 Ultra SoC.

We should see 1 x 6nm + 1 x 5nm tile using 150W of power, so a full high-end Instinct MI300 accelerator should push up to 600W or so.

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering.

Newsletter Subscription

    Related Tags

    Newsletter Subscription
    Latest News
    View More News
    Latest Reviews
    View More Reviews
    Latest Articles
    View More Articles