{"id":62806,"date":"2024-12-27T05:49:48","date_gmt":"2024-12-27T05:49:48","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2024\/12\/27\/leaks-reveal-beefed-up-specifications-for-nvidias-next-gen-gb300-ai-server\/"},"modified":"2024-12-27T05:51:21","modified_gmt":"2024-12-27T05:51:21","slug":"leaks-reveal-beefed-up-specifications-for-nvidias-next-gen-gb300-ai-server","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2024\/12\/27\/leaks-reveal-beefed-up-specifications-for-nvidias-next-gen-gb300-ai-server\/","title":{"rendered":"Leaks reveal beefed-up specifications for Nvidia’s next-gen GB300 AI server"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n

Particulars of Nvidia Corp.\u2019s<\/a> subsequent technology synthetic intelligence server, the GB300 platform, have been leaked by Chinese language media, and it\u2019s anticipated to ship some huge enhancements by way of reminiscence, efficiency, connectivity and cooling.<\/p>\n

The world\u2019s most dear chipmaker is anticipated to announce the GB300 AI server at its annual GTC occasion, slated to happen in March 2025, but when it hoped to maintain the brand new platform underneath wraps till then, it seems to have failed to take action.<\/p>\n

The Chinese language language media web site UDN claims<\/a> that provide chain sources have revealed detailed specs in regards to the new server. The GB300, which will probably be powered by Nvidia\u2019s most superior Blackwell graphics processing units<\/a>, will reportedly include a big enhance in reminiscence, with 288 gigabytes of HBM3e random-access reminiscence, in contrast with simply 192 gigabytes on its predecessor, the GB200 AI server<\/a>.<\/p>\n

As well as, Nvidia has altered the structure from eight layers to 12, whereas the computing motherboard now makes use of a Low Energy Compression Hooked up Reminiscence Module.<\/p>\n

The Nvidia B300 chips that sit on the coronary heart of the GB300 would require 1,400 watts of energy, and the networking pace has been upgraded with the change from ConnectX 7 to ConnectX 8, increasing bandwidth from 800 gigabits per second to 1.6 terabits per second.<\/p>\n

The report additionally mentions a 50% enhance in FP4 efficiency in comparison with the GB200. The choice to make use of FP4, which stands for 4 bits of floating-point precision per operation, is outwardly one of many primary causes individuals are so excited in regards to the GB300. The diminished precision gained by shifting to FP4 interprets to quicker compute, diminished information motion and decrease energy consumption, making it higher suited to AI inference workloads.<\/p>\n

\"\"<\/p>\n

There are different upgrades too, with using a brand new \u201cslot design\u201d set to be launched within the GB300 server and a brand new capacitor tray.<\/p>\n

UDN says the upgrades imply that the efficiency of the GB300 server will enhance on that of the GB200 \u201cin all features.\u201d It provides that the server stands out as Nvidia\u2019s \u201csubsequent market-grabbing weapon.\u201d<\/p>\n

Not surprisingly, although, these improved specs come at a substantial value, and the GB300 is more likely to command a mind-blowing price ticket. In keeping with UDN, its provide chain sources estimate that the overall manufacturing value of a single supercapacitor within the GB300 will come to between $20,000 and $25,000. With the GB300\u2019s NVL72 AI server cupboard requiring over 300 of these supercapacitors, prospects comparable to Amazon Net Providers Inc., Microsoft Corp. and Google LLC can anticipate to pay a minimum of $7.5 million to fill one up.<\/p>\n

What isn\u2019t clear is when the GB300 will go into mass manufacturing. Its predecessor, the GB200, continues to be not at peak manufacturing and shipments aren\u2019t anticipated to peak till the center of subsequent 12 months, following delays that stemmed from late-stage design flaws<\/a> within the Blackwell GPUs, which reportedly precipitated overheating points.<\/p>\n

The setbacks imply that Nvidia has an order backlog of round one 12 months. That\u2019s as a result of the AI growth has led to intense demand for computing capability, and Nvidia\u2019s GPUs are typically seen as the perfect within the enterprise. As such, Nvidia\u2019s market capitalization has risen greater than $3 trillion, making it one of many three most dear corporations on the planet.<\/p>\n

Although the main focus has been on enterprises up to now, Nvidia can also be set to roll out its first consumer-grade Blackwell GPUs, and insiders say we could effectively hear extra about these throughout subsequent month\u2019s Client Electronics Present.<\/p>\n

Picture: SiliconANGLE\/Meta AI<\/h5>\n
\n
\n

Your vote of help is essential to us and it helps us hold the content material FREE.<\/span><\/h3>\n

One click on under helps our mission to supply free, deep, and related content material. \u00a0<\/span><\/h3>\n

Join our community on YouTube<\/a><\/h3>\n

Be part of the group that features greater than 15,000 #CubeAlumni specialists, together with Amazon.com CEO Andy Jassy, Dell Applied sciences founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and lots of extra luminaries and specialists.<\/span><\/h3>\n
\n

\u201cTheCUBE\u00a0is a crucial accomplice to the business. You guys actually are part of our occasions and we actually admire you coming and I do know folks admire the\u00a0content material you create as effectively\u201d \u2013 Andy Jassy<\/strong><\/figure>\n<\/p>\n<\/div>\n

THANK YOU<\/strong><\/p>\n<\/div><\/div>\n