{"id":82959,"date":"2025-06-25T20:33:05","date_gmt":"2025-06-25T20:33:05","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/"},"modified":"2025-06-25T20:34:19","modified_gmt":"2025-06-25T20:34:19","slug":"an-introduction-to-rack-scale-networking-the-register","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/","title":{"rendered":"An introduction to rack-scale networking \u2022 The Register"},"content":{"rendered":"<p> <a href=\"https:\/\/go.fiverr.com\/visit\/?bta=1052423&nci=17043\" Target=\"_Top\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/fiverr.ck-cdn.com\/tn\/serve\/?cid=40081059\"  width=\"601\" height=\"201\"><\/a>\n<\/p>\n<div id=\"body\">\n<p><span class=\"label\">Evaluation<\/span> For those who thought AI networks weren&#8217;t difficult sufficient, the rise of rack-scale architectures from the likes of Nvidia, AMD, and shortly Intel has launched a brand new layer of complexity.<\/p>\n<p>In comparison with the scale-out networks, which generally use Ethernet or InfiniBand, the scale-up materials on the coronary heart of those programs usually make use of proprietary, or on the very least rising, interconnect applied sciences that provide a number of orders of magnitude greater bandwidth per accelerator.<\/p>\n<p>As an illustration, Nvidia&#8217;s fifth-gen NVLink interconnect delivers between 9x and 18x greater mixture bandwidth to every accelerator than Ethernet or InfiniBand at this time.<\/p>\n<div aria-hidden=\"true\" class=\"adun\" data-pos=\"top\" data-raptor=\"condor\" data-xsm=\",fluid,mpu,\" data-sm=\",fluid,mpu,\" data-md=\",fluid,mpu,\">\n        <noscript><br \/>\n            <a href=\"https:\/\/pubads.g.doubleclick.net\/gampad\/jump?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=2&amp;c=2aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0\" target=\"_blank\"><br \/>\n                <img decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/pubads.g.doubleclick.net\/gampad\/ad?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=2&amp;c=2aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0\" alt=\"\"\/><br \/>\n            <\/a><br \/>\n        <\/noscript>\n    <\/div>\n<p>This bandwidth implies that GPU compute and reminiscence could be pooled, though they&#8217;re bodily distributed throughout a number of distinct servers. Nvidia CEO Jensen Huang wasn&#8217;t kidding when he known as the GB200 NVL72 &#8220;one large GPU.&#8221;<\/p>\n<div aria-hidden=\"true\" class=\"adun\" data-pos=\"top\" data-raptor=\"falcon\" data-xmd=\",fluid,mpu,leaderboard,\" data-lg=\",fluid,mpu,leaderboard,\" data-xlg=\",fluid,billboard,superleaderboard,mpu,leaderboard,\" data-xxlg=\",fluid,billboard,superleaderboard,brandwidth,brandimpact,leaderboard,mpu,\">\n            <noscript><br \/>\n                <a href=\"https:\/\/pubads.g.doubleclick.net\/gampad\/jump?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=4&amp;c=44aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0\" target=\"_blank\"><br \/>\n                    <img decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/pubads.g.doubleclick.net\/gampad\/ad?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=4&amp;c=44aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D426raptor%3Dfalcon%26pos%3Dmid%26test%3D0\" alt=\"\"\/><br \/>\n                <\/a><br \/>\n            <\/noscript>\n        <\/div>\n<div class=\"adun_eagle_desktop_story_wrapper\">\n<div aria-hidden=\"true\" class=\"adun\" data-pos=\"mid\" data-raptor=\"eagle\" data-xxlg=\",mpu,dmpu,\">\n                <noscript><br \/>\n                    <a href=\"https:\/\/pubads.g.doubleclick.net\/gampad\/jump?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=3&amp;c=33aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0\" target=\"_blank\"><br \/>\n                        <img decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/pubads.g.doubleclick.net\/gampad\/ad?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=3&amp;c=33aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0\" alt=\"\"\/><br \/>\n                    <\/a><br \/>\n                <\/noscript>\n            <\/div>\n<\/p><\/div>\n<p>The transition to those rack-scale architectures is being pushed in no small half by the calls for of mannequin builders, like OpenAI and Meta, and they&#8217;re primarily aimed toward hyperscale cloud suppliers, neo-cloud operators like CoreWeave or Lambda, and enormous enterprises that have to maintain their AI workloads on-prem.<\/p>\n<p>Given this goal market, these machines aren&#8217;t low-cost. Our sibling web site <em>The Subsequent Platform<\/em> <a target=\"_blank\" href=\"https:\/\/www.nextplatform.com\/2024\/03\/20\/aws-and-nvidia-reboot-ceiba-supercomputer-for-blackwell-gpus\/\">estimates<\/a> the price of a single NVL72 rack at $3.5 million.<\/p>\n<div aria-hidden=\"true\" class=\"adun\" data-pos=\"top\" data-raptor=\"falcon\" data-xsm=\",fluid,mpu,\" data-sm=\",fluid,mpu,\" data-md=\",fluid,mpu,\">\n            <noscript><br \/>\n                <a href=\"https:\/\/pubads.g.doubleclick.net\/gampad\/jump?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=4&amp;c=44aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0\" target=\"_blank\"><br \/>\n                    <img decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/pubads.g.doubleclick.net\/gampad\/ad?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=4&amp;c=44aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D426raptor%3Dfalcon%26pos%3Dmid%26test%3D0\" alt=\"\"\/><br \/>\n                <\/a><br \/>\n            <\/noscript>\n        <\/div>\n<p>To be clear, the scale-up materials that make these rack-scale architectures attainable aren&#8217;t precisely new. It is simply that till now, they&#8217;ve not often prolonged past a single node and often topped out at eight GPUs. As an illustration, here is a take a look at the scale-up cloth discovered inside AMD&#8217;s newly <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2025\/06\/12\/amd_mi355x\/\">announced<\/a> MI350-series programs.<\/p>\n<div class=\"CaptionedImage Border width_85\"><a href=\"https:\/\/regmedia.co.uk\/2025\/06\/12\/mi350x_oam_config.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/regmedia.co.uk\/2025\/06\/12\/mi350x_oam_config.jpg?x=442&amp;y=366&amp;infer_y=1\" alt=\"AMD's MI350-series GPU sticks with a fairly standard configuration with eight GPUs coupled to an equal number of 400Gbps NICs and a pair of x86 CPUs\" title=\"AMD's MI350-series GPU sticks with a fairly standard configuration with eight GPUs coupled to an equal number of 400Gbps NICs and a pair of x86 CPUs\" height=\"366\" width=\"442\"\/><\/a><\/p>\n<p class=\"text_center\">AMD&#8217;s MI350-series GPU sticks with a reasonably normal configuration with eight GPUs coupled to an equal variety of 400Gbps NICs and a pair of x86 CPUs &#8211; Click on to enlarge<\/p>\n<\/div>\n<p>As you&#8217;ll be able to see, every chip connects the opposite seven in an all-to-all topology.<\/p>\n<p>Nvidia&#8217;s HGX design follows the identical primary template for its 4 GPU H100 programs, however provides 4 NVLink switches to the combination for its extra ubiquitous eight GPU nodes. Whereas Nvidia <a target=\"_blank\" rel=\"nofollow\" href=\"https:\/\/developer.nvidia.com\/blog\/nvidia-nvlink-and-nvidia-nvswitch-supercharge-large-language-model-inference\/?ncid=no-ncid\">says<\/a> these switches benefit from chopping down on communication time, in addition they add complexity.<\/p>\n<div class=\"CaptionedImage Border width_85\"><a href=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/nvidia_nvl8_config.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/nvidia_nvl8_config.jpg?x=648&amp;y=414&amp;infer_y=1\" alt=\"Rather than an all-to-all mesh, like we see in AMD's 8-GPU nodes, Nvidia's HGX architecture has employed NVLink switches to mesh its GPUs together going back to the Volta generation\" title=\"Rather than an all-to-all mesh, like we see in AMD's 8-GPU nodes, Nvidia's HGX architecture has employed NVLink switches to mesh its GPUs together going back to the Volta generation\" height=\"414\" width=\"648\"\/><\/a><\/p>\n<p class=\"text_center\">Reasonably than an all-to-all mesh, like we see in AMD&#8217;s 8-GPU nodes, Nvidia&#8217;s HGX structure has employed NVLink switches to mesh its GPUs collectively going again to the Volta era &#8211; Click on to enlarge<\/p>\n<\/div>\n<p>With the transfer to rack scale, this similar primary topology is just scaled up \u2014 at the least for Nvidia&#8217;s NVL programs. For AMD, an all-to-all mesh merely is not sufficient, and switches develop into unavoidable.\u00a0<\/p>\n<h3 class=\"crosshead\">Diving into Nvidia&#8217;s NVL72 scale-up structure<\/h3>\n<p>We&#8217;ll dig into the Home of Zen&#8217;s upcoming Helios racks in a bit, however first let&#8217;s check out Nvidia&#8217;s NVL72. Since it has been out there a short time longer, we all know a good bit extra about it.<\/p>\n<p>As a fast reminder, the rack-scale system <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2024\/03\/21\/nvidia_dgx_gb200_nvk72\/\">features<\/a> 72 Blackwell GPUs unfold throughout 18 compute nodes. All these GPUs are related by way of 18 7.2TB\/s NVLink 5 change chips deployed in pairs throughout 9 blades.<\/p>\n<p>From what we perceive, every change ASIC options 72 ports with 800Gbps or 100GB\/s of bi-directional bandwidth every. Nvidia&#8217;s Blackwell GPUs, in the meantime, boast 1.8TB\/s of mixture bandwidth unfold throughout 18 ports \u2014 one for every change within the rack. The result&#8217;s a topology that appears a bit like this one:<\/p>\n<div class=\"CaptionedImage Center Border\"><a href=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/nvl72_topology.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/nvl72_topology.jpg?x=648&amp;y=433&amp;infer_y=1\" alt=\"Each GPU in the rack connects to two NVLink ports in each of the rack's nine NVLink 5 switches.\" title=\"Each GPU in the rack connects to two NVLink ports in each of the rack's nine NVLink 5 switches.\" height=\"433\" width=\"648\"\/><\/a><\/p>\n<p class=\"text_center\">Every GPU within the rack connects to 2 NVLink ports in every of the rack&#8217;s 9 NVLink 5 switches. &#8211; Click on to enlarge<\/p>\n<\/div>\n<p>This high-speed all-to-all interconnect cloth implies that any GPU within the rack can entry one other&#8217;s reminiscence.<\/p>\n<h3 class=\"crosshead\">Why scale-up?<\/h3>\n<p>In line with Nvidia, these huge compute domains permit the GPUs to run way more effectively. For AI coaching workloads, the GPU large estimates its GB200 NVL72 programs are as much as 4x quicker than the equal variety of H100s, though the part chips solely supply 2.5x greater efficiency on the similar precision.<\/p>\n<p>In the meantime, for inference, Nvidia <a target=\"_blank\" rel=\"nofollow\" href=\"https:\/\/www.nvidia.com\/en-us\/data-center\/gb200-nvl72\/\">says<\/a> its rack scale configuration is as much as 30x quicker \u2014 partly as a result of numerous levels of information, pipeline, tensor, and knowledgeable parallelism could be employed to reap the benefits of all that reminiscence bandwidth even when the mannequin does not essentially profit from all of the reminiscence capability or compute.<\/p>\n<p>With that mentioned, with between 13.5TB and 20TB of VRAM in Nvidia&#8217;s Grace-Blackwell-based racks, and roughly 30TB on AMD&#8217;s upcoming Helios racks, these programs are clearly designed to serve extraordinarily giant fashions like Meta&#8217;s (apparently <a target=\"_blank\" rel=\"nofollow\" href=\"https:\/\/www.wsj.com\/tech\/ai\/meta-is-delaying-the-rollout-of-its-flagship-ai-model-f4b105f7\">delayed<\/a>) two-trillion parameter Llama 4 Behemoth, which would require 4TB of reminiscence to run at BF16.<\/p>\n<div aria-hidden=\"true\" class=\"adun\" id=\"story_eagle_xsm_sm_md_xmd_lg_xlg\" data-pos=\"mid\" data-raptor=\"eagle\" data-xsm=\",mpu,dmpu,\" data-sm=\",mpu,dmpu,\" data-md=\",mpu,dmpu,\" data-xmd=\",mpu,dmpu,\" data-lg=\",mpu,dmpu,\" data-xlg=\",mpu,dmpu,\">\n            <noscript><br \/>\n                <a href=\"https:\/\/pubads.g.doubleclick.net\/gampad\/jump?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=3&amp;c=33aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0\" target=\"_blank\"><br \/>\n                    <img decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/pubads.g.doubleclick.net\/gampad\/ad?co=1&amp;iu=\/6978\/reg_onprem\/networks&amp;sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&amp;tile=3&amp;c=33aFxdAQsD13qlhmT_QvkxEAAAAAc&amp;t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0\" alt=\"\"\/><br \/>\n                <\/a><br \/>\n            <\/noscript>\n        <\/div>\n<p>Not solely are the fashions getting bigger, however the context home windows, which you&#8217;ll consider because the LLMs&#8217; brief time period reminiscence, are too. Meta&#8217;s Llama 4 Scout, for instance, is not significantly massive at 109 billion parameters \u2014 requiring simply 218GB of GPU reminiscence to run at BF16. Its 10-million-token context window, nevertheless, would require a number of instances that, particularly at greater batch sizes. (We focus on the reminiscence necessities of LLMs in <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2025\/04\/22\/llm_production_guide\/\">our guide to running LLMs in production here<\/a>.)<\/p>\n<h3 class=\"crosshead\">Speculating on AMD&#8217;s first scale-up system Helios<\/h3>\n<p>That is little doubt why AMD has additionally embraced the rack-scale structure with its MI400-series accelerators.\u00a0<\/p>\n<p>At its Advancing AI occasion earlier this month, AMD <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2025\/06\/12\/amd_helios_dc\/\">revealed<\/a> its Helios reference design. In a nutshell, the system, very like Nvidia&#8217;s NVL72, will function 72 MI400-series accelerators, 18 EPYC Venice CPUs, and AMD&#8217;s Pensando Vulcano NICs, when it arrives subsequent 12 months.<\/p>\n<p>Particulars on the system stay skinny, however we do know its scale-up cloth will supply 260TB\/s of mixture bandwidth, and can tunnel the rising UALink over Ethernet.<\/p>\n<p>For those who&#8217;re not acquainted, the rising Extremely Accelerator Hyperlink normal is an open different to NVLink for scale-up networks. The Extremely Accelerator Hyperlink Consortium just lately <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2025\/04\/08\/ualink_200g_version_1\/\">published<\/a> its first specification in April.<\/p>\n<p>At roughly 3.6TB\/s of bidirectional bandwidth per GPU, that&#8217;ll put Helios on par with Nvidia&#8217;s first-generation Vera-Rubin rack programs, additionally due out subsequent 12 months. How AMD intends to try this, we are able to solely speculate \u2014 so we did.<\/p>\n<div class=\"CaptionedImage Center Border\"><a href=\"https:\/\/regmedia.co.uk\/2025\/06\/12\/amd_helios_rack_scale_system.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/regmedia.co.uk\/2025\/06\/12\/amd_helios_rack_scale_system.jpg?x=442&amp;y=283&amp;infer_y=1\" alt=\"AMD Helios systems won't exactly fit into a standard 19&quot; rack\" title=\"AMD Helios systems won't exactly fit into a standard 19&quot; rack\" height=\"283\" width=\"442\"\/><\/a><\/p>\n<p class=\"text_center\">AMD Helios programs will not precisely match into a typical 19&#8243; rack &#8211; Click on to enlarge<\/p>\n<\/div>\n<p>Based mostly on what we noticed from AMD&#8217;s keynote, the system rack seems to function 5 change blades, with what appears to be two ASICs a bit. With 72 GPUs per rack, this configuration strikes us as a bit odd.<\/p>\n<p>The best rationalization is regardless of there being 5 change blades, there are literally solely 9 change ASICs in there. For this to work, every change chip would require 144 800Gbps ports. This can be a tad uncommon for Ethernet, however not far off from what Nvidia did with its NVLink 5 switches, albeit utilizing twice as many ASICs at half the bandwidth.<\/p>\n<p>The end result can be a topology that appears fairly just like Nvidia&#8217;s NVL72.\u00a0<\/p>\n<div class=\"CaptionedImage Center Border\"><a href=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/helios_nine_switch_topology.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/helios_nine_switch_topology.jpg?x=648&amp;y=554&amp;infer_y=1\" alt=\"The simplest way for AMD to connect 72 GPUs together would be to use nine 144-port 800Gbps switches.\" title=\"The simplest way for AMD to connect 72 GPUs together would be to use nine 144-port 800Gbps switches.\" height=\"554\" width=\"648\"\/><\/a><\/p>\n<p class=\"text_center\">The best means for AMD to attach 72 GPUs collectively can be to make use of 9 144-port 800Gbps switches. &#8211; Click on to enlarge<\/p>\n<\/div>\n<p>The tough bit is, at the least to our data, no such change ASIC able to delivering that degree of bandwidth exists at this time. Broadcom&#8217;s Tomahawk 6, which we <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2025\/06\/04\/broadcom_tomahawk_6\/\">looked at<\/a> in depth a number of weeks again, comes the closest with as much as 128 800Gbps ports and 102.4Tbps of mixture bandwidth.<\/p>\n<p>For the document, we do not know that AMD is utilizing Broadcom for Helios \u2014 it simply occurs to be one of many few publicly disclosed 102.4Tbps switches not from Nvidia.<\/p>\n<p>However even with 10 of these chips crammed into Helios, you&#8217;d nonetheless want one other 16 ports of 800Gbps Ethernet to succeed in the 260TB\/s bandwidth AMD is claiming. So what provides?<\/p>\n<p>Our greatest guess is that Helios is utilizing a distinct topology from Nvidia&#8217;s NVL72. In Nvidia&#8217;s rack-scale structure, the GPUs join to at least one one other over the NVLink Switches.<\/p>\n<p>Nevertheless, it appears like AMD&#8217;s Helios compute blades will retain the chip-to-chip mesh from the MI300-series, albeit with three mesh hyperlinks connecting every GPU to the opposite three.\u00a0<\/p>\n<div class=\"CaptionedImage Border width_85\"><a href=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/helios_compute_blade.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/helios_compute_blade.jpg\" alt=\"Assuming that AMD MI400-series GPUs retain their chip-to-chip mesh in the node, a 10 switch scale up fabric starts to make more sense.\" title=\"Assuming that AMD MI400-series GPUs retain their chip-to-chip mesh in the node, a 10 switch scale up fabric starts to make more sense.\" height=\"431\" width=\"381\"\/><\/a><\/p>\n<p class=\"text_center\">Assuming that AMD MI400-series GPUs retain their chip-to-chip mesh within the node, a ten change scale up cloth begins to make extra sense. &#8211; Click on to enlarge<\/p>\n<\/div>\n<p>That is all hypothesis after all, however the numbers do line up fairly properly.<\/p>\n<p>By our estimate, every GPU is dedicating 600GB\/s (12x 200Gbps hyperlinks) of bidirectional bandwidth to the in-node mesh and about 3TB\/s of bandwidth (60x 200Gbps hyperlinks) for the scale-up community. That works out to about 600GB\/s per change blade.<\/p>\n<div class=\"CaptionedImage Center Border\"><a href=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/helios_scale_up_topology_speculative.jpg\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mailinvest.blog\/wp-content\/themes\/breek\/assets\/images\/transparent.gif\" data-lazy=\"true\" data-src=\"https:\/\/regmedia.co.uk\/2025\/06\/25\/helios_scale_up_topology_speculative.jpg?x=648&amp;y=487&amp;infer_y=1\" alt=\"With the four GPUs in each compute blade meshed together, the scale up topology would look like this.\" title=\"With the four GPUs in each compute blade meshed together, the scale up topology would look like this.\" height=\"487\" width=\"648\"\/><\/a><\/p>\n<p class=\"text_center\">With the 4 GPUs in every compute blade meshed collectively, the dimensions up topology would seem like this. &#8211; Click on to enlarge<\/p>\n<\/div>\n<p>For those who&#8217;re pondering that is a lotta ports, we anticipate they&#8217;re going to get aggregated into round 60 800Gbps ports or probably even 30 1.6Tbps ports per compute blade. That is considerably just like what Intel did with its <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2024\/04\/09\/intel_gaudi_ai_accelerator\/\">Gaudi3 systems<\/a>. From what we perceive, the precise cabling will probably be built-in right into a blind-mate backplane similar to Nvidia&#8217;s NVL72 programs. So, in case you had been sweating the thought of getting to community the rack by hand, you&#8217;ll be able to relaxation straightforward.<\/p>\n<p>We will see a number of advantages to this strategy. If we&#8217;re proper, every Helios compute blade will operate independently of each other. Nvidia, in the meantime, has a separate SKU known as the GB200 NVL4 aimed toward HPC purposes, which meshes the 4 Blackwell GPUs collectively, just like the above diagram, however does not assist utilizing NVLink for scale-up.<\/p>\n<p>However once more, there is not any assure that is what AMD is doing \u2014 it is simply our greatest guess.<\/p>\n<h3 class=\"crosshead\">Scaling up does not imply you cease scaling out<\/h3>\n<p>You would possibly suppose the bigger compute domains enabled by AMD and Nvidia&#8217;s rack-scale architectures would imply the Ethernet, InfiniBand, or OmniPath \u2014 sure they&#8217;re again! \u2014 would take a again seat.<\/p>\n<p>In actuality, these scale-up networks cannot scale a lot past a rack. The copper flyover cables utilized in programs like Nvidia&#8217;s NVL72 and presumably AMD&#8217;s Helios simply cannot attain that far.<\/p>\n<p>As we have beforehand <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2024\/11\/28\/ai_copper_cables_limits\/\">explored<\/a>, silicon photonics has the potential to alter that, however the know-how faces its personal hurdles with regard to integration. We don\u2019t think about Nvidia is charting a course towards 600kW racks as a result of it needs to, however fairly as a result of it anticipates the photonics tech vital for these scale-up networks to flee the rack gained\u2019t be prepared in time.<\/p>\n<p>So in case you want greater than 72 GPUs \u2014 and in case you&#8217;re doing any type of coaching, you undoubtedly do \u2014 you continue to want a scale-out cloth. In reality, you want two. One for coordinating compute on the back-end and one for information ingest on the front-end.<\/p>\n<p>Rack-scale does not seem to have diminished the quantity of scale-out bandwidth required both. For its NVL72 at the least, Nvidia has caught with a 1:1 ratio of NICs to GPUs this era. Often there are one other two NIC or information processing unit (DPU) ports per blade for the traditional front-end community to maneuver information out and in of storage and so forth.<\/p>\n<p>This is smart for coaching, however might not be strictly vital for inference in case your workload can match inside a single 72-GPU compute and reminiscence area. Spoiler alert: except you are operating some huge proprietary mannequin, the main points for which are not identified, you most likely can.<\/p>\n<p>The excellent news is we&#8217;re about to see some critically excessive radix switches hit the market over the subsequent six to 12 months.<\/p>\n<p>We have already talked about Broadcom&#8217;s Tomahawk 6, which can assist wherever from 64 1.6Tbps ports to 1,024 100Gbps ports. However there&#8217;s additionally Nvidia&#8217;s Spectrum-X SN6810 due out subsequent 12 months, which can supply as much as 128 800Gbps ports and can use silicon photonics <a target=\"_blank\" href=\"https:\/\/www.theregister.com\/2025\/03\/18\/nvidia_punts_silicon_photonic_switches\/\">to do it<\/a>. Nvidia&#8217;s SN6800, in the meantime, will function 512 MPO ports good for 800Gbps a bit.<\/p>\n<p>These switches dramatically cut back the variety of switches required for large-scale AI deployments. To attach up a cluster of 128,000 GPUs at 400Gbps, you&#8217;d want about 10,000 Quantum-2 InfiniBand switches. Choosing 51.2Tbps Ethernet switches successfully minimize that in half.<\/p>\n<p>With the transfer to 102.4Tbps switching, the quantity shrinks to 2,500, and in case you can reside with 200Gbps ports, you&#8217;d want simply 750, because the radix is sufficiently giant you could get away with a two-tiered community versus the three-tiered fat-tree topologies we regularly see in large-scale AI coaching clusters. \u00ae<\/p>\n<\/p><\/div>\n<iframe data-lazy=\"true\" data-src=\"https:\/\/www.fiverr.com\/gig_widgets?id=U2FsdGVkX18x7XQvttUTrv1oEqmGNGTgvvCUiUoJ\/AP4z\/UyMz8lXGOLpu15jIMxBbTR0gmD5uBoFvhC4KWeALQRp3h\/X\/AwcVD0K8Wj9H\/ZzYKzcCNHosB9oS4SCJJFWiN85P9ICAc4OgCoE\/wHKIY7CDkf2\/DQ1vqGvk4smVe5cRDEmrLPCWi4FC8p40VUhSmWQ5udCm0zoJtorgWv3vbDQw0kKYkwn39ozAnQXDe+YvWMxkLFWA+O3TFwkJvdkIK+\/AUSnRssPKt5WHY0FhNOxnSPcLslEL4G4\/RfP95ve99U+kRnDy3X+KtzdQLY+u935ghON\/o3UE4IMv9oN6JX9RnxzL\/LRcOgnHigxStSGPKsZYtnz8RWNVT\/rOLAibqiWJadC5MYHRbekF3eg6FOGrQGkXYbsn0+a5aovnlLCbLwIqY9fcS17UX8J235iQ6cdmHNbrPeS84CMm34RA==&affiliate_id=1052423&strip_google_tagmanager=true\" loading=\"lazy\" data-with-title=\"true\" class=\"fiverr_nga_frame\" frameborder=\"0\" height=\"350\" width=\"100%\" referrerpolicy=\"no-referrer-when-downgrade\" data-mode=\"random_gigs\" onload=\" var frame = this; var script = document.createElement('script'); script.addEventListener('load', function() { window.FW_SDK.register(frame); }); script.setAttribute('src', 'https:\/\/www.fiverr.com\/gig_widgets\/sdk'); document.body.appendChild(script); \" ><\/iframe>\n<br \/><a href=\"https:\/\/go.theregister.com\/feed\/www.theregister.com\/2025\/06\/25\/rack_scale_networking\/\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Evaluation For those who thought AI networks weren&#8217;t difficult sufficient, the rise of rack-scale architectures from the likes of Nvidia, AMD, and shortly Intel has&#8230;<\/p>\n","protected":false},"author":1,"featured_media":82960,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[],"class_list":["post-82959","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech-universe"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>An introduction to rack-scale networking \u2022 The Register - mailinvest.blog<\/title>\n<meta name=\"description\" content=\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"An introduction to rack-scale networking \u2022 The Register - mailinvest.blog\" \/>\n<meta property=\"og:description\" content=\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/\" \/>\n<meta property=\"og:site_name\" content=\"mailinvest.blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/freelanceracademic\/\" \/>\n<meta property=\"article:published_time\" content=\"2025-06-25T20:33:05+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-25T20:34:19+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/06\/rackscale_network_cover.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1600\" \/>\n\t<meta property=\"og:image:height\" content=\"1024\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin@mailinvest.blog\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin@mailinvest.blog\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"10 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/\"},\"author\":{\"name\":\"admin@mailinvest.blog\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/person\\\/012701c4c204d4e4ebd34f926cfd31a4\"},\"headline\":\"An introduction to rack-scale networking \u2022 The Register\",\"datePublished\":\"2025-06-25T20:33:05+00:00\",\"dateModified\":\"2025-06-25T20:34:19+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/\"},\"wordCount\":2140,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/rackscale_network_cover.jpg\",\"articleSection\":[\"Tech Universe\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/\",\"name\":\"An introduction to rack-scale networking \u2022 The Register - mailinvest.blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/rackscale_network_cover.jpg\",\"datePublished\":\"2025-06-25T20:33:05+00:00\",\"dateModified\":\"2025-06-25T20:34:19+00:00\",\"description\":\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/rackscale_network_cover.jpg\",\"contentUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2025\\\/06\\\/rackscale_network_cover.jpg\",\"width\":1600,\"height\":1024},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/2025\\\/06\\\/25\\\/an-introduction-to-rack-scale-networking-the-register\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mailinvest.blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"An introduction to rack-scale networking \u2022 The Register\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#website\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/\",\"name\":\"mailinvest.blog\",\"description\":\"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis. mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.\",\"publisher\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mailinvest.blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#organization\",\"name\":\"mailinvest\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/default.png\",\"contentUrl\":\"https:\\\/\\\/mailinvest.blog\\\/wp-content\\\/uploads\\\/2022\\\/01\\\/default.png\",\"width\":1000,\"height\":1000,\"caption\":\"mailinvest\"},\"image\":{\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/freelanceracademic\\\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mailinvest.blog\\\/#\\\/schema\\\/person\\\/012701c4c204d4e4ebd34f926cfd31a4\",\"name\":\"admin@mailinvest.blog\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g\",\"caption\":\"admin@mailinvest.blog\"},\"sameAs\":[\"https:\\\/\\\/mailinvest.blog\",\"admin@mailinvest.blog\"],\"url\":\"https:\\\/\\\/mailinvest.blog\\\/index.php\\\/author\\\/adminmailinvest-blog\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"An introduction to rack-scale networking \u2022 The Register - mailinvest.blog","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/","og_locale":"en_US","og_type":"article","og_title":"An introduction to rack-scale networking \u2022 The Register - mailinvest.blog","og_description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","og_url":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/","og_site_name":"mailinvest.blog","article_publisher":"https:\/\/www.facebook.com\/freelanceracademic\/","article_published_time":"2025-06-25T20:33:05+00:00","article_modified_time":"2025-06-25T20:34:19+00:00","og_image":[{"width":1600,"height":1024,"url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/06\/rackscale_network_cover.jpg","type":"image\/jpeg"}],"author":"admin@mailinvest.blog","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin@mailinvest.blog","Est. reading time":"10 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/#article","isPartOf":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/"},"author":{"name":"admin@mailinvest.blog","@id":"https:\/\/mailinvest.blog\/#\/schema\/person\/012701c4c204d4e4ebd34f926cfd31a4"},"headline":"An introduction to rack-scale networking \u2022 The Register","datePublished":"2025-06-25T20:33:05+00:00","dateModified":"2025-06-25T20:34:19+00:00","mainEntityOfPage":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/"},"wordCount":2140,"commentCount":0,"publisher":{"@id":"https:\/\/mailinvest.blog\/#organization"},"image":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/#primaryimage"},"thumbnailUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/06\/rackscale_network_cover.jpg","articleSection":["Tech Universe"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/","url":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/","name":"An introduction to rack-scale networking \u2022 The Register - mailinvest.blog","isPartOf":{"@id":"https:\/\/mailinvest.blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/#primaryimage"},"image":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/#primaryimage"},"thumbnailUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/06\/rackscale_network_cover.jpg","datePublished":"2025-06-25T20:33:05+00:00","dateModified":"2025-06-25T20:34:19+00:00","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis.mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what's new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","breadcrumb":{"@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/#primaryimage","url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/06\/rackscale_network_cover.jpg","contentUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2025\/06\/rackscale_network_cover.jpg","width":1600,"height":1024},{"@type":"BreadcrumbList","@id":"https:\/\/mailinvest.blog\/index.php\/2025\/06\/25\/an-introduction-to-rack-scale-networking-the-register\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mailinvest.blog\/"},{"@type":"ListItem","position":2,"name":"An introduction to rack-scale networking \u2022 The Register"}]},{"@type":"WebSite","@id":"https:\/\/mailinvest.blog\/#website","url":"https:\/\/mailinvest.blog\/","name":"mailinvest.blog","description":"Technology is forever changing, and there are always new pieces of technology to replace obsolete ones. Tons of people enjoy reading tech blogs on a daily basis. mailinvest.blog tracks all the latest consumer technology breakthroughs and shows you what&#039;s new, what matters and how technology can enrich your life. mailinvest.blog also provides the information, tools, and advice that helps when deciding what to buy.","publisher":{"@id":"https:\/\/mailinvest.blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mailinvest.blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/mailinvest.blog\/#organization","name":"mailinvest","url":"https:\/\/mailinvest.blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mailinvest.blog\/#\/schema\/logo\/image\/","url":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2022\/01\/default.png","contentUrl":"https:\/\/mailinvest.blog\/wp-content\/uploads\/2022\/01\/default.png","width":1000,"height":1000,"caption":"mailinvest"},"image":{"@id":"https:\/\/mailinvest.blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/freelanceracademic\/"]},{"@type":"Person","@id":"https:\/\/mailinvest.blog\/#\/schema\/person\/012701c4c204d4e4ebd34f926cfd31a4","name":"admin@mailinvest.blog","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/98ed217bd0f3d6a6dcae2d9b0c76e305b049a07275e315e1407e19ec8b08e139?s=96&d=mm&r=g","caption":"admin@mailinvest.blog"},"sameAs":["https:\/\/mailinvest.blog","admin@mailinvest.blog"],"url":"https:\/\/mailinvest.blog\/index.php\/author\/adminmailinvest-blog\/"}]}},"_links":{"self":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/82959","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/comments?post=82959"}],"version-history":[{"count":1,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/82959\/revisions"}],"predecessor-version":[{"id":82961,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/posts\/82959\/revisions\/82961"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/media\/82960"}],"wp:attachment":[{"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/media?parent=82959"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/categories?post=82959"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mailinvest.blog\/index.php\/wp-json\/wp\/v2\/tags?post=82959"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}