{"id":15541,"date":"2024-12-27T07:28:07","date_gmt":"2024-12-27T07:28:07","guid":{"rendered":"https:\/\/www.fibermall.com\/blog\/?p=15541"},"modified":"2024-12-27T07:28:12","modified_gmt":"2024-12-27T07:28:12","slug":"in-depth-analysis-how-to-choose-computing-power-liquid-cooling-network-and-power-for-nvidia-gb200","status":"publish","type":"post","link":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm","title":{"rendered":"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200"},"content":{"rendered":"\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_76 ez-toc-wrap-left counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\/#Name_Origin\" >Name Origin<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\/#Computing_Power_Configuration\" >Computing Power Configuration<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\/#Cooling_Configuration\" >Cooling Configuration<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\/#Network_Configuration\" >Network Configuration<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\/#Power_Configuration\" >Power Configuration<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\/#Related_Posts\" >Related Posts<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\" id=\"h-name-origin\"><span class=\"ez-toc-section\" id=\"Name_Origin\"><\/span><strong>Name Origin<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>G &#8211; Grace CPU<\/p>\n\n\n\n<p>B &#8211; Blackwell GPU<\/p>\n\n\n\n<p>200 &#8211; Generation<\/p>\n\n\n\n<p>NVL &#8211; NVlink Interconnect Technology<\/p>\n\n\n\n<p>72 &#8211; 72 GPUs<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72-1024x575.png\" alt=\"announcing gb200 nvl72\" class=\"wp-image-15544\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72-1024x575.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72-300x168.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72-768x431.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-computing-power-configuration\"><span class=\"ez-toc-section\" id=\"Computing_Power_Configuration\"><\/span><strong>Computing Power Configuration<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Each NVL72 has 18 compute trays, which are the basic units of the NVL72&#8217;s computing power configuration. Each tray serves as a computing node. The GB200 NVL72 defines the Bianca board&#8217;s super chipset, where each chipset comprises one Grace CPU (developed by NV based on ARM architecture) and two Blackwell GPU chips. Each compute tray consists of two super chipsets, i.e., 2 CPUs + 4 GPUs. The NVL72&#8217;s 18 compute trays total 18 * 4 = 72 GPUs.<\/p>\n\n\n\n<p>Each compute tray, in a 1U form factor, directly plugs into the chassis. It is the minimal unit for daily deployment and maintenance, with each compute tray consuming up to 5400W of power.<\/p>\n\n\n\n<p>The entire NVL72 system boasts 13.8T of video memory, with each B200 chip containing 192GB of video memory, an increase of 112GB over the H100&#8217;s 80GB. Additionally, the single GPU memory bandwidth has been upgraded from 3.35TB\/s in the H100 to 8TB\/s. The system also includes 17TB of DDR5X memory, with each Bianca chip equipped with 480GB of memory.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/Computing-Power-Configuration.jpg\" alt=\"Computing Power Configuration\" class=\"wp-image-15545\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/Computing-Power-Configuration.jpg 955w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/Computing-Power-Configuration-300x236.jpg 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/Computing-Power-Configuration-768x603.jpg 768w\" sizes=\"(max-width: 955px) 100vw, 955px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-cooling-configuration\"><span class=\"ez-toc-section\" id=\"Cooling_Configuration\"><\/span><strong>Cooling Configuration<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>During the H100 phase, each GPU consumed 700W. To meet air cooling requirements and create a better aerodynamic environment, the entire system fit into a 6-8U space with 8 H100s. In the B200 phase, each chip consumes 1200W, requiring more cooling space, thus expanding the system to a 10U size (8 * B200).<\/p>\n\n\n\n<p>In the GB200 Bianca board scenario, with a power consumption of 2700W, air velocity is insufficient to provide effective cooling within a 19-inch rack, necessitating a liquid cooling solution. This allows the system&#8217;s volume to be controlled within the 1-2U range, significantly enhancing space utilization and cooling efficiency.<\/p>\n\n\n\n<ol class=\"wp-block-list\" type=\"1\">\n<li>At the Server Level: Liquid cooling can address the cooling needs of the CPUs and GPUs on the Bianca board through cold plates. However, the front part of each compute tray and NVswitch tray still contains many custom components, such as network cards, PDUs, management cards, and hard drives, which still require air cooling. Typically, the liquid-to-air ratio for a compute tray is about 8.5:1.5. In the future, if scaling out based on CX network cards, cold plates might be designed for NICs.<\/li>\n\n\n\n<li>At the Rack Level: Various liquid cooling solutions are currently available:<\/li>\n\n\n\n<li>Retrofit Solutions for Older Air-Cooled Rooms: There are two options, RDHx and Sidecar, with the former providing 30-40KW cooling and the latter offering 70-140KW cooling. These solutions allow for the addition of a liquid cooling system to each rack without altering the existing air-cooled HVAC units, using a refrigerant to transfer heat to a radiator for air exchange (retaining the indoor air cooling environment). Minimal modifications are required, avoiding extensive pipeline renovations.<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-rack-1024x413.png\" alt=\"in-rack\" class=\"wp-image-15546\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-rack-1024x413.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-rack-300x121.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-rack-768x310.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-rack.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>New High-Density Data Centers: For new high-density data centers like NV72, in-rack CDUs and in-row CDUs are the primary options. In-rack CDUs require more than 4U space within the rack and typically offer around 80KW cooling efficiency without redundancy capabilities. In contrast, in-row CDUs are installed outside individual racks and provide cooling for several racks or rows, configured with two CDU systems, offering 800KW-2000KW cooling and redundancy. The NVL576 cluster&#8217;s official marketing uses the in-row solution.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/L2L-in-rack-CDU-1024x355.png\" alt=\"L2L in-rack CDU\" class=\"wp-image-15547\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/L2L-in-rack-CDU-1024x355.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/L2L-in-rack-CDU-300x104.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/L2L-in-rack-CDU-768x266.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/L2L-in-rack-CDU.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-row-CDU-1024x603.png\" alt=\"in-row CDU\" class=\"wp-image-15548\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-row-CDU-1024x603.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-row-CDU-300x177.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-row-CDU-768x452.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/in-row-CDU.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-network-configuration\"><span class=\"ez-toc-section\" id=\"Network_Configuration\"><\/span><strong>Network Configuration<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>NVLink Network<\/p>\n\n\n\n<p>The NVL72 features a fully interconnected NVLink architecture, eliminating the need for RDMA (IB&amp;RoCE) networks in NVL72 mode.<\/p>\n\n\n\n<p>The NVL72 system is equipped with 9 NVSwitch trays, each containing 2 NVLink switch chips. Each chip supports a rate of 4 * 1.8TB\/s, totaling 7.2TB\/s capacity, which translates to 57.6Tbps. This capacity is slightly higher than the popular TH5 chip&#8217;s 51.2Tbps. Each NVSwitch tray provides an NVLink capacity of 2 * 4 * 1.8TB\/s = 14.4TB\/s.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-inside.jpg\" alt=\"NVswitch tray inside\" class=\"wp-image-15549\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-inside.jpg 1000w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-inside-300x225.jpg 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-inside-768x576.jpg 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-inside-2.jpg\" alt=\"NVswitch tray inside 2\" class=\"wp-image-15550\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-inside-2.jpg 800w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-inside-2-300x174.jpg 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-inside-2-768x446.jpg 768w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-front.jpg\" alt=\"NVswitch tray front\" class=\"wp-image-15551\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-front.jpg 800w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-front-300x180.jpg 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/NVswitch-tray-front-768x462.jpg 768w\" sizes=\"(max-width: 800px) 100vw, 800px\" \/><\/figure>\n\n\n\n<p>The GB200 utilizes NVLink 5.0, with each B200 chip interconnected to NVLink switch chips via 18 NVLink 5.0 connections. Therefore, an NVL72 unit has 72 * 18 = 1296 NVLink 5.0 ports, with each port offering bidirectional 100GB\/s, consisting of 4 pairs of differential signal lines. Each pair is connected by a copper cable, resulting in 1296 * 4 = 5184 physical connections.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/nvlink5.0.png\" alt=\"nvlink5.0\" class=\"wp-image-15552\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/nvlink5.0.png 847w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/nvlink5.0-300x139.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/nvlink5.0-768x355.png 768w\" sizes=\"(max-width: 847px) 100vw, 847px\" \/><\/figure>\n\n\n\n<p>As depicted, all 9 NVSwitch trays in a GB200 NVL72 cabinet are used to connect 72 B200 chips. Each B200 chip is linked to 18 NVSwitch chips via a single NVLink 5.0 bidirectional 100GB connection. Each NVSwitch chip supports 7.2GB bandwidth, corresponding to 72 NVLink 5.0 connections, thus accommodating the deployment of 72 B200 GPUs. There are no additional NVLink interfaces for expanding to larger clusters.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/all-9-NVSwitch-trays-in-a-GB200-NVL72-cabinet-are-used-to-connect-72-B200-chips-1024x382.png\" alt=\"all 9 NVSwitch trays in a GB200 NVL72 cabinet are used to connect 72 B200 chips\" class=\"wp-image-15553\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/all-9-NVSwitch-trays-in-a-GB200-NVL72-cabinet-are-used-to-connect-72-B200-chips-1024x382.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/all-9-NVSwitch-trays-in-a-GB200-NVL72-cabinet-are-used-to-connect-72-B200-chips-300x112.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/all-9-NVSwitch-trays-in-a-GB200-NVL72-cabinet-are-used-to-connect-72-B200-chips-768x287.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/all-9-NVSwitch-trays-in-a-GB200-NVL72-cabinet-are-used-to-connect-72-B200-chips.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>The NVLink network within the GB200 NVL72 forms a fully interconnected state, achieving full interconnectivity for 72 B200 chips via a single NVSwitch hop. Each switch chip has 4 NVLink ports, with each port paired with 72 copper cables, significantly reducing optical communication power consumption and cost, and saving up to 20KW per system. The internal communication structure of the NVL72 is illustrated in the following diagram:<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/gb200-nvl72-architecture-1024x583.png\" alt=\"gb200 nvl72 architecture\" class=\"wp-image-15554\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/gb200-nvl72-architecture-1024x583.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/gb200-nvl72-architecture-300x171.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/gb200-nvl72-architecture-768x437.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/gb200-nvl72-architecture.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Non-NVLink Network (RDMA + High-Speed TCP Network)<\/p>\n\n\n\n<p>Each compute tray includes 4 OSFP slots and 2 QSFP slots. The network port layout on the compute tray&#8217;s front panel is shown below:<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-network-port-layout-on-the-compute-trays-front-panel.jpg\" alt=\"The network port layout on the compute tray's front panel\" class=\"wp-image-15555\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-network-port-layout-on-the-compute-trays-front-panel.jpg 822w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-network-port-layout-on-the-compute-trays-front-panel-300x69.jpg 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-network-port-layout-on-the-compute-trays-front-panel-768x177.jpg 768w\" sizes=\"(max-width: 822px) 100vw, 822px\" \/><\/figure>\n\n\n\n<ol class=\"wp-block-list\" type=\"a\">\n<li>The 2 QSFP slots, supported by Bluefield-3 DPU, provide 400G\/800G ports for high-performance TCP\/storage network interconnectivity, forming the front-end network proposed by NV.<\/li>\n<\/ol>\n\n\n\n<p>b. The 4 OSFP slots, with CX7\/CX8 800G\/1.6TB ports, support the GB200&#8217;s external expansion using RDMA network communication, constituting the back-end network proposed by NV.<\/p>\n\n\n\n<p>Due to design architecture, transmission costs, and chip capabilities, NV currently provides a pure NVLink networking solution for a maximum of 576 GPUs, equivalent to 8 GB200 NVL72 units. For further expansion of AI training\/inference clusters, RDMA networks are required. NVLink 5.0 achieves a 100GB\/s bandwidth per GPU, with 18 connections per GPU, totaling 1.8TB\/s bandwidth. RDMA&#8217;s current fastest single port rate is 200GB\/s (1.6Tbps), which does not match NVLink&#8217;s speed.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-power-configuration\"><span class=\"ez-toc-section\" id=\"Power_Configuration\"><\/span><strong>Power Configuration<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Overall Rated Power Consumption: The system has an overall rated power consumption of 120KW. It is configured as 2N with 4+4 (or 4+2) power shelves, each supporting 33KW. Each power shelf can accommodate six 5.5KW PSU units, providing 5+1 redundancy.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-system-has-an-overall-rated-power-consumption-of-120KW-1024x477.png\" alt=\"The system has an overall rated power consumption of 120KW.\" class=\"wp-image-15556\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-system-has-an-overall-rated-power-consumption-of-120KW-1024x477.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-system-has-an-overall-rated-power-consumption-of-120KW-300x140.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-system-has-an-overall-rated-power-consumption-of-120KW-768x358.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/The-system-has-an-overall-rated-power-consumption-of-120KW.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Power Shelf Specifications: The power shelves utilize OCP&#8217;s ORv3 HPR power shelf, boasting over 97.5% power efficiency, thus reducing power losses during the AC-DC conversion process. Additionally, it uses 48V\/50V low-voltage DC output for each slot, which offers lower power transmission losses compared to the traditional 12V output.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/ORv3-hpr-1024x521.png\" alt=\"ORv3 hpr\" class=\"wp-image-15557\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/ORv3-hpr-1024x521.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/ORv3-hpr-300x153.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/ORv3-hpr-768x390.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/ORv3-hpr.png 1064w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Rack Input Power Standard: The rack input power conforms to OCP&#8217;s ORv3 HPR standard, with an AC input of 415V. Each slot is directly connected to the rack&#8217;s busbar via hard connections.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/OCP-1024x479.png\" alt=\"OCP\" class=\"wp-image-15558\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/OCP-1024x479.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/OCP-300x140.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/OCP-768x359.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/OCP.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/Each-slot-is-directly-connected-to-the-racks-busbar-via-hard-connections.png\" alt=\"Each slot is directly connected to the rack's busbar via hard connections.\" class=\"wp-image-15559\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/Each-slot-is-directly-connected-to-the-racks-busbar-via-hard-connections.png 781w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/Each-slot-is-directly-connected-to-the-racks-busbar-via-hard-connections-300x233.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/Each-slot-is-directly-connected-to-the-racks-busbar-via-hard-connections-768x596.png 768w\" sizes=\"(max-width: 781px) 100vw, 781px\" \/><\/figure>\n\n\n\n<p>AC Input Configuration: On the AC input side, the system uses ORv3-defined 7-pin connectors. The diagram below shows two different connector standards (left for North America, right for Europe). Based on the power shelf&#8217;s 33KW support, each input likely adheres to a 125A breaker standard.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/AC-Input-Configuration-1024x704.png\" alt=\"AC Input Configuration\" class=\"wp-image-15560\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/AC-Input-Configuration-1024x704.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/AC-Input-Configuration-300x206.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/AC-Input-Configuration-768x528.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/AC-Input-Configuration.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Upstream AC Input Connections: The upstream end of the AC input uses standard industrial connectors, compliant with IEC 60309-2 standards and rated IP67. These mobile industrial plugs support a 125A breaker. Depending on the phase voltage, you can choose between 3-pin 125A or 5-pin 125A configurations.<\/p>\n<style>\r\n\r\n        .lwrp.link-whisper-related-posts{\r\n            \r\n            margin-top: 40px;\nmargin-bottom: 30px;\r\n        }\r\n        .lwrp .lwrp-title{\r\n            \r\n            \r\n        }\r\n        .lwrp .lwrp-description{\r\n            \r\n            \r\n\r\n        }\r\n        .lwrp .lwrp-list-container{\r\n        }\r\n        .lwrp .lwrp-list-multi-container{\r\n            display: flex;\r\n        }\r\n        .lwrp .lwrp-list-double{\r\n            width: 48%;\r\n        }\r\n        .lwrp .lwrp-list-triple{\r\n            width: 32%;\r\n        }\r\n        .lwrp .lwrp-list-row-container{\r\n            display: flex;\r\n            justify-content: space-between;\r\n        }\r\n        .lwrp .lwrp-list-row-container .lwrp-list-item{\r\n            width: calc(100% - 20px);\r\n        }\r\n        .lwrp .lwrp-list-item:not(.lwrp-no-posts-message-item){\r\n            \r\n            list-style: decimal;\r\n        }\r\n        .lwrp .lwrp-list-item img{\r\n            max-width: 100%;\r\n            height: auto;\r\n        }\r\n        .lwrp .lwrp-list-item.lwrp-empty-list-item{\r\n            background: initial !important;\r\n        }\r\n        .lwrp .lwrp-list-item .lwrp-list-link .lwrp-list-link-title-text,\r\n        .lwrp .lwrp-list-item .lwrp-list-no-posts-message{\r\n            \r\n                \r\n        }\r\n        @media screen and (max-width: 480px) {\r\n            .lwrp.link-whisper-related-posts{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-title{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-description{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-list-multi-container{\r\n                flex-direction: column;\r\n            }\r\n            .lwrp .lwrp-list-multi-container ul.lwrp-list{\r\n                margin-top: 0px;\r\n                margin-bottom: 0px;\r\n                padding-top: 0px;\r\n                padding-bottom: 0px;\r\n            }\r\n            .lwrp .lwrp-list-double,\r\n            .lwrp .lwrp-list-triple{\r\n                width: 100%;\r\n            }\r\n            .lwrp .lwrp-list-row-container{\r\n                justify-content: initial;\r\n                flex-direction: column;\r\n            }\r\n            .lwrp .lwrp-list-row-container .lwrp-list-item{\r\n                width: 100%;\r\n            }\r\n            .lwrp .lwrp-list-item:not(.lwrp-no-posts-message-item){\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-list-item .lwrp-list-link .lwrp-list-link-title-text,\r\n            .lwrp .lwrp-list-item .lwrp-list-no-posts-message{\r\n                \r\n                    \r\n            }\r\n        }<\/style>\r\n<div id=\"link-whisper-related-posts-widget\" class=\"link-whisper-related-posts lwrp\">\r\n            <h3 class=\"lwrp-title\">Related Posts<\/h3>    \r\n        <div class=\"lwrp-list-container\">\r\n                                            <ul class=\"lwrp-list lwrp-list-single\">\r\n                    <li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/news\/mass-400g-qsfp-dd-optical-modules.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">Fiber Mall Achieves Mass Production of 400G QSFP-DD Optical Modules<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/metro-network.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">Revolutionizing Connectivity with Metro Networks: Jump to Content for 5G Insights<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/news\/the-shortage-of-chips-affects-the-optical-device-market.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">The shortage of chips continues to affect the optical device market<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/25g-dwdm-sfp28.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">The Ultimate Guide to 25G DWDM SFP28 Transceivers<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/gpon-olt.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">Unlocking the Potential of GPON OLT: A Comprehensive Guide<\/span><\/a><\/li>                <\/ul>\r\n                        <\/div>\r\n<\/div>","protected":false},"excerpt":{"rendered":"<p>Name Origin G &#8211; Grace CPU B &#8211; Blackwell GPU 200 &#8211; Generation NVL &#8211; NVlink Interconnect Technology 72 &#8211; 72 GPUs Computing Power Configuration Each NVL72 has 18 compute trays, which are the basic units of the NVL72&#8217;s computing power configuration. Each tray serves as a computing node. The GB200 NVL72 defines the Bianca [&hellip;]<\/p>\n","protected":false},"author":8,"featured_media":15544,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":"","_wpscppro_dont_share_socialmedia":false,"_wpscppro_custom_social_share_image":0,"_facebook_share_type":"default","_twitter_share_type":"default","_linkedin_share_type":"default","_pinterest_share_type":"default","_linkedin_share_type_page":"default","_instagram_share_type":"default","_medium_share_type":"","_threads_share_type":"","_google_business_share_type":"","_selected_social_profile":[{"id":"skM9ewvR8O","platform":"linkedin","platformKey":0,"name":"Jason Xue","type":"person","thumbnail_url":"https:\/\/media.licdn.com\/dms\/image\/C5603AQErPqKD0j6qBg\/profile-displayphoto-shrink_100_100\/0\/1599138392315?e=1723075200&v=beta&t=joEkh1OeKQ0F-QpAPv4xxQyBdGlHyccIQZauRSs6RvU","share_type":"default"}],"_wpsp_enable_custom_social_template":false,"_wpsp_social_scheduling":{"enabled":false,"datetime":null,"platforms":[],"status":"template_only","dateOption":"today","timeOption":"now","customDays":"","customHours":"","customDate":"","customTime":"","schedulingType":"absolute"},"_wpsp_active_default_template":true},"categories":[2],"tags":[],"class_list":["post-15541","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v20.13 (Yoast SEO v25.8) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200 - fibermall.com<\/title>\n<meta name=\"description\" content=\"The NVLink network within the GB200 NVL72 forms a fully interconnected state, achieving full interconnectivity for 72 B200 chips via a single NVSwitch hop.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200\" \/>\n<meta property=\"og:description\" content=\"Name Origin G - Grace CPU B - Blackwell GPU 200 - Generation NVL - NVlink Interconnect Technology 72 - 72 GPUs Computing Power Configuration Each NVL72\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\" \/>\n<meta property=\"og:site_name\" content=\"fibermall.com\" \/>\n<meta property=\"article:published_time\" content=\"2024-12-27T07:28:07+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-12-27T07:28:12+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1080\" \/>\n\t<meta property=\"og:image:height\" content=\"606\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Felisac\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Felisac\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\"},\"author\":{\"name\":\"Felisac\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/6c504b906bd2221757ca517a21eb21b3\"},\"headline\":\"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200\",\"datePublished\":\"2024-12-27T07:28:07+00:00\",\"dateModified\":\"2024-12-27T07:28:12+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\"},\"wordCount\":1160,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png\",\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\",\"url\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\",\"name\":\"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200 - fibermall.com\",\"isPartOf\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png\",\"datePublished\":\"2024-12-27T07:28:07+00:00\",\"dateModified\":\"2024-12-27T07:28:12+00:00\",\"description\":\"The NVLink network within the GB200 NVL72 forms a fully interconnected state, achieving full interconnectivity for 72 B200 chips via a single NVSwitch hop.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#primaryimage\",\"url\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png\",\"contentUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png\",\"width\":1080,\"height\":606,\"caption\":\"announcing-gb200-nvl72\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.fibermall.com\/blog.htm\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#website\",\"url\":\"https:\/\/www.fibermall.com\/blog.htm\/\",\"name\":\"fibermall.com\",\"description\":\"Optical Communication Expert\",\"publisher\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.fibermall.com\/blog.htm\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\",\"name\":\"fibermall.com\",\"url\":\"https:\/\/www.fibermall.com\/blog.htm\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg\",\"contentUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg\",\"width\":200,\"height\":67,\"caption\":\"fibermall.com\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/6c504b906bd2221757ca517a21eb21b3\",\"name\":\"Felisac\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/0fee6bec0831365a6e53fa374f659c986987cc7c085842868236d48e2d5f048c?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/0fee6bec0831365a6e53fa374f659c986987cc7c085842868236d48e2d5f048c?s=96&d=mm&r=g\",\"caption\":\"Felisac\"},\"description\":\"Optical Technician\",\"sameAs\":[\"https:\/\/www.fibermall.com\/\"],\"url\":\"https:\/\/www.fibermall.com\/blog.htm?author=8\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200 - fibermall.com","description":"The NVLink network within the GB200 NVL72 forms a fully interconnected state, achieving full interconnectivity for 72 B200 chips via a single NVSwitch hop.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm","og_locale":"en_US","og_type":"article","og_title":"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200","og_description":"Name Origin G - Grace CPU B - Blackwell GPU 200 - Generation NVL - NVlink Interconnect Technology 72 - 72 GPUs Computing Power Configuration Each NVL72","og_url":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm","og_site_name":"fibermall.com","article_published_time":"2024-12-27T07:28:07+00:00","article_modified_time":"2024-12-27T07:28:12+00:00","og_image":[{"width":1080,"height":606,"url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png","type":"image\/png"}],"author":"Felisac","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Felisac","Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#article","isPartOf":{"@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm"},"author":{"name":"Felisac","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/6c504b906bd2221757ca517a21eb21b3"},"headline":"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200","datePublished":"2024-12-27T07:28:07+00:00","dateModified":"2024-12-27T07:28:12+00:00","mainEntityOfPage":{"@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm"},"wordCount":1160,"commentCount":0,"publisher":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization"},"image":{"@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#primaryimage"},"thumbnailUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png","articleSection":["Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm","url":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm","name":"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200 - fibermall.com","isPartOf":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#primaryimage"},"image":{"@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#primaryimage"},"thumbnailUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png","datePublished":"2024-12-27T07:28:07+00:00","dateModified":"2024-12-27T07:28:12+00:00","description":"The NVLink network within the GB200 NVL72 forms a fully interconnected state, achieving full interconnectivity for 72 B200 chips via a single NVSwitch hop.","breadcrumb":{"@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#primaryimage","url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png","contentUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/announcing-gb200-nvl72.png","width":1080,"height":606,"caption":"announcing-gb200-nvl72"},{"@type":"BreadcrumbList","@id":"https:\/\/www.fibermall.com\/blog\/in-depth-analysis-for-nvidia-gb200.htm#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.fibermall.com\/blog.htm"},{"@type":"ListItem","position":2,"name":"In-depth Analysis: How to Choose Computing Power, Liquid Cooling, Network, and Power for NVIDIA GB200"}]},{"@type":"WebSite","@id":"https:\/\/www.fibermall.com\/blog.htm\/#website","url":"https:\/\/www.fibermall.com\/blog.htm\/","name":"fibermall.com","description":"Optical Communication Expert","publisher":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.fibermall.com\/blog.htm\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization","name":"fibermall.com","url":"https:\/\/www.fibermall.com\/blog.htm\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/","url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg","contentUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg","width":200,"height":67,"caption":"fibermall.com"},"image":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/6c504b906bd2221757ca517a21eb21b3","name":"Felisac","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/0fee6bec0831365a6e53fa374f659c986987cc7c085842868236d48e2d5f048c?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0fee6bec0831365a6e53fa374f659c986987cc7c085842868236d48e2d5f048c?s=96&d=mm&r=g","caption":"Felisac"},"description":"Optical Technician","sameAs":["https:\/\/www.fibermall.com\/"],"url":"https:\/\/www.fibermall.com\/blog.htm?author=8"}]}},"_links":{"self":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/15541","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/users\/8"}],"replies":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=15541"}],"version-history":[{"count":4,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/15541\/revisions"}],"predecessor-version":[{"id":15565,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/15541\/revisions\/15565"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/media\/15544"}],"wp:attachment":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=15541"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=15541"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=15541"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}