{"id":6845,"date":"2023-12-09T04:00:58","date_gmt":"2023-12-09T04:00:58","guid":{"rendered":"https:\/\/www.fibermall.com\/blog\/?p=6845"},"modified":"2023-12-19T06:46:47","modified_gmt":"2023-12-19T06:46:47","slug":"ethernet-or-ethernot","status":"publish","type":"post","link":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm","title":{"rendered":"EtherNET or EtherNOT?"},"content":{"rendered":"\n<p>A survey of the AI network positions of the leading vendors In July 2023, the Ultra Ethernet Consortium (UEC), initiated by the Linux Foundation and its Joint Development Foundation, was officially launched, dropping a depth charge into the turbulent AI network interconnection ecosystem. In August 2023, at the IEEE Hot Interconnects (HOTI) international forum, which focuses on advanced hardware and software architectures and various interconnect network implementations, representatives from Intel, Nvidia, AMD, and other companies participated in a panel discussion on the question of \u201cEtherNET or EtherNOT\u201d, and expressed their views on Ethernet. The emerging AI\/ML workloads are driving the demand for high-performance network interconnection. About ten years ago, RDMA over Converged Ethernet (RoCE) introduced low-latency data transmission into the Ethernet architecture, but compared with other network technologies, Ethernet seemed to lag in technology development. Is the battle between EtherNET and EtherNOT coming again? In the Ethernet era, cloud vendors, equipment vendors, and other parties have their interests, and it is a critical decision-making period. How will they choose?<\/p>\n\n\n\n<p>This topic of \u201cEtherNET or EtherNOT\u201d was already discussed at the HOTI conference in 2005, and the conclusion at that time was as follows:<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT.png\" alt=\"EtherNET or EtherNOT\" class=\"wp-image-6848\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT.png 994w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-300x205.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-768x525.png 768w\" sizes=\"(max-width: 994px) 100vw, 994px\" \/><\/figure>\n\n\n\n<p>At the\u00a0discussion of\u00a0the 2023 HOTI conference, Brad Burres, senior researcher and chief hardware architect for the Network and Edge Group at Intel, and Frank Helms, data center GPU system architect at AMD, favored Ethernet. Brad Burres argued that no matter what technology is adopted, an open ecosystem is needed to reduce the cost of the entire industry and achieve the required software infrastructure. As the protocol matures, Ethernet will be the winner unless another open standard structure emerges immediately (such as CXL). Frank Helms listed the first, second, and fifth places in the global supercomputer TOP500 list, Frontier, Aurora, and LUMI, respectively, which are all based on the Ethernet-based HPE Cray Slingshot-11 network structure for connection. He believed that Ethernet is at the forefront of interconnect technology. The emergence of UEC (Ultra Ethernet Alliance) also reflects that there is a lot of suppressed demand for Ethernet for large-scale AI training cluster interconnection. Larry Dennison, director of network research at NVIDIA, believed that there is still a gap between Ethernet and meeting the needs of AI workloads. If Ethernet meets all these needs, is it still Ethernet? How long can it be achieved? The Ethernet market is indeed huge, it will not disappear, but in the next few years, the development speed of Ethernet will not be able to meet the needs of this market. Torsten Hoefler, professor at ETH Zurich and consultant for Microsoft in the field of large-scale artificial intelligence and network, pointed out that Ethernet is the present and future of data centers and supercomputers, but not the Ethernet we are talking about now, Ethernet needs to evolve.<\/p>\n\n\n\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_76 ez-toc-wrap-left counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Open_Ecology_or_Vendor_Lock-in\" >Open Ecology or&nbsp;Vendor Lock-in?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#AIML_Networking_Technology_Inventory\" >AI\/ML Networking Technology Inventory<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Amazon_AWS\" >Amazon AWS<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Google\" >Google<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Microsoft\" >Microsoft<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Meta\" >Meta<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Oracle\" >Oracle<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#NVIDIA\" >NVIDIA<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Broadcom\" >Broadcom<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Cisco\" >Cisco<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Conclusion\" >Conclusion<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\/#Related_Posts\" >Related Posts<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\" id=\"h-open-ecology-or-nbsp-vendor-lock-in\"><span class=\"ez-toc-section\" id=\"Open_Ecology_or_Vendor_Lock-in\"><\/span><strong>Open Ecology <\/strong><strong>or<\/strong><strong>&nbsp;Vendor Lock-in? <\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Historically, InfiniBand and Ethernet have been competing for the dominance of the AI\/HPC market, as they are both open standards. However, a key difference is that InfiniBand is currently supported by Nvidia as a single vendor, while Ethernet enjoys multi-vendor support, fostering a vibrant and competitive ecosystem. However, even in the field of AI\/HPC network solutions, Ethernet solutions may come with a \u201cpartially customized\u201d label, which may lead to vendor lock-in.<\/p>\n\n\n\n<p>For example, Broadcom\u2019s Jericho3 Ethernet switch requires the entire network fabric to use the same switch chip when running in its high-performance \u201cfully scheduled fabric\u201d mode. Cisco\u2019s Silicon One switch and Nvidia\u2019s Spectrum-X switch also have similar situations &#8211; high-performance requirements may cause vendor lock-in. Some hyperscale enterprises have designed \u201ccustom\u201d NICs, which can also lead to custom networks. Therefore, even when choosing Ethernet solutions, one may encounter custom implementations and vendor lock-in. AI\/HPC networks may transition to a new, open, and more powerful transport standard, partially or fully replacing the ROCEv2 RDMA protocol, which is the vision that the Beyond Ethernet Alliance is pursuing.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-ai-ml-networking-technology-inventory\"><span class=\"ez-toc-section\" id=\"AIML_Networking_Technology_Inventory\"><\/span><strong>AI\/ML Networking Technology Inventory<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>How do the hyperscale vendors choose their AI\/ML network technologies? Is it EtherNET or EtherNOT?<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-amazon-aws\"><span class=\"ez-toc-section\" id=\"Amazon_AWS\"><\/span><strong>Amazon AWS<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Amazon drew inspiration from the InfiniBand RD protocol and launched the Scalable Reliable Datagram (SRD) transport protocol for HPC networks. Amazon \u201cexclusively\u201d uses Enhanced Network Adapters (ENA), which are based on its proprietary Nitro chip. SRD uses UDP, supports packet spraying across multiple links, and eliminates the \u201cin-order\u201d packet delivery requirement, reducing fabric congestion and tail latency. When necessary, packet reordering is handled by the upper layer of SRD. Amazon continues to pursue a native AI\/HPC network strategy and is probably the least cooperative with NVIDIA.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-google\"><span class=\"ez-toc-section\" id=\"Google\"><\/span><strong>Google <\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Google uses a mix of its TPUs and NVIDIA&#8217;s\u00a0GPUs. TPUs and GPUs compete with each other and may be deployed depending on the workload suitability. Google is unlikely to use InfiniBand products in its network. Google\u2019s AI\/ML network is relatively customized and has been deploying a similar NVLink \u201ccoherent\u201d architecture for years. Google has innovated a lot on the network stack and deployed \u201cnative\u201d Optical Switching Systems (OCS) &#8211; a circuit switch based on Micro-Electro-Mechanical Systems (MEM mirrors) &#8211; in its regular data centers and artificial intelligence data centers. Optical switches typically eliminate a layer of physical switches, support higher radix configurations, and reduce power consumption and latency. Optical switches \u201creflect\u201d light and are independent of network protocols and network switch upgrades. The downside is that the mirror reconfiguration time is usually long, in the tens of milliseconds range, so these OCS switches work as fixed-capacity \u201ccircuit\u201d. For artificial intelligence training networks, this is not a major issue, as the traffic patterns are predictable.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-microsoft\"><span class=\"ez-toc-section\" id=\"Microsoft\"><\/span><strong>Microsoft <\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Microsoft is the most pragmatic among the hyperscale enterprises, and it adopted <a href=\"https:\/\/www.fibermall.com\/collection\/infiniband.htm\" target=\"_blank\" rel=\"noreferrer noopener\">InfiniBand<\/a> early on to build artificial intelligence networks for its partner OpenAI. Although Microsoft developed its custom network adapter and used a custom RDMA protocol for Azure cloud, its openness to InfiniBand, embrace of NVIDIA&#8217;s\u00a0full-stack AI\/ML solution, and close collaboration with OpenAI, all make it NVIDIA&#8217;s\u00a0preferred customer. Microsoft acquired Fungible, which invented True Fabric &#8211; a reliable datagram protocol based on UDP that handles traffic, congestion, and error control, and optimizes tail latency. Some of Fungible\u2019s technological innovations may appear in Microsoft\u2019s future products and open-source contributions.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-meta\"><span class=\"ez-toc-section\" id=\"Meta\"><\/span><strong>Meta<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Meta is a dark horse in the AI competition, with its artificial intelligence program having the following outstanding features:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>It adopts an open source approach using foundational models such as Llama.<\/li>\n\n\n\n<li>It makes AI user-friendly and accessible to every software engineer through the PyTorch software framework\/ecosystem.<\/li>\n\n\n\n<li>It establishes the Open Compute Project community as a key pillar of open hardware innovation.<\/li>\n\n\n\n<li>It deploys large-scale GPU clusters and stays at the forefront of AI innovation with its recommendation system (DLRM model).<\/li>\n<\/ul>\n\n\n\n<p>Meta\u2019s AI foundational models and PyTorch ecosystem enable a huge open source AI innovation library, deploy AI\/ML clusters based on Ethernet and InfiniBand, and build ASICs for its DLRM model and video transcoding.<\/p>\n\n\n\n<p>Meta is democratizing AI, and although it has not received enough recognition yet, this trend will soon change.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-oracle\"><span class=\"ez-toc-section\" id=\"Oracle\"><\/span><strong>Oracle<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Oracle firmly supports Ethernet and does not use InfiniBand. Oracle Cloud Infrastructure (OCI) leverages Nvidia GPUs and ConnectX NICs to build a supercluster based on ROCEv2 RDMA. OCI builds a separate RDMA network, based on a custom congestion notification protocol of DC-QCN, minimizes the use of PFC, and fine-tunes custom profiles for AI and HPC workloads.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-nvidia\"><span class=\"ez-toc-section\" id=\"NVIDIA\"><\/span><strong>NVIDIA<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>NVIDIA&#8217;s\u00a0GPUs and its full-stack AI\/ML solutions make it an undisputed upstream player in the market. NVIDIA\u00a0DGX Cloud solution integrates Quantum-2 (25.6Tbs) InfiniBand switch with ConnectX and Bluefield network adapters. These network adapters support both Ethernet and InfiniBand. The full-stack InfiniBand solution based on DGX Cloud will also be sold to telecom and enterprise markets by NVIDIA\u00a0and its OEMs. However, NVIDIA\u00a0is also investing heavily in Ethernet through its Spectrum-X switch. A few years ago, InfiniBand was the preferred architecture for AI training, making it the ideal choice for NVIDIA&#8217;s\u00a0integrated DGX cloud solution. With the launch of the NVIDIA\u00a0Spectrum-X Ethernet switch (capacity of 51.2 Tbs, twice the capacity of InfiniBand switch), NVIDIA\u00a0will switch to Ethernet for large-scale GPU deployment, to take advantage of Ethernet\u2019s higher port speed, cost-effectiveness, and scalability. Spectrum-X Ethernet switch supports advanced ROCEv2 extensions &#8211; RoCE adaptive routing and congestion control, telemetry support, and in-network computing called collective (through NVIDIA&#8217;s\u00a0SHARP product).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-broadcom\"><span class=\"ez-toc-section\" id=\"Broadcom\"><\/span><strong>Broadcom <\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Broadcom offers comprehensive AI\/HPC network solutions, including switch chips and network adapters. Broadcom\u2019s strategic acquisition of \u201cCorrect Networks\u201d introduced a transport protocol based on EQDS UDP, which moves all queuing activities from the core network to the transmitting host or leaf switch. This approach supports switch optimization in the Jericho3\/Ramon3 chip combination, which is a \u201cfully scheduled fabric\u201d equipped with packet spraying, reordering buffers in leaf switches, path rebalancing, congestion notification dropping, and hardware-driven in-band fault recovery mechanisms. The Tomahawk (52Tbs) series is designed to optimize single-chip capacity and is not a fully scheduled fabric. Tomahawk switches also support edge queues, as well as latency-critical functions in hardware, such as global fabric-level load balancing and path rebalancing. Tomahawk does not support packet sorting in leaf switches, so packet reordering buffers need to be implemented in <a href=\"https:\/\/www.fibermall.com\/blog\/network-adapter-nics-function-construction-classification.htm\" target=\"_blank\" rel=\"noreferrer noopener\">network adapters<\/a> (endpoints).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-cisco\"><span class=\"ez-toc-section\" id=\"Cisco\"><\/span><strong>Cisco <\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Cisco recently launched the Silicon One 52Tb\/s switch, demonstrating the versatility of its network solutions. The switch is P4 programmable, allowing flexible programming for various network use cases. Cisco\u2019s Silicon One-based switches provide support for fully scheduled fabrics, load balancing, hardware fault isolation, and telemetry. Cisco partners with multiple NIC vendors to provide complete AI\/ML network solutions.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-conclusion\"><span class=\"ez-toc-section\" id=\"Conclusion\"><\/span><strong>Conclusion <\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>The journey of Ethernet standardization for AI\/HPC networks has just begun, and it requires further cost and power reduction through scale, open innovation, and multi-vendor competition. The Super Ethernet Alliance is composed of major network stakeholders and is committed to creating an open, \u201cfull-stack\u201d Ethernet solution tailored for AI\/HPC workloads. As mentioned above, most of the \u201cnecessary\u201d AI\/HPC network technologies have been deployed by various Ethernet vendors and hyperscalers in some form or way. Therefore, the challenge of standardization is not technical, but more about building consensus.<\/p>\n<style>\r\n\r\n        .lwrp.link-whisper-related-posts{\r\n            \r\n            margin-top: 40px;\nmargin-bottom: 30px;\r\n        }\r\n        .lwrp .lwrp-title{\r\n            \r\n            \r\n        }\r\n        .lwrp .lwrp-description{\r\n            \r\n            \r\n\r\n        }\r\n        .lwrp .lwrp-list-container{\r\n        }\r\n        .lwrp .lwrp-list-multi-container{\r\n            display: flex;\r\n        }\r\n        .lwrp .lwrp-list-double{\r\n            width: 48%;\r\n        }\r\n        .lwrp .lwrp-list-triple{\r\n            width: 32%;\r\n        }\r\n        .lwrp .lwrp-list-row-container{\r\n            display: flex;\r\n            justify-content: space-between;\r\n        }\r\n        .lwrp .lwrp-list-row-container .lwrp-list-item{\r\n            width: calc(100% - 20px);\r\n        }\r\n        .lwrp .lwrp-list-item:not(.lwrp-no-posts-message-item){\r\n            \r\n            list-style: decimal;\r\n        }\r\n        .lwrp .lwrp-list-item img{\r\n            max-width: 100%;\r\n            height: auto;\r\n        }\r\n        .lwrp .lwrp-list-item.lwrp-empty-list-item{\r\n            background: initial !important;\r\n        }\r\n        .lwrp .lwrp-list-item .lwrp-list-link .lwrp-list-link-title-text,\r\n        .lwrp .lwrp-list-item .lwrp-list-no-posts-message{\r\n            \r\n                \r\n        }\r\n        @media screen and (max-width: 480px) {\r\n            .lwrp.link-whisper-related-posts{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-title{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-description{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-list-multi-container{\r\n                flex-direction: column;\r\n            }\r\n            .lwrp .lwrp-list-multi-container ul.lwrp-list{\r\n                margin-top: 0px;\r\n                margin-bottom: 0px;\r\n                padding-top: 0px;\r\n                padding-bottom: 0px;\r\n            }\r\n            .lwrp .lwrp-list-double,\r\n            .lwrp .lwrp-list-triple{\r\n                width: 100%;\r\n            }\r\n            .lwrp .lwrp-list-row-container{\r\n                justify-content: initial;\r\n                flex-direction: column;\r\n            }\r\n            .lwrp .lwrp-list-row-container .lwrp-list-item{\r\n                width: 100%;\r\n            }\r\n            .lwrp .lwrp-list-item:not(.lwrp-no-posts-message-item){\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-list-item .lwrp-list-link .lwrp-list-link-title-text,\r\n            .lwrp .lwrp-list-item .lwrp-list-no-posts-message{\r\n                \r\n                    \r\n            }\r\n        }<\/style>\r\n<div id=\"link-whisper-related-posts-widget\" class=\"link-whisper-related-posts lwrp\">\r\n            <h3 class=\"lwrp-title\">Related Posts<\/h3>    \r\n        <div class=\"lwrp-list-container\">\r\n                                            <ul class=\"lwrp-list lwrp-list-single\">\r\n                    <li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/data-center-cable.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">Mastering Data Center Cable Management: Best Practices and Solutions<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/10g-ethernet-switching-technology-enterprises.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">10 Gigabit Ethernet Switching Technology for Enterprises<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/h100-server.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">Unlocking the Power of NVIDIA H100 GPUs in High-Performance Servers<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/400g-network-solutions-typical.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">Detailed explanation of 4 typical 400G network solutions<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/gigabit-switch.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">Discover the Power of a Gigabit Ethernet Switch for Your Network<\/span><\/a><\/li>                <\/ul>\r\n                        <\/div>\r\n<\/div>","protected":false},"excerpt":{"rendered":"<p>A survey of the AI network positions of the leading vendors In July 2023, the Ultra Ethernet Consortium (UEC), initiated by the Linux Foundation and its Joint Development Foundation, was officially launched, dropping a depth charge into the turbulent AI network interconnection ecosystem. In August 2023, at the IEEE Hot Interconnects (HOTI) international forum, which [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":6849,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":"","_wpscppro_dont_share_socialmedia":false,"_wpscppro_custom_social_share_image":0,"_facebook_share_type":"","_twitter_share_type":"","_linkedin_share_type":"","_pinterest_share_type":"","_linkedin_share_type_page":"","_instagram_share_type":"","_medium_share_type":"","_threads_share_type":"","_google_business_share_type":"","_selected_social_profile":[],"_wpsp_enable_custom_social_template":false,"_wpsp_social_scheduling":{"enabled":false,"datetime":null,"platforms":[],"status":"template_only","dateOption":"today","timeOption":"now","customDays":"","customHours":"","customDate":"","customTime":"","schedulingType":"absolute"},"_wpsp_active_default_template":true},"categories":[2,29],"tags":[],"class_list":["post-6845","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog","category-networking"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v20.13 (Yoast SEO v25.8) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>EtherNET or EtherNOT? | FiberMall<\/title>\n<meta name=\"description\" content=\"The journey of Ethernet standardization for AI\/HPC networks has just begun, and it requires further cost and power reduction.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"EtherNET or EtherNOT?\" \/>\n<meta property=\"og:description\" content=\"A survey of the AI network positions of the leading vendors In July 2023, the Ultra Ethernet Consortium (UEC), initiated by the Linux Foundation and its\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\" \/>\n<meta property=\"og:site_name\" content=\"fibermall.com\" \/>\n<meta property=\"article:published_time\" content=\"2023-12-09T04:00:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-19T06:46:47+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"665\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Brian\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Brian\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\"},\"author\":{\"name\":\"Brian\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/9421292f8817d668e9e64f94dfe9b901\"},\"headline\":\"EtherNET or EtherNOT?\",\"datePublished\":\"2023-12-09T04:00:58+00:00\",\"dateModified\":\"2023-12-19T06:46:47+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\"},\"wordCount\":1684,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png\",\"articleSection\":[\"Blog\",\"Networking\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\",\"url\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\",\"name\":\"EtherNET or EtherNOT? | FiberMall\",\"isPartOf\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png\",\"datePublished\":\"2023-12-09T04:00:58+00:00\",\"dateModified\":\"2023-12-19T06:46:47+00:00\",\"description\":\"The journey of Ethernet standardization for AI\/HPC networks has just begun, and it requires further cost and power reduction.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#primaryimage\",\"url\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png\",\"contentUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png\",\"width\":1000,\"height\":665,\"caption\":\"EtherNET or EtherNOT\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.fibermall.com\/blog.htm\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"EtherNET or EtherNOT?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#website\",\"url\":\"https:\/\/www.fibermall.com\/blog.htm\/\",\"name\":\"fibermall.com\",\"description\":\"Optical Communication Expert\",\"publisher\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.fibermall.com\/blog.htm\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\",\"name\":\"fibermall.com\",\"url\":\"https:\/\/www.fibermall.com\/blog.htm\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg\",\"contentUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg\",\"width\":200,\"height\":67,\"caption\":\"fibermall.com\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/9421292f8817d668e9e64f94dfe9b901\",\"name\":\"Brian\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c196835c5ddcc99559fcfaa0046ffbd895891b78d40ab46bf34f7a5ecd73dfd9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c196835c5ddcc99559fcfaa0046ffbd895891b78d40ab46bf34f7a5ecd73dfd9?s=96&d=mm&r=g\",\"caption\":\"Brian\"},\"description\":\"Optical Network Engineer\",\"sameAs\":[\"https:\/\/www.fibermall.com\"],\"url\":\"https:\/\/www.fibermall.com\/blog.htm?author=5\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"EtherNET or EtherNOT? | FiberMall","description":"The journey of Ethernet standardization for AI\/HPC networks has just begun, and it requires further cost and power reduction.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm","og_locale":"en_US","og_type":"article","og_title":"EtherNET or EtherNOT?","og_description":"A survey of the AI network positions of the leading vendors In July 2023, the Ultra Ethernet Consortium (UEC), initiated by the Linux Foundation and its","og_url":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm","og_site_name":"fibermall.com","article_published_time":"2023-12-09T04:00:58+00:00","article_modified_time":"2023-12-19T06:46:47+00:00","og_image":[{"width":1000,"height":665,"url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png","type":"image\/png"}],"author":"Brian","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Brian","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#article","isPartOf":{"@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm"},"author":{"name":"Brian","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/9421292f8817d668e9e64f94dfe9b901"},"headline":"EtherNET or EtherNOT?","datePublished":"2023-12-09T04:00:58+00:00","dateModified":"2023-12-19T06:46:47+00:00","mainEntityOfPage":{"@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm"},"wordCount":1684,"commentCount":0,"publisher":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization"},"image":{"@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#primaryimage"},"thumbnailUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png","articleSection":["Blog","Networking"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm","url":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm","name":"EtherNET or EtherNOT? | FiberMall","isPartOf":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#primaryimage"},"image":{"@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#primaryimage"},"thumbnailUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png","datePublished":"2023-12-09T04:00:58+00:00","dateModified":"2023-12-19T06:46:47+00:00","description":"The journey of Ethernet standardization for AI\/HPC networks has just begun, and it requires further cost and power reduction.","breadcrumb":{"@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#primaryimage","url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png","contentUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/12\/EtherNET-or-EtherNOT-1.png","width":1000,"height":665,"caption":"EtherNET or EtherNOT"},{"@type":"BreadcrumbList","@id":"https:\/\/www.fibermall.com\/blog\/ethernet-or-ethernot.htm#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.fibermall.com\/blog.htm"},{"@type":"ListItem","position":2,"name":"EtherNET or EtherNOT?"}]},{"@type":"WebSite","@id":"https:\/\/www.fibermall.com\/blog.htm\/#website","url":"https:\/\/www.fibermall.com\/blog.htm\/","name":"fibermall.com","description":"Optical Communication Expert","publisher":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.fibermall.com\/blog.htm\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization","name":"fibermall.com","url":"https:\/\/www.fibermall.com\/blog.htm\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/","url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg","contentUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg","width":200,"height":67,"caption":"fibermall.com"},"image":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/9421292f8817d668e9e64f94dfe9b901","name":"Brian","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/c196835c5ddcc99559fcfaa0046ffbd895891b78d40ab46bf34f7a5ecd73dfd9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c196835c5ddcc99559fcfaa0046ffbd895891b78d40ab46bf34f7a5ecd73dfd9?s=96&d=mm&r=g","caption":"Brian"},"description":"Optical Network Engineer","sameAs":["https:\/\/www.fibermall.com"],"url":"https:\/\/www.fibermall.com\/blog.htm?author=5"}]}},"_links":{"self":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/6845","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6845"}],"version-history":[{"count":4,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/6845\/revisions"}],"predecessor-version":[{"id":6853,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/6845\/revisions\/6853"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/media\/6849"}],"wp:attachment":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6845"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6845"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6845"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}