{"id":6438,"date":"2023-10-30T08:45:28","date_gmt":"2023-10-30T08:45:28","guid":{"rendered":"https:\/\/www.fibermall.com\/blog\/?p=6438"},"modified":"2025-06-25T07:24:23","modified_gmt":"2025-06-25T07:24:23","slug":"what-is-roce","status":"publish","type":"post","link":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm","title":{"rendered":"What is RoCE?"},"content":{"rendered":"\n<p>RoCE is known as RDMA over Converged Ethernet. So it is important to recognize RDMA as a technology before understanding RoCE.<\/p>\n\n\n\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_76 ez-toc-wrap-left counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\/#What_is_RDMA\" >What is RDMA?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\/#What_is_RoCE\" >What is RoCE?<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\/#How_Does_RoCE_Work\" >How Does RoCE Work?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\/#Applications_of_RoCE\" >Applications of RoCE<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\/#RoCE_vs_InfiniBand_and_iWARP\" >RoCE vs. InfiniBand and iWARP<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\/#Challenges_and_Considerations_for_RoCE\" >Challenges and Considerations for RoCE<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\/#Why_is_RoCE_the_mainstream_RDMA_protocol\" >Why is RoCE the mainstream RDMA protocol?<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\/#Related_Posts\" >Related Posts<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\" id=\"h-what-is-rdma\"><span class=\"ez-toc-section\" id=\"What_is_RDMA\"><\/span><strong>What is RDMA?<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>In modern data centers, achieving high-speed, low-latency networking is critical for applications like artificial intelligence (AI), high-performance computing (HPC), and cloud storage. RoCE (RDMA over Converged Ethernet) is a cutting-edge protocol that delivers Remote Direct Memory Access (RDMA) capabilities over standard Ethernet networks, combining ultra-low latency with cost-effective infrastructure. This comprehensive guide dives into what RoCE is, how it works, its benefits, and its applications, empowering IT professionals to optimize their network performance. Whether you\u2019re exploring RoCE for HPC clusters or enterprise storage, this article provides actionable insights to help you leverage this transformative technology.<\/p>\n\n\n\n<p>RDMA, Remote Direct Memory Access, can transmit data from one server to another, or from storage to server, with very minimal CPU occupancy. To send data, traditional applications have to go through the operating system to package TCP\/IP, and then pass through the main cache, the NIC cache, and finally be sent out. This leads to two limitations.<\/p>\n\n\n\n<p>Limitation 1: TCP\/IP stack processing introduces a latency of several tens of microseconds. When the TCP protocol stack receives and sends messages, the kernel needs to do multiple context switches, each of which consumes 5-10 microseconds. Plus, at least three data copies and protocol work depend on the CPU. This means that just protocol processing will bring a fixed delay of several tens of microseconds. The delay of the protocol stack becomes the most obvious bottleneck.<\/p>\n\n\n\n<p>Limitation 2: Processing with the TCP protocol stack results in a high load on the server CPU. In addition to the problem of a longer fixed delay, the TCP\/IP network requires the host CPU to participate in the memory copy of the protocol multiple times. The larger the network size and the higher the network bandwidth, the greater the scheduling burden on the CPU when sending and receiving data, leading to a continuously high CPU load.<\/p>\n\n\n\n<p>In data centers, if traditional TCP\/IP is used for network interconnection among ultra-large scale distributed computing storage resources, it will consume a great deal of computing resources of the system, leading to IO bottlenecks and failing to meet the network demands for higher throughput and lower latency.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/traditional-mode-to-rdma-mode.png\" alt=\"traditional mode to rdma mode\" class=\"wp-image-6440\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/traditional-mode-to-rdma-mode.png 1020w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/traditional-mode-to-rdma-mode-300x166.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/traditional-mode-to-rdma-mode-768x424.png 768w\" sizes=\"(max-width: 1020px) 100vw, 1020px\" \/><\/figure>\n\n\n\n<p>RDMA is a network interconnection technology that offers high bandwidth, low latency, and low CPU consumption. This technology overcomes many of the obstacles commonly associated with traditional TCP\/IP networking.<\/p>\n\n\n\n<p><strong>Remote<\/strong>: Refers to data transferring between two nodes in a network.<\/p>\n\n\n\n<p><strong>Direct<\/strong>: No kernel involvement is required. All transmission processing is offloaded to the NIC (Network Interface Card) hardware.<\/p>\n\n\n\n<p><strong>Memory<\/strong>: The data are transferred directly between the virtual memory of the applications on both nodes, without the need for additional copying and caching.<\/p>\n\n\n\n<p><strong>Access<\/strong>: The access operations include send\/receive, read\/write, etc.<\/p>\n\n\n\n<p>Compared with TCP\/IP, <a href=\"https:\/\/www.fibermall.com\/blog\/what-is-rdma.htm\" target=\"_blank\" rel=\"noreferrer noopener\">RDMA<\/a> reduces the usage of computing resources and increases the data transmission speed.<\/p>\n\n\n\n<p>RDMA&#8217;s kernel bypass mechanism allows direct data read\/write between the application and the NIC, reducing the data transfer latency within the server to nearly 1 microsecond. Also, RDMA&#8217;s zero-copy mechanism allows the receiving end to directly read data from the sender&#8217;s memory, significantly reducing the load on the CPU and improving CPU utilization.<\/p>\n\n\n\n<p>The benefits of using RDMA include:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Zero Copy: RDMA applications can bypass the kernel network stack and directly transfer data, eliminating the need to copy data from the user space memory of the application to the kernel network stack memory space.<\/li>\n\n\n\n<li>Kernel bypass: RDMA applications can initiate data transmission directly from user mode, avoiding the need for context switching between kernel mode and user mode.<\/li>\n\n\n\n<li>CPU offload: RDMA can directly access the memory of a remote host without consuming any CPU resources on the remote host. The remote host&#8217;s CPU can then focus on its prerogatives, avoid cache disturbance, and prevent a large-scale memory access data overspill.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-is-roce\"><span class=\"ez-toc-section\" id=\"What_is_RoCE\"><\/span><strong>What is RoCE?<\/strong><strong><\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Starting from 2010, RDMA caught more and more attention when the IBTA released the first specification for running RDMA over Converged Ethernet (RoCE). However, the initial specification limited the deployment of RoCE to a single Layer 2 domain because RoCE encapsulated frames lacked routing capabilities. In 2014, the IBTA released RoCEv2, which updated the initial RoCE specification to support routing across Layer 3 networks, making it more suitable for large-scale data center networks and enterprise data centers.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE-1024x574.png\" alt=\"RoCE\" class=\"wp-image-6441\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE-1024x574.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE-300x168.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE-768x430.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>RDMA protocols include Infiniband (IB), Internet Wide Area RDMA Protocol (iWARP), and RDMA over Converged Ethernet (RoCE):<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>InfiniBand<\/strong>: Designed with RDMA in mind, it re-designed the physical link layer, network layer, and transport layer, to ensure reliable transmission at the hardware level, and provide higher bandwidth and lower latency. But it is expensive and requires IB network cards and switches.<\/li>\n\n\n\n<li><strong>iWARP<\/strong>: RDMA network based on TCP, using TCP to achieve reliable transmission. Compared with RoCE, in the case of large-scale networking, iWARP\u2019s large number of TCP connections will consume a lot of memory resources, and require higher system specifications. It can use ordinary Ethernet switches, but it requires network cards that support iWARP.<\/li>\n\n\n\n<li><strong>RoCE<\/strong>: RDMA is based on Ethernet, RoCEv1 version is based on the network link layer, cannot cross network segments, and has basically no application. RoCEv2 is based on UDP, can cross network segments has good scalability, and can achieve good throughput and latency performance, so it is the solution adopted on a large scale. RoCE consumes fewer resources than iWARP and supports more features than iWARP. It can use ordinary Ethernet switches but requires network cards supporting RoCE.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/rdma-application-1024x388.png\" alt=\"rdma application\" class=\"wp-image-6442\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/rdma-application-1024x388.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/rdma-application-300x114.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/rdma-application-768x291.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/rdma-application.png 1034w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-how-does-roce-work\"><span class=\"ez-toc-section\" id=\"How_Does_RoCE_Work\"><\/span>How Does RoCE Work?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>RoCE leverages RDMA to enable direct memory access between networked devices, minimizing CPU overhead and latency. Here\u2019s a simplified breakdown of its operation:<\/p>\n\n\n\n<p>Memory Registration: Applications register memory regions for RDMA, allowing direct access by the network adapter.<\/p>\n\n\n\n<p>Queue Pair Creation: RoCE uses queue pairs (send and receive queues) to manage data transfers, handled by RDMA-capable network interface cards (RNICs).<\/p>\n\n\n\n<p>Data Transfer: The RNIC transfers data directly from the sender\u2019s memory to the receiver\u2019s memory, bypassing the CPU and kernel.<\/p>\n\n\n\n<p>Lossless Ethernet: RoCE requires a lossless Ethernet network, achieved through PFC (for RoCE v1\/v2) and ECN (for RoCE v2), to prevent packet loss and ensure reliable delivery.<\/p>\n\n\n\n<p>For RoCE v2, IP-based routing and UDP encapsulation allow data to traverse complex networks, making it suitable for enterprise and cloud environments. This efficiency makes RoCE a game-changer for applications requiring high-speed data transfers.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-applications-of-roce\"><span class=\"ez-toc-section\" id=\"Applications_of_RoCE\"><\/span>Applications of RoCE<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>RoCE is widely adopted across industries requiring high-performance networking. Key applications include:<\/p>\n\n\n\n<p>High-Performance Computing (HPC): RoCE enables low-latency communication in HPC clusters, supporting simulations in fields like physics, chemistry, and weather modeling.<\/p>\n\n\n\n<p>Artificial Intelligence and Machine Learning: AI workloads demand massive data transfers. RoCE accelerates training and inference by minimizing latency and maximizing bandwidth.<\/p>\n\n\n\n<p>Enterprise Storage: RoCE enhances storage solutions like NVMe-oF (NVMe over Fabrics), providing fast access to distributed storage systems.<\/p>\n\n\n\n<p>Cloud Computing: Cloud providers use RoCE to optimize virtualized environments, ensuring high-speed data delivery for SaaS and IaaS platforms.<\/p>\n\n\n\n<p>Financial Services: High-frequency trading platforms leverage RoCE\u2019s ultra-low latency to execute trades faster, gaining a competitive edge.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-roce-vs-infiniband-and-iwarp\"><span class=\"ez-toc-section\" id=\"RoCE_vs_InfiniBand_and_iWARP\"><\/span>RoCE vs. InfiniBand and iWARP<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>When choosing an RDMA protocol, understanding RoCE\u2019s differences from InfiniBand and iWARP is critical. Here\u2019s a comparison:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>Feature<\/strong><strong><\/strong><\/td><td><strong>RoCE<\/strong><strong><\/strong><\/td><td><strong>InfiniBand<\/strong><strong><\/strong><\/td><td><strong>iWARP<\/strong><strong><\/strong><\/td><\/tr><tr><td>Network Type<\/td><td>Ethernet (v1\/v2)<\/td><td>Proprietary fabric<\/td><td>Ethernet (TCP-based)<\/td><\/tr><tr><td>Latency<\/td><td>Sub-microsecond (&lt;1 \u00b5s)<\/td><td>Sub-microsecond (&lt;1 \u00b5s)<\/td><td>3-5 \u00b5s<\/td><\/tr><tr><td>Bandwidth<\/td><td>Up to 400 Gbps<\/td><td>Up to 400 Gbps<\/td><td>Up to 100 Gbps<\/td><\/tr><tr><td>Cost<\/td><td>Moderate (uses Ethernet)<\/td><td>Higher (specialized hardware)<\/td><td>Moderate (Ethernet-based)<\/td><\/tr><tr><td>Scalability<\/td><td>High (RoCE v2 routable)<\/td><td>Very high (fabric topology)<\/td><td>Moderate (TCP overhead)<\/td><\/tr><tr><td>Lossless Requirement<\/td><td>Yes (PFC, ECN)<\/td><td>Built-in lossless fabric<\/td><td>No (uses TCP)<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>RoCE offers a cost-effective RDMA solution over Ethernet, balancing performance and compatibility. <a href=\"https:\/\/www.fibermall.com\/store-21993-linkx-transceivers-and-cables.htm\" target=\"_blank\" rel=\"noreferrer noopener\">InfiniBand<\/a> excels in dedicated HPC environments, while iWARP suits TCP-based networks but sacrifices latency. For organizations with Ethernet infrastructure, RoCE is often the optimal choice.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-challenges-and-considerations-for-roce\"><span class=\"ez-toc-section\" id=\"Challenges_and_Considerations_for_RoCE\"><\/span>Challenges and Considerations for RoCE<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>While RoCE offers significant advantages, it comes with challenges that require careful consideration:<\/p>\n\n\n\n<p>Lossless Network Requirement: RoCE demands a lossless Ethernet environment, necessitating switches with PFC and ECN support, which can increase complexity.<\/p>\n\n\n\n<p>Configuration Complexity: Properly tuning QoS and RDMA settings requires expertise to avoid performance issues.<\/p>\n\n\n\n<p>Compatibility: Not all Ethernet switches support RoCE, so hardware upgrades may be needed.<\/p>\n\n\n\n<p>Network Congestion: In large-scale deployments, improper congestion management can degrade RoCE performance.<\/p>\n\n\n\n<p>Cost vs. Benefit: While cheaper than InfiniBand, RoCE-capable hardware may still require significant investment.<\/p>\n\n\n\n<p>Mitigate these challenges by partnering with trusted vendors like Fibermall, which offers RoCE-compatible solutions and technical support.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-why-is-roce-the-mainstream-rdma-protocol\"><span class=\"ez-toc-section\" id=\"Why_is_RoCE_the_mainstream_RDMA_protocol\"><\/span>Why is RoCE the mainstream RDMA protocol?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>First, let\u2019s talk about iWARP. The iWARP protocol stack is more complex than the other two, and because of the limitations of TCP, it can only support reliable transmission. Therefore, iWARP\u2019s development is not as good as RoCE and Infiniband.<\/p>\n\n\n\n<p>The Infiniband protocol itself defines a new set of hierarchical architecture, from the link layer to the transport layer, which is incompatible with existing Ethernet devices. For example, if a data center wants to switch from Ethernet to <a href=\"https:\/\/www.fibermall.com\/collection\/infiniband.htm\" target=\"_blank\" rel=\"noreferrer noopener\">Infiniband<\/a> technology because of performance bottlenecks, it must purchase a full set of Infiniband devices, including network cards, cables, switches, routers, etc., which is too costly.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"ast-oembed-container \" style=\"height: 100%;\"><iframe title=\"InfiniBand and RoCE: Artificial Intelligence Data Centers | FiberMall\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/eGoP2wPoaEM?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/div>\n<\/div><\/figure>\n\n\n\n<p>The advantage of the RoCE protocol is very obvious here. Users only need to buy network cards that support RoCE to switch from Ethernet to RoCE, and other network devices are compatible. Therefore, RoCE\u2019s main advantage over Infiniband is its lower cost.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/The-advantage-of-RoCE-protocol-1024x327.png\" alt=\"The advantage of RoCE protocol\" class=\"wp-image-6443\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/The-advantage-of-RoCE-protocol-1024x327.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/The-advantage-of-RoCE-protocol-300x96.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/The-advantage-of-RoCE-protocol-768x245.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/The-advantage-of-RoCE-protocol.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><strong>RoCEv1 <\/strong><strong><\/strong><\/p>\n\n\n\n<p>In April 2010, IBTA released RoCE, which was published as an addendum to the Infiniband Architecture Specification, so it is also called IBoE (InfiniBand over Ethernet). At this time, the RoCE standard used the IB network layer instead of the TCP\/IP network layer on top of the Ethernet link layer, so it did not support the IP routing function. The RoCE V1 protocol has a typeID of 0x8915 at the Ethernet layer.<\/p>\n\n\n\n<p>In RoCE, the Infiniband link layer protocol header is removed, and the GUID used to indicate the address is converted to Ethernet MAC. Infiniband relies on lossless physical transmission, and RoCE also relies on lossless Ethernet transmission, which brings cost and management overhead to the deployment of Ethernet.<\/p>\n\n\n\n<p>The lossless transmission of Ethernet must rely on L2 QoS support, such as PFC (Priority Flow Control). When the buffer pool exceeds the threshold, the receiver sends a pause frame to the sender. After receiving the pause frame, the MAC layer of the sender automatically reduces the transmission rate. This requirement means that all nodes on the entire transmission link, including the end, switch, and router, must all support L2 QoS, otherwise the PFC on the link cannot play an effective role at both ends.<\/p>\n\n\n\n<p><strong>RoCEv2 <\/strong><strong><\/strong><\/p>\n\n\n\n<p>Since the data frame of RoCEv1 does not have an IP header, it can only communicate within the L2 subnet. To solve this problem, IBTA proposed RoCE V2 in 2014, which extended RoCEv1, replacing the GRH (Global Routing Header) with UDP header + IP header. The extended frame structure is shown in the following figure. For RoCE v1 and RoCE v2, the following two points are worth noting:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>RoCE v1 (Layer 2) operates on the Ehternet Link Layer (Layer 2), so Ethertype 0x8915, so the normal Frame size is 1500 bytes, and Jumbo Frame is 9000 bytes.<\/li>\n\n\n\n<li>RoCE v2 (Layer 3) operates on UDP\/IPv4 or UDP\/IPv6 (Layer 3) and uses UDP Port 4791 for transmission. Because the RoCE v2 packet can be routed on Layer 3, it is sometimes called Routable RoCE or simply RRoCE.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image aligncenter size-full is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE-v1-Layer-2-operates-on-the-Ehternet-Link-Layer-Layer-2.png\" alt=\"RoCE v1 (Layer 2) operates on the Ehternet Link Layer (Layer 2)\" class=\"wp-image-6444\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE-v1-Layer-2-operates-on-the-Ehternet-Link-Layer-Layer-2.png 720w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE-v1-Layer-2-operates-on-the-Ehternet-Link-Layer-Layer-2-300x146.png 300w\" sizes=\"(max-width: 720px) 100vw, 720px\" \/><\/figure>\n\n\n\n<p>Since RDMA requires a packet lossless network to avoid drastic performance degradation, RoCE technology needs to transform the traditional Ethernet network into a lossless Ethernet network using PFC, ECN, and DCQCN technologies, to ensure zero packet loss.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/the-lossless-network-for-roce-1024x586.png\" alt=\"the lossless network for roce\" class=\"wp-image-6445\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/the-lossless-network-for-roce-1024x586.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/the-lossless-network-for-roce-300x172.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/the-lossless-network-for-roce-768x439.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/the-lossless-network-for-roce.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>PFC: Priority-based Flow Control. PFC provides per-hop priority-based flow control for various types of traffic.<\/p>\n\n\n\n<p>When forwarding packets, the device assigns packets to queues for scheduling and forwarding by looking up the priority of the packets in the priority mapping table. When the sending rate of 802.1p priority packets exceeds the receiving rate and the data buffer space at the receiver is insufficient, the receiver sends a PFC pause frame to the sender. When the sender receives the PFC pause frame, the sender stops sending packets with the specified 802.1p priority until the sender receives a PFC XON frame or the aging timer times out. When configuring PFC, the congestion of a specific type of packet does not affect the normal forwarding of other types of packets.<\/p>\n\n\n\n<p>ECN: Explicit Congestion Notification. ECN defines a traffic control and end-to-end congestion notification mechanism based on the IP layer and the transport layer. When the device is congested, ECN marks the ECN field in the IP header of the packet. The receiver sends a congestion notification packet (CNP) to notify the sender to slow down the sending speed. ECN implements end-to-end congestion management, reducing the spread and aggravation of congestion.<\/p>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/PFC-ECN-1024x601.png\" alt=\"PFC ECN\" class=\"wp-image-6446\" style=\"width:800px\" width=\"800\" srcset=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/PFC-ECN-1024x601.png 1024w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/PFC-ECN-300x176.png 300w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/PFC-ECN-768x451.png 768w, https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/PFC-ECN.png 1080w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>DCQCN (Data Center Quantized Congestion Notification): Currently the most widely used congestion control algorithm in RoCEv2 networks. It merges QCN and DCTCP algorithms and requires data center switches to support WRED and ECN. DCQCN can provide better fairness, achieve a high bandwidth utilization rate, ensure a low queue buffer occupancy rate, and less queue buffer jitter.<\/p>\n\n\n\n<p>At present, many manufacturers have their own lossless network solutions.<\/p>\n\n\n\n<p><strong>Huawei<\/strong><strong><\/strong><\/p>\n\n\n\n<p>Huawei&#8217;s iLossless intelligent lossless algorithm solution is an AI algorithm that utilizes artificial intelligence to achieve network congestion scheduling and network self-optimization. It&#8217;s centered on Automatic ECN and introduces Deep Reinforcement Learning (DRL) into ultra-high-speed data center switches. Based on the iLossless intelligent lossless algorithm, Huawei released the super-converged data center network solution CloudFabric 3.0, leading the intelligent lossless era into 1.0.<\/p>\n\n\n\n<p>In 2022, Huawei&#8217;s hyper-converged data center network proposed intelligent lossless web calculation integration technology and innovative direct connection topology architecture, which can realize a 270k large-scale computational hub network. The delay can be further reduced by 25% based on intelligent lossless 1.0.<\/p>\n\n\n\n<p>Huawei Intelligent Lossless 2.0 is based on in-network computing and topology-aware computing to achieve network and computing synergy. The network participates in the collection and synchronization of computing information, reducing the number of times of computing information synchronization. Simultaneously, it ensures the completion of computing tasks near the computing nodes through scheduling, reducing communication jumps, and further reducing application latency.<\/p>\n\n\n\n<p><strong>H3C<\/strong><strong><\/strong><\/p>\n\n\n\n<p>H3C&#8217;s AI ECN intelligent lossless algorithm, which draws on the network traffic model (Incast values, maximum queue depth, proportion of large and small flows, among other traffic characteristics in the N-to-1 model), utilizes reinforcement learning algorithms to train the AI with the traffic model. The AI can sense and predict network traffic trends in real time, and automatically adjust the most optimal ECN threshold for precise queue scheduling. In doing so, it balances the transmission of latency-sensitive small flows and throughput-sensitive larger flows to ensure optimal network performance, all while avoiding the triggering of network PFC congestion control.<\/p>\n\n\n\n<p>H3C&#8217;s AD-DC SeerFabric lossless network solution is based on an edge-cloud AI collaborative architecture. By innovating and optimizing the industry&#8217;s AI ECN tuning algorithm and combining the local AI Inside capability of H3C&#8217;s data center switch, this solution boosts throughput and decreases latency while ensuring zero packet loss. It ensures precise network service quality and forwarding. Moreover, through fine-grained intelligent operations and maintenance, it visualizes the service experience of RoCE networks.<\/p>\n\n\n\n<p><strong>Inspur<\/strong><strong><\/strong><\/p>\n\n\n\n<p>In April 2022, Inspur Networks launched its typical lossless Ethernet solution, centered around data center Ethernet switches supporting the RoCE technology. The solution offers the following advantages:<\/p>\n\n\n\n<p>1. Seamless integration of computing, storage, networking, and AIStation. It supports congestion management technologies such as PFC and ECN, allowing the establishment of end-to-end, lossless, low-latency RDMA-bearing networks. The switch&#8217;s excellent buffer advantage can absorb burst traffic smoothly, effectively dealing with TCP in cast scenarios.<\/p>\n\n\n\n<p>2. Proactive fault discovery and automatic failover. RoCE-SAN networks can collaborate with storage operations for quick fault sensing. The switch can rapidly detect fault states and notify servers subscribing to notification messages within the relevant business domain, enabling a quick switch to redundant pathways and reducing business impacts. For large-scale, lossless Ethernet environments experiencing PFC deadlock issues, the solution provides a chip-level PFC deadlock prevention mechanism for automatic deadlock detection and recovery.<\/p>\n\n\n\n<p>3. Plug-and-play storage. RoCE-SAN networks can automatically detect the incorporation of device servers and storage devices, notifying servers to automatically establish connections with the storage devices.<\/p>\n<style>\r\n\r\n        .lwrp.link-whisper-related-posts{\r\n            \r\n            margin-top: 40px;\nmargin-bottom: 30px;\r\n        }\r\n        .lwrp .lwrp-title{\r\n            \r\n            \r\n        }\r\n        .lwrp .lwrp-description{\r\n            \r\n            \r\n\r\n        }\r\n        .lwrp .lwrp-list-container{\r\n        }\r\n        .lwrp .lwrp-list-multi-container{\r\n            display: flex;\r\n        }\r\n        .lwrp .lwrp-list-double{\r\n            width: 48%;\r\n        }\r\n        .lwrp .lwrp-list-triple{\r\n            width: 32%;\r\n        }\r\n        .lwrp .lwrp-list-row-container{\r\n            display: flex;\r\n            justify-content: space-between;\r\n        }\r\n        .lwrp .lwrp-list-row-container .lwrp-list-item{\r\n            width: calc(100% - 20px);\r\n        }\r\n        .lwrp .lwrp-list-item:not(.lwrp-no-posts-message-item){\r\n            \r\n            list-style: decimal;\r\n        }\r\n        .lwrp .lwrp-list-item img{\r\n            max-width: 100%;\r\n            height: auto;\r\n        }\r\n        .lwrp .lwrp-list-item.lwrp-empty-list-item{\r\n            background: initial !important;\r\n        }\r\n        .lwrp .lwrp-list-item .lwrp-list-link .lwrp-list-link-title-text,\r\n        .lwrp .lwrp-list-item .lwrp-list-no-posts-message{\r\n            \r\n                \r\n        }\r\n        @media screen and (max-width: 480px) {\r\n            .lwrp.link-whisper-related-posts{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-title{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-description{\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-list-multi-container{\r\n                flex-direction: column;\r\n            }\r\n            .lwrp .lwrp-list-multi-container ul.lwrp-list{\r\n                margin-top: 0px;\r\n                margin-bottom: 0px;\r\n                padding-top: 0px;\r\n                padding-bottom: 0px;\r\n            }\r\n            .lwrp .lwrp-list-double,\r\n            .lwrp .lwrp-list-triple{\r\n                width: 100%;\r\n            }\r\n            .lwrp .lwrp-list-row-container{\r\n                justify-content: initial;\r\n                flex-direction: column;\r\n            }\r\n            .lwrp .lwrp-list-row-container .lwrp-list-item{\r\n                width: 100%;\r\n            }\r\n            .lwrp .lwrp-list-item:not(.lwrp-no-posts-message-item){\r\n                \r\n                \r\n            }\r\n            .lwrp .lwrp-list-item .lwrp-list-link .lwrp-list-link-title-text,\r\n            .lwrp .lwrp-list-item .lwrp-list-no-posts-message{\r\n                \r\n                    \r\n            }\r\n        }<\/style>\r\n<div id=\"link-whisper-related-posts-widget\" class=\"link-whisper-related-posts lwrp\">\r\n            <h3 class=\"lwrp-title\">Related Posts<\/h3>    \r\n        <div class=\"lwrp-list-container\">\r\n                                            <ul class=\"lwrp-list lwrp-list-single\">\r\n                    <li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/nvidia-a100.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">NVIDIA A100: The Ultimate GPU for High-Performance Computing and AI<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/400g-zr-transceiver.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">Optimizing Data Centers with Cutting-Edge 400G ZR Transceivers<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/the-design-and-practice-of-large-scale-high-performance-ai-networks.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">The Design and Practice of Large-Scale High-Performance AI Networks<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/news\/800g-redefines-networking-landscape.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">800G Technology Redefines the Networking Landscape<\/span><\/a><\/li><li class=\"lwrp-list-item\"><a href=\"https:\/\/www.fibermall.com\/blog\/practical-co-packaged-optics.htm\" class=\"lwrp-list-link\"><span class=\"lwrp-list-link-title-text\">How many years are there before CPO technology is practical?<\/span><\/a><\/li>                <\/ul>\r\n                        <\/div>\r\n<\/div>","protected":false},"excerpt":{"rendered":"<p>RoCE is known as RDMA over Converged Ethernet. So it is important to recognize RDMA as a technology before understanding RoCE. What is RDMA? In modern data centers, achieving high-speed, low-latency networking is critical for applications like artificial intelligence (AI), high-performance computing (HPC), and cloud storage. RoCE (RDMA over Converged Ethernet) is a cutting-edge protocol [&hellip;]<\/p>\n","protected":false},"author":7,"featured_media":6441,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":"","_wpscppro_dont_share_socialmedia":false,"_wpscppro_custom_social_share_image":0,"_facebook_share_type":"default","_twitter_share_type":"default","_linkedin_share_type":"default","_pinterest_share_type":"default","_linkedin_share_type_page":"default","_instagram_share_type":"default","_medium_share_type":"","_threads_share_type":"","_google_business_share_type":"","_selected_social_profile":[{"id":"skM9ewvR8O","platform":"linkedin","platformKey":0,"name":"Jason Xue","type":"person","thumbnail_url":"https:\/\/media.licdn.com\/dms\/image\/C5603AQErPqKD0j6qBg\/profile-displayphoto-shrink_100_100\/0\/1599138392315?e=1723075200&v=beta&t=joEkh1OeKQ0F-QpAPv4xxQyBdGlHyccIQZauRSs6RvU","share_type":"default"}],"_wpsp_enable_custom_social_template":false,"_wpsp_social_scheduling":{"enabled":false,"datetime":null,"platforms":[],"status":"template_only","dateOption":"today","timeOption":"now","customDays":"","customHours":"","customDate":"","customTime":"","schedulingType":"absolute"},"_wpsp_active_default_template":true},"categories":[2],"tags":[],"class_list":["post-6438","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v20.13 (Yoast SEO v25.8) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>What is RoCE? | FiberMall<\/title>\n<meta name=\"description\" content=\"RoCE is known as RDMA over Converged Ethernet. RoCE\u2019s main advantage over Infiniband is that it has lower cost.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What is RoCE?\" \/>\n<meta property=\"og:description\" content=\"RoCE is known as RDMA over Converged Ethernet. So it is important to recognize RDMA as a technology before understanding RoCE. What is RDMA? In modern\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\" \/>\n<meta property=\"og:site_name\" content=\"fibermall.com\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-30T08:45:28+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-25T07:24:23+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1080\" \/>\n\t<meta property=\"og:image:height\" content=\"605\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Casey\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Casey\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"14 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\"},\"author\":{\"name\":\"Casey\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/8a62a1260941aa13aa5900e9ea7e1342\"},\"headline\":\"What is RoCE?\",\"datePublished\":\"2023-10-30T08:45:28+00:00\",\"dateModified\":\"2025-06-25T07:24:23+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\"},\"wordCount\":2709,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png\",\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\",\"url\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\",\"name\":\"What is RoCE? | FiberMall\",\"isPartOf\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png\",\"datePublished\":\"2023-10-30T08:45:28+00:00\",\"dateModified\":\"2025-06-25T07:24:23+00:00\",\"description\":\"RoCE is known as RDMA over Converged Ethernet. RoCE\u2019s main advantage over Infiniband is that it has lower cost.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#primaryimage\",\"url\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png\",\"contentUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png\",\"width\":1080,\"height\":605,\"caption\":\"RoCE\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.fibermall.com\/blog.htm\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What is RoCE?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#website\",\"url\":\"https:\/\/www.fibermall.com\/blog.htm\/\",\"name\":\"fibermall.com\",\"description\":\"Optical Communication Expert\",\"publisher\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.fibermall.com\/blog.htm\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#organization\",\"name\":\"fibermall.com\",\"url\":\"https:\/\/www.fibermall.com\/blog.htm\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg\",\"contentUrl\":\"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg\",\"width\":200,\"height\":67,\"caption\":\"fibermall.com\"},\"image\":{\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/8a62a1260941aa13aa5900e9ea7e1342\",\"name\":\"Casey\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/28096898b03bf5fa03557b33f40633b0fe4fa656c7f28e52669eca8ec4146459?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/28096898b03bf5fa03557b33f40633b0fe4fa656c7f28e52669eca8ec4146459?s=96&d=mm&r=g\",\"caption\":\"Casey\"},\"description\":\"Expert in access network, PON, GPON, etc.\",\"sameAs\":[\"https:\/\/www.fibermall.com\/\"],\"url\":\"https:\/\/www.fibermall.com\/blog.htm?author=7\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"What is RoCE? | FiberMall","description":"RoCE is known as RDMA over Converged Ethernet. RoCE\u2019s main advantage over Infiniband is that it has lower cost.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm","og_locale":"en_US","og_type":"article","og_title":"What is RoCE?","og_description":"RoCE is known as RDMA over Converged Ethernet. So it is important to recognize RDMA as a technology before understanding RoCE. What is RDMA? In modern","og_url":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm","og_site_name":"fibermall.com","article_published_time":"2023-10-30T08:45:28+00:00","article_modified_time":"2025-06-25T07:24:23+00:00","og_image":[{"width":1080,"height":605,"url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png","type":"image\/png"}],"author":"Casey","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Casey","Est. reading time":"14 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#article","isPartOf":{"@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm"},"author":{"name":"Casey","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/8a62a1260941aa13aa5900e9ea7e1342"},"headline":"What is RoCE?","datePublished":"2023-10-30T08:45:28+00:00","dateModified":"2025-06-25T07:24:23+00:00","mainEntityOfPage":{"@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm"},"wordCount":2709,"commentCount":0,"publisher":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization"},"image":{"@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#primaryimage"},"thumbnailUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png","articleSection":["Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm","url":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm","name":"What is RoCE? | FiberMall","isPartOf":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#primaryimage"},"image":{"@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#primaryimage"},"thumbnailUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png","datePublished":"2023-10-30T08:45:28+00:00","dateModified":"2025-06-25T07:24:23+00:00","description":"RoCE is known as RDMA over Converged Ethernet. RoCE\u2019s main advantage over Infiniband is that it has lower cost.","breadcrumb":{"@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.fibermall.com\/blog\/what-is-roce.htm"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#primaryimage","url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png","contentUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2023\/11\/RoCE.png","width":1080,"height":605,"caption":"RoCE"},{"@type":"BreadcrumbList","@id":"https:\/\/www.fibermall.com\/blog\/what-is-roce.htm#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.fibermall.com\/blog.htm"},{"@type":"ListItem","position":2,"name":"What is RoCE?"}]},{"@type":"WebSite","@id":"https:\/\/www.fibermall.com\/blog.htm\/#website","url":"https:\/\/www.fibermall.com\/blog.htm\/","name":"fibermall.com","description":"Optical Communication Expert","publisher":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.fibermall.com\/blog.htm\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.fibermall.com\/blog.htm\/#organization","name":"fibermall.com","url":"https:\/\/www.fibermall.com\/blog.htm\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/","url":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg","contentUrl":"https:\/\/www.fibermall.com\/blog\/wp-content\/uploads\/2024\/12\/cropped-Fiber-Mall-Logo.jpg","width":200,"height":67,"caption":"fibermall.com"},"image":{"@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/8a62a1260941aa13aa5900e9ea7e1342","name":"Casey","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.fibermall.com\/blog.htm\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/28096898b03bf5fa03557b33f40633b0fe4fa656c7f28e52669eca8ec4146459?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/28096898b03bf5fa03557b33f40633b0fe4fa656c7f28e52669eca8ec4146459?s=96&d=mm&r=g","caption":"Casey"},"description":"Expert in access network, PON, GPON, etc.","sameAs":["https:\/\/www.fibermall.com\/"],"url":"https:\/\/www.fibermall.com\/blog.htm?author=7"}]}},"_links":{"self":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/6438","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6438"}],"version-history":[{"count":8,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/6438\/revisions"}],"predecessor-version":[{"id":17521,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/posts\/6438\/revisions\/17521"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=\/wp\/v2\/media\/6441"}],"wp:attachment":[{"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6438"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6438"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.fibermall.com\/blog.htm\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6438"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}