{"id":10673,"date":"2024-07-25T07:44:33","date_gmt":"2024-07-25T07:44:33","guid":{"rendered":"https:\/\/www.fibermall.com\/blog\/?p=10673"},"modified":"2024-07-25T10:08:08","modified_gmt":"2024-07-25T10:08:08","slug":"breaking-down-the-five-key-components-of-an-ai-server","status":"publish","type":"post","link":"https:\/\/www.fibermall.com\/blog\/key-components-of-ai-server.htm","title":{"rendered":"Breaking down the Five Key Components of an AI Server"},"content":{"rendered":"\n

The DGX A100 resembles a typical home computer and can be divided into five main hardware modules:<\/p>\n\n\n\n

\"server\"<\/figure>\n\n\n\n
    \n
  1. Fan Module: Located at the front, the fan module consists of eight fans, which align with the standard 8U configuration found in traditional servers.<\/li>\n\n\n\n
  2. Hard Drives: Positioned below the front fan module, the DGX A100 houses eight 3.84TB hard drives, providing a total internal storage capacity of 30TB.<\/li>\n\n\n\n
  3. GPU Board Tray: The rear section of the AI server is where the critical components come together. The GPU board tray is the heart of the system and differentiates AI servers from regular ones. In the DGX A100 architecture, the GPU board tray includes GPU components, module boards, and NVSwitch components\u2014all of which involve various types of PCBs.<\/li>\n\n\n\n
  4. CPU Motherboard Tray: This part serves as the core component for all servers, including both regular and AI servers. It contains the CPU motherboard, system memory, network cards, and PCIE switches. The CPU motherboard and system memory significantly contribute to the overall PCB usage.<\/li>\n\n\n\n
  5. Power Module: The DGX A100\u2019s rear section also features six power modules, internally utilizing thick copper PCBs.<\/li>\n<\/ol>\n\n\n\n

    From a functional perspective, we can categorize the PCB value calculation for AI servers into three parts:<\/p>\n\n\n\n

    \"nvidia<\/figure>\n\n\n\n
    \"DGX<\/figure>\n\n\n\n
    \n
    \n

    Table of Contents<\/p>\nToggle<\/span><\/path><\/svg><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n