{"id":16521,"date":"2025-03-19T07:10:56","date_gmt":"2025-03-19T07:10:56","guid":{"rendered":"https:\/\/www.fibermall.com\/blog\/?p=16521"},"modified":"2025-03-19T08:50:21","modified_gmt":"2025-03-19T08:50:21","slug":"scaling-law-misunderstood-nvidia-launches-blackwell-rubin","status":"publish","type":"post","link":"https:\/\/www.fibermall.com\/news\/nvidia-launches-blackwell-and-rubin.htm","title":{"rendered":"Scaling Law Misunderstood, NVIDIA Launches Blackwell & Rubin"},"content":{"rendered":"\n

The AI industry\u2019s “Super Bowl” has begun, and today\u2019s star is Jensen Huang.<\/p>\n\n\n\n

Tech entrepreneurs, developers, scientists, investors, NVIDIA clients, partners, and media from around the world have flocked to the small city of San Jose for the man in the black leather jacket.<\/p>\n\n\n\n

Huang\u2019s GTC 2025 keynote began at 10:00 AM local time on March 18, but by 6:00 AM, Doges AI founder Abraham Gomez had already secured the second spot in line at the SAP Center, hoping to “grab a front-row seat.” By 8:00 AM, the queue outside stretched over a kilometer.<\/p>\n\n\n\n

Bill, CEO of music-generation startup Wondera, sat in the front row wearing his own black leather jacket “as a tribute to Jensen.” While the crowd was enthusiastic, Huang struck a more measured tone compared to last year\u2019s rockstar energy. This time, he aimed to reaffirm NVIDIA\u2019s strategy, repeatedly emphasizing “scale up” throughout his speech.<\/p>\n\n\n\n

Last year, Huang declared “the future is generative”; this year, he asserted that “AI is at a tipping point.” His keynote focused on three key announcements:<\/p>\n\n\n\n

1. Blackwell GPU Enters Full Production<\/p>\n\n\n\n

“Demand is incredible, and for good reason\u2014AI is at an inflection point,” Huang stated. He highlighted the growing need for computing power driven by AI inference systems and agentic training workloads.<\/p>\n\n\n\n

2. Blackwell NVLink 72 with Dynamo AI Software<\/p>\n\n\n\n

The new platform delivers 40x the AI factory performance of NVIDIA Hopper. “As we scale AI, inference will dominate workloads over the next decade,” Huang explained. Introducing Blackwell Ultra, he revived a classic line: “The more you buy, the more you save. Actually, even better\u2014the more you buy, the more you earn.”<\/p>\n\n\n\n

3. NVIDIA\u2019s Annual Roadmap for AI Infrastructure<\/p>\n\n\n\n

The company outlined three AI infrastructure pillars: cloud, enterprise, and robotics. <\/p>\n\n\n\n

\"AI<\/figure>\n\n\n\n

Huang also unveiled two new GPUs: the Blackwell Ultra GB300 (an upgraded Blackwell) and the next-gen Vera Rubin architecture with Rubin Ultra.<\/p>\n\n\n\n

NVIDIA has unveiled two new GPUs: the Blackwell Ultra GB300, an upgraded version of last year’s Blackwell, and a completely new chip architecture called Vera Rubin, along with Rubin Ultra.<\/p>\n\n\n\n

Jensen Huang’s unwavering belief in the Scaling Law is rooted in the advancements achieved through several generations of chip architectures.<\/p>\n\n\n\n

His keynote speech primarily focused on “Extreme Computation for Large-Scale AI Inference.”<\/p>\n\n\n\n

In AI inference, scaling from individual users to large-scale deployments requires finding the optimal balance between performance and cost-efficiency. Systems must not only ensure rapid responses for users but also maximize overall throughput (tokens per second) by enhancing hardware capabilities (e.g., FLOPS, HBM bandwidth) and optimizing software (e.g., architecture, algorithms), ultimately unlocking the economic value of large-scale inference.<\/p>\n\n\n\n

\"inference<\/figure>\n\n\n\n

Addressing concerns about the slowing down of the Scaling Law, Jensen Huang expressed a contrasting viewpoint, claiming that “emerging expansion methods and technologies are accelerating AI improvement at an unprecedented pace.”<\/p>\n\n\n\n

Facing considerable pressure, Huang appeared visibly strained during the live broadcast, frequently sipping water during breaks and sounding slightly hoarse by the end of his presentation.<\/p>\n\n\n\n

As the AI market transitions from “training” to “inference,” competitors such as AMD, Intel, Google, and Amazon are introducing specialized inference chips to reduce reliance on NVIDIA. Meanwhile, startups like Cerebras, Groq, and Tenstorrent are accelerating the development of AI accelerators, and companies like DeepSeek aim to minimize dependence on costly GPUs by optimizing their models. These dynamics contribute to the challenges Huang faces. While NVIDIA dominates over 90% of the training market, Huang is determined not to relinquish the inference market amidst intensifying competition. The event’s entry banner boldly asked: “What\u2019s Next in AI Starts Here.”<\/p>\n\n\n\n

\"What\u2019s<\/figure>\n\n\n\n

Key highlights of Jensen Huang’s keynote, as summarized on-site by “FiberMall,” include:<\/p>\n\n\n\n

The World Has Misunderstood the Scaling Law<\/strong><\/p>\n\n\n\n

AI has represented a transformative opportunity for NVIDIA over the past decade, and Huang remains deeply confident in its potential. At this GTC, he revisited two slides from his January CES keynote:<\/p>\n\n\n\n

The first slide outlined the stages of AI development: Perception AI, Generative AI, Agentic AI, and Physical AI.<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"the<\/figure>\n\n\n\n

The second slide depicted the three phases of the Scaling Law: Pre-training Scaling, Post-training Scaling, and Test-time Scaling (Long Thinking).<\/p>\n\n\n\n

\"three<\/figure>\n\n\n\n

Huang offered a perspective that sharply contrasts with mainstream views, asserting that concerns about the Scaling Law\u2019s slowing are misplaced. In his view, emerging expansion methods and technologies are driving AI progress at an unprecedented pace.<\/p>\n\n\n\n

As a firm believer in the Scaling Law, Huang’s conviction stems from the fact that global AI advancements are closely tied to NVIDIA’s GPU business. He went on to describe the evolution of AI that can “reason step by step,” emphasizing the role of inference and reinforcement learning in driving computational demands. As AI reaches an “inflection point,” cloud service providers are increasingly demanding GPUs, with Huang estimating that data center construction value will reach $1 trillion.<\/p>\n\n\n\n

Huang elaborated that NVIDIA CUDA-X GPU acceleration libraries and microservices now serve nearly every industry. In his vision, every company will operate two factories in the future: one for producing goods and another for generating AI.<\/p>\n\n\n\n

\"CUDA-X<\/figure>\n\n\n\n

AI is expanding into various fields worldwide, including robotics, autonomous vehicles, factories, and wireless networks. Jensen Huang highlighted that one of AI’s earliest applications was in autonomous vehicles, stating, “The technologies we\u2019ve developed are used by almost every autonomous vehicle company,” across both data centers and the automotive industry.<\/p>\n\n\n\n

Jensen announced a significant milestone in autonomous driving: General Motors, the largest automaker in the United States, is adopting NVIDIA AI, simulation, and accelerated computing to develop its next-generation vehicles, factories, and robots. He also introduced NVIDIA Halos, an integrated safety system combining NVIDIA’s automotive hardware and software safety solutions with cutting-edge AI research in autonomous vehicle safety.<\/p>\n\n\n\n

\"autonomous<\/figure>\n\n\n\n

Moving to data centers and inference, Huang shared that NVIDIA Blackwell has entered full-scale production, presenting systems from numerous industry partners. Pleased with Blackwell’s potential, he elaborated on how it supports extreme scalability, explaining, “We aim to address a critical challenge, and this is what we call inference.”<\/p>\n\n\n\n

Huang emphasized that inference involves generating tokens, a process essential for businesses. These AI factories that generate tokens must be built with exceptional efficiency and performance. With the latest inference models capable of solving increasingly complex problems, the demand for tokens will continue to rise.<\/p>\n\n\n\n

To accelerate large-scale inference further, Huang announced NVIDIA Dynamo, an open-source software platform designed to optimize and scale inference models in AI factories. Describing it as “essentially the operating system for AI factories,” he underscored its transformative potential.<\/p>\n\n\n\n

\"announcing<\/figure>\n\n\n\n

\u201cBuy More, Save More, Earn More\u201d<\/strong><\/p>\n\n\n\n

NVIDIA also revealed two new GPUs: the Blackwell Ultra GB300, an upgraded version of last year\u2019s Blackwell, and the next-generation Vera Rubin and Rubin Ultra chip architectures.<\/p>\n\n\n\n

Blackwell Ultra GB300 will be available in the second half of this year.<\/p>\n\n\n\n

Vera Rubin is set for release in the second half of next year.<\/p>\n\n\n\n

Rubin Ultra is expected in late 2027.<\/p>\n\n\n\n

Additionally, Huang unveiled the roadmap for upcoming chips. The architecture for the generation beyond Rubin has been named Feynman, anticipated in 2028. The name likely honors the renowned theoretical physicist Richard Feynman.<\/p>\n\n\n\n

Continuing NVIDIA’s tradition, each GPU architecture is named after prominent scientists\u2014Blackwell after statistician David Harold Blackwell, and Rubin after Vera Rubin, the pioneering astrophysicist who confirmed the existence of dark matter.<\/p>\n\n\n\n

\"nvidi<\/figure>\n\n\n\n

Over the past decade, NVIDIA has released 13 generations of GPU architectures, averaging over one new generation per year. These include iconic names such as Tesla, Fermi, Kepler, Maxwell, Pascal, Turing, Ampere, Hopper, and most recently, Rubin. Huang’s commitment to the Scaling Law has been a driving force behind these innovations.<\/p>\n\n\n\n

Regarding performance, Blackwell Ultra offers substantial upgrades compared to Blackwell, including an increase in HBM3e memory capacity from 192GB to 288GB. NVIDIA has also compared Blackwell Ultra to the H100 chip released in 2022, noting its ability to deliver 1.5 times the FP4 inference performance. This translates to a significant advantage: an NVL72 cluster running the DeepSeek-R1 671B model can provide interactive responses in 10 seconds, compared to 1.5 minutes with the H100. Blackwell Ultra processes 1,000 tokens per second, 10 times that of the H100.<\/p>\n\n\n\n

\"blackwell<\/figure>\n\n\n\n

NVIDIA will also offer the GB300 NVL72 single-rack system, featuring:<\/p>\n\n\n\n

1.1 exaflops of FP4,<\/p>\n\n\n\n

20TB of HBM memory,<\/p>\n\n\n\n

40TB of \u201cfast memory,\u201d<\/p>\n\n\n\n

130TB\/s of NVLink bandwidth, and<\/p>\n\n\n\n

14.4TB\/s of network speed.<\/p>\n\n\n\n

Acknowledging the overwhelming performance of Blackwell Ultra, Huang joked about his concerns that customers might skip purchasing the H100. He humorously referred to himself as the “chief revenue destroyer,” admitting that, in limited cases, Hopper chips are “okay,” but such scenarios are rare. Concluding with his classic line, he declared, “Buy more, save more. It’s even better than that. Now, the more you buy, the more you earn.”<\/p>\n\n\n\n

The Rubin architecture represents a groundbreaking step for NVIDIA. Jensen Huang emphasized, “Essentially, everything except the rack is brand new.”<\/p>\n\n\n\n

Enhanced FP4 Performance: Rubin GPUs achieve 50 petaflops, surpassing Blackwell\u2019s 20 petaflops. Rubin Ultra comprises a single chip with two interconnected Rubin GPUs, delivering 100 petaflops of FP4 performance\u2014twice that of Rubin\u2014and nearly quadrupling memory to 1TB.<\/p>\n\n\n\n

NVL576 Rubin Ultra Rack: Offers 15 exaflops of FP4 inference and 5 exaflops of FP8 training, boasting performance 14 times greater than Blackwell Ultra racks.<\/p>\n\n\n\n

\"nvidia<\/figure>\n\n\n\n

Huang also explained the integration of photonics technology to scale systems, incorporating it into NVIDIA’s Spectrum-X and Quantum-X silicon photonic network switches. These innovations blend electronic and optical communication, enabling AI factories to interconnect millions of GPUs across sites while reducing energy consumption and costs.<\/p>\n\n\n\n

\"photonic<\/figure>\n\n\n\n

The switches are exceptionally efficient, achieving 3.5 times power efficiency, 63 times signal integrity, 10 times network resilience, and faster deployment compared to traditional methods.<\/p>\n\n\n\n

Computers for the AI Era<\/strong><\/strong><\/p>\n\n\n\n

Expanding beyond cloud chips and data centers, NVIDIA launched desktop AI supercomputers powered by the NVIDIA Grace Blackwell platform. Designed for AI developers, researchers, data scientists, and students, these devices enable prototyping, fine-tuning, and inference of large models at the desktop level.<\/p>\n\n\n\n

\"desktop<\/figure>\n\n\n\n

Key products include:<\/p>\n\n\n\n

DGX Supercomputers: Featuring the NVIDIA Grace Blackwell platform for unmatched local or cloud deployment capabilities.<\/p>\n\n\n\n

DGX Station: A high-performance workstation equipped with Blackwell Ultra.<\/p>\n\n\n\n

\"Blackwell<\/figure>\n\n\n\n

Llama Nemotron Inference Series: An open-source AI model family offering improved multi-step reasoning, coding, and decision-making. NVIDIA\u2019s enhancements boost accuracy by 20%, inference speed by 5x, and operational cost efficiency. Leading companies such as Microsoft, SAP, and Accenture are partnering with NVIDIA to develop new inference models.<\/p>\n\n\n\n

The Era of General-Purpose Robotics<\/p>\n\n\n\n

Jensen Huang declared robots as the next $10 trillion industry, addressing a global labor shortage expected to reach 50 million workers by the end of the century. NVIDIA unveiled Isaac GR00T N1, the world\u2019s first open, fully customizable humanoid inference and skill foundation model, along with a new data generation and robotics learning framework. This paves the way for the next frontier in AI.<\/p>\n\n\n\n

In addition, NVIDIA released the Cosmos Foundation Model for physical AI development. This open, customizable model empowers developers with unprecedented control over world generation, creating vast and systematically infinite datasets through integration with Omniverse.<\/p>\n\n\n\n

Huang also introduced Newton, an open-source physics engine for robotics simulation co-developed with Google DeepMind and Disney Research. In a memorable moment, a miniature robot named “Blue,” which previously appeared at last year’s GTC, emerged on stage again, delighting the audience.<\/p>\n\n\n\n

\"blue\"<\/figure>\n\n\n\n

NVIDIA\u2019s ongoing journey has been about finding applications for its GPUs, from AI breakthroughs with AlexNet over a decade ago to today\u2019s focus on robotics and physical AI. Will NVIDIA’s aspirations for the next decade bear fruit? Time will tell.<\/p>\n