NVIDIA reposted this
The AI industry has evolved across multiple layers since its initial boom in 2022, and we are now witnessing a major shift toward agentic computing, driven by applications and wrappers built on frontier models. At the same time, for infrastructure providers like NVIDIA, having ample memory bandwidth and onboard performance has become increasingly critical to meet the latency demands of agentic frameworks. With Blackwell Ultra, Team Green appears to have addressed those needs. In a recent blog post, NVIDIA tested Blackwell Ultra using SemiAnalysis’s InferenceMAX, and the results were astonishing. The company has focused on both raw performance and throughput optimizations, which is why, with GB300 NVL72, NVIDIA sees a 50x increase in throughput per megawatt compared to Hopper GPUs. 🔗 https://lnkd.in/dc3_QqvC