The Data Center is the New Unit of Computing (NVIDIA GTC 2021 Keynote Part 3)

TL;DR

Bluefield chips revolutionize data center infrastructure for improved performance and scalability.

Transcript

data center is the new unit of computing cloud computing and ai are driving fundamental changes in the architecture of data centers traditionally enterprise data centers ran monolithic software packages virtualization started the trend towards software-defined data centers allowing applications to move about and letting it manage from a single pane... Read More

Key Insights

• 🪛 Disaggregated microservices drive data center re-architecture for scalability.
• 🐕‍🦺 GPUs are crucial for compute-intensive AI services in data centers.
• 🐿️ Bluefield chips offer offloading and acceleration for networking, storage, and security tasks.
• 🈸 Transition from monolithic applications to microservices improves resource utilization.
• 😤 Multiple engineering teams can work concurrently in data centers using CI/CD methods.
• 🐕‍🦺 Bluefield chips improve quality of service and user concurrency in cloud services like GeForce Now.
• ❓ Bluefield 3 and future generations promise significant performance enhancements in data centers.

Questions & Answers

Q: How did virtualization impact the architecture of data centers?

Virtualization allowed applications to move around and transformed enterprise data centers into software-defined, easier-to-manage entities, running on CPUs.

Q: What challenges did data center networks face with the emergence of disaggregated microservices?

Data center networks were overwhelmed by east-west traffic generated by disaggregated microservices, leading to the need for high-speed, low-latency networking solutions.

Q: How does Bluefield improve NVIDIA's GeForce Now cloud gaming service?

Bluefield chips isolate infrastructure from game instances, offload networking, storage, and security tasks, improving quality of service and user concurrency in services like GeForce Now.

Q: What future innovations are expected with Bluefield chips in data centers?

Bluefield 3, with 400GB/s networking and advanced security capabilities, promises a 10x leap in performance, with Bluefield 4 set to incorporate AI computing for further enhancements.

Summary & Key Takeaways

• Data centers transitioned from monolithic software packages to disaggregated microservices for scalability.

• Deep learning and AI services drove the adoption of GPUs in data centers.

• NVIDIA's Bluefield chips offer offloading and acceleration for networking, storage, and security in data centers.