GTC 2017: NVIDIA Announces Tesla V100 (NVIDIA keynote part 6)

TL;DR

The Tesla Volta V100 is an incredibly complex and expensive computer project that pushes the limits of technology.

Transcript

I would like to introduce you to something that has taken several thousand Engineers several thousand Engineers several years to create it is a masterpiece on many levels it is the most complex project that has ever been undertaken arguably the most expensive computer project the world's ever done ladies and gentlemen the Tesla Volta v00 this is ma... Read More

Key Insights

• 🫷 The Tesla Volta V100 is an impressively complex and expensive computer project that pushes the limits of technology.
• 💨 It incorporates the most advanced technology, cramming all possible transistors into the processor and utilizing the fastest memories available.
• 💯 The tensor core, a new processor type, greatly enhances the Volta V100's performance in deep learning tasks.

Questions & Answers

Q: What makes the Tesla Volta V100 such a remarkable project?

The Volta V100 is considered a masterpiece due to its complexity, incorporating the most advanced technology and cramming every possible transistor into the processor. Its manufacturing feasibility is impressive.

Q: What is the significance of the tensor core in the Volta V100?

The tensor core is a new type of processor that performs the important primitives of deep learning. It significantly increases the throughput and can achieve a 20 times increase in performance compared to previous processors.

Q: How does the memory system in the Volta V100 differ from other processors?

Unlike other processors, the Volta V100 has a huge register file of 20 megabytes, allowing for faster and closer access to memory. It also utilizes state-of-the-art memories, achieving a speed of 900 gigabytes per second.

Q: How does the Volta V100 compare to its predecessor, Pascal, in terms of performance?

The Volta V100 offers one and a half times the floating-point performance and 12 times the tensor operations for deep learning training compared to Pascal. Additionally, it provides six times the performance for inferencing tasks.

Summary & Key Takeaways

• The Tesla Volta V100 is a masterpiece project that incorporates the most advanced technology, with a chip made at the limits of photolithography.

• It contains 21 billion processors, almost 100 billion vas connectors, and 800 millim squared die size, making it an impressive feat of engineering.

• The Volta V100 also introduces a brand new type of processor called tensor core, capable of 120 teraflops of tensor operations.