The Intersection of Valuing Securities and the Demand for Nvidia H100 GPUs

The Intersection of Valuing Securities and the Demand for Nvidia H100 GPUs

Introduction:

In the world of investing, there are two crucial aspects to consider: quantitative and qualitative analysis. This sentiment is echoed by Todd Combs, a prominent investor, who emphasizes the importance of understanding how to value a security while also recognizing the unique qualitative factors that contribute to its success. This analogy can be compared to being a chef, where even with the same recipe, two chefs can create vastly different dishes. Similarly, when evaluating stocks or acquisitions, the focus should primarily be on qualitative factors that determine a company's competitive advantage and potential for growth.

Valuing Securities: The Quantitative Aspect

The process of valuing a security involves analyzing financial statements, market trends, and other numerical data. While the math involved may not be complicated, it serves as a starting point for investors to assess the intrinsic value of a company. However, it is essential to note that this quantitative analysis is only one part of the equation. It provides a foundation, but the real value lies in the qualitative factors that differentiate one company from another.

Understanding the Qualitative Factors: The Secret Sauce

The qualitative factors that Todd Combs refers to are the secret sauce of investing. These factors encompass a company's moats, barriers to entry, and other intangible qualities that contribute to its competitive advantage. Unlike quantitative data, which can be found in public filings and annual reports, these qualitative aspects require a deeper understanding of the industry, market dynamics, and the company itself. They provide insights into a company's potential for sustainable growth and long-term success.

Starting with Facts: Building a Narrative

To effectively evaluate a company's potential, it is crucial to start with the facts and build a narrative from there. Instead of starting with a predetermined narrative and attempting to prove it, investors should gather all relevant information and analyze it objectively. This approach helps avoid the anchoring effect, where initial preconceptions can cloud judgment and hinder accurate valuation. By starting with the facts, investors can develop a comprehensive understanding of a company's value and make more informed investment decisions.

The Role of Mentors and Gratitude

Todd Combs emphasizes the role of mentors and the gratitude he feels towards those who have supported and guided him throughout his career. Investing is not a solitary endeavor but a collaborative effort that involves learning from others' experiences and insights. Mentors provide invaluable guidance and help investors recognize their potential even when they may not see it themselves. Gratitude for the support received along the way is a powerful motivator and reminder of the importance of collaboration in achieving success.

Connecting Valuing Securities to the Demand for Nvidia H100 GPUs

Shifting gears, let's explore the demand for Nvidia H100 GPUs, specifically in the field of fine-tuning large open-source models (LLMs) and other model development work. Startups and companies using private clouds are the primary consumers of these high-end GPUs, with a focus on LLMs and new model development. The H100 GPU is favored for its speed and scalability, making it the preferred choice for training LLMs. Additionally, factors such as memory bandwidth, FLOPS, and cache latencies play a crucial role in LLM training.

The Influence of CUDA and the AMD Challenge

Nvidia's CUDA platform currently serves as its moat, preventing competitors like AMD from gaining significant traction in the market. While theoretically, companies could opt for AMD GPUs, the investment required in dev time and compatibility issues creates a significant barrier. The time spent on these challenges could delay a company's entry into the market, making CUDA the preferred choice for most LLM companies.

Estimating the Demand and Production Challenges

To understand the demand for H100 GPUs, it is essential to consider the number of GPUs required for various projects. For example, GPT-4 was likely trained on thousands of A100s, indicating the need for a substantial number of H100s for similar projects. Estimates suggest that companies like OpenAI, Inflection, and Meta may require tens of thousands of H100 GPUs. However, production challenges, specifically CoWoS packaging, pose a bottleneck in meeting this demand.

Nvidia Allocations and Customer Preference

Nvidia's allocation strategy plays a crucial role in meeting the demand for H100 GPUs. Cloud providers like Azure, AWS, and Google Cloud have launched their H100 previews, with Nvidia considering the end customer and their brand reputation when allocating GPUs. Startups and companies with strong pedigrees are more likely to receive larger allocations. Nvidia aims to avoid providing significant allocations to companies directly competing with their own hardware offerings.

Conclusion:

Valuing securities and understanding the demand for high-end GPUs like the Nvidia H100 require a comprehensive analysis that combines both quantitative and qualitative factors. By starting with the facts and building a narrative, investors can make informed investment decisions. Additionally, the demand for H100 GPUs in the field of LLMs and model development highlights the importance of speed, scalability, and compatibility. Understanding these factors and the production challenges faced by manufacturers like Nvidia is crucial in predicting market trends and meeting the growing demand.

Actionable Advice:

1. Embrace a comprehensive approach: When evaluating investments, consider both the quantitative and qualitative factors that contribute to a company's value and potential for growth. This holistic approach provides a more accurate assessment of investment opportunities.

2. Stay informed about industry trends: To understand the demand for technological products like high-end GPUs, it is essential to stay updated on industry developments, market dynamics, and emerging technologies. This knowledge will help identify potential investment opportunities and market trends.

3. Foster collaboration and gratitude: Recognize the importance of mentors and those who have supported you throughout your journey. Collaborate with others, learn from their experiences, and express gratitude for the guidance received. This mindset fosters personal growth and opens doors to new opportunities.

In conclusion, the intersection of valuing securities and the demand for high-end GPUs reveals the need for a comprehensive understanding of both quantitative and qualitative factors. By incorporating these insights into investment strategies and staying informed about market trends, investors can make informed decisions and capitalize on emerging opportunities.