AI/ML is booming, and there are certain areas and players worth paying attention to. From an investment perspective, the competition landscape is relatively clear in the underlying cloud, the middle layer of data lakes and data warehouses, and the small tools created around cloud data warehouses. The best investment opportunities in these areas have already passed, so now is the time to shift focus to the application layer of the data industry.

Darren LI

Hatched by Darren LI

May 25, 2024

4 min read

0

AI/ML is booming, and there are certain areas and players worth paying attention to. From an investment perspective, the competition landscape is relatively clear in the underlying cloud, the middle layer of data lakes and data warehouses, and the small tools created around cloud data warehouses. The best investment opportunities in these areas have already passed, so now is the time to shift focus to the application layer of the data industry.

As the use of artificial intelligence becomes increasingly complex, there is a growing demand from businesses for more specialized modular products. The AI/ML industry is showing a trend towards a shift from platformization to modularization. With advancements in GPU and AI/ML technologies, people are now able to analyze large amounts of data in an economically efficient and scalable manner. AI/ML is being widely applied in practical use cases. These customers want "off-the-shelf" products to solve their immediate business problems. They may not necessarily care about how the algorithms work; they just want to ensure that the algorithms are effective.

There are three core types of AI/ML users: Off-the-shelfers, Bet-the-farmers, and Rocket scientists. Off-the-shelfers abstract the various parts of the AI model building and deployment workflow, and it is crucial to demonstrate tangible value to this user group. Bet-the-farmers focus on developing specialized solutions for "million-dollar level problems." These solutions can improve inefficient or ineffective processes and often result in cost savings worth millions and increased profits due to their large business scale. From an AI investment perspective, the opportunity is greatest for bet-the-farmers. Although machine learning applications in this field are currently limited due to budget constraints, it is only a matter of time before bet-the-farmers extensively adopt machine learning because of its immense potential. Rocket scientists, on the other hand, may not necessarily need a commercial platform. They customize their own solutions or use open-source code because they have a precise understanding of the tools they need and how to solve problems.

Automation of machine learning (AutoML) solutions simplifies the end-to-end AI project lifecycle by handling core workflow components, including data preparation, model selection and training, and model deployment, through a single integrated platform. This is achieved through drag-and-drop functionality and easy-to-understand visualizations. The platform includes data platforms, data preprocessing (data labeling, data preparation, and data quality), feature libraries, ML architecture, distributed computing, model evaluation and experiment tracking, model deployment, model monitoring and management, business decision and application, deep learning, task scheduling, and platform solutions. Companies in this field include databases, data lakes, Snowflake, Databricks, AWS S3, and query engines like Dremio.

Data processing is the process of converting raw data into structured data for training ML models. It involves running the data set through training to determine the model's fit, running it on a validation data set to evaluate model performance and adjust parameters, and running it on a test data set to ensure accuracy in real-world applications. Platforms that effectively select and train models include Hugging Face, PyTorch, and TensorFlow.

Distributed data engines orchestrate computation to process data in server clusters. Companies in this field include Coiled, AnyScale, and Databricks.

Model building is an empirical science that requires multiple iterations and specific adjustments to the model and underlying code. End users need a system that tracks all changes to enable seamless collaboration and adjustments to AI/ML plans. Companies in this field include Weights & Biases and Comet.ML.

Other notable companies in the AI/ML field include OctoML (acquired by DataRobot), Algorithmia (acquired by DataRobot), and Velohai.

In addition to understanding the various players and areas in the AI/ML industry, it is important to consider actionable advice for those looking to invest or navigate this space:

  1. Stay ahead of the curve: While the competition may be clear in certain areas, the AI/ML industry is constantly evolving. Keeping up with the latest trends, technologies, and players will help identify emerging investment opportunities and potential partnerships.

  2. Focus on industry-specific applications: As AI/ML becomes more ubiquitous, businesses are seeking specialized solutions tailored to their specific industries. Identifying niche markets or verticals where AI/ML can have a significant impact can lead to lucrative investment opportunities.

  3. Embrace collaboration and integration: The AI/ML landscape is vast and complex. Companies that prioritize collaboration and integration with other players in the ecosystem are more likely to succeed. Look for companies that offer seamless integration with existing systems and prioritize partnerships to create a comprehensive AI/ML solution.

In conclusion, while the competition may be fierce in certain areas of the AI/ML industry, there are still ample investment opportunities at the application layer. Understanding the different types of AI/ML users and their needs, as well as keeping up with the evolving landscape, will help investors and businesses make informed decisions. By focusing on industry-specific applications, embracing collaboration and integration, and staying ahead of the curve, stakeholders can navigate the AI/ML industry successfully.

Sources

← Back to Library

Hatch New Ideas with Glasp AI 🐣

Glasp AI allows you to hatch new ideas based on your curated content. Let's curate and create with Glasp AI :)

Start Hatching 🐣