Allen Cheng


27 Quotes

"If it’s easy to make a good-enough app out of the box, the barriers to entry are mercilessly low."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"If GPT-3 is so easy to adopt and build products with, incumbents will do it too."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"If the baseline GPT-3 performance cannot be substantially improved to create a substantial (10x) proprietary edge, the competition will shift away from technology to other dimensions of competition—particularly in marketing and distribution."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Meanwhile, the profits will accrue to the true beneficiaries: 1) the algorithm owners,  OpenAI (and, by extension, Azure), 2) to marketing platforms, particularly Google and Facebook."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Unfortunately, most of the products built on GPT-3 will be identical to each other, and few will have a meaningful edge."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"When Google first came out, it delivered such better search results than other engines—possibly by a subjective factor of 10 or more—that there was little reason to use any competitor."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"I argue: The better GPT-3 works out of the box, the harder it will be for any single company to build meaningful differentiation. Frankly, early demos already look very good."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Before GPT-3, building anything close to the Good Enough AI was really hard. A company would have needed to invest many millions into its own algorithms and data cleanup to get anywhere close to the human user bar."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"There are many more competitors who can offer a “good enough” product."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"The range of competition is compressed into a narrower band."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Because the companies don’t own the core technology behind GPT-3, their ability to improve beyond the baseline performance is limited."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Then imagine how much worse this will get when GPT-4 comes out. And again with GPT-5."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Plus, it’s likely that any proprietary progress you make on GPT-3 will be totally wiped out by GPT-4; the same way your tweaks on GPT-2 would have been wiped out by GPT-3."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Yes, the algorithm isn’t everything. Products can still differentiate with their user experience, product design, customer support, adding on human services, and so on."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"How much can a GPT-3 user improve on the base algorithm experience in a proprietary way?"
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"To get to the sweet spot of that improvement curve (80-20 rule), how much investment do you need to make?"
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"That because GPT-3 already constitutes such a large dataset and heavy training, marginal improvements are hard to come by and will look log-linear"
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"How about companies built on GPT-3? While the beta API is free, OpenAI will charge for API access. Every API call will cost you money. As you get more users and users use your product more, you will pay OpenAI more money. This sounds more like a Spotify situation than an Amazon situation."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"The simplistic reflex answer here is that AI companies can achieve this with data, but whether this effect even exists in AI is questionable. If the marginal improvements to more data plateau quickly, then companies with more data won’t have an advantage."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"In fact, since the most obvious uses of GPT-3 are human-to-computer interactions, it might be anti-network building."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"But with GPT-3, it’s likely this effect quickly taper off, particularly because GPT-3 only has a limited “working memory” (currently limited to around 1000 words). If you watch someone play AI Dungeon for a few minutes, this becomes apparent—while it stays fairly coherent in a narrow time window, it forgets characters and events that came just 5 minutes earlier."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"In Clayton Christensen’s terms, GPT-3 becomes a sustaining innovation that benefits the existing players, rather than a disruptive innovation that benefits new entrants."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Sustaining innovations offer better performance or cost savings to existing products. They most benefit market leaders, who use sustaining innovations to augment their existing products."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Disruptive innovations offer significantly worse performance than existing products; they at first look like toys, nothing that any professional user would rely on."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"A tricky but important point: within the same industry, an innovation can be disruptive to some incumbents and sustaining to other incumbents."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Incumbents can easily use GPT-3 because it works right out of the box. Capital expenses are low, and building a GPT-3-powered product wouldn’t require a drastic overhaul of the company’s business model."
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng
"Peloton, Lululemon, and Strava will build AI fitness coaches"
Allen Cheng
Starting a Business Around GPT-3 is a Bad Idea - Allen Cheng

Want to Save Quotes?

Glasp is a social web highlighter that people can highlight and organize quotes and thoughts from the web, and access other like-minded people’s learning.