"We measured ChatGPT vs. Google, and found that ChatGPT crushes Google on coding queries and ties it on general informational queries — despite not being optimized for a search experience at all."

"But is Twitter merely showcasing the best 10 queries out of 10,000, or is ChatGPT’s dominance already widespread?"

"Finally, they rated Google and ChatGPT’s performance, and compared the two experiences."

"The results? Despite not being optimized for a search experience at all, ChatGPT already matches or slightly beats Google’s performance."

"urge AI search engine raters preferred ChatGPT on 42% of queries and Google on 40%."

"If we dive into each platform individually, we see that ChatGPT is rated more often at the extremes: more frequently Amazing, but also more frequently Bad."

"ChatGPT’s dominance becomes even more stark on a set of 100 coding-specific queries — where Google loses out 70% of the time!"

"I feel like the Chatbot was better in terms of delivering a concise answer that anyone (myself included) could unambiguously digest. The Chatbot killed it comparatively, in terms of format. It's not even close. 100%, this was more pleasant.”"

"I like the very quick response as opposed to clicking results from Google and skimming articles for the information.”"

"Query: how do you search for tweets from a specific date on twitter"

"Rating Explanation: “ChatGPT’s response is inaccurate when it states that you must, ""go to the Twitter homepage and click on the ""More options"" button in the top right corner of the page."" The ""more options"" button is not accessible from Twitter's homepage; the first step should be entering a query into Twitter's search bar, at which point it is possible to click ""More options"" or ""Advanced search."""

"Query: how do you cite a book in mla format"

"Query: What kind of dog is Brian Griffin? Intent: Trying to find out what breed of dog the fictional character Brian Griffin in the series Family Guy is supposed to be"

"Query: Which ETF has historically offered higher ROI?"

"Rating Explanation: “Google gave me a list with the top ETFs but did not specify to me exactly which one has the highest ROI."

"However, it refused to answer my question for 2 reasons. Firstly because it doesn’t have access to historical data and secondly because it was programmed not to give financial advice. However, my question was not asking for advice but for access to well-documented data.”"

"Its minimal interface – no more scrolling through 13 ads before you get to your risotto recipe."

"Its ability to understand complex queries – like realizing that “largest active volcano in the mainland of the United States” should exclude volcanoes in Hawaii."

"“I vastly preferred Google for everything. The AI struggled with anything that wasn't very common knowledge."

"Of course, there are a million details in building a search engine that are needed to pull Google users away. As a general AI platform, OpenAI itself probably doesn’t care!"

"Google’s 24 years of search expertise have been toppled by a new technology that soon even small startups will be able to use."

"Newer search engines like Neeva, You.com, Kagi, and Bing already move faster, with the freedom to explore new products and UIs that Google can’t"

"In some domains, the reimagined search experiences they’re building already beat Google’s performance head-to-head!"