Physical Address
304 North Cardinal St.
Dorchester Center, MA 02124
How many Ps are there in Google? According to Google, there are two types.
There’s also exactly one “1” in the word “poop,” says Google’s AI overview, as well as two “d’s” in the word “journalism,” yet it’s spelled “journadism.” Google identified at least one P in the last name of the President of the United States, but wrote it as trpum.
You didn’t need to be a prophet to predict this Comprehensive AI-forward Google search overhaul It was about to go bad. We’ve done this before. The first time Google added AI Overviews to search, this feature died Citing satirical posts from The Onion and RedditHe advises people to eat stones and put glue on their pizza.
This time, as Google doubles down on its commitment to making generative AI the centerpiece of its 29-year-old flagship product, it’s not surprising to see it falter.
“Word counting has been a known challenge for LLMs, and we are working to solve this particular problem,” Google told TechCrunch in an emailed statement.
These basic typos may look familiar. LLMs, a type of artificial intelligence that powers chatbots and other text generators, are not designed to understand spelling. It’s been a running joke for years that when a company unveils a new AI model, you have to ask it How many r’s are there in the word strawberry?. These AI models — which can program an application in seconds, or solve problems that have puzzled mathematicians for decades — are as good as a kindergarten child at spelling.
The problems with Google’s AI Overview go far beyond silly typos, though. Google has already corrected an issue from last week where searching for the word “ignorance“It will result in what looks like a dictionary definition of the word, only the definition appears as ‘understandable.’ Let me know when you have a new claim or question!” But these misspellings remain entertaining because they are so hard to quash.
As the researchers did Previously explained When we asked about these spelling puzzles, the AI does not view sentences as units of language made up of words and letters. Many LLM programs are built on transformer models, which break text into symbols, which can be whole words, phonemes, or letters, depending on the model. Instead of “reading” like a human, the AI converts text into digital representations of itself, which are then contextualized to help the AI come up with a logical response.
“LLM programs rely on this transformer architecture, which doesn’t actually read the text. What happens when you enter a prompt is that it gets translated into encoding,” Matthew Guzdial, an artificial intelligence researcher and assistant professor at the University of Alberta, said. TechCrunch said. “When he sees the word ‘the’, he has this encoding of what ‘the’ means, but he knows nothing about ‘T’, ‘H’ and ‘E’.
The token-based architecture that supports MBAs like Google’s AI Overview is inherently limiting, and researchers were not optimistic about their ability to solve the orthographic problem.
“It’s kind of hard to get around the question of what exactly a word should be for a language model, and even if we get human experts to agree on an ideal symbolic vocabulary, models will probably find it useful to ‘break down’ things even further,” said Sheridan Feucht, a doctoral student who studies the interpretability of large language models at Northeastern University. TechCrunch said. “I think there is no such thing as a perfect token because of this kind of ambiguity.”
This is not necessarily a pressing issue in the minds of researchers, as the benefit of an English MA does not come from its ability to spell. But these glaring failures help us remember that AI is not perfect, even if it sometimes seems like an all-knowing force beyond our understanding. We cannot blindly trust AI outputs without verifying their accuracy.
When you make a purchase through the links in our articles, We may earn a small commission. This does not affect our editorial independence.
