Given the linguistic diversity of India, digital content companies are already faced with a challenge to try to show and accurately translate the content. Google is faced with a similar problem with AI previews recently deployed in the country.
The company introduced support in Hindi for AI previews in the country earlier in August. Users in India can also switch between Hindi and English without leaving the search page. But the functionality is disappointing incoherent.
A simple example was the result we chose on Google’s blog. The GIF showed an answer for “Cheni Ki Jagah Chai Mai Kya Daal Sakte Hai?” What results in “What is a sugar substitute in tea?” During the tests, we changed the order of words to “chai mai cheeni ke jagah kya daal sakte hai?” And Google simply did not show an answer.
Another problem we have spotted was literally translated English words. When we asked in Hindi: “What type of food can we eat during the summer?” One of the answers was “Chiknai Wali Cheezien”, which translates into “sticky things” – and it’s confusing. When I went to English, Google showed me “Grasse” an A option, which is a very different thing of “sticky” with regard to food. Anyway, it is a kind of strange suggestion.
In another case, when we asked questions about the property of Youtube, the IA glimps declared “until February 16, 2023, Neal Mohan was the CEO of Google” in Hindi, which is incorrect. The English text had the right version, saying: “On February 16, 2023, Neal Mohan is the CEO of Google.”
There are also qualitative problems. When we asked, “When is Diwali this year?” Instead of obtaining a simple response, we obtained a paragraph on Diwali from last year, then a carousel of links, and SO The real answer we are looking for.
When we asked if we could eat several times with spices in Hindi and English, we obtained incoherent responses thanks to an overview of the AI.
However, there are more results concerning other subjects such as menstruation and pregnancy. For one of our questions, on the moment when someone should think about having children after marriage, the first paragraph of the response to the overview said that couples should wait at least two years, confusing the ‘Hindi.
He also mentioned that if someone gets married around the age of 25, he is “three years” – without specifying for what. This paragraph apparently came from a Hindi slideshow article on an Indian information site, which had written information based on various opinions on quora and other blogs.
When we asked what food to eat when someone was monthly, some of the answers suggested “drink milk with a lot” and lemon for mood swings.
Google’s AI’s preview is also missing the context. When we asked questions about food in Delhi, it suggested that Bangla Sahib Gurudwara, a place of worship for sikhs, is open 24 hours a day and you can get Indian tea and snacks like Samosa and Kachori . However, this does not mention something important that the source article has done: that you could obtain these elements out The Gurudwara, an operating word that the AI tool has missed while summarizing. The snacks are not in the place of worship.
Some of the results for similar questions in English are much better than Hindi. This could be partly due to more and better sources available in this language. But some of the problems we have highlighted were due to Google Systems’ errors, such as off -context summaries and inaccurate translations. Google has worked on research and language problems in India, and the wait is that it should have provided better results in her first time.
Google told Techcrunch that its IA glimpses only appear for requests where it has great confidence in the quality of the output, claiming that functionality is “rooted in our basic quality of research systems” and “will display Only information that is saved by the best web results.
“Our tests show that the precision rate for AI previews is tied with other features such as star extracts. When problems arise, they can be the result of our systems that poorly interpret web content or reflect inaccuracies on the web – and we use these examples to improve, as we do with all research features ”. Declared in Techcrunch, a google spokesperson.
Google can blame the quality of the sources it cites. However, it was Google’s algorithm that decided that the question and the sources are worth being summarized by AI. Not all users will consult the equipment on the source sites and will not simply be google to display inaccurate or incomprehensible responses.
IA glimps were A disappointing company for Google. Earlier this year, the company caught a lot of flacks to surface the responses of Reddit complexion A user to add pizza glue. IA’s overviews told another user to eat “A small rock per dayA response from the onion. Many examples that we have tested in Hindi simply did not provide correct information on the subject.
India has more than 830 million InternetAnd a good part of them use Google for research. If the company wants more people to use IA overviews in local languages, it will have to intensify its game in terms of language and content accuracy.