Home » News » Snapchat's New AI-Powered Chatbot 'My AI' Raises Concerns About Accuracy and Reliability

Snapchat's New AI-Powered Chatbot 'My AI' Raises Concerns About Accuracy and Reliability

(Image Credit Google)
Snapchat has recently unveiled an experimental AI chatbot named "My AI," which is powered by OpenAI's ChatGPT-style technology. The company announced that My AI will be available for Snapchat+ subscribers for $3.99 per month, starting this week. The AI chatbot can be personalized by giving it a custom name, and users can converse with it in a similar interface to a regular chat with a human. The CEO of Snap, Evan Spiegel, said that the goal is to talk to AI every day, in addition to friends and family. However, like other GPT-powered chatbots such as Bing Chat and ChatGPT, My AI is susceptible to "hallucinations," which are unexpected falsehoods generated by the AI model. Snap included a lengthy disclaimer in its My AI announcement post, cautioning users about the bot's deficiencies and advising them not to share any secrets with it or rely on it for advice. "Hallucination" is a term used by machine-learning researchers to describe when an AI model makes inaccurate inferences about a subject or situation that isn't covered in its training data set. This is a known drawback of current large language models such as ChatGPT, which can easily generate convincing-sounding falsehoods, including academic papers that don't exist and inaccurate biographies. Despite Shrinking Advertiser Budgets, Snap Stock Drops Nearly 25% Despite the warning about My AI's tendency to generate false information, Snap says that the new chatbot will be pinned above conversations with friends in its own tab in the Snapchat app. It will provide users with suggestions such as birthday gift ideas, hiking trip plans, recipes for dinner, and even haikus about cheese for cheddar-obsessed friends. Critics of generative AI have raised concerns about the potential danger of chatbots, especially when presented as a reference or relied upon for advice, despite the disclaimer about their limitations. They argue that these bots are not yet ready for widespread use. Snap has reportedly trained its GPT model to avoid discussing sex, swearing, violence, or political opinions. This is to avoid the unhinged behavior that we saw with Bing Chat a few weeks ago. Snapchat Furthermore, "My AI" may have a powerful tool running under the hood: OpenAI's next-generation large language model. According to The Verge, Snap is using a new OpenAI enterprise plan called "Foundry" that gives companies dedicated cloud access to OpenAI's GPT-3.5 and "DV" models. Several AI experts have speculated that "DV" may be equivalent to GPT-4, the rumored high-powered follow-up to GPT-3. In summary, while My AI may have some limitations and potential risks, it represents an exciting new development in the field of AI chatbots. As new GPT-powered commercial services come online, it will be interesting to see how they are received and used by the public.

By Jozeph P

Journalism explorer, tech Enthusiast. Love to read and write.


Elon Musk revealed his newest project, XMail, an e...


Prepare to navigate your friends' Stories using a ...


Apple faces a challenge from the Cash program, the...


Remember how difficult it was to Shazam a catchy T...


Following the viral popularity of its AI selfies, ...


The days of awkward keyword searches and never-end...