In March, Mark Zuckerberg’s Meta announced a new Meta AI support assistant feature on both Facebook and Instagram, providing users with a way to “resolve account problems” and help in taking down any offending impersonator accounts or scams.
Besides highlighting the tech industry’s seemingly insatiable appetite for automating customer service-level jobs with AI, the new feature appears to have backfired spectacularly. As 404 Media reports, the chatbot happily obliged when hackers asked it for access to high-profile Instagram profiles.
The ruse is shockingly simple: after matching the account owner’s geographic region using a VPN, the hackers asked the support chatbot to change the email address associated with the profile, thereby allowing them to successfully complete two-factor authentication. Worse yet, the vulnerability has been around for several months already, according to Telegram group messages reviewed by 404 Media.
“t’s either the new Meta Accounts Center glitching out or my Instagram account is being targeted in a hacking attempt,” former Meta researcher and self-proclaimed hacker Jane Wong wrote in a Threads post. “It appears that my password has been changed without my knowledge / I was not able to log in using my password.”
The exploit highlights glaring cybersecurity issues that continue to plague AI-powered chatbots. We’ve seen countless instances of large language model based tools being jailbroken, tricked into telling lies, or even hallucinate made-up company policies leading to plenty of confusion and even lawsuits.
Experts have also long warned against handing AI chatbots personal information, citing the risk of data leaks. Meta, in particular, has garnered a reputation for continuously treating user data with little care. In March, for instance, The Information reported that an in-house AI agent had caused a critical security incident at Meta, exposing sensitive user data to people without proper authorization.
While it’s unclear whether they were connected to the latest exploit, the news comes after several high profile Instagram accounts, including former president Barack Obama’s and Space Force chief master John Bentivegna’s, were hacked.
Hackers have been offering access to high-profile accounts in exchange for small amounts of money by using the vulnerability, per 404 Media.
Fortunately, Meta appears to have patched the issue, but considering the exploit was discovered months ago, the damage could be extensive.
More on Meta: Meta Workers Say They’re Seeing Disturbing Things Through Users’ Smart Glasses
The post Meta’s AI Support Bot Is Giving Hackers Access to Other People’s Instagram Accounts Just by Asking appeared first on Futurism.
