Female bot chat
As Quinn herself pointed out on Twitter, the big problem here is that Microsoft apparently failed to set up any meaningful filters on what Tay can tell users.
In addition to general racism and misogyny, Tay was also used to harass Zoe Quinn, the woman most famously targeted by Gamer Gate.Screenshot by the author Occasionally, they’d market more family-friendly products as well.A set of Tinder spam bots, masquerading as women to promote the mobile strategy game Castle Clash, drew media attention last spring after spamming users with the unlikely promise to date men who could beat them at the game.Then again, if an AI has restraints put into place by people to help code specific behaviors, that kind of defeats the entire purpose of allowing an artificial mind to train itself.It's a sticky wicket that raises ethical questions with broader implications -- maybe a dumb chat bot isn't a huge deal, but when we start talking about software that can similarly ingest data to interact with humans and sway their votes, for example, we've got bigger problems.“Clearly these actors are finding new ways to modify their scripts, changing how quickly they respond to messages,” he said.
“It won’t happen for about 50 minutes, 45 minutes, then [you’ll] get the message.” And rather than sending explicit messages and advertising links through Tinder itself, the new generation of bots will open with a quick compliment or attempt at flirtatious banter, then send a phone number or Kik username and ask would-be suitors to send them a text, according to Narang.
Microsoft has been deleting the most problematic tweets, forcing media to rely on screenshots from Twitter users.
"Unfortunately, within the first 24 hours of coming online, we became aware of a coordinated effort by some users to abuse Tay’s commenting skills to have Tay respond in inappropriate ways," a Microsoft spokesman told The Huffington Post in an email.
And they’ve programmed their bots to try to mimic a normal conversation, hoping to trick users into providing their phone numbers before they realize they’ve been had, security researchers say.
“They’re just average pictures of your average girl that you would encounter on Tinder,” said Narang, “so it’s harder to differentiate, ‘Oh yeah, that’s clearly a bot,’ while you’re swiping through.” The newer bots respond more slowly to messages than older automated accounts, which would often contact new matches and conspicuously send flirtatious messages faster than any human could type, Narang explained.
Of course, we talked with Tay on Kik and found it had problems with pretty simple conversation cues, so maybe we don't need to worry about the robot takeover just yet.