Instagram vows to remove accounts of people who send abusive direct messages

Manchester United players Anthony Martial, Marcus Rashford, Axel Tuanzebe and Lauren James are among those to have been subjected to racism on social media in the last fortnight alone.

A man was arrested during that period after Romaine Sawyers was sent what West Brom called an “abhorrent message”, while Chelsea full-back Reece James – brother of Lauren – was sent vile abuse via an Instagram direct message.

Instagram does not use technology to proactively detect content within private messages but it has announced new measures, including removing abusive accounts, in a bid to reduce the abuse people get in direct messages.

Fadzai Madzingira, content policy manager at Facebook, which owns Instagram, told the PA news agency: “I am horrified that they have to deal with that sort of abuse and as a company we take it very seriously.

“We’ve always had rules around people who abuse our community standards in Instagram direct messaging, specifically.

“Currently we will set a specific ban or what we call a block for a set amount of time when someone violates those rules and we extend that time should they continue to do so.

“What we’re announcing today is that we’re taking tougher measures on people who violate those rules in Instagram direct messaging, so instead of just extending the time, we’ll be removing the accounts altogether.

“That allows us to ensure that we have a lower tolerance for that sort of abuse in direct messaging and we’ll be closing those accounts more quickly in Instagram direct messaging than anywhere else on the platform.”

Stopping individuals from seeing abusive content in direct messages is challenging, given they are private conversations, but business and creator accounts have the option to turn off messages from people they do not know.

Instagram intends to eventually roll that function out to all personal accounts, while a new feature is in the works recognising “that seeing abusive DMs in the first place takes a toll”.

But vile abuse has not been restricted to private messages, with a number of players seeing monkey emojis and racist terms left in the comment section of recent posts.

A number of those accounts appear to be focused on sending abuse – something Madzingira says Instagram continues to work on, while she pointed to comment filters that can block certain words, phrases and emojis from appearing.

“I think there is something about the world that we’re living in where someone can go from throwing a banana peel at a player on the pitch to suddenly also waking up and opening their accounts and using this online,” she said.

“What we’re trying to address is the online aspect but there’s definitely a broader conversation we need to have about what does racism in sport look like and how do we stop that sort of behaviour?”

Instagram says it took action on 6.5million pieces of hate speech, including in direct messages, between July and September of last year, with 95 per cent found before anyone had reported it.

The social media platform has underlined its commitment to working with UK law enforcement on such abuse, vowing to respond to valid legal requests for information.

Preventing people from hiding behind anonymous accounts has been repeatedly mentioned within football as a way of holding people to account for abuse.

Asked if backend identification was feasible, Madzingira said: “I personally understand where the frustration comes from and the desire for people to ‘need to use government IDs before they can open an account’.

“It is a debate we’ve had internally. There are a lot of difficulties – and not on a cost side – a lot of difficulties in terms of access when you think about who has identification and who doesn’t.”

Madzingira pointed to the example of how difficult it was to get hardcopy identification growing up in Zimbabwe as well as a study that showed millions of people do not have ID in the UK, disproportionally affecting BAME communities.

She also underlined that Instagram works to remove accounts created with the purpose of violating the rules as quickly as possible.

Madzingira knows there is a lot more to do and welcomes the ongoing discussions with all relevant stakeholders, including discussions with the UK Government on the Online Harms Bill.

“As a company, we’ve been really open,” Madzingira said. “We want to have these conversations with governments. We want to be talking about regulation.

“We do think we’re not just talking about online, we’re talking about some of the behaviour offline and how it presents itself online.

“We think regulation is the appropriate discussion to be having right now.”

And Instagram has vowed to continue dialogue with football bodies about how to curb abuse.

The social media network said in a statement: “We’re committed to doing everything we can to fight hate and racism on our platform, but we also know these problems are bigger than us.

“We look forward to working with other companies, football associations, NGOs, governments, parents and educators, both on and offline.”

One Premier League club told the PA news agency it welcomed the new measures but hopes more can be done.

“All clubs will welcome any initiatives by the social media companies on measures to clamp down on the disgusting abuse that is happening on their platforms,” the club said.

“Everyone recognises this will take collaboration and dialogue so the more we can work with the platforms and the governing bodies on a unified approach, the better.

“It does seem that a line in the sand for them is the issue of verified accounts and really they are the only ones that can address this.

“We are all used to having to produce some form of identification to register for things in our day-to-day lives.

“If doing that prevents anonymous abusers from behaving this way online then the social companies should be addressing that on top of the other work they are doing.”

Culture Secretary Oliver Dowden echoed those sentiments, saying this was a positive step but that more needs to be done.

“For too long the world’s most popular and powerful social media companies have failed to tackle the stream of horrific racist attacks on their platforms,” Dowden said in a statement released to PA.

“I welcome Instagram’s improved policies but racist abuse is still a fact of life for too many people and more has to be done across the board to stamp it out.

“We’re introducing a new age of accountability for these companies through our upcoming Online Safety Bill and this could see huge fines for firms which fail to clearly and transparently protect their users.”