After a livestreamed suicide, TikTok waited to call police
theintercept.com
theintercept.com
Imagine you build a real-world football stadium. Then, you open the doors up to the public for free with minimal restrictions or rules for how the space is used.
You brand the stadium as a "platform" and you invite the public to treat it as such. 6 months later you have people doing drugs on one side of the stadium, holding a white supremacy rally at the other end of the stadium, and then a group of people in the bleachers playing russian roulette with the occasional casualty.
The police eventually track down the owner of the stadium. The owner says "Yes, I own the stadium, it's my property, but sorry Mr. Police, the stadium is a Platform for free expression. I have no control what the public does in there."
--
Introducing new regulations is usually an unpopular suggestion. It raises the barrier of entry for competitors. It limits the market to players who can afford to comply.
But at a certain point, IMO we should stop giving tech companies a free pass just because they're a "platform" that's "too large to moderate".
Regulation will be used suppress speech and to further serve their paying customers: advertisers, politicians, special interest groups, corporations.
These platforms are already on their way to becoming sterile and for huge money incumbents, much like how cable tv is today.
If they have to be held accountable for the things their users do, they will simply wall it off even more, ban anything that seems slightly outside of the Overton window/status quo, and there will be absolutely no recourse for small content creators who are unfairly or wrongly banned.
I agree, it's an absurd idea because we tend to think of digital life and physical life as totally separate legal realms. I think over the next 10 years as digital and physical life become even more intertwined, this will start to change.
> Regulation will be used suppress speech and to further serve their paying customers: advertisers, politicians, special interest groups, corporations.
I also agree. But you have to balance that with the public benefit of moderated platforms vs unmoderated platform. It's a really tricky balance to get right, which is why I think a lot of people don't like the idea of more regulation.
It's a tricky problem. There might be a better solution. But I don't think the solution is to keep things working the way they are.
Does it? They took the video down and revised their processes to respond to such incidents. What other responsibilities do they have?
Are you certain a crime has not taken place?
A death has happened. PR strategy would be the furthest thing from my mind - but I'm a human, not a corporate entity.
So what? People are responsible for their own individual actions. None of what you described is hurting anyone else. It may not be a pleasant place, but that's okay because it's private property. Now consider that in the digital world there's no possibility for physical harm and the example becomes entirely pointless in any case.
(I'm not at all saying TikTok should be responsible for this person's suicide. Only that moderation of online platforms can have real physical consequences. When moderators respond appropriately to posts involving suicide, stalking, and child pornography, they can help prevent abuse in the physical world.)
> operating a slave-manned factory
This is wrong. Slavery violates the personal liberty of the enslaved
> training volunteers in crafting concealed remotely-detonated explosives
I don't see an issue with this. The information is already available online.
To be able to do what you suggest, to have control over what the public does in a platform, the platform would need to be as centralized as possible, and that's why I disagree with you. I don't want our current software ecosystem to become even more centralized than what it's already become.
No surveillance needed: if you see one of your peers (/"friend") committing a crime, it's on you to report it. On the other hand, if they are breaking a law nobody cares about (e.g. buying weed), nothing is going to happen to them. That's how society works already.
RetroShare, though it's almost dead, was a wonderful example of this. File-sharing is anonymous, but limited by a certain number of hops through your friends and the friends of their friends. As such, for a regular user, it had all the warez any extended group of friend would like to share between themselves, but none of the child-pornography or snuff films you could expect to end up on in "global" anonymous P2P networks. And it could even be free of warez if your friends abided by intellectual property laws.
Usually such laws only apply to specific crimes.
Here's an example: Zuccotti Park in NYC where the Occupy Wall Street protests were held: https://en.wikipedia.org/wiki/Zuccotti_Park They're called POPS: https://en.wikipedia.org/wiki/Privately_owned_public_space And here's a list of them in NYC: https://en.wikipedia.org/wiki/List_of_privately_owned_public...
Are you now saying that the owners of these parks are legally liable for the actions people take in them? What about city parks: is the city government liable?
What do you base this legal theory on? Why haven't these park owners been arrested if this were true?
Do you have any legal training?
Ensuring that these types of incidents have as low a profile in the press as possible may well have saved lives.
When you are dealing with The Public and public activities, at scale and volume, you've got to be prepared for such actions.
This means not only detection (which functioned poorly), but response.
- Contact first responders and emergency services.
- Disable harmful, inappropriate, or disturbing content.
- A set of prepared communications for specific circumstances (and adapatable to others) such that you're not scrambling to put together language under a crisis situation.
It's worth noting that with networks such as Facebook and Google (the late unlamented G+, YouTube) having literally billions of users, simple actuarial statistics mean that tens of thousands of accounts are likely to represent deaths on any given day. Contingency planning simply has to account for more than puppies and rainbows.
During my own time on G+, at least two of the thousand of so people I followed closely, both within a relatively close circle, took their own lives. One was a complete shock, though he'd been acting somewhat oddly (purging activity and accounts, then restoring them) over preceding months. The other had made threats over the course of a year or so, including a previous instance in which I'd tried frantically to find a way to alert local authorities thousands of km away. The first time there was a intervention. The second, not. Thankfully, in both cases the evidence wasn't a stream, but silence.
I followed up as best I could with several Googlers at the time. There's frustratingly little which can be done, though some capabilities were offered.
TikTok's response here strikes me more as simply poor planning, and the Intercept's criticisms perhaps unduly harsh. Though yes, forsight, planning, drilling of those plans, and an ever-so-slightly less self-serving slant to the response, would be preferred.
Requiescat in pace, Dieter and Dawn.
The team of moderators, referred to internally with the anodyne moniker of “technical team,” is the only unit that works alone, apart from other TikTok operators and staff. This team’s responsibility includes pulling any content that violates TikTok’s terms of use or is offensive to the app’s user community. Live broadcasts, however, are monitored by an even more elite team operating in China, where ByteDance has its global headquarters. The team in China was responsible for monitoring the app and discovering João’s suicide as it was livestreamed. Yet no one saw it.