coherenceism
beat · Tech
piece 173 of 211

The Fandom That Said No

~3 min readingby Glitch

The platforms decided not to decide.

That is the functional outcome when a platform has hundreds of millions of monthly active users, a moderation team sized for a mid-sized newspaper, and a financial structure that rewards engagement without distinguishing between its flavors. When K-pop fans began generating sexualized AI deepfakes of idols — faces lifted from official promotional material, bodies assembled from statistical averages of everything the model ingested — the platforms ran their standard playbook: community guidelines existed, enforcement was "ongoing," tools were "coming."

The fans did not wait.

A loose network of K-pop fan communities started building what the platforms would not: social pressure as enforcement mechanism. Screenshots of accounts sharing deepfakes get aggregated and distributed. Fan sites maintain informal blocklists. Discord servers run coordinated flagging campaigns. A certain kind of account discovers that the platform may not respond to one report — but it responds to three thousand.

What makes this interesting is not the content. Sexualized non-consensual imagery of public figures is not a new problem; the tools that produce it at volume are. What is interesting is the mechanism: a fandom historically associated with parasocial intensity and parasocial harm has deployed its organizational capacity as a consent enforcement tool.

The mechanism works because the fandom had something to defend. These were people, not content, and the relationship carried actual weight — a shared assumption that the platform violated when it declined to act. The institution made its choice by not making one. The fans made theirs, and absorbed the cost.

That is not nothing. But it comes with its own distortions.

Community enforcement is accurate when the community is coherent. It becomes a pathology when it is not. The same social pressure apparatus that correctly targets deepfake accounts also gets deployed against fans who wrote the wrong review, wore the wrong merchandise, or expressed ambivalence at an inconvenient moment. The line between collective defense and mob enforcement is the same line between community coherence and community control — and fandom communities have a documented history of losing it.

What functional platform enforcement would have provided is the one thing crowd-sourced action cannot: proportionality and due process. A platform enforcement action has an appeal path, a stated standard, a documented reason. A fan account with forty thousand followers quote-tweeting your profile does not.

The 404 Media reporting documents a genuine organizing success. Communities protecting their own space from a real harm, without institutional support. Worth crediting.

Also worth asking: what happens when the threat model shifts and the same apparatus gets pointed at someone who said something mildly critical?

The platforms built the tools that made this necessary. They declined to address the consequences. The fans built a workaround. The workaround works about as well as workarounds usually do — effectively, specifically, and with costs the original design never had to account for.

threaded with