Algospeak

Algospeak is the use of coded expressions to evade automated moderation algorithms on social media platforms such as TikTok and YouTube. It is used to discuss topics deemed sensitive to moderation algorithms while avoiding penalties such as shadow banning. It is a type of internet slang[1] and a form of linguistic self-censorship.[2][3]

The term algospeak is a blend of Algorithm and -speak;[4] it is also known as slang replacement or Voldemorting,[3] referencing the fictional character known as "He-Who-Must-Not-Be-Named".[5] Algospeak is different from other types of netspeak in that its primary purpose is to avoid moderation, rather than to create communal identity. However, algospeak may still be used in online communities.[1]

A 2022 poll showed that nearly a third of American social media users reported using "emojis or alternative phrases" to subvert content moderation.[6]

Causes and motivations

Many social media platforms relies on automated content moderation systems to enforce their guidelines, which are often not determined by users themselves.[2] TikTok in particular uses artificial intelligence (AI) to proactively moderate content, in addition to responding to user reports and using human moderators. In colloquial usage, such AIs are called "algorithms" or "bots". TikTok has faced criticism for their unequal enforcement on topics such as LGBT and obesity. This led to a perception that social media moderation is contradictory and inconsistent.[1] Between July and September 2024, TikTok reported removing 150 million videos, 120 million of which were flagged by automated systems.[7] In addition, AI may miss important context; for example, communities who aid people who struggle with self-harm or suicidal thoughts may inadvertently get caught in automated moderation.[8][1] TikTok users have used algospeak to discuss and provide support to those who self-harm.[9] An interview with 19 TikTok creators revealed that they felt TikTok's moderation lacked contextual understanding, appeared random, was often inaccurate, and exhibited bias against marginalized communities.[1]

Algospeak is also used in communities promoting harmful behaviors. Anti-vaccination Facebook groups began renaming themselves to “dance party” or “dinner party” to avoid being flagged for misinformation. Likewise, communities that encourage the eating disorder anorexia have been employing algospeak.[10] Euphemisms like "cheese pizza" and "touch the ceiling" are used to promote child sexual abuse material (CSAM).[6]

On TikTok, moderation decisions can result in consequences such as account bans, video removals, or delisting videos from the For You page. A TikTok spokeswoman told The New York Times that users' fears are misplaced, saying that many popular videos discuss sex-adjacent topics.[11]

Methods

Algospeak uses techniques akin to those used in Aesopian language to conceal the intended meaning from automated content filters, while being understandable to human readers. One such method draws from leetspeak, where letters are replaced with lookalike characters (eg. $3X for sex).[3] Other similar adoption of obfuscated speech include Cockney rhyming slang and Polari, which were formerly used by London gangs and British gay men respectively.[8]

Another method is where certain words may be censored, or in the case of auditory media, cut off or bleeped, e.g., s*icide instead of suicide. A third method involves "pseudo-substitution", where an item is censored in one form, while it is present in another form at the same time, as used in videos.[12]

A similar phenomenon applies to the names of famous individuals, such as politicians, businesspeople, and celebrities, whose names may be censored when typically criticizing or defaming them to avoid detection by bots, trolls, or the supporters of said individuals or in some cases, protecting their identities. (e.g., J*an de la Cr*z for Juan de la Cruz) In its typical use, this practice may associate such individuals as taboo.[13][14]

In an interview study, most creators that were interviewed suspected Tiktok's automated moderation was scanning the audio as well, leading them to also use algospeak terms in speech. Some also label sensitive images with innocuous captions using algospeak, such as captioning a scantily-dressed body as "fake body".[1]

The use of gestures are emojis are common in algospeak, showing that algospeak is not limited to written communication.[15]

Impact

Algospeak can lead to misunderstandings. A high-profile incident occured when Italian actress Julia Fox made a seemingly unsympathetic comment on a Tiktok post mentioning "mascara", not knowing its obfuscated meaning of sexual assault. Fox later apologized for her comment.[8][16] In interviews, creators shared that the evolving nature of content moderation pressure them to constantly innovate their use of algospeak, and that the use of algospeak makes them feel less authentic.[15]

Examples

According to New York Times:[11]

Other examples:[18]

See also

References

  1. ^ a b c d e f Steen, Ella; Yurechko, Kathryn; Klug, Daniel (September 2023). "You Can (Not) Say What You Want: Using Algospeak to Contest and Evade Algorithmic Content Moderation on TikTok". Social Media + Society. 9 (3). doi:10.1177/20563051231194586. ISSN 2056-3051.
  2. ^ a b Kendra, Alexia; Calhoun, Fawcett (December 30, 2023). ""They Edited Out her Nip Nops": Linguistic Innovation as Textual Censorship Avoidance on TikTok". Language@Internet. 21: 1–30.
  3. ^ a b c Stano, Simona (2022). "Linguistic guerrilla warfare 2.0: On the "forms" of online resistance". Rivista Italiana di Filosofia del Linguaggio (2022: SFL - Language, powers, rights (eds. A. Bertollini & S. Garello)). doi:10.4396/2022SFL13. ISSN 2036-6728.
  4. ^ Kireeva, Anna (2022). "Neologisms: Sociolinguistic Approach". SSRN Electronic Journal. doi:10.2139/ssrn.4232119. ISSN 1556-5068.
  5. ^ McCulloch, Gretchen. "Welcome to Voldemorting, the Ultimate SEO Dis". Wired. ISSN 1059-1028. Retrieved 2024-08-12.
  6. ^ a b Levine, Alexandra S. "From Camping To Cheese Pizza, 'Algospeak' Is Taking Over Social Media". Forbes. Retrieved 2023-08-27.
  7. ^ "Community Guidelines Enforcement Report". www.tiktok.com. December 18, 2024. Archived from the original on 2024-12-18. Retrieved 2024-12-21.
  8. ^ a b c Kreuz, Roger J. (13 April 2023). "What is 'algospeak'? Inside the newest version of linguistic subterfuge". The Conversation. Retrieved 2 January 2024.
  9. ^ Vera, Valerie (October 2023). "Nonsuicidal Self-Injury and Content Moderation on TikTok". Proceedings of the Association for Information Science and Technology. 60 (1): 1164–1166. doi:10.1002/pra2.979. ISSN 2373-9231.
  10. ^ Lorenz, Taylor (8 April 2022). "Internet 'algospeak' is changing our language in real time, from 'nip nops' to 'le dollar bean'". The Washington Post. Retrieved 2 January 2024.
  11. ^ a b Delkic, Melina (2022-11-19). "Leg Booty? Panoramic? Seggs? How TikTok Is Changing Language". The New York Times. ISSN 0362-4331. Retrieved 2024-04-16.
  12. ^ https://www.researchgate.net/publication/379119607_TW_su11d3_-Multimodal_Self-Censorship_on_YouTube
  13. ^ https://works.swarthmore.edu/cgi/viewcontent.cgi?article=1309&context=theses
  14. ^ https://www.researchgate.net/publication/379119607_TW_su11d3_-Multimodal_Self-Censorship_on_YouTube
  15. ^ a b Klug, Daniel; Steen, Ella; Yurechko, Kathryn (2022). "How Algorithm Awareness Impacts Algospeak Use on TikTok". Companion Proceedings of the ACM Web Conference 2022. pp. 234–237. doi:10.1145/3543873.3587355. ISBN 9781450394192. S2CID 258377709. Retrieved 2 January 2024.
  16. ^ Noyce, Eleanor (2023-02-02). "The 'mascara' trend is empowering people to discuss sexual assault on TikTok – but are code-words enough?". Glamour UK. Retrieved 2024-12-22.
  17. ^ Brown, Evan Nicole (2021-03-19). "How Nicknames for the Pandemic Became a Popular Online Trend". The New York Times. Retrieved 2024-10-03.
  18. ^ Tellez, Anthony. "'Mascara,' 'Unalive,' 'Corn': What Common Social Media Algospeak Words Actually Mean". Forbes. Retrieved 2 January 2024.