{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T12:42:23Z","timestamp":1776343343193,"version":"3.51.2"},"reference-count":108,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2019,7,19]],"date-time":"2019-07-19T00:00:00Z","timestamp":1563494400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1553376"],"award-info":[{"award-number":["IIS-1553376"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2019,10,31]]},"abstract":"<jats:p>What one may say on the internet is increasingly controlled by a mix of automated programs, and decisions made by paid and volunteer human moderators. On the popular social media site Reddit, moderators heavily rely on a configurable, automated program called \u201cAutomoderator\u201d (or \u201cAutomod\u201d). How do moderators use Automod? What advantages and challenges does the use of Automod present? We participated as Reddit moderators for over a year, and conducted interviews with 16 moderators to understand the use of Automod in the context of the sociotechnical system of Reddit. Our findings suggest a need for audit tools to help tune the performance of automated mechanisms, a repository for sharing tools, and improving the division of labor between human and machine decision making. We offer insights that are relevant to multiple stakeholders\u2014creators of platforms, designers of automated regulation systems, scholars of platform governance, and content moderators.<\/jats:p>","DOI":"10.1145\/3338243","type":"journal-article","created":{"date-parts":[[2019,7,19]],"date-time":"2019-07-19T13:17:14Z","timestamp":1563542234000},"page":"1-35","update-policy":"https:\/\/linproxy.fan.workers.dev:443\/https\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":256,"title":["Human-Machine Collaboration for Content Regulation"],"prefix":"10.1145","volume":"26","author":[{"given":"Shagun","family":"Jhaver","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}]},{"given":"Iris","family":"Birman","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}]},{"given":"Eric","family":"Gilbert","sequence":"additional","affiliation":[{"name":"University of Michigan, Ann Arbor, MI"}]},{"given":"Amy","family":"Bruckman","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA"}]}],"member":"320","published-online":{"date-parts":[[2019,7,19]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI1523_5"},{"key":"e_1_2_1_2_1","unstructured":"Alexa. 2018. reddit.com Traffic Statistics. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.alexa.com\/siteinfo\/reddit.com.  Alexa. 2018. reddit.com Traffic Statistics. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.alexa.com\/siteinfo\/reddit.com."},{"key":"e_1_2_1_3_1","unstructured":"Automoderator. 2018. Automoderator - reddit.com. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.reddit.com\/wiki\/automoderator.  Automoderator. 2018. Automoderator - reddit.com. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.reddit.com\/wiki\/automoderator."},{"key":"e_1_2_1_4_1","unstructured":"Oren Ben-Kiki Clark Evans and Brian Ingerson. 2005. YAML Ain\u2019t Markup Language. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/http\/yaml.org\/spec\/1.2\/spec.html.  Oren Ben-Kiki Clark Evans and Brian Ingerson. 2005. YAML Ain\u2019t Markup Language. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/http\/yaml.org\/spec\/1.2\/spec.html."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1080\/0158791000210106"},{"key":"e_1_2_1_6_1","unstructured":"BigQuery. 2018. Google BigQuery. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/bigquery.cloud.google.com\/dataset\/fh-bigquery:reddit_comments.  BigQuery. 2018. Google BigQuery. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/bigquery.cloud.google.com\/dataset\/fh-bigquery:reddit_comments."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67256-4_32"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134659"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3172\/JIE.15.2.82"},{"key":"e_1_2_1_10_1","volume-title":"When should we use real names in published accounts of internet research? In Digital Research Confidential: The Secrets of Studying Behavior Online","author":"Bruckman Amy","unstructured":"Amy Bruckman , Kurt Luther , and Casey Fiesler . 2015. When should we use real names in published accounts of internet research? In Digital Research Confidential: The Secrets of Studying Behavior Online . Eszter Hargittai and Christian Sandvig (Eds.), MIT Press . Amy Bruckman, Kurt Luther, and Casey Fiesler. 2015. When should we use real names in published accounts of internet research? In Digital Research Confidential: The Secrets of Studying Behavior Online. Eszter Hargittai and Christian Sandvig (Eds.), MIT Press."},{"key":"e_1_2_1_11_1","unstructured":"Catherine Buni. 2016. The secret rules of the internet: The murky history of moderation and how it\u2019s shaping the future of free speech. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.theverge.com\/2016\/4\/13\/11387934\/internet-moderator-history-youtube-facebook-reddit-censorship-free-speech.  Catherine Buni. 2016. The secret rules of the internet: The murky history of moderation and how it\u2019s shaping the future of free speech. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.theverge.com\/2016\/4\/13\/11387934\/internet-moderator-history-youtube-facebook-reddit-censorship-free-speech."},{"key":"e_1_2_1_12_1","unstructured":"Catherine Buni. 2019. The Trauma Floor: The secret lives of Facebook moderators in America. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.theverge.com\/2019\/2\/25\/18229714\/cognizant-facebook-content-moderator-interviews-trauma-working-conditions-arizona.  Catherine Buni. 2019. The Trauma Floor: The secret lives of Facebook moderators in America. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.theverge.com\/2019\/2\/25\/18229714\/cognizant-facebook-content-moderator-interviews-trauma-working-conditions-arizona."},{"key":"e_1_2_1_13_1","unstructured":"Robyn Caplan. 2018. Content or Context Moderation? Artisanal Community-Reliant and Industrial Approaches. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/datasociety.net\/output\/content-or-context-moderation\/.  Robyn Caplan. 2018. Content or Context Moderation? Artisanal Community-Reliant and Industrial Approaches. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/datasociety.net\/output\/content-or-context-moderation\/."},{"key":"e_1_2_1_14_1","unstructured":"captainmeta4 (Submitter). 2016. What is \/u\/BotBust?: BotBust. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.reddit.com\/r\/BotBust\/comments\/5092dg\/what_is_ubotbust\/.  captainmeta4 (Submitter). 2016. What is \/u\/BotBust?: BotBust. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.reddit.com\/r\/BotBust\/comments\/5092dg\/what_is_ubotbust\/."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025985"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819963"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274301"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026018"},{"key":"e_1_2_1_19_1","volume-title":"Coding in grounded theory practice. Constructing Grounded Theory","author":"Charmaz Kathy","year":"2006","unstructured":"Kathy Charmaz . 2006. Coding in grounded theory practice. Constructing Grounded Theory ( 2006 ), 42--70. Sage Publications Ltd , Thousand Oaks, CA . Kathy Charmaz. 2006. Coding in grounded theory practice. Constructing Grounded Theory (2006), 42--70. Sage Publications Ltd, Thousand Oaks, CA."},{"key":"e_1_2_1_20_1","unstructured":"Adrian Chen. 2014. The Laborers Who Keep Dick Pics and Beheadings Out of Your Facebook Feed. Wired. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.wired.com\/2014\/10\/content-moderation\/.  Adrian Chen. 2014. The Laborers Who Keep Dick Pics and Beheadings Out of Your Facebook Feed. Wired. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.wired.com\/2014\/10\/content-moderation\/."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675214"},{"key":"e_1_2_1_22_1","volume-title":"Hate Crimes in Cyberspace","author":"Citron Danielle Keats","unstructured":"Danielle Keats Citron . 2014. Hate Crimes in Cyberspace . Harvard University Press . Danielle Keats Citron. 2014. Hate Crimes in Cyberspace. Harvard University Press."},{"key":"e_1_2_1_23_1","first-page":"345","article-title":"Criminalizing revenge porn","volume":"49","author":"Citron Danielle Keats","year":"2014","unstructured":"Danielle Keats Citron and Mary Anne Franks . 2014 . Criminalizing revenge porn . Wake Forest Law Review 49 (2014), 345 . Danielle Keats Citron and Mary Anne Franks. 2014. Criminalizing revenge porn. Wake Forest Law Review 49 (2014), 345.","journal-title":"Wake Forest Law Review"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2015.03.078"},{"key":"e_1_2_1_25_1","volume-title":"Design Justice: Towards an Intersectional Feminist Framework for Design Theory and Practice.","author":"Costanza-Chock Sasha","year":"2018","unstructured":"Sasha Costanza-Chock . 2018 . Design Justice: Towards an Intersectional Feminist Framework for Design Theory and Practice. (2018). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/ssrn.com\/abstract&equals;3189696. Sasha Costanza-Chock. 2018. Design Justice: Towards an Intersectional Feminist Framework for Design Theory and Practice. (2018). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/ssrn.com\/abstract&equals;3189696."},{"key":"e_1_2_1_26_1","volume-title":"What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media 8 Society 18, 3","author":"Crawford Kate","year":"2016","unstructured":"Kate Crawford and Tarleton Gillespie . 2016. What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media 8 Society 18, 3 ( 2016 ), 410--428. Kate Crawford and Tarleton Gillespie. 2016. What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media 8 Society 18, 3 (2016), 410--428."},{"key":"e_1_2_1_27_1","unstructured":"Deimorz (Submitter). 2012. AutoModerator -- A Bot for Automating Straightforward Reddit Moderation Tasks and Improving Upon the Existing Spam-Filter : TheoryOfReddit. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.reddit.com\/r\/TheoryOfReddit\/comments\/onl2u\/automoderator_a_bot_for_automating\/.  Deimorz (Submitter). 2012. AutoModerator -- A Bot for Automating Straightforward Reddit Moderation Tasks and Improving Upon the Existing Spam-Filter : TheoryOfReddit. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.reddit.com\/r\/TheoryOfReddit\/comments\/onl2u\/automoderator_a_bot_for_automating\/."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.2753\/JEC1086-4415150302"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958844"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300372"},{"key":"e_1_2_1_31_1","first-page":"4","article-title":"The magic sauce: Practices of facilitation in online policy deliberation","volume":"12","author":"Epstein Dmitry","year":"2016","unstructured":"Dmitry Epstein and Gilly Leshed . 2016 . The magic sauce: Practices of facilitation in online policy deliberation . Journal of Public Deliberation 12 , 1 (2016), 4 . Dmitry Epstein and Gilly Leshed. 2016. The magic sauce: Practices of facilitation in online policy deliberation. Journal of Public Deliberation 12, 1 (2016), 4.","journal-title":"Journal of Public Deliberation"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 12th International AAAI Conference on Web and Social Media. 72--81","author":"Fiesler Casey","unstructured":"Casey Fiesler , Jialun Aaron Jiang , Joshua McCann , Kyle Frye , and Jed R. Brubaker . 2018. Reddit rules&excl; Characterizing an ecosystem of governance . In Proceedings of the 12th International AAAI Conference on Web and Social Media. 72--81 . Casey Fiesler, Jialun Aaron Jiang, Joshua McCann, Kyle Frye, and Jed R. Brubaker. 2018. Reddit rules&excl; Characterizing an ecosystem of governance. In Proceedings of the 12th International AAAI Conference on Web and Social Media. 72--81."},{"key":"e_1_2_1_33_1","unstructured":"National Science Foundation. 2019. Future of Work at the Human-Technology Frontier: Core Research (FW-HTF). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.nsf.gov\/funding\/pgm_summ.jsp?pims_id&equals;505620.  National Science Foundation. 2019. Future of Work at the Human-Technology Frontier: Core Research (FW-HTF). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.nsf.gov\/funding\/pgm_summ.jsp?pims_id&equals;505620."},{"key":"e_1_2_1_34_1","unstructured":"Sandra E. Garcia. 2018. Ex-Content Moderator Sues Facebook Saying Violent Images Caused Her PTSD. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.nytimes.com\/2018\/09\/25\/technology\/facebook-moderator-job-ptsd-lawsuit.html.  Sandra E. Garcia. 2018. Ex-Content Moderator Sues Facebook Saying Violent Images Caused Her PTSD. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.nytimes.com\/2018\/09\/25\/technology\/facebook-moderator-job-ptsd-lawsuit.html."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491055.2491061"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1718918.1718941"},{"key":"e_1_2_1_37_1","volume-title":"Beyond the hashtag: Circumventing content moderation on social media. New Media 8 Society 20, 12","author":"Gerrard Ysabel","year":"2018","unstructured":"Ysabel Gerrard . 2018. Beyond the hashtag: Circumventing content moderation on social media. New Media 8 Society 20, 12 ( 2018 ), 4492--4511. Ysabel Gerrard. 2018. Beyond the hashtag: Circumventing content moderation on social media. New Media 8 Society 20, 12 (2018), 4492--4511."},{"key":"e_1_2_1_38_1","volume-title":"Governance of and by platforms","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie . 2017. Governance of and by platforms . In Sage Handbook of Social Media. Sage . Tarleton Gillespie. 2017. Governance of and by platforms. In Sage Handbook of Social Media. Sage."},{"key":"e_1_2_1_39_1","volume-title":"Content Moderation, and the Hidden Decisions That Shape Social Media","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie . 2018. Custodians of the Internet: Platforms , Content Moderation, and the Hidden Decisions That Shape Social Media . Yale University Press . Tarleton Gillespie. 2018. Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media. Yale University Press."},{"key":"e_1_2_1_40_1","unstructured":"Tarleton Gillespie. 2018. The Logan Paul YouTube controversy and What We Should Expect from Internet Platforms. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.vox.com\/the-big-idea\/2018\/1\/12\/16881046\/logan-paul-youtube-controversy-internet-companies.  Tarleton Gillespie. 2018. The Logan Paul YouTube controversy and What We Should Expect from Internet Platforms. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.vox.com\/the-big-idea\/2018\/1\/12\/16881046\/logan-paul-youtube-controversy-internet-companies."},{"key":"e_1_2_1_41_1","unstructured":"April Glaser. 2018. Want a Terrible Job? Facebook and Google May Be Hiring. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/slate.com\/technology\/2018\/01\/facebook-and-google-are-building-an-army-of-content-moderators-for-2018.html.  April Glaser. 2018. Want a Terrible Job? Facebook and Google May Be Hiring. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/slate.com\/technology\/2018\/01\/facebook-and-google-are-building-an-army-of-content-moderators-for-2018.html."},{"key":"e_1_2_1_42_1","volume-title":"The turn to artificial intelligence in governing communication online. (2018). Social Science Open Access Repository.","author":"Gollatz Kirsten","unstructured":"Kirsten Gollatz , Felix Beer , and Christian Katzenbach . 2018. The turn to artificial intelligence in governing communication online. (2018). Social Science Open Access Repository. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/nbn-resolving.org\/urn:nbn:de:0168-ssoar-59528-6. Kirsten Gollatz, Felix Beer, and Christian Katzenbach. 2018. The turn to artificial intelligence in governing communication online. (2018). Social Science Open Access Repository. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/nbn-resolving.org\/urn:nbn:de:0168-ssoar-59528-6."},{"key":"e_1_2_1_43_1","volume-title":"Communication 8 Society 22, 6","author":"Gorwa Robert","year":"2019","unstructured":"Robert Gorwa . 2019. What is platform governance? Information , Communication 8 Society 22, 6 ( 2019 ), 854--871. Robert Gorwa. 2019. What is platform governance? Information, Communication 8 Society 22, 6 (2019), 854--871."},{"key":"e_1_2_1_44_1","first-page":"42","article-title":"The virtues of moderation","volume":"17","author":"Grimmelmann James","year":"2015","unstructured":"James Grimmelmann . 2015 . The virtues of moderation . Yale Journal of Law and Technology 17 (2015), 42 . James Grimmelmann. 2015. The virtues of moderation. Yale Journal of Law and Technology 17 (2015), 42.","journal-title":"Yale Journal of Law and Technology"},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the International Conference on Industrial Networks and Intelligent Systems. Springer, 164--173","author":"Hammer Hugo Lewi","year":"2016","unstructured":"Hugo Lewi Hammer . 2016 . Automatic detection of hateful comments in online discussion . In Proceedings of the International Conference on Industrial Networks and Intelligent Systems. Springer, 164--173 . Hugo Lewi Hammer. 2016. Automatic detection of hateful comments in online discussion. In Proceedings of the International Conference on Industrial Networks and Intelligent Systems. Springer, 164--173."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1080\/01972243.2017.1391913"},{"key":"e_1_2_1_47_1","first-page":"1","article-title":"Gender differences in CMC: Findings and implications","volume":"18","author":"Herring Susan C.","year":"2000","unstructured":"Susan C. Herring . 2000 . Gender differences in CMC: Findings and implications . Computer Professionals for Social Responsibility Journal 18 , 1 (2000), 1 -- 9 . Susan C. Herring. 2000. Gender differences in CMC: Findings and implications. Computer Professionals for Social Responsibility Journal 18, 1 (2000), 1--9.","journal-title":"Computer Professionals for Social Responsibility Journal"},{"key":"e_1_2_1_48_1","volume-title":"The Managed Heart: Commercialization of Human Feeling","author":"Hochschild Arlie Russell","unstructured":"Arlie Russell Hochschild . 1983. The Managed Heart: Commercialization of Human Feeling . University of California Press , Berkeley. Arlie Russell Hochschild. 1983. The Managed Heart: Commercialization of Human Feeling. University of California Press, Berkeley."},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"Maya Holikatti Shagun Jhaver and Neha Kumar. 2019. Learning to Airbnb by engaging in online communities of practice. Under Review at Proceedings of the ACM on Human-Computer Interaction.  Maya Holikatti Shagun Jhaver and Neha Kumar. 2019. Learning to Airbnb by engaging in online communities of practice. Under Review at Proceedings of the ACM on Human-Computer Interaction.","DOI":"10.1145\/3359330"},{"key":"e_1_2_1_50_1","volume-title":"Hughey and Jessie Daniels","author":"Matthew","year":"2013","unstructured":"Matthew W. Hughey and Jessie Daniels . 2013 . Racist comments at online news sites: A methodological dilemma for discourse analysis. Media, Culture 8 Society 35, 3 (2013), 332--347. Matthew W. Hughey and Jessie Daniels. 2013. Racist comments at online news sites: A methodological dilemma for discourse analysis. Media, Culture 8 Society 35, 3 (2013), 332--347."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359294"},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","unstructured":"Shagun Jhaver Amy Bruckman and Eric Gilbert. 2019. Does transparency in moderation really matter? User behavior after content removal explanations on reddit. Under Review at Proceedings of the ACM on Human-Computer Interaction.  Shagun Jhaver Amy Bruckman and Eric Gilbert. 2019. Does transparency in moderation really matter? User behavior after content removal explanations on reddit. Under Review at Proceedings of the ACM on Human-Computer Interaction.","DOI":"10.1145\/3359252"},{"key":"e_1_2_1_53_1","volume-title":"The view from the other side: The border between controversial speech and harassment on Kotaku in Action. First Monday 23, 2","author":"Jhaver Shagun","year":"2018","unstructured":"Shagun Jhaver , Larry Chan , and Amy Bruckman . 2018. The view from the other side: The border between controversial speech and harassment on Kotaku in Action. First Monday 23, 2 ( 2018 ). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/http\/firstmonday.org\/ojs\/index.php\/fm\/article\/view\/8232. Shagun Jhaver, Larry Chan, and Amy Bruckman. 2018. The view from the other side: The border between controversial speech and harassment on Kotaku in Action. First Monday 23, 2 (2018). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/http\/firstmonday.org\/ojs\/index.php\/fm\/article\/view\/8232."},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the 13th International AAAI Conference on Web and Social Media.","author":"Jhaver Shagun","year":"2019","unstructured":"Shagun Jhaver , Justin Cranshaw , and Scott Counts . 2019 . Measuring professional skill development in U.S. cities using internet search queries . In Proceedings of the 13th International AAAI Conference on Web and Social Media. Shagun Jhaver, Justin Cranshaw, and Scott Counts. 2019. Measuring professional skill development in U.S. cities using internet search queries. In Proceedings of the 13th International AAAI Conference on Web and Social Media."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185593"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173995"},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the Computation+ Journalism Symposium.","author":"Jiang Ling","year":"2019","unstructured":"Ling Jiang and Eui-Hong Han . 2019 . ModBot: Automatic comments moderation . In Proceedings of the Computation+ Journalism Symposium. Ling Jiang and Eui-Hong Han. 2019. ModBot: Automatic comments moderation. In Proceedings of the Computation+ Journalism Symposium."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/223826.223831"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1080\/15295036.2015.1045005"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858356"},{"key":"e_1_2_1_62_1","volume-title":"Building Successful Online Communities: Evidence-Based Social Design","author":"Kiesler Sara","unstructured":"Sara Kiesler , Robert Kraut , and Paul Resnick . 2012. Regulating behavior in online communities . In Building Successful Online Communities: Evidence-Based Social Design . MIT Press . Sara Kiesler, Robert Kraut, and Paul Resnick. 2012. Regulating behavior in online communities. In Building Successful Online Communities: Evidence-Based Social Design. MIT Press."},{"key":"e_1_2_1_63_1","volume-title":"The new governors: The people, rules, and processes governing online speech. Harvard Law Review 131 (March","author":"Klonick Kate","year":"2017","unstructured":"Kate Klonick . 2017. The new governors: The people, rules, and processes governing online speech. Harvard Law Review 131 (March 2017 ), 1598--1670. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id&equals;2937985. Kate Klonick. 2017. The new governors: The people, rules, and processes governing online speech. Harvard Law Review 131 (March 2017), 1598--1670. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id&equals;2937985."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939874"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240815"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985761"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2013.11.005"},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the 12th International AAAI Conference on Web and Social Media.","author":"Liu Ping","year":"2018","unstructured":"Ping Liu , Joshua Guberman , Libby Hemphill , and Aron Culotta . 2018 . Forecasting the presence and intensity of hostility on Instagram using linguistic and social features . In Proceedings of the 12th International AAAI Conference on Web and Social Media. Ping Liu, Joshua Guberman, Libby Hemphill, and Aron Culotta. 2018. Forecasting the presence and intensity of hostility on Instagram using linguistic and social features. In Proceedings of the 12th International AAAI Conference on Web and Social Media."},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025830"},{"key":"e_1_2_1_71_1","unstructured":"Alexis Madrigal. 2018. Inside Facebook\u2019s Fast-Growing Content-Moderation Effort. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.theatlantic.com\/technology\/archive\/2018\/02\/what-facebook-told-insiders-about-how-it-moderates-posts\/552632\/.  Alexis Madrigal. 2018. Inside Facebook\u2019s Fast-Growing Content-Moderation Effort. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.theatlantic.com\/technology\/archive\/2018\/02\/what-facebook-told-insiders-about-how-it-moderates-posts\/552632\/."},{"key":"e_1_2_1_72_1","unstructured":"Fiona Martin. 2015. Getting My Two Cents Worth In: Access Interaction Participation and Social Inclusion in Online News Commenting. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/isojjournal.wordpress.com\/2015\/04\/15\/getting-my-two-cents-worth-in-access-interaction-participation-and-social-inclusion-in-online-news-commenting\/.  Fiona Martin. 2015. Getting My Two Cents Worth In: Access Interaction Participation and Social Inclusion in Online News Commenting. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/isojjournal.wordpress.com\/2015\/04\/15\/getting-my-two-cents-worth-in-access-interaction-participation-and-social-inclusion-in-online-news-commenting\/."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858391"},{"key":"e_1_2_1_74_1","unstructured":"Nathan J. Matias. 2016. Posting Rules in Online Discussions Prevents Problems 8 Increases Participation. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/civilservant.io\/moderation_experiment_r_science_rule_posting.html.  Nathan J. Matias. 2016. Posting Rules in Online Discussions Prevents Problems 8 Increases Participation. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/civilservant.io\/moderation_experiment_r_science_rule_posting.html."},{"key":"e_1_2_1_75_1","volume-title":"Internet Politics and Policy conference","author":"Matias Nathan J.","year":"2016","unstructured":"Nathan J. Matias . 2016 . The civic labor of online moderators . In Internet Politics and Policy conference . Oxford, United Kingdom. Nathan J. Matias. 2016. The civic labor of online moderators. In Internet Politics and Policy conference. Oxford, United Kingdom."},{"key":"e_1_2_1_76_1","volume-title":"Machine learning in adversarial settings","author":"McDaniel Patrick","year":"2016","unstructured":"Patrick McDaniel , Nicolas Papernot , and Z. Berkay Celik . 2016. Machine learning in adversarial settings . IEEE Security 8 Privacy 14, 3 ( May 2016 ), 68--72. Patrick McDaniel, Nicolas Papernot, and Z. Berkay Celik. 2016. Machine learning in adversarial settings. IEEE Security 8 Privacy 14, 3 (May 2016), 68--72."},{"key":"e_1_2_1_77_1","volume-title":"Proceedings of the International Conference on Information Systems (ICIS\u201916)","author":"McGillicuddy Aiden","year":"2016","unstructured":"Aiden McGillicuddy , Jean-Gregoire Bernard , and Jocelyn Cranefield . 2016 . Controlling bad behavior in online communities: An examination of moderation work . In Proceedings of the International Conference on Information Systems (ICIS\u201916) . Retrieved from https:\/\/linproxy.fan.workers.dev:443\/http\/aisel.aisnet.org\/icis 2016\/SocialMedia\/Presentations\/23. Aiden McGillicuddy, Jean-Gregoire Bernard, and Jocelyn Cranefield. 2016. Controlling bad behavior in online communities: An examination of moderation work. In Proceedings of the International Conference on Information Systems (ICIS\u201916). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/http\/aisel.aisnet.org\/icis2016\/SocialMedia\/Presentations\/23."},{"key":"e_1_2_1_78_1","unstructured":"Steven Melendez. 2015. Here\u2019s How 20 000 Reddit Volunteers Fight Trolls Spammers and Played-Out Memes. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.fastcompany.com\/3048406\/heres-how-20000-reddit-volunteers-fight-trolls-spammers-and-played-out-memes.  Steven Melendez. 2015. Here\u2019s How 20 000 Reddit Volunteers Fight Trolls Spammers and Played-Out Memes. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.fastcompany.com\/3048406\/heres-how-20000-reddit-volunteers-fight-trolls-spammers-and-played-out-memes."},{"key":"e_1_2_1_79_1","volume-title":"Qualitative Research in Practice: Examples for Discussion and Analysis. Jossey-Bass","author":"Merriam Sharan B.","unstructured":"Sharan B. Merriam . 2002. Introduction to qualitative research . In Qualitative Research in Practice: Examples for Discussion and Analysis. Jossey-Bass , San Francisco . Sharan B. Merriam. 2002. Introduction to qualitative research. In Qualitative Research in Practice: Examples for Discussion and Analysis. Jossey-Bass, San Francisco."},{"key":"e_1_2_1_80_1","unstructured":"Elise Moreau. 2017. What Exactly Is a Reddit AMA? Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.lifewire.com\/what-exactly-is-a-reddit-ama-3485985.  Elise Moreau. 2017. What Exactly Is a Reddit AMA? Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.lifewire.com\/what-exactly-is-a-reddit-ama-3485985."},{"key":"e_1_2_1_81_1","unstructured":"Kevin Morris. 2015. Reddit Moderation Being Taken Over by Bots\u2014And That\u2019s a Good Thing. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.dailydot.com\/news\/reddit-automoderator-bots\/.  Kevin Morris. 2015. Reddit Moderation Being Taken Over by Bots\u2014And That\u2019s a Good Thing. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.dailydot.com\/news\/reddit-automoderator-bots\/."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1007\/PL00010345"},{"key":"e_1_2_1_83_1","unstructured":"Erica Ong. 2018. Is Machine Learning the Future of Content Moderation? Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/insights.conduent.com\/conduent-blog\/is-machine-learning-the-future-of-content-moderation.  Erica Ong. 2018. Is Machine Learning the Future of Content Moderation? Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/insights.conduent.com\/conduent-blog\/is-machine-learning-the-future-of-content-moderation."},{"key":"e_1_2_1_84_1","unstructured":"M. Pilar Opazo. 2010. Revitalizing the concept of sociotechnical systems in social studies of technology. (2010). Available at https:\/\/linproxy.fan.workers.dev:443\/https\/www.semanticscholar.org\/paper\/Revitalizing-the-Concept-of-Sociotechnical-Systems-Opazo\/78460b4bdcbe004ccd469f4bda1f7d98017954de.  M. Pilar Opazo. 2010. Revitalizing the concept of sociotechnical systems in social studies of technology. (2010). Available at https:\/\/linproxy.fan.workers.dev:443\/https\/www.semanticscholar.org\/paper\/Revitalizing-the-Concept-of-Sociotechnical-Systems-Opazo\/78460b4bdcbe004ccd469f4bda1f7d98017954de."},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858389"},{"key":"e_1_2_1_86_1","volume-title":"Qualitative Evaluation and Research Methods","author":"Patton Michael Quinn","unstructured":"Michael Quinn Patton . 1990. Qualitative Evaluation and Research Methods . SAGE Publications, Inc. Michael Quinn Patton. 1990. Qualitative Evaluation and Research Methods. SAGE Publications, Inc."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675134"},{"key":"e_1_2_1_88_1","unstructured":"Neil Postman. 1992. Technopoly. Vintage New York.  Neil Postman. 1992. Technopoly. Vintage New York."},{"key":"e_1_2_1_89_1","unstructured":"Kim Renfro. 2016. For whom the troll trolls: A day in the life of a Reddit moderator. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.businessinsider.com\/what-is-a-reddit-moderator-2016-1#crocker-has-.  Kim Renfro. 2016. For whom the troll trolls: A day in the life of a Reddit moderator. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.businessinsider.com\/what-is-a-reddit-moderator-2016-1#crocker-has-."},{"key":"e_1_2_1_91_1","volume-title":"Commercial content moderation: Digital laborers","author":"Roberts Sarah T.","year":"2016","unstructured":"Sarah T. Roberts . 2016. Commercial content moderation: Digital laborers \u2019 dirty work. Media Studies Publications ( January 2016 ). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/ir.lib.uwo.ca\/commpub\/12. Sarah T. Roberts. 2016. Commercial content moderation: Digital laborers\u2019 dirty work. Media Studies Publications (January 2016). Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/ir.lib.uwo.ca\/commpub\/12."},{"key":"e_1_2_1_92_1","volume-title":"Behind The Screen: Content Moderation in the Shadows of Social Media","author":"Roberts Sarah T.","unstructured":"Sarah T. Roberts . 2019. Behind The Screen: Content Moderation in the Shadows of Social Media . Yale University Press . Sarah T. Roberts. 2019. Behind The Screen: Content Moderation in the Shadows of Social Media. Yale University Press."},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292522.3326032"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLEI.2014.6965181"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300836"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998277"},{"key":"e_1_2_1_97_1","volume-title":"Moderator engagement and community development in the age of algorithms. New Media 8 Society 21, 7","author":"Seering Joseph","year":"2019","unstructured":"Joseph Seering , Tony Wang , Jina Yoon , and Geoff Kaufman . 2019. Moderator engagement and community development in the age of algorithms. New Media 8 Society 21, 7 ( 2019 ), 1417--1443. Joseph Seering, Tony Wang, Jina Yoon, and Geoff Kaufman. 2019. Moderator engagement and community development in the age of algorithms. New Media 8 Society 21, 7 (2019), 1417--1443."},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13278-016-0350-0"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274433"},{"key":"e_1_2_1_100_1","volume-title":"Platform dialectics: The relationships between volunteer moderators and end users on reddit. New Media 8 Society","author":"Squirrell Tim","year":"2019","unstructured":"Tim Squirrell . 2019. Platform dialectics: The relationships between volunteer moderators and end users on reddit. New Media 8 Society ( 2019 ). Tim Squirrell. 2019. Platform dialectics: The relationships between volunteer moderators and end users on reddit. New Media 8 Society (2019)."},{"key":"e_1_2_1_101_1","unstructured":"Steve Stecklow. 2018. Why Facebook is Losing the War on Hate Speech in Myanmar. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.reuters.com\/investigates\/special-report\/myanmar-facebook-hate\/.  Steve Stecklow. 2018. Why Facebook is Losing the War on Hate Speech in Myanmar. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.reuters.com\/investigates\/special-report\/myanmar-facebook-hate\/."},{"key":"e_1_2_1_102_1","volume-title":"Basics of Qualitative Research","author":"Strauss Anselm","unstructured":"Anselm Strauss and Juliet Corbin . 1990. Basics of Qualitative Research . Sage publications. Anselm Strauss and Juliet Corbin. 1990. Basics of Qualitative Research. Sage publications."},{"key":"e_1_2_1_103_1","first-page":"18","article-title":"What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation","volume":"13","author":"Suzor Nicolas P.","year":"2019","unstructured":"Nicolas P. Suzor , Sarah Myers West , Andrew Quodling , and Jillian York . 2019 . What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation . International Journal of Communication 13 (2019), 18 . Nicolas P. Suzor, Sarah Myers West, Andrew Quodling, and Jillian York. 2019. What do we mean when we talk about transparency? Toward meaningful transparency in commercial content moderation. International Journal of Communication 13 (2019), 18.","journal-title":"International Journal of Communication"},{"key":"e_1_2_1_104_1","unstructured":"Courtnie Swearingen and Brian Lynch. 2018. We\u2019re Reddit Mods and This Is How We Handle Hate Speech. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.wired.com\/2015\/08\/reddit-mods-handle-hate-speech\/.  Courtnie Swearingen and Brian Lynch. 2018. We\u2019re Reddit Mods and This Is How We Handle Hate Speech. Retrieved from https:\/\/linproxy.fan.workers.dev:443\/https\/www.wired.com\/2015\/08\/reddit-mods-handle-hate-speech\/."},{"key":"e_1_2_1_105_1","volume-title":"Introduction to Qualitative Research Methods: A Guidebook and Resource","author":"Taylor Steven J.","unstructured":"Steven J. Taylor , Robert Bogdan , and Marjorie DeVault . 2015. Participant observation: In the field . In Introduction to Qualitative Research Methods: A Guidebook and Resource . John Wiley 8 Sons, Chapter 3. Steven J. Taylor, Robert Bogdan, and Marjorie DeVault. 2015. Participant observation: In the field. In Introduction to Qualitative Research Methods: A Guidebook and Resource. John Wiley 8 Sons, Chapter 3."},{"key":"e_1_2_1_106_1","volume-title":"Watch Me Play: Twitch and the Rise of Game Live Streaming","author":"Taylor T. L.","unstructured":"T. L. Taylor . 2018. Regulating the networked broadcasting frontier . In Watch Me Play: Twitch and the Rise of Game Live Streaming . Princeton University Press , Chapter 5. T. L. Taylor. 2018. Regulating the networked broadcasting frontier. In Watch Me Play: Twitch and the Rise of Game Live Streaming. Princeton University Press, Chapter 5."},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1145\/363347.363387"},{"key":"e_1_2_1_108_1","volume-title":"Proceedings of the 2007 International Conference on Weblogs and Social Media (ICWSM\u201907)","author":"Veloso Adriano","year":"2007","unstructured":"Adriano Veloso , Wagner Meira Jr , Tiago Alves Macambira , Dorgival O. Guedes , and H\u00e9lio Marcos Paz de Almeida . 2007 . Automatic moderation of comments in a large on-line journalistic environment . In Proceedings of the 2007 International Conference on Weblogs and Social Media (ICWSM\u201907) . Adriano Veloso, Wagner Meira Jr, Tiago Alves Macambira, Dorgival O. Guedes, and H\u00e9lio Marcos Paz de Almeida. 2007. Automatic moderation of comments in a large on-line journalistic environment. In Proceedings of the 2007 International Conference on Weblogs and Social Media (ICWSM\u201907)."},{"key":"e_1_2_1_109_1","volume-title":"suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media 8 Society","author":"West Sarah Myers","year":"2018","unstructured":"Sarah Myers West . 2018. Censored , suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media 8 Society ( 2018 ). Sarah Myers West. 2018. Censored, suspended, shadowbanned: User interpretations of content moderation on social media platforms. New Media 8 Society (2018)."},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300390"},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052591"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/dl.acm.org\/doi\/10.1145\/3338243","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/dl.acm.org\/doi\/pdf\/10.1145\/3338243","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/dl.acm.org\/doi\/pdf\/10.1145\/3338243","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:54:02Z","timestamp":1750204442000},"score":1,"resource":{"primary":{"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/dl.acm.org\/doi\/10.1145\/3338243"}},"subtitle":["The Case of Reddit Automoderator"],"short-title":[],"issued":{"date-parts":[[2019,7,19]]},"references-count":108,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2019,10,31]]}},"alternative-id":["10.1145\/3338243"],"URL":"https:\/\/linproxy.fan.workers.dev:443\/https\/doi.org\/10.1145\/3338243","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,19]]},"assertion":[{"value":"2019-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}