arXiv · 1908.11030
Towards Ethical Content-Based Detection of Online Influence Campaigns
Abstract
The detection of clandestine efforts to influence users in online communities is a challenging problem with significant active development. We demonstrate that features derived from the text of user comments are useful for identifying suspect activity, but lead to increased erroneous identifications when keywords over-represented in past influence campaigns are present. Drawing on research in native language identification (NLI), we use "named entity masking" (NEM) to create sentence features robust to this shortcoming, while maintaining comparable classification accuracy. We demonstrate that while NEM consistently reduces false positives when key named entities are mentioned, both masked and unmasked models exhibit increased false positive rates on English sentences by Russian native speakers, raising ethical considerations that should be addressed in future research.
Explore related subjects
Keep this discovery
Evan Crothers, Nathalie Japkowicz, Herna Viktor. 2019-08-29. Towards Ethical Content-Based Detection of Online Influence Campaigns. https://doi.org/10.1109/mlsp.2019.8918842
Cite the original work for its findings. Save a collection to share your selection of sources.