Use of Natural Language Processing to Identify Inappropriate Content in Text
-
Sergio Merayo-Alba [1] ; Eduardo Fidalgo [1] ; Victor González-Castro [1] ; Rocío Alaiz-Rodríguez [1] ; Javier Velasco-Mata [1]
-
[1] Universidad de León
Universidad de León
León, España
-
- Localización: Hybrid Artificial Intelligent Systems. 14th International Conference, HAIS 2019: León, Spain, September 4–6, 2019. Proceedings / coord. por Hilde Pérez García
, Lidia Sánchez González , Manuel Castejón Limas , Héctor Quintián Pardo , Emilio Santiago Corchado Rodríguez , 2019, ISBN 978-3-030-29858-6, págs. 254-263 - Idioma: inglés
- Enlaces
-
Resumen
The quick development of communication through new technology media such as social networks and mobile phones has improved our lives. However, this also produces collateral problems such as the presence of insults and abusive comments. In this work, we address the problem of detecting violent content on text documents using Natural Language Processing techniques. Following an approach based on Machine Learning techniques, we have trained six models resulting from the combinations of two text encoders, Term Frequency-Inverse Document Frequency and Bag of Words, together with three classifiers: Logistic Regression, Support Vector Machines and Na¨ıve Bayes. We have also assessed StarSpace, a Deep Learning approach proposed by Facebook and configured to use a Hit@1 accuracy. We evaluated these seven alternatives in two publicly available datasets from the Wikipedia Detox Project: Attack and Aggression. StarSpace achieved an accuracy of 0.938 and 0.937 in these datasets, respectively, being the algorithm recommended to detect violent content on text documents among the alternatives evaluated.
