Ir al contenido

Documat


Resumen de Use of Natural Language Processing to Identify Inappropriate Content in Text

Sergio Merayo Alba, Eduardo Fidalgo Fernández Árbol académico, Víctor González Castro Árbol académico, Rocío Aláiz Rodríguez Árbol académico, Javier Velasco Mata

  • The quick development of communication through new technology media such as social networks and mobile phones has improved our lives. However, this also produces collateral problems such as the presence of insults and abusive comments. In this work, we address the problem of detecting violent content on text documents using Natural Language Processing techniques. Following an approach based on Machine Learning techniques, we have trained six models resulting from the combinations of two text encoders, Term Frequency-Inverse Document Frequency and Bag of Words, together with three classifiers: Logistic Regression, Support Vector Machines and Na¨ıve Bayes. We have also assessed StarSpace, a Deep Learning approach proposed by Facebook and configured to use a Hit@1 accuracy. We evaluated these seven alternatives in two publicly available datasets from the Wikipedia Detox Project: Attack and Aggression. StarSpace achieved an accuracy of 0.938 and 0.937 in these datasets, respectively, being the algorithm recommended to detect violent content on text documents among the alternatives evaluated.


Fundación Dialnet

Mi Documat