High-dimensional outlier detection using random projections
-
P. Navarro-Esteban [1] ; J. A. Cuesta-Albertos [1]
-
[1] Universidad de Cantabria
Universidad de Cantabria
Santander, España
-
- Localización: Test: An Official Journal of the Spanish Society of Statistics and Operations Research, ISSN-e 1863-8260, ISSN 1133-0686, Vol. 30, Nº. 4, 2021, págs. 908-934
- Idioma: inglés
- DOI: 10.1007/s11749-020-00750-y
- Texto completo no disponible (Saber más ...)
-
Resumen
There exist multiple methods to detect outliers in multivariate data in the literature, but most of them require to estimate the covariance matrix. The higher the dimension, the more complex the estimation of the matrix becoming impossible in high dimensions. In order to avoid estimating this matrix, we propose a novel random projection-based procedure to detect outliers in Gaussian multivariate data. It consists in projecting the data in several one-dimensional subspaces where an appropriate univariate outlier detection method, similar to Tukey’s method but with a threshold depending on the initial dimension and the sample size, is applied. The required number of projections is determined using sequential analysis. Simulated and real datasets illustrate the performance of the proposed method.
