A Near-linear Time Approximation Algorithm for Angle-based Outlier Detection in High-dimensional Data

Ninh Dang Pham, Rasmus Pagh

Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review

Abstract

Outlier mining in d-dimensional point sets is a fundamental and well studied data mining task due to its variety of applications. Most such applications arise in high-dimensional domains. A bottleneck of existing approaches is that implicit or explicit assessments on concepts of distance or nearest neighbor are deteriorated in high-dimensional data. Following up on the work of Kriegel et al. (KDD '08), we investigate the use of angle-based outlier factor in mining high-dimensional outliers. While their algorithm runs in cubic time (with a quadratic time heuristic), we propose a novel random projection-based technique that is able to estimate the angle-based outlier factor for all data points in time near-linear in the size of the data. Also, our approach is suitable
to be performed in parallel environment to achieve a parallel speedup. We introduce a theoretical analysis of the quality of approximation to guarantee the reliability of our estimation algorithm. The empirical experiments on synthetic and real world data sets demonstrate that our approach is efficient and scalable to very large high-dimensional data sets.
OriginalsprogEngelsk
TitelKDD '12 Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Antal sider9
ForlagAssociation for Computing Machinery
Publikationsdato12 aug. 2012
Sider877-885
ISBN (Trykt)978-1-4503-1462-6
StatusUdgivet - 12 aug. 2012

Emneord

  • Outlier detection
  • high-dimensional
  • angle-based
  • random projection
  • AMS Sketch

Fingeraftryk

Dyk ned i forskningsemnerne om 'A Near-linear Time Approximation Algorithm for Angle-based Outlier Detection in High-dimensional Data'. Sammen danner de et unikt fingeraftryk.

Citationsformater