Space-efficient Feature Maps for String Alignment Kernels

Yasuo Tabei, Yoshihiro Yamanishi, Rasmus Pagh

Publikation: Konference artikel i Proceeding eller bog/rapport kapitelKonferencebidrag i proceedingsForskningpeer review

Abstract

String kernels are attractive data analysis tools for analyzing string data. Among them, alignment kernels are known for their high prediction accuracies in string classifications when tested in combination with SVMin various applications. However, alignment kernels have a crucial drawback in that they scale poorly due to their quadratic computation complexity in the number of input strings, which limits large-scale applications in practice. We address this need by presenting the first approximation for string alignment kernels, which we call space-
efficient feature maps for edit distance with moves (SFMEDM), by leveraging a metric embedding named edit sensitive parsing (ESP) and feature maps (FMs) of random Fourier features (RFFs) for large-scale string analyses. The original FMs for RFFs consume a huge amount of memory proportional to the dimension d of
input vectors and the dimension D of output vectors, which prohibits its large-scale applications. We present novel space-efficient feature maps (SFMs) of RFFs for a space reduction from O(dD) of the original FMs to O(d) of SFMs with a
theoretical guarantee with respect to concentration bounds. We experimentally test SFMEDM on its ability to learn SVM for large-scale string classifications with various massive string data, and we demonstrate the superior performance of SFMEDM with respect to prediction accuracy, scalability and computation
efficiency.
OriginalsprogEngelsk
TitelIEEE International Conference on Data Mining (ICDM)
ForlagIEEE Computer Society Press
Publikationsdato2019
ISBN (Elektronisk)978-1-7281-4603-4
DOI
StatusUdgivet - 2019
NavnIEEE International Conference on Data Mining (ICDM)
ISSN2374-8486

Emneord

  • String kernels
  • Alignment kernels
  • SVM classification
  • Edit distance
  • Random Fourier features (RFFs)
  • Metric embedding
  • Edit sensitive parsing (ESP)
  • Large-scale string analysis
  • Space-efficient algorithms
  • Feature maps

Fingeraftryk

Dyk ned i forskningsemnerne om 'Space-efficient Feature Maps for String Alignment Kernels'. Sammen danner de et unikt fingeraftryk.

Citationsformater