Subset based error recovery

Ömer Ekmekcioğlu, Deniz Akkaya, Mustafa Pınar*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

We propose a data denoising method using Extreme Learning Machine (ELM) structure which allows us to use Johnson-Lindenstrauß Lemma (JL) for preserving Restricted Isometry Property (RIP) in order to give theoretical guarantees for recovery. Furthermore, we show that the method is equivalent to a robust two-layer ELM that implicitly benefits from the proposed denoising algorithm. Current robust ELM methods in the literature involve well-studied L1, L2 regularization techniques as well as the usage of the robust loss functions such as Huber Loss. We extend the recent analysis on the Robust Regression literature to be effectively used in more general, non-linear settings and to be compatible with any ML algorithm such as Neural Networks (NN). These methods are useful under the scenario where the observations suffer from the effect of heavy noise. We extend the usage of ELM as a general data denoising method independent of the ML algorithm. Tests for denoising and regularized ELM methods are conducted on both synthetic and real data. Our method performs better than its competitors for most of the scenarios, and successfully eliminates most of the noise.

Original languageEnglish
Article number108361
JournalSignal Processing
Volume191
DOIs
Publication statusPublished - Feb 2022
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2021 Elsevier B.V.

Keywords

  • Extreme Learning Machine
  • Hard Thresholding
  • Regularization
  • Robust Networks
  • Sparse Recovery

Fingerprint

Dive into the research topics of 'Subset based error recovery'. Together they form a unique fingerprint.

Cite this