Quantitative Robust Uncertainty Principles and Optimally Sparse Decompositions | Foundations of Computational Mathematics
Skip to main content

Advertisement

Quantitative Robust Uncertainty Principles and Optimally Sparse Decompositions

  • Published:
Foundations of Computational Mathematics Aims and scope Submit manuscript

An Erratum to this article was published on 01 November 2007

Abstract

In this paper we develop a robust uncertainty principle for finite signals in \({\Bbb C}^N\) which states that, for nearly all choices \(T, \Omega\subset\{0,\ldots,N-1\}\) such that

$|T| + |\Omega| \asymp (\log N)^{-1/2} \cdot N,$

there is no signal \(f\) supported on \(T\) whose discrete Fourier transform \(\hat{f}\) is supported on \(\Omega.\) In fact, we can make the above uncertainty principle quantitative in the sense that if \(f\) is supported on \(T,\) then only a small percentage of the energy (less than half, say) of \(\hat{f}\) is concentrated on \(\Omega.\) As an application of this robust uncertainty principle (QRUP), we consider the problem of decomposing a signal into a sparse superposition of spikes and complex sinusoids

$f(s) = \sum_{t\in T}\alpha_1(t)\delta(s-t) + \sum_{\omega\in\Omega}\alpha_2(\omega)e^{i2\pi \omega s/N}/\sqrt{N}.$

We show that if a generic signal \(f\) has a decomposition \((\alpha_1,\alpha_2)\) using spike and frequency locations in \(T\) and \(\Omega,\) respectively, and obeying

$|T| + |\Omega| \leq {\rm Const}\cdot (\log N)^{-1/2}\cdot N,$

then \((\alpha_1, \alpha_2)\) is the unique sparsest possible decomposition (all other decompositions have more nonzero terms). In addition, if

$|T| + |\Omega| \leq {\rm Const}\cdot (\log N)^{-1}\cdot N,$

then the sparsest \((\alpha_1,\alpha_2)\) can be found by solving a convex optimization problem. Underlying our results is a new probabilistic approach which insists on finding the correct uncertainty relation, or the optimally sparse solution for nearly all subsets but not necessarily all of them, and allows us to considerably sharpen previously known results [9], [10]. In fact, we show that the fraction of sets \((T, \Omega)\) for which the above properties do not hold can be upper bounded by quantities like \(N^{-\alpha}\) for large values of \(\alpha.\) The QRUP (and the application to finding sparse representations) can be extended to general pairs of orthogonal bases \(\Phi_1,\Phi_2 \mbox{of} {\Bbb C}^N.\) For nearly all choices \({\Gamma_1},{\Gamma_2}\subset\{0,\ldots,N-1\}\) obeying

$|{\Gamma_1}| + |{\Gamma_2}| \asymp \mu(\Phi_1,\Phi_2)^{-2} \cdot (\log N)^{-m},$

where \(m\leq 6,\) there is no signal \(f\) such that \(\Phi_1 f\) is supported on \({\Gamma_1}\) and \(\Phi_2 f\) is supported on \({\Gamma_2}\) where \(\mu(\Phi_1,\Phi_2)\) is the mutual coherence between \(\Phi_1\) and \(\Phi_2.\)

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Similar content being viewed by others

Author information

Authors and Affiliations

Authors

Additional information

An erratum to this article is available at http://dx.doi.org/10.1007/s10208-007-7162-6.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Candes, E., Romberg, J. Quantitative Robust Uncertainty Principles and Optimally Sparse Decompositions. Found Comput Math 6, 227–254 (2006). https://doi.org/10.1007/s10208-004-0162-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10208-004-0162-x