Your browser does not fully support modern features. Please upgrade for a smoother experience.
Sparse Signal Processing: History
Please note this is an old version of this entry, which may differ significantly from the current revision.
Contributor: Eng Editorial Office

Sparse signal processing is a framework for representing, acquiring, and reconstructing signals that have a sparse or compressible representation in some dictionary or transform basis, meaning that only a small fraction of the coefficients are significant while most are zero or near-zero. The central result of compressed sensing is that such signals can be reconstructed exactly from far fewer linear measurements than the Nyquist-Shannon sampling theorem requires, provided the measurement matrix satisfies the restricted isometry property and the signal is sufficiently sparse [1]. The reconstruction problem is formulated as an underdetermined linear system solved through L1-norm minimization, which promotes sparsity by penalizing the sum of absolute coefficients, or through greedy algorithms such as orthogonal matching pursuit that iteratively select the dictionary atoms most correlated with the residual. The framework applies to image processing, MRI, radar, and communication systems where the cost or bandwidth of acquiring full Nyquist-rate samples is prohibitive. The mathematical conditions for exact recovery are governed by incoherence between the measurement basis and the sparsity basis, and the number of measurements required scales logarithmically with signal dimension and linearly with sparsity level [2]. The theory unifies signal representation, sampling, and inverse problem solving under the principle that exploiting sparsity is equivalent to exploiting low-dimensional structure, and it provides deterministic recovery guarantees under random measurement ensembles [3].

  • sparse signal processing
  • compressed sensing
  • L1 minimization
  • sparse recovery

Advanced Signal Processing Techniques •  Electrical and Electronic Engineering •  Engineering •  Physical Sciences

References

  1. D.L. Donoho; Compressed sensing. IEEE Trans. Inf. Theory 2006, 52, 1289-1306, 10.1109/tit.2006.871582.
  2. E.J. Candes; J. Romberg; T. Tao; Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inf. Theory 2006, 52, 489-509, 10.1109/tit.2005.862083.
  3. Emmanuel J. Candes; Terence Tao; Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?. IEEE Trans. Inf. Theory 2006, 52, 5406-5425, 10.1109/tit.2006.885507.
More
This entry is offline, you can click here to edit this entry!
Academic Video Service