Git Product home page Git Product logo

reducing-basis-mismatch-using-alternating-convex-search's Introduction

Inferring Basis Mismatch in image representations

Objective is to reduce problem of Basis mismatch using Alternating Convex Search.

Build Status

Research Problem

In theory of compressive sensing,

equation

where eq And eq

Here we have to determine original signal/image z from Sensing matrix \Phi and measured signal/image y. For M < N$ , $y = \Phi z becomes under-determined and does not have a closed form solution for z(infinite many z's maps to same y).

But compressive sensing theory says we can uniquely estimate z from \Phi and y, given z should be sparse in some basis matrix say \Psi(commonly DFT, DCT or wavelet) which is theoretically known and \Phi should be incoherent with \Psi.

So equation becomes,

eq

where \Psi \in \R^{N\text{x}N} and x \in \R^{N}.

In practice, even small deviation from exact signal can cause drastic increase in estimation error. This is called Basis Mismatch problem.

Note- Basis mismatch always exists because of noise or discrete representation of bases as the sensed signal is almost never going to lay on the exact grid of \Psi. So sparse signals w.r.t. sparsifying matrix \Psi could become non-sparse or less sparse under another matrix say \Psi' , such that \Psi \Psi' \neq I.

Therefore it remained the predominant question of how to reduce the Basis Mismatch effect?

Solution Approaches

Previous Approaches:

  • Oversample the frequency space i.e. \Psi \in \R^{N\text{x}QN} contain sinusoids with frequencies 1 / QN apart instead of 1 / N apart.
  • Treat both the model coefficients and the associated frequency as unknown which need to be solved. Isolates the unknown frequencies in separate, non-overlapping bins and then solves for their location and amplitude.
  • Both frequency locations and amplitudes can be estimated by solving the constrained Atomic Norm Minimization by semi-definite programming. Also Atomic Norm Minimization constrain can be solved by greedy forward-backward (GFB) algorithm.

Proposed Approaches- Alternating Convex Search (ACS): This method is implemented as shown in this paper. Here, we solve the basis mismatch problem using Alternating Convex Search (ACS) which is trying to estimate both frequency bases matrix and coefficients.

eq

This method uses standard l_1 to find out the signal model coefficients i.e. x by keeping frequency parameter \theta fixed. Then using this coefficients find out the signal model using component-wise minimization like coordinate descent on the frequency parameter. These steps are repeated this until convergence criteria is met.

Dependencies

MATLAB

References

reducing-basis-mismatch-using-alternating-convex-search's People

Contributors

kalpeshdusane avatar

Stargazers

 avatar

Watchers

 avatar

Forkers

wangziyuexiaxia

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.