Some other Super-resolution examples

Some other super-resolution
examples
Javier Mateos
Outline
• Other applications of super-resolution
– Demosaicing
– Superresolution from multisensors
• Multi-Dimensional Signal Processing (MDSP)
• Commercial software
–
–
–
–
QE Superresolution
PhotoAcute
Cognitech Video Investigator
Other commercial software
Other approaches to superresolution
• Demosaicing
Improves color images from a single
CCD camera
• Superresolution from multisensors
Combine images from a set of shifted
sensors
Demosaicing
Bayer pattern
Demosaicing
Demosaicing + Deblurring
Original
Bilinear interpolation
+ deconvolution
Blurred
Proposed method
Super-resolution from multisensors
Super-resolution from multisensors
Original
Initial reconstruction
Low resolution
Final reconstruction
Multi-Dimensional Signal
Processing (MDSP)
• Implements several super-resolution
methods by Prof. Elad and Prof. Milanfar.
• For academic (Prof. Milanfar) and
commercial use (MotionDSP, Inc.)
• Allows super-resolution for gray scale and
color (demosaicing) images.
Multi-Dimensional Signal
Processing (MDSP)
Multi-Dimensional Signal
Processing (MDSP)
Bicubic interpolation
Shift & add + decovolution
BIlateral shift & add + decovolution Median shift & add + decovolution
Multi-Dimensional Signal
Processing (MDSP)
Bicubic interpolation
BIlateral shift & add + decovolution
Shift & add + decovolution
Median shift & add + decovolution
Comercial software
•
•
•
•
QE Superresolution
PhotoAcute
Cognitech Video Investigator
Other commercial software
– Salient Stills Video Focus
– Let it wave Video Upconversion
– Scientific Systems Company, Inc.
QE Superresolution
http://www.qelabs.com/sr/index.asp
•
•
•
•
Only performs super-resolution.
No information of how it works.
Only opens DV video sequences?
Allows different output resolutions (x2, x4).
QE Superresolution
QE Superresolution
PhotoAcute
http://www.photoacute.com
• PhotoAcute Studio
–
–
–
–
–
Noise Reduction.
Balanced light.
Unneeded moving objects removal.
And, of course, Super-resolution processing.
Needs to know the camera characteristics (brand,
model, focus, …) used to take the pictures.
• PhotoAcute Mobile
– For Nokia 3650/3660/6600/6620/6260 and
SonyEricsson P800/P900/P910.
– Allows super-resolution and geometry/brightness
correction.
PhotoAcute
Cognitech Video Investigator
http://cognitech.com/
• Forensic Enhancement Software
• Processes video sequences
• Deblurring, Demultiplexing, Denoising,
Bright/constract enhancement, Tracking,
Transform (mirror, deformatons, …), etc.
• Mosaic reconstruction from velocity information
• Movie stabilization from velocity information
• Frame fusion from velocity information
Cognitech Video Investigator
Resumen
original
PhotoAcute Studio
QE Superresolution
Cognitech Video Investigator
Other commercial software
•
Salient Stills Video Focus (http://www.salientstills.com)
Similar to Cognitech Video Investigator.
From technology conceived at the MIT Media Lab (and people from
the lab) (Negroponte).
Also offers image production services.
•
Let it wave Video Upconversion (http://www.letitwave.com)
Based on wavelets / bandelets.
Standard to High-Definition conversion.
Both hardware and software solutions are being developed.
Founded by Mallat (Ecole Polytechnique)
•
Scientific Systems Company, Inc. (http://www.ssci.com)
Produces a Matlab toolbox for Super-resolution.
Business base: Army, Intelligence, NASA.