Bio-Inspired Color Sensing

Many natural vision systems respond to color bands beyond RGB, revealing otherwise invisible material signatures. Check out our work on hyperspectral colorization, infrared material sensing, and human color perception.

Bio-Inspired Depth and Motion Sensing

Our computational models explain jumping spider behavior under defocus and spatial biases in larval zebrafish optic flow responses. They also enable a family of highly-efficient depth and velocity cameras [metalens, focal track, focal flow], reveal mathematical connections between depth photography and phase microscopy [TIE], and describe natural scene statistics of underwater motion [zebrafish].

Best Student Paper ECCV 2016, Best Demo ICCP 2018, patent licensed to Metalenz
[jumping spider media coverage 1 2 3 4 5 6 7]
[zebrafish media coverage 1 2 3 4 5 ... total: 75 outlets, est 1.5 mil readers]

Machine Learning for Scientific Imaging

Physics-informed machine learning allows us to combine models of the physical world with data-driven priors to solve difficult inverse problems like galaxy shear estimation for cosmology and material classification from thermal video . A combination of machine learning and classic image processing techniques reveal more information from medical imaging modalities including X-ray, photoacoustic, and optical coherence tomography.

[galaxy media coverage 1 2 3 4]

Recent Projects