Computational Imaging

A comprehensive and up-to-date textbook and reference for computational imaging, which combines vision, graphics, signal processing, and optics.

Computational imaging involves the joint design of imaging hardware and computer algorithms to create novel imaging systems with unprecedented capabilities. In recent years such capabilities include cameras that operate at a trillion frames per second, microscopes that can see small viruses long thought to be optically irresolvable, and telescopes that capture images of black holes. This text offers a comprehensive and up-to-date introduction to this rapidly growing field, a convergence of vision, graphics, signal processing, and optics. It can be used as an instructional resource for computer imaging courses and as a reference for professionals. It covers the fundamentals of the field, current research and applications, and light transport techniques.
 
The text first presents an imaging toolkit, including optics, image sensors, and illumination, and a computational toolkit, introducing modeling, mathematical tools, model-based inversion, data-driven inversion techniques, and hybrid inversion techniques. It then examines different modalities of light, focusing on the plenoptic function, which describes degrees of freedom of a light ray. Finally, the text outlines light transport techniques, describing imaging systems that obtain micron-scale 3D shape or optimize for noise-free imaging, optical computing, and non-line-of-sight imaging. Throughout, it discusses the use of computational imaging methods in a range of application areas, including smart phone photography, autonomous driving, and medical imaging. End-of-chapter exercises help put the material in context.
 

Ayush Bhandari is Assistant Professor of Electrical and Electronic Engineering at Imperial College London. Achuta Kadambi is Assistant Professor of Electrical Engineering and Computer Science at the University of California, Los Angeles. Ramesh Raskar is Associate Professor at the MIT Media Lab and winner of the 2016 Lemelson-MIT Prize.
 
 

List of Figures xi
List of Tables xxix
Preface xxxi
1 Introduction to Computational Imaging 1
I Part I: Toolkits 9
2 Imaging Toolkit 11
3 Computational Toolkit 67
II Part II: Plenoptic Imaging 127
4 Spatially Coded Imaging 127
5 Temporally Coded Imaging 169
6 Light Field Imaging and Display 211
7 Polarimetric Imaging 253
8 Spectral Imaging 287
III Part III: Shading and Transport of Light 315
9 Programmable Illumination and Shading 317
10 Light Transport 357
Glossary 415
References 421
Index 443