31  Image processing principles

Published

December 12, 2025

Work in Progress

Suggestions of all kinds for this book draft are welcome — whether it’s fixing small errors, raising bigger questions, or offering new perspectives. Please share comments through GitHub Issues. To make feedback easier to address, please point to the section you have in mind — by section number or a short snippet of text.

31.1 Image processing principles overview

The general field of digital image processing is enormous. It was large when I was a graduate student, and with time it has grown even more massive. It seems that whenever a new computational concept emerges, it finds application in imaging and expands the field. The most recent expansion is the use of deep neural network tools to create and edit images and videos. These are fascinating and

In

To this point, we have considered the environmental light field Section 2.1, how it is measured by the optics Chapter 7, and how it is then converted into electrons at each pixel Section 17.1. We have also considered how the visual system would capture the same light field.

The first part of this chapter on image processing describes the steps that converts the data measured by the sensor into a signal that can be viewed by a person.

It seems as if we should have display go first so we can do it. Or we might just assume that people know displays are typically RGB and hope for the best?

Also, the human section on color might include some minimal display description that we could use here as the basic display model, with more advanced displays to come later, in the chapter Section 28.1.

31.2 Lens shading

31.3 Acquisition policies

31.4 Demosaicking

Space-color correlations?

31.5 Color processing

31.5.1 Sensor correction

31.5.2 Illuminant correction