Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 6 additions & 15 deletions chapters/displays-01-principles.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -5,26 +5,17 @@ date: last-modified
# Display principles {#sec-display-principles}
{{< include "includes/WIP-callout.qmd" >}}

<!--
Read some Bernard Kress for near eye displays.

## Display devices
Refer to light field concepts as in the chapter

## LCD OLED CRT
I have OLED review papers in Paperpile on technology. Tsujimura for example. See chapter.
## Display principles overview {#sec-display-principles-overview}

## AR/VR
Consumer photography is a very important application of image sensors. In that application, sensor data are transformed into data that can drive a visual display. To understand these image processing steps, it is useful to understand both the sensor and display technology. Just as there are multiple types of sensors, there are multiple types of displays, each with its own strengths and weaknesses. The image processing methods must account for the input (sensors) and output data (display). In consumer photography applications, the display and algorithm designs must also account for certain properties of the human visual system ([Part IV: Human Vision](part-human.qmd)).

## Lightfield displays
I wonder if the Wetzstein work with LCDs should go in here?
Certain principles are implemented in nearly all visual displays, and we cover those in this chapter. The following charpters in [Part V: Displays](part-displays.qmd) introduce different display types and their features.

## Artal chapter text below
The critical algorithms for consumer photography are covered in @sec-imgprocessing-principles. It is increasingly the case that images are used for purposes other than consumer photography. Images play an important role in medical imaging, robotics, and autonomous vehicles, where they are both analyzed and created using computer algorithms. An increasingly large number of image sensors acquire environmental information that is never seen by human eyes. [Part VI: Image processing](part-processing.qmd) introduces image processing algorithms and metrics relevant to these applications as well[^ip-snark].

(Needs updating because I kept writing after this. The standard display model should go in here for calibration, for sure.)
-->
## Display principles overview {#sec-display-principles-overview}
[^ip-snark]: Computer scientists generally think RGB images magically appear and reflect reality. Sigh. IMHO there could be a lot more thought put into the question of image processing for machine vision applications—for example, standard RGB pipelines bake in human-centric demosaicking, white balance, and tone curves that are often unnecessary or suboptimal for machine vision.

## Displays - A Review chapter
**The text below is adapted from this review chapter. At this time, please also consult that article:**

**[Characterization of Visual Stimuli using the Standard Display Model, 2024](resources/Artal-2024/Artal-2024.qmd){target=_blank}**
Expand Down
17 changes: 10 additions & 7 deletions chapters/imgprocessing-01-principles.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -7,30 +7,32 @@ date: last-modified

## Image processing principles overview {#sec-imgprocessing-principles-overview}

The general field of digital image processing is enormous. It was large when I was a graduate student, and with time it has grown even more massive. It seems that whenever a new computational concept emerges, it finds application in imaging and expands the field. The most recent expansion is the use of deep neural network tools to create and edit images and videos. These are fascinating and
This chapter bridges the raw, mosaicked sensor measurements introduced in the sensor chapters and the trichromatic display representations introduced in @sec-display-principles-overview.

In
![Image processing stages](images/imageprocessing/01-image-processing/004-reference-consumer-photography-pipeline.png){#fig-ip-overview width="70%"}

To this point, we have considered the environmental light field [@sec-light-overview], how it is measured by the optics [@sec-geometric-optics], and how it is then converted into electrons at each pixel [@sec-pixels-overview]. We have also considered how the visual system would capture the same light field.
## Lens shading

The first part of this chapter on image processing describes the steps that converts the data measured by the sensor into a signal that can be viewed by a person.
Make a panel tabset of these.

It seems as if we should have display go first so we can do it. Or we might just assume that people know displays are typically RGB and hope for the best?
![Lens shading geometry.](images/imageprocessing/01-image-processing/013-relative-illumination-aperture-geometry.png){#fig-lens-shading}

Also, the human section on color might include some minimal display description that we could use here as the basic display model, with more advanced displays to come later, in the chapter @sec-display-principles-overview.

## Lens shading
![Lens shading geometry.](images/imageprocessing/01-image-processing/014-relative-illumination-sensor-distance.png){#fig-lens-shading}

## Acquisition policies


## Demosaicking

Space-color correlations?

## Color processing


### Sensor correction


### Illuminant correction


Expand All @@ -39,3 +41,4 @@ Space-color correlations?




2 changes: 1 addition & 1 deletion chapters/part-processing.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ date: last-modified

Intro to processing.

## Image processing topics
## Image processing topics {#sec-part-ip-overview}

* Hardware - Qualcomm, Broadcom type devices for rendering
* Rendering - Algorithms such as demosaic, defective pixel, color transforms, blurring, adaptive
Expand Down
Loading