[ Beneath the Waves ]

Calculated Greyscale Images

article by Ben Lincoln

 

With the raw data of the image cube as the starting point, it becomes possible to mathematically derive additional greyscale images which illuminate the relationships between them.

Mathematical Relationships

Because our eyes perceive (mostly) the intensity of three spectral bands, it seems natural to begin by treating other spectral bands the same way. But it can also be useful to generate images which instead represent, for example, the difference in intensity between two (or more) bands, or the ratio of one to another.

In this group of images, notice that several of the difference variations make it extremely obvious where there is variation across spectral bands near the centers of the flowers:

Differences
[ NIR (Grey) ]
NIR (Grey)
[ R (Grey) ]
R (Grey)
[ G (Grey) ]
G (Grey)
[ B (Grey) ]
B (Grey)
[ UVA (Grey) ]
UVA (Grey)
[ Difference: B-G (Grey) ]
Difference: B-G (Grey)
[ Difference: G-NIR (Grey) ]
Difference: G-NIR (Grey)
[ Difference: NIR-B (Grey) ]
Difference: NIR-B (Grey)
[ Difference: NIR-R (Grey) ]
Difference: NIR-R (Grey)
[ Difference: R-B (Grey) ]
Difference: R-B (Grey)
[ Difference: R-UVA (Grey) ]
Difference: R-UVA (Grey)
       

 

Date Shot: 2010-10-16
Camera Body: Nikon D70 (Modified)
Lens: Nikon Micro-Nikkor 105mm f/4
Filters: Standard Set
Date Processed: 2010-12-19
Version: 1.0

 

Calculating the ratio instead of the difference can produce a similar, but much more pronounced effect:

Ratios
[ Ratio: NIR To B (Grey) ]
Ratio: NIR To B (Grey)
[ Ratio: NIR To R (Grey) ]
Ratio: NIR To R (Grey)
[ Ratio: R To UVA (Grey) ]
Ratio: R To UVA (Grey)
[ Ratio: G To B (Grey) ]
Ratio: G To B (Grey)
[ Ratio: B To NIR (Grey) ]
Ratio: B To NIR (Grey)

 

Date Shot: 2010-10-16
Camera Body: Nikon D70 (Modified)
Lens: Nikon Micro-Nikkor 105mm f/4
Filters: Standard Set
Date Processed: 2010-12-19
Version: 1.0

 

Whichever of the two is preferable depends greatly on the subject matter and intent of the person processing the imagery.

A technique commonly used in the satellite mapping/remote-sensing community is to calculate the "normalized difference" between two bands[1]. The basic formula is in the form ND(a, b) = (a-b)/(a+b). For example, the normalized difference of 7 and 19 is (7 - 19)/(7 + 19), which is equal to -6/13, or about -0.46. In most instances that I've seen, zero is treated as a threshold, with negative values being discarded. If you are using The Mirror's Surface Breaks, it can generate both positive and negative values. When dealing with greyscale images, it is easiest to create a separate image for negative versus positive, because there is no intuitively visible way to indicate to the viewer where exactly zero lies in a greyscale image. There is a solution to this dilemma, which is discussed in the article Gradient-Mapped False Colour Images.

Here are a few examples of positive and negative normalized differences in OnEarth imagery of Grand Canyon National Park.

Normalized Differences
[ ND (Pos): SRTM-IR1 (Grey) ]
ND (Pos): SRTM-IR1 (Grey)
[ ND (Neg): SRTM-IR1 (Grey) ]
ND (Neg): SRTM-IR1 (Grey)
[ ND (Pos): IR3-Green (Grey) ]
ND (Pos): IR3-Green (Grey)
[ ND (Neg): IR3-Green (Grey) ]
ND (Neg): IR3-Green (Grey)
[ ND (Pos): IR2-Blue (Grey) ]
ND (Pos): IR2-Blue (Grey)
[ ND (Neg): IR2-Blue (Grey) ]
ND (Neg): IR2-Blue (Grey)
[ ND (Pos): IR1-Blue (Grey) ]
ND (Pos): IR1-Blue (Grey)
[ ND (Neg): IR1-Blue (Grey) ]
ND (Neg): IR1-Blue (Grey)
[ ND (Pos): Red-Green (Grey) ]
ND (Pos): Red-Green (Grey)
[ ND (Neg): Red-Green (Grey) ]
ND (Neg): Red-Green (Grey)
   

 

 

You can see that the negative values are generally washed out and not particularly useful, but some of them (such as the IR1/Blue variation) do provide some high-contrast views of the course of the river.

Vegetation Indices

The normalized difference formula is the basis for a whole branch of the satellite imagery field in which the amount/health of local vegetation (or other aspects of the terrain) is calculated from orbit. The original method is called the "normalized difference vegetation index" (NDVI), and is calculated simply by using the near-infrared image as the "a" variable and the red image as the "b" variable in the normalized different formula (so that NDVI = (NIR-Red)/(NIR+Red)). There are quite a few variations on this theme that have been developed over the years. They range from simple modifications (such as using the green image instead of red, yielding the "green normalized difference vegetation index" (GNDVI)), to the complex (for example, the "Global Environmental Monitoring Index" (GEMI) and "Angular Vegetation Index" (AVI)).

A lengthy list of these indices and their formulae is located at the end of this article. Here are a few examples based on OnEarth imagery of Yellowstone National Park:

Vegetation Index Examples 1
[ NDVI (Positive) (Grey) ]
NDVI (Positive) (Grey)
[ GNDVI (Positive) (Grey) ]
GNDVI (Positive) (Grey)
[ GEMI (Positive) (Grey) ]
GEMI (Positive) (Grey)
[ ASVI (Positive) (Grey) ]
ASVI (Positive) (Grey)
[ MSAVI (Positive) (Grey) ]
MSAVI (Positive) (Grey)
 

 

 

The same basic concept is also used to help detect other characteristics of the environment, such as distinguishing between water and land, or determining approximately how much sediment is present in a body of water.

This type of calculation can also be performed against multispectral imagery obtained with a camera on Earth, but it is very important to keep in mind that the technique was developed for satellite data, and the results may be wrong or misleading when applied to images captured in another way. For example, satellite imagery typically does not have to take into account shadows being cast on objects, or clouds moving in-between exposures. Satellites capture images of very wide areas, as opposed to individual plants. Some of the indices even depend on factors like the angle between the source of light and the sensor. Did you remember to measure that when you were out taking pictures?

That having been said, like so many other things, sometimes the results are quite striking, and as long as a pretty picture is the end goal (as opposed to obtaining reliable, scientific data), there's no reason not to do it. Here are a few examples from Big Bend National Park:

Vegetation Index Examples 2
[ NDVI (Negative) (Grey) ]
NDVI (Negative) (Grey)
[ NDVI (Positive) (Grey) ]
NDVI (Positive) (Grey)
[ ASVI (Negative) (Grey) ]
ASVI (Negative) (Grey)
[ MSAVI (Negative) (Grey) ]
MSAVI (Negative) (Grey)
 

 

Date Shot: 2010-07-07
Camera Body: Nikon D70 (Modified)
Lens: Nikon Nikkor 24mm f/2.8(?)
Filters: Standard Set
Date Processed: 2010-12-09
Version: 1.0

 

...and a phalaenopsis orchid:

Vegetation Index Examples 3
[ ARVI (Negative) (Grey) ]
ARVI (Negative) (Grey)
[ ARVI (Positive) (Grey) ]
ARVI (Positive) (Grey)
[ GNDVI (Negative) (Grey) ]
GNDVI (Negative) (Grey)
[ GNDVI (Positive) (Grey) ]
GNDVI (Positive) (Grey)
[ MSAVI2 (Grey) ]
MSAVI2 (Grey)

 

Date Shot: 2010-10-16
Camera Body: Nikon D70 (Modified)
Lens: Nikon Micro-Nikkor 105mm f/4
Filters: Standard Set
Date Processed: 2010-12-16
Version: 1.0

 

Vegetation Index Technical Background

The Mirror's Surface Breaks includes configuration files with numerous vegetation index and other satellite imagery-type calculated variations defined. For those who are interested, here is a list of the various functions and where I obtained the formula for each:

Abbreviations:

From Landsat Image Processing, James S. Aber, 2009:

From Above-Ground Biomass Estimation of Successional and Mature Forests Using TM Images in the Amazon Basin, Dengsheng Lu, Paul Mausel, Eduardo Brondizio, and Emilio Moran, 2002:

From Vegetation Detection for Mobile Robot Navigation, David M. Bradley, Scott M. Thayer, Anthony Stentz, and Peter Rander, 2004:

From Bilko Mini-Lesson 8: Vegetation Indices:

From Band Combinations, James W. Quinn, 2001:

Nonstandard formulae that I added myself for experimental purposes:

 
Footnotes
1. Just to be confusing, the "normalized difference" is often (but not always) different from the values that will result if the difference is calculated, and then those values are normalized in the more common sense.
2. For these formulas, no formal name was given, so I based the names off of the same category of formula in one of the other cited sources.
3. The KTx formulae are mysteriously referred to as "Tasseled Cap" earlier in the paper.
 
[ Page Icon ]