NOAA logo with flying seagull.

NOAA KLM User's Guide

Section 9.7.3

Blue line drawn across page to separate text from document title.
Image denotes media you're currently using--Web or CD.Introduction Page, NOAA KLM TOC, Acronyms
Previous Section, Next Section

9.7.3 Historical Instrument File

9.7.3.1 Overview

The Historical Instrument File (HIF) contains the data necessary to characterize the instrument performance and albedo correction over time. Included are interrange ratio statistics, diffuser degradations (unsmoothed at each discrete instrument wavelength), preliminary irradiances (i.e. before application of albedo correction factors), electronic calibration data, wavelength calibration data, and current and next day projections of interrange ratios and albedo correction factors.

9.7.3.2 Contents

Each Historical Instrument File contains a daily HIF directory and eight groups of information for each day's HIF arranged in the following order:

  1. Daily HIF Directory
  2. OOPS Standard Headers
  3. Instrument Calibration and Albedo Correction Data
  4. Interrange Ratio Statistics
  5. Electronic Calibration Data
  6. Wavelength Calibration Data
  7. Diffuser Degradation Data
  8. Preliminary Irradiance Data
  9. Albedo Correction Data

The arrangement of the data segments generally reflects the processing sequence of the Generate Historical Instrument File program.

Figure 9.7.3.2-1 provides a physical overview of a monthly archival HIF tape. Table 9.7.3.2-1 provides a detailed description of the arrangement of records within each Daily Historical Instrument File. Details regarding contents and record layout of each record type listed in Table 9.7.3.2-1 be found at the end of this section, in the 1b Data Set description (Section 9.7.1.4), and, for individual data items, in the Data Dictionary (Section 9.7.5).

Figure showing Historical Instrument File Data organization

Table 9.7.3.2-1. Daily HIF Data Set Arrangement.
Record Type # of Records
Daily HIF Directory Record 1
OOPS Standard headers I & II*
o Daily Historical Instrument File
o Daily 1b Data Set
o Instrument Calibration and Albedo Correction Data Set
6 + reprocessed
Instrument Calibration and Albedo Correction Data
o Instrument Calibration and Albedo Correction Directory Record
o Prelaunch Calibration Record*
o Baseline (day 1) Solar Flux Data Record*
o Interrange Rations Data Record*
o Albedo Correction Factor Data Record*
5
Earth View Interrange Ratio Statistics
o Instrument Characterization Header Record
o Offset Data Record
o Earth View Interrange Ratios Statistical Record
16 (nominal)
Electronic Calibration Data
o Instrument Characterization Header Record
o Discrete Data Records* (ECAL)
101 (nominal)
Wavelength Calibration Data
o Instrument Characterization Header Record
o Wavelength Calibration Data Records
9
Diffuser Degradation Data
o Instrument Characterization Header Record
o Diffuser Degradation Data Record
3
Preliminary Irradiance Data
o Instrument Characterization Header Record
o Preliminary Irradiance Statistical Record
o Discrete Preliminary Irradiance Data Records
13 (nominal
Albedo Correction Data
o Instrument Characterization Header Record
o Current Albedo correction Data Record
2 (nominal)
Total Records 156 Records (nominal)
* See Record layout in Section 9.7.1.4

The daily HIF directory record contains information pertaining to that day's data. All record numbers are relative record numbers within the day's data file.

OOPS Standard Header records for the following data sets occur on the Daily Historical Instrument File in the following order:

1. Daily Historical Instrument File
2. Daily 1b Data Set
3. Instrument Calibration and Albedo Correction Data Set

The first set of standard headers are generated by the Generate Historical Instrument File Program and pertain to the entire data set. The second and third sets are copies of the OOPS Standard Header records from those data sets read by the Generate Historical Instrument File program.

If a Daily Historical Instrument File is reprocessed, the set of current OOPS Standard Header records will be followed by the earlier OOPS Standard Header records. In the event of multiple reprocessing, the most current reprocessed header records will follow the current header records.

The Instrument Calibration and Albedo correction Data segment is a copy of the Instrument Calibration and Albedo Correction Data Set less OOPS Standard Headers after the interrange ratios and albedo correction factors are updated to next day projections by the Generate Historical Instrument File program. The directory is updated to reflect record numbers on the Daily Historical Instrument File.

The Interrange Ratio Data contains three record types arranged in the following order:

1. Instrument Characterization Header Records
2. Offset Data Record
3. Interrange Ratio Statistical record

The Instrument Characterization Header records identify the SBUV/2 orbits selected for zero offset interrange ratio computation. The Offset Data Record contains a flag which indicates whether offsets were computed from nighttime discrete mode earth view, default values were used, previous day's offsets were used or offsets as computed from non-illuminated mercury lamp view were used in computing interrange ratios. The offsets used are included. The Interrange Ratio Statistics Record include averages, standard deviations, minima, maxima, and number of samples of interrange ratios between gain ranges for each discrete wavelength. Also included are the minimum and maximum signal levels for acceptance in the interrange ratio computations and a source indicator similar to that described for the Offset Data Record.

The Electronic Calibration Data includes an Instrument Characterization Header record corresponding to the orbit selected for electronic calibration from the Daily 1b Data Set followed by discrete 1b data records for every other scan in the selected orbit. ECAL data are in samples 13, 14, 15 and 16.

The Wavelength Calibration Data includes the Instrument Characterization Header record corresponding to the orbit selected for wavelength calibration from the Daily 1b Data Set. This header record is followed by data records containing wavelengths of mercury line peaks.

The Diffuser Degradation Data segment contains Instrument Characterization Header records which identify the orbits selected for the diffuser degradation calculation from the Daily 1b Data Set. These header records are followed by a data record containing the wavelength and wavelength windows for mercury lines selected for diffuser degradation computation and the unsmoothed diffuser degradation at the mercury lines. A source indicator similar to that described for the Offset Data record is included.

The Preliminary Irradiance segment contains the Instrument Characterization Header records followed by discrete data records containing adjusted irradiances for solar view discrete mode data from the Daily 1b Data Set. The irradiance values have been adjusted for goniometric calibration and sun-earth distance and calibrated with prelaunch coefficients. A statistical record (averages, standard deviations, minima, maxima and number of samples) precedes the data records. A source indicator for albedo corrections is included in this statistical record.

The Albedo Correction data portion contains Instrument Characterization Header records followed by a data record. The data record includes smoothed diffuser degradations and albedo correction factors computed for the current day at the discrete monochromator and Cloud Cover Radiometer wavelengths.

9.7.3.3 Data Organization

Each Historical Instrument file consists of an IBM 3480 tape cartridge containing a calendar month of data. An OOPS Standard Header Record pair for the monthly product describes the data contained on the tape. This is followed by a series of Daily HIF data Sets, one for each day of the month. Each day's HIF is contained within one file.

The HIF has a logical record length of 720 bytes and a physical block size of 25,920 bytes.

9.7.3.4 Record Layouts

The following pages describe the layout of each record type unique to the Historical Instrument File. Other record types are described in Sections 9.7.4 ( OOPS Standard Header Record) and 9.7.1.4 (1b Data Records). Individual data items are described in the Data Dictionary (Section 9.7.5).

Table 9.7.3.4-1 contains a list of each record type found in the Historical Instrument File.

Table 9.7.3.4-1. Historical Instrument File Record IDs.
Record ID Record Description
Headers
241 OOPS Standard Header Record I
242 OOPS Standard Header Record II
551 Instrument Characterization Header Record
Directories
510 Instrument Calibration and Albedo Correction Directory Record
512 Daily Historical Instrument File Directory
Instrument Data
525 Prelaunch Calibration Data Record
565 Baseline (Day 1) Solar Flux Data Record
567 Offset Data Record
571 Wavelength Calibration Data Record
575 Interrange Ratios Data Record
577 Diffuser Degradation Data Record
581 Discrete Preliminary Irradiance Data Record
585 Albedo Correction Factor Data Record
587 Current Albedo Correction Data Record
591 Interrange Ratios Statistical Record
593 Preliminary Irradiance Statistical Record
661 Discrete Mode Data Record

Table 9.7.3.4-2. Daily Historical Instrument File Directory Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description

1

Record ID  
2 Processing Year Processing Day
3 Record Number of Instrument Calibration and Albedo Correction Directory
4 Record Number of 1st Instrument Characterization Header Record in IRR segment
5 Number of Instrument Characterization Header records in IRR segment
6-7 Same as Words 4-5 but for Electronic Calibration Data Segment
8-9 Same as Words 4-5 but for Wavelength Calibration Data Segment
10-11 Same as Words 4-5 but for Diffuser Degradation Data Segment
12-13 Same as words 4-5 but for Preliminary Irradiance Segment
14-15 Same as words 4-5 but for Albedo Correction Factor Segment
16-180 Spare

Table 9.7.3.4-3. Instrument Calibration Albedo Correction Directory Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description
1 Record ID
2 Record number of prelaunch calibration data record
3 Record number of Day 1 solar flux data record
4 Record number of interrange ratios data record
5 Record number of albedo correction factor data record
6-180 Spare

Table 9.7.3.4-4. Instrument Characterization Header Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description

1

Record ID
2-15 Same as 1b SBUV/2 Orbital Header Record
16 Number of Data Records in Section (See Table 9.7.3.2-1)
17-180 Spare

Table 9.7.3.4-5. Offset Data Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description
1 Record ID
2 Offset Source Indicator
3 Year of Offsets Day of Offsets
4 Offset for Discrete Channel 1, PMT Range 1
5-15 Same as Word 4, but for Channels 2-12
16-27 Same as Words 4-15, but for Range 2
28-39 Same as Words 4-15, but for Range 3
40-42 Average Offset over Wavelength for 3 Gain Ranges
43-180 Spare

Table 9.7.3.4-6. Earth View Interrange Ratios Statistical Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description

1

Record ID
2 Average IRR21 for Discrete Channel 1
3-13 Same as Word 2, but for Channels 2-12
14-25 Same as Words 2-13, but for IRR32
26 Standard Deviation of IRR21 for Discrete Channel 1
27-37 Same as Word 26, but for Channels 2-12
38-49 Same as Words 26-37, but for IRR32
50 Minimum Value of IRR21 for Discrete Channel 1
51-61 Same as Word 50, but for Channels 2-12
62-73 Same as Words 50-61, but for IRR32
74 Maximum Value of IRR21 for Discrete Channel 1
75-85 Same as Word 74, but for Channels 2-12
86-97 Same as Words 74-85, but for IRR32
98 Number of Samples of IRR21 for Discrete Channel 1
99-109 Same as Word 98, but for Channel 2-12
110-121 Same as Words 98-109, but for IRR32
122 Source indicator
123 Lower limit of acceptable counts in least sensitive range
124 Upper limit of acceptable counts in least sensitive range
125-180 Spares

Table 9.7.3.4-7. Wavelength Calibration Data Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description

1

Record ID
2-133 Same as words 2-133 of Discrete Data Record
134 Peak wavelength
135-180 Same as words 135-180 of Discrete Data Record

Table 9.7.3.4-8. Diffuser Degradation Data Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description

1

Record ID
2 Number of Hg Lines
3 Source indicator
4 Spare
5 Start of window End of window
6 Unsmoothed Diffuser Degradation of 1st Hg Line
7-28 Same as words 5-6, but for 2nd through 12th Hg Line
29-180 Spare

Table 9.7.3.4-9. Preliminary Irradiance Statistical Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description

1

Record ID
2 Average Preliminary Irradiance for Discrete Channel 1
3-13 Same as Word 2, but for Channels 2-12
14 Same as Word 2, but for CCR
15 Standard Deviation of Preliminary Irradiance for Discrete Channel 1
16-26 Same as Word 15, but for Channels 2-12
27 Same as Word 15, but for CCR
28 Minimum Value of Preliminary Irradiance for Discrete Channel 1
29-39 Same as Word 28, but for Channels 2-12
40 Same as Word 28, but for CCR
41 Maximum Value of Preliminary Irradiance for Discrete Channel 1
42-52 Same as Word 41, but for Channels 2-12
53 Same as Word 41, but for CCR
54 Number of Samples in Preliminary Irradiance Statistics for Discrete Channel 1
55-65 Same as Word 54, but for Channels 2-12
66 Same as Word 54, but for CCR
67-90 Average Solar View Interrange Ratios
91-114 Standard Deviations of Solar View Interrange Ratios
115-130 Number of Samples for Solar View Interrange Rations
131-180 Spare

Table 9.7.3.4-10. Discrete Preliminary Irradiance Data Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description

1

Record ID
2-40 Same as Discrete Data Record
41 Preliminary Irradiance from CCR
42 Preliminary Irradiance from Recommended Monochromator Range
43 Recommended Monochromator Range Data Recommended monochromator Range ID
44-180 Same as words 44-180 of Discrete Data Record

Table 9.7.3.4-11. Current Albedo Correction Data Record.
  Byte 1 Byte 2 Byte 3 Byte 4
Word Description

1

Record ID
2 Year of Albedo Correction Factor (ACF)
3 Day of ACF
4 Diffuser Degradation for Discrete Channel 1
5-15 Same as Word 3 but for Channels 2-12
16 Same as Word 3 but for CCR
17 ACF for Discrete Channel 1
18-28 Same as Word 16, but for Channels 2-12
29 Same as Word 16, but for CCR
30 Source Indicator
31-180 Spare


Previous Section Top of Page Next Section