Test Cases

[crepad –]

Dear Nigel,

My question is related with test cases. I downloaded noaa19_test.tgz and execute noaa19_run.sh with RUN_MAIA=yes. After execution, I compare the created files inside level1 directory with the ones in level1_atovs_withmaia directory using noaa19_compare.sh script. The numbers are very similar, but how can I know if the comparison is completely ok?
Sorry for bothering you again.
Thank you so much for your support.
Best regards,
Angel Garcia

For example, find below the result file “compare_hrsn.l1d.log”

Input A from: level1/hrsn.l1d
Input B from: level1_atovs_withmaia/hrsn.l1d

HEADER RECORD
=============

1 542327117 541936469 Site ID (ASCII)
2 542327117 541936469 Site ID (ASCII)

DATA RECORDS
============

Data ranges:
============

minA maxA | minB maxB | Description
————————|———————–|——————————–
1 29594 1 29594 Miscellaneous…
52279254 53060054 52279254 53060054 Scan line UTC time of day (ms)
0 0 0 0 Quality indicator
0 0 0 0 Scan line quality flags
-422575 754383 -422575 754383 Lat/Lon (degree*10000)
0 3078 0 3078 Surface height (m)
0 2 0 2 Surface type (0/1/2)
102 27310 102 27310 Scan angles (degree*100)
8621 8636 8621 8636 Sat altitude (km*10)
21468 33766 21468 33766 Hirs BT (K*100)
447 5969 447 5969 Hirs ch 20 radiance (*100)
14717 30420 14717 30420 Amsua BT (K*100)
20020 30412 20020 30412 Amsub BT (K*100)
0 100 0 100 AVHRR clear fraction (%)
-999900 30330 -999900 30330 Surface temperature (K*100)
27394 32022 27394 32022 Clim. temperature or t2m (K*100)
25399 33675 25399 33675 AVHRR ch 3 (% / K*100)
21626 32718 21626 32718 AVHRR ch 4/5 (K*100)
0 100 0 100 Percentage of black body (%)
21673 30118 21673 30118 CTT (K*100)
1 1687 1 1687 CTT std (K*100)
25805 32718 25805 32718 AVHRR clear ch 4/5 (K*100)
2 2990 2 2990 AVHRR std ch 4 (K*100)
3 1116 3 1116 AVHRR std clear ch 4 (K*100)
0 1 0 1 IFOV HIRS quality control
-2147483648 264241158 -2147483648 264241158 PP quality control
1 9 1 9 PP surface type (1-9)
0 7290 0 7290 PP cost function
-271 9160 -271 9160 PP scattering index
0 99 0 99 PP precipitation probability (%)
999999999 -999999999 999999999 -999999999 PP spare
999999999 -999999999 999999999 -999999999 Filler

Total IFOV count: 6888

Data differences (long format):
===============================

Data in both | Present | # of different | Max difference | Description
Miss Present | onlyA onlyB | dif>0 diff>thres.| valA valB diff |
————–|————–|——————–|——————————–|——————————-
492 861 0 0 0 0 1 0 Miscellaneous…
0 123 0 0 0 0 1 0 Scan line UTC time of day (ms)
0 123 0 0 0 0 1 0 Quality indicator
0 123 0 0 0 0 1 0 Scan line quality flags
0 13776 0 0 0 0 1 0 Lat/Lon (degree*10000)
0 6888 0 0 0 0 1 0 Surface height (m)
0 6888 0 0 0 0 1 0 Surface type (0/1/2)
0 27552 0 0 10 10 1 24554 24555 1 Scan angles (degree*100)
0 123 0 0 0 0 1 0 Sat altitude (km*10)
6384 124488 0 0 0 0 5 0 Hirs BT (K*100)
336 6552 0 0 0 0 5 0 Hirs ch 20 radiance (*100)
0 103320 0 0 0 0 5 0 Amsua BT (K*100)
430 34010 0 0 7 0 5 26857 26856 1 Amsub BT (K*100)
0 6888 0 0 2 2 1 24 25 1 AVHRR clear fraction (%)
5919 969 0 0 1 0 5 29965 29964 1 Surface temperature (K*100)
0 6888 0 0 3 3 1 30204 30203 1 Clim. temperature or t2m (K*100)
0 6888 0 0 18 4 5 28304 28295 9 AVHRR ch 3 (% / K*100)
0 13776 0 0 33 4 5 26386 26379 7 AVHRR ch 4/5 (K*100)
0 6888 0 0 1 0 2 49 48 1 Percentage of black body (%)
3360 3528 0 0 5 2 5 24432 24389 43 CTT (K*100)
3522 3366 0 0 4 1 5 792 768 24 CTT std (K*100)
7078 6698 0 0 6 1 5 29878 29883 5 AVHRR clear ch 4/5 (K*100)
0 6888 0 0 13 0 5 455 452 3 AVHRR std ch 4 (K*100)
3713 3175 0 0 2 1 5 95 88 7 AVHRR std clear ch 4 (K*100)
0 6888 0 0 0 0 1 0 IFOV HIRS quality control
0 6888 0 0 0 0 1 0 PP quality control
0 6888 0 0 0 0 1 0 PP surface type (1-9)
0 6888 0 0 16 0 50 325 323 2 PP cost function
0 6888 0 0 0 0 3 0 PP scattering index
0 6888 0 0 0 0 1 0 PP precipitation probability (%)
13776 0 0 0 0 0 1 -999999 PP spare
10947 0 0 0 0 0 1 -999999 Filler

Data differences (short format):
================================

# of data in | # diff. | Max difference | Description
onlyA onlyB | dif>0 | valA valB diff |
—————|———|——————————–|——————————-
0 0 0 0 Miscellaneous…
0 0 0 0 Scan line UTC time of day (ms)
0 0 0 0 Quality indicator
0 0 0 0 Scan line quality flags
0 0 0 0 Lat/Lon (degree*10000)
0 0 0 0 Surface height (m)
0 0 0 0 Surface type (0/1/2)
0 0 10 24554 24555 1 Scan angles (degree*100)
0 0 0 0 Sat altitude (km*10)
0 0 0 0 Hirs BT (K*100)
0 0 0 0 Hirs ch 20 radiance (*100)
0 0 0 0 Amsua BT (K*100)
0 0 7 26857 26856 1 Amsub BT (K*100)
0 0 2 24 25 1 AVHRR clear fraction (%)
0 0 1 29965 29964 1 Surface temperature (K*100)
0 0 3 30204 30203 1 Clim. temperature or t2m (K*100)
0 0 18 28304 28295 9 AVHRR ch 3 (% / K*100)
0 0 33 26386 26379 7 AVHRR ch 4/5 (K*100)
0 0 1 49 48 1 Percentage of black body (%)
0 0 5 24432 24389 43 CTT (K*100)
0 0 4 792 768 24 CTT std (K*100)
0 0 6 29878 29883 5 AVHRR clear ch 4/5 (K*100)
0 0 13 455 452 3 AVHRR std ch 4 (K*100)
0 0 2 95 88 7 AVHRR std clear ch 4 (K*100)
0 0 0 0 IFOV HIRS quality control
0 0 0 0 PP quality control
0 0 0 0 PP surface type (1-9)
0 0 16 325 323 2 PP cost function
0 0 0 0 PP scattering index
0 0 0 0 PP precipitation probability (%)
0 0 0 -999999 PP spare
0 0 0 -999999 Filler

[Nigel Atkinson]

Hello,

The most useful parts of the output are the tables of differences. Best to display them in plain text. (This web site has made them difficult to read). In your output I see, for a small number of samples:

Differences in brightness temperature of order 0.01K
Scan angle 0.01 degree
Mapped AVHRR up to 0.09K
Derived quantities – cloud top temperature – up to 0.43K

These differences are all perfectly normal. The maximum difference in CTT tends to be larger because it involves threshold tests. Different compilers, operating systems and hardware give slightly different numerical rounding, and since AAPP level 1b/1c files only have limited precision (e.g. 0.01K in BT) this explains the differences.

Nigel

[Author]

Posts