VIIRS Imagery and Products in D-2DInstructions for AWIPS InstallationSpace Science and Engineering Center
|
 |
| Project members: Scott Bachmeier, Jordan Gerth, Kathy Strabala, William Straka III | |
Announcements
The 0.865 µm I2 band configuration is included in version 1.1.
This data is provided as part of the GOES-R Proving Ground. For assistance and suggestions on obtaining and using the data, please contact Jordan Gerth.
Acquiring Data at a NWSFO
This page contains information for obtaining data from the NOAA satellites equipped with a Visible Infrared Imaging Radiometer Suite (VIIRS) for display in AWIPS.
For VIIRS imagery and products
Data is currently available to Weather Forecast Offices in Central Region, Eastern Region, Pacific Region, Southern Region, Western Region, and Alaska Region. Data is transmitted in compressed netCDF format on the EXP feed of the Local Data Manager (LDM). This is not an operational dataset, so unplanned data errors and outages may result. Contact Jordan Gerth once you are receiving data so we can add your office to the e-mail announcement list. We value any feedback.
The Space Science and Engineering Center is not continuously staffed. Consequently, data outages and processing issues may result. The products should be considered non-operational. Required LDAD/Processing Configurations
Perform the following actions to configure your Local Data Acquisition and Dissemination (LDAD) server.
As ldad on ls2:
- Create /data/ldad/VIIRS and give it user/group writable permissions
In /usr/local/ldm/etc as ldm on ls2:
- Modify ldmd.conf (position sensitive; change ldm.crh to your regional LDM server)
- For WFOs in Alaska Region, change "ECONUS" to "AK" and "SSEC" to "GINA".
- For WFOs in Pacific Region, change "ECONUS" to "HI".
- For CONUS WFOs, execute "cat $FXA_HOME/data/localizationDataSets/$FXA_LOCAL_SITE/whichSat.txt" as fxa on dx3:
- If the output is "WEST", change "ECONUS" to "WCONUS" (West CONUS WFOs).
- Otherwise, leave the ldmd.conf as-is with "ECONUS" (East CONUS WFOs).
- Append to pqact.conf
- For WFOs in Alaska Region, change "SSEC" to "GINA".
- Copy ldmd.conf and pqact.conf to ls3 with scp
- Execute "ldmadmin restart" to restart the LDM service
- With "ldmadmin watch -f EXP", watch the LDM queue up to 12 hours for VIIRS data (may take longer)
Caution: The LDAD is not used to process VIIRS files; there is no preprocess script and subsequently there is no entry in the LDADinfo.txt file. The VIIRS files are filed in their LDM state (compressed) on ls1, but moved to px1 for processing and filing. This is done by setting and running a cron task at least once hourly, which will be done in the following steps. It is important to assure this cron task exists and is executing properly or VIIRS products may quickly overwhelm ls1. The process script writes to a file in the log directory /data/logs/fxa.
As fxa on px1:
- Create the directory /data/local/localapps/VIIRS
- Copy processVIIRS.pl into the new directory and assign executable permissions
As root on px1:
- Add a cron task to /etc/cron.d/SITEpx1cron and /etc/ha.d/cron.d/SITEpx1cron
As root on px2:
- Add the same cron task to /etc/ha.d/cron.d/SITEpx1cron in case of a failover
Your operations should roughly follow this outline.
su - fxa cd /data/local/localapps # Choose the directory you wish mkdir VIIRS mv /tmp/processVIIRS.pl.gz VIIRS cd VIIRS # Move to that directory gunzip processVIIRS.pl.gz chmod 775 processVIIRS.pl su - root vi /etc/cron.d/SITEpx1cron # Make cron change in two files vi /etc/ha.d/cron.d/SITEpx1cron # After the first file complete ssh px2 vi /etc/ha.d/cron.d/SITEpx1cron # In case px1 fails <Page Up> # vi command to move to bottom of file a # vi command to append <Enter> # vi command to add blank line # Process VIIRS products from CIMSS/SSEC 5,20,35,50 * * * * fxa csh -c '/data/local/localapps/VIIRS/processVIIRS.pl >& /dev/null' <Esc> # vi command to stop append mode :wq! # vi command to write and quitA zip file of these is available.
Required AWIPS Customizations
Perform the following actions to configure your Advanced Weather Interactive Processing System (AWIPS) workstations/servers.
For east CONUS WFOs, in $FXA_CUSTOM_FILES as fxa (should be mounted on any workstation/server):
- Append to localDataKeys.txt to map product keys to directory locations
- Append to localDepictKeys.txt and modify the 127x color table keys for visualization
- Append to localImageStyle.txt to provide sampling
- Append to localProductButtons.txt to label the menu items
- Append to localPurgeInfo.txt to keep only recent files
- Append to otherSatMenus.txt or dataMenus.txt (see "Known Pitfalls") for selection
A zip file of these is available.
For west CONUS WFOs, in $FXA_CUSTOM_FILES as fxa (should be mounted on any workstation/server):
- Append to localDataKeys.txt to map product keys to directory locations
- Append to localDepictKeys.txt and modify the 127x color table keys for visualization
- Append to localImageStyle.txt to provide sampling
- Append to localProductButtons.txt to label the menu items
- Append to localPurgeInfo.txt to keep only recent files
- Append to otherSatMenus.txt or dataMenus.txt (see "Known Pitfalls") for selection
A zip file of these is available.
For Alaska Region WFOs, in $FXA_CUSTOM_FILES as fxa (should be mounted on any workstation/server):
- Append to localDataKeys.txt to map product keys to directory locations
- Append to localDepictKeys.txt and modify the 127x color table keys for visualization
- Append to localImageStyle.txt to provide sampling
- Append to localProductButtons.txt to label the menu items
- Append to localPurgeInfo.txt to keep only recent files
- Append to otherSatMenus.txt or dataMenus.txt (see "Known Pitfalls") for selection
A zip file of these is available.
For Pacific Region WFOs, in $FXA_CUSTOM_FILES as fxa (should be mounted on any workstation/server):
- Append to localDataKeys.txt to map product keys to directory locations
- Append to localDepictKeys.txt and modify the 127x color table keys for visualization
- Append to localImageStyle.txt to provide sampling
- Append to localProductButtons.txt to label the menu items
- Append to localPurgeInfo.txt to keep only recent files
- Append to otherSatMenus.txt or dataMenus.txt (see "Known Pitfalls") for selection
A zip file of these is available.
When complete with the changes, run '$FXA_LOCALIZATION_SCRIPTS/mainScript.csh f -tables -dataSups -dirs' on dx3 and dx4, create a directory /data/fxa/sat/SBN/netCDF/LOCAL/VIIRS-temp as fxa with write permissions, then execute '$FXA_LOCALIZATION_SCRIPTS/mainScript.csh f -tables -dataSups' on all lx and na workstations. If you experience a problem displaying the data, you may also need to run each of the mainScript.csh commands with the "-clipSups" argument.
As fxa on dx1 and dx2, perform a '-tables -purge' localization. On dx1, restart the purgeProcess.
As fxa on dx1, restart the notificationServer to complete.
Restart D-2D on the lx/na workstations to access the new products from the satellite menu (or custom menu if dataMenus.txt modified).
Known Pitfalls
- The instructions assume local files in $FXA_CUSTOM_FILES do not have the WFO identifier as the first three characters of the file name (LLL-).
- The satellite menu may be too long. This can be fixed.
If you change LLL-otherSatMenus.txt to LLL-dataMenus.txt in your /data/fxa/customFiles directory, and at the top of that file add a line such as, menu: "Local Sat" you can move all the CIMSS/SSEC products to their own menu between Maps and Help. Then localize with mainScript.csh -tables.If problems arise — You may need to run dos2unix on some scripts and files.
Learn More