This website works best with a newer web browser such as Chrome, Firefox, Safari or Microsoft Edge. Internet Explorer is not supported by this website.

Forecasting storms with AI

Severe weather season is underway across the southern U.S. NOAA and CIMSS are using satellite, radar, and lightning observations of thunderstorms to develop and evaluate artificial intelligence (AI) tools that forecast and diagnose convection.The NOAA/CIMSS ProbSevere portfolio has several such tools to help forecasters keep tabs on storms. LightningCastProbSevere LightningCast... Read More

Severe weather season is underway across the southern U.S. NOAA and CIMSS are using satellite, radar, and lightning observations of thunderstorms to develop and evaluate artificial intelligence (AI) tools that forecast and diagnose convection.The NOAA/CIMSS ProbSevere portfolio has several such tools to help forecasters keep tabs on storms.

LightningCast


ProbSevere LightningCast is a model that uses images of geostationary ABI data from GOES-16 or GOES-17 to predict where lightning will strike (as observed by the GLM) out to 60 minutes. We’ve found that the product frequently provides 15-30 minutes of lead-time to lightning initiation, measured from the 30-40% probability range (the most skillful range). LightningCast will be evaluated at the 2022 NOAA Hazardous Weather Testbed and at certain offices within the NWS. LightningCast may be able to one day aid forecasters in providing decision support services and general convective initiation situational awareness. Below is a movie of LightningCast output (contours) overlaid on the GOES-16 daytime cloud phase distinction RGB and GLM flash-extent density, for the developing severe storms in Texas on March 21st.


IntenseStormNet

Another image-based AI model within ProbSevere is called IntenseStormNet, which seeks to identify the most intense regions of thunderstorms. It uses images of ABI and GLM data as predictors to probabilistically diagnose storm intensity from a geostationary perspective. Its goal is to identify intense parts of storms as humans do: holistically; by picking up on the spatial and multispectral features that imagery captures, such as overshooting tops, cold-U/AACP, cloud-top texture patterns, and stark cloud edges. In a paper published in 2020, we found that high probabilities from IntenseStormNet are frequently correlated with severe weather reports. Below shows IntenseStormNet output (contours) for some of the storms over Texas on March 21st, most of which spawned hail, damaging winds, and several tornadoes. IntenseStormNet contours can also be tracked over time, providing a novel way to investigate convective properties of storms.


ProbSevere v3

IntenseStormNet output is also being used as a predictor within the experimental ProbSevere v3, which uses satellite, radar, lightning, and NWP data, and machine-learning (ML) models to forecast the probabilities of hail, severe winds, and tornadoes in the next 60 minutes. While ProbSevere v2 is operational at NOAA’s Centers for Environmental Prediction, ProbSevere v3 is being evaluated by NWS forecasters at the 2022 Hazardous Weather Testbed. An analysis of thousands of storms from 2021 showed that additional predictors and the more sophisticated ML models in v3 improve upon v2 performance. ProbSevere uses multi-sensor storm tracking and feature extraction to predict probabilities of severe weather across the U.S. Below are several animations of ProbSevere v3 output in Texas on March 21st.

ProbSevere v3 output (contours), MRMS composite reflectivity, and NWS severe weather warnings for storms in northern Texas on March 21st.
ProbSevere v3 output (contours), MRMS composite reflectivity, and NWS severe weather warnings for storms in central Texas on March 21st.

View only this post Read Less

Using McIDAS-V to display GOES-16 FDCA fields

The image below shows GOES-16 Fire Power, a Fire Detection/Characterization Algorithm (FDCA) output field (along with Fire Temperature and Fire Area), on a day when strong southerly winds helped support multiple fires over Texas (as shown in this animation, from this blog post). If you do not have access to AWIPS, as below... Read More

The image below shows GOES-16 Fire Power, a Fire Detection/Characterization Algorithm (FDCA) output field (along with Fire Temperature and Fire Area), on a day when strong southerly winds helped support multiple fires over Texas (as shown in this animation, from this blog post). If you do not have access to AWIPS, as below (or in the linked-to animation), are there other ways to access and display FDCA output? This blog post shows how to do that with McIDAS-V.

GOES-16 Fire Power, 2101 UTC on 20 March 2022 (click to enlarge)

Where can you get the FDCA data to display? The NOAA CLASS data respository is one place. The toggle below outlines the products to choose in the drop-down menu (“GOES-R Series ABI Products (GRABIPRD) partially restricted L1b and L2+ Data Products”) near the top of the CLASS home page (then click on the >>GO), and then shows how to select the data wanted. In the example below, I’ve chosen the ABI L2+ GOES-16 CONUS files of Fire/Hot Spot Characterization on 20 March 2022 between 21:00 and 21:04. After making those selections, click on ‘Search’ and then order. When the files are queued up for retrieval, you’ll receive an email with instructions.

NOAA CLASS website, and GOES-R L2 Products data selection (Click to enlarge)

You can also access GOES-R data through this website below hosted at the University of Utah. (Kudos to Brian Blaylock, its developer!) Note in the animation below how you choose the satellite, the product and the time, and then receive a list of downloadable files.

Amazon Web Services portal showing data selection and files retrieved (Click to enlarge)

You can start up McIDAS-V to view the data once you have downloaded to your machine the data file:

OR_ABI-L2-FDCC-M6_G16_s20220792101168_e20220792103541_c20220792104155.nc

FDCC in the filename signifies Fire Detection Characterization in the CONUS domain, created with Mode 6 scanning (M6) and GOES-16 data (G16). The data starts at 21:01:16.8 on 20 March (Julian Day 79) in 2022, i.e., 20220792101168 and ends at 21:03:54.1 on the same day. It was created at 21:04:15.5. Once you start McIDAS-V, you must input the data, via the Data Sources tab within the Data Explorer. The satellite data we’re using are gridded data, and they’re local. Select the file needed for display and click ‘Add Source’. When you do that, you’ll see a different window (‘Field Selector’) brought to the front.

McIDAS-V Data Explorer (Click to enlarge)
Steps under ‘Field Selector’ in the Data Explorer to find the data to display (Click to enlarge)

Note in this example that 5 different fields are present in the file: Fire + Hot Spot Characterization Fire Area, Fire Temperatures, Fire Mask, Fire Radiative Power and Data Quality Flags. In this example, I’ve selected ‘Data Quality Flags’ — to be presented as ‘Value Plots’; those are shown below in a region zoomed in over Texas and annotated.

FDCA Data Quality Flags, 2101 UTC, 20 March 2022 (Click to enlarge)

Rather than Data Quality Flags, one can show ‘Fire Mask’ — these data values are available in AWIPS files, but aren’t generally shown. So, I recreated the ‘Value Plots’ but selected ‘Fire Mask’ rather than ‘data quality Flags’; Next, I created a ‘Color-Shaded Plan View’ (the Data Explorer for that is shown here, created with ‘Match Display Region’ chosen). The animation below steps through the plotted values, the color-shaded plan view with default enhancement, and the color-shaded plan view with a McIDAS Enhancement Table appropriate to the Fire Mask (clouds, for example, are grey, and fires stand out against the background). (This pdf describes what the file mask values mean).

Plotted FDCA Fire Mask values, and color-enhanced gridded values, 2101 UTC on 20 March 2022 (click to enlarge)

This toggle compares Fire Mask, and Fire Power. A zoom in on Fire Power to north Texas, below, shows the same data as the AWIPS screen grab at the top of this blog post. They are nearly identical.

GOES-16 FDCA Fire Power, 2101 UTC on 20 March 2022 (click to enlarge)

Use McIDAS-V to display Level 2 products if it is difficult to find them online.

View only this post Read Less

The coming geo2grid update will include level 2 product support

As noted here, an updated version of geo2grid is being prepared at CIMSS. As part of that upgrade, support for some level 2 products will be included. For example, the image above — of cloud-top height — was created using the following set of geo2grid (a beta version that this... Read More

Cloud-top Height, 1510 UTC on 21 March 2022 (click to enlarge)

As noted here, an updated version of geo2grid is being prepared at CIMSS. As part of that upgrade, support for some level 2 products will be included. For example, the image above — of cloud-top height — was created using the following set of geo2grid (a beta version that this blogger is testing) calls.

./geo2grid.sh -r abi_l2_nc -w geotiff -p HT -g L2Fields --grid-configs $GEO2GRID_HOME/L2Fields.yaml --method nearest --radius-of-influence 40000 -f /arcdata/goes_restricted/grb/goes16/2022/2022_03_21_080/abi/L2/ACHAC/*s20220801501*.nc
../add_coastlines.sh --add-coastlines --coastlines-resolution h --coastlines-level=5 --coastlines-outline='blue' --add-grid --grid-text-size 0 --grid-D 5.0 5.0 --grid-d 5.0 5.0 --add-colorbar --colorbar-align right --colorbar-text-size 8 --colorbar-vertical --colorbar-no-ticks --add-borders GOES-16_ABI_HT_20220321_150116_L2Fields.tif
convert GOES-16_ABI_HT_20220321_150116_L2Fields.png -gravity Southwest -fill black -pointsize 16 -annotate +12+36 "GOES-16 Cloud Top Height 1501 UTC 21 March 2022" GOES-16_ABI_HT_20220321_150116_L2Fields1.png
convert GOES-16_ABI_HT_20220321_150116_L2Fields1.png ~scottl/smalllogo.png -gravity northwest -geometry +12+8 -composite GOES-16_ABI_HT_20220321_150116_L2Fields2.png

How does the image above compare to Level 2 product fields that can be found elsewhere? This website contains a link to a RealEarth instance that includes mappings of Full-Disk Cloud Mask, Cloud Top Pressure, Cloud top Phase, and Cloud Optical Depth. A portion of the Full-Disk Cloud Top Pressure is shown below (from 1500 UTC). Similar features are apparent in fields above and below.

GOES-16 Cloud Top Pressure, 1500 UTC on 21 March 2022 (click to enlarge)

Level 2 Products associated with Cloud-top properties are also available at the CIRA slider, including Cloud-top Height, shown below from 1501 UTC. Other GOES-R Level 2 products available there include Cloud Optical Depth, Cloud Mask, Cloud Phase and Cloud Effective Particle Size.

GOES-16 Cloud-top Height, 1501 UTC on 21 March 2022 (click to enlarge)

View only this post Read Less

Fall to Spring Equinox 2022

By animating daily NOAA GOES-17 ABI Full Disk true color imagery, how the Earth is illuminated over time can be seen. For example, the minimum in incoming solar radiation in the Northern Hemisphere associated with the Winter Solstice. For details, see “What is a Solstice?” by SciJinks. Or this NOAA https://www.noaa.gov/education/news/share-your-solstice-sunset-with-noaa-education post. 14 UTC... Read More

By animating daily NOAA GOES-17 ABI Full Disk true color imagery, how the Earth is illuminated over time can be seen. For example, the minimum in incoming solar radiation in the Northern Hemisphere associated with the Winter Solstice. For details, see “What is a Solstice?” by SciJinks. Or this NOAA https://www.noaa.gov/education/news/share-your-solstice-sunset-with-noaa-education post.

14 UTC loops from the fall Equinox of 2021 to the Spring Equinox of 2022. Also as an animated gif. These posted GOES ABI Full Disk imagery are only showing a small number of the pixels, for a fuller resolution image at one time (20-March-2022).

GOES-17 ABI true color images at 14 UTC each day from the 2021 Fall Equinox to the 2022 Spring Equinox.

The 16 bands of ABI from GOES-West and GOES-East from UW/CIMSS.

Interactive web page

The interactive web page that allows one to annotate images, such as drawing lines. (Click on the image to go to the webapp.)
An annotated image, with text and a line. (Click on the image to go to the webapp.)

An interactive web page with almost a years worth of GOES ABI Full Disk visible images at 11 UTC. The beginning date is the (northern hemisphere) summer solstice in 2021 and the end date is the winter solstice in 2021. A user can play the animation, as well as annotate the images. For example, draw lines along the terminator for different times of the year. One example might be to compare a solstice to an equinox. Can you estimate the day of the summery equinox? H/T Tom Whittaker, SSEC, for the webapp. Note that the app allows one to save an mp4 animation.

Screen shot of the webapp where one can explore the effect of the angle of incidence on sun’s energy. (Click on the image to go to the webapp.)
Explore the changing seasons on Earth by relating the orbit, rotation and solar insolation with this webapp by T. Whittaker. (Click on the image to go to the webapp.)

H/T

These images were made using NOAA data with geo2grid software, from UW-Madison, SSEC.

View only this post Read Less