{"id":59235,"date":"2024-05-14T21:34:48","date_gmt":"2024-05-14T21:34:48","guid":{"rendered":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/?p=59235"},"modified":"2024-05-15T15:46:23","modified_gmt":"2024-05-15T15:46:23","slug":"nucaps-edr-files-in-the-cloud","status":"publish","type":"post","link":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/archives\/59235","title":{"rendered":"NUCAPS EDR files in the cloud"},"content":{"rendered":"\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS-EDR_v3r1_j01_s202405141725069_e202405141725367_c202405141802540.nc_.NUCAPS_temp_706mb.png\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS-EDR_v3r1_j01_s202405141725069_e202405141725367_c202405141802540.nc_.NUCAPS_temp_706mb-1024x1024.png\" alt=\"\" class=\"wp-image-59240\" srcset=\"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS-EDR_v3r1_j01_s202405141725069_e202405141725367_c202405141802540.nc_.NUCAPS_temp_706mb-1024x1024.png 1024w, https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS-EDR_v3r1_j01_s202405141725069_e202405141725367_c202405141802540.nc_.NUCAPS_temp_706mb-300x300.png 300w, https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS-EDR_v3r1_j01_s202405141725069_e202405141725367_c202405141802540.nc_.NUCAPS_temp_706mb-150x150.png 150w, https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS-EDR_v3r1_j01_s202405141725069_e202405141725367_c202405141802540.nc_.NUCAPS_temp_706mb-768x768.png 768w, https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS-EDR_v3r1_j01_s202405141725069_e202405141725367_c202405141802540.nc_.NUCAPS_temp_706mb.png 1500w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><figcaption class=\"wp-element-caption\">NUCAPS Temperature estimates, 706 mb, 1725 UTC on 14 May 2024 (Click to enlarge)<\/figcaption><\/figure>\n\n\n\n<p>NUCAPS EDRs (Environmental Data Records) are now populating space in the cloud, such as at this Amazon webservices (AWS) link <a href=\"https:\/\/noaa-nesdis-n20-pds.s3.amazonaws.com\/index.html\">https:\/\/noaa-nesdis-n20-pds.s3.amazonaws.com\/index.html<\/a>.  This is part of the <a href=\"https:\/\/www.noaa.gov\/information-technology\/open-data-dissemination\">NODD<\/a> (NOAA Open-Data Dessemination) project.   At that AWS link you will see a &#8216;NUCAPS-EDR&#8217; directory, and dropping down through year\/month\/day selections, a list of filenames appears with names such as: <a href=\"https:\/\/noaa-nesdis-n20-pds.s3.amazonaws.com\/NUCAPS-EDR\/2024\/05\/14\/NUCAPS-EDR_v3r1_j01_s202405141514589_e202405141515287_c202405141606240.nc\"><code>NUCAPS-EDR_v3r1_j01_s202405141514589_e202405141515287_c202405141606240.nc<\/code><\/a> ; &#8216;j01&#8217; identifies the satellite as NOAA-20; data in this file starts 15:14:58.9 on 14 May 2024, ends at 15:15:28.7 on 14 May 2024, and was created on 16:06:24.0 on 14 May 2024. The file listing shown below as a screen-capture shows data from 1725 to 1732 UTC on 14 May 2024.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"619\" src=\"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS_EDRList_14May2024-1024x619.png\" alt=\"\" class=\"wp-image-59239\" srcset=\"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS_EDRList_14May2024-1024x619.png 1024w, https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS_EDRList_14May2024-300x181.png 300w, https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS_EDRList_14May2024-768x464.png 768w, https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/NUCAPS_EDRList_14May2024.png 1303w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">NUCAPS EDR data listing from Amazon Webservices (Click to enlarge)<\/figcaption><\/figure>\n\n\n\n<p>These data can be displayed most easily by knowing when NOAA-20 overflew a region, and <a href=\"https:\/\/www.ssec.wisc.edu\/datacenter\/polar_orbit_tracks\/#satellite:NOAA20;region:Global;\">this website<\/a> helps with that.  The GOES-East projection showing NOAA-20 orbits on 14 May is shown below.  Focus on the ascending pass off the East Coast of the United States, from 17:25 to 17:32 or so.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-content\/uploads\/sites\/5\/2024\/05\/N20_14May2024_GOESEAST.gif\" alt=\"\" class=\"wp-image-59236\"\/><figcaption class=\"wp-element-caption\">NOAA-20 orbits, 14 May 2024 (click to enlarge)<\/figcaption><\/figure>\n\n\n\n<p>After downloading the <a href=\"https:\/\/cimss.ssec.wisc.edu\/cspp\/sounder_ql_v1.3.shtml\">Sounder QuickLooks software<\/a> (<a href=\"https:\/\/cimss.ssec.wisc.edu\/cspp\/\">from CSPP<\/a>), 7 commands created the mapping of temperature shown up top. First, the .qz file that includes the software packages was expanded and I changed locations to the created directory, making that the home directory with the export command. A shell script within the directory is then sourced to set up environments (one result of this shell script is that the $CSPP_SOUNDER_QL_HOME\/bin directory is added to a user&#8217;s $PATH). Then I changed to the bin directory. The script &#8216;getall&#8217; retrieves the netcdf files from the cloud &#8212; it&#8217;s a series of unix wget commands, i.e., &#8220;<code>wget https:\/\/noaa-nesdis-n20-pds.s3.amazonaws.com\/NUCAPS-EDR\/2024\/05\/14\/NUCAPS-EDR_v3r1_j01_s202405141725389_e202405141726087_c202405141803060.nc\".<\/code> The variable &#8216;files&#8217; matches all of the netcdf files that were downloaded. Finally, the 700-mb temperature field is created, as shown above.  (Note:  because the cspp_sounder_ql_env shell script puts the bin directory in the user&#8217;s $PATH, the ql_level2_image shell script below could be invoked from any directory.  In other words, there&#8217;s no need to put the netcdf files in the bin directory!)<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>tar -xvf cspp-sounder-ql-1.3.tar.gz \ncd cspp-sounder-ql-1.3\nexport CSPP_SOUNDER_QL_HOME=$PWD\nsource $CSPP_SOUNDER_QL_HOME\/cspp_sounder_ql_env.sh\ncd bin\ngetall\nfiles=$PWD\/NUCAPS-EDR_v3r1_j01_s2024051417*\n.\/ql_level2_image.sh $files NUCAPS --dset temp --pressure 700<\/code><\/pre>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p>Past blog post entries on Sounder QuickLooks software are <a href=\"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/archives\/47696\">here<\/a> and <a href=\"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/archives\/37888\">here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>NUCAPS EDRs (Environmental Data Records) are now populating space in the cloud, such as at this Amazon webservices (AWS) link https:\/\/noaa-nesdis-n20-pds.s3.amazonaws.com\/index.html. This is part of the NODD (NOAA Open-Data Dessemination) project. At that AWS link you will see a &#8216;NUCAPS-EDR&#8217; directory, and dropping down through year\/month\/day selections, a list of filenames appears with names such [&hellip;]<\/p>\n","protected":false},"author":19,"featured_media":59240,"comment_status":"closed","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[78,83,109,39],"tags":[],"class_list":["post-59235","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-noaa-20","category-nucaps","category-software","category-training"],"acf":[],"_links":{"self":[{"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/posts\/59235","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/users\/19"}],"replies":[{"embeddable":true,"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/comments?post=59235"}],"version-history":[{"count":9,"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/posts\/59235\/revisions"}],"predecessor-version":[{"id":59251,"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/posts\/59235\/revisions\/59251"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/media\/59240"}],"wp:attachment":[{"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/media?parent=59235"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/categories?post=59235"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cimss.ssec.wisc.edu\/satellite-blog\/wp-json\/wp\/v2\/tags?post=59235"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}