youtube-logo 34xtwitter-1-logo 34xgithub-logo 34x

GEONETCast Toolbox version 1.7

Changes

The XML version 1.6 of the GEONETCast Toolbox has been updated with various changes and additions. The most important are:

  • All batch routines have been updated to reflect the changes in GEONETCast.
  • There is a new version of the Data Manager, including the option DOY (Day Of Year).
  • GDAL upgraded to version 1.11
  • Removed INPE GOES-MSG Thermal Composite / SPOT VGT
  • Updated FY from FY2D/2E to FY2E/2F, removed TSG and 120hr products from BBT and OLR, for FY derived PRE (_006 and _024). For high rain rates there is still a mistake in the data source!
  • Added NOAA and METOP A/B AVHRR creation of quicklooks (also for the EARS service): Added NOAA AVHRR in main Menu for AVHRR processing and creation of quicklooks. Added installation instructions for “METOP-A AVHRR quicklook picture” option under menu METOP A/B item.
    • uses xrit2pic:download setup_xrit2pic_cmd.exe from: http://www.alblas.demon.nl/wsat/software/winsoft_msg.html to temporary directory
    • download setup_gtk20dll.exe from: http://www.alblas.demon.nl/wsat/software/winsoft_msg.html to temporary directory
    • download setup_decompr.exe (JPEG and wvt decompression libs ) from: http://www.alblas.demon.nl/wsat/software/winsoft_msg.html to temporary directory
    • install xrit2pic_cmd to the same temp directory, repeat for setup_gtk20dll.exe - setup_decompr.exe and extract to the same directory
    • copy xrit2pic_cmd.exe and 16 dll files to your ilwis directory \Extensions\GEONETCast-Toolbox\util\xrit2pic  

NOTE: Polar orbit satellite tracks can be obained from: http://www.ssec.wisc.edu/datacenter/

  • select from the left hand menu the option: 'Polar Orbit Tracks'
  • select your satellite, e.g. NOAA 18, 19, Metop A (MO2) and 
  • select the region of interest, e.g. Europe, Africa, and
  • select the day and note the date-time of the overpass over your area of interest

Files available in GEONETCast:

  • NOAA-AVHRR:
    • avhrr_20140805_124000_noaa19.hrp.bz2 : 1 minute LAC data (2048 columns by 360 lines)
    • routine: NOAA19_LAC_quick_import.bat, routine creates map list and calculates day time colour composite, fixed colour stretch 
    • AVHR_GAC_1B_N19_20140805124003Z_20140805124303Z_N_O_201408051350 12Z.bz2: 3 minute GAC data (409 columns by 360 lines)
    • routine: NOAA19_GAC_quick_import.bat: creates map list only, no further processing
  • METOP AVHRR (METOP A - MO2):
    • AVHR_xxx_1B_M02_20140805101003Z_20140805101303Z_N_O_2014080511432 0Z.bz2: 3 minutes scan full resolution (2048 columns by 1080 lines)
    • routine: MetopA_quick_import.bat, creates map list and calculates day time colour composite, fixed colour stretch   
  • Added Eumetsat Advanced Retransmission Service (EARS) option for METOP A and METOP B AVHRR.
    • 6 tiles of 360 lines are extracted and processed from raw HRP, tif created and visualized with IRFANVIEW control buttons for IRFANVIEW are V and H (vertical and horizontal rotation), + and - for zooming in and out respectively time stamp refers to end of scan time. 
    • Sample file names:
      • AVHR_HRP_00_M02_20140822081500Z_20140822081600Z_N_O_20140822081654Z.bz2 (METOP-A)
      • AVHR_HRP_00_M01_20140822081500Z_20140822081600Z_N_O_20140822081654Z.bz2 (METOP-B) 
  • Added LSA SAF Fire products for Euro and Africa Window
    • Fire Detection and Monitoring product for both Euro and Africa windows, output class map. 0=water, 1 is land and 2=Land with Fire  
  • Fire risk map for the euro window only, for 3 forecasts (24, 48 and 72 hours). The routine checks if all 3 layers are available, else it aborts.
    • 3 layers imported:
      • Fire Weather Index, value map. Scaling used is 100
      • Daily Severity Rating. Scaling used is 100
      • Fire Risk map. Class map, less equal 0 =undefined, 10=low, 20=moderate and 30= high risk respectively 
  • Added import routines for Proba Vegetation:
    • Africa: DMP and VPI dekadal products - including product specific scaling and offset
    • Latin America: DMP, VCI and VPI dekadal products - including product specific scaling and offset 
  • Added GEOTif export for float data in menu under "to other applications /export to QGIS". The purpose is to make it compatible with other software, like QGIS. If nodata exsists in the input data, first reclassify to e.g. value of -9999.Data in latlon corner coordinates is expected, so it should be entered in degree.decimals. 

Uses powershell routine to display popup window. All routines are under sub directory 'Extensions\GEONETCast-Toolbox\toolbox_startscript\import_export\'. No extensions of ilwis and geotif file are required. 

  • Added visualization of Dust products from Barcelona Dust Forecast Centre. Products are covering Northern Africa, Middle East and Europe for Dust Optical Depth, Dust Surface Concentration, Dust Load, Dust Dry and Wet Deposition and Dust Surface Extinction
  • Added Import of GPM Level 2 rainfall (mm/hr) as 5 minutes orbit files for 1 hour
  • Added Import of GPM GMI Temperature for S1 and S2 - for 1st BT channel. A point/raster map is created only! 
  • Removed the btool (bufrtool, from Northern Lighthouse) routine and replaced it with bufrextract (http://www.elnath.org.uk/). This version (0,2,7) is only available for 64 bits OS! The following routines are affected: Ascat wind bufr data, ADNET bufr data, MSG MPEF bufr data, MFG bufr data, MPEF MFG bufr data, RSS bufr data
  • Included a new version of BufrDisplay version 0,7,5 see: http://www.elnath.org.uk/. This version is only available for 64 bits OS! 

GEONETCast Toolbox version 1.6

Please note that the XML version 1.6 of the GEONETCast Toolbox has new license and readme files. In additon, it has been updated with various changes and additions. The most important are:

Changes

  • All batch routines have been updated to reflect the changes in GEONETCast. In addition, they now check for the existence of input data and are thus more stable. If the data is not available, the routine terminates;
  • The OCEANSAT-OSCAT (modeled) Winds import routine was removed since the instrument is no longer operational;
  • There is a small change in the MPEF and SAF sub-menu structure;
  • A modified routine for MODIS fire data import now extracts and presents global fires in a single map.

Additions

  • Updated installation and user manuals in the sub-directory \util\manuals. This requires the installation of Adobe Reader;
  • Included import routines for the H-SAF global soil moisture and Copernicus global soil water index;
  • Included routines to process the nowcasting products from the NWC-SAF derived from MSG, e.g. Cloud Mask (CMa), Cloud Type (CT) and Cloud Height/Temperature (CTTH). Please note that this is a restricted service!
  • Included routines to process the Lightning Detection Data from ground based ATDNET network (Sferics). Please note that this is a restricted service!
  • Included routines to process the MPEF products from Meteosat7 (MFG) over the Indian Ocean, such as Clear Sky Radiances (CSR), Clear Sky Water Vapour Winds (WVW), Cloud  Analysis (CLA), Cloud Mask (CLM) and Low Resolution Cloud Motion Winds (ELW).
  • New routine for visualization of the NCEP GFS data.
  • New routines to process the Proba Vegetation products for Africa and Latin America.

GEONETCast Toolbox version 1.5

Changes

Various changes have been implemented in the GEONETCast Toolbox XML version 1.5. The most important are:

  • All batch routines have been updated to reflect the changes in the GEONETCast data stream. Routines have also been made more stable. A routine now checks if input data exists. If the data is not available, the routine terminates.
  • All import routines for the PML and EAMNET African Ocean data have been updated to reflect the current status. The nLw for 443 nm is now extracted so nLw colour composites can be made.
  • The geometric model of Fengyun 2D and 2E has been updated.
  • The SPOT VGT NDVI routine has been adapted to allow import of version 1 NDVI's.

Additions

  • New import routine for METOP derived Global Sea Surface Temperature. The MSG-GOES SST Composite was removed.
  • New routine to process Ascat Ocean Vector Winds from METOP B and OCEANSATOSCAT (modeled) Winds.
  • New routine to process the Optimal Cloud Analysis (OCAE) product from MPEF.
  • Small change in SAF sub-menu structure, so other SAF centres can be easily added in the future.
  • Use of a new grib decoder - available in the \util sub-directory;
  • Included installation and user manuals in the sub-directory \util\manuals.

GEONETCast Toolbox version 1.4

Changes

Various changes have been implemented in the XML version 1.4 of the GEONETCast Toolbox. The most important are:

  • Upgrade reflecting the EUMETSAT spacecraft position change (effective from January 19, 2013) from MSG2 to include MSG3. All import routines using filenames affected by the shift from MSG2 to MSG3 (e.g. LRIT and MPEF routines) have been adapted and can incorporate both MSG2 and MSG3 file name conventions.
  • MPEF FIRA has been removed and now FIRC and FIRG can be used.
  • Latest versions of BufrTool and BufrDisplay can be used. For some MPEF products, such as TOZ, GII or the RSS RII, processing takes a long time due to the large number of records retrieved and resampled. If Bufr encoded data does not need to be imported for further GIS processing and is used for visualization only, the BufrDisplay routine is recommended.
  • BufrTool ‘siteconf’ message is resolved. A configuration file is now copied from the \Util directory into the \Util sub‐directory \Tables.
  • Cloud Analysis Phase domain has been modified: 1=water, 2=ice, 3=mixed and 4=unknown.
  • All RSS routines have been checked. These will still require an update once MSG2 takes over the RSS service (effective by the middle of April 2013). As soon as data is operationally disseminated, the required modifications will be included in this release.
  • New Data Manager (version 2) is used. This version has an autostart option. Furthermore, the Data Manager can copy instead of move (default) data thus leaving the data in the receiving station's source, to be used by other applications. Further details on the EO web pages. An updated Data Manager's configuration file is included.
  • Updated Product Navigator. The content now reflects the situation as of 20 March 2013.

Additions

  • New routines for processing the Surface Soil Moisture L2‐12.5 km products from METOP A and METOP B.
  • New routines for processing the products produced by CMA based on Fengyun 2D. A number of products, such as TPW, TBB IR1‐120 and OLR IR1‐012, could not be validated since they are not currently disseminated. A small report has been prepared on the results of the import routines and can be obtained from the corresponding author.
  • Modified import routines for the Fengyun 2D and 2E High resolution product, as well as, the satellite geometric model used. The high resolution data assumes a spatial resolution of 1.25 km. For all low resolution images, a spatial resolution of 5 km is applied, including the visible channel! An overlay with a country boundary vector file shows only a minimal shift over the total field of view.
  • New routine to efficiently rename map lists and to convert these ‘ILWIS’ map lists to and from a number of other time series processing tools, such as HANTS, SPIRITS and TIMESAT. Further details on the EO web pages.

 


GEONETCast Toolbox version 1.3

The GEONETCast toolbox v1.3 has become a substantial “lighter” version as compared to v1.2. Users found it difficult to find their way through the large number of routines. This is now solved by creation of separate toolboxes and it is up to the user to install these plug‐ins as well. Some of the routines under the DevCoCast menu have become obsolete, since the data is no longer provided through EUMETCast Europe, Africa. Currently it is not clear to the author if data is still disseminated via GEONETCast America’s. Until this is has been sorted out these routines have not been removed.

Changes

In the XML version 1.3 of the GEONETCast toolbox various changes have been implemented. The most important are:

  • The Web Mapping Services and AMESD‐SADC import utilities have been put into two separate toolboxes, the ISOD and AMESD‐SADC toolboxes respectively. Consult the Installation and User Guides provided for these new toolboxes for further information. See also appendix 5.
  • Various import routines for ENVISAT (MERIS) based EAMNET marine products have been removed. These products are no longer provided due to the ENVISAT satellite's malfunctioning since April 8, 2012.
  • Pre‐March 2011 import routines for the TAMSAT products have been removed. The current products are disseminated in NETCDF format. Older products can be retrieved using the ISOD toolbox.
  • The LRIT MSG import and creation of IR Composite has been removed. The MSG LRIT is no longer disseminated. As a result, the global TIR composite had a gap at 0 degree longitude.

Additions

  • New import routines for Fengyun 2D high resolution panchromatic and low resolution multispectral channels. Note that the satellite orbit model still needs further validation.
  • Additional import routines for MPEF to import the FIRG product, daily NDVI and the decadal NDVI.
  • New generic Geotif import routine.
  • New visualization capability for BUFR encoded data, using BUFRdisplay.

 


GEONETCast Toolbox Version 1.2

New features

MPEF

  • NDVI from MSG, import of NDVI Min, Max and Mean from the whole field of view of the SEVIRI instrument
  • New FIR-G product. This grid file is transformed to a point file (right click with mouse on the point file to open it as table).

DevCoCast

  • INPE
  • Latin America: import routine added for the Fire Ascii from GOES and NOAA.

PML

  • Addition of various import routines for the marine products disseminated derived from MODIS and MERIS, for Africa (various) and Latin America (Brazil, MERIS only). The following products are now supported:
    • from MODIS: Chlorophyll-A, Turbidity Kd-490 and Water leaving radiances (nLw_547 and nLw_667);
    • from MERIS: Algal-1 and 2, and Water leaving radiances (nLw_490, nLw510, nLw 560 and nLw_619).
    • Regions covered for Africa are: Algeria-Tunisia, Egypt, Ghana, Libya, Madagascar (east and north-east), Morocco (north and south), Mozambique, Red Sea and Sierra Leone.
    • Region covered for Latin America is Brazil.

TAMSAT

  • New set of import routines for products released after 11 March 2011. The file format has changed from TIF to NETCDF. Old routines are still available.

EAMNET

  • Additon of various import routines for the marine products disseminated, derived from MODIS and MERIS, for Africa. The following products are now supported:
    • from MODIS: Chlorophyll-A, Turbidity Kd-490, Normalized Fluorescene Line Heigth and Sea Surface Temperature;
    • from MERIS: Algal-1 and 2, Total Suspended Matter and Yellow Substance.
    • Regions covered for Africa are: Angola, Cote d Ivoire, Guinea, Mauritania, Mozambique Channel, Namibia, Nigeria, Senegal, Somalia (north and south), Southern Africa (eastern, southern and western part), Tanzania.

AVISO

  • Aviso altimetry products (pre-processed with BRAT) can be imported using different resolutions.

EAMNET

  • Complete set of import routines for the various marine products produced through EAMNET, derived from MODIS and MERIS for Africa.

AMESD SADC

  • New set of import routines for products related to agricluture, drought, fire and weather forecasting that are disseminated through GEONETCast by AMESD-SADC. Not all import routines are currently operational.
  • Import routines have been checked for the following items
    • Drought: Vegetation performance maps:
      • VCI
      • SDVI
      • PASG
    • Agriculture: Agricultural products from Remote Sensing:
      • Current rainfall estimates map
      • Rainfall estimates compared with average (%)
      • Cum rainfall map
      • Cum rainfall map compared with average
      • NDVI compared with average (difference)
      • NDVI compared with average (%)
      • WRSI
      • SMI
      • Cum DMP
      • Cum DMP compared with average
    • CSIR Fire and SAWS Seasonal Forecast
      • All product import routines have been checked with sample data provided by CSIR and SAWS
  • Additional remarks: Use is made of sample data in a format that will be disseminated by GEONETCast in the near future.

Additional changes

  • SAF products
    • 7Z is now used for decompression of original files (orignially bzip2-104-x86-win32.exe).
  • Vector data in sub-directory util\maps\
    • Coordinate system has been changed to latlon (initially set to latlonwgs84.scy).
  • Batch routines
    • checked for consistency. Some batch routines have been renamed, e.g. those used to import the MPEF and LRIT products and images respectively.
  • Service objects
    • included in the subdirectory\Util and sub-directory \System for the various new import routines. When installing the toolbox all files for this toolbox subdirectory are copied to the ILWIS\System sub-directory and are available to the user. Files in this category are georeferences, coordinate systems, lookup tables, etc.
  • Removed files
    • Old files with DLL extension (cygpng12.dll and cygz.dll) from the sub-directory \util\. These files were used for extracting GRIB formatted data. There is a new version of WGRIB.
    • bzip2-104-x86- win32.exe

 


GEONETCast Toolbox Version 1.1

Data Manager

  • Empty folders that are a destination folder for one of the items are no longer (accidentally) deleted. This solves the accidental deletion of the famous Other/RSS/MPEF when it was empty.
  • Wildcard characters * and ? are now allowed in the filename pattern (thus not full regular expressions). As a result, you need to go through your configuration file once to append a * to all patterns, otherwise they don't match the Geonetcast files.

MPEF

  • Included the CLA (transformed from BUFR into phase, low-medium and high cloud percentages per segment / pixel)

VGT4Africa

  • Included new product BA (Burnt Area). Map value is yyjulianday (e.g. map value of 30219 is year 30 and julian day 219)
  • Change of batch routines for import of DMP, NDVI, NDWI, SWB and VPI. These files are now decompressed using 7z.

Real time visualization

  • Included GOES-MSG TIR composite (from INPE), loop of 5 hours.

Web Mapping Service

  • Included position of the ITCZ, for the Northern Hemisphere.
  • Included NOAA weather charts for Northern Hemisphere, Europe and Africa, Africa and Asia and Latin America and Africa. Contains forecast for up to 36 hours with wind speed, wind direction and temperature.
  • Flight level selected is FL050, meaning situation at 5000 feet, or at a standard barometric pressure of 850 millibar (assuming height approximation of roughly 33 feet per millibar):

    1013.25 – 850 = 163.25 mb
    163.25 * 33 = 5387.25 feet
    5387.25 * 0.304 = 1637 metres

    This assumes standard barometric pressure (1013.25 mb at sea level – using standard datum), but does not include local topography. This flight level is the lowest level and in many cases will correspond to ground surface phenomena for wind speed, direction and temperature.

Real time animations (for MSG and GOES-TIR composite):

  • The routine to create a scheduled task has been changed. It did not work under WINDOWS-7 (the batch start directory had to be defined for the scheduled task to be properly initiated).

 

All batch routines have been updated to reflect the changes in GEONETCast; New version of Data Manager, including option DOY (Day Of Year) Upgraded GDAL to version 1.11 Removed INPE GOES-MSG Thermal Composite / SPOT VGT Updated FY from FY2D/2E to FY2E/2F, removed TSG and 120hr products from BBT and OLR, for FY derived PRE (_006 and _024) for high rain rates still mistake in data source! 

For AVHRR processing and creating quicklooks, added in main Menu > NOAA AVHRR. Added under menu METOP A/B item. Installation instructions for “METOP-A AVHRR quicklook picture” option: uses xrit2pic:download setup_xrit2pic_cmd.exe from: http://www.alblas.demon.nl/wsat/software/winsoft_msg.html to temporary directory download setup_gtk20dll.exe from: http://www.alblas.demon.nl/wsat/software/winsoft_msg.html to temporary directory download setup_decompr.exe (JPEG and wvt decompression libs ) from: http://www.alblas.demon.nl/wsat/software/winsoft_msg.html to temporary directory install xrit2pic_cmd to the same temp directory, repeat for setup_gtk20dll.exe - setup_decompr.exe and extract to the same directory copy xrit2pic_cmd.exe and 16 dll files to your ilwis directory \Extensions\GEONETCast-Toolbox\util\xrit2pic  

NOTE: Polar orbit satellite tracks can be obained from: http://www.ssec.wisc.edu/datacenter/ select from the left hand menu the option: 'Polar Orbit Tracks' select your satellite, e.g. NOAA 18, 19, Metop A (MO2) and  select the region of interest, e.g. Europe, Africa, and select the day and note the date-time of the overpass over your area of interest  

Files available in GEONETCast: NOAA-AVHRR: avhrr_20140805_124000_noaa19.hrp.bz2 : 1 minute LAC data (2048 columns by 360 lines) routine: NOAA19_LAC_quick_import.bat, routine creates map list and calculates day time colour composite, fixed colour stretch 

AVHR_GAC_1B_N19_20140805124003Z_20140805124303Z_N_O_201408051350 12Z.bz2: 3 minute GAC data (409 columns by 360 lines) routine: NOAA19_GAC_quick_import.bat: creates map list only, no further processing  

METOP AVHRR (METOP A - MO2): AVHR_xxx_1B_M02_20140805101003Z_20140805101303Z_N_O_2014080511432 0Z.bz2: 3 minutes scan full resolution (2048 columns by 1080 lines) 

routine: MetopA_quick_import.bat, creates map list and calculates day time colour composite, fixed colour stretch   

Added Eumetsat Advanced Retransmission Service (EARS) option for METOP A and METOP B AVHRR. o 6 tiles of 360 lines are extracted and processed from raw HRP, tif created and visualized with IRFANVIEW control buttons for IRFANVIEW are V and H (vertical and horizontal rotation), + and - for zooming in and out respectively time stamp refers to end of scan time.  Sample file names: AVHR_HRP_00_M02_20140822081500Z_20140822081600Z_N_O_20140822081654Z.bz2 (METOP-A) 

AVHR_HRP_00_M01_20140822081500Z_20140822081600Z_N_O_20140822081654Z.bz2 (METOP-B) 

Added LSA SAF Fire products for Euro and Africa Window 

o Fire Detection and Monitoring product for both Euro and Africa windows, output class map. 0=water, 1 is land and 2=Land with Fire  

Fire risk map for the euro window only, for 3 forecasts (24, 48 and 72 hours). The routine checks if all 3 layers are available, else it aborts. o 3 layers imported: Fire Weather Index, value map. Scaling used is 100 Daily Severity Rating. Scaling used is 100 Fire Risk map. Class map, less equal 0 =undefined, 10=low, 20=moderate and 30= high risk respectively 

Added import routines for Proba Vegetation: Africa: DMP and VPI dekadal products - including product specific scaling and offset Latin America: DMP, VCI and VPI dekadal products - including product specific scaling and offset 

Added: GEOTif export for float data, in menu under: to other applications /export to QGIS. Purpose make it compatible with other softwares, like QGIS. If nodata exisist in the input data, first reclassify to e.g. value of -9999. Expects data in latlon corner coordinates should be entered in degree.decimals. 

Uses powershell routine to display popup window. All routines are under sub directory 'Extensions\GEONETCast-Toolbox\toolbox_startscript\import_export\'. No extensions of ilwis and geotif file required 

Added visualization of Dust products from Barcelona Dust Forecast Centre. Products are covering Northern Africa, Middle East and Europe for Dust Optical Depth, Dust Surface Concentration, Dust Load, Dust Dry and Wet Deposition and Dust Surface Extinction 

Added Import of GPM Level 2 rainfall (mm/hr) as 5 minutes orbit files for 1 hour

Added Import of GPM GMI Temperature for S1 and S2 - for 1st BT channel a point/raster map is created only! 

Removed the btool (bufrtool, from Northern Lighthouse) routine and replaced it with bufrextract (http://www.elnath.org.uk/), this version (0,2,7) is only available for 64 bits OS! Affected following routines:Ascat wind bufr data, ADNET bufr data, MSG MPEF bufr data, MFG bufr data, MPEF MFG bufr data, RSS bufr data Included a new version of BufrDisplay version 0,7,5 see: http://www.elnath.org.uk/,  this version is only available for 64 bits OS!


Upcoming Events

Affiliations

The 52° North affiliations:

OGC logo

Cooperation Partners

The 52°North principal cooperation partners

IfGI Logo con terra logo
esri Logo ITC logo