Skip to content

Add NOAA GSL RAP data stream. #72

Description

@christinaholtNOAA

Description

The GSL ITS Data Services Group (DSG) processes RAP data to add additional fields (current, annual min/max vegetation fraction). The data is available on disk here:

/public/data/grib/ftp_rap_hyb/7/0/105/0_794802_32769

And available in the HPSS archives here:

/BMC/fdr/Permanent/{yyyy}/{mm}/{dd}/grib/ftp_rap_hyb/7/0/105/0_794802_32769/

The archive files are named: {yyyymmdd}0000.zip

The file names are: {yy}{jjj}000000{hh} where jjj is 3-digit Julian Day.

Currently, uwtools does not support pulling files from zip archives, but does pull entire archives using hsi. The extraction of the necessary files from the archive will need to be added to retrieve_data or uwtools for this to work properly.

Solution

Add a new YAML block for GSL_RAP that includes this additional data store. It's not the same data as the RAP NCEP archives, so do not conflate the two.

Add capabilty to extract files from a zip archive.

Requirements**

  • Continues to support all currently available data stores.
  • Reliably extracts files from zip archive.
  • Passes all existing tests (currently in test branch)
  • Adds new system test for the new data store.
  • Adds new unittests to continue to achieve 100% test coverage for retrieve_data.py

Acceptance Criteria (Definition of Done)

Retrieves appropriate files for MPAS App to run from GSL's processed RAP data.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions