Skip to content

Diagnostic cloud-scatterplots-cli-ta expects mip=realm for OBS #788

Description

@k-a-webb

Describe the bug

I get the following error message (below) when trying to run the cloud-scatterplots-cli-ta diagnostic with a CMIP7 model, where the relevant error message (one of several) is:

2026-07-03 22:57:48,876 UTC [3019873] ERROR   No files were found for Dataset:
{'dataset': 'ISCCP-FH',
 'project': 'OBS',
 'mip': 'atmos',
 'short_name': 'rsutcs',
 'alias': 'OBS_ISCCP-FH',
 'derive': True,
 'frequency': '',
 'long_name': 'TOA Outgoing Clear-Sky Shortwave Radiation',
 'modeling_realm': ['atmos'],
 'original_short_name': 'rsutcs',
 'preprocessor': 'zonal_mean',
 'recipe_dataset_index': 3,
 'standard_name': 'toa_outgoing_shortwave_flux_assuming_clear_sky',
 'tier': 2,
 'timerange': '1996/2016',
 'type': 'sat',
 'units': 'W m-2',
 'version': 'v0'}
session: 'recipe_20260703_225747',
using data sources:
- data source: LocalDataSource(name='local', project='OBS', priority=1, rootpath=PosixPath('/fs/site7/eccc/crd/cccma/users/scrd115/REF_v4/climate-ref/.ref/cache/esmvaltool/datasets/ESMValTool/OBS'), dirname_template='Tier{tier}/{dataset}', filename_template='{project}_{dataset}_{type}_{version}_{mip}_{short_name}[_.]*nc', ignore_warnings=[])
  message: No files found matching glob pattern /fs/site7/eccc/crd/cccma/users/scrd115/REF_v4/climate-ref/.ref/cache/esmvaltool/datasets/ESMValTool/OBS/Tier2/ISCCP-FH/OBS_ISCCP-FH_sat_v0_atmos_rsutcs[_.]*nc

My interpretation of the filename, having _atmos_ (instead of _Amon_ where the diagnostic is run for a CMIP6 model), is that this diagnostic expects a different mip facet value when comparing to CMIP7? this is a problem, as the data provided (via the fetch function) has the filename structure where mip=<CMOR6 table_id>

out.log contents attached

System

  • OS: Linux
  • Python version: 3.11.9

out.log

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions