MiaplPy load_slc_geometry.py fix for TSX

[falkamelung]

For some reason no *rsc file is produced for the first SLC by teh prep_* command (Falk: check whetehr there was a fix which is not used). This leads to the failure in run_01 ( load_slc_geometry.py).

cd merged/SLC
lsd | wc -l
ls */*.rsc | wc -l

Is there a difference in the count? If so you can identify the SLC using

for dir in */; do   if ! find "$dir" -maxdepth 1 -type f -name '*.rsc' | grep -q .; then     echo "$dir";   fi; done

After removing this file it works fine.

[falkamelung]

When running load_slc_geometry.py, we get the error:

prepare slantRangeDistance ...
KeyError: 'STARTING_RANGE'
> /work2/05861/tg851601/stampede2/code/rsmas_insar/tools/MiaplPy/src/miaplpy/objects/geometryStack.py(226)write2hdf5()
-> data = self.get_slant_range_distance(box=box, xstep=xstep, ystep=ystep)
(Pdb) self.get_slant_range_distance(box=box, xstep=xstep, ystep=ystep)
prepare slantRangeDistance ...
*** KeyError: 'STARTING_RANGE'

The error occurs in the get_slant_range_distance method.

217         ###############################
218         # Generate Dataset if not existed in binary file: incidenceAngle, slantRangeDistance
219         for dsName in [i for i in ['incidenceAngle', 'slantRangeDistance']
220                        if i not in self.dsNames]:
221             # Calculate data
222             data = None
223             if dsName == 'incidenceAngle':
224                 data = self.get_incidence_angle(box=box, xstep=xstep, ystep=ystep)
225             elif dsName == 'slantRangeDistance':
226                 data = self.get_slant_range_distance(box=box, xstep=xstep, ystep=ystep)

The reason is that it uses self.extraMetadata which does not have 'STARTING_RANGE' attribute.

/work2/05861/tg851601/stampede2/code/rsmas_insar/tools/MintPy/src/mintpy/objects/stackDict.py(472)get_slant_range_distance()
-> if not self.extraMetadata:

(Pdb) pp self.extraMetadata
{'BANDS': '1',
 'BYTE_ORDER': 'little-endian',
 'DATA_TYPE': 'complex64',
 'FILE_PATH': '/scratch/05861/tg851601/qMiamitestTsxSMDT36/merged/SLC/20170901/20170901.slc',
 'FILE_TYPE': '.slc',
 'INTERLEAVE': 'bsq',
 'LENGTH': '26595',
 'NO_DATA_VALUE': 'none',
 'PROCESSOR': 'isce',
 'UNIT': 'i',
 'WIDTH': '16232',
 'band names': '{',
 'bands': '1',
 'byte order': '0',
 'coordinate system string': '{GEOGCS["GCS_WGS_1984",DATUM["D_WGS_1984",SPHEROID["WGS_1984",6378137.0,298.257223563]],PRIMEM["Greenwich",0.0],UNIT["Degree",0.0174532925199433]]}',
 'data type': '6',
 'description': '{',
 'file type': 'ENVI Standard',
 'header offset': '0',
 'interleave': 'bsq',
 'lines': '26595',
 'map info': '{Geographic Lat/Lon, 1, 1, 0, 0, 1, 1,WGS-84, rotation=180}',
 'samples': '16232'}

For the other datasets (e.g. longitude, incidenceangle) the files are created with the create_dataset method which works fine. There are no metadata needed for saving.

151         for dsName in self.dsNames:
152             # 3D datasets containing bperp
153             if dsName == 'bperp':
154                 self.dateList = list(self.datasetDict[dsName].keys())
155                 dsDataType = dataType
156                 self.numDate = len(self.dateList)
157                 dsShape = (self.numDate, length, width)
158                 ds = f.create_dataset(dsName,
159                                       shape=dsShape,
160                                       maxshape=(None, dsShape[1], dsShape[2]),
161                                       dtype=dsDataType,
162                                       chunks=True,
163                                       compression=compression)

this is in geometryStack.py:
https://github.com/insarlab/MiaplPy/blob/0f0741231dbcb4c7755821ff19a09d31d3477c2f/src/miaplpy/objects/geometryStack.py#L212-L216

In contrast extra_metadata in the same function has it

(Pdb) pp extra_metadata

 'ANTENNA_SIDE': '-1',
 'AZIMUTH_PIXEL_SIZE': '2.1495973013571024',
 'BANDS': '1',
 'CENTER_LINE_UTC': '40693.0',
 'DATA_TYPE': 'complex64',
 'DATE': '20170923',
 'EARTH_RADIUS': '6348030.184562681',
 'FILE_LENGTH': '26595',
 'FILE_PATH': '/scratch/05861/tg851601/qMiamitestTsxSMDT36/merged/SLC/20170923/20170923.slc',
 'FILE_TYPE': '.slc',
 'HEADING': '-168.44100752196547',
 'HEIGHT': '511026.115651361',
 'INTERLEAVE': 'BIP',
 'LAT_REF1': '26.000836438288573',
 'LAT_REF2': '26.04879067062456',
 'LAT_REF3': '25.53304157466543',
 'LAT_REF4': '25.581095029342798',
 'LENGTH': '26595',
 'LON_REF1': '-80.01319490242751',
 'LON_REF2': '-80.32445649289652',
 'LON_REF3': '-80.10258021834433',
 'LON_REF4': '-80.41255780596921',
 'NCORRLOOKS': '0.8178113495533404',
 'PLATFORM': 'Tsx',
 'POLARIZATION': 'HH',
 'PRF': '3577.0218098958335',
 'PROCESSOR': 'isce',
 'PROJECT_NAME': 'qMiamitestTsxSMDT36',
 'P_BASELINE_BOTTOM_HDR': '-42.87617808944443',
 'P_BASELINE_TOP_HDR': '-42.949260031892734',
 'RANGE_PIXEL_SIZE': '1.3641053359701238',
 'RLOOKS': '1',
 'STARTING_RANGE': '681478.0615665995',
 'UNIT': 'i',
 'WAVELENGTH': '0.03106658115133631',
 'WIDTH': '16232'}

The question is whetehr there is a way to make it use extra_metadata.