list_minsarApp.bash and make_templates.py to run multiple datasets with one go

[falkamelung]

We need a way to run all Central America volcanoes with one go. I call it here minsarApp_list.bash but I am unsure about the naming. For your data you will run:

minsarApp_list.bash $TE/CentralAmerica.xls
minsarApp_list.bash $TE/Japan.xls
minsarApp_list.bash $TE/Indonesia.xls
minsarApp_list.bash $TE/Indonesia.xls --no-mintpy --start miaplpy
minsarApp_list.bash $TE/Indonesia.xls --no-mintpy --period 20250101:20250430
minsarApp_list.bash $TE/Indonesia.xls --no-mintpy --period 20250101:XXXXXXXX

It will allow to try short time periods, easily update, and rerun everything once the processing system has improved.

It will use make_templates.py (to be developped) and $RSMASINSAR_HOME/minsar/defaults/miaplpy_sample.template (as default):

make_templates.py $TE/CentralAmerica.xls
make_templates.py $TE/CentralAmerica.xls --sample-template dummy1.template  

minsarApp_list.bash has as positional argument the *.xls file. The other arguments are the minsarApp.bash arguments. They should go into minsaropt

Options:

minsarApp_list.bash $TE/CentralAmerica.xls --no-mintpy --start miaplpy
will run

make_templates.py $TE/CentralAmerica.xls 

and create and execute a file run_minsarApp.bash containing:

minsarApp.bash $TE/tmp/RiconSenD157.template --no-mintpy --start miaplpy --sleep 21000`
minsarApp.bash $TE/tmp/RiconSenA165.template --no-mintpy --start miaplpy`

make_templates.py will use $RSMASINSAR_HOME/defaults/miaplpy_sample.template which is here and generate multiple files in the $TEMPLATES/tmp directory

• --outdir: default $TEMPLATES/tmp
• --sleep: default 21000 (6 hours)

Spreadsheet file
The CentralAmerica.xls contains:

name	direction	ssaraopt.startDate	ssaraopt.endDate	ssaraopt.relativeOrbit	topsStack.subswath	mintpy.subset.lalo	miaplpy.subset.lalo
Rincon	D	20160701	auto	157	2	10.8:10.841,-85.371:-85.306	10.8:10.841,-85.371:-85.306
Rincon	A	20160701	auto	165	2 3	10.8:10.841,-85.371:-85.306	10.8:10.841,-85.371:-85.30
Pacaya	A	20160701	auto	999

creates in the current directory:

RinconSenD157.template
RinconSenA165.template
PacayaSenA999.template

Naming:

• think about naming. We need a naming convention for scripts that work on a list of files (we have an example in precip). E.g. plotdata_list.py, minsarApp_list.bash`. For this problem that could mean we have two scripts:

Thoughts:

• The *.xls file can also have PlotData options, e.g. plotdata.lalo for a point time series. We then have run_plotdata.py CentralAmerica.xls to create a plot with one timeseries for each of the datasets in CentralAmerica.xls.

• also need summarize_insarmaps_url.py CentralAmerica.xls (or summarize_insarmaps_url.py run_minsar.bash`) to create a summary of the created insarmaps.log entries.

• also need remove_insamaps.py CentralAmerica.xls to remove the insarmaps entry if we screwed up

• create remove_insamaps.py run_minsar.bash to remove the insarmaps entries if we screwed up.

More thoughts:

• Automatic generation of iframes on GitHub geodesymiami/Results?:
  run_summarize_insarmaps_url.py CentralAmerica.xls would produce insarmaps iframes in geodesymiami/Resuts/CentralAmerica
  run_summarize_insarmaps_url.py Japan.xls would produce insarmaps iframes in geodesymiami/Resuts/Japan

• we start with a local *.xls file, but then switch to a Google sheet (the old run_operations.py has code for that)