Ten million changes as I develop in production as LS4 starts#535
Open
rknop wants to merge 168 commits into
Open
Ten million changes as I develop in production as LS4 starts#535rknop wants to merge 168 commits into
rknop wants to merge 168 commits into
Conversation
…but are 32 individual FITS files.
…handle file:/// ; update tests to allow download from a local directory (env var configured) or env-var set url instead of just hardcoded nersc url
…mize provenance parameters, make exposure_processor.py able to handle something not in knownexposures.
…s so we don't have to included lots of subclass module files in everything that wants to process exposures.
… images. Use astrometry.net to measure the offsets of the chip centers and chip corners from TELE_RA and TELE_DEC (which is *not* centered on the array).
…hange into import_ls4
…fits.save_fits_image_file, as we just had to get something in a temp directory for astrometry.net to use and didn't want our own assumptions creeping i
…rting to bite me.
…lding for Darks, Biases, Flats. Fix top_level so it won't go past preprcessing for Darks, Biases, Flats.
…mask
Builds three Rice-compressed FITS per chip from a stack of LS4Cam bias
frames:
superbias_<CCD>.fits.fz float32, MED_BIAS = median of image
superbias_nmad_<CCD>.fits.fz float32, MB_NMAD = median of NMAD image
superbias_mask_<CCD>.fits.fz int16, 1 where NMAD > 3*1.4826*median(NMAD)
Two input layouts via --input-mode:
multi-ext (default): raw multi-extension exposures; runs
LS4Cam.overscan_and_trim internally per chip.
per-chip: flat directory of already-trimmed per-chip files;
groups by CCD_LOC header keyword. Different chips
may have different N.
Both modes have been verified to produce bit-identical superbias / NMAD /
mask outputs on the same underlying frames.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
…hen redoing with --do-not-load. Add writing a diagnostic residual DS9 region file to scamp.py
…hange into import_ls4
…esses that might have used it having their subsets of configs within their own config tree. Handle this in Parametrs.subconfig_update. This will allow galactic and extragalactic fields to use different parameters but share the same provenances.
…l find out later if that has fallout I regret. Fighting more with tests and how they handle provenacnes to go with changes I made to RefMaker several commits back. Argh.
…_with_sleep accept_exception parameter, and fix the problem sthat the tests revealed
…ckerfile for the deprecation of ConfigChooser, bump docker-compose image version, apply Issue c3-time-domain#516 to webap and conftest.py
…actions and sent postgres an empty array
…o the chaos at the beginning of a survey.... Add a couple of parameters to ref_maker that allow you to tell it to just use the parameters from the provenance of a pre-existing refset rather than all the parameters you've actually configed. Sounds scary, but about the only way to allow us to go backwards and build new refs from an previously-configured refset. Along the way, do some Issue c3-time-domain#516 in provenance.py
…meant committed a flask secret key. So, change the key, put back empty webap_local_overrides.yaml. (More changings coming in a later commit that will allow putting local overrides in secrets on spin so we don't have to muck about with changing the config when building the docker file, which should obviate errors like this in the future!)
…me stuff mentioend in the previous commit.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.