Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
c5e729f
Adding a technical note on the design of the pipeline's crossmatching…
luigilcsilva Jul 6, 2026
464ba55
Merge branch 'main' into inconsitency-correction
luigilcsilva Jul 6, 2026
c34eaac
Minor changes in the design document
luigilcsilva Jul 6, 2026
1799f1f
feat: add conservative object type homogenization
luigilcsilva Jul 7, 2026
0f61225
Adding column value 'agn' for generic AGN, in contrast to certain qua…
luigilcsilva Jul 7, 2026
14de10b
feat: harden translation rules and disable Rubin footprint by default
luigilcsilva Jul 7, 2026
42982ab
Correcting validate_translation_config import error
luigilcsilva Jul 7, 2026
0933e06
fix: normalize runtime schemas across crossmatch rounds
luigilcsilva Jul 8, 2026
ddeda3a
feat: add galactic object type and tighten stellar classification rules
luigilcsilva Jul 8, 2026
9042bfe
feat: filter deduplication by object type and retire z-flag 6
luigilcsilva Jul 8, 2026
b286981
feat: bound transitive dedup groups by representative radius
luigilcsilva Jul 8, 2026
63cff44
Correcting distance diagnostics to use the reference objects from the…
luigilcsilva Jul 8, 2026
8a0cfaa
Correcting logs texts and comments for the new object type oriented w…
luigilcsilva Jul 8, 2026
177d441
refactor: replace legacy z-flag 6 sentinel with exclusion mask
luigilcsilva Jul 8, 2026
5c8a1d6
docs: add CRD_ID duplication incident report and impact analysis
luigilcsilva Jul 8, 2026
0c81dab
Correcting paths in the incident report
luigilcsilva Jul 8, 2026
9634123
Removing docs folder
luigilcsilva Jul 10, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 22 additions & 2 deletions config.py
Original file line number Diff line number Diff line change
Expand Up @@ -101,11 +101,31 @@ class Columns(BaseModel):
class Param(BaseModel):
combine_type: str = "concatenate"
extra_columns: dict[str, Any] = Field(default_factory=dict)
# Zero disables the cut; valid active cuts are 1, 2, 3, 4, 5, 6.
# Zero disables the cut; valid active cuts are 1, 2, 3, 4.
z_flag_homogenized_value_to_cut: float = 3.0
include_unclassified: bool = True
include_galaxy: bool = True
include_star: bool = False
include_agn: bool = True
include_qso: bool = True
include_galactic: bool = False
flags_translation_file: str = str(Path(MAINDIR, "flags_translation.yaml"))
insert_DP1_footprint_flag: bool = False
insert_rubin_footprint_flag: bool = True
insert_rubin_footprint_flag: bool = False

@model_validator(mode="after")
def validate_object_type_inclusion(self):
inclusion = (
self.include_unclassified,
self.include_galaxy,
self.include_star,
self.include_agn,
self.include_qso,
self.include_galactic,
)
if not any(inclusion):
raise ValueError("at least one include_* object-type option must be true")
return self


class Config(BaseModel):
Expand Down
12 changes: 10 additions & 2 deletions config.template.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,15 @@ param:
# ORIGINAL_ID:
# source: id
# type: str
z_flag_homogenized_value_to_cut: 0.0 # 0 disables the cut; valid active cuts are 1, 2, 3, 4, 5, 6.
z_flag_homogenized_value_to_cut: 0.0 # 0 disables the cut; valid active cuts are 1, 2, 3, 4.
# Object types allowed to participate in the deduplication graph. Disabled
# types remain in marked outputs as isolated rows with tie_result=3.
include_unclassified: true
include_galaxy: true
include_star: false
include_agn: true
include_qso: true
include_galactic: false
insert_DP1_footprint_flag: false # Adds is_in_DP1_fields (1/0)
insert_rubin_footprint_flag: true # Adds is_in_rubin_footprint (1/0)
insert_rubin_footprint_flag: false # Adds is_in_rubin_footprint (1/0)
flags_translation_file: flags_translation.yaml # File with homogenization rules for z_flag and type
Loading
Loading