Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
263 commits
Select commit Hold shift + click to select a range
ffd31a1
adding smoothing
Apr 8, 2023
2ba9427
working on adding harmonic limits to simple adder
Apr 8, 2023
2dabddd
added command line args and more plotting
Apr 8, 2023
ab717ae
adding more harminc investigation tools
Apr 9, 2023
f038f3e
switching to one plot and smoothing the spectra before performing the…
Apr 10, 2023
4980225
adding spectral whittening from Klapuri06
Apr 11, 2023
87c2ad7
Freq slicing (#3)
Sulla2012 Apr 12, 2023
a79fbff
not sure what changed tbh
Apr 12, 2023
dc71627
adding max scaling
Apr 13, 2023
51e9194
fix indent;missing fmi,fma; more axes labels
mohanagr Apr 13, 2023
89c8aab
cleaning up code for merging
Apr 25, 2023
85b3c88
removing all quick spectra and updating gitignore
Apr 26, 2023
2a6e398
fixing indentation issue
May 8, 2023
d8153a4
disabling accoustics
May 8, 2023
2115bee
removing non-interpolated results and some other minor cleanups
May 15, 2023
772d3a1
Merge branch 'master' into harmonic-finder
Sulla2012 May 16, 2023
dbf188a
Merge pull request #4 from ALBATROS-Experiment/harmonic-finder
Sulla2012 May 16, 2023
6ea846d
removing DS_Store
May 16, 2023
41e5c51
removing DS_Store
May 16, 2023
904a393
Minor fixes in plotting scripts from Marion
mohanagr Jun 6, 2023
d9a0403
adding test files to GLFS
mohanagr Jun 6, 2023
9b2fa08
minor plotting changes
mohanagr Jun 15, 2023
204a111
Fix the specnum overflow bug
mohanagr Jun 15, 2023
1420fe1
add specnum overflow correction
mohanagr Jun 15, 2023
b88b7dc
minor output changes
mohanagr Jun 16, 2023
ee40fe9
another pesky bug in overflow correction
mohanagr Jun 29, 2023
930cda5
van vleck addition and overflow fix improvement
mohanagr Jul 19, 2023
8604a1a
small fix
mohanagr Jul 24, 2023
36aba20
another micro fix
mohanagr Jul 24, 2023
36a2716
Black-ify code for future merge with refactor-pep8
mohanagr Jul 24, 2023
5bd95b6
updated numpy version in requirements because of dependency clash wit…
dcxSt Jul 24, 2023
494fb17
ported c-stuff to darwin (macos)
dcxSt Jul 24, 2023
1a38136
minimal working code to dump fake baseband files
mohanagr Jul 25, 2023
c090711
Clean uninterpretable (#17)
dcxSt Jul 27, 2023
312d8bf
Stevedev (#20)
dcxSt Aug 7, 2023
c628c73
add get_file_from_timestamp
mohanagr Aug 7, 2023
9b0d08a
formalizing some orbcomm work
mohanagr Aug 8, 2023
1f982a7
minor changes
mohanagr Aug 9, 2023
dfa25fa
some temp path hacks to make stuff work and missing imports
mohanagr Aug 10, 2023
5b680a9
file from timestamp bugfixes, some new utisl, some cosmetics
mohanagr Aug 10, 2023
bd2c842
simplify setup. move to root
mohanagr Aug 11, 2023
3658b77
improvements and additions to sat identification work
mohanagr Aug 26, 2023
2a5da7c
work from uapishka on orbcomm pipeline
mohanagr Sep 12, 2023
9b5d753
add arb rows to 1 bit float, and more utils
mohanagr Sep 13, 2023
d92bbfa
adding stuff to orbcomm utilities, minor changes elsewhere made durin…
mohanagr Dec 21, 2023
fcfa3a7
some optimizations: function factory for file loader, lazy init of sp…
mohanagr Dec 21, 2023
0617c50
minor bug fixes, rerun of existing tests
mohanagr Dec 22, 2023
aaf4354
some orbcomm peak finding automation
mohanagr Jan 2, 2024
cb87e42
orbcomm related work
mohanagr Feb 1, 2024
e157133
trial/testing of clock algo
mohanagr Feb 5, 2024
002faca
restructure package for future dev
mohanagr Feb 5, 2024
72fab30
sat detection automation work
mohanagr Feb 8, 2024
877272e
some more sat detection work. testing next.
mohanagr Feb 10, 2024
7b7cbe1
debugging and speeding up of coarse xcorr. sat det. automation
mohanagr Feb 12, 2024
d058d48
testing ways to speed up coarse xcorr and sat detection
mohanagr Feb 14, 2024
d0c21ab
add parallel delay numba func. some comments and cleaning
mohanagr Feb 15, 2024
9484479
plotting addition in sat-det, fix paths in tests
mohanagr Feb 19, 2024
d66df75
more robust satdet, better file+tstamp handling in butils, correct ma…
mohanagr Mar 5, 2024
c013ec9
bunch of parallel helper funcs and tests for them
mohanagr Mar 8, 2024
c1b1868
fast but specific transpose utility
mohanagr Mar 8, 2024
db392c8
add capability for arbitrary channel unpacking for 4 bit
mohanagr Mar 8, 2024
3ef5683
snapshot of all work leading upto the detection of clock drift with n…
mohanagr Apr 23, 2024
747ac9c
add genph4.py a simplified script that only deals with mu-chunks. fix…
mohanagr Apr 29, 2024
8bb2521
move all sat pulses to a TOML file to keep better track (for now). ev…
mohanagr May 23, 2024
f190cd9
changes to genph to accept a TOML file. this state has all xcorss ref…
mohanagr May 25, 2024
d531a8e
fix missing self in _assign_channels
mohanagr Jun 8, 2024
16e4c2f
commit some old work on splitting phased and unphased genphases
mohanagr Jun 21, 2024
5ad9fcf
fix the import inside the scripts dir for autocorravg
mohanagr Jun 29, 2024
194a39a
add makefile. gen_phases and .toml file has some input changes, peak…
mohanagr Sep 3, 2024
71ef5ba
remove old, unused gen_phases. rename the current, correct one to gen…
mohanagr Sep 3, 2024
ac9fc1f
merging the timing work from H12024
mohanagr Sep 17, 2024
3a339e5
modify sat utils to return altaz
mohanagr Oct 28, 2024
a91ad96
return az in get_risen_sats
mohanagr Oct 29, 2024
bd73763
extract a sat pass and plot arctic long bl IRI pred
mohanagr Oct 30, 2024
97d9973
generate requirements.txt
mohanagr Nov 14, 2024
728c34f
added tests for checking specnum wrap handling
mohanagr Sep 20, 2024
7ba1faa
commit testing data
mohanagr Sep 20, 2024
fa06b60
add tracking for testing data in git LFS and some minor changes
mohanagr Sep 20, 2024
90aeb8b
add gpu unpacking and related tests. unpack callsign changed to be mo…
mohanagr Oct 8, 2024
cfc9f6c
add specnum wrap tests and one bline autocorr for gpu
mohanagr Oct 16, 2024
2f8109d
upchannelization template
mohanagr Nov 1, 2024
7b045ef
add the cupy pfb/ipfb, pycufft libs, edit makefile
mohanagr Nov 1, 2024
21ee970
working upchannelization
mohanagr Nov 2, 2024
4666e25
committing some previous pfb work
mohanagr Nov 14, 2024
d518af6
start work on porting sat detec to gpu
mohanagr Dec 12, 2024
c7b9dd3
changes from dec24
mohanagr Jan 24, 2025
5a75072
bugfix to satdetect GPU and add 1-bit float unpack GPU
mohanagr Jan 28, 2025
3baf072
changes from Jan 2025 - 1 bit xcorr testing, sat detect gpu, clock of…
mohanagr Feb 5, 2025
aaa298a
test commit
thomasbolder9 Feb 12, 2025
d0d84c0
added paths document
thomasbolder9 Feb 13, 2025
33d05a1
changed paths on satellite detection
thomasbolder9 Feb 13, 2025
90295ea
all antenna cpu xcorr
mohanagr Feb 13, 2025
0281558
add initial GPU support for all ant*pol*time*freq complex xcorr
mohanagr Mar 18, 2025
bea0855
add gpu xcorr testing
mohanagr Mar 19, 2025
acdb02b
re-PFB + avg xcorr GPU. TODO: handle rowcount/missing fraction
mohanagr Mar 20, 2025
a8d3667
add the fitting files for coordinate calculation
thomasbolder9 Mar 26, 2025
44fc327
added manual xcorr notebook to thomas branch
Mar 26, 2025
7735e98
Merge branch 'thomas_dev' of github.com:ALBATROS-Experiment/albatros_…
Mar 26, 2025
88ed2f1
working GPU IPFB+XCORR. can see ORBCOMM phases.
mohanagr Apr 23, 2025
a8c1b16
made path changes, got cupy to work
May 5, 2025
39aa5f9
all antenna cpu xcorr
mohanagr Feb 13, 2025
2c30f41
add initial GPU support for all ant*pol*time*freq complex xcorr
mohanagr Mar 18, 2025
94c874e
add gpu xcorr testing
mohanagr Mar 19, 2025
71356c8
re-PFB + avg xcorr GPU. TODO: handle rowcount/missing fraction
mohanagr Mar 20, 2025
7a722a1
routine update
May 7, 2025
a010362
make bare bones coordinate calibration notebood, heavily annotated ma…
May 9, 2025
c693c5a
prepare for rebase
May 9, 2025
1ee6001
modified sat det gpu, debug version of calibration script
May 12, 2025
384f982
repaired SNR debug plot for satellite_detection_gpu
May 12, 2025
7591bcd
made a debug version of satdet, updated sat det a tiny bit, and shoul…
May 14, 2025
df5a811
worked on sat stuff, got calib coord insight
May 15, 2025
a275379
playing around with time-dependent offsets, and seeing how that can b…
May 15, 2025
c94c5af
created the final script as placeholder. split satellite and observed…
May 19, 2025
c6440b5
integrated some stuff into coord calib script
May 19, 2025
be7deec
merged calib_observed and calib_sats into calib_sats to get the fitti…
May 20, 2025
84963a8
updated sat_det script for ONLY_RUSSIANS option, also have filtering …
May 21, 2025
01ae6e8
prep for pull
May 22, 2025
689eec1
prep for merge
May 22, 2025
bcce676
merge resolutions
May 22, 2025
ad474f4
made satellite detection flags that work, and sat_filtering usable fo…
May 26, 2025
d0b1876
4bit functionality for coordinate calibration
May 28, 2025
6a8323a
integrated fitting into main script for coord calib
May 29, 2025
d4524db
further generalized single-baseline coordinate calibration stuff
May 29, 2025
6e0889f
put all functions into helper, make streamlined single baseline fitti…
Jun 2, 2025
9b776b2
added saving visibility data
Jun 3, 2025
7169c5c
started changing flow. more modules. fitting for some of the saved data
Jun 6, 2025
659a7b5
made everything more modular
Jun 9, 2025
b0fb19a
fully functional modular design, lives on notebooks, but can run one …
Jun 11, 2025
9b668dd
big update
Jun 27, 2025
37d6981
IRLS addition, and documentation latex upload prelim
Jul 3, 2025
ae89a73
updated documentation
Jul 4, 2025
ce93b83
improved the timing chapter of documentation
thomasbolder9 Jul 4, 2025
2548b2f
starting uvdata testing, and adding bash to run all of coordcalib stuff
Jul 9, 2025
9bdcf0f
pyuv
Jul 9, 2025
4ba0114
updated pyuv documentation on variables
thomasbolder9 Jul 10, 2025
bac4dcc
for rebase
Jul 10, 2025
cbd7af2
pyuv integrated for cpu xcorr
Jul 16, 2025
5176e08
gpu into pyuv changes
Aug 11, 2025
98a415b
cleaned up satdet
Aug 18, 2025
654d7e9
working streaming pfb
mohanagr Aug 24, 2025
32fd064
clean up debug prints in pfb utils
mohanagr Aug 24, 2025
363f90a
some more cleanup
mohanagr Aug 24, 2025
76b190d
cleanup pfb test
mohanagr Aug 24, 2025
f1e96ae
PFB cp.fft.rfft -> pycufft.rfft, 100x speedup since no buffer planning
mohanagr Aug 24, 2025
c078a13
remove unnecessary copy(), add ant,pol
mohanagr Aug 24, 2025
d1537cc
satdet changes
Aug 26, 2025
d9324a9
got satdet done, houskeeping old files
Aug 27, 2025
282dcdf
move test* in utils to utils/tests. Add working streaming x-corr, bas…
mohanagr Aug 27, 2025
a4e82f9
finished user friendly satdet script
Aug 28, 2025
6f3be3b
added some xcorr tests
mohanagr Aug 29, 2025
6d6af1a
moved old QC scripts into a dir
mohanagr Aug 29, 2025
a5752ea
some xcorr/ cleanup
mohanagr Aug 29, 2025
823585c
all antenna streaming x-corr
mohanagr Sep 5, 2025
7022b7c
config file for MARS 2025 data. paths in satdet changed for Trillium
mohanagr Sep 5, 2025
18e6186
added to pyuv documentation
thomasbolder9 Sep 6, 2025
5a1f826
removed junk
thomasbolder9 Sep 6, 2025
38cef13
added gitignore
thomasbolder9 Sep 6, 2025
c4a9f66
removed latex aux documents
thomasbolder9 Sep 6, 2025
d5fc0f6
removed more junk
thomasbolder9 Sep 6, 2025
59f231b
remove more junk
thomasbolder9 Sep 6, 2025
6fde3c8
moved sat cxcorr notebook
thomasbolder9 Sep 6, 2025
69cc16a
undid unaffecting change to correlations_gpu.py
thomasbolder9 Sep 6, 2025
8dc502e
made changes to init and such for new trillium venv
thomasbolder9 Sep 7, 2025
758afa9
updates satdet json output and removed inter-day compatibility
thomasbolder9 Sep 8, 2025
d15a403
made some sanity check notebooks
thomasbolder9 Sep 10, 2025
a3e73ab
added the get_avg_fast2 compatibility for sanity checker. will help m…
thomasbolder9 Sep 10, 2025
6b8470c
vismaker module now works, can spit out phases for any two baselines.…
thomasbolder9 Sep 11, 2025
cc99226
worked on vis plot to make better usability
thomasbolder9 Sep 14, 2025
f93bde3
rudimentary file simultaneity checker with plotting.
thomasbolder9 Sep 15, 2025
e718d4e
made get_present_files stuff better
thomasbolder9 Sep 16, 2025
f5d4ba6
made plotmakers and improved sanity checking abilities
thomasbolder9 Sep 22, 2025
9115d6c
removing bugs from satdet_modular, to do with multiple sats that are …
thomasbolder9 Sep 23, 2025
e6529b1
improved satdet modular version, added some figures to the figures.py…
thomasbolder9 Sep 28, 2025
fec0b3a
moved documentation to scratch for merge with dev
thomasbolder9 Sep 28, 2025
07f45eb
added requirements for current venv
thomasbolder9 Sep 28, 2025
34b68c1
added documentation to save to my mac via repo
thomasbolder9 Sep 28, 2025
749ef06
removed documentation again
thomasbolder9 Sep 28, 2025
6eeddb2
removed fitting from directory, for purposes of merging. there is a c…
thomasbolder9 Sep 28, 2025
f1ad7ff
put sim file data function as an ipynb checkpoint
thomasbolder9 Sep 28, 2025
2136ebf
latest gpu all ant xcorr updates
mohanagr Oct 9, 2025
2d58c17
meeting troubleshoot satdet
thomasbolder9 Oct 9, 2025
23f7410
set up satxcxcorr testing, getting ready to checkout gpu xcorr
thomasbolder9 Oct 11, 2025
bebf4aa
added xcorr_gpu_tb framework for uvh5 onto thomas_dev
thomasbolder9 Oct 13, 2025
f83b0aa
added framework for saving xcorr data to uvh5 file format
thomasbolder9 Oct 13, 2025
4737cc9
cleaned up orbcomm direcotry, functional satdet_testing module. TODO-…
thomasbolder9 Oct 13, 2025
a648c32
split up satutils, getting twoblineplotter to work
thomasbolder9 Oct 13, 2025
b279a1e
adding streaming correlator to this branch
thomasbolder9 Oct 13, 2025
d58209c
functional two-bline and satdet-tester
thomasbolder9 Oct 14, 2025
1cc045e
found way to compare SNRs, made two bline plotter work
thomasbolder9 Oct 15, 2025
bbd52ec
small updates to sat utils and satdet testing
thomasbolder9 Oct 15, 2025
557278e
satdet testing changes
thomasbolder9 Oct 15, 2025
106ca34
functional sim lst, got satdet to consume less memory, exported getti…
thomasbolder9 Oct 18, 2025
9d50cd0
find the edge case bug in get_file_from_timestamp. fix in BDC iterator
mohanagr Oct 17, 2025
1c756a7
add chunking for disk storage
mohanagr Oct 20, 2025
b4614af
add a sample xcorr json file
mohanagr Oct 20, 2025
bea0763
prep for pulling dev
thomasbolder9 Oct 22, 2025
5784d65
pulled dev
thomasbolder9 Oct 22, 2025
aacea6b
tring out uvh5 (blt,nfreq,npol)-style saving
mohanagr Oct 23, 2025
87c824b
benchmarking pyuv, improved satdet testing, improved two_bline_plotter
thomasbolder9 Oct 26, 2025
b1ca49b
cleanup
thomasbolder9 Oct 28, 2025
484bdcd
add file_size_limit to visibility part files. fix specnum_start in ma…
mohanagr Oct 31, 2025
f72b50b
upgraded satdet stuff. iterative detection, improved figs, pulse anal…
thomasbolder9 Nov 10, 2025
a711515
cleanup, snr fitting structure, added flicker stuff initial commit
thomasbolder9 Nov 10, 2025
abec69a
nothingburger. just changed paths and changed get_sat_delay to old ve…
thomasbolder9 Nov 16, 2025
11e868e
fix get_init_info_all_ant to start from antennas other than 0. add fi…
mohanagr Nov 18, 2025
00971ec
functional fine-timing single pulse no uppchannelization visualizer
thomasbolder9 Nov 18, 2025
c0add12
added framework for uvh5 saving. off-by-one row problem not resolved
thomasbolder9 Nov 25, 2025
5157d8b
about to change reforming in xcorr
thomasbolder9 Dec 4, 2025
dc36c96
added sql playground, improved pyuv
thomasbolder9 Dec 27, 2025
285e8c9
added oversampled fringes/phase plotter, added opening uvh5 playground
thomasbolder9 Dec 28, 2025
b196659
merge for fine timing correlator
thomasbolder9 Dec 28, 2025
98f25ff
seemingly functional timing discrepancy method, with test case in ipy…
thomasbolder9 Jan 10, 2026
4a64d8d
added snr plot during day (lst synced) and black-box ttime discrepanc…
thomasbolder9 Jan 11, 2026
ea8e27b
added full batch day discrepancy finder
thomasbolder9 Feb 15, 2026
e494e50
working discrep stuff, with coherency option
thomasbolder9 Mar 11, 2026
ceabd37
started automating fine timing
thomasbolder9 Mar 12, 2026
2611e49
automated fine timing
thomasbolder9 Mar 14, 2026
1dc375a
little cleanup
thomasbolder9 Mar 22, 2026
bd1847c
automate fine timing
thomasbolder9 Apr 11, 2026
f5773f9
small changes finetiming
thomasbolder9 Apr 12, 2026
b9c0dd2
added coherence, fixed discrep and finetiming
thomasbolder9 Apr 17, 2026
7a84fb2
merge commit with dev
thomasbolder9 Apr 17, 2026
aaa19dc
quick cleanup
thomasbolder9 Apr 17, 2026
f400aa9
added source beamform notebook
thomasbolder9 May 5, 2026
685fd11
added source beamform notebook pt2
thomasbolder9 May 5, 2026
62ef9de
merge commit to fix specnum overflow error
thomasbolder9 May 5, 2026
758c555
minor stuff before pulling again
thomasbolder9 May 5, 2026
309f969
changed clean beamform
thomasbolder9 May 5, 2026
4f0be92
bring in changes made by Mohan
thomasbolder9 May 5, 2026
901d636
changed get init info all ant
thomasbolder9 May 6, 2026
026232f
mohan changes to overflow issue
thomasbolder9 May 6, 2026
3888daa
before fixing bug, added UTC maker and pulse list maker
thomasbolder9 May 8, 2026
479f8ac
added misc functions to finish off pipeline
thomasbolder9 May 13, 2026
164762d
added peak guess to finetiming, made summer_school notebook
thomasbolder9 May 20, 2026
4de0af3
cleanup
thomasbolder9 May 22, 2026
c69c41c
cleanup
thomasbolder9 May 22, 2026
4b17cd9
to fix detached head I'm merging branch 'tmp' into thomas_dev
thomasbolder9 May 22, 2026
1b4fa4c
added basic batch maker
thomasbolder9 Jun 1, 2026
ed21a50
added batch getter, fixed satdet debug plotting
thomasbolder9 Jun 3, 2026
f511ed4
satdet bug push
thomasbolder9 Jun 8, 2026
d5b6f70
upgraded satdet compatibility. satdet works verified to work the same…
thomasbolder9 Jun 10, 2026
9a5fc80
satdet better configured (automatic to pulselist), finetiming sim com…
thomasbolder9 Jun 18, 2026
6d5e98f
brought macbook up to date, added old documentation
thomasbolder9 Jun 24, 2026
267728f
added to docs
thomasbolder9 Jun 26, 2026
f2fe91a
start on API docs. merged helper_discrep into helper_finetiming succe…
thomasbolder9 Jul 6, 2026
5239652
reorganization changes for improved documentation
thomasbolder9 Jul 7, 2026
dd16385
latest changes to pipeline.md
thomasbolder9 Jul 7, 2026
0c3dfaf
small mods, before merging with mohan's stuff
thomasbolder9 Jul 8, 2026
99a067b
removed stuff from being tracked
thomasbolder9 Jul 8, 2026
ab542ca
quick import changes to pulse discrep for stash
thomasbolder9 Jul 9, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 26 additions & 0 deletions .github/workflows/latex.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
name: Build LaTeX PDF

on:
push:
paths:
- 'documentation/**'
workflow_dispatch:

jobs:
build:
runs-on: ubuntu-latest

steps:
- name: Checkout repo
uses: actions/checkout@v3

- name: Set up LaTeX
uses: xu-cheng/latex-action@v2
with:
root_file: documentation/main.tex

- name: Upload PDF
uses: actions/upload-artifact@v4
with:
name: PDF
path: documentation/main.pdf
13 changes: 13 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,17 @@
*.png
*.swp
*.raw
*.jpeg

*.pdf
*.out
*.log
*.synctex.gz
*.toc
*.aux
*.fls
*.fdb_latexmk

plots/
usage.txt
plot_one_file_scaled.py
Expand All @@ -15,3 +26,5 @@ devenv/
env/
html/pdoc/

.ipynb_checkpoints/
__pycache__/
44 changes: 0 additions & 44 deletions .legacy/events.txt

This file was deleted.

20 changes: 0 additions & 20 deletions .legacy/radio.sh

This file was deleted.

12 changes: 0 additions & 12 deletions .legacy/radio_notes.txt

This file was deleted.

Binary file removed ALBATROS plotting.pdf
Binary file not shown.
7 changes: 0 additions & 7 deletions all_quick_spectra.sh

This file was deleted.

10 changes: 0 additions & 10 deletions build_docs.sh

This file was deleted.

Binary file added core.ood009.git.547742
Binary file not shown.
177 changes: 177 additions & 0 deletions docs/pipeline.md

Large diffs are not rendered by default.

Loading