Skip to content

ls: Fail nicer if duct logs are in git annex, not fetched #436

Description

@asmacdo
✘  ~/datasets/ds000007-mriqc   base  pwd
/home/austin/datasets/ds000007-mriqc
 ~/datasets/ds000007-mriqc   base  git remote -v
origin	https://cerebra.fz-juelich.de/f.hoffstaedter/ds000007-mriqc (fetch)
origin	https://cerebra.fz-juelich.de/f.hoffstaedter/ds000007-mriqc (push)
 ~/datasets/ds000007-mriqc   base  con-duct ls logs/duct/*         
2026-05-29T12:11:19-0500 [INFO    ] con-duct: No .env files found
Traceback (most recent call last):
  File "/home/austin/.local/bin/con-duct", line 6, in <module>
    sys.exit(main())
             ~~~~^^
  File "/home/austin/.local/lib/python3.13/site-packages/con_duct/cli.py", line 547, in main
    sys.exit(execute(args))
             ~~~~~~~^^^^^^
  File "/home/austin/.local/lib/python3.13/site-packages/con_duct/cli.py", line 473, in execute
    result = args.func(args)
  File "/home/austin/.local/lib/python3.13/site-packages/con_duct/ls.py", line 233, in ls
    run_data_raw = load_duct_runs(info_files, args.eval_filter)
  File "/home/austin/.local/lib/python3.13/site-packages/con_duct/ls.py", line 76, in load_duct_runs
    with open(info_file) as file:
         ~~~~^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_info.json'

Error resolves if you datalad get them.

 ✘  ~/datasets/ds000007-mriqc   base  datalad get logs/duct/
get(ok): logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_info.json (file) [from origin...]             
get(ok): logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_stderr (file) [from origin...]                
get(ok): logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_stdout (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_usage.json (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T04.03.42-2528807_info.json (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T04.03.42-2528807_stderr (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T04.03.42-2528807_stdout (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T04.03.42-2528807_usage.json (file) [from origin...]
get(ok): logs/duct/sub-01_2025.10.10T00.36.37-3899234_info.json (file) [from origin...]
get(ok): logs/duct/sub-01_2025.10.10T00.36.37-3899234_stderr (file) [from origin...]
  [78 similar messages have been suppressed; disable with datalad.ui.suppress-similar-results=off]
get(ok): logs/duct (directory)
action summary:
  get (ok: 89)
 ~/datasets/ds000007-mriqc   base  con-duct ls logs/duct/*
2026-05-29T12:13:02-0500 [INFO    ] con-duct: No .env files found
PREFIX                                 COMMAND                               EXIT_CODE WALL_CLOCK_TIME PEAK_RSS
logs/duct/mriqc-group-stats_2025.10... singularity exec -W /tmp/singtmp.Z... 0         7.088 sec       327.4 MB
logs/duct/mriqc-group-stats_2025.10... singularity exec -W /tmp/singtmp.j... 0         2.490 sec       141.1 MB
logs/duct/sub-01_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.k... 0         2080.558 sec    8.6 GB  
logs/duct/sub-02_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.Z... 0         1975.682 sec    7.1 GB  
logs/duct/sub-03_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.C... 0         2216.349 sec    7.1 GB  
logs/duct/sub-04_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.P... 0         2204.206 sec    7.1 GB  
logs/duct/sub-05_2025.10.10T01.19.4... singularity exec -W /tmp/singtmp.N... 0         1931.617 sec    7.1 GB  
logs/duct/sub-06_2025.10.10T00.36.4... singularity exec -W /tmp/singtmp.Z... 0         1991.743 sec    7.1 GB  
logs/duct/sub-07_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.n... 0         2586.044 sec    7.1 GB  
logs/duct/sub-08_2025.10.10T00.36.4... singularity exec -W /tmp/singtmp.w... 0         2084.968 sec    7.1 GB  
logs/duct/sub-09_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.r... 0         1597.623 sec    7.1 GB  
logs/duct/sub-10_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.X... 0         2224.364 sec    7.1 GB  
logs/duct/sub-11_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.M... 0         2003.605 sec    10.9 GB 
logs/duct/sub-12_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.y... 0         2010.894 sec    7.1 GB  
logs/duct/sub-13_2025.10.10T00.36.2... singularity exec -W /tmp/singtmp.l... 0         2118.546 sec    7.2 GB  
logs/duct/sub-14_2025.10.10T00.37.1... singularity exec -W /tmp/singtmp.c... 0         2610.599 sec    7.1 GB  
logs/duct/sub-15_2025.10.10T00.36.2... singularity exec -W /tmp/singtmp.Y... 0         1998.117 sec    7.1 GB  
logs/duct/sub-16_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.i... 0         2170.166 sec    7.1 GB  
logs/duct/sub-17_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.o... 0         2230.344 sec    7.1 GB  
logs/duct/sub-18_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.W... 0         1897.638 sec    7.1 GB  
logs/duct/sub-19_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.3... 0         2234.384 sec    7.1 GB  
logs/duct/sub-20_2025.10.10T00.36.2... singularity exec -W /tmp/singtmp.B... 0         2216.319 sec    7.1 GB  
 ~/datasets/ds000007-mriqc   base  

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions