Skip to content

Commit 564fe4b

Browse files
committed
fix: process properties first
The properties log has an unusual amount of streams, which makes syskit-log hit open file limits. Processing it first makes sure we hit that limit early instead of after an hour or two of processing.
1 parent 84fa117 commit 564fe4b

1 file changed

Lines changed: 5 additions & 1 deletion

File tree

‎lib/syskit/log/datastore/normalize.rb‎

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -436,7 +436,11 @@ def normalize(
436436
/\.\d+\.log(?:\.zst)?$/.match(_1.basename.to_s).pre_match
437437
end
438438

439-
result = logfile_groups.map do |key, files|
439+
properties_files = logfile_groups.delete("properties")
440+
groups = logfile_groups.to_a
441+
groups.unshift(["properties", properties_files]) if properties_files
442+
443+
result = groups.map do |key, files|
440444
reporter.info "Normalizing group #{key}"
441445
group_result = normalize_logfile_group(
442446
files, output_path: output_path, reporter: reporter

0 commit comments

Comments
 (0)