Skip to content

docs: mark RuntimeConfig::chunk_emb_workers as currently unused - #14

Open
attevon-admin wants to merge 2 commits into
avencera:masterfrom
attevon-llc:docs/chunk-emb-workers-reserved
Open

docs: mark RuntimeConfig::chunk_emb_workers as currently unused#14
attevon-admin wants to merge 2 commits into
avencera:masterfrom
attevon-llc:docs/chunk-emb-workers-reserved

Conversation

@attevon-admin

Copy link
Copy Markdown

Closes #13.

Confirmed by grep across the whole crate: no code path reads RuntimeConfig::chunk_emb_workers on either the CUDA or CoreML execution mode — only the sibling chunk_emb_compute_units field is consumed, and only under the coreml feature. This documents the gap rather than leave the field's purpose implied by its name, since actually wiring up a worker pool is a bigger design question than we wanted to guess at in a doc-only PR. Happy to take a swing at the real implementation if there's a preferred shape (rayon vs std::thread, where the pool should live).

Confirmed by grep across the whole crate: no code path reads
RuntimeConfig::chunk_emb_workers on either the CUDA or CoreML execution
mode. Only the sibling chunk_emb_compute_units field is consumed, and
only under the coreml feature. Document the gap rather than leave the
field's purpose implied by its name (closes avencera#13's underlying confusion
until it's actually wired up).
@coderabbitai

coderabbitai Bot commented Aug 25, 2026

Copy link
Copy Markdown

Warning

Review limit reached

Next included review available in 21 minutes.

View limit details

Limit details: You’ve used all 2 included reviews currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 350fbb38-aa39-45ea-ac61-04b284bae6ce

📥 Commits

Reviewing files that changed from the base of the PR and between b0756b1 and afae222.

📒 Files selected for processing (1)
  • src/pipeline/config.rs

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@greptile-apps

greptile-apps Bot commented Aug 25, 2026

Copy link
Copy Markdown

Greptile Summary

The PR clarifies that RuntimeConfig::chunk_emb_workers is currently unused and that changing it has no runtime effect.

  • Expands the field’s API documentation.
  • Records that worker-pool support remains a future implementation concern.

Confidence Score: 5/5

The PR appears safe to merge because it changes documentation only and accurately describes current behavior.

The changed comment does not alter runtime behavior, and the documented field is passed through configuration plumbing without being consumed by execution logic.

Important Files Changed

Filename Overview
src/pipeline/config.rs Documentation-only clarification accurately describes the existing unused runtime configuration field.

Reviews (1): Last reviewed commit: "docs: mark chunk_emb_workers as currentl..." | Re-trigger Greptile

chunk_emb_compute_units (the sibling field) is already gated to the coreml
feature, and CoreML sessions can only run one at a time - so this field
almost certainly exists to parallelize chunk embedding across several
single-threaded CoreML workers, not to control CUDA concurrency. CUDA
already gets concurrency a different way, from shared mutex-protected ORT
sessions (see the shared-sessions PR). Nothing to wire up on the CUDA path.
@attevon-admin

Copy link
Copy Markdown
Author

Pushed a follow-up: dug into why this field exists rather than leaving it a bare 'unused' note. Its sibling field, chunk_emb_compute_units, is already gated to the coreml feature, and CoreML sessions can only run one at a time (per ONNX Runtime's CoreML EP constraints) — so chunk_emb_workers almost certainly exists to parallelize chunk embedding across several single-threaded CoreML workers, not to control CUDA concurrency. CUDA already gets concurrency a different way (shared, mutex-protected ORT sessions — see the shared-sessions PR). So there's nothing to wire up on the CUDA path; this doc clarification should be the complete fix unless there's CoreML worker-pool work planned that I'm not aware of.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

--chunk-emb-workers is a no-op on the CUDA path

2 participants