Add simpler distributed runtime (HostWorker/DistWorker) design#1
Open
hw-native-sys-bot wants to merge 3 commits into
Open
Add simpler distributed runtime (HostWorker/DistWorker) design#1hw-native-sys-bot wants to merge 3 commits into
hw-native-sys-bot wants to merge 3 commits into
Conversation
Comprehensive design doc covering Phase 2 HostWorker implementation: - Unified IWorker interface (ChipWorker/SubWorker/DistWorker) - DistWorker scheduling engine with TensorMap/Ring/Scope/Scheduler - HostSubWorker fork+shm parallel execution with zero-copy tensors - Worker factory API and usage examples (L2-L4) - Platform services .so separation design - PR split plan and relationship with Linqu distributed runtime Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Convert the entire document from Chinese to English to match the existing documentation style in this repository. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Remove: implementation progress table, key types, platform services, file layout, and PR split plan sections - Keep only design and usage/examples - Clarify that simpler IS the implementation of Linqu runtime Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
simplerPhase 2 distributed runtime (HostWorker / DistWorker)simpler/.docs/design documents:UNIFIED_RUNTIME_PLAN.md,PHASE2_HOST_WORKER.md,HOSTSUB_FORK_SHM_DESIGN.md,PLATFORM_SERVICES_DESIGN.mdDocument Scope
Architecture
ChipWorker(L2 device) /SubWorker(fork+shm Python) /DistWorker(L3+ orchestration)ready_queue+completion_queue+ CV notificationUsage
Worker(level=N, ...)factory API with symmetric interface across all levelsImplementation Plan
Relationship with Linqu
linqu_runtime_design.md§3.1: simpler L3 extensionChipBackendadapterTest plan
simpler/.docs/source documentslinqu_runtime_design.md🤖 Generated with Claude Code