Skip to content

Formal fix for a PD case#1368

Draft
yeonsily wants to merge 6 commits into
dev/ace_productionfrom
yyoon/prefill_fix
Draft

Formal fix for a PD case#1368
yeonsily wants to merge 6 commits into
dev/ace_productionfrom
yyoon/prefill_fix

Conversation

@yeonsily

@yeonsily yeonsily commented Jun 4, 2025

Copy link
Copy Markdown

No description provided.

Comment thread examples/lmcache/disagg_prefill_lmcache_v1/disagg_vllm_launcher_gaudi_lm.sh Outdated
Comment thread examples/lmcache/disagg_prefill_lmcache_v1/disagg_vllm_launcher_gaudi_lm.sh Outdated
Comment thread vllm/v1/worker/hpu_model_runner.py Outdated

# This is decode
if not is_decoder_only:
if not self.is_decoder_only:

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where this from?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@libinta libinta left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for script only change lm related

@michalkuligowski michalkuligowski left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no update for 1 month converting to draft

@michalkuligowski michalkuligowski marked this pull request as draft July 25, 2025 11:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants