Skip to content

[QoL] Add generated text summary to top of output file#116

Merged
benchislett merged 2 commits into
mainfrom
qol-output-file
Aug 27, 2025
Merged

[QoL] Add generated text summary to top of output file#116
benchislett merged 2 commits into
mainfrom
qol-output-file

Conversation

@benchislett

Copy link
Copy Markdown
Contributor

Overview

Include the generated_text section from each request in the top of the output-file. This makes it much easier to check the response quality at a glance, and correspond them by line-number to the i-th prompt.

Other

  • Allow small output token lengths as long as they are < 1. This was formerly a sanity check for ShareGPT data but isn't really needed anymore. Now we can run with --output-token-distribution same 1 to test prefill-only workloads.

Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
@benchislett benchislett self-assigned this Aug 27, 2025
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
@benchislett
benchislett merged commit 695da06 into main Aug 27, 2025
5 checks passed
@benchislett
benchislett deleted the qol-output-file branch August 27, 2025 20:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants