negative result in Prompt Throughput (tokens/s)

[syheliel]

Following code is tested under SiliconFlow, can also be reproduced in OpenRouter

BASE_URL="http://api.siliconflow.cn/v1/"
API_KEY="sk-XXXX"
./llmapibenchmark_linux_amd64 \
  --base-url "$BASE_URL" \
  --api-key "$API_KEY" \
  --model "Qwen/Qwen3.5-4B" \
--max-tokens 512

[Yoosu-L]

It looks like this might have been addressed in the latest release. You can check out v1.0.8 to see if it resolves the issue for you.