Skip to content

[Auto] session_failure: The request was malformed and could not be processed. oMLX prefill memory guard  #558

Description

@igorcosta

Auto-Reported Error

Field Value
Error Type session_failure
CLI Version 0.9.7-alpha.1b28fda
Model orcarouter--Qwen3.8-27B-4bit
Provider mlx
Platform darwin 27.0.0
Session ID 36dbf2f7-2879-44e7-a86d-ded9f256994b-1788509715157
Report ID V168JOF2wdF55aqTOyz2S

Error Message

The request was malformed and could not be processed.
oMLX prefill memory guard rejected this prompt: Prefill would require ~55.12 GB peak (current 29.69 GB + KV+SDPA 25.43 GB) but metal_cap ceiling is 49.25 GB. Raise kernel iogpu.wired_limit_mb in Terminal (currently caps Metal at 51.84 GB), or reduce context length. To continue, set Memory Guard to aggressive, raise the custom memory guard ceiling, free system memory, or compact/reduce context.

Stack Trace

ApiError: The request was malformed and could not be processed.
oMLX prefill memory guard rejected this prompt: Prefill would require ~55.12 GB peak (current 29.69 GB + KV+SDPA 25.43 GB) but metal_cap ceiling is 49.25 GB. Raise kernel iogpu.wired_limit_mb in Terminal (currently caps Metal at 51.84 GB), or reduce context length. To continue, set Memory Guard to aggressive, raise the custom memory guard ceiling, free system memory, or compact/reduce context.
    at makeError (/$bunfs/root/autohand-macos-arm64:72265:22)
    at async makeRequest (/$bunfs/root/autohand-macos-arm64:73218:37)
    at async complete (/$bunfs/root/autohand-macos-arm64:73175:38)
    at async runAgentReactLoop (/$bunfs/root/autohand-macos-arm64:253836:45)
    at processTicksAndRejections (native:7:39)

Session Context

  • Conversation length: 35 messages
  • Context usage: 91%
  • Last tools used: todo_write, write_file, write_file, write_file, write_file, todo_write, run_command
  • Retry attempt: 0 / 3

Additional Context

{
  "retryAttempt": 0,
  "maxRetries": 3
}

Auto-reported by Autohand CLI v0.9.7-alpha.1b28fda | Report ID: V168JOF2wdF55aqTOyz2S

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions