[Feature] Please add a configurable Rate Limit Controller to control API calling frequency.

[zhengr]

Version

v0.260709.1

OS & Architecture

Linux x86_64

Category

Protocol

Scenario

Currently, when the rate limit is reached, the request fails immediately. For applications with agents, automation workflows, or multiple concurrent users, this can easily trigger repeated failures.

---

Proposed Feature

Please add a configurable Rate Limit Controller to control API calling frequency.

The system should allow users to configure:

• Maximum requests per minute (RPM)
• Maximum requests per second
• Maximum concurrent API requests
• Daily request limit
• Queue behavior when the limit is reached
• Automatic retry with exponential backoff after HTTP 429 errors

---

Example Configuration

rate_limit:
  enabled: true

  requests_per_minute: 10
  requests_per_second: 1

  max_concurrent_requests: 2

  daily_request_limit: 500

  on_limit_reached:
    strategy: queue   # queue | reject

  retry:
    enabled: true
    max_attempts: 5
    initial_delay: 2
    max_delay: 60

### Proposed Solution

_No response_