Skip to content

Implement Redis caching layer for GitHub API ingestion to prevent rate limiting #43

Description

@SHAURYASANYAL3

Context

Right now, Forge-Lens fetches data directly from the GitHub API on demand. This is causing us to hit rate limits incredibly fast when rendering the dashboard for users with many repositories, leading to 403 Forbidden errors and a broken UI.

Requirements

  • Implement a caching layer using Redis (e.g., ioredis) for all GitHub API outbound calls.
  • Cache repository metadata for 1 hour, and PR/issue data for 15 minutes.
  • Add a fallback mechanism so that if Redis is down, we fail gracefully rather than crashing the app.
  • Update the Inngest jobs to refresh the cache in the background.

Why this is awesome

This is a core architectural improvement. By implementing this, you will single-handedly solve our biggest stability issue and improve the dashboard load time by over 80%. If you want to claim this, comment .take below!

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions