Rewrite it in Rust.

[apognu]

Summary by CodeRabbit

• New Features

  • Implemented Rust-based API service with authentication, health checks, and detection endpoints

• Chores

  • Migrated CI/CD pipelines to Rust-focused workflows with cargo-based checks and builds
  • Updated Docker build to use Rust multistage compilation with optimized runtime image
  • Added code formatter configuration
  • Updated ignore patterns for build artifacts and model files
  • Removed legacy Python test suite and dependencies

[Pascal-Delange]

I'll grant you this one, rusty crab !

[Pascal-Delange]

beautiful

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 1235cd4b-c468-47eb-81b7-afbefe50a5ba

📥 Commits

Reviewing files that changed from the base of the PR and between 1a6705e and f03f4e4.

⛔ Files ignored due to path filters (3)

• Cargo.lock is excluded by !**/*.lock
• poetry.cpu.lock is excluded by !**/*.lock
• poetry.gpu.lock is excluded by !**/*.lock

📒 Files selected for processing (20)

• .dockerignore
• .github/workflows/build.yml
• .github/workflows/docker.yml
• .github/workflows/production.yml
• .github/workflows/staging.yml
• .gitignore
• .rustfmt.toml
• Cargo.toml
• Dockerfile
• Makefile
• README.md
• logger.py
• main.py
• pyproject.cpu.toml
• pyproject.gpu.toml
• src/auth.rs
• src/inference.rs
• src/main.rs
• src/trace.rs
• test_main.py

---

📝 Walkthrough

Walkthrough

This PR migrates the NER service from Python (FastAPI/Poetry) to Rust (Axum), replacing the entire API implementation, adding structured tracing-based logging, Rust-focused CI/CD workflows, and Rust multistage Docker builds.

Changes

Python-to-Rust Service Migration

Layer / File(s)	Summary
Project Foundation & Manifests Cargo.toml, .rustfmt.toml, README.md	Rust project manifest with Axum, GLiNER, and logging dependencies; Rust formatter configuration with 200-character line width; README title placeholder updated.
CI/CD Workflows .github/workflows/build.yml, .github/workflows/docker.yml, .github/workflows/staging.yml, .github/workflows/production.yml	Replaced Python/Poetry test workflow with Rust-based cargo check/lint/build matrix; updated docker workflow to use matrix strategy instead of inputs; staging and production workflows now depend on docker job for image builds.
Container Build & Ignore Files Dockerfile, .dockerignore, .gitignore, Makefile	Switched from Python distroless runtime to Rust multistage build with base (model cloning), builder (cargo build), and distroless runtime; ignore patterns updated to exclude /model and /target; download target added for HuggingFace model fetching.
Core API & Request Handling src/main.rs	Implemented Axum async web service with AppState (API key), routes for health check and /detect endpoint, JSON request/response serialization, error handling (empty results and inference failures return HTTP 500).
Authentication & Middleware src/auth.rs, src/trace.rs	Bearer token extractor that validates against AppState.api_key; structured tracing initialization with JSON formatting and request-level API logger recording timestamp, IP, method, path, status, and latency.
Model & Inference src/inference.rs	Lazy-initialized GLiNER model with optional CUDA support; label set from GLINER_LABELS environment variable; inference function wrapping model.infer() calls with anyhow error context.
Removed Python Code main.py, logger.py, test_main.py, pyproject.cpu.toml, pyproject.gpu.toml	Deleted entire FastAPI application, JSON logging middleware, HTTP tests, and Poetry project configurations.

Sequence Diagram

sequenceDiagram
    participant Client
    participant Axum as Axum Router
    participant Auth as Auth Extractor
    participant Trace as API Logger
    participant Inference as Inference Engine
    participant Model as GLiNER Model

    Client->>Axum: POST /detect + Bearer Token
    Axum->>Trace: Log request (timestamp, method, path)
    Trace->>Auth: Forward request with headers
    Auth->>Auth: Extract Bearer token from Authorization header
    alt Token Valid
        Auth->>Inference: Return Auth, pass to handler
        Inference->>Model: Call infer(text)
        Model->>Model: Lazy-load GLiNER + CUDA if enabled
        Model-->>Inference: Return Vec<Vec<Span>>
        Inference->>Inference: Map spans to Output { kind, text }
        Inference-->>Axum: (StatusCode::OK, JSON array)
    else Token Missing/Invalid
        Auth-->>Axum: Reject (HTTP 401)
    end
    Axum->>Trace: Log response (status, latency, size)
    Trace-->>Client: HTTP response with result

Loading

Estimated Code Review Effort

🎯 4 (Complex) | ⏱️ ~45 minutes

Suggested Labels

rust, migration, refactor, ci/cd, docker

---

From Python's halls we bid farewell,
Where FastAPI did gently dwell;
Now Axum's fire burns true and bright,
With Rust's own speed and zero-copy might—
A humble service, reborn in flame, 🦀⚡

✨ Finishing Touches

📝 Generate docstrings

• Create stacked PR
• Commit on current branch

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch feat/rerite-it-in-rust

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}