Create File Upload and Storage Module

[memplethee-lab]

Overview

Implement a file upload module that handles file uploads, storage, and retrieval with support for multiple storage backends and security validation.

Direction

This module should provide:

• File upload with size and type validation
• Support for multiple storage backends (S3, local, Azure Blob)
• Secure file storage with encryption
• Virus scanning for uploaded files
• Image optimization and thumbnail generation
• File metadata extraction and indexing
• Secure file download with expiring URLs
• Cleanup and garbage collection of orphaned files

Implementation Details

The file upload module should provide a unified interface for multiple storage backends and handle security concerns like file type validation, size limits, and content scanning.

Acceptance Criteria

• File uploads validate file type and size before processing
• Files are stored securely with proper access controls
• Multiple storage backends are supported (S3, local, Azure)
• Virus scanning runs on all uploaded files
• Images are optimized and thumbnails generated
• File metadata is extracted and searchable
• Download URLs expire after configurable time period
• Orphaned files are cleaned up periodically
• Upload progress tracking works for large files
• File module tests cover all storage backends

[Scepter00]

Hi! I'd like to work on this issue.

I have experience building backend infrastructure with a focus on observability, performance, and production readiness. This issue is particularly interesting because it brings together monitoring, metrics collection, and health reporting into a unified framework that will make the system easier to operate and troubleshoot.

My approach will be to build a modular monitoring layer that collects metrics through middleware while also providing decorators for instrumenting application specific operations. I'll implement Prometheus compatible metrics, HTTP performance metrics such as latency, throughput, and status codes, system metrics for CPU, memory, and disk usage, as well as support for custom business metrics.

In addition, I'll implement health check endpoints, configurable alert thresholds, historical metrics retention, and a dashboard that exposes key performance indicators in a clear and actionable way. The design will emphasize extensibility so new metrics and instrumentation points can be added with minimal effort.

To ensure reliability, I'll write comprehensive tests covering metrics collection, labeling, aggregation, health reporting, alert configuration, retention behavior, and dashboard accuracy. In the PR, I'll document the monitoring architecture, instrumentation strategy, metrics model, configuration options, and testing approach.

I'd be happy to take ownership of this issue and ensure the implementation meets all of the acceptance criteria.

[Bamzy123]

I have ex creating files upload and storage module and I'll submit PR within 2 days max.

[mxrtins04]

Hi maintainer, can i be assigned this issue pleasee?