Logging, worker tmp clean, and inference-service tests - #48
Open
AraNge wants to merge 7 commits into
Open
Conversation
- Updated README.md/System Architecture to reflect removal of PostgreSQL. - Added sections for Reliability & Resiliency detailing the new retry logic. - Updated Graceful Failure Handling documentation with 404, 503, and 500 status codes. - Refined Request Life Cycle to include model-fetch retries and multi-process handoff. - Synchronized Configuration table with current MinIO environment variables.
… all services - Create shared JSON formatter for consistent log format - Add correlation ID propagation to orchestrator, training worker, inference service, and dashboard - Implement request tracking with X-Correlation-ID header - Add comprehensive logging tests for all services - Log key events: requests, job processing, training pipeline, model persistence, and errors
- Added Grafana Loki Docker Driver for all services - Implemented structured JSON logging with custom Formatter - Added persistent volumes for Loki and Grafana data - Updated docker-compose with automated Loki health checks and retries - Update Dockerfiles to use root context (.) for better build management - Add logging verification tests for all microservices - Implement correlation_id injection for Streamlit and FastAPI
- Implement `cleanup_temp_files` - Added comprehensive integration tests for job processing lifecycle - Verified `finally` block execution for guaranteed file cleanup on success and failure
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Pull Request: Structured Logging Implementation
Description
Implementing structured logging, automated resource cleanup, and a comprehensive test suite.
Related Issues
Fixes #43
Affected Components
Changes Made
Structured Logging & Aggregation (Task 1)
JSONFormatterand setup_logging function.Automated Resource Cleanup (Task 2)
Inference Service Testing (Task 3)
Testing Performed
docker-compose up