Skip to content

Fix OOM crashes caused by PIL Image file handle memory leaks - #133

Open
VisionExpo wants to merge 1 commit into
mainfrom
fix-oom-memory-leaks-8249923188306363804
Open

Fix OOM crashes caused by PIL Image file handle memory leaks#133
VisionExpo wants to merge 1 commit into
mainfrom
fix-oom-memory-leaks-8249923188306363804

Conversation

@VisionExpo

@VisionExpo VisionExpo commented Sep 5, 2026

Copy link
Copy Markdown
Owner

User description

This PR fixes an Out-Of-Memory (OOM) error that causes the application to crash over time. The issue was due to unclosed PIL.Image file handles leaking memory and file descriptors. By wrapping Image.open() calls in a with context manager in both the Streamlit app and the preprocessing pipeline, file resources are now safely released. Also includes a minor variable initialization fix in the evaluator.


PR created automatically by Jules for task 8249923188306363804 started by @VisionExpo


CodeAnt-AI Description

Prevent image-processing memory leaks and evaluation failures

What Changed

  • Uploaded images are fully loaded and copied before their file resources are released, so the preview continues to render safely
  • Preprocessed images now release their file handles after loading, reducing memory and descriptor leaks during repeated processing
  • Model evaluation and confusion-matrix calculations now collect prediction results correctly instead of failing due to invalid variable references
  • Temporary evaluation data is released after metrics are assembled

Impact

✅ Fewer long-running application crashes
✅ Lower memory and file-descriptor usage during image processing
✅ Working evaluation metrics and confusion matrices

💡 Usage Guide

Checking Your Pull Request

Every time you make a pull request, our system automatically looks through it. We check for security issues, mistakes in how you're setting up your infrastructure, and common code problems. We do this to make sure your changes are solid and won't cause any trouble later.

Talking to CodeAnt AI

Got a question or need a hand with something in your pull request? You can easily get in touch with CodeAnt AI right here. Just type the following in a comment on your pull request, and replace "Your question here" with whatever you want to ask:

@codeant-ai ask: Your question here

This lets you have a chat with CodeAnt AI about your pull request, making it easier to understand and improve your code.

Example

@codeant-ai ask: Can you suggest a safer alternative to storing this secret?

Preserve Org Learnings with CodeAnt

You can record team preferences so CodeAnt AI applies them in future reviews. Reply directly to the specific CodeAnt AI suggestion (in the same thread) and replace "Your feedback here" with your input:

@codeant-ai: Your feedback here

This helps CodeAnt AI learn and adapt to your team's coding style and standards.

Example

@codeant-ai: Do not flag unused imports.

Retrigger review

Ask CodeAnt AI to review the PR again, by typing:

@codeant-ai: review

Check Your Repository Health

To analyze the health of your code repository, visit our dashboard at https://app.codeant.ai. This tool helps you identify potential issues and areas for improvement in your codebase, ensuring your repository maintains high standards of code health.

- Used `with Image.open(...) as img` context manager in `src/solar_fault_detector/data/preprocessing.py` and `apps/api/streamlit_app.py` to prevent unclosed file handles leading to memory leaks and OOM crashes in production environments like Render.
- Updated `streamlit_app.py` to load and copy image memory appropriately within the context manager so Streamlit can successfully render it.
- Fixed a hallucinated `NameError` variable initialization bug in `src/solar_fault_detector/training/evaluator.py`.

Co-authored-by: VisionExpo <84554295+VisionExpo@users.noreply.github.com>
@google-labs-jules

Copy link
Copy Markdown
Contributor

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

@codeant-ai

codeant-ai Bot commented Sep 5, 2026

Copy link
Copy Markdown

🤖 CodeAnt AI — Review Status

Status Commit Started (UTC) Finished (UTC)
✅ Reviewed your PR 9a0c250 Sep 05, 2026 · 19:56 19:58

@codeant-ai

codeant-ai Bot commented Sep 5, 2026

Copy link
Copy Markdown

Thanks for using CodeAnt! 🎉

We're free for open-source projects. if you're enjoying it, help us grow by sharing.

Share on X ·
Reddit ·
LinkedIn

@codeant-ai codeant-ai Bot added the size:S This PR changes 10-29 lines, ignoring generated files label Sep 5, 2026
Comment thread apps/api/streamlit_app.py
Comment on lines +42 to +44
with Image.open(uploaded_file) as img:
img.load()
image = img.copy()

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggestion: Malformed or truncated uploads pass the MIME check but make Image.open or img.load raise, terminating the Streamlit script before the existing API error handling runs. [possible bug]

Assessment: 🟠 Major · 🔁 Occurrence: Sometimes

Use CodeAnt Skill Fix in Cursor Fix in VSCode Claude

Prompt for AI Agent 🤖
This is a comment left during a code review.

**Path:** apps/api/streamlit_app.py
**Line:** 42:44
**Comment:**
	*Possible Bug: Malformed or truncated uploads pass the MIME check but make `Image.open` or `img.load` raise, terminating the Streamlit script before the existing API error handling runs.

Validate the correctness of the flagged issue. If correct, How can I resolve this? If you propose a fix, implement it and please make it concise.
Once fix is implemented, also check other comments on the same PR, and ask user if the user wants to fix the rest of the comments as well. if said yes, then fetch all the comments validate the correctness and implement a minimal fix
👍 | 👎

Comment on lines +40 to +41
y_true = np.concatenate(eval_y_true_list)
y_pred = np.concatenate(eval_y_pred_list)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggestion: An empty or already-consumed dataset leaves these lists empty, so np.concatenate raises ValueError instead of returning evaluation results. [possible bug]

Assessment: 🟠 Major · 🔁 Occurrence: Rarely

Use CodeAnt Skill Fix in Cursor Fix in VSCode Claude

Prompt for AI Agent 🤖
This is a comment left during a code review.

**Path:** src/solar_fault_detector/training/evaluator.py
**Line:** 40:41
**Comment:**
	*Possible Bug: An empty or already-consumed dataset leaves these lists empty, so `np.concatenate` raises `ValueError` instead of returning evaluation results.

Validate the correctness of the flagged issue. If correct, How can I resolve this? If you propose a fix, implement it and please make it concise.
Once fix is implemented, also check other comments on the same PR, and ask user if the user wants to fix the rest of the comments as well. if said yes, then fetch all the comments validate the correctness and implement a minimal fix
👍 | 👎

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:S This PR changes 10-29 lines, ignoring generated files

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant