fix: close file handles with context managers in data_util.py and umls_semantic_type_tree.py (Fixes #599)#600
Open
rtmalikian wants to merge 1 commit into
Conversation
…s_semantic_type_tree.py Replaced bare open() calls with context managers (with statements) in: - data_util.py read_full_med_mentions(): train_ids, dev_ids, test_ids set comprehensions now read from a properly closed file handle - data_util.py read_ner_from_tsv(): for loop now iterates over a file handle opened in a with block - umls_semantic_type_tree.py construct_umls_tree_from_tsv(): for loop now iterates over a file handle opened in a with block These bare open() calls were resource leaks that could cause issues on non-CPython implementations or when processing many files. Signed-off-by: Raphael Malikian <rtmalikian@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #599
Problem
Several functions in scispacy use bare
open()calls without closing the file handles:data_util.pyread_full_med_mentions()— 3 set comprehensions iterate over bareopen()calls (lines 186-197)data_util.pyread_ner_from_tsv()— for loop iterates over bareopen()call (line 302)umls_semantic_type_tree.pyconstruct_umls_tree_from_tsv()— for loop iterates over bareopen()call (line 98)These are resource leaks. While CPython's reference counting typically handles cleanup, this is not guaranteed on other implementations (PyPy, Jython) and can cause resource exhaustion when processing many files.
Fix
Replaced all bare
open()calls withwithstatements:Verification
ast.parse()passes for both filesChangelog
Files Changed
scispacy/data_util.py— Replaced 4 bare open() calls with context managersscispacy/umls_semantic_type_tree.py— Replaced 1 bare open() call with context managerVerification
python3 -c "import ast; ast.parse(open('scispacy/data_util.py').read())"— syntax OKpython3 -c "import ast; ast.parse(open('scispacy/umls_semantic_type_tree.py').read())"— syntax OKAbout the Author: Raphael Malikian — Clinical AI Solutions Architect. I specialise in building and fixing AI/ML systems for healthcare, including vector databases, RAG pipelines, and clinical NLP. If you need help with your project or think I can add value to your organisation, feel free to reach out — I'd love to connect.
📧 rtmalikian@gmail.com
🔗 GitHub: https://github.com/rtmalikian
🔗 LinkedIn: http://www.linkedin.com/in/raphael-t-malikian-mbbs-bsc-hons-71075436a
Disclosure: This code was developed with assistance from MiMo-v2.5-Pro (Xiaomi) via Hermes Agent (Nous Research). All changes were reviewed, tested against the actual codebase, and verified for correctness.