Skip to content

fix: reclaim browser, PDF, and institutional resources #32

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jung233 wants to merge 17 commits into
base: master
Choose a base branch
from
Open

fix: reclaim browser, PDF, and institutional resources #32

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
30ab2c5
fix(browser): reject sync Playwright inside event loops
jung233 Jul 17, 2026
598aca6
fix(container): install CloakBrowser and Chromium runtime dependencies
jung233 Jul 16, 2026
c49176b
fix(browser): force headless mode when no display is available
jung233 Jul 16, 2026
b0f0a44
feat(browser): provide persistent contexts for login sessions
jung233 Jul 16, 2026
07f9f26
fix(browser): enforce thread ownership and release driver resources
jung233 Jul 16, 2026
c0c1313
fix(browser): close login and cookie capture sessions deterministically
jung233 Jul 16, 2026
cfce925
Add missing is_suspicious_pdf and suspicious_pdf functions
jung233 Jun 26, 2026
87669e8
fix(pdf): close PyMuPDF documents after extraction
jung233 Jul 16, 2026
f86514c
fix(pdf): publish validated downloads atomically
jung233 Jul 16, 2026
828ecfb
fix(container): reap children and bound allocator arenas
jung233 Jul 16, 2026
4e942db
fix(auth): release institutional browser sessions
jung233 Jul 16, 2026
3f4d3d7
fix(publishers): close batch workers and browser handles
jung233 Jul 16, 2026
987d3de
fix(commands): close fetchers and CARSI clients on every path
jung233 Jul 16, 2026
f542808
fix(browser): capture direct PDF download events
jung233 Jul 19, 2026
9a1ea17
fix(sources): use official MDPI browser downloads
jung233 Jul 19, 2026
cd7f526
fix(browser): avoid network-dependent tab warmups
jung233 Jul 19, 2026
0eea382
fix(browser): reject cross-origin reference PDFs
jung233 Jul 19, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 13 additions & 1 deletion Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,10 +5,19 @@ WORKDIR /app
COPY pyproject.toml .
COPY src ./src

RUN pip install --no-cache-dir ".[tor,instsci]"
RUN pip install --no-cache-dir ".[tor,cloakbrowser,instsci]"

FROM python:3.12-slim

RUN apt-get update \
&& apt-get install -y --no-install-recommends \
libglib2.0-0 libnss3 libnspr4 libdbus-1-3 \
libatk1.0-0 libatk-bridge2.0-0 libcups2 libdrm2 \
libxkbcommon0 libxcomposite1 libxdamage1 libxfixes3 \
libxrandr2 libgbm1 libpango-1.0-0 libcairo2 libasound2 \
libatspi2.0-0 libwayland-client0 tini \
&& rm -rf /var/lib/apt/lists/*

WORKDIR /app

COPY --from=builder /usr/local/lib/python3.12/site-packages /usr/local/lib/python3.12/site-packages
Expand All @@ -19,6 +28,9 @@ COPY pyproject.toml .
EXPOSE 8000

ENV SCANSCI_PDF_DATA_DIR=/data/paper-fetch
ENV CLOAKBROWSER_CACHE_DIR=/data/paper-fetch/browser-cache
ENV MCP_MODE=streamable_http
ENV MALLOC_ARENA_MAX=2

ENTRYPOINT ["tini", "--"]
CMD ["python", "-m", "scansci_pdf", "run", "--mode", "streamable_http"]
1 change: 1 addition & 0 deletions pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ dependencies = [
"requests>=2.31",
"requests[socks]>=2.31",
"beautifulsoup4>=4.12",
"PyMuPDF>=1.24",
"mcp[cli]>=1.12",
"typer>=0.15",
"uvicorn>=0.34",
Expand Down
Loading