docker部署的镜像名tag错误

[liguoyu666]

原为： FROM nvidia/cuda:11.8-devel-ubuntu20.04
应该为：FROM nvidia/cuda:11.8.0-devel-ubuntu20.04

[yelongyelong]

折腾了我2个小时，我还以为是网络问题

[liguoyu666]

折腾了我2个小时，我还以为是网络问题

别整了，后面torch安装不了，我把包下载好离线安装都不行，这dockerfile就有问题

[andyoulovexy]

折腾了我2个小时，我还以为是网络问题

别整了，后面torch安装不了，我把包下载好离线安装都不行，这dockerfile就有问题

跑是可以跑起来，就是很费劲，折腾了很久

[newlxj]

感谢提出，FROM nvidia/cuda:11.8.0-devel-ubuntu20.04 已补充进去，但是建议别用docker模式 @andyoulovexy 如果方便可以提交一个fix合并进来

[liguoyu666]

折腾了我2个小时，我还以为是网络问题

别整了，后面torch安装不了，我把包下载好离线安装都不行，这dockerfile就有问题

跑是可以跑起来，就是很费劲，折腾了很久

你好，可以分享下相关改动的文件吗

[gkm0120]

折腾了我2个小时，我还以为是网络问题

别整了，后面torch安装不了，我把包下载好离线安装都不行，这dockerfile就有问题

我按照这个dockerfile也没有跑起来，主要是出现 ERROR: Could not find a version that satisfies the requirement torch==2.6.0 (from -r requirements.txt (line 16)) (from versions: 1.4.0, 1.5.0, 1.5.1, 1.6.0, 1.7.0, 1.7.1, 1.8.0, 1.8.1, 1.9.0, 1.9.1, 1.10.0, 1.10.1, 1.10.2, 1.11.0, 1.12.0, 1.12.1, 1.13.0, 1.13.1, 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1, 2.4.0, 2.4.1),离线安装whl文件也不大行

[gkm0120]

我刚刚试了，提前把对应的whl离线文件下载，requirements.txt走官方的，搭建镜像没有问题，能不能跑起来这个还需要后续测试

FROM continuumio/miniconda3:latest

# 创建 Python 3.12.9 环境
RUN conda create -n deepseek-ocr python=3.12.9 -y

# 把环境写到 bashrc，容器启动后自动激活 deepseek-ocr
RUN echo "source activate deepseek-ocr" >> ~/.bashrc
ENV PATH /opt/conda/envs/deepseek-ocr/bin:$PATH
ENV CONDA_DEFAULT_ENV deepseek-ocr
COPY . .
RUN pip install torch==2.6.0 torchvision==0.21.0 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu118
# RUN wget https://github.com/vllm-project/vllm/releases/download/v0.8.5/vllm-0.8.5-cp38-abi3-manylinux1_x86_64.whl && pip install ./vllm-0.8.5-cp38-abi3-manylinux1_x86_64.whl
RUN pip install vllm-0.8.5-cp38-abi3-manylinux1_x86_64.whl

RUN pip install -r requirements.txt
# RUN wget https://github.com/Dao-AILab/flash-attention/releases/download/v2.7.3/flash_attn-2.7.3+cu11torch2.6cxx11abiFALSE-cp312-cp312-linux_x86_64.whl
RUN pip install flash_attn-2.7.3+cu11torch2.6cxx11abiFALSE-cp312-cp312-linux_x86_64.whl
````

[andyoulovexy]

折腾了我2个小时，我还以为是网络问题

别整了，后面torch安装不了，我把包下载好离线安装都不行，这dockerfile就有问题

跑是可以跑起来，就是很费劲，折腾了很久

你好，可以分享下相关改动的文件吗

Use NVIDIA CUDA base image for GPU support

#FROM nvidia/cuda:11.8-devel-ubuntu20.04
FROM swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvidia/cuda:12.4.0-devel-ubuntu22.04

Set environment variables

ENV DEBIAN_FRONTEND=noninteractive
ENV PYTHONUNBUFFERED=1
ENV MODEL_PATH=/app/models/DeepSeek-OCR
ENV CUDA_VISIBLE_DEVICES=0

Install system dependencies

RUN apt-get update && apt-get install -y
python3
python3-pip
python3-dev
git
git-lfs
wget
curl
build-essential
&& rm -rf /var/lib/apt/lists/*

Create symbolic link for python

RUN ln -s /usr/bin/python3 /usr/bin/python

Set working directory

WORKDIR /app

Copy requirements first for better Docker layer caching

COPY requirements.txt .

Install Python dependencies

RUN pip3 install --no-cache-dir --upgrade pip &&
pip3 config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple &&
pip3 config set global.trusted-host pypi.tuna.tsinghua.edu.cn &&
pip3 config set global.timeout 120 &&
PYTHONWARNINGS="ignore:Unverified HTTPS request" pip3 install --no-cache-dir -r requirements.txt
#pip3 install --no-cache-dir -r requirements.txt

Copy application files

COPY . .

Create models directory

RUN mkdir -p /app/models

Set permissions

RUN chmod +x /app/*.py

Expose the port that Gradio will run on

EXPOSE 7860

Health check

HEALTHCHECK --interval=30s --timeout=30s --start-period=5s --retries=3
CMD curl -f http://localhost:7860/ || exit 1

Create a non-root user for security

RUN useradd -m -u 1000 appuser && chown -R appuser:appuser /app
USER appuser

Set the default command

CMD ["python3", "start_ocr_webui.py"]

以上是Dockerfile，后续需要在容器中执行pip install flash-attn==2.7.3 --no-build-isolation

[HappySandSculpture]

折腾了我2个小时，我还以为是网络问题

别整了，后面torch安装不了，我把包下载好离线安装都不行，这dockerfile就有问题

我按照这个dockerfile也没有跑起来，主要是出现 ERROR: Could not find a version that satisfies the requirement torch==2.6.0 (from -r requirements.txt (line 16)) (from versions: 1.4.0, 1.5.0, 1.5.1, 1.6.0, 1.7.0, 1.7.1, 1.8.0, 1.8.1, 1.9.0, 1.9.1, 1.10.0, 1.10.1, 1.10.2, 1.11.0, 1.12.0, 1.12.1, 1.13.0, 1.13.1, 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.1.2, 2.2.0, 2.2.1, 2.2.2, 2.3.0, 2.3.1, 2.4.0, 2.4.1),离线安装whl文件也不大行

请问你的docker环境跑起来了吗？我的也是报这个错误

[liguoyu666]

折腾了我2个小时，我还以为是网络问题

别整了，后面torch安装不了，我把包下载好离线安装都不行，这dockerfile就有问题

跑是可以跑起来，就是很费劲，折腾了很久

你好，可以分享下相关改动的文件吗

Use NVIDIA CUDA base image for GPU support

#FROM nvidia/cuda:11.8-devel-ubuntu20.04 FROM swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/nvidia/cuda:12.4.0-devel-ubuntu22.04

Set environment variables

ENV DEBIAN_FRONTEND=noninteractive ENV PYTHONUNBUFFERED=1 ENV MODEL_PATH=/app/models/DeepSeek-OCR ENV CUDA_VISIBLE_DEVICES=0

Install system dependencies

RUN apt-get update && apt-get install -y python3 python3-pip python3-dev git git-lfs wget curl build-essential && rm -rf /var/lib/apt/lists/*

Create symbolic link for python

RUN ln -s /usr/bin/python3 /usr/bin/python

Set working directory

WORKDIR /app

Copy requirements first for better Docker layer caching

COPY requirements.txt .

Install Python dependencies

RUN pip3 install --no-cache-dir --upgrade pip && pip3 config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple && pip3 config set global.trusted-host pypi.tuna.tsinghua.edu.cn && pip3 config set global.timeout 120 && PYTHONWARNINGS="ignore:Unverified HTTPS request" pip3 install --no-cache-dir -r requirements.txt #pip3 install --no-cache-dir -r requirements.txt

Copy application files

COPY . .

Create models directory

RUN mkdir -p /app/models

Set permissions

RUN chmod +x /app/*.py

Expose the port that Gradio will run on

EXPOSE 7860

Health check

HEALTHCHECK --interval=30s --timeout=30s --start-period=5s --retries=3 CMD curl -f http://localhost:7860/ || exit 1

Create a non-root user for security

RUN useradd -m -u 1000 appuser && chown -R appuser:appuser /app USER appuser

Set the default command

CMD ["python3", "start_ocr_webui.py"]

以上是Dockerfile，后续需要在容器中执行pip install flash-attn==2.7.3 --no-build-isolation

感谢，构建镜像时安装flash-attn失败或者卡住半天东，我直接在代码里改成_attn_implementation='eager'了