Device Specs:
NVIDIA Jetson Orin Developer 64GB emmc
Jetpack 6.5
Docker:
Client: Docker Engine - Community
Version: 28.3.0
Context: default
Debug mode: false
Plugins:
buildx: Docker Buildx (Docker Inc)
version: v0.25.0
path: /usr/livexec/docker/cli-plugins/docker-buildx
compose: Docker Compose (Docker Inc)
version: v2.37.3
path: /usr/libexec/docker/cli-plugins/docker-compose
Server Version: 28.3.0
Storage Driver: overlay2
Backing filesystem: extfs
Supports d_type: true
using metacopy: false
Native overlay diff: true
userxattr: false
Logging Driver: json-file
Cgroup driver: systemd
Cgroup version: 2
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
CDI spec directories:
/etc/cdi
/var/run/cdi
Discovered devices:
cdi: [nvidia.com/pva=0](http://nvidia.com/pva=0)
cdi: [nvidia.com/pva=all](http://nvidia.com/pva=all)
Swarm: inactive
Runtimes: io.containerd.runc.v2 nvidia runc
Default runtime: nvidia
Init Binary: docker-init
containerd version: 05044ec0a9a75232cad458027ca83437aaef4da
runc version: v1.2.5-0-g59923ef
init verson: de40ad0
Security options:
seccomp
Profile: builtin
cgroupns
Kernel Version: 5-15.148-tegra
Operating System: Ubuntu 22.04.5 LTS
OSType: linux
Architecture: aarch64
CPUs: 8
Total Memory: 61.37GiB
name: ubuntu
ID: ef329e32-ed03-4e42-afae-da2b0a648ac3
Docker Root Dir: /var/lib/docker
Debug mode: false
Experimental: false
Insecure Registries:
::1/128
127.0.0.0/8
Live Restore Enabled: false
- Also Added 110GB USB 3.0 stick for extra swap space.
1st. cleared up space (starting with 50 out 60.8GB total) and went about installing NanoVLM
This was done by:
- Doing a shallow clone of the jetson-containers repo
git clone --depth 1 https://github.com/dusty-nv/jetson-containers
- After this, I cd’d into the jetson-containers repo and on branch
master ran:
./run.sh $(./autotag nano_llm) python3 -m nano_llm.chat --api=mlc --model Efficient-Large-Model/VILA1.5-3b
- This was successfully built and then I was asked for a prompt
>> PROMPT: https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg
>> PROMPT: what is in this image?
- I received an error:
File"opt/clip_trt/utils/image.py", line 62, in load_image
response = requests.get(path)
NameError: name "requests" is not defined
- Afterwards, I Ctrl +C ‘d the command and attempted to run this once more for reproducibility.
./run.sh $(./autotag nano_llm) python3 -m nano_llm.chat --api=mlc --model Efficient-Large-Model/VILA1.5-3b
- I received the same error as before:
File"opt/clip_trt/utils/image.py", line 62, in load_image
response = requests.get(path)
NameError: name "requests" is not defined
- I inspected my system memory and found that I only had about 2.1 GB available of the 60.8GB total.
- In diving deeper, the breakdown of my file storage is:
36G ./var
32G .var/lib
30G .var/lib/docker
8.5G ./home/jetson/jetson-containers
9.7G ./usr
5.6G ./lib
3.1G ./aarch64-linux-gnu
1.1G ./firmware
393M ./aarch64-linux-gnu/nvidia
366M ./python3/dist-packages
286M ./libreoffice
221M ./thunderbird
141M ./firmware/netronome
1.8G ./local/cuda-12.6/targets
1.3G ./share
- In inspecting the files, I found that at
jeston@ubuntu:/var$ sudo du -h —max-depth=3 | sort -rh | head -n 10
36G .
32G ./lib
30G ./lib/docker/overlay2
30G ./lib/docker
4.3G ./crash
2.1G ./lib/apport/coredump
2.1G ./lib/apport
245M ./lib/apt/lists
From jeston@ubuntu:/var/lib$ cd docker/
I get the error: bash: cd: docker/: Permission denied
And when I try From jeston@ubuntu:/var/lib$ sudo cd docker/
It says cd: command not found.
Note, when i run docker ps, nothing shows up. When I run docker list volumes, nothing shows up.
Was successfull in getting back docker data when running docker system df
There is indeed an Image that is not active with a size of 30.62GB (reclaimable 100%)
1st. cleared up space (starting with 50 out 60.8GB total) and went about installing NanoVLM
This was done by:
git clone --depth 1 https://github.com/dusty-nv/jetson-containersmasterran:./run.sh $(./autotag nano_llm) python3 -m nano_llm.chat --api=mlc --model Efficient-Large-Model/VILA1.5-3b./run.sh $(./autotag nano_llm) python3 -m nano_llm.chat --api=mlc --model Efficient-Large-Model/VILA1.5-3b36G ./var
32G .var/lib
30G .var/lib/docker
8.5G ./home/jetson/jetson-containers
9.7G ./usr
5.6G ./lib
3.1G ./aarch64-linux-gnu
1.1G ./firmware
393M ./aarch64-linux-gnu/nvidia
366M ./python3/dist-packages
286M ./libreoffice
221M ./thunderbird
141M ./firmware/netronome
1.8G ./local/cuda-12.6/targets
1.3G ./share
jeston@ubuntu:/var$ sudo du -h —max-depth=3 | sort -rh | head -n 1036G .
32G ./lib
30G ./lib/docker/overlay2
30G ./lib/docker
4.3G ./crash
2.1G ./lib/apport/coredump
2.1G ./lib/apport
245M ./lib/apt/lists
From
jeston@ubuntu:/var/lib$ cd docker/I get the error: bash: cd: docker/: Permission denied
And when I try From
jeston@ubuntu:/var/lib$ sudo cd docker/It says cd: command not found.
Note, when i run docker ps, nothing shows up. When I run docker list volumes, nothing shows up.
Was successfull in getting back docker data when running
docker system dfThere is indeed an Image that is not active with a size of 30.62GB (reclaimable 100%)