🐛 Bug
Issue :
I am trying to get WEBLLM for my model but I can't install mlc_llm or mlc_ai on my Macbook air m2, what is the cause ? can you please guide me how can I do this ? thank you.
pip install --pre --force-reinstall mlc-ai-nightly mlc-llm-nightly -f https://mlc.ai/wheels ok mlc-env
python -m pip install --pre -U -f https://mlc.ai/wheels mlc-llm-cpu mlc-ai-cpu
Expected behavior
expected install but got this :
Looking in links: https://mlc.ai/wheels
ERROR: Could not find a version that satisfies the requirement mlc-ai-nightly (from versions: none)
[notice] A new release of pip is available: 25.2 -> 26.1.2
[notice] To update, run: pip install --upgrade pip
ERROR: No matching distribution found for mlc-ai-nightly
Environment
- Platform (e.g. WebGPU/Vulkan/IOS/Android/CUDA):
- Operating system (e.g. Ubuntu/Windows/MacOS/...):
- Device (e.g. iPhone 12 Pro, PC+RTX 3090, ...)
- How you installed MLC-LLM (
conda, source):
- How you installed TVM (
pip, source):
- Python version (e.g. 3.10):
- GPU driver version (if applicable):
- CUDA/cuDNN version (if applicable):
- TVM Hash Tag (
python -c "import tvm; print('\n'.join(f'{k}: {v}' for k, v in tvm.support.libinfo().items()))", applicable if you compile models):
- Any other relevant information:
Additional context
other tried stuffs got me these :
python -m pip install --pre -U -f https://mlc.ai/wheels mlc-llm-cpu mlc-ai-cpu ok mlc-env py at 00:21:59
Looking in links: https://mlc.ai/wheels
Collecting mlc-llm-cpu
Downloading https://github.com/mlc-ai/package/releases/download/v0.9.dev0/mlc_llm_cpu-0.20.0.dev0-py3-none-macosx_26_0_arm64.whl (20.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.7/20.7 MB 6.0 MB/s 0:00:04
Collecting mlc-ai-cpu
Downloading https://github.com/mlc-ai/package/releases/download/v0.9.dev0/mlc_ai_cpu-0.20.0-py3-none-macosx_26_0_arm64.whl (61.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 MB 7.4 MB/s 0:00:08
Collecting apache-tvm-ffi (from mlc-llm-cpu)
Using cached apache_tvm_ffi-0.1.12-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.2 kB)
Requirement already satisfied: datasets in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (5.0.0)
Requirement already satisfied: fastapi in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.139.2)
Requirement already satisfied: ml_dtypes>=0.5.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.5.4)
Requirement already satisfied: openai in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (2.46.0)
Requirement already satisfied: pandas in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (3.0.3)
Requirement already satisfied: prompt_toolkit in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (3.0.52)
Requirement already satisfied: requests in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (2.34.2)
Requirement already satisfied: safetensors in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.8.0)
Requirement already satisfied: sentencepiece in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.2.2)
Requirement already satisfied: shortuuid in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (1.0.13)
Requirement already satisfied: tiktoken in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.13.0)
Requirement already satisfied: torch in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (2.13.0)
Requirement already satisfied: tqdm in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (4.69.0)
Requirement already satisfied: transformers in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (5.14.1)
Requirement already satisfied: uvicorn in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.51.0)
Collecting cloudpickle (from mlc-ai-cpu)
Using cached cloudpickle-3.1.2-py3-none-any.whl.metadata (7.1 kB)
Requirement already satisfied: numpy in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-ai-cpu) (2.4.6)
Requirement already satisfied: packaging in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-ai-cpu) (26.2)
Collecting psutil (from mlc-ai-cpu)
Using cached psutil-7.2.2-cp36-abi3-macosx_11_0_arm64.whl.metadata (22 kB)
Collecting scipy (from mlc-ai-cpu)
Downloading scipy-1.17.1-cp311-cp311-macosx_14_0_arm64.whl.metadata (62 kB)
Collecting tornado (from mlc-ai-cpu)
Using cached tornado-6.5.7-cp39-abi3-macosx_10_9_universal2.whl.metadata (2.8 kB)
Requirement already satisfied: typing_extensions in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-ai-cpu) (4.16.0)
Requirement already satisfied: filelock in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (3.30.3)
Requirement already satisfied: pyarrow>=21.0.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (25.0.0)
Requirement already satisfied: dill<0.4.2,>=0.3.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (0.4.1)
Requirement already satisfied: httpx<1.0.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (0.28.1)
Requirement already satisfied: xxhash in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (3.8.1)
Requirement already satisfied: multiprocess<0.70.20 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (0.70.19)
Requirement already satisfied: fsspec<=2026.4.0,>=2023.1.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (2026.4.0)
Requirement already satisfied: huggingface-hub<2.0,>=0.25.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (1.24.0)
Requirement already satisfied: pyyaml>=5.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (6.0.3)
Requirement already satisfied: aiohttp!=4.0.0a0,!=4.0.0a1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (3.14.1)
Requirement already satisfied: anyio in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpx<1.0.0->datasets->mlc-llm-cpu) (4.14.2)
Requirement already satisfied: certifi in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpx<1.0.0->datasets->mlc-llm-cpu) (2026.6.17)
Requirement already satisfied: httpcore==1.* in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpx<1.0.0->datasets->mlc-llm-cpu) (1.0.9)
Requirement already satisfied: idna in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpx<1.0.0->datasets->mlc-llm-cpu) (3.18)
Requirement already satisfied: h11>=0.16 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpcore==1.*->httpx<1.0.0->datasets->mlc-llm-cpu) (0.16.0)
Requirement already satisfied: click<9.0.0,>=8.4.2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from huggingface-hub<2.0,>=0.25.0->datasets->mlc-llm-cpu) (8.4.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from huggingface-hub<2.0,>=0.25.0->datasets->mlc-llm-cpu) (1.5.2)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (2.7.1)
Requirement already satisfied: aiosignal>=1.4.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (1.4.0)
Requirement already satisfied: attrs>=17.3.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (26.1.0)
Requirement already satisfied: frozenlist>=1.1.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (1.8.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (6.7.1)
Requirement already satisfied: propcache>=0.2.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (0.5.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (1.24.2)
Requirement already satisfied: charset_normalizer<4,>=2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from requests->mlc-llm-cpu) (3.4.9)
Requirement already satisfied: urllib3<3,>=1.26 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from requests->mlc-llm-cpu) (2.7.0)
Requirement already satisfied: starlette>=0.46.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fastapi->mlc-llm-cpu) (1.3.1)
Requirement already satisfied: pydantic>=2.9.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fastapi->mlc-llm-cpu) (2.13.4)
Requirement already satisfied: typing-inspection>=0.4.2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fastapi->mlc-llm-cpu) (0.4.2)
Requirement already satisfied: annotated-doc>=0.0.2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fastapi->mlc-llm-cpu) (0.0.4)
Requirement already satisfied: annotated-types>=0.6.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from pydantic>=2.9.0->fastapi->mlc-llm-cpu) (0.7.0)
Requirement already satisfied: pydantic-core==2.46.4 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from pydantic>=2.9.0->fastapi->mlc-llm-cpu) (2.46.4)
Requirement already satisfied: distro<2,>=1.7.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from openai->mlc-llm-cpu) (1.9.0)
Requirement already satisfied: jiter<1,>=0.10.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from openai->mlc-llm-cpu) (0.16.0)
Requirement already satisfied: sniffio in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from openai->mlc-llm-cpu) (1.3.1)
Requirement already satisfied: python-dateutil>=2.8.2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from pandas->mlc-llm-cpu) (2.9.0.post0)
Requirement already satisfied: six>=1.5 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from python-dateutil>=2.8.2->pandas->mlc-llm-cpu) (1.17.0)
Requirement already satisfied: wcwidth in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from prompt_toolkit->mlc-llm-cpu) (0.8.2)
Requirement already satisfied: regex in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from tiktoken->mlc-llm-cpu) (2026.7.10)
Requirement already satisfied: setuptools>=77.0.3 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from torch->mlc-llm-cpu) (82.0.0)
Requirement already satisfied: sympy>=1.13.3 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from torch->mlc-llm-cpu) (1.14.0)
Requirement already satisfied: networkx>=2.5.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from torch->mlc-llm-cpu) (3.6.1)
Requirement already satisfied: jinja2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from torch->mlc-llm-cpu) (3.1.6)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from sympy>=1.13.3->torch->mlc-llm-cpu) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from jinja2->torch->mlc-llm-cpu) (3.0.3)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from transformers->mlc-llm-cpu) (0.22.2)
Requirement already satisfied: typer in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from transformers->mlc-llm-cpu) (0.27.0)
Requirement already satisfied: shellingham>=1.3.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from typer->transformers->mlc-llm-cpu) (1.5.4)
Requirement already satisfied: rich>=13.8.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from typer->transformers->mlc-llm-cpu) (15.0.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from rich>=13.8.0->typer->transformers->mlc-llm-cpu) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from rich>=13.8.0->typer->transformers->mlc-llm-cpu) (2.20.0)
Requirement already satisfied: mdurl~=0.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.8.0->typer->transformers->mlc-llm-cpu) (0.1.2)
Using cached apache_tvm_ffi-0.1.12-cp311-cp311-macosx_11_0_arm64.whl (2.5 MB)
Using cached cloudpickle-3.1.2-py3-none-any.whl (22 kB)
Using cached psutil-7.2.2-cp36-abi3-macosx_11_0_arm64.whl (129 kB)
Downloading scipy-1.17.1-cp311-cp311-macosx_14_0_arm64.whl (20.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.3/20.3 MB 4.7 MB/s 0:00:04
Using cached tornado-6.5.7-cp39-abi3-macosx_10_9_universal2.whl (448 kB)
Installing collected packages: tornado, scipy, psutil, cloudpickle, apache-tvm-ffi, mlc-ai-cpu, mlc-llm-cpu
Successfully installed apache-tvm-ffi-0.1.12 cloudpickle-3.1.2 mlc-ai-cpu-0.20.0 mlc-llm-cpu-0.20.0.dev0 psutil-7.2.2 scipy-1.17.1 tornado-6.5.7
[notice] A new release of pip is available: 26.0.1 -> 26.1.2
[notice] To update, run: pip install --upgrade pip
python -c "import mlc_llm_cpu; print('✅ MLC ready (mlc_llm_cpu)')"
KILL took 11s mlc-env py at 00:31:50
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'mlc_llm_cpu'
🐛 Bug
Issue :
I am trying to get WEBLLM for my model but I can't install mlc_llm or mlc_ai on my Macbook air m2, what is the cause ? can you please guide me how can I do this ? thank you.
pip install --pre --force-reinstall mlc-ai-nightly mlc-llm-nightly -f https://mlc.ai/wheels ok mlc-env
python -m pip install --pre -U -f https://mlc.ai/wheels mlc-llm-cpu mlc-ai-cpu
Expected behavior
expected install but got this :
Looking in links: https://mlc.ai/wheels
ERROR: Could not find a version that satisfies the requirement mlc-ai-nightly (from versions: none)
[notice] A new release of pip is available: 25.2 -> 26.1.2
[notice] To update, run: pip install --upgrade pip
ERROR: No matching distribution found for mlc-ai-nightly
Environment
conda, source):pip, source):python -c "import tvm; print('\n'.join(f'{k}: {v}' for k, v in tvm.support.libinfo().items()))", applicable if you compile models):Additional context
other tried stuffs got me these :
python -m pip install --pre -U -f https://mlc.ai/wheels mlc-llm-cpu mlc-ai-cpu ok mlc-env py at 00:21:59
Looking in links: https://mlc.ai/wheels
Collecting mlc-llm-cpu
Downloading https://github.com/mlc-ai/package/releases/download/v0.9.dev0/mlc_llm_cpu-0.20.0.dev0-py3-none-macosx_26_0_arm64.whl (20.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.7/20.7 MB 6.0 MB/s 0:00:04
Collecting mlc-ai-cpu
Downloading https://github.com/mlc-ai/package/releases/download/v0.9.dev0/mlc_ai_cpu-0.20.0-py3-none-macosx_26_0_arm64.whl (61.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 MB 7.4 MB/s 0:00:08
Collecting apache-tvm-ffi (from mlc-llm-cpu)
Using cached apache_tvm_ffi-0.1.12-cp311-cp311-macosx_11_0_arm64.whl.metadata (6.2 kB)
Requirement already satisfied: datasets in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (5.0.0)
Requirement already satisfied: fastapi in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.139.2)
Requirement already satisfied: ml_dtypes>=0.5.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.5.4)
Requirement already satisfied: openai in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (2.46.0)
Requirement already satisfied: pandas in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (3.0.3)
Requirement already satisfied: prompt_toolkit in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (3.0.52)
Requirement already satisfied: requests in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (2.34.2)
Requirement already satisfied: safetensors in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.8.0)
Requirement already satisfied: sentencepiece in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.2.2)
Requirement already satisfied: shortuuid in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (1.0.13)
Requirement already satisfied: tiktoken in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.13.0)
Requirement already satisfied: torch in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (2.13.0)
Requirement already satisfied: tqdm in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (4.69.0)
Requirement already satisfied: transformers in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (5.14.1)
Requirement already satisfied: uvicorn in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-llm-cpu) (0.51.0)
Collecting cloudpickle (from mlc-ai-cpu)
Using cached cloudpickle-3.1.2-py3-none-any.whl.metadata (7.1 kB)
Requirement already satisfied: numpy in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-ai-cpu) (2.4.6)
Requirement already satisfied: packaging in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-ai-cpu) (26.2)
Collecting psutil (from mlc-ai-cpu)
Using cached psutil-7.2.2-cp36-abi3-macosx_11_0_arm64.whl.metadata (22 kB)
Collecting scipy (from mlc-ai-cpu)
Downloading scipy-1.17.1-cp311-cp311-macosx_14_0_arm64.whl.metadata (62 kB)
Collecting tornado (from mlc-ai-cpu)
Using cached tornado-6.5.7-cp39-abi3-macosx_10_9_universal2.whl.metadata (2.8 kB)
Requirement already satisfied: typing_extensions in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from mlc-ai-cpu) (4.16.0)
Requirement already satisfied: filelock in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (3.30.3)
Requirement already satisfied: pyarrow>=21.0.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (25.0.0)
Requirement already satisfied: dill<0.4.2,>=0.3.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (0.4.1)
Requirement already satisfied: httpx<1.0.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (0.28.1)
Requirement already satisfied: xxhash in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (3.8.1)
Requirement already satisfied: multiprocess<0.70.20 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (0.70.19)
Requirement already satisfied: fsspec<=2026.4.0,>=2023.1.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (2026.4.0)
Requirement already satisfied: huggingface-hub<2.0,>=0.25.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (1.24.0)
Requirement already satisfied: pyyaml>=5.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from datasets->mlc-llm-cpu) (6.0.3)
Requirement already satisfied: aiohttp!=4.0.0a0,!=4.0.0a1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (3.14.1)
Requirement already satisfied: anyio in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpx<1.0.0->datasets->mlc-llm-cpu) (4.14.2)
Requirement already satisfied: certifi in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpx<1.0.0->datasets->mlc-llm-cpu) (2026.6.17)
Requirement already satisfied: httpcore==1.* in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpx<1.0.0->datasets->mlc-llm-cpu) (1.0.9)
Requirement already satisfied: idna in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpx<1.0.0->datasets->mlc-llm-cpu) (3.18)
Requirement already satisfied: h11>=0.16 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from httpcore==1.*->httpx<1.0.0->datasets->mlc-llm-cpu) (0.16.0)
Requirement already satisfied: click<9.0.0,>=8.4.2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from huggingface-hub<2.0,>=0.25.0->datasets->mlc-llm-cpu) (8.4.2)
Requirement already satisfied: hf-xet<2.0.0,>=1.5.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from huggingface-hub<2.0,>=0.25.0->datasets->mlc-llm-cpu) (1.5.2)
Requirement already satisfied: aiohappyeyeballs>=2.5.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (2.7.1)
Requirement already satisfied: aiosignal>=1.4.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (1.4.0)
Requirement already satisfied: attrs>=17.3.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (26.1.0)
Requirement already satisfied: frozenlist>=1.1.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (1.8.0)
Requirement already satisfied: multidict<7.0,>=4.5 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (6.7.1)
Requirement already satisfied: propcache>=0.2.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (0.5.2)
Requirement already satisfied: yarl<2.0,>=1.17.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec[http]<=2026.4.0,>=2023.1.0->datasets->mlc-llm-cpu) (1.24.2)
Requirement already satisfied: charset_normalizer<4,>=2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from requests->mlc-llm-cpu) (3.4.9)
Requirement already satisfied: urllib3<3,>=1.26 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from requests->mlc-llm-cpu) (2.7.0)
Requirement already satisfied: starlette>=0.46.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fastapi->mlc-llm-cpu) (1.3.1)
Requirement already satisfied: pydantic>=2.9.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fastapi->mlc-llm-cpu) (2.13.4)
Requirement already satisfied: typing-inspection>=0.4.2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fastapi->mlc-llm-cpu) (0.4.2)
Requirement already satisfied: annotated-doc>=0.0.2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from fastapi->mlc-llm-cpu) (0.0.4)
Requirement already satisfied: annotated-types>=0.6.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from pydantic>=2.9.0->fastapi->mlc-llm-cpu) (0.7.0)
Requirement already satisfied: pydantic-core==2.46.4 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from pydantic>=2.9.0->fastapi->mlc-llm-cpu) (2.46.4)
Requirement already satisfied: distro<2,>=1.7.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from openai->mlc-llm-cpu) (1.9.0)
Requirement already satisfied: jiter<1,>=0.10.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from openai->mlc-llm-cpu) (0.16.0)
Requirement already satisfied: sniffio in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from openai->mlc-llm-cpu) (1.3.1)
Requirement already satisfied: python-dateutil>=2.8.2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from pandas->mlc-llm-cpu) (2.9.0.post0)
Requirement already satisfied: six>=1.5 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from python-dateutil>=2.8.2->pandas->mlc-llm-cpu) (1.17.0)
Requirement already satisfied: wcwidth in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from prompt_toolkit->mlc-llm-cpu) (0.8.2)
Requirement already satisfied: regex in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from tiktoken->mlc-llm-cpu) (2026.7.10)
Requirement already satisfied: setuptools>=77.0.3 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from torch->mlc-llm-cpu) (82.0.0)
Requirement already satisfied: sympy>=1.13.3 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from torch->mlc-llm-cpu) (1.14.0)
Requirement already satisfied: networkx>=2.5.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from torch->mlc-llm-cpu) (3.6.1)
Requirement already satisfied: jinja2 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from torch->mlc-llm-cpu) (3.1.6)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from sympy>=1.13.3->torch->mlc-llm-cpu) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from jinja2->torch->mlc-llm-cpu) (3.0.3)
Requirement already satisfied: tokenizers<=0.23.0,>=0.22.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from transformers->mlc-llm-cpu) (0.22.2)
Requirement already satisfied: typer in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from transformers->mlc-llm-cpu) (0.27.0)
Requirement already satisfied: shellingham>=1.3.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from typer->transformers->mlc-llm-cpu) (1.5.4)
Requirement already satisfied: rich>=13.8.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from typer->transformers->mlc-llm-cpu) (15.0.0)
Requirement already satisfied: markdown-it-py>=2.2.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from rich>=13.8.0->typer->transformers->mlc-llm-cpu) (4.2.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from rich>=13.8.0->typer->transformers->mlc-llm-cpu) (2.20.0)
Requirement already satisfied: mdurl~=0.1 in /Users/anthonychadwick/mlc-env/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich>=13.8.0->typer->transformers->mlc-llm-cpu) (0.1.2)
Using cached apache_tvm_ffi-0.1.12-cp311-cp311-macosx_11_0_arm64.whl (2.5 MB)
Using cached cloudpickle-3.1.2-py3-none-any.whl (22 kB)
Using cached psutil-7.2.2-cp36-abi3-macosx_11_0_arm64.whl (129 kB)
Downloading scipy-1.17.1-cp311-cp311-macosx_14_0_arm64.whl (20.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 20.3/20.3 MB 4.7 MB/s 0:00:04
Using cached tornado-6.5.7-cp39-abi3-macosx_10_9_universal2.whl (448 kB)
Installing collected packages: tornado, scipy, psutil, cloudpickle, apache-tvm-ffi, mlc-ai-cpu, mlc-llm-cpu
Successfully installed apache-tvm-ffi-0.1.12 cloudpickle-3.1.2 mlc-ai-cpu-0.20.0 mlc-llm-cpu-0.20.0.dev0 psutil-7.2.2 scipy-1.17.1 tornado-6.5.7
[notice] A new release of pip is available: 26.0.1 -> 26.1.2
[notice] To update, run: pip install --upgrade pip
python -c "import mlc_llm_cpu; print('✅ MLC ready (mlc_llm_cpu)')"
KILL took 11s mlc-env py at 00:31:50
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'mlc_llm_cpu'