npu-llm

Here are 5 public repositories matching this topic...

NotPunchnox / rkllama

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU support ( rkllm )

python client ai server offline rockchip client-server ia orangepi orange-pi npu llm rk3588 orangepi5 llm-inference llm-apps rk3576 orangepi5pro npu-llm

Updated Aug 25, 2026
Python

justADeni / intel-npu-llm

Star

A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)

ai intel inference text-generation gpt openvino npu llm mistral-7b tinyllama qwen2 llama3 microsoft-phi-3 npu-llm

Updated Jul 4, 2026
Python

Atomic-Germ / FLM_Q4NX_Converter

Star

A converter for transferring gguf Q8_0, Q4_0, Q4_1, MXFP4, or raw tensors to FLM Q4NX

quantization fastflow npu llm llm-tools npu-llm fastflowlm q4nx npu2

Updated Aug 17, 2026
Python

mybigday / react-native-qnn-llm

Star

QNN LLM binding for React Native

react-native ai qualcomm qnn npu llm npu-llm qualcomm-npu

Updated Apr 1, 2026
C++

mybigday / node-qnn-llm

Star

Qualcomm lib Genie binding for Node.js

nodejs ai qualcomm qnn npu llm npu-llm qualcomm-npu

Updated Apr 6, 2026
C++

Improve this page

Add a description, image, and links to the npu-llm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the npu-llm topic, visit your repo's landing page and select "manage topics."

Learn more