Skip to content

Commit 6dc2dbc

Browse files
localai-botmudler
andauthored
chore(model gallery): 🤖 add 1 new models via gallery agent (#7707)
chore(model gallery): 🤖 add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
1 parent 0a16883 commit 6dc2dbc

1 file changed

Lines changed: 31 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,35 @@
11
---
2+
- name: "qwen3-coder-30b-a3b-instruct-rtpurbo-i1"
3+
urls:
4+
- https://huggingface.co/mradermacher/Qwen3-Coder-30B-A3B-Instruct-RTPurbo-i1-GGUF
5+
description: |
6+
The model in question is a quantized version of the original **Qwen3-Coder** large language model, specifically tailored for code generation. The base model, **RTP-LLM/Qwen3-Coder-30B-A3B-Instruct-RTPurbo**, is a 30B-parameter variant optimized for instruction-following and code-related tasks. It employs the **A3B attention mechanism** and is trained on diverse data to excel in programming and logical reasoning. The current repository provides a quantized (compressed) version of this model, which is suitable for deployment on hardware with limited memory but loses some precision compared to the original. For a high-fidelity version, the unquantized base model is recommended.
7+
tags:
8+
- llm
9+
- code
10+
- instruction-tuned
11+
- text-to-text
12+
- gguf
13+
- qwen3
14+
overrides:
15+
parameters:
16+
model: llama-cpp/models/Qwen3-Coder-30B-A3B-Instruct-RTPurbo.i1-Q4_K_M.gguf
17+
name: Qwen3-Coder-30B-A3B-Instruct-RTPurbo-i1-GGUF
18+
backend: llama-cpp
19+
template:
20+
use_tokenizer_template: true
21+
known_usecases:
22+
- chat
23+
function:
24+
grammar:
25+
disable: true
26+
description: Imported from https://huggingface.co/mradermacher/Qwen3-Coder-30B-A3B-Instruct-RTPurbo-i1-GGUF
27+
options:
28+
- use_jinja:true
29+
files:
30+
- filename: llama-cpp/models/Qwen3-Coder-30B-A3B-Instruct-RTPurbo.i1-Q4_K_M.gguf
31+
sha256: a25f1817a557da703ab685e6b98550cd7ed87e4a74573b5057e6e2f26b21140e
32+
uri: https://huggingface.co/mradermacher/Qwen3-Coder-30B-A3B-Instruct-RTPurbo-i1-GGUF/resolve/main/Qwen3-Coder-30B-A3B-Instruct-RTPurbo.i1-Q4_K_M.gguf
233
- name: "glm-4.5v-i1"
334
urls:
435
- https://huggingface.co/mradermacher/GLM-4.5V-i1-GGUF

0 commit comments

Comments
 (0)