Skip to content

Commit 20f120e

Browse files
feat(gallery): add Ornith 1.0 9B variants
Add Q4_K_M and Q8_0 llama.cpp builds with the shared vision projector. The MIT-licensed agentic coding model is absent from the current gallery. Assisted-by: Codex:gpt-5
1 parent 869b30d commit 20f120e

1 file changed

Lines changed: 95 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 95 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,99 @@
11
---
2+
- &ornith-1-0-9b
3+
name: "ornith-1.0-9b-q4"
4+
variants:
5+
- model: ornith-1.0-9b-q8
6+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
7+
urls:
8+
- https://huggingface.co/ornith-ai/Ornith-1.0-9B
9+
- https://huggingface.co/unsloth/Ornith-1.0-9B-GGUF
10+
description: |
11+
Ornith-1.0-9B is an MIT-licensed Qwen3.5 model from Ornith AI for
12+
agentic coding, reasoning, repository-level software tasks, and tool use.
13+
It supports text and image input with a context window of 262K tokens.
14+
15+
This default entry uses the Q4_K_M GGUF and F16 vision projector. A
16+
higher-quality Q8_0 model is available as a variant.
17+
license: "mit"
18+
tags:
19+
- llm
20+
- gguf
21+
- cpu
22+
- gpu
23+
- qwen
24+
- reasoning
25+
- thinking
26+
- coding
27+
- agent
28+
- tools
29+
- vision
30+
- multimodal
31+
- long-context
32+
last_checked: "2026-08-16"
33+
overrides:
34+
backend: llama-cpp
35+
context_size: 262144
36+
function:
37+
automatic_tool_parsing_fallback: true
38+
grammar:
39+
disable: true
40+
known_usecases:
41+
- chat
42+
- vision
43+
mmproj: llama-cpp/mmproj/ornith-1.0-9b/mmproj-F16.gguf
44+
options:
45+
- use_jinja:true
46+
parameters:
47+
min_p: 0
48+
model: llama-cpp/models/ornith-1.0-9b/Ornith-1.0-9B-Q4_K_M.gguf
49+
repeat_penalty: 1
50+
temperature: 0.6
51+
top_k: 20
52+
top_p: 0.95
53+
template:
54+
use_tokenizer_template: true
55+
files:
56+
- filename: llama-cpp/models/ornith-1.0-9b/Ornith-1.0-9B-Q4_K_M.gguf
57+
uri: huggingface://unsloth/Ornith-1.0-9B-GGUF/Ornith-1.0-9B-Q4_K_M.gguf
58+
sha256: 641675b356a4463677a02a0d703f7b571b39f0b747fbd270b379c848edc29e84
59+
- filename: llama-cpp/mmproj/ornith-1.0-9b/mmproj-F16.gguf
60+
uri: huggingface://unsloth/Ornith-1.0-9B-GGUF/mmproj-F16.gguf
61+
sha256: 013638437d619467b92412e6efa281f706132f05ba6d0f4733e50f812c7e32fa
62+
- !!merge <<: *ornith-1-0-9b
63+
name: "ornith-1.0-9b-q8"
64+
variants: []
65+
description: |
66+
Ornith-1.0-9B in the higher-quality Q8_0 GGUF format, with the shared F16
67+
vision projector for multimodal prompts.
68+
overrides:
69+
backend: llama-cpp
70+
context_size: 262144
71+
function:
72+
automatic_tool_parsing_fallback: true
73+
grammar:
74+
disable: true
75+
known_usecases:
76+
- chat
77+
- vision
78+
mmproj: llama-cpp/mmproj/ornith-1.0-9b/mmproj-F16.gguf
79+
options:
80+
- use_jinja:true
81+
parameters:
82+
min_p: 0
83+
model: llama-cpp/models/ornith-1.0-9b/Ornith-1.0-9B-Q8_0.gguf
84+
repeat_penalty: 1
85+
temperature: 0.6
86+
top_k: 20
87+
top_p: 0.95
88+
template:
89+
use_tokenizer_template: true
90+
files:
91+
- filename: llama-cpp/models/ornith-1.0-9b/Ornith-1.0-9B-Q8_0.gguf
92+
uri: huggingface://unsloth/Ornith-1.0-9B-GGUF/Ornith-1.0-9B-Q8_0.gguf
93+
sha256: 4d469c15b1ef0e494c4a756acc8b2eec9eabcc6572986e9cb89efa87444c2d72
94+
- filename: llama-cpp/mmproj/ornith-1.0-9b/mmproj-F16.gguf
95+
uri: huggingface://unsloth/Ornith-1.0-9B-GGUF/mmproj-F16.gguf
96+
sha256: 013638437d619467b92412e6efa281f706132f05ba6d0f4733e50f812c7e32fa
297
- &qwen3-8-27b
398
name: "qwen3.8-27b-q4"
499
variants:

0 commit comments

Comments
 (0)