Skip to content

Commit fbe1d50

Browse files
feat(gallery): add Gemma 4 Scotoma 2 variants (#11458)
Add Q4_K_M and Q8_0 multimodal builds with the matching vision projector. Assisted-by: Codex:gpt-5 [HF API] Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
1 parent 8ad22ee commit fbe1d50

1 file changed

Lines changed: 74 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 74 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4407,6 +4407,80 @@
44074407
- filename: llama-cpp/mmproj/Qwopus3.6-27B-Coder-MTP-GGUF/mmproj-F32.gguf
44084408
sha256: 32f7ea0600c07272547da401d460f8abbd980f3a57b69d6df87be0e2505e0b9c
44094409
uri: https://huggingface.co/Jackrong/Qwopus3.6-27B-Coder-MTP-GGUF/resolve/main/mmproj-F32.gguf
4410+
- &gemma-4-31b-scotoma-2
4411+
name: "gemma-4-31b-scotoma-2-q4"
4412+
variants:
4413+
- model: gemma-4-31b-scotoma-2-q8
4414+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4415+
urls:
4416+
- https://huggingface.co/ReadyArt/gemma-4-31B-it-scotoma-2
4417+
- https://huggingface.co/ReadyArt/gemma-4-31B-it-scotoma-2-GGUF
4418+
description: |
4419+
Gemma 4 31B Scotoma 2 is a multimodal Gemma 4 31B instruction-tuned model from ReadyArt. It applies a bounded refusal edit and preference training intended to reduce repetitive prose patterns while retaining the base model's text and image capabilities. This entry uses the 18.7 GB Q4_K_M GGUF and the matching Q8_0 vision projector.
4420+
4421+
License: Apache 2.0 | Base model: Google Gemma 4 31B IT
4422+
license: "apache-2.0"
4423+
icon: https://ai.google.dev/gemma/images/gemma4_banner.png
4424+
tags:
4425+
- llm
4426+
- gguf
4427+
- gemma
4428+
- gemma4
4429+
- multimodal
4430+
- reasoning
4431+
overrides:
4432+
backend: llama-cpp
4433+
function:
4434+
automatic_tool_parsing_fallback: true
4435+
grammar:
4436+
disable: true
4437+
known_usecases:
4438+
- chat
4439+
- vision
4440+
mmproj: llama-cpp/mmproj/gemma-4-31B-it-scotoma-2-GGUF/mmproj-gemma-4-31B-scotoma-2-Q8_0.gguf
4441+
options:
4442+
- use_jinja:true
4443+
parameters:
4444+
model: llama-cpp/models/gemma-4-31B-it-scotoma-2-GGUF/gemma-4-31B-scotoma-2-Q4_K_M.gguf
4445+
template:
4446+
use_tokenizer_template: true
4447+
files:
4448+
- filename: llama-cpp/models/gemma-4-31B-it-scotoma-2-GGUF/gemma-4-31B-scotoma-2-Q4_K_M.gguf
4449+
sha256: 3d2d373d499662cfc5703adcd46b527054267fd750d1e55b11c3d2861b5e7330
4450+
uri: huggingface://ReadyArt/gemma-4-31B-it-scotoma-2-GGUF/gemma-4-31B-scotoma-2-Q4_K_M.gguf
4451+
- filename: llama-cpp/mmproj/gemma-4-31B-it-scotoma-2-GGUF/mmproj-gemma-4-31B-scotoma-2-Q8_0.gguf
4452+
sha256: a65401a0143d4a9883a4bca7e0c780b7140fc98142aaa26790da1ee46aa163dd
4453+
uri: huggingface://ReadyArt/gemma-4-31B-it-scotoma-2-GGUF/mmproj-gemma-4-31B-scotoma-2-Q8_0.gguf
4454+
- !!merge <<: *gemma-4-31b-scotoma-2
4455+
name: "gemma-4-31b-scotoma-2-q8"
4456+
variants: []
4457+
description: |
4458+
Gemma 4 31B Scotoma 2 is a multimodal Gemma 4 31B instruction-tuned model from ReadyArt. It applies a bounded refusal edit and preference training intended to reduce repetitive prose patterns while retaining the base model's text and image capabilities. This higher-fidelity entry uses the 32.6 GB Q8_0 GGUF and the matching Q8_0 vision projector.
4459+
4460+
License: Apache 2.0 | Base model: Google Gemma 4 31B IT
4461+
overrides:
4462+
backend: llama-cpp
4463+
function:
4464+
automatic_tool_parsing_fallback: true
4465+
grammar:
4466+
disable: true
4467+
known_usecases:
4468+
- chat
4469+
- vision
4470+
mmproj: llama-cpp/mmproj/gemma-4-31B-it-scotoma-2-GGUF/mmproj-gemma-4-31B-scotoma-2-Q8_0.gguf
4471+
options:
4472+
- use_jinja:true
4473+
parameters:
4474+
model: llama-cpp/models/gemma-4-31B-it-scotoma-2-GGUF/gemma-4-31B-scotoma-2-Q8_0.gguf
4475+
template:
4476+
use_tokenizer_template: true
4477+
files:
4478+
- filename: llama-cpp/models/gemma-4-31B-it-scotoma-2-GGUF/gemma-4-31B-scotoma-2-Q8_0.gguf
4479+
sha256: 79d9125f9769d95ceaa5e77cca72e9af99f4c9effb5bbe78999e9f3afe5e8d45
4480+
uri: huggingface://ReadyArt/gemma-4-31B-it-scotoma-2-GGUF/gemma-4-31B-scotoma-2-Q8_0.gguf
4481+
- filename: llama-cpp/mmproj/gemma-4-31B-it-scotoma-2-GGUF/mmproj-gemma-4-31B-scotoma-2-Q8_0.gguf
4482+
sha256: a65401a0143d4a9883a4bca7e0c780b7140fc98142aaa26790da1ee46aa163dd
4483+
uri: huggingface://ReadyArt/gemma-4-31B-it-scotoma-2-GGUF/mmproj-gemma-4-31B-scotoma-2-Q8_0.gguf
44104484
- name: "gemma-4-26b-a4b-it-qat"
44114485
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
44124486
urls:

0 commit comments

Comments
 (0)