Skip to content

Commit cff69a0

Browse files
gallery: add Qwen3.6 27B Q8 variant (#11293)
Assisted-by: Codex:gpt-5 Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
1 parent 896b4b6 commit cff69a0

1 file changed

Lines changed: 68 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 68 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4761,8 +4761,10 @@
47614761
variants:
47624762
- model: qwen3.6-27b-dflash
47634763
- model: qwen3.6-27b-nvfp4-mtp
4764+
- model: qwen3.6-27b-q8
47644765
url: github:mudler/LocalAI/gallery/virtual.yaml@master
47654766
urls:
4767+
- https://huggingface.co/Qwen/Qwen3.6-27B
47664768
- https://huggingface.co/unsloth/Qwen3.6-27B-GGUF
47674769
description: |
47684770
# Qwen3.6-27B
@@ -4824,6 +4826,71 @@
48244826
- filename: llama-cpp/mmproj/Qwen3.6-27B-GGUF/mmproj-F32.gguf
48254827
sha256: fdc443e974cad1f61c45af1cfd5580855855ddce0d6c14cc500a5714c486ac1d
48264828
uri: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF/resolve/main/mmproj-F32.gguf
4829+
- name: qwen3.6-27b-q8
4830+
url: github:mudler/LocalAI/gallery/virtual.yaml@master
4831+
urls:
4832+
- https://huggingface.co/Qwen/Qwen3.6-27B
4833+
- https://huggingface.co/unsloth/Qwen3.6-27B-GGUF
4834+
description: |
4835+
# Qwen3.6-27B Q8_0
4836+
4837+
[](https://chat.qwen.ai)
4838+
4839+
> [!Note]
4840+
> This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
4841+
>
4842+
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc.
4843+
4844+
Following the February release of the Qwen3.5 series, we're pleased to share the first open-weight variant of Qwen3.6. Built on direct feedback from the community, Qwen3.6 prioritizes stability and real-world utility, offering developers a more intuitive, responsive, and genuinely productive coding experience.
4845+
4846+
## Qwen3.6 Highlights
4847+
4848+
This release delivers substantial upgrades, particularly in
4849+
4850+
- **Agentic Coding:** the model now handles frontend workflows and repository-level reasoning with greater fluency and precision.
4851+
- **Thinking Preservation:** we've introduced a new option to retain reasoning context from historical messages, streamlining iterative development and reducing overhead.
4852+
4853+
For more details, please refer to our blog post Qwen3.6-27B.
4854+
4855+
## Model Overview
4856+
4857+
...
4858+
license: apache-2.0
4859+
icon: https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen3.6/Figures/qwen3.6_27b_score.png
4860+
tags:
4861+
- llm
4862+
- gguf
4863+
- qwen
4864+
last_checked: "2026-04-30"
4865+
overrides:
4866+
backend: llama-cpp
4867+
function:
4868+
automatic_tool_parsing_fallback: true
4869+
grammar:
4870+
disable: true
4871+
known_usecases:
4872+
- chat
4873+
- vision
4874+
mmproj: llama-cpp/mmproj/Qwen3.6-27B-GGUF/mmproj-F32.gguf
4875+
options:
4876+
- use_jinja:true
4877+
parameters:
4878+
min_p: 0
4879+
model: llama-cpp/models/Qwen3.6-27B-GGUF/Qwen3.6-27B-Q8_0.gguf
4880+
presence_penalty: 1.5
4881+
repeat_penalty: 1
4882+
temperature: 0.7
4883+
top_k: 20
4884+
top_p: 0.8
4885+
template:
4886+
use_tokenizer_template: true
4887+
files:
4888+
- filename: llama-cpp/models/Qwen3.6-27B-GGUF/Qwen3.6-27B-Q8_0.gguf
4889+
sha256: f93f517f38e696d35a1a7df2c0e3155a64f4c4dcd662107a146ae263f7fb14ce
4890+
uri: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF/resolve/main/Qwen3.6-27B-Q8_0.gguf
4891+
- filename: llama-cpp/mmproj/Qwen3.6-27B-GGUF/mmproj-F32.gguf
4892+
sha256: fdc443e974cad1f61c45af1cfd5580855855ddce0d6c14cc500a5714c486ac1d
4893+
uri: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF/resolve/main/mmproj-F32.gguf
48274894
- name: qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled
48284895
variants:
48294896
- model: qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-i-quality
@@ -5048,6 +5115,7 @@
50485115
- model: qwen3.6-35b-a3b-apex-mtp-i-nano
50495116
url: github:mudler/LocalAI/gallery/virtual.yaml@master
50505117
urls:
5118+
- https://huggingface.co/Qwen/Qwen3.6-35B-A3B
50515119
- https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF
50525120
description: |
50535121
# Qwen3.6-35B-A3B

0 commit comments

Comments
 (0)