|
4761 | 4761 | variants: |
4762 | 4762 | - model: qwen3.6-27b-dflash |
4763 | 4763 | - model: qwen3.6-27b-nvfp4-mtp |
| 4764 | + - model: qwen3.6-27b-q8 |
4764 | 4765 | url: github:mudler/LocalAI/gallery/virtual.yaml@master |
4765 | 4766 | urls: |
| 4767 | + - https://huggingface.co/Qwen/Qwen3.6-27B |
4766 | 4768 | - https://huggingface.co/unsloth/Qwen3.6-27B-GGUF |
4767 | 4769 | description: | |
4768 | 4770 | # Qwen3.6-27B |
|
4824 | 4826 | - filename: llama-cpp/mmproj/Qwen3.6-27B-GGUF/mmproj-F32.gguf |
4825 | 4827 | sha256: fdc443e974cad1f61c45af1cfd5580855855ddce0d6c14cc500a5714c486ac1d |
4826 | 4828 | uri: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF/resolve/main/mmproj-F32.gguf |
| 4829 | +- name: qwen3.6-27b-q8 |
| 4830 | + url: github:mudler/LocalAI/gallery/virtual.yaml@master |
| 4831 | + urls: |
| 4832 | + - https://huggingface.co/Qwen/Qwen3.6-27B |
| 4833 | + - https://huggingface.co/unsloth/Qwen3.6-27B-GGUF |
| 4834 | + description: | |
| 4835 | + # Qwen3.6-27B Q8_0 |
| 4836 | + |
| 4837 | + [](https://chat.qwen.ai) |
| 4838 | + |
| 4839 | + > [!Note] |
| 4840 | + > This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format. |
| 4841 | + > |
| 4842 | + > These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, KTransformers, etc. |
| 4843 | + |
| 4844 | + Following the February release of the Qwen3.5 series, we're pleased to share the first open-weight variant of Qwen3.6. Built on direct feedback from the community, Qwen3.6 prioritizes stability and real-world utility, offering developers a more intuitive, responsive, and genuinely productive coding experience. |
| 4845 | + |
| 4846 | + ## Qwen3.6 Highlights |
| 4847 | + |
| 4848 | + This release delivers substantial upgrades, particularly in |
| 4849 | + |
| 4850 | + - **Agentic Coding:** the model now handles frontend workflows and repository-level reasoning with greater fluency and precision. |
| 4851 | + - **Thinking Preservation:** we've introduced a new option to retain reasoning context from historical messages, streamlining iterative development and reducing overhead. |
| 4852 | + |
| 4853 | + For more details, please refer to our blog post Qwen3.6-27B. |
| 4854 | + |
| 4855 | + ## Model Overview |
| 4856 | + |
| 4857 | + ... |
| 4858 | + license: apache-2.0 |
| 4859 | + icon: https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen3.6/Figures/qwen3.6_27b_score.png |
| 4860 | + tags: |
| 4861 | + - llm |
| 4862 | + - gguf |
| 4863 | + - qwen |
| 4864 | + last_checked: "2026-04-30" |
| 4865 | + overrides: |
| 4866 | + backend: llama-cpp |
| 4867 | + function: |
| 4868 | + automatic_tool_parsing_fallback: true |
| 4869 | + grammar: |
| 4870 | + disable: true |
| 4871 | + known_usecases: |
| 4872 | + - chat |
| 4873 | + - vision |
| 4874 | + mmproj: llama-cpp/mmproj/Qwen3.6-27B-GGUF/mmproj-F32.gguf |
| 4875 | + options: |
| 4876 | + - use_jinja:true |
| 4877 | + parameters: |
| 4878 | + min_p: 0 |
| 4879 | + model: llama-cpp/models/Qwen3.6-27B-GGUF/Qwen3.6-27B-Q8_0.gguf |
| 4880 | + presence_penalty: 1.5 |
| 4881 | + repeat_penalty: 1 |
| 4882 | + temperature: 0.7 |
| 4883 | + top_k: 20 |
| 4884 | + top_p: 0.8 |
| 4885 | + template: |
| 4886 | + use_tokenizer_template: true |
| 4887 | + files: |
| 4888 | + - filename: llama-cpp/models/Qwen3.6-27B-GGUF/Qwen3.6-27B-Q8_0.gguf |
| 4889 | + sha256: f93f517f38e696d35a1a7df2c0e3155a64f4c4dcd662107a146ae263f7fb14ce |
| 4890 | + uri: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF/resolve/main/Qwen3.6-27B-Q8_0.gguf |
| 4891 | + - filename: llama-cpp/mmproj/Qwen3.6-27B-GGUF/mmproj-F32.gguf |
| 4892 | + sha256: fdc443e974cad1f61c45af1cfd5580855855ddce0d6c14cc500a5714c486ac1d |
| 4893 | + uri: https://huggingface.co/unsloth/Qwen3.6-27B-GGUF/resolve/main/mmproj-F32.gguf |
4827 | 4894 | - name: qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled |
4828 | 4895 | variants: |
4829 | 4896 | - model: qwen3.6-35b-a3b-claude-4.6-opus-reasoning-distilled-apex-i-quality |
|
5048 | 5115 | - model: qwen3.6-35b-a3b-apex-mtp-i-nano |
5049 | 5116 | url: github:mudler/LocalAI/gallery/virtual.yaml@master |
5050 | 5117 | urls: |
| 5118 | + - https://huggingface.co/Qwen/Qwen3.6-35B-A3B |
5051 | 5119 | - https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF |
5052 | 5120 | description: | |
5053 | 5121 | # Qwen3.6-35B-A3B |
|
0 commit comments