Skip to content

Commit 0df8de3

Browse files
feat(gallery): add Hy-MT2 1.8B variants (#11599)
Add Tencent’s compact translation model in Q4 and Q8 GGUF formats. The linked variants let LocalAI select the best build that fits each host. Assisted-by: Codex:gpt-5 Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
1 parent 2383726 commit 0df8de3

1 file changed

Lines changed: 69 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 69 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,73 @@
11
---
2+
- &hy-mt2-1-8b
3+
name: "hy-mt2-1.8b-q4"
4+
variants:
5+
- model: hy-mt2-1.8b-q8
6+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
7+
urls:
8+
- https://huggingface.co/tencent/Hy-MT2-1.8B
9+
- https://huggingface.co/tencent/Hy-MT2-1.8B-GGUF
10+
description: |
11+
Hy-MT2-1.8B is Tencent's compact multilingual translation model. It
12+
follows translation instructions across 33 languages and supports tasks
13+
such as terminology control, style transfer, and structure-preserving
14+
translation.
15+
16+
This default entry uses the 1.1 GB Q4_K_M GGUF. A higher-quality Q8_0
17+
model is available as a variant.
18+
license: "apache-2.0"
19+
tags:
20+
- llm
21+
- gguf
22+
- cpu
23+
- gpu
24+
- multilingual
25+
- translation
26+
last_checked: "2026-08-19"
27+
overrides:
28+
backend: llama-cpp
29+
context_size: 262144
30+
known_usecases:
31+
- chat
32+
options:
33+
- use_jinja:true
34+
parameters:
35+
model: llama-cpp/models/hy-mt2-1.8b/Hy-MT2-1.8B-Q4_K_M.gguf
36+
repeat_penalty: 1.05
37+
temperature: 0.7
38+
top_k: 20
39+
top_p: 0.6
40+
template:
41+
use_tokenizer_template: true
42+
files:
43+
- filename: llama-cpp/models/hy-mt2-1.8b/Hy-MT2-1.8B-Q4_K_M.gguf
44+
uri: huggingface://tencent/Hy-MT2-1.8B-GGUF/Hy-MT2-1.8B-Q4_K_M.gguf
45+
sha256: dc5f44fcf1fa496ee7ad725982c0c8c553a4de00259b53af84c4b89fb0c06699
46+
- !!merge <<: *hy-mt2-1-8b
47+
name: "hy-mt2-1.8b-q8"
48+
variants: []
49+
description: |
50+
Hy-MT2-1.8B in the higher-quality 1.9 GB Q8_0 GGUF format. This variant
51+
preserves more model fidelity for hosts with enough memory.
52+
overrides:
53+
backend: llama-cpp
54+
context_size: 262144
55+
known_usecases:
56+
- chat
57+
options:
58+
- use_jinja:true
59+
parameters:
60+
model: llama-cpp/models/hy-mt2-1.8b/Hy-MT2-1.8B-Q8_0.gguf
61+
repeat_penalty: 1.05
62+
temperature: 0.7
63+
top_k: 20
64+
top_p: 0.6
65+
template:
66+
use_tokenizer_template: true
67+
files:
68+
- filename: llama-cpp/models/hy-mt2-1.8b/Hy-MT2-1.8B-Q8_0.gguf
69+
uri: huggingface://tencent/Hy-MT2-1.8B-GGUF/Hy-MT2-1.8B-Q8_0.gguf
70+
sha256: 5c3fe0b1408a5ceb0143184ef247b11b579c525f4b02b060e6c851bb76fef1a4
271
- &ling-3-0-flash
372
name: "ling-3.0-flash-iq1"
473
variants:

0 commit comments

Comments
 (0)