Skip to content

Commit ea51567

Browse files
LocalAI [bot]mudler
andauthored
chore(model gallery): 🤖 add 1 new models via gallery agent (#8170)
chore(model gallery): 🤖 add new models via gallery agent Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
1 parent 552c62a commit ea51567

1 file changed

Lines changed: 32 additions & 0 deletions

File tree

‎gallery/index.yaml‎

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,36 @@
11
---
2+
- name: "huihui-glm-4.7-flash-abliterated-i1"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/mradermacher/Huihui-GLM-4.7-Flash-abliterated-i1-GGUF
6+
description: |
7+
The model is a quantized version of **huihui-ai/Huihui-GLM-4.7-Flash-abliterated**, optimized for efficiency and deployment. It uses GGUF files with various quantization levels (e.g., IQ1_M, IQ2_XXS, Q4_K_M) and is designed for tasks requiring low-resource deployment. Key features include:
8+
- **Base Model**: Huihui-GLM-4.7-Flash-abliterated (unmodified, original model).
9+
- **Quantization**: Supports IQ1_M to Q4_K_M, balancing accuracy and efficiency.
10+
- **Use Cases**: Suitable for applications needing lightweight inference, such as edge devices or resource-constrained environments.
11+
- **Downloads**: Available in GGUF format with varying quality and size (e.g., 0.2GB to 18.2GB).
12+
- **Tags**: Abliterated, uncensored, and optimized for specific tasks.
13+
14+
This model is a modified version of the original GLM-4.7, tailored for deployment with quantized weights.
15+
overrides:
16+
parameters:
17+
model: llama-cpp/models/Huihui-GLM-4.7-Flash-abliterated.i1-Q4_K_M.gguf
18+
name: Huihui-GLM-4.7-Flash-abliterated-i1-GGUF
19+
backend: llama-cpp
20+
template:
21+
use_tokenizer_template: true
22+
known_usecases:
23+
- chat
24+
function:
25+
grammar:
26+
disable: true
27+
description: Imported from https://huggingface.co/mradermacher/Huihui-GLM-4.7-Flash-abliterated-i1-GGUF
28+
options:
29+
- use_jinja:true
30+
files:
31+
- filename: llama-cpp/models/Huihui-GLM-4.7-Flash-abliterated.i1-Q4_K_M.gguf
32+
sha256: 2ec5fcf2aa882c0c55fc67a35ea7ed50c24016bc4a8a4ceacfcea103dc2f1cb8
33+
uri: https://huggingface.co/mradermacher/Huihui-GLM-4.7-Flash-abliterated-i1-GGUF/resolve/main/Huihui-GLM-4.7-Flash-abliterated.i1-Q4_K_M.gguf
234
- name: "mox-small-1-i1"
335
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
436
urls:

0 commit comments

Comments
 (0)