Skip to content

Commit eaa09af

Browse files
feat(gallery): add nl2sh 1.5B
Add the Q4_K_M build of the nl2sh shell-command model with its recommended deterministic sampling and a safety warning. Assisted-by: Codex:gpt-5
1 parent c29c99e commit eaa09af

1 file changed

Lines changed: 39 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,43 @@
11
---
2+
- name: "nl2sh-1.5b-q4"
3+
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+
urls:
5+
- https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct
6+
- https://huggingface.co/ThorOdinson246/nl2sh-1.5b-Q4_K_M
7+
description: |
8+
nl2sh-1.5b is a 1.5B Qwen2.5-Coder fine-tune that converts plain-English
9+
requests into single POSIX or Bash commands. This Q4_K_M GGUF is 941 MB
10+
and is designed for fast CPU inference.
11+
12+
Use the system prompt from the model card and review every generated
13+
command before execution. The model can produce destructive commands and
14+
cannot inspect the local filesystem.
15+
license: "apache-2.0"
16+
tags:
17+
- llm
18+
- gguf
19+
- cpu
20+
- gpu
21+
- coding
22+
- shell
23+
- command-generation
24+
last_checked: "2026-08-15"
25+
overrides:
26+
backend: llama-cpp
27+
context_size: 32768
28+
known_usecases:
29+
- chat
30+
options:
31+
- use_jinja:true
32+
parameters:
33+
model: nl2sh-1.5b-Q4_K_M.gguf
34+
temperature: 0
35+
template:
36+
use_tokenizer_template: true
37+
files:
38+
- filename: nl2sh-1.5b-Q4_K_M.gguf
39+
uri: huggingface://ThorOdinson246/nl2sh-1.5b-Q4_K_M/nl2sh-1.5b-Q4_K_M.gguf
40+
sha256: 6f8a17a11129a31074c944f4c2602453fafd9de43bdaeb1630a8f511ec820f71
241
- &ornith-1-0-9b
342
name: "ornith-1.0-9b-q4"
443
variants:

0 commit comments

Comments
 (0)