File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change 11---
2+ - name: "nl2sh-1.5b-q4"
3+ url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
4+ urls:
5+ - https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct
6+ - https://huggingface.co/ThorOdinson246/nl2sh-1.5b-Q4_K_M
7+ description: |
8+ nl2sh-1.5b is a 1.5B Qwen2.5-Coder fine-tune that converts plain-English
9+ requests into single POSIX or Bash commands. This Q4_K_M GGUF is 941 MB
10+ and is designed for fast CPU inference.
11+
12+ Use the system prompt from the model card and review every generated
13+ command before execution. The model can produce destructive commands and
14+ cannot inspect the local filesystem.
15+ license: "apache-2.0"
16+ tags:
17+ - llm
18+ - gguf
19+ - cpu
20+ - gpu
21+ - coding
22+ - shell
23+ - command-generation
24+ last_checked: "2026-08-15"
25+ overrides:
26+ backend: llama-cpp
27+ context_size: 32768
28+ known_usecases:
29+ - chat
30+ options:
31+ - use_jinja:true
32+ parameters:
33+ model: nl2sh-1.5b-Q4_K_M.gguf
34+ temperature: 0
35+ template:
36+ use_tokenizer_template: true
37+ files:
38+ - filename: nl2sh-1.5b-Q4_K_M.gguf
39+ uri: huggingface://ThorOdinson246/nl2sh-1.5b-Q4_K_M/nl2sh-1.5b-Q4_K_M.gguf
40+ sha256: 6f8a17a11129a31074c944f4c2602453fafd9de43bdaeb1630a8f511ec820f71
241- &ornith-1-0-9b
342 name: "ornith-1.0-9b-q4"
443 variants:
You can’t perform that action at this time.
0 commit comments