Skip to content

Commit c52808c

Browse files
feat(gallery): add Fara1.5 4B variants (#11479)
Add the smaller Fara1.5 computer-use model alongside the existing 9B and 27B gallery entries. Offer Q4_K_M and Q8_0 builds so LocalAI can select for memory or quality. Assisted-by: Codex:gpt-5 Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
1 parent 0647939 commit c52808c

1 file changed

Lines changed: 76 additions & 0 deletions

File tree

gallery/index.yaml

Lines changed: 76 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7147,6 +7147,82 @@
71477147
- filename: llama-cpp/models/Qwen3.5-35B-A3B-APEX-GGUF/Qwen3.5-35B-A3B-APEX-Quality.gguf
71487148
sha256: 50887b60c77ee5c95bc3657814ae993abcab7b2d71868b9af1e84d6badd09a57
71497149
uri: https://huggingface.co/mudler/Qwen3.5-35B-A3B-APEX-GGUF/resolve/main/Qwen3.5-35B-A3B-APEX-Quality.gguf
7150+
- &fara1-5-4b
7151+
name: fara1.5-4b
7152+
url: github:mudler/LocalAI/gallery/virtual.yaml@master
7153+
variants:
7154+
- model: fara1.5-4b-q8
7155+
urls:
7156+
- https://huggingface.co/microsoft/Fara1.5-4B
7157+
- https://huggingface.co/bartowski/Fara1.5-4B-GGUF
7158+
description: |
7159+
Fara1.5-4B is Microsoft's 4B-parameter multimodal computer-use agent for web browsers, fine-tuned from Qwen3.5-4B. It accepts screenshots and text, emits structured browser actions, supports a 262K-token context, and should be deployed with appropriate sandboxing and user-confirmation controls. This entry uses the recommended Q4_K_M GGUF quantization.
7160+
license: mit
7161+
tags:
7162+
- fara
7163+
- qwen
7164+
- qwen3.5
7165+
- 4b
7166+
- llm
7167+
- gguf
7168+
- quantized
7169+
- chat
7170+
- vision
7171+
- multimodal
7172+
- agent
7173+
- computer-use
7174+
- gpu
7175+
- cpu
7176+
last_checked: "2026-08-12"
7177+
overrides:
7178+
backend: llama-cpp
7179+
function:
7180+
grammar:
7181+
disable: true
7182+
known_usecases:
7183+
- chat
7184+
- vision
7185+
mmproj: llama-cpp/mmproj/Fara1.5-4B-GGUF/mmproj-Fara1.5-4B-f16.gguf
7186+
options:
7187+
- use_jinja:true
7188+
parameters:
7189+
model: llama-cpp/models/Fara1.5-4B-GGUF/Fara1.5-4B-Q4_K_M.gguf
7190+
template:
7191+
use_tokenizer_template: true
7192+
files:
7193+
- filename: llama-cpp/models/Fara1.5-4B-GGUF/Fara1.5-4B-Q4_K_M.gguf
7194+
sha256: aedd3e6ed7071eb0941a9d86de0f35c16f76eedb9e15dbefa2b4a4e5e7838e51
7195+
uri: huggingface://bartowski/Fara1.5-4B-GGUF/Fara1.5-4B-Q4_K_M.gguf
7196+
- filename: llama-cpp/mmproj/Fara1.5-4B-GGUF/mmproj-Fara1.5-4B-f16.gguf
7197+
sha256: 373320845fb5539dd55a66d3faafcd8f123e83a7318334d557a04d604f5ef84d
7198+
uri: huggingface://bartowski/Fara1.5-4B-GGUF/mmproj-Fara1.5-4B-f16.gguf
7199+
- !!merge <<: *fara1-5-4b
7200+
name: fara1.5-4b-q8
7201+
variants: []
7202+
description: |
7203+
Fara1.5-4B is Microsoft's 4B-parameter multimodal computer-use agent for web browsers, fine-tuned from Qwen3.5-4B. It accepts screenshots and text, emits structured browser actions, supports a 262K-token context, and should be deployed with appropriate sandboxing and user-confirmation controls. This entry uses the higher-quality Q8_0 GGUF quantization.
7204+
overrides:
7205+
backend: llama-cpp
7206+
function:
7207+
grammar:
7208+
disable: true
7209+
known_usecases:
7210+
- chat
7211+
- vision
7212+
mmproj: llama-cpp/mmproj/Fara1.5-4B-GGUF/mmproj-Fara1.5-4B-f16.gguf
7213+
options:
7214+
- use_jinja:true
7215+
parameters:
7216+
model: llama-cpp/models/Fara1.5-4B-GGUF/Fara1.5-4B-Q8_0.gguf
7217+
template:
7218+
use_tokenizer_template: true
7219+
files:
7220+
- filename: llama-cpp/models/Fara1.5-4B-GGUF/Fara1.5-4B-Q8_0.gguf
7221+
sha256: 943b76f8ff6893c465de5c841e5116941fe87c8863dbb759d386697faa723880
7222+
uri: huggingface://bartowski/Fara1.5-4B-GGUF/Fara1.5-4B-Q8_0.gguf
7223+
- filename: llama-cpp/mmproj/Fara1.5-4B-GGUF/mmproj-Fara1.5-4B-f16.gguf
7224+
sha256: 373320845fb5539dd55a66d3faafcd8f123e83a7318334d557a04d604f5ef84d
7225+
uri: huggingface://bartowski/Fara1.5-4B-GGUF/mmproj-Fara1.5-4B-f16.gguf
71507226
- &fara1-5-9b
71517227
name: fara1.5-9b
71527228
url: github:mudler/LocalAI/gallery/virtual.yaml@master

0 commit comments

Comments
 (0)