4bit-quantization

Here are 4 public repositories matching this topic...

Nawfal-AI / DPO-Safety-Alignment-Phi3

DPO fine-tuning of Phi-3-mini for safety alignment using QLoRA, runnable end-to-end on a single 16GB T4 GPU. Includes training health monitoring, data validation, and a toxicity/reasoning eval harness.

pytorch ai-safety fine-tuning preference-learning dpo huggingface-transformers rlhf qlora llm-fine-tuning phi-3 preference-optimization llm-alignment 4bit-quantization

Updated Nov 8, 2026
Python

Haven16262 / LLM-Local-Deployment-Guide

Star

A practical guide for local LLM deployment with 4-bit quantization. / 4-bit量化本地大模型部署实战指南

python cuda quantization gradio huggingface llm local-llm bitsandbytes qwen deployment-guide 4bit-quantization

Updated May 6, 2026
Python

avan-codes / LLM_4_bit_quantization

Star

A (7B) Large Language Model quantized to 4-bit NF4, with VRAM and speed benchmarking

quantization mistral model-benchmarking llm bitsandbytes nf4 model-benchmarking-and-optimization vram-optimization 4bit-quantization

Updated Oct 26, 2026
Jupyter Notebook

MaheshJakkala / naamapadam-multilingual-ner

Star

Benchmarking NER on Naamapadam across 11 Indic languages. EDA + model training using mBERT, XLM-R, T5, FlanT5, mT5 + LLM fine-tuning (TinyLlama, Llama-3.2, Gemma, Qwen, Mistral) + 0–5 shot inference on 9 generative models.

pytorch named-entity-recognition lora bert indic-languages peft few-shot-learning xlm-roberta huggingface-transformers multilingual-nlp llm ai4bharat hindi-nlp naamapadam 4bit-quantization 8bit-quantization

Updated Sep 7, 2026
Jupyter Notebook

Add this topic to your repo

To associate your repository with the 4bit-quantization topic, visit your repo's landing page and select "manage topics."

Learn more