Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

360

Base only

Active filters: qat

nerkyor/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2

Text Generation • 2B • Updated Sep 12 • 18.8k • 77

SC117/gemma-4-26B-A4B-it-qat-heretic-GGUF

25B • Updated Oct 3 • 29.7k • 41

SC117/gemma-4-12B-it-heretic-QAT-GGUF

12B • Updated Oct 3 • 11.8k • 64

mlx-community/gemma-4-31B-it-qat-OptiQ-4bit

Text Generation • 31B • Updated 17 days ago • 2.49k • 11

EigenLabs/gemma-4-31B-it-qat-q4_0-MLX

Text Generation • 31B • Updated Jul 6 • 94 • 1

YoozLabs/Qwen3.5-4B-qat-GGUF

Text Generation • 4B • Updated Jul 13 • 164 • 3

ProCreations/grug-27b-qat-q4-gguf

27B • Updated Jul 23 • 84.2k • 22

moebiusT7/gemma-4-12b-mobius-custom-c1

Text Generation • 12B • Updated Sep 29 • 173 • 2

JoaoZaokk/Qwen2.1-W8A8-W8A16-W4A8-W4A16-W4A4-QAT

Text-to-Image • 7B • Updated Sep 27 • 940 • 3

xbill9/gemma-4-E4B-it-qat-q4_0-w4a16-ct-text-ple4

Text Generation • 7B • Updated 26 days ago • 322 • 1

WaveCut/gemma-4-26B-A4B-it-QAT-Q4_0-MTP-NInfer-v3

Image-Text-to-Text • Updated 24 days ago • 1.38k • 2

WaveCut/Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced-MTP-NInfer-v3

Image-Text-to-Text • Updated 24 days ago • 2.15k • 1

xbill9/gemma-4-12B-it-qat-assistant-q4_0-exact-gguf

Text Generation • 0.4B • Updated 17 days ago • 213 • 1

jianlee/yolox-tiny-quantized

Object Detection • Updated 1 day ago • 1

Thomaschtl/qwen3-0.6b-qat-test

Text Generation • Updated Jun 3, 2025

Thomaschtl/qwen3-06b-qat-test

Text Generation • Updated Jun 3, 2025 • 1

Thomaschtl/test2

Text Generation • Updated Jun 4, 2025 • 16

Thomaschtl/test3

Text Generation • 0.2B • Updated Jun 4, 2025 • 12

PKU-DS-LAB/Fairy2i-W2

Text Generation • 7B • Updated Dec 12, 2025 • 49 • 3

mradermacher/Fairy2i-W2-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 199

mradermacher/Fairy2i-W2-i1-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 1.26k

thebajajra/RexReranker-0.6B-MXFP4

Text Ranking • 0.5B • Updated Jan 24 • 14 • 3

Adanmohh/apuri-v3-0.6b-sft-qat-gguf

0.6B • Updated Jan 14 • 46

junzzhu/atomllama-33K-5x5-DigitMesh-sparse-q8

Text Generation • 34.7k • Updated Jan 15 • 7

tokenlabsdotrun/Llama-3.1-8B-Unsloth-FP8_INT4-QAT

Text Generation • Updated Jan 19 • 12

Harahan/QVGen-Wan-1_3B-W4A4

Text-to-Video • 1B • Updated Feb 2 • 49 • 3

Harahan/QVGen-CogVideoX-2B-W4A4

Text-to-Video • 2B • Updated Feb 2 • 18 • 2

Sikaworld1990/gemma-3-12b-qat-abliterated-sikaworld-fp4-ltx2

Feature Extraction • Updated Mar 11 • 40

kusakana/ReasoningQAT-Qwen3-1.7B-3bit

2B • Updated Mar 20 • 7

kusakana/ReasoningQAT-Qwen3-1.7B-2bit

2B • Updated Mar 20 • 7