Qwen
Image-Text-to-Text • 10B • Updated • 521 • 3Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-9B-AWQ-8bit
Image-Text-to-Text • 9B • Updated • 238 • 3Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-9B-NVFP4A16
Image-Text-to-Text • 9B • Updated • 243 • 4Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-9B-AWQ-4bit
Image-Text-to-Text • 9B • Updated • 234 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-9B-NVFP4
Image-Text-to-Text • 9B • Updated • 215 • 1Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-9B-GGUF
9B • Updated • 544 • 3Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.8-27B-FP8-dynamic
Image-Text-to-Text • 28B • Updated • 254 • 3Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.8-27B-AWQ-8bit
Image-Text-to-Text • 28B • Updated • 233 • 2Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.8-27B-NVFP4A16
Image-Text-to-Text • 28B • Updated • 265 • 2Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.8-27B-AWQ-4bit
Image-Text-to-Text • 28B • Updated • 285 • 2Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.8-27B-NVFP4
Image-Text-to-Text • 28B • Updated • 278 • 2Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.8-27B-GGUF
27B • Updated • 2.41k • 3Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.6-35B-A3B-FP8-dynamic
Image-Text-to-Text • 36B • Updated • 205 • 1Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.6-35B-A3B-AWQ-8bit
Image-Text-to-Text • 36B • Updated • 241 • 2Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.6-35B-A3B-AWQ-4bit
Image-Text-to-Text • 36B • Updated • 222 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.6-35B-A3B-NVFP4
Image-Text-to-Text • 36B • Updated • 259 • 2Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.6-35B-A3B-GGUF
36B • Updated • 512 • 2Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.5-122B-A10B-AWQ-8bit
Image-Text-to-Text • 125B • Updated • 217 • 1Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-122B-A10B-AWQ-4bit
Image-Text-to-Text • 125B • Updated • 216 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-122B-A10B-FP8-dynamic
Image-Text-to-Text • 125B • Updated • 240 • 1Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-122B-A10B-NVFP4
Image-Text-to-Text • 125B • Updated • 229 • 1Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-122B-A10B-GGUF
125B • Updated • 436 • 2Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.6-35B-A3B-NVFP4A16
Image-Text-to-Text • 36B • Updated • 227 • 1Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-122B-A10B-NVFP4A16
Image-Text-to-Text • 125B • Updated • 253 • 2Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-0.8B-FP8-dynamic
Image-Text-to-Text • 0.9B • Updated • 161Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-0.8B-AWQ-8bit
Image-Text-to-Text • 0.9B • Updated • 142Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-0.8B-NVFP4A16
Image-Text-to-Text • 0.9B • Updated • 165Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-0.8B-AWQ-4bit
Image-Text-to-Text • 0.9B • Updated • 161Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-0.8B-NVFP4
Image-Text-to-Text • 0.9B • Updated • 153Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-0.8B-GGUF
0.8B • Updated • 384 • 1Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.5-2B-FP8-dynamic
Image-Text-to-Text • 2B • Updated • 171 • 1Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-2B-AWQ-8bit
Image-Text-to-Text • 2B • Updated • 160Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-2B-NVFP4A16
Image-Text-to-Text • 2B • Updated • 168Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-2B-AWQ-4bit
Image-Text-to-Text • 2B • Updated • 156Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-2B-NVFP4
Image-Text-to-Text • 2B • Updated • 155Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-2B-GGUF
2B • Updated • 379 • 1Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.5-4B-FP8-dynamic
Image-Text-to-Text • 5B • Updated • 146Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-4B-AWQ-8bit
Image-Text-to-Text • 5B • Updated • 152Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-4B-NVFP4A16
Image-Text-to-Text • 5B • Updated • 168Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-4B-AWQ-4bit
Image-Text-to-Text • 5B • Updated • 280 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-4B-NVFP4
Image-Text-to-Text • 5B • Updated • 165Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-4B-GGUF
4B • Updated • 393 • 1Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama
axteam/Qwen3.5-27B-FP8-dynamic
Image-Text-to-Text • 28B • Updated • 195 • 1Note FP8 dynamic (W8A8) — near-lossless 8-bit, vLLM
axteam/Qwen3.5-27B-AWQ-8bit
Image-Text-to-Text • 28B • Updated • 177 • 1Note AWQ INT8 (W8A16) — near-lossless 8-bit
axteam/Qwen3.5-27B-NVFP4A16
Image-Text-to-Text • 28B • Updated • 187 • 1Note NVFP4 W4A16 (FP4 weights, BF16 act) — best 4-bit quality
axteam/Qwen3.5-27B-AWQ-4bit
Image-Text-to-Text • 28B • Updated • 388 • 1Note AWQ INT4 (W4A16) — ~1/4 size
axteam/Qwen3.5-27B-NVFP4
Image-Text-to-Text • 28B • Updated • 176Note NVFP4 W4A4 (FP4 weights+act) — fastest on Blackwell
axteam/Qwen3.5-27B-GGUF
27B • Updated • 355 • 1Note GGUF Q8_0 / Q4_K_M for llama.cpp / Ollama