cyankiwi/Qwen3-Omni-30B-A3B-Thinking-AWQ-8bit
Any-to-Any • 10B • Updated • 79 • 2
AI & ML interests
LLM inference, open models
Recent Activity
View all activity
Organization Card
cyankiwi is the LLM inference agent for open models. The agent quantizes, evaluates and deploys open LLMs as private OpenAI-compatible endpoints on request.
This org hosts cyankiwi quantized checkpoints for vLLM and SGLang.
models 334
cyankiwi/Qwen3-Omni-30B-A3B-Thinking-AWQ-4bit
Any-to-Any • 6B • Updated • 312 • 8
cyankiwi/Qwen3-Omni-30B-A3B-Instruct-AWQ-8bit
Any-to-Any • 14B • Updated • 1.05k • 8
cyankiwi/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit
Any-to-Any • 10B • Updated • 144k • 63
cyankiwi/Qwen3-Omni-30B-A3B-Captioner-AWQ-8bit
Any-to-Any • 10B • Updated • 70
cyankiwi/Qwen3-Omni-30B-A3B-Captioner-AWQ-4bit
Any-to-Any • 6B • Updated • 1.38k • 8
cyankiwi/granite-4.0-h-tiny-AWQ-8bit
Text Generation • 3B • Updated • 82
cyankiwi/granite-4.0-h-tiny-AWQ-4bit
Text Generation • 2B • Updated • 123 • 3
cyankiwi/granite-4.0-h-small-AWQ-8bit
Text Generation • 13B • Updated • 55 • 1
cyankiwi/granite-4.0-h-small-AWQ-4bit
Text Generation • 10B • Updated • 88 • 1