Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

21,309

Base only

Active filters: gguf-my-repo

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 961 • 380

eepos/Nanbeige4.3-33B-Q4_K_S-GGUF

Text Generation • 33B • Updated 1 day ago • 545 • 4

rippertnt/HyperCLOVAX-SEED-Text-Instruct-1.5B-Q4_K_M-GGUF

2B • Updated Apr 28, 2025 • 1.11M • 16

ggml-org/bge-m3-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Oct 12, 2025 • 17k • 22

RuCoverLAB/deepseek-r1-8b-abliterated-q4-Q4_K_M-GGUF

8B • Updated 9 days ago • 128 • 3

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 2.08k • 73

mondk/Claude-Haiku-5.5-Qwen-5B-Thinking-GGUF

4B • Updated 9 days ago • 405 • 2

gnh1201/SmolLM2-135M-Instruct-Q8_0-GGUF

Text Generation • 0.1B • Updated 4 days ago • 145 • 2

HigherMind/Dystopian-Survival-Guide-1-Q8_0-GGUF

7B • Updated Sep 24, 2024 • 63 • 2

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 361 • 26

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 41.2k • 36

tessellation/qwen2.5-32B-roleplay-zh-Q4_K_M-GGUF

33B • Updated Nov 7, 2024 • 57 • 2

hardikg2907/code-llama-html-completion-1-Q2_K-GGUF

7B • Updated Nov 26, 2024 • 167 • 8

sabafallah/bge-reranker-v2-m3-Q4_K_M-GGUF

Text Ranking • 0.6B • Updated Apr 2, 2025 • 181 • 3

freddyaboulton/3b-fr-ft-research_release-Q4_K_M-GGUF

Text-to-Speech • 3B • Updated Apr 9, 2025 • 44 • 3

rippertnt/Qwen3-0.6B-Q4_K_M-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 242 • 2

rippertnt/Qwen3-1.7B-Q4_K_M-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 3.12k • 5

Aldaris/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 11.5k • 14

dean2155/Qwen3-Reranker-0.6B-Q4_K_M-GGUF

0.6B • Updated Jun 5, 2025 • 145 • 1

Koitenshin/Huihui-InternVL3-2B-abliterated-GGUF

Image-Text-to-Text • 2B • Updated Aug 18, 2025 • 346 • 2

fdtn-ai/Foundation-Sec-1.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Nov 19, 2025 • 212 • 4

NikolayKozloff/translategemma-4b-it-Q8_0-GGUF

Image-Text-to-Text • 4B • Updated Jan 15 • 1.33k • 12

AlfRjw/prompt-enhancer-gemma-3-270m-it-Q8_0-GGUF

Text Generation • 0.3B • Updated Jan 15 • 249 • 2

vividdream/Qwen-Open-Finance-R-8B-IQ4_NL-GGUF

Question Answering • 8B • Updated Apr 4 • 103 • 4

Ngvrd/video_generation_model-Q2_K-GGUF

Text-to-Video • 7B • Updated Jun 14 • 554 • 14

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated Jun 15 • 63 • 20

Medvedko/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-Q4_K_M-GGUF

Text Generation • 12B • Updated Jun 18 • 868 • 13

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated Jul 29 • 2.87k • 23

serajfast4/serajflash

Image-Text-to-Text • 27B • Updated Aug 15 • 43 • 1

mitkox/Huihui-Qwen3.8-27B-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated Aug 16 • 1.01k • 6