Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

8,641

Base only

Active filters: gptq

Xu-Ouyang/pythia-1.4b-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 11

Xu-Ouyang/pythia-6.9b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 7B • Updated Jul 19, 2024 • 7

ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit

Text Generation • 12B • Updated Jul 23, 2024 • 23 • 5

Xu-Ouyang/pythia-410m-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 19, 2024 • 9

Xu-Ouyang/pythia-70m-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 70.4M • Updated Jul 19, 2024 • 10

Xu-Ouyang/pythia-70m-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 70.4M • Updated Jul 19, 2024 • 8

Xu-Ouyang/pythia-70m-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 70.4M • Updated Jul 19, 2024 • 9

Xu-Ouyang/pythia-70m-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 70.4M • Updated Jul 19, 2024 • 17

Xu-Ouyang/pythia-70m-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 70.4M • Updated Jul 19, 2024 • 8

Xu-Ouyang/pythia-70m-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 70.4M • Updated Jul 19, 2024 • 21

Xu-Ouyang/pythia-70m-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 70.4M • Updated Aug 9, 2024 • 20

Xu-Ouyang/pythia-70m-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 70.4M • Updated Aug 9, 2024 • 21

Xu-Ouyang/pythia-1.4b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 12

Xu-Ouyang/pythia-1.4b-deduped-int4-step129000-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 19, 2024 • 9

Xu-Ouyang/pythia-6.9b-deduped-int4-step43000-GPTQ-wikitext2

Text Generation • 7B • Updated Jul 19, 2024 • 6

Xu-Ouyang/pythia-6.9b-deduped-int4-step57000-GPTQ-wikitext2

Text Generation • 7B • Updated Jul 19, 2024 • 9

Xu-Ouyang/pythia-12b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 12B • Updated Jul 20, 2024 • 12

Xu-Ouyang/pythia-6.9b-deduped-int4-step86000-GPTQ-wikitext2

Text Generation • 7B • Updated Jul 19, 2024 • 8

Xu-Ouyang/pythia-6.9b-deduped-int4-step100000-GPTQ-wikitext2

Text Generation • 7B • Updated Jul 19, 2024 • 11

Ksgk-fy/Llama-3-8B-Instruct-abliterated_gptq_prompt

Text Generation • 8B • Updated Jul 19, 2024 • 5

ModelCloud/DeepSeek-V2-Chat-0628-gptq-4bit

Text Generation • 236B • Updated Jul 20, 2024 • 34 • 2

Xu-Ouyang/pythia-6.9b-deduped-int4-step115000-GPTQ-wikitext2

Text Generation • 7B • Updated Jul 19, 2024 • 11

navubolecou/semikong-8b-GGUF

Text Generation • 8B • Updated Jul 19, 2024 • 13 • 3

acl-srw-2024/llama-3-8b-instruct-cs-gptq-2bit

Text Generation • Updated Jul 19, 2024 • 10

acl-srw-2024/llama-3-8b-instruct-scb-gptq-2bit

Text Generation • Updated Jul 19, 2024 • 14

acl-srw-2024/llama-3-8b-instruct-scb-gptq-3bit

Text Generation • Updated Jul 19, 2024 • 8

acl-srw-2024/llama-3-8b-instruct-cs-gptq-3bit

Text Generation • Updated Jul 19, 2024 • 8

Xu-Ouyang/pythia-2.8b-deduped-int4-step14000-GPTQ-wikitext2

Text Generation • 3B • Updated Jul 19, 2024 • 15

Xu-Ouyang/pythia-2.8b-deduped-int4-step29000-GPTQ-wikitext2

Text Generation • 3B • Updated Jul 19, 2024 • 11

acl-srw-2024/llama-3-8b-instruct-scb-gptq-4bit

Text Generation • Updated Jul 19, 2024 • 9