How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="tthanhannguyen/qwen25-coder-3b-uncensored")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("tthanhannguyen/qwen25-coder-3b-uncensored")
model = AutoModelForCausalLM.from_pretrained("tthanhannguyen/qwen25-coder-3b-uncensored", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

Qwen2.5-Coder-3B-Instruct - Abliterated (Uncensored, Q4_K_M GGUF)

An abliterated (refusal-removed) variant of Qwen2.5-Coder-3B-Instruct.

What "abliterated" means

The model's refusal direction was measured (harmful vs. harmless contrastive prompts) and subtracted from the residual stream across all 36 layers using norm-preserving biprojected abliteration. Result: the model no longer emits "I can't help with that" style refusals. It is otherwise the same Qwen2.5-Coder-3B coding model.

  • Base: Qwen2.5-Coder-3B-Instruct (Apache-2.0)
  • Method: refusal-direction ablation, all layers, norm-preserving
  • Quant: Q4_K_M (~1.8 GB)

Intended use

For local, private use on your own hardware. Runs on CPU or consumer GPUs. The model is a capable coding assistant; it will comply with a wider range of prompts than the original. Use responsibly and within the laws that apply to you.

Run it locally

llama.cpp (CLI):

llama-cli -m qwen25-coder-3b-uncensored-q4_k_m.gguf -ngl 0 -p "write a function to parse json safely"

llama.cpp (server / OpenAI-compatible API):

llama-server -m qwen25-coder-3b-uncensored-q4_k_m.gguf --port 8081
# then: curl http://localhost:8081/v1/chat/completions ...

LM Studio: drag qwen25-coder-3b-uncensored-q4_k_m.gguf into LM Studio and chat.

Files

  • qwen25-coder-3b-uncensored-q4_k_m.gguf โ€” the quantized model
  • config.json, tokenizer.json, tokenizer_config.json โ€” architecture + tokenizer

License

Apache-2.0 (inherited from the base model).

Downloads last month
2,652
GGUF
Model size
3B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for tthanhannguyen/qwen25-coder-3b-uncensored

Base model

Qwen/Qwen2.5-3B
Quantized
(150)
this model