How to use from the
Use from the
PEFT library
from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("google/gemma-3-4b-pt")
model = PeftModel.from_pretrained(base_model, "swadeshb/g3-4b-flat")

g3-4b-flat

LoRA adapter for the controlled Gemma 3 / T5Gemma 2 hierarchical-SFT experiment.

  • Base: google/gemma-3-4b-pt
  • Method: flat
  • Training data: sxiong/MLR_structured_trajectory, MATH subset only
  • LoRA: r=16, alpha=32
  • Training max length: 8192
Downloads last month
6
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for swadeshb/g3-4b-flat

Adapter
(19)
this model

Dataset used to train swadeshb/g3-4b-flat