How to use from the
Use from the
MLX library
# Make sure mlx-vlm is installed
# pip install --upgrade mlx-vlm

from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
from mlx_vlm.utils import load_config

# Load the model
model, processor = load("mlx-community/gemma-4-26b-a4b-it-bf16")
config = load_config("mlx-community/gemma-4-26b-a4b-it-bf16")

# Prepare input
image = ["http://images.cocodataset.org/val2017/000000039769.jpg"]
prompt = "Describe this image."

# Apply chat template
formatted_prompt = apply_chat_template(
    processor, config, prompt, num_images=1
)

# Generate output
output = generate(model, processor, formatted_prompt, image)
print(output)

mlx-community/gemma-4-26b-a4b-it-bf16

This model was converted to MLX format from google/gemma-4-26B-A4B-it at revision 20da991ab4afab98e8f910c4a2e8f4fbefc404ad.

It was generated from the current mlx-vlm source checkout.

Use with mlx-vlm

pip install -U mlx-vlm
mlx_vlm.generate --model mlx-community/gemma-4-26b-a4b-it-bf16 --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
Downloads last month
442
Safetensors
Model size
26B params
Tensor type
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for mlx-community/gemma-4-26b-a4b-it-bf16

Finetuned
(253)
this model

Collection including mlx-community/gemma-4-26b-a4b-it-bf16