FP8-Dynamic (Linear layers, PTQ activations) quant of cyberagent/Mistral-Nemo-Japanese-Instruct-2408 w/ LLM Compressor 0.4.0

Downloads last month
36
Safetensors
Model size
12B params
Tensor type
BF16
ยท
F8_E4M3
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for shisa-ai/Mistral-Nemo-Japanese-Instruct-FP8-Dynamic

Collection including shisa-ai/Mistral-Nemo-Japanese-Instruct-FP8-Dynamic