Instructions to use Ssum-mer/qwen3.8-27b-growpath with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Ssum-mer/qwen3.8-27b-growpath with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Ssum-mer/qwen3.8-27b-growpath") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Ssum-mer/qwen3.8-27b-growpath") model = AutoModelForMultimodalLM.from_pretrained("Ssum-mer/qwen3.8-27b-growpath", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Ssum-mer/qwen3.8-27b-growpath with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Ssum-mer/qwen3.8-27b-growpath:BF16 # Run inference directly in the terminal: llama cli -hf Ssum-mer/qwen3.8-27b-growpath:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Ssum-mer/qwen3.8-27b-growpath:BF16 # Run inference directly in the terminal: llama cli -hf Ssum-mer/qwen3.8-27b-growpath:BF16
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Ssum-mer/qwen3.8-27b-growpath:BF16 # Run inference directly in the terminal: ./build/bin/llama cli -hf Ssum-mer/qwen3.8-27b-growpath:BF16
Use Docker
docker model run hf.co/Ssum-mer/qwen3.8-27b-growpath:BF16
- Llama new
- LM Studio
- Jan
- vLLM
How to use Ssum-mer/qwen3.8-27b-growpath with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Ssum-mer/qwen3.8-27b-growpath" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ssum-mer/qwen3.8-27b-growpath", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Ssum-mer/qwen3.8-27b-growpath:BF16
- SGLang
How to use Ssum-mer/qwen3.8-27b-growpath with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Ssum-mer/qwen3.8-27b-growpath" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ssum-mer/qwen3.8-27b-growpath", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Ssum-mer/qwen3.8-27b-growpath" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Ssum-mer/qwen3.8-27b-growpath", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use Ssum-mer/qwen3.8-27b-growpath with Ollama:
ollama run hf.co/Ssum-mer/qwen3.8-27b-growpath:BF16
- Unsloth Desktop
- Pi
How to use Ssum-mer/qwen3.8-27b-growpath with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Ssum-mer/qwen3.8-27b-growpath:BF16
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Ssum-mer/qwen3.8-27b-growpath:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Ssum-mer/qwen3.8-27b-growpath with Docker Model Runner:
docker model run hf.co/Ssum-mer/qwen3.8-27b-growpath:BF16
- Lemonade
How to use Ssum-mer/qwen3.8-27b-growpath with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Ssum-mer/qwen3.8-27b-growpath:BF16
Run and chat with the model
lemonade run user.qwen3.8-27b-growpath-BF16
List all available models
lemonade list
- Hermes Agent
How to use Ssum-mer/qwen3.8-27b-growpath with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Ssum-mer/qwen3.8-27b-growpath:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Ssum-mer/qwen3.8-27b-growpath:BF16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Ssum-mer/qwen3.8-27b-growpath with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Ssum-mer/qwen3.8-27b-growpath:BF16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Ssum-mer/qwen3.8-27b-growpath:BF16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
GrowPath โ Qwen3.8-27B ยท V18
Qwen3.8-27B๋ฅผ ๊ธฐ๋ฐ์ผ๋ก ํ์ธํ๋ํ GrowPath ์ ๋ฌด ํ์ต ๋ก๋๋งต ์์ฑ ๋ชจ๋ธ.
๊ธฐ๋ณธ ๋ชจ๋ธ์ LoRA ๋ณ๊ฒฝ๋ถ์ ๋ณํฉํ ์ ์ฒด ๊ฐ์ค์น์ ๋๋ค. ๋ณ๋ LoRA ์ด๋ํฐ ์ ์ฉ ์์ด ๋ณํฉ ๋ชจ๋ธ๋ก ๋ก๋ํฉ๋๋ค.
๋ชจ๋ธ ์ ๋ณด
| ํญ๋ชฉ | ๋ด์ฉ |
|---|---|
| ๊ธฐ๋ฐ ๋ชจ๋ธ | Qwen/Qwen3.8-27B |
| ๊ธฐ๋ฐ revision | 1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0 |
| ์ต์ข ๋ฒ์ | GrowPath V18 |
| ์ต์ข ํ์ต ์ํญ | 2 ยท ์ ์์ ํ์ธ |
| ์ฃผ์ ์ฉ๋ | ํ๊ตญ์ด ์ ๋ฌด ํ์ต ๋ก๋๋งต ์์ฑยท๋ถ๋ถ ์์ |
| ๋ฐฐํฌ ํํ | LoRA ๋ณํฉ ์ ์ฒด ๋ชจ๋ธยทBF16ยทSafetensors 12์ค๋ |
| ํ๋ผ๋ฏธํฐ | 27,356,728,560 |
| ๊ฐ์ค์น ํฌ๊ธฐ | 54,713,457,120 bytes |
์ํคํ ์ฒ ํ๊ธฐ
์ ์ฅ์์ ๊ธฐ๋ฐ ๋ชจ๋ธ์ ์ด๋ฆ์ Qwen3.8-27B์
๋๋ค. ์ ์ฅ๋ config์ ์ํคํ
์ฒ ๊ตฌํ ์ด๋ฆ์ Qwen3_5ForConditionalGeneration, model_type์ qwen3_5์
๋๋ค. Hugging Face๊ฐ ํ์ํ๋ qwen3_5 ์๋ ํ๊ทธ๋ ์ด config ํ๋์์ ์ ๋ํ๋ฉฐ, ๊ธฐ๋ฐ ์ ์ฅ์๋ช
๊ณผ ๊ตฌ๋ถํฉ๋๋ค.
์ ๋ ฅ๊ณผ ์ถ๋ ฅ
์ ๋ฌด ๋ชฉํยทํ์ฌ ์ญ๋ยท๊ธฐ๊ฐยท์ฃผ๋น ํ์ต์๊ฐยท์์ฐยทํ์ต ์๋ฃ ๋ฑ ์ ๊ณต๋ ์กฐ๊ฑด์ ์ ๋ ฅ์ผ๋ก ์ฌ์ฉํฉ๋๋ค. ๋ก๋๋งต๊ณผ ๋ถ๋ถ ์์ ์์ฒญ์ ๊ตฌ์กฐํ๋ ์๋ต์ ๋์์ผ๋ก ํ์ธํ๋ํ์ต๋๋ค. ์ถ๋ ฅ๋ ๊ธฐ๊ฐยท์์ฐยท์๋ฃ ๊ทผ๊ฑฐยท์์ ๋ฒ์๋ ์ฌ์ฉ ์ ์ ํ์ธํด์ผ ํฉ๋๋ค.
์ ์ ๋ฐฐ๊ฒฝ
๊ธฐ์กด ๋ชจ๋ธ๋ณด๋ค ์ฝ 10% ์ฐ์๋ผ๊ณ ํ๋จํด V18์ ์ต์ข ์ ํํ์ต๋๋ค. ์ ๋ฌด ๋ชฉ์ ์ ๋ง์ถ ๋ต๋ณ ๊ตฌ์ฑ๊ณผ ๋ณํฉ ๋ชจ๋ธ์ ๋ฐฐํฌยท๋ฒ์ ๊ด๋ฆฌ ํธ์๋ฅผ ํจ๊ป ๊ณ ๋ คํ์ต๋๋ค. 10%๋ ์ ์์์ ์ ์ ํ๋จ์ด๋ฉฐ, ์ด ๋ชจ๋ธ ์นด๋์์ ์๋ก ์ธก์ ํ ๋ฒค์น๋งํฌ ํฅ์๋ฅ ์ ๋ปํ์ง ์์ต๋๋ค.
์ฌ์ฉ ๋ฒ์
์ ๋ฌด ํ์ต ๊ณํ ์๋ฆฝ์ ์ง์ํ๋ ๋ชจ๋ธ์ ๋๋ค. ๊ท์ ์ ์ต์ ์ฑยท์น์ธ ์ํ์ ์ถ์ฒ ์๋ฃ์ ์ด์ฉ ๊ฐ๋ฅ์ฑ์ ๋ณ๋ ๊ฒ์ยท๊ฒ์ฆ ๊ฒฝ๋ก์์ ํ์ธํด์ผ ํฉ๋๋ค. ํ์ธํ๋ ๋ชจ๋ธ ์์ฒด๊ฐ ํ์ฌ DB๋ ์ต์ ์๋ฌธ์ ์๋ ์กฐํํ์ง๋ ์์ต๋๋ค.
BF16 GGUF
ํ ์คํธ ์์ฑ์ฉ BF16 GGUF์ ๋๋ค. ๊ธฐ์กด Safetensors12์ค๋๋ ๊ทธ๋๋ก ์ ์งํฉ๋๋ค.
- ํ์ผ: qwen3.8-27b-growpath-BF16.gguf
- ํฌ๊ธฐ: 53,808,282,112 bytes
- SHA256:
32d69322977ccd21240d4005a5b4cedb877702724c1159a57faa174f87e1cb81 - ๋ณํ ๊ธฐ๋ก ยท ์ฒดํฌ์ฌ
- ์๋ณธ ๋ชจ๋ธ: https://huggingface.co/Ssum-mer/qwen3.8-27b-growpath
- 4๋นํธ ๋ชจ๋ธ: https://huggingface.co/Ssum-mer/qwen3.8-27b-growpath-Q4
- ๋ชจ๋ธ ๋ฒ์ : V18 ยท ์๋ณธํ์ต2์ํญ(์ ์์ ํ์ธ)
- ์๋ณธ revision:
66d1af509ab0681f3b9365227e5c794c65801fbf
A100์์ ๋ชจ๋ธ ๋ก๋ฉยท์งง์ ํ๊ตญ์ด ์์ฑ์ ํ์ธํ์ต๋๋ค. ์ ์ฒด ํ์ง ์ฌํ๊ฐ ๊ฒฐ๊ณผ๋ ์๋๋๋ค. ์ด๋ฏธ์ง ์ ๋ ฅ์ฉ vision projector๋ ํฌํจํ์ง ์์ต๋๋ค. ์ ์ฅ์๋ช ์ Qwen3.8์ด๋ฉฐ ๊ตฌํ ์ํคํ ์ฒ ์ด๋ฆ์ qwen3_5์ ๋๋ค.
- Downloads last month
- 338