Instructions to use XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct") model = AutoModelForMultimodalLM.from_pretrained("XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct
- SGLang
How to use XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct with Docker Model Runner:
docker model run hf.co/XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct
Scene-Builder-Qwen3-VL-8B-Instruct
Learning to Design Scenes and Critique Their Quality
Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation
OmniAI Group of ZJU ACES Lab
Scene-Builder is the supervised fine-tuning (SFT) model from Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation, built on Qwen3-VL-8B-Instruct. It learns from complementary scene-construction and scene-critique experience and serves as the starting point for subsequent Scene-GRPO training.
This repository releases the SFT checkpoint with full model weights and inference configurations.
Overview: Design Intelligence
We define design intelligence as the ability to both design a scene and critique its quality.
Scene design concerns constructing physically valid, functionally correct, and layout-coherent scenes, while efficiently correcting errors without unnecessary trial and error when problems arise. Scene critique focuses on assessing scene quality along the same dimensions and distinguishing better designs from poorer ones. These two capabilities are closely connected, since effective design requires reliable critique to guide construction, while meaningful critique requires an understanding of what constitutes good scene design.
Video Introduction
Watch or download the English introduction · Explore scene demos
The video introduces the broader Scene-Designer project, including design intelligence, data construction, and Critic-guided learning. The weights released here are the Scene-Builder SFT stage, before Scene-GRPO.
From Experience to Scene-Builder
The project constructs two complementary sources of supervision:
- Scene-OTA-35K: scene-construction experience with Observation–Thought–Action interactions. Causal Trajectory Consolidation preserves important construction and correction decisions while removing ineffective corrections.
- Scene-OTC-15K: scene-critique experience with Observation–Thought–Critic supervision, using scene perturbations to construct comparisons with ordered quality degradation.
Joint SFT develops scene construction and scene critique capabilities, yielding Scene-Builder. The subsequent Scene-GRPO stage uses a frozen Critic to compare candidate designs and assess parent-to-child improvement, producing Scene-Designer.
For evaluating scene critique, Scene-OTC-Bench provides 94 two-scene comparison questions and 55 four-scene ranking questions.
Checkpoint at a Glance
| Property | Value |
|---|---|
| Model | Scene-Builder-Qwen3-VL-8B-Instruct |
| Base model | Qwen/Qwen3-VL-8B-Instruct |
| Training stage | Supervised fine-tuning (SFT) |
| Architecture | Qwen3VLForConditionalGeneration |
| Format | Full model weights in four safetensors shards |
| Precision | BF16 |
Files and Usage
The repository includes the final model weights, shard index, model and generation configurations, tokenizer, chat template, and image/video preprocessing configurations. Training checkpoints, optimizer states, and logs are excluded.
Download the model with the Hugging Face CLI:
hf download XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct --local-dir ./Scene-Builder-Qwen3-VL-8B-Instruct
Load it in a Transformers environment that supports Qwen3-VL:
from transformers import AutoProcessor, Qwen3VLForConditionalGeneration
model_id = "XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct"
processor = AutoProcessor.from_pretrained(model_id)
model = Qwen3VLForConditionalGeneration.from_pretrained(
model_id,
dtype="auto",
device_map="auto",
)
End-to-end scene generation additionally requires the project's scene-construction tools and execution environment. This repository provides the model weights and processing assets.
Citation
@misc{liu2026scenedesignerlearningdesignintelligence,
title={Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation},
author={Xuanyu Liu and Hongyan Feng and Miao Pan and Sunlai Chen and Lizhou Liang and Bing Sun and Wenqi Zhang and Xuhong Zhang},
year={2026},
eprint={2610.23121},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2610.23121},
}
Contact
Xuanyu Liu: 22651306@zju.edu.cn.
- Downloads last month
- 101
Model tree for XuanyuLiu/Scene-Builder-Qwen3-VL-8B-Instruct
Base model
Qwen/Qwen3-VL-8B-Instruct