Video-Text-to-Text
Safetensors
qwen3_vl
shunyang90 commited on
Commit
1516793
·
verified ·
1 Parent(s): b23d8dd

Reference official WebUI instead of removed Gradio app

Browse files
Files changed (1) hide show
  1. README.md +2 -6
README.md CHANGED
@@ -25,7 +25,7 @@ To our knowledge, this is the **first open, vision-driven interaction model** re
25
  ---
26
  ## vLLM Usage
27
 
28
- [vLLM-Omni](https://github.com/vllm-project/vllm-omni) provides **day-0 support** for JoyAI-VL-Interaction! The model is a standard Qwen3-VL VLM served by a plain `vllm serve`; vLLM-Omni adds the real-time interaction layer on top — the per-second **speak / silence / delegate** orchestration, 3-tier summary memory, and pluggable ASR / TTS / delegation. For installation and full setup (browser demo, RTSP input, delegation, ASR/TTS), see the [vLLM-Omni recipe](https://github.com/vllm-project/vllm-omni/blob/main/recipes/JD/JoyAI-VL-Interaction.md).
29
 
30
  ### Online Serving
31
 
@@ -40,10 +40,6 @@ vllm serve jdopensource/JoyAI-VL-Interaction-Preview \
40
  # 2. Start the interaction orchestrator (OpenAI-compatible, :8070)
41
  python -m vllm_omni.experimental.fullduplex.joyvl.serving.server --port 8070 \
42
  --main-backend-url http://127.0.0.1:8061/v1 --main-model JoyAI-VL-Interaction-Preview
43
-
44
- # 3. (optional) launch the self-contained Gradio demo
45
- pip install vllm-omni[demo]
46
- python vllm-omni/examples/online_serving/joyvl_interaction/app.py --server http://127.0.0.1:8070
47
  ```
48
 
49
- Send one frame per turn (~1 fps) to `/v1/chat/completions` with an `x-session-id` header and an optional standing instruction; each reply's `interaction.action` is `silence` / `response` / `delegate`. See the recipe for the full client and capability examples.
 
25
  ---
26
  ## vLLM Usage
27
 
28
+ [vLLM-Omni](https://github.com/vllm-project/vllm-omni) provides **day-0 support** for JoyAI-VL-Interaction! The model is a standard Qwen3-VL VLM served by a plain `vllm serve`; vLLM-Omni adds the real-time interaction layer on top — the per-second **speak / silence / delegate** orchestration, 3-tier summary memory, and pluggable ASR / TTS / delegation. For installation and full setup, see the [vLLM-Omni recipe](https://github.com/vllm-project/vllm-omni/blob/main/recipes/JD/JoyAI-VL-Interaction.md).
29
 
30
  ### Online Serving
31
 
 
40
  # 2. Start the interaction orchestrator (OpenAI-compatible, :8070)
41
  python -m vllm_omni.experimental.fullduplex.joyvl.serving.server --port 8070 \
42
  --main-backend-url http://127.0.0.1:8061/v1 --main-model JoyAI-VL-Interaction-Preview
 
 
 
 
43
  ```
44
 
45
+ For the full browser demo live webcam / RTSP input, voice (ASR/TTS), and the per-tick decision stream run JD's official WebUI (`services/webui`) in front of the orchestrator; see the [vLLM-Omni recipe](https://github.com/vllm-project/vllm-omni/blob/main/recipes/JD/JoyAI-VL-Interaction.md) for the steps.