Instructions to use AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice")

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice

SGLang

How to use AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice with Docker Model Runner:
```
docker model run hf.co/AbteeXAILab/lumynax-infused-qwen25-omni-7b-voice
```

lumynax-infused-qwen25-omni-7b-voice / checksums.sha256

AbteeXAILabs

docs: publish professional LumynaX model card

35fcf6a verified 2 months ago

Raw

History Blame Contribute Delete

3.07 kB

	9d8e0ab23ff2dd2725da70a95221051dff3bef68bd0f286a8eac2910361f5ddf artifacts/release_training_summary.json
	8478a44400579a8c5731072109a45f69ad31c785e62d038ab63c1892f74b5b44 hf_space/app.py
	5fdb392bfc6d5129086057049543fa741d1c1cd963c8a316017eb41f488fb720 hf_space/README.md
	3e78abed8cdc940c6bf1c763d81d829ec4dfe2f8b3897e5051989ef19169eaeb hf_space/requirements.txt
	597e9f0af8dcaaed94aeaa35ae95e7d996edd679dd8f20409831eef0f9b1b7a8 LICENSE.txt
	e81a2cc3bd867a1217019eed202d1d8a07e1063ece716f22060dda14f6cc07d8 merged_model/added_tokens.json
	1933f7ca08e6503460e981d9037ddc0b851196abfa3aceea52d6ee0c0fdfd9f0 merged_model/chat_template.json
	f85f5a078951471e32d6ce5dd169acf619e3480c83daf195e5016ef3eb89b1a9 merged_model/config.json
	b9acf52072249e0e1850541d51ca4c85a30b9d7e23c2f2093ec0fb4139059ac7 merged_model/generation_config.json
	f146283f155042ab703527aff06da373946e8a514eace3d741dfa7e8d2a09828 merged_model/LUMYNAX_PACKAGE_IDENTITY.txt
	8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5 merged_model/merges.txt
	5edb02fd7c98803239468375cc9dc1bff492865c2aa086b78f348597021d6cbc merged_model/model-00001-of-00005.safetensors
	7c99b55c6e5bc63fd4b19d4dc23cdc3ddac4b0101bb3c0958cc2b5d05c2bbafe merged_model/model-00002-of-00005.safetensors
	ad00c3ac296300db905934ed213c4077ff49b85d30c0099270c814e2c77ec812 merged_model/model-00003-of-00005.safetensors
	152bc7d81441eaba22547d8d96c03d32dd592ce0e0e1d0e449347a4b23a532d3 merged_model/model-00004-of-00005.safetensors
	b8b18276481ba8cdf4fe2c98ac4c7a2da6e0d1c8a51850d162a391760cb2b81e merged_model/model-00005-of-00005.safetensors
	5428b3927da9f3bd525967db81936642e4e068afc3f8f2dfaf2a9066c9bef8e2 merged_model/model.safetensors.index.json
	b47055ce61463ce143e9aab741d55c0aa520801a0a5d63be73c5b17cecb6bc69 merged_model/preprocessor_config.json
	dc241604d085780a33f760f69c47e6622451104c20eee3cd3a12b6e884b43f44 merged_model/special_tokens_map.json
	8441917e39ae0244e06d704b95b3124795cec478e297f9afac39ba670d7e9d99 merged_model/tokenizer.json
	569aa7a9171e36dfff80f0a7550ab0c9c09e46ac840fea5030641417394fb0d2 merged_model/tokenizer_config.json
	ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910 merged_model/vocab.json
	3ebd3cc62bc61e2963698e3e9aba3fdca8f886950d831db4577f12d945e8ca56 ollama/create_ollama_model.ps1
	585ef6d7643cb741da5253658e95b9950b6c304cf2cf235bb7a326fdaccb2b85 ollama/Modelfile
	27442fbaae94b7942d59f9e73195fef06f32db5621f23765263d653bb130ed59 quickstart.py
	7f3cb526a5ec12ce7aa4641026ebcb675f5e98321f5cdfad8eb845bc8cb32cb6 README.md
	05963b8209b115b025a72aeab4b9e1270e0d739bb4c4d996b8c85f63c6d199ca release_export_manifest.json
	6fe6e0bf994dd6462085d6b6defae60fbf4fc1dea32881910f0c8f1f6f696a8d requirements.txt
	2dfede0e6610c473959c963b292fcec325452acba33fd1bba21110e04933df53 VERSION.txt
	469c148cb8e04ecb9e79cfb6ff72d0158347acce94b1abf924c2c1a78e2645ae docs/lumynax-release-map.svg
	a87664c8d3de17d5491c6e0f27f94565437f25eca240d35f23be04c3c1394168 docs/lumynax-release-overview.svg
	d4e38a0dac9183d66bb44860f2b904acd73a29889b0907aa16a3ca7ed21a6169 docs/lumynax-runtime-flow.svg