Instructions to use xCloudinfo/xVITA-Embed-300M-zhTW-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use xCloudinfo/xVITA-Embed-300M-zhTW-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0
# Run inference directly in the terminal:
llama cli -hf xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0
# Run inference directly in the terminal:
llama cli -hf xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0

Use Docker

docker model run hf.co/xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0

LM Studio
Jan
Ollama
How to use xCloudinfo/xVITA-Embed-300M-zhTW-GGUF with Ollama:
```
ollama run hf.co/xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0
```

Unsloth Studio

How to use xCloudinfo/xVITA-Embed-300M-zhTW-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for xCloudinfo/xVITA-Embed-300M-zhTW-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for xCloudinfo/xVITA-Embed-300M-zhTW-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for xCloudinfo/xVITA-Embed-300M-zhTW-GGUF to start chatting

Atomic Chat new
Docker Model Runner
How to use xCloudinfo/xVITA-Embed-300M-zhTW-GGUF with Docker Model Runner:
```
docker model run hf.co/xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0
```

Lemonade

How to use xCloudinfo/xVITA-Embed-300M-zhTW-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull xCloudinfo/xVITA-Embed-300M-zhTW-GGUF:Q8_0

Run and chat with the model

lemonade run user.xVITA-Embed-300M-zhTW-GGUF-Q8_0

List all available models

lemonade list

guessleej commited on 9 days ago

Commit

7538ada

verified ·

1 Parent(s): b86e006

更名為 xVITA-Embed-300M-zhTW，補 Gemma Terms 合規聲明

Browse files

Files changed (1) hide show

README.md +16 -3

README.md CHANGED Viewed

@@ -1,6 +1,6 @@
 ---
 license: gemma
-base_model: xCloudinfo/xcloud-emb-zhtw
 language:
 - zh
 pipeline_tag: sentence-similarity
@@ -16,9 +16,9 @@ tags:
 - taiwan
 ---
-# xcloud-emb-zhtw — GGUF
-[xCloudinfo/xcloud-emb-zhtw](https://huggingface.co/xCloudinfo/xcloud-emb-zhtw)（云碩科技自製繁體中文檢索 embedding，DRCD test hit@1 86.0、超越 bge-m3 / multilingual-e5-large）的 GGUF 量化版，適用 llama.cpp 與 ollama。
 > **2026-07-18 重要修復**：本日以前的所有 GGUF 檔因轉檔工具與 sentence-transformers 5.6 模組命名不相容，
 > **缺少模型的 Dense 投影層**，向量空間與 safetensors 版不一致（cosine 相似度失效）。請重新下載本日後的檔案。
@@ -78,3 +78,16 @@ llama-server -m xcloud-emb-zhtw-8k-Q8_0.gguf --embeddings --port 8080
 ---
 云碩科技股份有限公司（xCloudinfo Corp. Limited）

 ---
 license: gemma
+base_model: xCloudinfo/xVITA-Embed-300M-zhTW
 language:
 - zh
 pipeline_tag: sentence-similarity
 - taiwan
 ---
+# xVITA-Embed-300M-zhTW — GGUF
+[xCloudinfo/xVITA-Embed-300M-zhTW](https://huggingface.co/xCloudinfo/xVITA-Embed-300M-zhTW)（云碩科技自製繁體中文檢索 embedding，DRCD test hit@1 86.0、超越 bge-m3 / multilingual-e5-large）的 GGUF 量化版，適用 llama.cpp 與 ollama。
 > **2026-07-18 重要修復**：本日以前的所有 GGUF 檔因轉檔工具與 sentence-transformers 5.6 模組命名不相容，
 > **缺少模型的 Dense 投影層**，向量空間與 safetensors 版不一致（cosine 相似度失效）。請重新下載本日後的檔案。
 ---
 云碩科技股份有限公司（xCloudinfo Corp. Limited）
+## 授權
+底模依 [Gemma Terms of Use](https://ai.google.dev/gemma/terms) 授權，本量化模型之使用同受其約束。
+**Gemma 合規聲明**
+> Gemma is provided under and subject to the Gemma Terms of Use found at [ai.google.dev/gemma/terms](https://ai.google.dev/gemma/terms)
+- 本模型為 **Google EmbeddingGemma-300m 的修改版本（Model Derivative）**，經繁體中文檢索語料微調後轉換為 GGUF 格式。
+- 使用者再散布本模型或其衍生物時，須一併傳遞 Gemma Terms of Use 第 3.2 節之使用限制。
+> 註：GGUF 檔名維持 `xcloud-emb-*` 前綴不變，以免既有下載腳本與 ollama 設定失效；模型本身即 xVITA-Embed-300M-zhTW。