cstr/Octen-Embedding-0.6B-GGUF

Octen-Embedding-0.6B — GGUF

GGUF conversion of Octen/Octen-Embedding-0.6B for use with CrispEmbed.

Model Details

• Architecture: Qwen3 decoder with GQA (16 Q heads, 8 KV heads, head_dim=128)
• Parameters: 0.6B (28 layers, 1024 hidden, 3072 intermediate)
• Embedding dim: 1024
• Pooling: Last-token
• Tokenizer: GPT-2 BPE (151K vocab)
• RoPE: theta=1,000,000
• License: Apache-2.0

Files

File	Type	Size	CosSim vs HF
octen-0.6b-f32.gguf	F32	2.3 GB	0.9999
octen-0.6b-q8_0.gguf	Q8_0	609 MB	0.9993
octen-0.6b-q4_k.gguf	Q4_K	325 MB	0.9570

Usage with CrispEmbed

./crispembed -m octen-0.6b-q8_0.gguf "Hello world"
# prints 1024-dim L2-normalized embedding

# Server mode
./crispembed-server -m octen-0.6b-q8_0.gguf --port 8080
curl -X POST http://localhost:8080/embed -d '{"texts": ["Hello world"]}'

Conversion

Converted from the original PyTorch model using models/convert-decoder-embed-to-gguf.py from the CrispEmbed repo. Verified bit-identical (cos≥0.999) to HuggingFace sentence-transformers output.

Provenance and EU AI Act Art. 53 note

• Upstream model: Octen/Octen-Embedding-0.6B — published by Octen.
• Upstream licence: apache-2.0. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
• What was done here: format conversion and/or quantisation only (GGUF). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
• Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository. No training-content summary was found on the upstream model card at the time of writing; that documentation gap is upstream's and is not filled here.
• Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.