Instructions to use nicolasembleton/gliner2.5-multi-v1-onnx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- GLiNER2
How to use nicolasembleton/gliner2.5-multi-v1-onnx with GLiNER2:
from gliner2 import GLiNER2 model = GLiNER2.from_pretrained("nicolasembleton/gliner2.5-multi-v1-onnx") # Extract entities text = "Apple CEO Tim Cook announced iPhone 15 in Cupertino yesterday." result = extractor.extract_entities(text, ["company", "person", "product", "location"]) print(result) - Notebooks
- Google Colab
- Kaggle
library_name: onnx
license: apache-2.0
pipeline_tag: token-classification
base_model: fastino/gliner2.5-multi-v1
tags:
- onnx
- gliner2
- gliner2.5
- boundary
- webgpu
- token-classification
- text-classification
- relation-extraction
gliner2.5-multi-v1-onnx
ONNX export of fastino/gliner2.5-multi-v1 (GLiNER 2.5
BoundaryExtractor) for onnxruntime-web / WebGPU. Revision 5: revision 4
plus candidate_states on the main graph and a tiny records.onnx assignment
head.
One encoder pass. JointIE beam, classification implies/excludes, and record
assignment stay in JavaScript.
Host packing and decode: Pastel-Org/gliner2.5-onnx-webgpu (live: gliner25-onnx-webgpu.pages.dev).
Files
| File | Role | Size |
|---|---|---|
onnx/model.onnx |
Encoder + entity pair path + classifier + text_states + candidate_states |
1121.5 MB |
onnx/heads.onnx |
SparseRelationScorer only (no encoder) |
23.7 MB |
onnx/records.onnx |
RecordHead assignment (inst/field/cand projections + null column) | 1.19 MB |
model.onnx outputs (new in v5)
candidate_states [B, Q, C, H] — C=192. Needed by records.onnx. Unused heads:
pass length-1 indices with mask 0.
records.onnx
Inputs: inst_states [B,N,H], inst_mask [B,N], field_query_states [B,F,H],
field_cand_states [B,F,C,H], field_cand_mask [B,F,C].
Outputs: assign_logits [B,N,F,1+C] (col 0 is ABSENT), object_logits,
latent_logits. Natural mode seeds instances from the first ::str field's
candidates above threshold.
Still not in ONNX
score_explicit_spans (pair-reranker broadcast does not export). The demo
attaches attributes by looking up the same (start,end) on attribute [E]
queries. Full Kleene classification AST is not ported; README implies /
excludes is a JS beam.
Credits
- Base checkpoints: Fastino, Apache-2.0.
- ONNX export + JS host: Pastel-Cloud OÜ.