nicolasembleton's picture
v5 export: candidate_states + records.onnx assignment head
20c74ee verified
|
Raw
History Blame
2.11 kB
metadata
library_name: onnx
license: apache-2.0
pipeline_tag: token-classification
base_model: fastino/gliner2.5-multi-v1
tags:
  - onnx
  - gliner2
  - gliner2.5
  - boundary
  - webgpu
  - token-classification
  - text-classification
  - relation-extraction

gliner2.5-multi-v1-onnx

ONNX export of fastino/gliner2.5-multi-v1 (GLiNER 2.5 BoundaryExtractor) for onnxruntime-web / WebGPU. Revision 5: revision 4 plus candidate_states on the main graph and a tiny records.onnx assignment head.

One encoder pass. JointIE beam, classification implies/excludes, and record assignment stay in JavaScript.

Host packing and decode: Pastel-Org/gliner2.5-onnx-webgpu (live: gliner25-onnx-webgpu.pages.dev).

Files

File Role Size
onnx/model.onnx Encoder + entity pair path + classifier + text_states + candidate_states 1121.5 MB
onnx/heads.onnx SparseRelationScorer only (no encoder) 23.7 MB
onnx/records.onnx RecordHead assignment (inst/field/cand projections + null column) 1.19 MB

model.onnx outputs (new in v5)

candidate_states [B, Q, C, H] — C=192. Needed by records.onnx. Unused heads: pass length-1 indices with mask 0.

records.onnx

Inputs: inst_states [B,N,H], inst_mask [B,N], field_query_states [B,F,H], field_cand_states [B,F,C,H], field_cand_mask [B,F,C]. Outputs: assign_logits [B,N,F,1+C] (col 0 is ABSENT), object_logits, latent_logits. Natural mode seeds instances from the first ::str field's candidates above threshold.

Still not in ONNX

score_explicit_spans (pair-reranker broadcast does not export). The demo attaches attributes by looking up the same (start,end) on attribute [E] queries. Full Kleene classification AST is not ported; README implies / excludes is a JS beam.

Credits