tillmannohm commited on
Commit
8ebfb69
·
verified ·
1 Parent(s): f196995

Upload 3 files

Browse files
Files changed (3) hide show
  1. README.md +98 -0
  2. config.yaml +150 -0
  3. model.onnx +3 -0
README.md ADDED
@@ -0,0 +1,98 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: onnx
3
+ pipeline_tag: feature-extraction
4
+ license: mit
5
+ tags:
6
+ - eidora
7
+ - eidora-model-zoo
8
+ - onnx
9
+ - onnxruntime
10
+ - embeddings
11
+ - text
12
+ - e5
13
+ - compute:light
14
+ - modality:text
15
+ base_model: intfloat/e5-small-v2
16
+ datasets:
17
+ - intfloat/e5
18
+ metrics:
19
+ - cosine-similarity
20
+ model-index:
21
+ - name: E5_SMALL_384
22
+ results: []
23
+ ---
24
+
25
+ # E5_SMALL_384
26
+
27
+ E5_SMALL_384 is a light text embedding model for fast semantic grouping and search in EIDORA. Choose it when you want a compact text model that runs comfortably on ordinary laptops.
28
+
29
+ ## Best For
30
+
31
+ - Fast first-pass grouping of text notes, captions, and metadata.
32
+ - Semantic search over medium and large text projects on laptops.
33
+ - A compact starter model for EIDORA text embedding workflows.
34
+
35
+ ## Not Ideal For
36
+
37
+ - Long-document reasoning or generation.
38
+ - Fine-grained domain retrieval where a larger text embedding model is acceptable.
39
+ - Image, video, or audio inputs.
40
+
41
+ ## Compute Tier
42
+
43
+ Light: small download, low memory, faster CPU runtime. Intended for laptop CPU use and large first-pass projects.
44
+
45
+ ## Inputs
46
+
47
+ - `text`: required text input from `text_source`.
48
+
49
+ ## Output
50
+
51
+ The primary output is `embedding`, a float32 tensor shaped `[batch, 384]`. Embeddings are already normalized and are intended for cosine similarity.
52
+
53
+ ## Usage In EIDORA
54
+
55
+ EIDORA shows this package as a light text embedding model in the Model Zoo. Use it for discovery maps, grouping, retrieval, and related embedding workflows.
56
+
57
+ ## Preprocessing
58
+
59
+ - `text`: .
60
+
61
+ ## Authorship And Citation
62
+
63
+ This ONNX package was produced by EIDORA from the original E5 Small v2 model. EIDORA converted the model to ONNX and is not the original model creator. Please cite Text Embeddings by Weakly-Supervised Contrastive Pre-training and the original model repository when using this converted model.
64
+
65
+ Original model: https://github.com/microsoft/unilm/tree/master/e5
66
+
67
+ Original paper: https://arxiv.org/abs/2212.03533
68
+
69
+ Authors: Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei
70
+
71
+ ```bibtex
72
+ @article{wang2022text,
73
+ title={Text Embeddings by Weakly-Supervised Contrastive Pre-training},
74
+ author={Wang, Liang and Yang, Nan and Huang, Xiaolong and Jiao, Binxing and Yang, Linjun and Jiang, Daxin and Majumder, Rangan and Wei, Furu},
75
+ journal={arXiv preprint arXiv:2212.03533},
76
+ year={2022}
77
+ }
78
+ ```
79
+
80
+ ## Training Data And Provenance
81
+
82
+ Base model: `intfloat/e5-small-v2`. Source repository: https://huggingface.co/intfloat/e5-small-v2. Known training data: Weakly supervised text pairs from the E5 training recipe, including CCPairs and supervised fine-tuning data described by the upstream authors. Package payload size: 133782386 bytes.
83
+
84
+ ## Evaluation And Validation
85
+
86
+ The package validation checks that the ONNX graph loads with ONNX Runtime CPU execution, runs the declared fixtures, returns finite float32 embeddings with the declared shape, and matches the artifact hash recorded in `config.yaml`.
87
+
88
+ ## Limitations And Safety
89
+
90
+ E5 embeddings can reflect the biases and language coverage of the upstream training data. The upstream recipe recommends query and passage prefixes; quality may drop if text is passed without the expected prefix style.
91
+
92
+ ## License And Attribution
93
+
94
+ This package uses license `mit`. Upstream license: MIT. Converted to ONNX for EIDORA from the upstream intfloat E5 small v2 model.
95
+
96
+ ## Version
97
+
98
+ Package version: 1.0.0. ONNX opset: 17. Exporter: eidora-onnx-exporter 0.1.0.
config.yaml ADDED
@@ -0,0 +1,150 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ id: EIDORA/E5_small
3
+ name: E5_small
4
+ version: 1.0.0
5
+ model_family: E5
6
+ backend: onnx
7
+ file_size: 134 MB
8
+ runtime:
9
+ adapter: onnx_text
10
+ execution_provider: CPUExecutionProvider
11
+ model_path: model.onnx
12
+ input_names:
13
+ - input_ids
14
+ - attention_mask
15
+ output_name: embedding
16
+ onnxruntime:
17
+ opset: 17
18
+ tested_versions: '>=1.17,<2'
19
+ artifact:
20
+ path: model.onnx
21
+ sha256: 67c0e5500336f67e22d59f942604308aca6af009ebc91ece04c649f86e1d2961
22
+ package_size_bytes: 133782386
23
+ inputs:
24
+ - id: text
25
+ modality: text
26
+ label: Text
27
+ required: true
28
+ source_kind: text_source
29
+ requirements:
30
+ max_tokens: 512
31
+ recommended_prefixes:
32
+ - 'query: '
33
+ - 'passage: '
34
+ preprocess:
35
+ text:
36
+ tokenizer:
37
+ path: tokenizer
38
+ max_length: 512
39
+ truncation: true
40
+ padding: max_length
41
+ prefix_policy:
42
+ query: 'query: '
43
+ document: 'passage: '
44
+ embedding:
45
+ dimensions: 384
46
+ feature_type: embedding
47
+ pooling: mean
48
+ normalized: true
49
+ similarity: cosine
50
+ output_name: embedding
51
+ dtype: float32
52
+ shape:
53
+ - batch
54
+ - 384
55
+ display:
56
+ summary: 'Light: compact text embeddings for fast search, grouping, and discovery
57
+ on laptops.'
58
+ compute_tier: light
59
+ modality_labels:
60
+ - text
61
+ recommended_batch_size: 16
62
+ validation:
63
+ fixtures:
64
+ - id: text_tokens_001
65
+ input_shapes:
66
+ input_ids:
67
+ - 1
68
+ - 16
69
+ attention_mask:
70
+ - 1
71
+ - 16
72
+ input_dtypes:
73
+ input_ids: int64
74
+ attention_mask: int64
75
+ expected_shape:
76
+ - 1
77
+ - 384
78
+ seed: 23
79
+ checks:
80
+ load_with: onnxruntime
81
+ execution_provider: CPUExecutionProvider
82
+ output_dtype: float32
83
+ finite: true
84
+ normalized_l2_range:
85
+ - 0.99
86
+ - 1.01
87
+ provenance:
88
+ base_model: intfloat/e5-small-v2
89
+ source_repository: https://huggingface.co/intfloat/e5-small-v2
90
+ original_model_name: E5 Small v2
91
+ original_model_url: https://github.com/microsoft/unilm/tree/master/e5
92
+ authors:
93
+ - Liang Wang
94
+ - Nan Yang
95
+ - Xiaolong Huang
96
+ - Binxing Jiao
97
+ - Linjun Yang
98
+ - Daxin Jiang
99
+ - Rangan Majumder
100
+ - Furu Wei
101
+ paper_title: Text Embeddings by Weakly-Supervised Contrastive Pre-training
102
+ paper_url: https://arxiv.org/abs/2212.03533
103
+ upstream_license: MIT
104
+ training_data: Weakly supervised text pairs from the E5 training recipe, including
105
+ CCPairs and supervised fine-tuning data described by the upstream authors.
106
+ citation: "@article{wang2022text,\n title={Text Embeddings by Weakly-Supervised\
107
+ \ Contrastive Pre-training},\n author={Wang, Liang and Yang, Nan and Huang, Xiaolong\
108
+ \ and Jiao, Binxing and Yang, Linjun and Jiang, Daxin and Majumder, Rangan and\
109
+ \ Wei, Furu},\n journal={arXiv preprint arXiv:2212.03533},\n year={2022}\n}\n"
110
+ conversion_note: EIDORA produced this ONNX conversion and is not the original model
111
+ creator.
112
+ export_date: '2026-07-14'
113
+ exporter_version: eidora-onnx-exporter 0.1.0
114
+ model_card:
115
+ best_for:
116
+ - Fast first-pass grouping of text notes, captions, and metadata.
117
+ - Semantic search over medium and large text projects on laptops.
118
+ - A compact starter model for EIDORA text embedding workflows.
119
+ not_ideal_for:
120
+ - Long-document reasoning or generation.
121
+ - Fine-grained domain retrieval where a larger text embedding model is acceptable.
122
+ - Image, video, or audio inputs.
123
+ limitations: E5 embeddings can reflect the biases and language coverage of the upstream
124
+ training data. The upstream recipe recommends query and passage prefixes; quality
125
+ may drop if text is passed without the expected prefix style.
126
+ license:
127
+ id: mit
128
+ attribution: Converted to ONNX for EIDORA from the upstream intfloat E5 small
129
+ v2 model.
130
+ huggingface:
131
+ org: eidora
132
+ repo_name: E5_SMALL_384
133
+ pipeline_tag: feature-extraction
134
+ tags:
135
+ - eidora
136
+ - eidora-model-zoo
137
+ - onnx
138
+ - onnxruntime
139
+ - embeddings
140
+ - text
141
+ - e5
142
+ - compute:light
143
+ - modality:text
144
+ datasets:
145
+ - intfloat/e5
146
+ metrics:
147
+ - cosine-similarity
148
+ tokenizer:
149
+ path: tokenizer
150
+ source: intfloat/e5-small-v2
model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:67c0e5500336f67e22d59f942604308aca6af009ebc91ece04c649f86e1d2961
3
+ size 133070104