musk12 commited on
Commit
3850ac2
·
verified ·
1 Parent(s): b398e7c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -13
README.md CHANGED
@@ -1,27 +1,41 @@
1
  ---
2
- name: apple-fastvlm-vision-projector-512
3
- model_file: vision_projector_v1_standalone.onnx
4
  license: mit
5
  language:
6
  - en
7
- framework: onnx
8
  pipeline_tag: feature-extraction
9
  tags:
10
- - fastvlm 0.5B
11
- - apple's fast vlm
12
  - onnx
13
  - vision
14
  - image-encoder
15
  - multimodal
16
  - fastvlm
17
  - cpu
18
- description: >
19
- A standalone ONNX vision projector extracted from the FastVLM pipeline.
20
- Converts image features into the FastVLM multimodal embedding space and is
21
- designed for CPU-based image-to-text and vision+language inference.
22
- usage: >
23
- Use this model to convert images into embeddings for a compatible FastVLM
24
- language backbone.
25
  base_model:
26
  - apple/FastVLM-0.5B
27
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
 
2
  license: mit
3
  language:
4
  - en
 
5
  pipeline_tag: feature-extraction
6
  tags:
 
 
7
  - onnx
8
  - vision
9
  - image-encoder
10
  - multimodal
11
  - fastvlm
12
  - cpu
 
 
 
 
 
 
 
13
  base_model:
14
  - apple/FastVLM-0.5B
15
+ ---
16
+
17
+ # Apple FastVLM Vision Projector (512)
18
+
19
+ A standalone ONNX vision projector extracted from the FastVLM pipeline.
20
+ Converts image features into the FastVLM multimodal embedding space and is
21
+ designed for CPU-based image-to-text and vision+language inference.
22
+
23
+ ## Model file
24
+
25
+ - `vision_projector_v1_standalone.onnx`
26
+
27
+ ## Usage
28
+
29
+ Use this model to convert images into embeddings for a compatible FastVLM
30
+ language backbone.
31
+
32
+ ```python
33
+ import onnxruntime as ort
34
+
35
+ session = ort.InferenceSession("vision_projector_v1_standalone.onnx")
36
+ # feed in your preprocessed image tensor and run inference
37
+ ```
38
+
39
+ ## Base model
40
+
41
+ Derived from [apple/FastVLM-0.5B](https://huggingface.co/apple/FastVLM-0.5B).