juliendenize commited on
Commit
19037a2
·
verified ·
1 Parent(s): 86caf1b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -22
README.md CHANGED
@@ -139,28 +139,20 @@ We recommend using Mistral Small 4 with the [vLLM library](https://github.com/vl
139
 
140
  ### Installation
141
 
142
- 1. Make sure to install **vllm nightly**:
143
-
144
- ```
145
- uv pip install -U vllm \
146
- --torch-backend=auto \
147
- --extra-index-url https://wheels.vllm.ai/nightly
148
- ```
149
-
150
- Doing so should automatically install [`mistral_common >= 1.11.0`](https://github.com/mistralai/mistral-common/releases/tag/v1.11.0).
151
-
152
- To check:
153
- ```
154
- python -c "import mistral_common; print(mistral_common.__version__)"
155
- ```
156
-
157
- You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/blob/main/docker/Dockerfile) or on the [docker hub](https://hub.docker.com/layers/vllm/vllm-openai/nightly).
158
-
159
- 2. Install `transformers` from main:
160
-
161
- ```bash
162
- uv pip install git+https://github.com/huggingface/transformers.git
163
- ```
164
 
165
  ### Serve the Model
166
 
 
139
 
140
  ### Installation
141
 
142
+ Install latest **vllm**:
143
+
144
+ ```
145
+ uv pip install -U vllm
146
+ ```
147
+
148
+ Doing so should automatically install [`mistral_common >= 1.11.0`](https://github.com/mistralai/mistral-common/releases/tag/v1.11.0).
149
+
150
+ To check:
151
+ ```
152
+ python -c "import mistral_common; print(mistral_common.__version__)"
153
+ ```
154
+
155
+ You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/blob/main/docker/Dockerfile) or on the [docker hub](https://hub.docker.com/layers/vllm/vllm-openai/latest).
 
 
 
 
 
 
 
 
156
 
157
  ### Serve the Model
158