Update README.md
Browse files
README.md
CHANGED
|
@@ -139,28 +139,20 @@ We recommend using Mistral Small 4 with the [vLLM library](https://github.com/vl
|
|
| 139 |
|
| 140 |
### Installation
|
| 141 |
|
| 142 |
-
|
| 143 |
-
|
| 144 |
-
|
| 145 |
-
|
| 146 |
-
|
| 147 |
-
|
| 148 |
-
|
| 149 |
-
|
| 150 |
-
|
| 151 |
-
|
| 152 |
-
|
| 153 |
-
|
| 154 |
-
|
| 155 |
-
|
| 156 |
-
|
| 157 |
-
You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/blob/main/docker/Dockerfile) or on the [docker hub](https://hub.docker.com/layers/vllm/vllm-openai/nightly).
|
| 158 |
-
|
| 159 |
-
2. Install `transformers` from main:
|
| 160 |
-
|
| 161 |
-
```bash
|
| 162 |
-
uv pip install git+https://github.com/huggingface/transformers.git
|
| 163 |
-
```
|
| 164 |
|
| 165 |
### Serve the Model
|
| 166 |
|
|
|
|
| 139 |
|
| 140 |
### Installation
|
| 141 |
|
| 142 |
+
Install latest **vllm**:
|
| 143 |
+
|
| 144 |
+
```
|
| 145 |
+
uv pip install -U vllm
|
| 146 |
+
```
|
| 147 |
+
|
| 148 |
+
Doing so should automatically install [`mistral_common >= 1.11.0`](https://github.com/mistralai/mistral-common/releases/tag/v1.11.0).
|
| 149 |
+
|
| 150 |
+
To check:
|
| 151 |
+
```
|
| 152 |
+
python -c "import mistral_common; print(mistral_common.__version__)"
|
| 153 |
+
```
|
| 154 |
+
|
| 155 |
+
You can also make use of a ready-to-go [docker image](https://github.com/vllm-project/vllm/blob/main/docker/Dockerfile) or on the [docker hub](https://hub.docker.com/layers/vllm/vllm-openai/latest).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 156 |
|
| 157 |
### Serve the Model
|
| 158 |
|