Text Generation
PEFT
Safetensors
English
lora
grpo
dr-grpo
mathematical-reasoning
math
conversational
Instructions to use hugruby/mathstral-7b-mismatched-correct-drafts with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use hugruby/mathstral-7b-mismatched-correct-drafts with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mathstral-7B-v0.1") model = PeftModel.from_pretrained(base_model, "hugruby/mathstral-7b-mismatched-correct-drafts") - Notebooks
- Google Colab
- Kaggle
Model card: clarify length-budget notes (max-prompt-tokens for no-draft, max-seq-length wording)
Browse files
README.md
CHANGED
|
@@ -121,10 +121,10 @@ python scripts/train.py \
|
|
| 121 |
|---|---|---|---|
|
| 122 |
| mismatched-wrong | 7168 | 4096 | 3072 |
|
| 123 |
| matched-wrong | 7168 | 4096 | 3072 |
|
| 124 |
-
| no-draft | 7168 | 4096 | disabled (equivalent to 3,072, as all prompts are short) |
|
| 125 |
| **mismatched-correct** | 8192 | 4096 | disabled |
|
| 126 |
|
| 127 |
-
For a strict apple-to-apple comparison, `mismatched-correct` should have used `--max-seq-length 7168` and `--max-prompt-tokens 3072` like the other three variants; the larger 8,192 with the cap left off was an omission. The effect should be negligible though — only **6 of 8,888** prompts exceed 3,072 tokens (longest 3,317),
|
| 128 |
|
| 129 |
## Files
|
| 130 |
|
|
|
|
| 121 |
|---|---|---|---|
|
| 122 |
| mismatched-wrong | 7168 | 4096 | 3072 |
|
| 123 |
| matched-wrong | 7168 | 4096 | 3072 |
|
| 124 |
+
| no-draft | 7168 | 4096 | disabled (but it is equivalent to 3,072, as all prompts are short and no truncation) |
|
| 125 |
| **mismatched-correct** | 8192 | 4096 | disabled |
|
| 126 |
|
| 127 |
+
For a strict apple-to-apple comparison, `mismatched-correct` should have used `--max-seq-length 7168` and `--max-prompt-tokens 3072` like the other three variants; the larger 8,192 with the max-prompt-tokens cap left off was an omission. The effect should be negligible though — only **6 of 8,888** prompts exceed 3,072 tokens (longest 3,317), and for the other 8,882 the run is identical to a 7,168 / 3,072 setup. For those 6 the prompt is left untruncated, but the 4,096 max-completion length is still respected and max-seq-length runs only slightly past 7,168 (at most 3,317 + 4,096 = 7,413, well under 8,192). But to train a precise apple-to-apple version yourself, for mismatched-correct, change `--max-seq-length 8192` to `7168` and add `--max-prompt-tokens 3072`. For the no-draft variant, it is better to add `--max-prompt-tokens 3072` explicitly as well.
|
| 128 |
|
| 129 |
## Files
|
| 130 |
|