docs: model card
Browse files
README.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
library_name: ctranslate2
|
| 3 |
pipeline_tag: translation
|
| 4 |
license: apache-2.0
|
| 5 |
-
base_model: protonx-models/protonx-legal-tc
|
| 6 |
language:
|
| 7 |
- vi
|
| 8 |
tags:
|
|
@@ -12,21 +12,20 @@ tags:
|
|
| 12 |
- vietnamese
|
| 13 |
- ocr-correction
|
| 14 |
- post-ocr
|
| 15 |
-
- distillation
|
| 16 |
---
|
| 17 |
|
| 18 |
-
#
|
| 19 |
|
| 20 |
-
|
| 21 |
|
| 22 |
-
The
|
| 23 |
|
| 24 |
-
## Performance (ScanIndex internal benchmark)
|
| 25 |
|
| 26 |
-
| Variant | Time
|
| 27 |
|---|---|---|
|
| 28 |
-
| protonx-legal-tc
|
| 29 |
-
| **This distilled CT2
|
| 30 |
|
| 31 |
42% faster, 0.011 pp accuracy drop — recommended trade-off for CPU.
|
| 32 |
|
|
|
|
| 2 |
library_name: ctranslate2
|
| 3 |
pipeline_tag: translation
|
| 4 |
license: apache-2.0
|
| 5 |
+
base_model: protonx-models/distilled-protonx-legal-tc
|
| 6 |
language:
|
| 7 |
- vi
|
| 8 |
tags:
|
|
|
|
| 12 |
- vietnamese
|
| 13 |
- ocr-correction
|
| 14 |
- post-ocr
|
|
|
|
| 15 |
---
|
| 16 |
|
| 17 |
+
# distilled-protonx-legal-tc — CTranslate2 build (Vietnamese OCR text correction)
|
| 18 |
|
| 19 |
+
CTranslate2-converted version of [`protonx-models/distilled-protonx-legal-tc`](https://huggingface.co/protonx-models/distilled-protonx-legal-tc), optimised for fast CPU OCR text correction on Vietnamese administrative documents.
|
| 20 |
|
| 21 |
+
The upstream `distilled-protonx-legal-tc` is a smaller student distilled from `protonx-legal-tc`. This repo only does the CT2 conversion + INT8 quantization — no further training. Used by the [ScanIndex](https://github.com/welcomyou/scanindex) pipeline as the correction stage between OCR and PDF/DOCX export.
|
| 22 |
|
| 23 |
+
## Performance (ScanIndex internal benchmark, 13-page Vietnamese admin doc)
|
| 24 |
|
| 25 |
+
| Variant | Time | Accuracy |
|
| 26 |
|---|---|---|
|
| 27 |
+
| `protonx-legal-tc` — CT2 OPTIMIZE, beam=1 | 14.5s | 99.561% |
|
| 28 |
+
| **This repo** (`distilled-protonx-legal-tc` CT2 INT8, beam=1) | **8.3s** | **99.550%** |
|
| 29 |
|
| 30 |
42% faster, 0.011 pp accuracy drop — recommended trade-off for CPU.
|
| 31 |
|