Instructions to use kiwiki196/PoC-SNOMEDCT-extract-gemma-4-e2b-it-medium with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use kiwiki196/PoC-SNOMEDCT-extract-gemma-4-e2b-it-medium with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-4-E2B-it") model = PeftModel.from_pretrained(base_model, "kiwiki196/PoC-SNOMEDCT-extract-gemma-4-e2b-it-medium") - Notebooks
- Google Colab
- Kaggle
PoC-SNOMEDCT-extract-gemma-4-e2b-it-medium
Proof-of-concept -- trained on synthetic data. Every run behind this repo so far fine-tunes on a synthetically generated batch, not real MIMIC-IV-Note. Treat these weights as a proof of concept, not a clinically validated model.
LoRA adapter for SNOMED-CT span extraction, fine-tuned from google/gemma-4-E2B-it.
Required system prompt
PROMPT_VARIANT = "medium". Inference
must use this exact prompt — a different one silently degrades output:
(Omitted here.)
Run config
| timestamp | 2026-08-06 05:47:12 |
| run_mode | train |
| model_id | google/gemma-4-E2B-it |
| gpu_target | L4 |
| prompt_variant | medium |
| max_length | 4096 |
| fast_iter | False |
| n_train_chunks | 144 |
| n_train_notes | 107 |
| n_val_chunks | 38 |
| n_val_notes | 27 |
| epochs | 4 |
| train_batch | 1 |
| grad_accum | 16 |
| grad_ckpt | True |
| train_seconds | 5818.1 |
Fine-tuned
Invalid output: 3/38 (7.9%)
Category + text (multiset)
| category | P | R | F1 |
|---|---|---|---|
| micro | 0.289 | 0.170 | 0.214 |
| macro | 0.240 | 0.137 | 0.163 |
| body_structure | 0.000 | 0.000 | 0.000 |
| finding | 0.118 | 0.112 | 0.115 |
| procedure | 0.395 | 0.194 | 0.260 |
Positional (char-level)
| category | P | R | F1 | IOU |
|---|---|---|---|---|
| body_structure | 0.000 | 0.000 | 0.000 | 0.000 |
| finding | 0.150 | 0.164 | 0.157 | 0.115 |
| procedure | 0.287 | 0.178 | 0.220 | 0.102 |
- Downloads last month
- 1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support