founder-distilbert-imdb-v12
Fine-tuned by The Founder — an autonomous ML orchestration superagent.
Model Description
This is a fine-tuned version of distilbert-base-uncased on the stanfordnlp/imdb dataset for Text Classification.
Training was orchestrated end-to-end by The Founder — a personal ML agent that handles research, compute scheduling, experiment tracking, and artifact management autonomously using Modal (NVIDIA T4), Weights & Biases, and HuggingFace Hub.
Model Details
| Property | Value |
|---|---|
| Base model | distilbert-base-uncased |
| Fine-tuned on | stanfordnlp/imdb |
| Task | Text Classification |
| Epochs | 2 |
| Batch size | 16 |
| Learning rate | 2e-05 |
| GPU | NVIDIA T4 (Modal) |
| Train loss | 0.2390 |
| Eval loss | 0.3153 |
| Eval accuracy | 0.8671 |
| Duration | 19.7 min |
How to Get Started
from transformers import pipeline
clf = pipeline("text-classification", model="zanesmit29/founder-distilbert-imdb-v12")
clf("Your input text here")
Uses
Direct Use
This model is suitable for Text Classification tasks in English. It can be used out-of-the-box with the Transformers pipeline API.
Out-of-Scope Use
This model was trained on a specific dataset and may not generalise to all domains or languages. It should not be used to make high-stakes automated decisions without human review. Performance on out-of-distribution data (e.g. non-English text, domain-specific jargon) is not guaranteed.
Training Details
Data
Trained on stanfordnlp/imdb — 2 epochs, no additional preprocessing beyond standard tokenization.
Hyperparameters
| Hyperparameter | Value |
|---|---|
| Learning rate | 2e-05 |
| Batch size | 16 |
| Epochs | 2 |
| Optimizer | AdamW |
| LR scheduler | Linear with warmup |
| Max sequence length | 512 |
| fp16 | true |
Results
| Metric | Value |
|---|---|
| Train loss | 0.2390 |
| Eval loss | 0.3153 |
| Eval accuracy | 0.8671 |
| Duration | 19.7 min |
Experiment Tracking
Infrastructure
| Component | Tool |
|---|---|
| Compute | Modal (NVIDIA T4) |
| Experiment tracking | Weights & Biases |
| Artifact storage | HuggingFace Hub |
| Orchestration | The Founder |
- Downloads last month
- 39
Model tree for zanesmit29/founder-distilbert-imdb-v12
Base model
distilbert/distilbert-base-uncasedDataset used to train zanesmit29/founder-distilbert-imdb-v12
Evaluation results
- Accuracy on IMDBvalidation set self-reported0.867
- Eval Loss on IMDBvalidation set self-reported0.315