license: mit
language:
- en
library_name: transformers
pipeline_tag: text-classification
tags:
- text-classification
- synthetic-data
- public-sector
- helpdesk
- educational
datasets:
- synthetic
model-index:
- name: synthetic-public-sector-ticket-classifier
results:
- task:
type: text-classification
name: Text Classification
dataset:
type: synthetic
name: Repository synthetic validation split
metrics:
- type: accuracy
value: 0.6111111111111112
name: Accuracy
- type: f1
value: 0.5962962962962962
name: Macro F1
Synthetic Public Sector Ticket Classifier
This is a compact Hugging Face Transformers text-classification model for synthetic public-sector helpdesk tickets. It predicts one of six labels: policy_question, login_issue, incident_report, training_request, data_privacy, or document_access.
GitHub repository: https://github.com/nprasann/synthetic-public-sector-ticket-classifier
Intended Use
- Educational demonstrations of safe text-classification workflows.
- Local experiments with synthetic helpdesk routing examples.
- Testing Hugging Face model save/load and publishing flows.
Out-of-Scope Use
Do not use this model for production routing, legal decisions, benefits decisions, HR decisions, privacy determinations, security incident response, or authoritative public-sector advice.
Dataset Description
The repository contains synthetic JSONL data only:
data/train.jsonl: 60 examples.data/validation.jsonl: 18 examples.data/test.jsonl: 18 examples.
The data is written to avoid real client data, employee data, agency case details, credentials, internal URLs, logs, IP addresses, and regulated information.
Training Procedure
The model artifacts in this repository were produced with python -m model.train --epochs 200 --batch-size 8 --learning-rate 0.001 --output-dir model.
The training script builds a small BERT-style sequence classifier from configuration and trains a word-level tokenizer from the synthetic repository data. No external pretrained checkpoint is downloaded by model.train.
Evaluation Metrics
Validation split metrics from the packaged training run:
| Metric | Value |
|---|---|
| Accuracy | 0.6111111111111112 |
| Macro F1 | 0.5962962962962962 |
These metrics are from a very small synthetic validation split and should not be interpreted as real-world performance.
Limitations and Ethical Considerations
- The dataset is small and synthetic.
- The model may be brittle on wording outside the examples.
- The model may be overconfident.
- It has not been evaluated for demographic fairness.
- Human review is required for any consequential workflow.
Example Inference
from transformers import pipeline
classifier = pipeline(
"text-classification",
model="nprasann/synthetic-public-sector-ticket-classifier",
tokenizer="nprasann/synthetic-public-sector-ticket-classifier",
)
print(classifier("I cannot access the policy document library."))