# Ethics Probes: qwen-8b

This repository contains Sparse Autoencoder (SAE) + Probe models trained on various ethics datasets.

## Model
- **Base Model**: Qwen/Qwen3-8B
- **Short Name**: qwen-8b

## Datasets

The following datasets have been processed:

- **[commonsense](./commonsense/)**: Best Layer: 21, Val Acc: 0.7777, Test Acc: 0.7748

## Repository Structure

```
.
├── commonsense/
│   ├── layer_0/
│   │   ├── sae.pt
│   │   ├── probe.pt
│   │   ├── config.json
│   │   └── metrics.json
│   ├── layer_1/
│   ├── ...
│   ├── best/          # Best performing layer
│   └── README.md      # Dataset-specific details
└── README.md          # This file
```

## Usage

Each dataset folder contains:
- `layer_N/`: Models for each layer
- `best/`: Copy of the best performing layer's models
- `sae.pt`: Sparse Autoencoder state dict
- `probe.pt`: Probe state dict
- `config.json`: Configuration used for training
- `metrics.json`: Performance metrics
- `README.md`: Detailed results for the dataset