Add model card with arena badges
Browse files
README.md
ADDED
|
@@ -0,0 +1,69 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- audio
|
| 5 |
+
- anti-spoofing
|
| 6 |
+
- audio-deepfake-detection
|
| 7 |
+
- speech
|
| 8 |
+
- asvspoof
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# AASIST
|
| 12 |
+
|
| 13 |
+
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=aasist)
|
| 14 |
+
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=aasist)
|
| 15 |
+
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=aasist)
|
| 16 |
+
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=aasist)
|
| 17 |
+
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=aasist)
|
| 18 |
+
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=aasist)
|
| 19 |
+
[](https://huggingface.co/spaces/SpeechAntiSpoofingBenchmarks/SpeechAntiSpoofingArena?system=aasist)
|
| 20 |
+
|
| 21 |
+
AASIST audio anti-spoofing (voice-deepfake detection) countermeasure from
|
| 22 |
+
*"AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention
|
| 23 |
+
Networks"* (Jung et al., ICASSP 2022). This is the **official `AASIST` variant**
|
| 24 |
+
(not AASIST-L), using the upstream [clovaai/aasist](https://github.com/clovaai/aasist)
|
| 25 |
+
ASVspoof2019 LA pretrained checkpoint. The model takes a raw speech waveform and
|
| 26 |
+
returns a score where **higher = more bona fide**.
|
| 27 |
+
|
| 28 |
+
- **Code:** https://github.com/clovaai/aasist
|
| 29 |
+
- **Paper:** https://arxiv.org/abs/2110.01200
|
| 30 |
+
- **Parameters:** 297,866 (0.298 M)
|
| 31 |
+
- **Checkpoint:** [`AASIST.pth`](./AASIST.pth)
|
| 32 |
+
|
| 33 |
+
This repo is self-contained for inference: the network definition is in
|
| 34 |
+
[`_net.py`](./_net.py) and the exact wrapper used to produce the Arena scores in
|
| 35 |
+
[`aasist.py`](./aasist.py).
|
| 36 |
+
|
| 37 |
+
## Architecture
|
| 38 |
+
|
| 39 |
+
AASIST operates directly on the raw waveform: a sinc-convolution front-end and a
|
| 40 |
+
RawNet2-style residual encoder produce a spectro-temporal feature map, which is
|
| 41 |
+
modelled by heterogeneous stacking graph attention layers over spectral and
|
| 42 |
+
temporal sub-graphs with a learnable max/average readout, followed by a 2-class
|
| 43 |
+
output (bona fide vs. spoof). The Arena score is the bona-fide logit.
|
| 44 |
+
|
| 45 |
+
## Reproducing the Arena scores
|
| 46 |
+
|
| 47 |
+
Inference uses a deterministic first-64600-sample window (no random crop),
|
| 48 |
+
matching the upstream `data_utils.pad()` used at eval. Audio is provided as
|
| 49 |
+
float32 mono at 16 kHz (no resampling in the wrapper).
|
| 50 |
+
|
| 51 |
+
```python
|
| 52 |
+
from aasist import AASIST
|
| 53 |
+
m = AASIST(); m.load()
|
| 54 |
+
scores = m.score_batch([wav], [16000]) # higher = more bona fide
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
| Dataset | EER % | n_trials |
|
| 58 |
+
|---------|------:|---------:|
|
| 59 |
+
| ASVspoof2019_LA (in-domain) | 0.83 | 71,237 |
|
| 60 |
+
| ASVspoof2021_LA | 12.35 | 181,566 |
|
| 61 |
+
| ASVspoof2021_DF | 17.04 | 611,829 |
|
| 62 |
+
| InTheWild | 43.01 | 31,779 |
|
| 63 |
+
| CD-ADD | 51.05 | 20,786 |
|
| 64 |
+
|
| 65 |
+
The in-domain ASVspoof2019 LA result reproduces the paper's reported EER (~0.83%).
|
| 66 |
+
|
| 67 |
+
## License
|
| 68 |
+
|
| 69 |
+
MIT (inherited from clovaai/aasist; see [`LICENSE`](./LICENSE)).
|