Update README.md
Browse files
README.md
CHANGED
|
@@ -197,7 +197,7 @@ Results shown below can be reproduced using scripts provided in our [GitHub repo
|
|
| 197 |
| FakeOrReal | 1.000 | 0.992 | 0.994 | 0.989 | 0.991 | 0.005 | 0.011 | 0.63 @ 0.3727 |
|
| 198 |
| FakeOrReal-norm | 0.999 | 0.986 | 0.975 | 0.997 | 0.986 | 0.025 | 0.003 | 0.97 @ 0.7975 |
|
| 199 |
| In-the-Wild | 0.997 | 0.976 | 0.991 | 0.970 | 0.980 | 0.015 | 0.030 | 1.91 @ 0.3240 |
|
| 200 |
-
| Deepfake-Eval-2024
|
| 201 |
|
| 202 |
You can also fine-tune this model on a specific database, the corresponding code is provided in our [GitHub repository](https://github.com/nii-yamagishilab/AntiDeepfake). Fine-tuning will follow a similar process to training a new model, except that model weights will be initialized as AntiDeepfake checkpoints.
|
| 203 |
|
|
@@ -205,11 +205,11 @@ Below are the evaluation results of this model fine-tuned on the Deepfake-Eval-2
|
|
| 205 |
|
| 206 |
| Test Input Length | ROC AUC | Accuracy | Precision | Recall | F1-score | FPR | FNR | EER (%) @ Threshold |
|
| 207 |
|-------------------|---------|----------|-----------|--------|----------|--------|--------|----------------------|
|
| 208 |
-
| 4s | 0.8776 | 0.8147 | 0.8126 | 0.9315 | 0.8680 | 0.4060 | 0.0685 | 19.56 @ 0.
|
| 209 |
-
| 10s | 0.9362 | 0.8831 | 0.8914 | 0.9346 | 0.9125 | 0.2135 | 0.0654 | 12.
|
| 210 |
-
| 13s | 0.9440 | 0.8977 | 0.9114 | 0.9337 | 0.9224 | 0.1697 | 0.0663 | 10.
|
| 211 |
-
| 30s | 0.9495 | 0.8975 | 0.9310 | 0.9088 | 0.9198 | 0.1233 | 0.0912 | 10.52 @ 0.
|
| 212 |
-
| 50s | 0.9414 | 0.8792 | 0.9348 | 0.8707 | 0.9016 | 0.1060 | 0.1293 | 11.
|
| 213 |
|
| 214 |
|
| 215 |
|
|
@@ -240,7 +240,7 @@ Below is a breakdown of the training set used for post-training of speech SSL mo
|
|
| 240 |
| LibriTTS-R | en | 0 | 583.15 |
|
| 241 |
| LibriTTS-Vocoded | en | 0 | 2345.14 |
|
| 242 |
| LJSpeech | en | 23.92 | 0 |
|
| 243 |
-
|
|
| 244 |
| MLS | 8 languages | 50558.11 | 0 |
|
| 245 |
| SpoofCeleb | Multilingual | 173.00 | 1916.20 |
|
| 246 |
| VoiceMOS | en | 0 | 448.44 |
|
|
|
|
| 197 |
| FakeOrReal | 1.000 | 0.992 | 0.994 | 0.989 | 0.991 | 0.005 | 0.011 | 0.63 @ 0.3727 |
|
| 198 |
| FakeOrReal-norm | 0.999 | 0.986 | 0.975 | 0.997 | 0.986 | 0.025 | 0.003 | 0.97 @ 0.7975 |
|
| 199 |
| In-the-Wild | 0.997 | 0.976 | 0.991 | 0.970 | 0.980 | 0.015 | 0.030 | 1.91 @ 0.3240 |
|
| 200 |
+
| Deepfake-Eval-2024 | 0.797 | 0.743 | 0.734 | 0.920 | 0.816 | 0.545 | 0.083 | 28.73 @ 0.9972 |
|
| 201 |
|
| 202 |
You can also fine-tune this model on a specific database, the corresponding code is provided in our [GitHub repository](https://github.com/nii-yamagishilab/AntiDeepfake). Fine-tuning will follow a similar process to training a new model, except that model weights will be initialized as AntiDeepfake checkpoints.
|
| 203 |
|
|
|
|
| 205 |
|
| 206 |
| Test Input Length | ROC AUC | Accuracy | Precision | Recall | F1-score | FPR | FNR | EER (%) @ Threshold |
|
| 207 |
|-------------------|---------|----------|-----------|--------|----------|--------|--------|----------------------|
|
| 208 |
+
| 4s | 0.8776 | 0.8147 | 0.8126 | 0.9315 | 0.8680 | 0.4060 | 0.0685 | 19.56 @ 0.9237 |
|
| 209 |
+
| 10s | 0.9362 | 0.8831 | 0.8914 | 0.9346 | 0.9125 | 0.2135 | 0.0654 | 12.11 @ 0.8521 |
|
| 210 |
+
| 13s | 0.9440 | 0.8977 | 0.9114 | 0.9337 | 0.9224 | 0.1697 | 0.0663 | 10.95 @ 0.8126 |
|
| 211 |
+
| 30s | 0.9495 | 0.8975 | 0.9310 | 0.9088 | 0.9198 | 0.1233 | 0.0912 | 10.52 @ 0.6023 |
|
| 212 |
+
| 50s | 0.9414 | 0.8792 | 0.9348 | 0.8707 | 0.9016 | 0.1060 | 0.1293 | 11.36 @ 0.4097 |
|
| 213 |
|
| 214 |
|
| 215 |
|
|
|
|
| 240 |
| LibriTTS-R | en | 0 | 583.15 |
|
| 241 |
| LibriTTS-Vocoded | en | 0 | 2345.14 |
|
| 242 |
| LJSpeech | en | 23.92 | 0 |
|
| 243 |
+
| MLAAD | 38 languages | 0 | 377.96 |
|
| 244 |
| MLS | 8 languages | 50558.11 | 0 |
|
| 245 |
| SpoofCeleb | Multilingual | 173.00 | 1916.20 |
|
| 246 |
| VoiceMOS | en | 0 | 448.44 |
|