Mukul Rayana commited on
Commit ·
713dff4
1
Parent(s): dad49b3
Day 3: correct gitignore, add data manifest
Browse files- .gitignore +1 -1
- data/MANIFEST.md +22 -0
.gitignore
CHANGED
|
@@ -1,6 +1,7 @@
|
|
| 1 |
venv/
|
| 2 |
data/raw/
|
| 3 |
data/processed/*.csv
|
|
|
|
| 4 |
models/
|
| 5 |
*.gguf
|
| 6 |
__pycache__/
|
|
@@ -10,4 +11,3 @@ __pycache__/
|
|
| 10 |
dist/
|
| 11 |
.DS_Store
|
| 12 |
.claude/
|
| 13 |
-
claude_code_overnight_prompt.md
|
|
|
|
| 1 |
venv/
|
| 2 |
data/raw/
|
| 3 |
data/processed/*.csv
|
| 4 |
+
data/indexes/
|
| 5 |
models/
|
| 6 |
*.gguf
|
| 7 |
__pycache__/
|
|
|
|
| 11 |
dist/
|
| 12 |
.DS_Store
|
| 13 |
.claude/
|
|
|
data/MANIFEST.md
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Data Manifest
|
| 2 |
+
Files tracked here are too large for git. Re-download using instructions below.
|
| 3 |
+
|
| 4 |
+
## data/raw/ — source datasets (not in git)
|
| 5 |
+
| Dataset | Source | Size | Download command |
|
| 6 |
+
|---|---|---|---|
|
| 7 |
+
| GoEmotions | HuggingFace | ~200MB | python src/data/download_datasets.py |
|
| 8 |
+
| Empathetic Dialogues | HuggingFace | ~500MB | python src/data/download_datasets.py |
|
| 9 |
+
| Reddit Mental Health | zenodo.org/records/3941387 | 3.1GB | zenodo_get 3941387 -o data/raw/reddit_mental_health/ |
|
| 10 |
+
| Suicide Detection | kaggle nikhileswarkomati/suicide-watch | 60MB | kaggle datasets download -d nikhileswarkomati/suicide-watch -p data/raw/suicide_detection/ --unzip |
|
| 11 |
+
|
| 12 |
+
## data/indexes/ — built artifacts (not in git)
|
| 13 |
+
| File | How to rebuild |
|
| 14 |
+
|---|---|
|
| 15 |
+
| faiss_flat.index | Run
|
| 16 |
+
otebooks/colab_build_faiss_index.ipynb on Colab A100 |
|
| 17 |
+
| metadata.db | Same as above |
|
| 18 |
+
|
| 19 |
+
## data/processed/ — derived files (not in git)
|
| 20 |
+
| File | How to rebuild |
|
| 21 |
+
|---|---|
|
| 22 |
+
| nli_train/val/test.csv | python src/data/build_nli_pairs.py |
|