Mukul Rayana commited on
Commit
713dff4
·
1 Parent(s): dad49b3

Day 3: correct gitignore, add data manifest

Browse files
Files changed (2) hide show
  1. .gitignore +1 -1
  2. data/MANIFEST.md +22 -0
.gitignore CHANGED
@@ -1,6 +1,7 @@
1
  venv/
2
  data/raw/
3
  data/processed/*.csv
 
4
  models/
5
  *.gguf
6
  __pycache__/
@@ -10,4 +11,3 @@ __pycache__/
10
  dist/
11
  .DS_Store
12
  .claude/
13
- claude_code_overnight_prompt.md
 
1
  venv/
2
  data/raw/
3
  data/processed/*.csv
4
+ data/indexes/
5
  models/
6
  *.gguf
7
  __pycache__/
 
11
  dist/
12
  .DS_Store
13
  .claude/
 
data/MANIFEST.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Data Manifest
2
+ Files tracked here are too large for git. Re-download using instructions below.
3
+
4
+ ## data/raw/ — source datasets (not in git)
5
+ | Dataset | Source | Size | Download command |
6
+ |---|---|---|---|
7
+ | GoEmotions | HuggingFace | ~200MB | python src/data/download_datasets.py |
8
+ | Empathetic Dialogues | HuggingFace | ~500MB | python src/data/download_datasets.py |
9
+ | Reddit Mental Health | zenodo.org/records/3941387 | 3.1GB | zenodo_get 3941387 -o data/raw/reddit_mental_health/ |
10
+ | Suicide Detection | kaggle nikhileswarkomati/suicide-watch | 60MB | kaggle datasets download -d nikhileswarkomati/suicide-watch -p data/raw/suicide_detection/ --unzip |
11
+
12
+ ## data/indexes/ — built artifacts (not in git)
13
+ | File | How to rebuild |
14
+ |---|---|
15
+ | faiss_flat.index | Run
16
+ otebooks/colab_build_faiss_index.ipynb on Colab A100 |
17
+ | metadata.db | Same as above |
18
+
19
+ ## data/processed/ — derived files (not in git)
20
+ | File | How to rebuild |
21
+ |---|---|
22
+ | nli_train/val/test.csv | python src/data/build_nli_pairs.py |