Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,18 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+fold_0/model.bias_scaled.fold_0.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_0/model.chrombpnet.fold_0.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_0/model.chrombpnet_nobias.fold_0.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.bias_scaled.fold_1.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.chrombpnet.fold_1.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_1/model.chrombpnet_nobias.fold_1.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.bias_scaled.fold_2.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.chrombpnet.fold_2.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_2/model.chrombpnet_nobias.fold_2.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.bias_scaled.fold_3.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.chrombpnet.fold_3.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_3/model.chrombpnet_nobias.fold_3.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.bias_scaled.fold_4.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.chrombpnet.fold_4.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text
+fold_4/model.chrombpnet_nobias.fold_4.ENCSR970UNF.tar/variables/variables.data-00000-of-00001 filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,120 @@
+---
+license: mit
+library_name: chrombpnet
+tags:
+  - encode
+  - chrombpnet
+  - chromatin-accessibility
+  - ATAC
+  - colon
+  - hg38
+---
+# ENCODE ChromBPNet Atlas
+As part of the ENCODE 4 Project, we trained ChromBPNet models on 1,512 ENCODE DNAse-seq and ATAC-seq across 408 biosamples. Here, we provide all models for open-source use.
+
+For more information about the models, see:
+- Main ENCODE 4 Paper
+- [A unified lexicon of predictive DNA sequence motifs from ENCODE transcription factor binding and chromatin accessibility assays](https://doi.org/10.5281/zenodo.17123347) (Deshpande et al., Zenodo 2025)
+- [ChromBPNet: bias factorized, base-resolution deep learning models of chromatin accessibility reveal cis-regulatory sequence syntax, transcription factor footprints and regulatory variants](https://doi.org/10.1101/2024.12.25.630221) (Pampari et al., bioRxiv 2024)
+
+## ChromBPNet model: ATAC in colonic mucosa (ENCSR970UNF)
+- Model: ChromBPNet
+- Assay: ATAC-seq
+- Experiment: [ENCSR970UNF](https://www.encodeproject.org/experiments/ENCSR970UNF/)
+- Model annotation: [ENCSR425JQH](https://www.encodeproject.org/annotations/ENCSR425JQH/)
+- Biosample: colonic mucosa (Full name: Homo sapiens colonic mucosa tissue female adult (41 years))
+- Cell slim(s): None
+- Organ slim(s): colon,intestine,large-intestine
+- Developmental slim(s): endoderm
+- System slim(s): digestive-system
+- Assembly: hg38
+
+## Directory structure
+- `fold_0`: Model of 5-fold cross-validation: Fold 0
+    - `model.chrombpnet.fold_0.encid.h5`: full chrombpnet model that combines both bias and corrected model in .h5 format
+    - `model.chrombpnet_nobias.fold_0.encid.h5`: bias-corrected accessibility model in .h5 format (Use for all biological discovery)
+    - `model.bias_scaled.fold_0.encid.h5`: bias model in .h5 format
+    - `model.chrombpnet.fold_0.encid.tar`: full chrombpnet model that combines both bias and  corrected model in SavedModel format. After being untarred, it results in a directory named "chrombpnet".
+    - `model.chrombpnet_nobias.fold_0.encid.tar`: bias-corrected accessibility model in SavedModel format (Use for all biological discovery). After being untarred, it results in a directory named "chrombpnet_wo_bias".
+    - `model.bias_scaled.fold_0.encid.tar`: bias model in SavedModel format. After being untarred, it results in a directory named "bias_model_scaled".
+    - `logs.models.fold_0.encid`: folder containing log files for training models
+- `fold_1`: Model of 5-fold coss-validation: Fold 1
+- `fold_2`: Model of 5-fold cross-validation: Fold 2
+- `fold_3`: Model of 5-fold cross-validation: Fold 3
+- `fold_4`: Model of 5-fold cross-validation: Fold 4
+
+# Instructions
+## 1. Pseudocode for loading models in .h5 format 
+
+(1) Use the code in python after appropriately defining `model_in_h5_format` and `inputs`. \
+(2) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the 
+number of tested sequences, 2114 is the input sequence length and 4 corresponds to [A,C,G,T].
+
+```python
+import tensorflow as tf
+from tensorflow.keras.utils import get_custom_objects
+from tensorflow.keras.models import load_model
+
+custom_objects={"tf": tf}
+get_custom_objects().update(custom_objects)
+
+model=load_model(model_in_h5_format,compile=False)
+outputs = model(inputs)
+```
+
+The list `outputs` consists of two elements. The first element has a shape of (N, 1000) and
+contains logit predictions for a 1000-base-pair output. The second element, with a shape of
+(N, 1), contains logcount predictions. To transform these predictions into per-base signals, 
+follow the provided pseudo code lines below.
+
+```python
+import numpy as np
+
+def softmax(x, temp=1):
+    norm_x = x - np.mean(x,axis=1, keepdims=True)
+    return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
+    
+predictions = softmax(outputs[0]) * (np.exp(outputs[1])-1)
+```
+
+## 2. Pseudocode for loading models in .tar format
+
+(1) First untar the directory as follows `tar -xvf model.tar`. \
+(2) Use the code below in python after appropriately defining `model_dir_untared` and `inputs`. \
+(3) `inputs` is a one hot encoded sequence of shape (N,2114,4). Here N corresponds to the number
+of tested sequences, 2114 is the input sequence length and 4 corresponds to ACGT.
+
+Reference: https://www.tensorflow.org/api_docs/python/tf/saved_model/load
+
+```python
+import tensorflow as tf
+
+model = tf.saved_model.load('model_dir_untared')
+outputs = model.signatures['serving_default'](**{'sequence':inputs.astype('float32')})
+```
+
+The variable `outputs` represents a dictionary containing two key-value pairs. The first key
+is `logits_profile_predictions`, holding a value with a shape of (N, 1000). This value corresponds
+to logit predictions for a 1000-base-pair output. The second key, named `logcount_predictions``, 
+is associated with a value of shape (N, 1), representing logcount predictions. To transform these
+predictions into per-base signals, utilize the provided pseudo code lines mentioned below.
+
+```python
+import numpy as np
+def softmax(x, temp=1):
+    norm_x = x - np.mean(x,axis=1, keepdims=True)
+    return np.exp(temp*norm_x)/np.sum(np.exp(temp*norm_x), axis=1, keepdims=True)
+    
+predictions = softmax(outputs["logits_profile_predictions"]) * (np.exp(outputs["logcount_predictions"])-1)
+```
+
+## Docker image to load and use the models
+- https://hub.docker.com/r/kundajelab/chrombpnet-atlas/ (tag:v1)
+
+## Code for ChromBPNet
+- https://github.com/kundajelab/chrombpnet/
+
+# License & citation
+External data users may freely download, analyze and publish results based on any ENCODE data without restrictions.
+
+Released under the [ENCODE data-use policy](https://www.encodeproject.org/about/data-use-policy/). Please cite the ENCODE Project Consortium and the model software: [ChromBPNet](https://github.com/kundajelab/chrombpnet) (Pampari et al., bioRxiv 2024).

fold_0/logs.models.fold_0.ENCSR970UNF/logfile.modelling.fold_0.ENCSR970UNF.args.json

@@ -0,0 +1,50 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "input_bam_file": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/preprocessing/bigWigs/ENCSR970UNF.bigWig",
+    "input_fragment_file": null,
+    "input_tagalign_file": null,
+    "output_dir": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs",
+    "data_type": "ATAC",
+    "peaks": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_0.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bsort": false,
+    "tmpdir": null,
+    "no_st": false,
+    "bias_model_path": "/scratch/users/vhecht/chromatin-atlas-2022/reference/ATAC/fold_0/model.bias.fold_0.ENCSR868FGK.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/models/chrombpnet",
+    "bigwig": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/auxiliary/data_unstranded.bw",
+    "plus_shift": null,
+    "minus_shift": null,
+    "chr": "chr8",
+    "pwm_width": 24,
+    "params": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/logs/chrombpnet_model_params.tsv"
+}

fold_0/logs.models.fold_0.ENCSR970UNF/logfile.modelling.fold_0.ENCSR970UNF.bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR970UNF/logfile.modelling.fold_0.ENCSR970UNF.chrombpnet_data_params.tsv

@@ -0,0 +1,3 @@
+counts_sum_min_thresh	0.0
+counts_sum_max_thresh	20781.7
+trainings_pts_post_thresh	236974

fold_0/logs.models.fold_0.ENCSR970UNF/logfile.modelling.fold_0.ENCSR970UNF.chrombpnet_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/new_model_format/chrombpnet.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR970UNF/logfile.modelling.fold_0.ENCSR970UNF.chrombpnet_model_params.tsv

@@ -0,0 +1,9 @@
+counts_loss_weight	103.5
+filters	512
+n_dil_layers	8
+bias_model_path	/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/models/bias_model_scaled.h5
+inputlen	2114
+outputlen	1000
+max_jitter	500
+chr_fold_path	/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_0.json
+negative_sampling_ratio	0.1

fold_0/logs.models.fold_0.ENCSR970UNF/logfile.modelling.fold_0.ENCSR970UNF.chrombpnet_no_bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/model_outputs/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_0/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py

fold_0/logs.models.fold_0.ENCSR970UNF/logfile.modelling.fold_0.ENCSR970UNF.epoch_loss.csv

@@ -0,0 +1,15 @@
+epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
+0,2.3313252925872803,1240.304931640625,1481.5970458984375,0.8527184724807739,1134.6134033203125,1222.8702392578125
+1,0.8587007522583008,1104.6134033203125,1193.48974609375,0.8110675811767578,1081.4276123046875,1165.3731689453125
+2,0.786515474319458,1060.9114990234375,1142.3172607421875,0.742167055606842,1070.0184326171875,1146.831787109375
+3,0.7288759350776672,1032.798828125,1108.23681640625,0.6810799241065979,1039.6651611328125,1110.1575927734375
+4,0.6771937012672424,1011.8444213867188,1081.9354248046875,0.8097579479217529,1034.6036376953125,1118.4134521484375
+5,0.6425686478614807,994.098876953125,1060.6044921875,0.7797794342041016,1033.93994140625,1114.646728515625
+6,0.6135047078132629,981.076416015625,1044.57421875,0.693716824054718,1032.35205078125,1104.1529541015625
+7,0.5802947282791138,970.5447998046875,1030.6038818359375,0.662339985370636,1033.5584716796875,1102.1112060546875
+8,0.5529722571372986,962.0862426757812,1019.3169555664062,0.6387882232666016,1030.5615234375,1096.67626953125
+9,0.5278037786483765,956.6690673828125,1011.2977294921875,0.6333808302879333,1033.265625,1098.8201904296875
+10,0.5039258599281311,952.4902954101562,1004.6449584960938,0.6469613909721375,1036.737548828125,1103.697998046875
+11,0.4865837097167969,948.07568359375,998.4375610351562,0.6827487349510193,1037.5010986328125,1108.1656494140625
+12,0.46465787291526794,943.619873046875,991.711181640625,0.6484317183494568,1036.1043701171875,1103.217041015625
+13,0.4442336857318878,941.2442626953125,987.224365234375,0.6416950225830078,1039.997802734375,1106.4129638671875

fold_0/model.bias_scaled.fold_0.ENCSR970UNF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f473f3f2a0151a63a172cca0741a40e93e52cd3e6a510667687c5f8a79febe1d
+size 2691928

fold_0/model.bias_scaled.fold_0.ENCSR970UNF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:63117a2eb534ffbbab49a8851db5a3a389848ec95e238cdeb7703f716320b0e2
+size 32967

fold_0/model.bias_scaled.fold_0.ENCSR970UNF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b609c6240b6cac9cb3c4fcd8327e7e02089b8294af626a08962d6180f9f1d363
+size 269887

fold_0/model.bias_scaled.fold_0.ENCSR970UNF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e8aaccf8b2dcb929552942407477ccc6239ddb800c0f5521fd2bd83a9a490ed7
+size 882550

fold_0/model.chrombpnet.fold_0.ENCSR970UNF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ad5cebf4b908f9632e1ee08c0d2fc548025ea026de1157b65fda7a8e6e4bfba
+size 77538896

fold_0/model.chrombpnet.fold_0.ENCSR970UNF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:acf3863f686789c3a7ab7e82f43ff3a62f3bb2cbca7c7edc474c5c0c71b48787
+size 136816

fold_0/model.chrombpnet.fold_0.ENCSR970UNF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f7667f7da7fa82e2453e3945a25b18afdfe3be11f8374c22791443d7b38a7b5
+size 967124

fold_0/model.chrombpnet.fold_0.ENCSR970UNF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:67185e5d60d54cd2ff281f2c0dc689f5115c8263f14592ddd838c6072d8a74d6
+size 26415899

fold_0/model.chrombpnet_nobias.fold_0.ENCSR970UNF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8984ca4843ea2d48c162974ddcfc11df9cbd3fe022bbd704d4f91c5d4032861e
+size 25582648

fold_0/model.chrombpnet_nobias.fold_0.ENCSR970UNF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3414d53705260cdd80f7a6c30a5457b7ed495394a3f243abf90239d125be736
+size 53915

fold_0/model.chrombpnet_nobias.fold_0.ENCSR970UNF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3cf82e94c50badd69ec5aff3655d797f290d17f4848d905447395cf70d4c65d5
+size 460921

fold_0/model.chrombpnet_nobias.fold_0.ENCSR970UNF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:08e1f602e81de4ba8576ee597751d85b35eeab56c184b7a8fab0af82cb6cc1db
+size 25531097

fold_1/logs.models.fold_1.ENCSR970UNF/logfile.modelling.fold_1.ENCSR970UNF.args.json

@@ -0,0 +1,50 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "input_bam_file": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/preprocessing/bigWigs/ENCSR970UNF.bigWig",
+    "input_fragment_file": null,
+    "input_tagalign_file": null,
+    "output_dir": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs",
+    "data_type": "ATAC",
+    "peaks": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_1.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bsort": false,
+    "tmpdir": null,
+    "no_st": false,
+    "bias_model_path": "/scratch/users/vhecht/chromatin-atlas-2022/reference/ATAC/fold_0/model.bias.fold_0.ENCSR868FGK.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/models/chrombpnet",
+    "bigwig": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/auxiliary/data_unstranded.bw",
+    "plus_shift": null,
+    "minus_shift": null,
+    "chr": "chr12",
+    "pwm_width": 24,
+    "params": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/logs/chrombpnet_model_params.tsv"
+}

fold_1/logs.models.fold_1.ENCSR970UNF/logfile.modelling.fold_1.ENCSR970UNF.bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/models/bias_model_scaled.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/new_model_format/bias_model_scaled.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR970UNF/logfile.modelling.fold_1.ENCSR970UNF.chrombpnet_data_params.tsv

@@ -0,0 +1,3 @@
+counts_sum_min_thresh	0.0
+counts_sum_max_thresh	19795.87
+trainings_pts_post_thresh	241853

fold_1/logs.models.fold_1.ENCSR970UNF/logfile.modelling.fold_1.ENCSR970UNF.chrombpnet_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/models/chrombpnet.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/new_model_format/chrombpnet.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR970UNF/logfile.modelling.fold_1.ENCSR970UNF.chrombpnet_model_params.tsv

@@ -0,0 +1,9 @@
+counts_loss_weight	104.3
+filters	512
+n_dil_layers	8
+bias_model_path	/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/models/bias_model_scaled.h5
+inputlen	2114
+outputlen	1000
+max_jitter	500
+chr_fold_path	/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_1.json
+negative_sampling_ratio	0.1

fold_1/logs.models.fold_1.ENCSR970UNF/logfile.modelling.fold_1.ENCSR970UNF.chrombpnet_no_bias_formatting.stdout.txt

@@ -0,0 +1 @@
+Converting /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/model_outputs/models/chrombpnet_nobias.h5 to /oak/stanford/groups/akundaje/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_1/new_model_format/chrombpnet_nobias.tar with get_new_tf_model_format.py

fold_1/logs.models.fold_1.ENCSR970UNF/logfile.modelling.fold_1.ENCSR970UNF.epoch_loss.csv

@@ -0,0 +1,10 @@
+epoch,logcount_predictions_loss,logits_profile_predictions_loss,loss,val_logcount_predictions_loss,val_logits_profile_predictions_loss,val_loss
+0,1.7787070274353027,1184.6751708984375,1370.192626953125,0.8641586899757385,1227.0885009765625,1317.2200927734375
+1,0.7888829112052917,1057.3712158203125,1139.652099609375,0.9624937772750854,1184.8214111328125,1285.2088623046875
+2,0.7262194156646729,1021.5388793945312,1097.2823486328125,0.7761104702949524,1160.4454345703125,1241.3939208984375
+3,0.6737771034240723,998.3246459960938,1068.598388671875,0.6691036820411682,1157.9395751953125,1227.7265625
+4,0.6387962102890015,980.1671752929688,1046.792236328125,0.7874271273612976,1159.154052734375,1241.2821044921875
+5,0.6018968224525452,967.218505859375,1029.9971923828125,0.8213894963264465,1160.0723876953125,1245.74365234375
+6,0.5697330236434937,957.2275390625,1016.6513061523438,0.7030179500579834,1159.1142578125,1232.43896484375
+7,0.5418502688407898,950.75390625,1007.2678833007812,0.6811396479606628,1161.317626953125,1232.359130859375
+8,0.5162275433540344,945.268310546875,999.1107788085938,0.6652536988258362,1161.4642333984375,1230.849853515625

fold_1/model.bias_scaled.fold_1.ENCSR970UNF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b149adc0014099a37cf514da3e49bc1ea973b4cb7d0cc605fe2fc81fca40347
+size 2691928

fold_1/model.bias_scaled.fold_1.ENCSR970UNF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:63117a2eb534ffbbab49a8851db5a3a389848ec95e238cdeb7703f716320b0e2
+size 32967

fold_1/model.bias_scaled.fold_1.ENCSR970UNF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b609c6240b6cac9cb3c4fcd8327e7e02089b8294af626a08962d6180f9f1d363
+size 269887

fold_1/model.bias_scaled.fold_1.ENCSR970UNF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e86a1f58daeb09099e935b1f0a0ad0e5dca75109f1926d45c3f0e355f6200195
+size 882550

fold_1/model.chrombpnet.fold_1.ENCSR970UNF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3d78df65bb4f180907582d9b91852f096b60c9cfa88e6b95615543bea9ecbd89
+size 77538896

fold_1/model.chrombpnet.fold_1.ENCSR970UNF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:acf3863f686789c3a7ab7e82f43ff3a62f3bb2cbca7c7edc474c5c0c71b48787
+size 136816

fold_1/model.chrombpnet.fold_1.ENCSR970UNF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f7667f7da7fa82e2453e3945a25b18afdfe3be11f8374c22791443d7b38a7b5
+size 967124

fold_1/model.chrombpnet.fold_1.ENCSR970UNF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1ff7f8dab9bbb41035804dde21df6ed6d249a39d243c6ec1ebe0d7fc46005b02
+size 26415899

fold_1/model.chrombpnet_nobias.fold_1.ENCSR970UNF.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0759469e9c41238d9bb773c88d962d067afbac7366a0715fc08a3b613613ebc6
+size 25582648

fold_1/model.chrombpnet_nobias.fold_1.ENCSR970UNF.tar/keras_metadata.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3414d53705260cdd80f7a6c30a5457b7ed495394a3f243abf90239d125be736
+size 53915

fold_1/model.chrombpnet_nobias.fold_1.ENCSR970UNF.tar/saved_model.pb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3cf82e94c50badd69ec5aff3655d797f290d17f4848d905447395cf70d4c65d5
+size 460921

fold_1/model.chrombpnet_nobias.fold_1.ENCSR970UNF.tar/variables/variables.data-00000-of-00001

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1c9c04f0b69381c16991c76cacb4ee14563df820a5fa7b500992d691b17b1671
+size 25531097

fold_2/logs.models.fold_2.ENCSR970UNF/logfile.modelling.fold_2.ENCSR970UNF.args.json

@@ -0,0 +1,50 @@
+{
+    "cmd": "pipeline",
+    "genome": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_no_alt_analysis_set_GCA_000001405.15.fasta",
+    "chrom_sizes": "/oak/stanford/groups/akundaje/ziwei75/atac_seq_pipeline/hg38/GRCh38_EBV.chrom.sizes.tsv",
+    "input_bam_file": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/preprocessing/bigWigs/ENCSR970UNF.bigWig",
+    "input_fragment_file": null,
+    "input_tagalign_file": null,
+    "output_dir": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_2/model_outputs",
+    "data_type": "ATAC",
+    "peaks": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_2/model_outputs/auxiliary/filtered.peaks.bed",
+    "nonpeaks": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_2/model_outputs/auxiliary/filtered.nonpeaks.bed",
+    "chr_fold_path": "/oak/stanford/groups/akundaje/projects/chromatin-atlas-2022/splits/fold_2.json",
+    "outlier_threshold": 0.9999,
+    "ATAC_ref_path": null,
+    "DNASE_ref_path": null,
+    "num_samples": 10000,
+    "inputlen": 2114,
+    "outputlen": 1000,
+    "seed": 1234,
+    "epochs": 50,
+    "early_stop": 5,
+    "learning_rate": 0.001,
+    "trackables": [
+        "logcount_predictions_loss",
+        "loss",
+        "logits_profile_predictions_loss",
+        "val_logcount_predictions_loss",
+        "val_loss",
+        "val_logits_profile_predictions_loss"
+    ],
+    "architecture_from_file": "/home/users/vhecht/chrombpnet/chrombpnet/chrombpnet/training/models/chrombpnet_with_bias_model.py",
+    "file_prefix": null,
+    "html_prefix": "./",
+    "bsort": false,
+    "tmpdir": null,
+    "no_st": false,
+    "bias_model_path": "/scratch/users/vhecht/chromatin-atlas-2022/reference/ATAC/fold_0/model.bias.fold_0.ENCSR868FGK.h5",
+    "negative_sampling_ratio": 0.1,
+    "filters": 512,
+    "n_dilation_layers": 8,
+    "max_jitter": 500,
+    "batch_size": 64,
+    "output_prefix": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_2/model_outputs/models/chrombpnet",
+    "bigwig": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_2/model_outputs/auxiliary/data_unstranded.bw",
+    "plus_shift": null,
+    "minus_shift": null,
+    "chr": "chr22",
+    "pwm_width": 24,
+    "params": "/scratch/users/vhecht/chromatin-atlas-2022/ATAC/ENCSR970UNF/fold_2/model_outputs/logs/chrombpnet_model_params.tsv"
+}