MAGAer13
/

mplug-owl-llama-7b-pt

Model card Files Files and versions

MAGAer13 commited on May 20, 2023

Commit

ef48c47

·

1 Parent(s): a4412c1

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -205,7 +205,7 @@
         "num_hidden_layers": 6,
         "num_attention_heads": 16,
         "hidden_act": "gelu",
-        "intermediate_size": 4096,
         "hidden_dropout_prob": 0.1,
         "attention_probs_dropout_prob": 0.1,
         "max_position_embeddings": 512,

         "num_hidden_layers": 6,
         "num_attention_heads": 16,
         "hidden_act": "gelu",
+        "intermediate_size": 2816,
         "hidden_dropout_prob": 0.1,
         "attention_probs_dropout_prob": 0.1,
         "max_position_embeddings": 512,