Guy DuGan II commited on
Commit
ec24ea7
·
verified ·
1 Parent(s): 7610098

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -51
README.md CHANGED
@@ -1,60 +1,17 @@
1
  ---
2
  library_name: transformers
3
- base_model: gss1147/GPT2.5.2-high-reasoning-codex-0.4B
 
 
4
  tags:
5
  - generated_from_trainer
6
  model-index:
7
  - name: gpt2-finetuned
8
  results: []
 
 
 
 
 
9
  ---
10
 
11
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
- should probably proofread and complete it, then remove this comment. -->
13
-
14
- # gpt2-finetuned
15
-
16
- This model is a fine-tuned version of [gss1147/GPT2.5.2-high-reasoning-codex-0.4B](https://huggingface.co/gss1147/GPT2.5.2-high-reasoning-codex-0.4B) on the None dataset.
17
- It achieves the following results on the evaluation set:
18
- - Loss: 2.8222
19
-
20
- ## Model description
21
-
22
- More information needed
23
-
24
- ## Intended uses & limitations
25
-
26
- More information needed
27
-
28
- ## Training and evaluation data
29
-
30
- More information needed
31
-
32
- ## Training procedure
33
-
34
- ### Training hyperparameters
35
-
36
- The following hyperparameters were used during training:
37
- - learning_rate: 5e-05
38
- - train_batch_size: 4
39
- - eval_batch_size: 4
40
- - seed: 42
41
- - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
42
- - lr_scheduler_type: linear
43
- - lr_scheduler_warmup_steps: 500
44
- - num_epochs: 3
45
-
46
- ### Training results
47
-
48
- | Training Loss | Epoch | Step | Validation Loss |
49
- |:-------------:|:-----:|:----:|:---------------:|
50
- | 3.3111 | 1.0 | 913 | 2.8776 |
51
- | 2.8017 | 2.0 | 1826 | 2.8265 |
52
- | 2.6463 | 3.0 | 2739 | 2.8222 |
53
-
54
-
55
- ### Framework versions
56
-
57
- - Transformers 5.0.0
58
- - Pytorch 2.10.0+cu128
59
- - Datasets 4.0.0
60
- - Tokenizers 0.22.2
 
1
  ---
2
  library_name: transformers
3
+ base_model:
4
+ - gss1147/GPT2.5.2-high-reasoning-codex-0.4B
5
+ - openai-community/gpt2-medium
6
  tags:
7
  - generated_from_trainer
8
  model-index:
9
  - name: gpt2-finetuned
10
  results: []
11
+ datasets:
12
+ - TeichAI/gpt-5.1-codex-max-1000x
13
+ - TeichAI/gpt-5.2-high-reasoning-250x
14
+ - jjmachan/NSFW-reddit
15
+ - gss1147/GPT-2-to-GPT-5-5k
16
  ---
17