Hugging Face's logo

Spaces:
AdithyaSK
/
scaling-rl-for-llms-amd-ai-dev-day
Running

App Files Community
AdithyaSK HF Staff commited on
Commit
88369c2
·
verified ·
1 Parent(s): 467d813

Deploy Scaling RL for LLMs deck (AMD AI Dev Day)

Browse files
Files changed (15) hide show
  1. .gitattributes +5 -0
  2. README.md +18 -4
  3. assets/adithyask-CfgQu2fr.jpeg +0 -0
  4. assets/blog-hero-A-OkyEfb.png +3 -0
  5. assets/cheating-agents-Bpt4f8GA.jpeg +0 -0
  6. assets/cognitivelab-BpHudwdd.png +0 -0
  7. assets/index-BaIqJAjN.js +0 -0
  8. assets/index-DlQWIdL0.css +1 -0
  9. assets/openai-ss1-DOT2K7xh.png +3 -0
  10. assets/openai-ss2-crop-BqCLkRBg.png +0 -0
  11. assets/openai-ss3-crop-KZZxFTHs.png +3 -0
  12. assets/qwen-scaling-C1rB1MJm.png +3 -0
  13. assets/reward-hack-curves-Dsoa5-YV.png +3 -0
  14. index.html +41 -17
  15. og.png +0 -0
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/blog-hero-A-OkyEfb.png filter=lfs diff=lfs merge=lfs -text
37
+ assets/openai-ss1-DOT2K7xh.png filter=lfs diff=lfs merge=lfs -text
38
+ assets/openai-ss3-crop-KZZxFTHs.png filter=lfs diff=lfs merge=lfs -text
39
+ assets/qwen-scaling-C1rB1MJm.png filter=lfs diff=lfs merge=lfs -text
40
+ assets/reward-hack-curves-Dsoa5-YV.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,10 +1,24 @@
1
  ---
2
- title: Scaling Rl For Llms Amd Ai Dev Day
3
- emoji: 🏆
4
  colorFrom: green
5
- colorTo: blue
6
  sdk: static
 
7
  pinned: false
 
 
8
  ---
9
 
10
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Scaling RL for LLMs — Slides
3
+ emoji: 📈
4
  colorFrom: green
5
+ colorTo: purple
6
  sdk: static
7
+ app_file: index.html
8
  pinned: false
9
+ license: mit
10
+ short_description: Scaling RL for LLMs — AMD AI Dev Day slides
11
  ---
12
 
13
+ # Scaling RL for LLMs — RL Environments and RL Training
14
+
15
+ Talk slides by [Adithya S Kolavi](https://huggingface.co/AdithyaSK), presented at
16
+ **[AMD AI Dev Day](https://amd.indiadevday.com/)**.
17
+
18
+ RL environments (OpenEnv) and RL training (TRL) — what an environment actually is,
19
+ how reward hacking happens, and how to build and train against your own.
20
+
21
+ React + Vite. Arrow keys / clicker / swipe to navigate, `t` for light/dark, `f` for fullscreen.
22
+
23
+ Source: [adithya-s-k/RL_Envs_101](https://github.com/adithya-s-k/RL_Envs_101) →
24
+ `tutorials/slides/rl-environments-101-amd/`
assets/adithyask-CfgQu2fr.jpeg ADDED
assets/blog-hero-A-OkyEfb.png ADDED

Git LFS Details

  • SHA256: 6cca07e5b76ff38e1be7a95956c9c94bb55621735e2806e8a91532ba59ee1d15
  • Pointer size: 131 Bytes
  • Size of remote file: 379 kB
assets/cheating-agents-Bpt4f8GA.jpeg ADDED
assets/cognitivelab-BpHudwdd.png ADDED
assets/index-BaIqJAjN.js ADDED
The diff for this file is too large to render. See raw diff
 
assets/index-DlQWIdL0.css ADDED
@@ -0,0 +1 @@
 
 
1
+ *,*:before,*:after{box-sizing:border-box}html,body,#root{margin:0;padding:0;width:100%;height:100%;overflow:hidden}body{font-family:ui-monospace,SF Mono,JetBrains Mono,Menlo,Monaco,Consolas,monospace;-webkit-font-smoothing:antialiased;text-rendering:optimizeLegibility}button{font-family:inherit;cursor:pointer}button:focus:not(:focus-visible){outline:none}
assets/openai-ss1-DOT2K7xh.png ADDED

Git LFS Details

  • SHA256: 1b2035cbe7404178ee3fa985544a435f5c75f096110a14600ff16e79fec765ca
  • Pointer size: 131 Bytes
  • Size of remote file: 392 kB
assets/openai-ss2-crop-BqCLkRBg.png ADDED
assets/openai-ss3-crop-KZZxFTHs.png ADDED

Git LFS Details

  • SHA256: e98c01f01ac405adebf74045dac591900b5bed9bad519cb672686649ed193056
  • Pointer size: 131 Bytes
  • Size of remote file: 109 kB
assets/qwen-scaling-C1rB1MJm.png ADDED

Git LFS Details

  • SHA256: ee9d64ba0c6211c619f93e9d2f94738bd57a9d40ccc81cfd8f0a71ae1fcea08c
  • Pointer size: 131 Bytes
  • Size of remote file: 189 kB
assets/reward-hack-curves-Dsoa5-YV.png ADDED

Git LFS Details

  • SHA256: 47746dadd99d4a9afd06edb86a13cac6bdd98ce4201b19faeabde54a95a06b70
  • Pointer size: 131 Bytes
  • Size of remote file: 168 kB
index.html CHANGED
@@ -1,19 +1,43 @@
1
  <!doctype html>
2
- <html>
3
- <head>
4
- <meta charset="utf-8" />
5
- <meta name="viewport" content="width=device-width" />
6
- <title>My static Space</title>
7
- <link rel="stylesheet" href="style.css" />
8
- </head>
9
- <body>
10
- <div class="card">
11
- <h1>Welcome to your static Space!</h1>
12
- <p>You can modify this app directly by editing <i>index.html</i> in the Files and versions tab.</p>
13
- <p>
14
- Also don't forget to check the
15
- <a href="https://huggingface.co/docs/hub/spaces" target="_blank">Spaces documentation</a>.
16
- </p>
17
- </div>
18
- </body>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  </html>
 
1
  <!doctype html>
2
+ <html lang="en">
3
+ <head>
4
+ <meta charset="UTF-8" />
5
+ <meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=no" />
6
+ <title>Scaling RL for LLMs — Adithya S Kolavi</title>
7
+ <meta
8
+ name="description"
9
+ content="Scaling RL for LLMs: RL Environments and RL Training — a talk by Adithya S Kolavi at AMD AI Dev Day."
10
+ />
11
+ <meta name="theme-color" content="#07090f" />
12
+
13
+ <!-- Social preview. og:image must be absolute, so it points at the deployed
14
+ Space; public/og.png is regenerated by scripts/make_og.py. -->
15
+ <meta property="og:type" content="website" />
16
+ <meta property="og:site_name" content="Scaling RL for LLMs" />
17
+ <meta property="og:url" content="https://adithyask-scaling-rl-for-llms-amd-ai-dev-day.static.hf.space/" />
18
+ <meta property="og:title" content="Scaling RL for LLMs — RL Environments and RL Training" />
19
+ <meta
20
+ property="og:description"
21
+ content="A talk by Adithya S Kolavi at AMD AI Dev Day: what an RL environment actually is, how reward hacking happens, and how to build and train your own with OpenEnv + TRL."
22
+ />
23
+ <meta property="og:image" content="https://adithyask-scaling-rl-for-llms-amd-ai-dev-day.static.hf.space/og.png" />
24
+ <meta property="og:image:width" content="1200" />
25
+ <meta property="og:image:height" content="630" />
26
+ <meta property="og:image:alt" content="Scaling RL for LLMs — RL Environments and RL Training · Adithya S Kolavi" />
27
+
28
+ <meta name="twitter:card" content="summary_large_image" />
29
+ <meta name="twitter:site" content="@AdithyaSK" />
30
+ <meta name="twitter:creator" content="@AdithyaSK" />
31
+ <meta name="twitter:title" content="Scaling RL for LLMs — RL Environments and RL Training" />
32
+ <meta
33
+ name="twitter:description"
34
+ content="A talk by Adithya S Kolavi at AMD AI Dev Day: what an RL environment actually is, how reward hacking happens, and how to build and train your own with OpenEnv + TRL."
35
+ />
36
+ <meta name="twitter:image" content="https://adithyask-scaling-rl-for-llms-amd-ai-dev-day.static.hf.space/og.png" />
37
+ <script type="module" crossorigin src="./assets/index-BaIqJAjN.js"></script>
38
+ <link rel="stylesheet" crossorigin href="./assets/index-DlQWIdL0.css">
39
+ </head>
40
+ <body>
41
+ <div id="root"></div>
42
+ </body>
43
  </html>
og.png ADDED