ZeroGPU Explorers

community

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

sayakpaul authored a paper 10 days ago

DynEval: Holistic Evaluations of T2I Generative Models in the Wild

CongWei1230 authored a paper 10 days ago

Function-Aware Fill-in-the-Middle as Mid-Training for Coding Agent Foundation Models

CongWei1230 authored a paper 10 days ago

Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation

View all activity

sergiopaniego

posted an update about 23 hours ago

Post

yesterday we had Class 3 of the Training Agents live series

we went through how GRPO works in depth and applied it to real experiments with TRL

sharing the resources in case you want to dig in, enjoy!

🎥 session recording: https://www.youtube.com/watch?v=ztdTed5egrM

📄 slides with links: https://docs.google.com/presentation/d/19v5_HR5B-1CPHuoZ-RXjhgBrGFXGnBNd6TfLhsXWT1c/edit?usp=sharing

sergiopaniego

posted an update 3 days ago

Post

2798

quick reminder! 🚨

tomorrow (Tuesday, July 28), we're back with Class 3 of the Training Agents live series

🧠 what: reinforcement learning for training agents (GRPO): how it works, how to implement it in TRL, and end-to-end examples
🗓️ when: Tuesday, July 28 - 🕔 5:00 PM CEST / 8:30 PM IST
📍 where: Live on @huggingface 's X, YouTube, and LinkedIn

live: https://www.youtube.com/watch?v=ztdTed5egrM

class 1: https://x.com/SergioPaniego/status/2069382207618379813
class 2: https://x.com/SergioPaniego/status/2075180665184686187

1 reply

sergiopaniego

posted an update 6 days ago

Post

160

you can now train your own coding agents with trl + openenv, starting with opencode

we just added end-to-end support for training agent harnesses:

> TRL: a loop-owning training path (AsyncGRPOTrainer + HarnessRolloutWorker) that launches the agent in an OpenEnv session, reads back its trace, reconstructs the training samples, and trains with AsyncGRPO
> OpenEnv: the OpenCode harness environment plus a transparent proxy that forwards the agent's model calls and records each turn's token ids and logprobs

you train the actual opencode agent as is, it runs its own loop and tools and the policy learns from the exact tokens it produced

we're shipping a self-contained example: local subprocess sandbox, DeepCoder problems, validated on Qwen3-8B.

> example: https://github.com/huggingface/trl/blob/main/examples/scripts/openenv/opencode.py
> docs: https://huggingface.co/docs/trl/main/openenv

and we're working actively on both sides so expect more 🤓

1 reply

sergiopaniego

posted an update 7 days ago

Post

1473

you can train DiffusionGemma (a block-diffusion LLM) in TRL! and we're sharing an example for it

TRL trainers are made to be easily extended and adapted to different real-world use cases.

in this one, with a single method overridden in SFTTrainer (compute_loss), you can train this model

> example: https://github.com/huggingface/trl/blob/main/examples/scripts/sft_diffusion_gemma.py

sergiopaniego

posted an update 8 days ago

Post

198

join us next Tuesday, July 28, for Class 3 of the Training Agents live series!

we'll dive into reinforcement learning for agent training, covering the intuition behind GRPO, how it works, and how to implement it in TRL with practical, e2e examples

see you there 🤠

live: https://www.youtube.com/live/ztdTed5egrM

> in case you missed class 1:
https://x.com/SergioPaniego/status/2069382207618379813
> and in case you missed class 2: https://x.com/SergioPaniego/status/2075180665184686187