sergiopaniego/sdpo-hints-demo-bucket
11.6 MB
Sergio Paniego PRO
sergiopaniego
AI & ML interests
None yet
Recent Activity
updated a dataset 1 day ago
huggingface-projects/Deep-RL-Course-Certification updated a dataset 1 day ago
agents-course/final-certificates updated a dataset 1 day ago
agents-course/course-certificates-of-excellenceOrganizations
buckets 58
Posts 100
Post
7467
Frontier models use distillation as a step of their post-training pipelines.
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL!
In 2026 it has three jobs: compress a big model into a small one, merge RL experts into a single model, and let a model teach itself.
I wrote up which frontier models use each one and how: https://huggingface.co/blog/sergiopaniego/distillation-2026
It pairs with Class 2 of the Training an Agent series Ben and I are doing, where we teach these techniques hands-on with TRL!
Articles 26
Article
18
Profiling in PyTorch (Part 3): Attention is all you profile
spaces 164
pinned
Running on Zero
Agents
Featured
120
VLM Object Understanding
🦀
Explore object detection, visual grounding, keypoint Detecti
pinned
Runtime error
Agents
11
Qwen2-VL-7B
🔥
Ask questions about charts in images
pinned
Running on Zero
Agents
SmolVLM-trl-dpo-rlaif-v
🔥
Generate text from an image and question
pinned
Runtime error
Agents
SmolVLM-trl-sft-ChartQA
🔥
Ask questions about charts in images
Running
Sdpo Vllm Smoke Static 64b0e4
🎯
View and monitor key metrics with the Trackio dashboard
Running
Sdpo Hints Eval Static Ae196e
🎯
View and explore your tracking data in a dashboard
models 140
sergiopaniego/Qwen3.5-4B-sdpo-math-hints
Updated • 1
sergiopaniego/Qwen3.5-4B-sdpo-math-gold
Updated
sergiopaniego/Qwen3.5-4B-sdpo-math-baseline
Updated
sergiopaniego/sdpo-hints
Updated
sergiopaniego/pi-mono-youtube-livestream-2-scripts
Updated • 2
sergiopaniego/gemma-4-E2B-offpolicy-kd-lr1e4
Updated
sergiopaniego/gemma-4-E2B-offpolicy-kd-lr2e4
Updated
sergiopaniego/gemma-4-E2B-offpolicy-kd-lr5e5
Updated
sergiopaniego/qwen3-0.6b-pimono-gkd-lr2e5
Text Generation • 0.6B • Updated • 466
sergiopaniego/qwen3-0.6b-pimono-gkd-lr1e5
Text Generation • 0.6B • Updated • 462
datasets 14
sergiopaniego/math-sdpo-hints-plain
Viewer • Updated • 600 • 13
sergiopaniego/math-sdpo-hints
Viewer • Updated • 600 • 15
sergiopaniego/gsm8k-sdpo-plain
Viewer • Updated • 700 • 18
sergiopaniego/gsm8k-sdpo-hints
Viewer • Updated • 700 • 22
sergiopaniego/pi-mono-chat
Viewer • Updated • 886 • 86
sergiopaniego/requests-pr-diff
Viewer • Updated • 1 • 19
sergiopaniego/trl-r2e-test
Viewer • Updated • 1 • 28
sergiopaniego/chain-sum-rollouts
Viewer • Updated • 50 • 18
sergiopaniego/ttt-scripted-smoke
Viewer • Updated • 20 • 13
sergiopaniego/sample_videos
Viewer • Updated • 2 • 20