You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This training offers an intensive exploration into the frontier of reinforcement learning techniques with large language models (LLMs). We will explore advanced topics such as Reinforcement Learning with Human Feedback (RLHF), Reinforcement Learning from AI Feedback (RLAIF), Reasoning LLMs, and demonstrate practical applications such as fine-tuning
Reproduces Hugging Face's RLOO vs. PPO win-rate comparison on real public checkpoints, using Claude as judge instead of GPT-4. Evaluation only — no training.
Frontier-curriculum RLOO for LLM reasoning, developed for Stanford CS224R. Includes baseline comparisons, a simplified public implementation, evaluation, and results. Improved pass@1 from 0.41 to 0.49 over vanilla RLOO.