SEC.03 / LLM Research
LLM Alignment Explained: RLHF, DPO, Constitutional AI and Reinforcement Learning from Verifiable Rewards
How large language models are trained to be helpful, honest and safe: RLHF with reward models, Direct Preference Optimization and its variants, Constitutional AI and AI feedback, reinforcement learning on verifiable rewards with GRPO, how the methods compare, known failure modes and practical advice for fine-tuning.