LLM fine-tuning

Large language models don’t become helpful, harmless, and aligned with human expectations by accident. Pretraining teaches a model to predict the next token across a massive corpus of text, but it doesn’t teach the model what a good response actually looks like from a human’s point of view. That gap is closed through Reinforcement Learning […]