Learn Before
Reward Models as an Example of Automated Feedback
A reward model, trained on labeled data, serves as a specific example of an automated feedback mechanism. It functions by evaluating a model's output and assigning a numerical score that represents its quality.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Using LLMs for Feedback Generation
Feedback System Design for an AI Startup
A company is developing a system to iteratively improve the quality of its primary model's text summaries. They are considering using a separate, automated feedback model to score the summaries instead of relying on human reviewers. Which of the following represents the most significant trade-off the company must consider when choosing the automated approach?
In a system designed for automated self-refinement, the same model that generates the initial output must also be used to generate the feedback for that output.
Learn After
Improving a Chatbot's Politeness
A development team wants to improve a language model's ability to generate helpful and safe responses. They decide to use a system where a separate, trained model provides a quality score for each generated response. Arrange the following steps in the logical order required to implement and use this system.
A development team trains a language model to generate helpful code snippets. To improve its performance, they also build a separate model that automatically assigns a numerical score from 1 to 10 to each generated snippet, with 10 being the most helpful. What is the most critical factor that determines whether this scoring model can reliably identify helpful code?