1Cademy - In the context of a system that generates sequences of values (like words in a sentence), the expression $q(\hat{y}_{i+t})$ is often used. Match each component of this expression to its correct description.

Learn Before

Function of a Predicted Future Value Notation ( $q(\hat{y}_{i+t})$ )

Matching

In the context of a system that generates sequences of values (like words in a sentence), the expression $q(\hat{y}_{i+t})$ is often used. Match each component of this expression to its correct description.

Updated 2025-10-04

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science

Acceptance-Rejection Mechanism for Speculative Decoding
Condition for Rejecting Speculation
Consider a text generation system that uses a fast, approximate model to propose a potential future word. For each proposed word, a more accurate but slower model also calculates a probability. Suppose at a certain step i, the fast model predicts the next word will be 'universe' (represented as $\hat{y}_{i+1}$ ). The fast model's confidence in this specific prediction is calculated and denoted as $q(\hat{y}_{i+1}) = 0.8$ . Based on this information, what is the most accurate interpretation of th
Rejection Criterion in Speculative Sampling
Interpreting Model Predictions
Condition for Accepting Speculation ( $q(\hat{y}_{i+t}) \le p(\hat{y}_{i+t})$ )

Learn Before

Related