Google

The output stage is the final step (labeled ④) in a single iteration of the Top-k sampling process. The token that was selected through sampling in the previous stage is confirmed as the generated output. This token is then appended to the sequence of text, and the model can begin the entire process again to generate the next token.

Output Stage in Top-k Sampling

A text generation model using a specific sampling strategy follows a multi-step process to produce one word at a time. Arrange the following descriptions of these steps into the correct logical order for a single generation cycle.

A language model is generating a story and has just completed a sampling step, selecting the token 'forest' from a filtered list of probable next words. Describe the two distinct actions that must occur in the final stage of this single generation cycle to finalize this choice and prepare for generating the *next* token.

Finalizing a Token Generation Step

A text generation model is in the process of creating a sentence. It has already produced the sequence 'The sun shines brightly in the'. In the step just completed, the model considered a small, filtered set of the most probable next words and, through a sampling process, selected the token 'sky'. What is the immediate next action the model must perform to continue the generation process?

Learn Before

Related