Google

In the context of LLM inference, where predictions are conditioned on an input sequence `x`, the starting point or 'root' of the search process can be conceptualized as a representation of this input `x`. All subsequent predictions branch out from this initial state.

Root of the Search Space as a Representation of Input (x)

Analyze the following scenario and identify the most probable cause of the error, explaining your reasoning based on how the text generation process is initiated.

Analyzing a Faulty Text Generation Process

When a language model is tasked with generating text for two distinct input prompts, the search for the optimal output sequence begins from an identical initial state for both prompts, regardless of the prompts' content.

A language model is tasked with generating a continuation for two different input prompts:

Prompt 1: "The history of the Roman Empire is..."
Prompt 2: "The recipe for a perfect pizza dough is..."

When the model begins the process of finding the most likely sequence of words to follow each prompt, how does the starting point (or 'root') of this search process differ between Prompt 1 and Prompt 2?

Learn Before

Related