Google

LLM scaling strategies, which aim to enhance performance and compute capabilities, can be categorized based on the model's lifecycle stage. The three primary types are Pre-training Scaling, Fine-tuning Scaling, and Inference-time Scaling.

Classification of LLM Scaling

Inference-time scaling is a strategy for enhancing the performance of Large Language Models during their application phase, which notably does not involve any parameter updates or further training. This approach is distinct from pre-training and fine-tuning scaling. It encompasses a wide array of methods that scale LLMs across various dimensions, including techniques like ensembling multiple model outputs, expanding the context length, employing more aggressive decoding algorithms, and leveraging external tools to augment the model's inherent capabilities.

Inference-Time Scaling

A development team is enhancing a large language model through a series of steps. First, they train a new, larger version of the model from scratch on a massive, general-purpose text corpus. Next, they adapt this new model for a specific task by continuing its training on a smaller, curated dataset of customer service conversations. Finally, when the model is deployed, they improve its response quality by using a technique that generates multiple potential answers and selects the best one, a pro

Based on the following scenario, identify which of the three primary categories of LLM scaling is being employed. Justify your answer by explaining why it fits the identified category and not the other two.

Learn Before

Related