Google

Dataset A: A large dataset with 2 million examples, all focused on a single, complex task: summarizing scientific research papers.
Dataset B: A smaller dataset with 200,000 examples, but spread across 150 different tasks, such as question-answering, creative writing, translation, an

The performance of Large Language Models can be enhanced by increasing the number of distinct tasks used during the fine-tuning process.

Performance Improvement by Scaling Fine-Tuning Tasks

Based on the scenario below, which dataset should the team choose to best achieve their goal? Justify your decision by explaining the relationship between the diversity of adaptation tasks and the resulting model's capabilities.

Evaluating Fine-Tuning Strategies for a General-Purpose LLM

A team is fine-tuning a language model to create a specialized assistant for the legal domain. The senior developer argues for using their entire data budget on a single, massive dataset of one task: summarizing legal documents. They believe this will maximize performance. A junior developer suggests diversifying the fine-tuning data to include several other legal tasks (e.g., contract analysis, question answering), even if it means using fewer examples for the summarization task.

Critique the senior developer's strategy. Is it the optimal approach for creating a robust and versatile legal assistant? Explain your reasoning.

Evaluating a Fine-Tuning Strategy for a Specialized LLM

A development team is fine-tuning a large language model to serve as a general-purpose assistant capable of handling a wide variety of user queries. They have two potential datasets for this process:

*   **Dataset A:** A large dataset with 2 million examples, all focused on a single, complex task: summarizing scientific research papers.
*   **Dataset B:** A smaller dataset with 200,000 examples, but spread across 150 different tasks, such as question-answering, creative writing, translation, an

Learn Before

Related