A team is tasked with optimizing a large language model's inference performance. Match each specific optimization challenge they face with the primary computer science or engineering discipline best equipped to solve it.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Importance of Hands-On Practice for Mastering LLM Inference
A technology company is experiencing significant latency and high operational costs when generating responses from its large language model. The engineering team, composed entirely of natural language processing specialists, has already attempted to solve the issue by refining the model's output generation algorithm, but the improvements have been minimal. Based on the current understanding of performance optimization for these systems, which of the following strategies should the company priori
Evaluating an LLM Inference Optimization Strategy