Google

A grammaticality judgment prompt can be designed by first providing the sentence to be assessed, followed by a related question, and ending with clear multiple-choice options for the answer. For example, the sentence 'LLMs are powerful models but are expensive to build.' is presented at the beginning. This is followed by asking 'Does this sentence make sense grammatically?' and supplying an 'Answer Option' list that explicitly states the choices '- Yes' and '- No', along with the expected final response 'Yes'.

Example of a Sentence-First Prompt for Grammaticality Judgment with Answer Options

Based on the scenario described, what is the most significant weakness in the data scientist's prompt that leads to inconsistent outputs, and what specific change would make the responses uniform and easily processable?

Improving Prompt Reliability for Automated Text Checking

A developer is creating a 'sentence-first' prompt to have a language model judge the grammatical correctness of a sentence. Arrange the following components into the correct structural order for this type of prompt.

A developer needs to create a prompt for a language model to determine if a given sentence is grammatically sound. The prompt design requires presenting the sentence first, followed by a direct question, and finally, clear instructions that restrict the model's output to one of two predefined words, with each word's meaning explicitly defined. Which of the following prompts best adheres to this design for the sentence 'The cat sat on the mat quickly.'?

Learn Before

Related