If the validation curve reaches the target after the data set doubles, what should be concluded?
Case context: A model team draws a target validation-error level on a learning curve. By extending the observed trend beyond the current sample count, the curve appears to meet that target at roughly two times the present data size.
Question: What does this suggest about the value of collecting additional examples, and how definite should that judgment be?
Sample answer: This suggests that increasing the data set to about twice its current size may be enough to get to the target. The team should treat that as a rough forecast, not as a promise, because it comes from extending the curve rather than from a direct test.
Key points:
- The target level is the benchmark being compared against.
- Extending the learning trend points to improvement from more examples.
- A doubling of the data appears likely to help enough.
- A projected trend is only an estimate, so it is not certain.
Rubric: The response should link the projected meeting point with the benchmark to a plausible payoff from doubling the data and should clearly state that the conclusion is uncertain rather than guaranteed.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What does sketching an extension of the dev-error curve help you estimate?
A trend line from past data can give an exact guarantee of the model’s future error after more training data is added.
Add the target _____ to a dev-error curve before estimating the value of more data.
Match each learning-curve element with its role when estimating the benefit of more labeled data.
Order the reasoning steps for judging whether more data is likely to reach a target performance level.
Using a Validation Curve to Judge the Value of More Data
Why Add the Target Line to a Learning Curve?
Which conclusion best matches the example learning curve?
A rough learning-curve estimate can support a tentative prediction about the value of adding more training data, but it does not guarantee the outcome.