02 · See it in action
Follow the steps
- Define what an independent example means for your task.
- Separate the test set before experimenting.
- Use validation data or cross-validation to choose settings.
- Evaluate the final design once on the held-out test set and report limitations.
Worked example
For 1,000 independent toy examples:
600 training + 200 validation + 200 test
For repeated users: keep each user in only one split.
For forecasting: use chronological splits.
Read the example once, then explain each part aloud in your own words. If it includes Python, you can understand the idea first and run the code later in a local Python environment. Code is shown as text; this page does not execute it.
Sign in to save your reading progress.
Sign in