Supervised Learning
Supervised learning trains a model on examples that already carry the correct answer, then uses the patterns it finds to predict that answer for new, unseen cases — the approach behind spam filters, fraud alerts, and price predictions.
itArtificial intelligence and machine learning | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic — Supervised Learning
Supervised learning shows a model examples with answers attached, then asks it to make the same kind of guess for a new case. It teaches a function by example rather than writing every rule by hand, which helps when a rule has too many corners for a spreadsheet to sulk through alone.
Each example has features, the input details, and a target, the known answer. A category such as spam is classification; a number such as a house price is regression. Give the model the wrong target, and it will work diligently on a question no one meant to ask.
Linear models add weighted inputs. Trees divide cases at feature thresholds. Ensembles combine models: random forests average independent trees, while gradient boosting corrects earlier errors. Nearest neighbors consult nearby labeled cases. Neural networks stack transformations when the relationship needs more flexibility. None has won the title of Universal Machine, chiefly because the universe declined to supply a test set.
The awkward part is evaluation. A training score says how well a model remembers examples, not how it handles new ones. Cross-validation repeatedly withholds part of the training data before a final untouched test set gives the honest estimate. For rare events, accuracy can look excellent while the model misses the cases anyone cared about, so precision, recall, and F1 matter.
Labels are the floor and ceiling of the arrangement. Biased historical labels reproduce their history. A changing world makes an old mapping stale even when code remains impeccably motionless. The Course tab gives the full map; Cheatsheet holds metrics and evaluation rules; Field Notes covers where tidy splits meet production data.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://scikit-learn.org/stable/supervised_learning.html
Supports
- Classification vs regression
- algorithm families
- https://scikit-learn.org/stable/modules/model_evaluation.html
Supports
- Metrics
- https://scikit-learn.org/stable/modules/cross_validation.html
Supports
- Cross-validation
- exercise
- https://xgboost.ai/
Supports
- XGBoost
- https://lightgbm.readthedocs.io/en/stable/
Supports
- LightGBM
- https://catboost.ai/
Supports
- CatBoost
- https://pycaret.gitbook.io/docs
Supports
- PyCaret
- https://featuretools.alteryx.com/en/stable/
Supports
- Featuretools
- https://github.com/josephmisiti/awesome-machine-learning
Supports
- Ecosystem discovery
- https://h2o.ai/
Supports
- H2O landscape
- https://psycnet.apa.org/record/1959-09865-001
Supports
- 1958 timeline
- https://doi.org/10.1109/TIT.1967.1053964
Supports
- 1967 timeline
- https://doi.org/10.1038/323533a0
Supports
- 1986 timeline
- https://doi.org/10.1007/BF00994018
Supports
- 1995 timeline
- https://doi.org/10.1007/978-3-642-59136-1_2
Supports
- 1997 timeline
- https://doi.org/10.1023/A:1010933404324
Supports
- 2001 timeline
- https://doi.org/10.1214/aos/1013203451
Supports
- 2001 timeline
- https://arxiv.org/abs/1603.02754
Supports
- 2016 timeline
- https://proceedings.neurips.cc/paper/2017/hash/6449f44a102fde848669bdd9eb6b76fa-Abstract.html
Supports
- 2017 timeline
- https://arxiv.org/abs/1810.11363
Supports
- 2018 timeline
- https://developers.google.com/machine-learning/guides/rules-of-ml/
Supports
- Field Notes
- https://developers.google.com/machine-learning/crash-course/production-ml-systems/monitoring
Supports
- Field Notes
- https://developers.google.com/machine-learning/crash-course/overfitting/dividing-datasets
Supports
- Field Notes
