Recommender Systems
Recommender systems select useful items from a large catalog for a person or situation. They combine item information with observed behavior to suggest products, videos, music, articles, and other items.
itArtificial intelligence and machine learning | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic - Recommender Systems
A recommender system is a machine for reducing a huge catalog to a small list worth inspecting. It is not a certified personality detector, a digital butler, or a tiny oracle with suspiciously good taste. It makes a ranking decision from incomplete evidence, which is less glamorous and much more useful.
A catalog contains alternatives. Without a recommender, it remains a large catalog and the selection problem remains politely on the reader's desk. The system uses item information, context, and observed interactions, then starts with candidate generation, the fast step that cuts the catalog into a workable pool. Content-based filtering uses similar item attributes. Collaborative filtering uses patterns across people and items. Neither gets to read minds, which is considerate of the minds.
Next, scoring uses richer information to order the candidates. The score can represent clicks, watch time, purchases, or another outcome. That choice matters because an objective changes the behavior the system rewards. A final re-ranking pass handles a fact models prefer to ignore: a list can be individually high-scoring and still be repetitive, stale, or incompatible with policy. Diversity and freshness arrive here to stop the list becoming a chorus that knows one note.
The surprise is that an absent interaction is not a negative interaction. A person may never have seen the item. Display position also affects clicks. Exposure therefore becomes part of the evidence, not background furniture. New users and new items add cold start, so metadata, context, defaults, editorial choices, and policy rules keep the system useful while history is scarce.
The rest of this course sorts the moving parts. Read the Introduction for the architecture and the meanings of retrieval, ranking, and re-ranking. Use the Slides when the pipeline needs to fit in one mental picture. Keep the Cheatsheet nearby when comparing feedback signals, similarity measures, and failure modes. The video script gives the short spoken route through the same path. Field Notes adds the operational judgment: inspect which stage lost an item before asking a ranker to rescue it.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://developers.google.com/machine-learning/recommendation/overview/types
Supports
- Three-stage architecture
- re-ranking constraints
- https://developers.google.com/machine-learning/recommendation/overview/candidate-generation
Supports
- Filtering approaches
- embeddings
- similarity measures
- https://developers.google.com/machine-learning/recommendation/dnn/scoring
Supports
- Ranking
- objectives
- positional bias
- https://www.tensorflow.org/recommenders/examples/basic_retrieval
Supports
- Two-tower retrieval
- explicit and implicit feedback
- https://github.com/grahamjenson/list_of_recommender_systems
Supports
- RecBole
- LensKit
- NVIDIA Merlin selections
- https://ccs.mit.edu/papers/CCSWP165.html
Supports
- 1994 GroupLens milestone
- collaborative filtering architecture
- https://doi.org/10.1145/223904.223931
Supports
- 1995 Ringo milestone
- social information filtering
- https://www.microsoft.com/en-us/research/publication/empirical-analysis-of-predictive-algorithms-for-collaborative-filtering/
Supports
- 1998 algorithm comparison milestone
- ranked-list evaluation
- https://doi.org/10.1109/MIC.2003.1167344
Supports
- 2003 item-to-item collaborative filtering milestone
- https://doi.org/10.1109/MC.2009.263
Supports
- 2009 matrix factorization milestone
- https://research.google/pubs/deep-neural-networks-for-youtube-recommendations/
Supports
- 2016 YouTube two-stage system milestone
- https://arxiv.org/abs/1708.05031
Supports
- 2017 Neural Collaborative Filtering milestone
- https://arxiv.org/abs/1904.06690
Supports
- 2019 BERT4Rec milestone
- https://blog.tensorflow.org/2020/09/introducing-tensorflow-recommenders.html
Supports
- 2020 TensorFlow Recommenders milestone
- https://www.recombee.com/
Supports
- Recombee landscape entry
- https://www.dynamicyield.com/
Supports
- Dynamic Yield landscape entry
- https://developer.nvidia.com/merlin
Supports
- NVIDIA Merlin landscape entry
- https://cloud.google.com/retail/docs/overview
Supports
- Google Cloud AI Commerce Search landscape entry
- https://www.bloomreach.com/en/products/discovery
Supports
- Bloomreach Discovery landscape entry
- https://medium.com/airbnb-engineering/learning-to-rank-diversely-add6b1929621
Supports
- Field Note on list-level diversity
- https://medium.com/airbnb-engineering/beyond-a-b-test-speeding-up-airbnb-search-ranking-experimentation-through-interleaving-7087afa09c8e
Supports
- Field Note on ranking experiment attribution
