{"id":2477,"date":"2026-09-16T14:01:59","date_gmt":"2026-09-16T14:01:59","guid":{"rendered":"https:\/\/www.epw.com\/blog\/?p=2477"},"modified":"2026-09-27T10:39:16","modified_gmt":"2026-09-27T10:39:16","slug":"recommendation-system-design-guide","status":"publish","type":"post","link":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide","title":{"rendered":"Recommendation System Design: A Practical Guide from Objectives to Evaluation"},"content":{"rendered":"<p class=\"epw-featured-image-caption\"><em>AI-generated illustration created to represent the article\u2019s subject. It does not depict an actual EPW course, trainer, participant, client, event or venue.<\/em><\/p>\n<p>A recommendation system does more than predict what a person might click. It decides which products, courses, documents, services or media receive attention\u2014and in what order. That makes recommendation system design an operational and governance problem as much as a modelling problem.<\/p>\n<p>The most reliable starting point is not an algorithm. It is a precisely defined decision, a useful outcome and a measurement plan that prevents one convenient metric from distorting the experience. This practical guide takes a system from objectives through candidate retrieval, scoring, re-ranking, evaluation and production monitoring.<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #dd0808;color:#dd0808\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #dd0808;color:#dd0808\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 eztoc-toggle-hide-by-default' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#What_a_recommendation_system_actually_does\" >What a recommendation system actually does<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#Start_with_the_decision_not_the_click\" >Start with the decision, not the click<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#The_EPW_RANKED_design_framework\" >The EPW RANKED design framework<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#R_%E2%80%94_Result_and_decision\" >R \u2014 Result and decision<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#A_%E2%80%94_Audience_catalogue_and_availability\" >A \u2014 Audience, catalogue and availability<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#N_%E2%80%94_Notice_signals_and_negatives\" >N \u2014 Notice signals and negatives<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#K_%E2%80%94_Keep_candidates_scores_and_constraints_separate\" >K \u2014 Keep candidates, scores and constraints separate<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#E_%E2%80%94_Evaluate_offline_and_online\" >E \u2014 Evaluate offline and online<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#D_%E2%80%94_Deploy_detect_and_decide_again\" >D \u2014 Deploy, detect and decide again<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#Architecture_choices_by_problem_condition\" >Architecture choices by problem condition<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#Worked_example_recommending_professional_courses\" >Worked example: recommending professional courses<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#How_to_evaluate_recommendation_quality\" >How to evaluate recommendation quality<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#Cold_start_feedback_loops_and_responsible_control\" >Cold start, feedback loops and responsible control<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#Production-readiness_checklist\" >Production-readiness checklist<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#Developing_recommendation-system_design_skills\" >Developing recommendation-system design skills<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\/#Conclusion\" >Conclusion<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"What_a_recommendation_system_actually_does\"><\/span>What a recommendation system actually does<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>A recommender selects a small, ordered set of items for a user or context from a much larger catalogue. Inputs can include explicit preferences, previous interactions, item attributes, session context, availability and organisational rules. Outputs may appear as \u201cnext best action\u201d, \u201csimilar items\u201d, a personalised home page or a ranked search result.<\/p>\n<p>Google\u2019s official <a href=\"https:\/\/developers.google.com\/machine-learning\/recommendation\/overview\/types\">recommendation-systems overview<\/a> describes a common three-stage production architecture: candidate generation, scoring and re-ranking. Candidate generation rapidly reduces a large corpus to a manageable subset. A more precise model scores that subset. Re-ranking then applies requirements such as freshness, diversity and exclusions.<\/p>\n<p>That separation is useful because each stage has a different job. Retrieval must be fast and inclusive enough not to miss strong candidates. Scoring estimates value more carefully. Re-ranking protects the final experience and business rules. Trying to make one model perform all three jobs can be expensive, opaque and difficult to control.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Start_with_the_decision_not_the_click\"><\/span>Start with the decision, not the click<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u201cIncrease engagement\u201d is not a sufficient objective. It does not say which behaviour is valuable, for whom, over what period or at what cost. A learning platform might value course completion and skill progression, while a retailer might value suitable purchases with low return rates. A public-service portal may prioritise successful task completion rather than time spent.<\/p>\n<p>A good objective has four parts:<\/p>\n<ul>\n<li><strong>User outcome:<\/strong> what becomes easier, safer or more relevant?<\/li>\n<li><strong>Organisational outcome:<\/strong> what sustainable value should improve?<\/li>\n<li><strong>Guardrails:<\/strong> which harms, exclusions or quality losses are unacceptable?<\/li>\n<li><strong>Time horizon:<\/strong> is success measured in the session, after a transaction or over months?<\/li>\n<\/ul>\n<p>Objective choice changes ranking behaviour. Google\u2019s <a href=\"https:\/\/developers.google.com\/machine-learning\/recommendation\/dnn\/scoring\">scoring guidance<\/a> warns that optimising clicks can favour clickbait, while optimising watch time can favour very long content. The lesson generalises: the model will exploit the proxy it receives, so pair every optimisation metric with outcome and guardrail measures.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"The_EPW_RANKED_design_framework\"><\/span>The EPW RANKED design framework<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>RANKED is a six-part framework for moving from a vague personalisation idea to a governable production system.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"R_%E2%80%94_Result_and_decision\"><\/span>R \u2014 Result and decision<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>State where recommendations appear, who sees them, which action they support and what success means. Define the eligible catalogue and the moment at which the decision is made. Write the primary metric, secondary outcomes and guardrails before building a model.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"A_%E2%80%94_Audience_catalogue_and_availability\"><\/span>A \u2014 Audience, catalogue and availability<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Profile the users, items and contexts the system must serve. Examine catalogue size, turnover, language, geography, stock or capacity constraints and the proportion of new users and items. Availability rules belong upstream: recommending an unavailable product or unsuitable course is not a ranking error alone; it is a system-design failure.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"N_%E2%80%94_Notice_signals_and_negatives\"><\/span>N \u2014 Notice signals and negatives<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>List the events that might represent interest: views, saves, purchases, completions, ratings or repeat use. Then test what each signal really means. A long dwell time may show interest, confusion or an unattended screen. Non-interaction is not automatically dislike because the user may never have seen the item.<\/p>\n<p>Log exposure as well as response. Without knowing which items were displayed, training data confuses \u201cnot chosen\u201d with \u201cnot offered\u201d. Define negative signals carefully\u2014returns, hides, complaints and rapid abandonment can be more informative than the absence of a click.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"K_%E2%80%94_Keep_candidates_scores_and_constraints_separate\"><\/span>K \u2014 Keep candidates, scores and constraints separate<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Choose retrieval methods that fit the data. Content-based filtering uses item and user features, making it useful for new items and explainability. Collaborative filtering learns from patterns of user\u2013item interaction and can uncover latent relationships, but it struggles when interaction data is sparse. Hybrid systems combine sources such as popularity, rules, content similarity and learned embeddings.<\/p>\n<p>Google\u2019s <a href=\"https:\/\/developers.google.com\/machine-learning\/recommendation\/overview\/candidate-generation\">candidate-generation guidance<\/a> notes that content-based and collaborative methods can represent queries and items in an embedding space, then retrieve candidates using measures such as cosine similarity, dot product or Euclidean distance. Those measures are not interchangeable: for example, dot product can favour high-norm, often frequent items.<\/p>\n<p>After retrieval, a ranking model can use richer features. Re-ranking should then remove ineligible items and enforce diversity, freshness, fairness, frequency limits or contractual rules. Keep these policies visible rather than hoping the model learns them indirectly.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"E_%E2%80%94_Evaluate_offline_and_online\"><\/span>E \u2014 Evaluate offline and online<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Offline evaluation helps compare models safely. Use a time-based split where appropriate so the test set represents future behaviour rather than a random mixture of past and future. Metrics must match the interface: precision@k measures how many displayed items are relevant; recall@k measures how many relevant items are recovered; ranking metrics such as NDCG reward putting useful items near the top. Coverage, novelty and diversity reveal whether relevance is concentrated on a narrow set.<\/p>\n<p>Offline performance is necessary but not sufficient. Historical data was produced by the previous policy, position effects and exposure choices. Online experiments should therefore measure the stated user and organisational outcome, guardrails, subgroup effects and longer-term behaviour. Predefine stopping rules and minimum practical effect, not only statistical significance.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"D_%E2%80%94_Deploy_detect_and_decide_again\"><\/span>D \u2014 Deploy, detect and decide again<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Monitor candidate availability, feature freshness, retrieval recall, score distributions, latency, fallback rates and business outcomes. Track exposure concentration and subgroup performance. Define ownership for incidents, rollback and model retirement. Feedback changes the data the next model learns from, so periodically reconsider the objective and exploration policy rather than treating deployment as the end.<\/p>\n<figure class=\"wp-block-image alignnone size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1400\" height=\"850\" src=\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132636\/epw-ranked-recommendation-framework.webp\" alt=\"EPW RANKED framework for recommendation-system design and continuous improvement\" class=\"wp-image-3230\" srcset=\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132636\/epw-ranked-recommendation-framework.webp 1400w, https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132636\/epw-ranked-recommendation-framework-300x182.webp 300w, https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132636\/epw-ranked-recommendation-framework-1024x622.webp 1024w, https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132636\/epw-ranked-recommendation-framework-768x466.webp 768w\" sizes=\"auto, (max-width: 1400px) 100vw, 1400px\" \/><figcaption class=\"wp-element-caption\">RANKED keeps objectives, data, architecture, evaluation and production feedback connected.<\/figcaption><\/figure>\n<h2><span class=\"ez-toc-section\" id=\"Architecture_choices_by_problem_condition\"><\/span>Architecture choices by problem condition<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<table>\n<thead>\n<tr>\n<th>Condition<\/th>\n<th>Useful starting method<\/th>\n<th>Main strength<\/th>\n<th>Main risk<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Limited interaction data<\/td>\n<td>Rules, popularity and content-based retrieval<\/td>\n<td>Works before a dense behaviour history exists<\/td>\n<td>Can be generic or over-similar<\/td>\n<\/tr>\n<tr>\n<td>Rich user\u2013item interactions<\/td>\n<td>Collaborative filtering or matrix factorisation<\/td>\n<td>Finds latent taste patterns<\/td>\n<td>Cold start and popularity bias<\/td>\n<\/tr>\n<tr>\n<td>Large, fast-changing catalogue<\/td>\n<td>Multiple candidate generators plus learned ranking<\/td>\n<td>Balances scale and precision<\/td>\n<td>Operational complexity and retrieval blind spots<\/td>\n<\/tr>\n<tr>\n<td>Strict eligibility constraints<\/td>\n<td>Rule filter before retrieval and policy re-ranking<\/td>\n<td>Prevents unsuitable results<\/td>\n<td>Rules can become fragmented or stale<\/td>\n<\/tr>\n<tr>\n<td>Several competing outcomes<\/td>\n<td>Multi-objective ranking with explicit guardrails<\/td>\n<td>Makes trade-offs testable<\/td>\n<td>Weights can hide policy choices<\/td>\n<\/tr>\n<tr>\n<td>High-stakes decision support<\/td>\n<td>Conservative retrieval, explanations and human review<\/td>\n<td>Supports accountability<\/td>\n<td>Personalisation may be inappropriate for some decisions<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>A simple baseline should survive long enough to be beaten convincingly. Popular items within an eligible category, recent successful choices or a rule-based shortlist often create a strong reference. Compare any complex model against that baseline on outcome, robustness, cost and explainability.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Worked_example_recommending_professional_courses\"><\/span>Worked example: recommending professional courses<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Imagine a catalogue that recommends professional courses. The initial request is to \u201cshow people courses they will click\u201d. RANKED exposes the weakness of that objective. A click on an advanced course that the learner cannot use is not success. The team reframes the result as helping a visitor identify a relevant, feasible next course, measured by qualified enquiries and later enrolment, with guardrails for prerequisite fit, catalogue exposure and complaint rate.<\/p>\n<p>The audience and catalogue analysis records role, stated goal, experience, preferred location and schedule only when appropriately collected. Course records include topic, level, prerequisites, delivery locations and dates. Eligibility filters remove unavailable sessions and courses whose mandatory prerequisites are not met.<\/p>\n<p>For retrieval, the system combines three candidate sources: content similarity to the visitor\u2019s stated goal, popular courses within the relevant professional family, and courses related to recent voluntary browsing. A ranker estimates usefulness using those features, while re-ranking limits near-duplicates and adds some diversity across skills or dates.<\/p>\n<p>Offline evaluation uses time-ordered data and reports precision@5, catalogue coverage and results for new versus returning visitors. The online test measures qualified course enquiries, not clicks alone. It also monitors backtracking, unsuitable-course reports and concentration of exposure. New visitors receive a robust content-and-popularity fallback instead of a fabricated personal profile.<\/p>\n<p>This design is modest, but it is testable. It separates eligibility from prediction, includes a cold-start path and measures whether the recommendation helped someone make a better choice.<\/p>\n<figure class=\"wp-block-image alignnone size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1400\" height=\"900\" src=\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132730\/epw-recommendation-worked-example-pipeline.webp\" alt=\"Worked recommendation-system design from user goal and eligibility to ranking and outcome measurement\" class=\"wp-image-3231\" srcset=\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132730\/epw-recommendation-worked-example-pipeline.webp 1400w, https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132730\/epw-recommendation-worked-example-pipeline-300x193.webp 300w, https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132730\/epw-recommendation-worked-example-pipeline-1024x658.webp 1024w, https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132730\/epw-recommendation-worked-example-pipeline-768x494.webp 768w, https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/16132730\/epw-recommendation-worked-example-pipeline-150x95.webp 150w\" sizes=\"auto, (max-width: 1400px) 100vw, 1400px\" \/><figcaption class=\"wp-element-caption\">A practical recommender separates eligibility, candidate sources, scoring, re-ranking and outcome evaluation.<\/figcaption><\/figure>\n<h2><span class=\"ez-toc-section\" id=\"How_to_evaluate_recommendation_quality\"><\/span>How to evaluate recommendation quality<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Use a scorecard rather than a single headline number:<\/p>\n<ul>\n<li><strong>Relevance:<\/strong> precision@k, recall@k, NDCG or task-specific success.<\/li>\n<li><strong>Reach:<\/strong> user coverage, item coverage and performance for sparse-history cases.<\/li>\n<li><strong>Experience:<\/strong> diversity, novelty, repetition, latency and explicit dissatisfaction.<\/li>\n<li><strong>Outcome:<\/strong> completion, retained use, suitable purchase, qualified enquiry or another durable result.<\/li>\n<li><strong>Guardrails:<\/strong> returns, complaints, unsafe or ineligible exposure, subgroup disparities and excessive concentration.<\/li>\n<li><strong>Operations:<\/strong> feature freshness, empty candidate sets, fallback rate, service errors and cost per recommendation.<\/li>\n<\/ul>\n<p>Break metrics down by meaningful conditions: new and established users, new and established items, device type, region or catalogue segment. Aggregate gains can hide a system that improves for data-rich users while degrading for everyone else.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Cold_start_feedback_loops_and_responsible_control\"><\/span>Cold start, feedback loops and responsible control<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Cold start is not one problem. New users lack interaction history; new items lack exposure; a new platform lacks both. Use declared preferences, item metadata, contextual popularity and brief onboarding where proportionate. Exploration can gather evidence for new items, but it should be bounded by suitability and risk.<\/p>\n<p>Recommendation creates feedback. Items shown near the top gain interactions, which can make them more likely to be shown again. Monitor exposure as well as response, compare popularity-normalised measures and reserve controlled opportunities for suitable new or less-exposed items. Do not force diversity where it conflicts with safety or relevance; treat it as an explicit policy trade-off.<\/p>\n<p>Privacy also shapes design. Collect only signals needed for the stated purpose, explain personalisation where appropriate, respect user controls and set retention limits. Sensitive attributes should not be inferred casually. In higher-impact contexts, a recommendation may require explanations, appeal routes and human oversight\u2014or personalisation may be the wrong approach entirely.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Production-readiness_checklist\"><\/span>Production-readiness checklist<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ol>\n<li>Write the decision, primary outcome, time horizon and guardrail metrics.<\/li>\n<li>Define catalogue eligibility, availability and exclusion rules.<\/li>\n<li>Document each behavioural signal and plausible alternative interpretation.<\/li>\n<li>Log exposure, position, response and outcome with appropriate privacy controls.<\/li>\n<li>Build and retain a simple baseline.<\/li>\n<li>Measure candidate recall separately from ranking quality.<\/li>\n<li>Create explicit fallbacks for new users, new items and service failure.<\/li>\n<li>Use time-aware offline evaluation and prevent feature leakage.<\/li>\n<li>Test online with pre-agreed success, guardrail and stopping criteria.<\/li>\n<li>Monitor subgroup performance, catalogue concentration, latency and cost.<\/li>\n<li>Version features, models and policies; rehearse rollback.<\/li>\n<li>Assign owners for quality review, incidents and objective changes.<\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"Developing_recommendation-system_design_skills\"><\/span>Developing recommendation-system design skills<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Recommendation systems require a blend of problem framing, data interpretation, retrieval, ranking, experimentation and production governance. EPW\u2019s <a href=\"https:\/\/www.epw.com\/training\/recommendation-systems-design-optimization\">Recommendation Systems Design and Optimization course<\/a> covers collaborative and content-based methods, matrix factorisation, hybrid and context-aware approaches, evaluation, deployment, scalability and feedback-loop optimisation.<\/p>\n<p>The discipline also connects to wider organisational use of AI. EPW\u2019s guide to the <a href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/benefits-of-ai-and-machine-learning-for-organisations\">benefits of AI and machine learning for organisations<\/a> explains how to link model outputs to decisions, controls and measurable outcomes.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"Conclusion\"><\/span>Conclusion<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>Good recommendation system design aligns the ranked list with a useful decision. Start with the result and guardrails; understand the audience, catalogue and signals; keep retrieval, scoring and policy controls distinct; evaluate online as well as offline; and monitor the feedback the system creates.<\/p>\n<p>The RANKED framework makes those dependencies visible. It also makes a crucial point: a better prediction metric is not automatically a better recommendation. The system succeeds when it helps people make better choices while remaining relevant, resilient and accountable in production.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Use EPW\u2019s RANKED framework to design recommendation objectives, data, retrieval, ranking, evaluation and feedback controls for production systems.<\/p>\n","protected":false},"author":1,"featured_media":3668,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-2477","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence-machine-learning-articles"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Recommendation System Design: A Practical Guide<\/title>\n<meta name=\"description\" content=\"Design a recommendation system from objectives and candidate retrieval to ranking, evaluation, feedback controls and responsible production monitoring.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Recommendation System Design: A Practical Guide\" \/>\n<meta property=\"og:description\" content=\"Design a recommendation system from objectives and candidate retrieval to ranking, evaluation, feedback controls and responsible production monitoring.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\" \/>\n<meta property=\"og:site_name\" content=\"Blog Categories - EPW Training\" \/>\n<meta property=\"article:published_time\" content=\"2026-09-16T14:01:59+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-27T10:39:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"576\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"EPW Training Blog\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"EPW Training Blog\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"10 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\"},\"author\":{\"@type\":\"Organization\",\"name\":\"EPW Training Blog\",\"url\":\"https:\/\/www.epw.com\/blog\/\",\"@id\":\"https:\/\/www.epw.com\/blog\/#organization\"},\"headline\":\"Recommendation System Design: A Practical Guide from Objectives to Evaluation\",\"datePublished\":\"2026-09-16T14:01:59+00:00\",\"dateModified\":\"2026-09-27T10:39:16+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\"},\"wordCount\":1962,\"publisher\":{\"@id\":\"https:\/\/www.epw.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#primaryimage\"},\"thumbnailUrl\":\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp\",\"articleSection\":[\"Artificial Intelligence and Machine Learning Articles\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\",\"url\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\",\"name\":\"Recommendation System Design: A Practical Guide\",\"isPartOf\":{\"@id\":\"https:\/\/www.epw.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#primaryimage\"},\"thumbnailUrl\":\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp\",\"datePublished\":\"2026-09-16T14:01:59+00:00\",\"dateModified\":\"2026-09-27T10:39:16+00:00\",\"description\":\"Design a recommendation system from objectives and candidate retrieval to ranking, evaluation, feedback controls and responsible production monitoring.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#primaryimage\",\"url\":\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp\",\"contentUrl\":\"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp\",\"width\":1024,\"height\":576,\"caption\":\"Two data scientists at their workstations reviewing abstract charts while working on a recommendation system\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.epw.com\/blog\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Recommendation System Design: A Practical Guide from Objectives to Evaluation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.epw.com\/blog\/#website\",\"url\":\"https:\/\/www.epw.com\/blog\/\",\"name\":\"Blog Categories - EPW Training\",\"description\":\"Expert Insights and Updates in Professional Training\",\"publisher\":{\"@id\":\"https:\/\/www.epw.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.epw.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.epw.com\/blog\/#organization\",\"name\":\"Blog Categories - EPW Training\",\"url\":\"https:\/\/www.epw.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.epw.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.epw.com\/blog\/wp-content\/uploads\/2025\/08\/epw-training-blog-logo.png\",\"contentUrl\":\"https:\/\/www.epw.com\/blog\/wp-content\/uploads\/2025\/08\/epw-training-blog-logo.png\",\"width\":746,\"height\":256,\"caption\":\"Blog Categories - EPW Training\"},\"image\":{\"@id\":\"https:\/\/www.epw.com\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.epw.com\/blog\/#person\",\"name\":\"EPW Training Blog\",\"sameAs\":[\"https:\/\/www.epw.com\/blog\/\"],\"url\":\"https:\/\/www.epw.com\/blog\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Recommendation System Design: A Practical Guide","description":"Design a recommendation system from objectives and candidate retrieval to ranking, evaluation, feedback controls and responsible production monitoring.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide","og_locale":"en_US","og_type":"article","og_title":"Recommendation System Design: A Practical Guide","og_description":"Design a recommendation system from objectives and candidate retrieval to ranking, evaluation, feedback controls and responsible production monitoring.","og_url":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide","og_site_name":"Blog Categories - EPW Training","article_published_time":"2026-09-16T14:01:59+00:00","article_modified_time":"2026-09-27T10:39:16+00:00","og_image":[{"width":1024,"height":576,"url":"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp","type":"image\/webp"}],"author":"EPW Training Blog","twitter_card":"summary_large_image","twitter_misc":{"Written by":"EPW Training Blog","Est. reading time":"10 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#article","isPartOf":{"@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide"},"author":{"@type":"Organization","name":"EPW Training Blog","url":"https:\/\/www.epw.com\/blog\/","@id":"https:\/\/www.epw.com\/blog\/#organization"},"headline":"Recommendation System Design: A Practical Guide from Objectives to Evaluation","datePublished":"2026-09-16T14:01:59+00:00","dateModified":"2026-09-27T10:39:16+00:00","mainEntityOfPage":{"@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide"},"wordCount":1962,"publisher":{"@id":"https:\/\/www.epw.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#primaryimage"},"thumbnailUrl":"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp","articleSection":["Artificial Intelligence and Machine Learning Articles"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide","url":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide","name":"Recommendation System Design: A Practical Guide","isPartOf":{"@id":"https:\/\/www.epw.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#primaryimage"},"image":{"@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#primaryimage"},"thumbnailUrl":"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp","datePublished":"2026-09-16T14:01:59+00:00","dateModified":"2026-09-27T10:39:16+00:00","description":"Design a recommendation system from objectives and candidate retrieval to ranking, evaluation, feedback controls and responsible production monitoring.","breadcrumb":{"@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#primaryimage","url":"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp","contentUrl":"https:\/\/assets.epw.com\/blog\/wp-content\/uploads\/2026\/09\/27103748\/recommendation-system-design-guide-featured.webp","width":1024,"height":576,"caption":"Two data scientists at their workstations reviewing abstract charts while working on a recommendation system"},{"@type":"BreadcrumbList","@id":"https:\/\/www.epw.com\/blog\/artificial-intelligence-machine-learning-articles\/recommendation-system-design-guide#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.epw.com\/blog"},{"@type":"ListItem","position":2,"name":"Recommendation System Design: A Practical Guide from Objectives to Evaluation"}]},{"@type":"WebSite","@id":"https:\/\/www.epw.com\/blog\/#website","url":"https:\/\/www.epw.com\/blog\/","name":"Blog Categories - EPW Training","description":"Expert Insights and Updates in Professional Training","publisher":{"@id":"https:\/\/www.epw.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.epw.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.epw.com\/blog\/#organization","name":"Blog Categories - EPW Training","url":"https:\/\/www.epw.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.epw.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.epw.com\/blog\/wp-content\/uploads\/2025\/08\/epw-training-blog-logo.png","contentUrl":"https:\/\/www.epw.com\/blog\/wp-content\/uploads\/2025\/08\/epw-training-blog-logo.png","width":746,"height":256,"caption":"Blog Categories - EPW Training"},"image":{"@id":"https:\/\/www.epw.com\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.epw.com\/blog\/#person","name":"EPW Training Blog","sameAs":["https:\/\/www.epw.com\/blog\/"],"url":"https:\/\/www.epw.com\/blog\/"}]}},"_links":{"self":[{"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/posts\/2477","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/comments?post=2477"}],"version-history":[{"count":3,"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/posts\/2477\/revisions"}],"predecessor-version":[{"id":3669,"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/posts\/2477\/revisions\/3669"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/media\/3668"}],"wp:attachment":[{"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/media?parent=2477"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/categories?post=2477"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.epw.com\/blog\/wp-json\/wp\/v2\/tags?post=2477"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}