Solution Evaluation
Solution evaluation checks whether an implemented solution delivers the intended value, identifies what limits its performance, and supports a decision to improve, replace, retire, or leave it unchanged.
itEngineering leadership and delivery management | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic - Solution Evaluation
Solution Evaluation is the subject of this course. A solution is not successful because a team delivered it. It is successful when people use it and the organization receives enough value from it.
The useful unit of work is a closed loop: clarify the goal and boundaries, gather the inputs the practice requires, make the decision or change, record evidence, and return with owners for the next cycle. Skipping any link leaves teams busy without durable results.
Tooling supports the loop; it does not replace it. Choose tools after the boundary and evidence model are clear. Comparing products without that model produces feature matrices that do not change how the work runs.
Common failure modes include undefined ownership, metrics that count activity instead of outcomes, and irreversible steps taken without a review path. Treat those as design defects in the practice, not as individual heroics to compensate later.
Operators should be able to explain which signals would change a decision this week. If no signal can change the plan, the practice has become ritual. Keep the feedback path short enough that evidence still influences the next cycle.
Name the owners for each stage of the loop before the work scales. Unowned stages become permanent exceptions. Record decisions with enough context that a future operator can tell why a tradeoff was accepted. Prefer fewer, sharper metrics that change behavior over broad dashboards that only describe activity after the fact.
Read the Intro for the core model. Use the Cheatsheet when you need the operating map. Updates tracks official guidance when this course configures an update source; otherwise the practice is settled without a live feed.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://www.iiba.org/knowledgehub/the-business-analysis-standard/5-applying-business-analysis-tasks/5-3-business-analysis-knowledge-areas/solution-evaluation/
Supports
- Solution Evaluation as assessment of solution performance, value, and limitations
- The five-task structure from performance measurement through recommended actions
- https://www.iiba.org/contentassets/4f55f935d21a4075a66cab84ed5684b4/all-task-cards-solution-evaluation.pdf
Supports
- Purposes, inputs, outputs, stakeholders, and techniques for all five Solution Evaluation tasks
- Distinction between solution limitations and enterprise limitations
- Recommendations to remove, improve, replace, retire, or take no action
- Use of acceptance criteria, metrics and KPIs, observation, root cause analysis, process analysis, financial analysis, prioritization, and risk analysis
- https://www.iiba.org/globalassets/standards-and-resources/core-standard/iiba-core-standard.pdf
Supports
- Performance measures and analysis in relation to solution value
- Solution limitations, enterprise limitations, and recommended actions
- Potential value and actual value as the basis for recommendations
- https://www.pmi.org/learning/thought-leadership/series/benefits-realization/benefits-realization-management-framework
Supports
- Benefits realization as identification and strategic alignment of benefits
- Identification, delivery, and sustained realization of expected benefits
- https://www.iso.org/standard/78176.html
Supports
- Product quality model for ICT and software products
- Nine product quality characteristics and their use in specification, evaluation, acceptance criteria, testing objectives, and quality measurement
- Current published edition and lifecycle status
- https://www.gov.uk/government/publications/the-magenta-book/magenta-book-central-government-guidance-on-evaluation-html
Supports
- Evaluation as systematic assessment of design, implementation, and outcomes
- Evaluation before, during, and after implementation
- Process, impact, and value-for-money evaluation questions
- Early planning for baseline, comparison, data access, collection, and triangulation
- Monitoring of inputs, activities, outputs, and outcomes
- Need to test data quality, context, unintended outcomes, and different affected groups
- https://www.gov.uk/government/publications/the-magenta-book/quality-in-policy-impact-evaluation-qpie-html
Supports
- Distinction between observed outcome change and attribution
- Role of a counterfactual in judging whether an intervention caused an outcome
- Proportionate choice of impact-evaluation design
- https://github.com/sindresorhus/awesome
Supports
- Discovery route to the curated Awesome Product Management list
- https://github.com/dend/awesome-product-management
Supports
- Curation of Productboard, Screeb, and Tability as relevant product-management tools
- Tool categories for feedback, user research, and outcome tracking
- https://support.productboard.com/hc/en-us/articles/26907498937235-Quick-start-guide-Feedback
Supports
- Productboard insights boards for collecting, organizing, analyzing, and processing feedback
- Linking highlighted feedback to product entities
- https://help.screeb.app/en/
Supports
- Screeb user feedback through in-app surveys and targeted questions
- Official learner documentation for deploying and using feedback features
- https://guides.tability.io/docs/about-tability/how-does-tability-work
Supports
- Measurable outcomes, owners, and recurring check-ins
- Tracking progress, confidence, analysis, and changes over time
