Test Strategy
A test strategy is the shared set of decisions that directs how a team tests software. It connects product risks and delivery goals to the test work, evidence, and release decisions that matter.
itSoftware engineering | OpenSkills.info
Course pathWalk it in order
Look it upDip in anytime
Go furtherLeaves this page
Don't Panic
Don't Panic — Test Strategy
A test strategy is the agreement that stops a team responding to every software change with the ancient and expensive ritual of “run all the tests and hope the dashboard looks encouraging.” It decides what evidence a release needs, which failures matter most, and who can accept risk that refuses to be abolished on schedule.
The useful starting point is not a tool, a test case count, or a solemn spreadsheet. It is the release decision. Can someone recover an account safely? Can a migration preserve the ledger? Can an operator undo a deployment without turning the database into an archaeological site? Those questions point to product risks: failures that harm someone. Estimate likelihood and impact, then spend more attention where failure would cost more. This is risk-based testing, which is less mystical than it sounds and considerably more useful.
Evidence comes in different shapes. Test levels tell you where you look, from a component to the whole system and its integrations. Test types tell you which concern you examine, such as security, performance, or accessibility. Techniques tell you how to select or derive tests, including boundaries, decisions, states, branches, exploration, and reviews. One check can help with several questions. That does not mean one check should be asked to run the government.
Keep the paperwork species separate. The strategy is the lasting approach. A test plan applies it to a release or iteration. Test execution produces results, defects, coverage information, and residual risk, meaning the risk left after work is done. Mixing these layers produces a document that tries to be policy, schedule, and evidence at once. Such documents become very good at being found in old folders.
A controllable clock, representative data, a usable environment, and diagnostics can determine whether a failure is understandable. Automation is useful for stable, repeatable checks that repay maintenance cost. Exploration, reviews, and investigation remain useful where discovery and judgment matter.
Before work begins, state entry criteria: the preconditions that make testing meaningful. Before declaring completion, state exit criteria: the evidence required to make the release decision. A date can end a test period. It cannot prove quality, however confidently it arrives in a calendar invite.
Read the intro for the full map of strategy, plan, risks, and evidence. Use the slides for the chain from product goal to release decision, and the cheatsheet for the distinctions at hand. The practice reference turns the ideas into a planning sequence. The quiz checks vocabulary. The field notes cover operational habits that can make respectable-looking test evidence untrustworthy.
Where this skill leads
Relevant careers
See how this topic contributes to broader role-level skill maps.
Sources
- https://istqb.org/certifications/certified-tester-foundation-level-ctfl-v4-0/
Supports
- CTFL curriculum covers testing concepts, test levels and types, test analysis and design, test planning, risk management, reporting, and tools
- CTFL applies across Waterfall, Agile, DevOps, and Continuous Delivery approaches
- https://istqb.org/wp-content/uploads/2024/11/ISTQB_CTFL_Syllabus_v4.0.1.pdf
Supports
- Test planning defines objectives and selects an approach within context constraints
- Test-plan content includes risks, approach, levels, types, techniques, criteria, metrics, data, environments, budget, and schedule
- Risk level uses likelihood and impact; product risk analysis influences scope, levels, types, techniques, coverage, effort, and prioritization
- Risk-based testing selects, prioritizes, and manages activities using risk analysis and risk control
- Entry criteria are preconditions; exit criteria define completion conditions
- Test work products include plans, risk registers, criteria, results, and reports
- Testing activities can be iterative or parallel and must be tailored to the system and project
- https://committee.iso.org/sites/jtc1sc7/home/projects/flagship-standards/isoiecieee-29119-series.html
Supports
- The ISO/IEC/IEEE 29119 series defines internationally agreed software testing standards
- The series covers organizational, management, and dynamic test processes, documentation, and test techniques
- https://standards.ieee.org/ieee/C2/10779/
Supports
- IEEE/ISO/IEC 29119-1 specifies general testing concepts
- IEEE/ISO/IEC 29119-2 specifies processes for governing, managing, and implementing testing
- IEEE/ISO/IEC 29119-3 covers test documentation and IEEE/ISO/IEC 29119-4 covers test techniques
- https://github.com/TheJambo/awesome-testing
Supports
- Curated collection of testing software, extensions, and resources for the ecosystem links tab
- https://standards.ieee.org/ieee/829/1218/
Supports
- IEEE 829-1983 defined basic software test documentation
- IEEE 829-1998 superseded the 1983 edition and was published in December 1998
- https://standards.ieee.org/ieee/829/3787/
Supports
- IEEE 829-2008 linked documentation to test-process tasks and integrity levels
- IEEE 829-2008 was published in July 2008 and superseded the 1998 edition
- https://www.istqb.org/istqb-endorses-the-practical-tester-by-a4q/
Supports
- ISTQB was established in 2002
- https://www.iso.org/standard/56736.html
Supports
- ISO/IEC/IEEE 29119-2:2013 specified generic software test processes and was published in August 2013
- https://www.iso.org/standard/59444.html
Supports
- ISO/IEC/IEEE 29119-4:2015 covers test techniques
- https://www.iso.org/standard/79428.html
Supports
- ISO/IEC/IEEE 29119-2:2021 replaced the 2013 edition and was published in October 2021
- https://www.iso.org/standard/81291.html
Supports
- ISO/IEC/IEEE 29119-1:2022 replaced the 2013 edition and was published in January 2022
- https://testing.googleblog.com/2015/04/just-say-no-to-more-end-to-end-tests.html
Supports
- A useful test feedback loop is fast, reliable, and isolates failures
- Flaky tests reduce developer trust and can cause real failures to be ignored
- https://testing.googleblog.com/2021/03/test-flakiness-one-of-main-challenges.html
Supports
- Test flakiness can originate in tests, frameworks, systems, dependencies, operating systems, hardware, and networks
- https://www.testrail.com/platform/
Supports
- TestRail centralizes manual and automated test cases, runs, and reporting
- https://smartbear.com/product/zephyr/
Supports
- Zephyr manages test planning, execution, reporting, traceability, and automation inside Jira
- https://www.testmanagement.com/xray/
Supports
- Xray manages plans, specifications, executions, reporting, and Jira-native testing entities
- https://www.practitest.com/product/
Supports
- PractiTest supports manual, exploratory, automated, and behavior-driven testing with traceability
- https://www.qase.io/product/
Supports
- Qase records cases, runs, environments, builds, configurations, logs, defects, and reports
