The scoreboard, and what is not on it. The hard targets, how often each is actually
looked at, and the quiet signals that never reach a dashboard.
Defect Escape Rate
The number of critical or major bugs that slip through into production after your workstream has been signed off.
Target · Less than 0.5% for critical bugs; less than 2% for major bugs. If your feature had 100 bugs found in testing and 1 critical bug was found in production post-release, that's a 1% escape rate for criticals – we'd want to understand why.
Test Automation Coverage (for your workstream)
The percentage of your assigned feature's test cases that are covered by stable, automated tests (UI and API).
Target · Increase coverage by at least 10% per quarter, aiming for 70%+ for critical paths. If your feature's critical paths had 50 manual test cases, you'd aim to automate 5 more per quarter, bringing the total automated to 35 (70%) in a few months.
Test Plan Coverage
How thoroughly your test plans cover all acceptance criteria and identified risks for a given feature.
Target · 100% coverage of all explicit acceptance criteria; 80%+ coverage of identified edge cases and negative scenarios. For a new user registration flow, you'd ensure tests exist for valid inputs, invalid emails, existing users, network errors, and different device types.
Regression Suite Runtime Contribution
Your contribution to optimising the regression suite, making it faster and more efficient without losing coverage.
Target · Reduce the runtime of your owned test suites by 15% through parallelisation or targeted test selection. You might identify a slow-running set of tests, refactor them, or propose splitting them into parallel jobs, cutting 10 minutes off the overall run time.
Bug Report Quality & Triage Leadership
Your bug reports are consistently clear, concise, and actionable, requiring minimal back-and-forth. You also effectively lead bug triage discussions, helping the team prioritise.
- Developers rarely ask for clarification on your bugs. You successfully guide triage meetings, ensuring bugs are understood and prioritised. Feedback from Product and Dev teams often highlights your clarity and thoroughness.
Mentorship Effectiveness
You effectively guide and support junior QA Testers, helping them grow their skills and navigate challenges.
- Junior team members seek your advice and feedback. They show measurable improvement in their test design, bug reporting, and automation skills. You're seen as a helpful, approachable resource.
Proactive Issue Identification & Prevention
You don't just find bugs; you anticipate potential problems, question requirements, and suggest improvements to prevent issues before they even become code.
- You're often involved in early design discussions, pointing out potential pitfalls. Your suggestions lead to changes in requirements or design that avoid future bugs. You're seen as a 'shift-left' advocate.
Test Strategy & Design Impact
Your ability to design robust, efficient, and comprehensive test strategies for complex features, considering various risks and scenarios.
- Your test plans are consistently well-received and adopted by the team. You introduce new testing techniques (e.g., specific exploratory testing charters) that uncover unique bugs. You get positive feedback on your approach from your Lead QA.