Imagine you are in a scenario where there are lots of incidents, delivery is slow and customers are not happy with the quality of your products or you are promoted/hired as Head of QA where QA department doesn’t exist yet.
Step 1: Investigate
The first step is to hold independent interviews with multiple team members to understand the problem at hand.
I would recommend asking open-ended questions like:
– What is the reason in your view for the incidents and customer complaints?
– How would you describe the culture?
If asking questions outside the QA team:
– How would you describe the QA approach?
– How do you collaborate with the QA team?
Once the inspector gadget phase is over, we must now digest the information. I would recommend independent chats or surveys with QA, product, engineering, delivery, and customers (if possible). These chats should not be biased in any way and it should be shared by the interviewee that chats are confidential, with no names or details being shared outwards.
Step 2: Data analysis
Based on the data gathered, this data should be analyzed to then decide where to focus your attention.
For example, in my experience data can be generally focused on the following:
– Cultural issues.
– Lack of ‘Assurance’.
– Poor product knowledge.
– Lack of collaboration between Product, Engineering, and QA.
Step 3: What to do?
The next aspect is to decide what to do. I will explain some examples of what I did for each scenario, with additional examples.
– Cultural issues.
a. Poor work-life balance: Start to track hours worked and establish why working hours are so long. People MUST have a work-life balance. In the past, this has been due to poor estimation in sprints and also the fact that a change in mindset is needed by senior management.
b. People are not developing: People MUST be developing, a successful company is built around its people. I would recommend ensuring that there is a career development plan in place for each member and also ensuring there are training services available via the learning and development team.
– Lack of assurance.
This generally can be a standard issue across most companies. Yes, we want to work in an agile way and release at pace, but at the same time, we must have some of the basics in place so that we know that we are testing the right things. If the basics are not in place it generally will lead to incidents and customer complaints. Key assurance documents that I would recommend:
a. QA strategy – aligned to your technology strategy, what are you testing and why?
b. Testing approach – what is your particular approach to testing on a particular project/squad?
c. General overview on what you are testing and why? At least then you can then collaborate with engineering, product, and stakeholders to review gaps in your test cases.
– Poor product knowledge.
In this case, without a great relationship with the product team it may mean that we are testing the wrong aspects, also that incidents/customer issues are increasing – which is bad! How can you improve your product knowledge:
a. Get the product team to review and contribute to the test coverage in the test cases.
b. Get the product team to review and contribute to the acceptance criteria on tickets.
c. Meet regularly with the product team and ensure that product knowledge is shared/updated.
– Poor collaboration with Product and Engineering.
This is a complex one, though firstly there should be a walkthrough between QA and Engineering once the code has been developed (shift left). From a product perspective, they should be reviewing test cases and sharing gaps in the test cases.
Step 4 – How do we maintain success?
We should track whether our mitigating measures have made a difference or not. Going back to our problem statement, we wanted to see whether we can reduce customer incidents and also customer complaints.
I would recommend a full post-mortem review as learning when incidents take place and reviewing whether the incident amount is going down. If they are not, do another review independently to establish the root of the issues. Tracking success can only be done if we start to track certain metrics.
Aspects that I have found useful to track:
a. Escaped defects.
b. Customer complaints.
c. Test cases that have been added to your regression suite every sprint.
d. Unit test coverage.
e. Number of times a ticket is re-tested and defects found against it.
Conclusion
Quality assurance transformation is a journey piece, and by tracking QA metrics, step-wise improvements can be achieved. Success cannot be maintained solely by QA, rather it is a collaborative effort with QA, Engineering, product, and the wider team.
Original article: https://www.lambdatest.com/blog/qa-transformation-journey/