QA Wolf

BACKGROUND

Please describe your company and position.

I am the Senior Director of Engineering of an automotive retailing software company.

Describe what your company does in a single sentence.

Digital retailing software for the automotive industry.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Reduce time to release.
• Bring up automated regression coverage.
• Give time back to our QA team.
• Increase confidence in the quality of our releases.

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Great culture fit
• Good value for cost
• Referred to me

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QAWolf built a suite of regression tests that runs daily, before every release, and on demand. They also maintain the existing tests regularly as the application evolves. They work closely with our Engineering and QA teams to understand the scope of changes and new features, how they ought to be tested, what our expectations are and what priorities we have for our automated tests.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

The main measurable outcome was the massive reduction in our time to release: from a week due to manual regression testing of every release, down to an hour thanks to the automatic suite running multiple tests concurrently and reporting all findings in an easy to consume format to decide what is a blocker, what is known, and what is of minor importance.

Without the burden of manual testing, our QA team is now free to build and maintain our test cases, ensure that new features are built to spec, find inconsistencies in implementation; in short, they now have time to go about their other responsibilities.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QAWolf delivered the 80% coverage in the promised timeline, and that is despite our shortcomings in terms of environment stability, and the quality and thoroughness of our test cases. They took charge of their task and helped guide us to provide them with the most important requirements they needed from us.

As a side effect, we now have a much better idea of internal issues we have to resolve in our testing environments. As for the response to our needs, the QAWolf team is always around and they make sure to communicate to each other whenever we send a request or have a question. We always get an answer within the day. The relationship is friendly, casual, unobstructed by procedures and delays, and extremely effective.

What was your primary form of communication with QA Wolf?

Virtual Meeting

What did you find most impressive or unique about this company?

Besides the fact that they did indeed deliver the 80% coverage in the time they promised, I am always impressed by their responsiveness; their thoroughness in triaging findings from test runs; their eye for details; their willingness to hear about rough edges in the platform and ability to sand them down quickly; their openness about their roadmap and plans and how they could benefit us; their autonomy in finding the answers they need to unblock their work.

Are there any areas for improvement or something QA Wolf could have done differently?

Nothing that I can think of. As I mentioned before, whenever I have found an inconvenience with the platform, the tooling or the process, it has been very easy to just talk about it with QA Wolf and find a solution.