TestRail

If you are executing manual test cases on a large scale then Test Rail is for you

Comments: Having using various test management suites TestRail does excel in that it was built to run manual test cases and display results in an easy glance for the whole team. Linking to defects is simple, generating a report when the test run is complete. I feel like reusing regression suites could be improved, it does what it is meant to however you have to repeat several steps each time you want to generate a regression suite.
Some areas for improvement would be a test case type for API tests, I am sure everyone needs this but struggles to find a way to record this data.

Pros:

I think report generation is the strong suit of Test rail, the percentage pie chart of passed, failed blocked cases at a glance make daily reporting for scrum stand up meetings ideal. Integration with Jira is excellent, although some room for improvement.

Cons:

Trying to do something simple like import test case steps from a .csv is not so easy. You can import a suite but that is not ideal. Trying to duplicate cases can be tedious, let's say you have a lot of cases, trying to copy paste them in to various projects is a lot of hassle, it is surprising they have not addressed issues like this after so many years.

Quality Assured

Comments: TestRail was a huge step up from our previous process which was a Google Sheet.

Pros:

It helps our QA team with managing regression testing between multiple remote QA engineers. Adding new test cases is easy, and being able to go back and see who tested each case is extremely valuable.

Cons:

Getting all of our test cases moved over to TestRail was a huge undertaking, but once done, maintaining has been easy.

Unfortunately, disappointing experience.

Comments: When I started to use it it was a relatively good test management tool, but in the second year it turned into a day-to-day struggle, I was wasting a lot of time writing and editing test cases - one of the key job characteristics of the QA. It's important to mention that I am not using TestRail for almost two years, and I hope the things got better. But honestly, I wouldn't risk to go back again.

Pros:

The test suites and test case structure were good and easy to navigate.

Cons:

The small tiny bugs that appeared every day and bothered our work. Things like the inability to open a screenshot in full-screen with 1 click.. To do that I had to open it on a new browser tab which was very annoying. And plenty of other similar issues that were arising day by day. This was the reason for switching to another test management system.

Everything we needed at half the cost

Comments: We are better able to track our software testing and coverage with this tool.

Pros:

I love the way they setup billing, every month you it automatically detects how many active users you have and you pay for that instead of being roped into a set amount of licenses. This has been incredibly helpful as we've gone through hiring, layoffs, and bringing on offshore contracted workers. Great flexibility! Another thing I like a lot are the UI Scripts, where you can customize the instance adding in or removing features and functionality. They are very powerful and super useful for us.

Cons:

It bugs me that every time you close a test run the test case id numbers have a huge spike, a case we created today had the id number of over 11 million even though we have less than 50,000 cases total in our library. I also do not like the way you add and remove tests from a run. It is a bit awkward and hard to see exactly what tests you're adding and removing.

Testcase Management

Comments: We enjoy using this tool because it takes little time to train new members and easy of using. SImple and faster.

Pros:

Ease of use. Simple and intuitive flow for the workflows that can be customized based on your work.

Cons:

Traceability is based on how you configure. Little confusing if you try to explain to users not familiar with the tool.

Alternatives Considered: Zephyr

Reasons for Choosing TestRail: Ease of use and less maintenance work. No need to worry about managing the infrastructure and secure.

Switched From: Rally Platform