ProdPerfect Reviews

ProdPerfect was exactly what we needed as a small software business that did not want to hire a full time front-end QA engineer.

Onboarding was easy because their software automatically measured the user flow in our web app, which is then used to create test cases.

The ProdPerfect team created the test cases and got them up and running without very much input from me.

Once testing was operational, we held a highly effective weekly meeting series to discuss the system use, testing issues, and new test cases.

My finding is that we achieved more than we would have with a fulltime QA engineer, for about 50% of the price of a off-shore (relative to U.S.) engineer.

The ProdPerfect team has good handle on what is needed in the roadmap.

In general it would be ideal for the test execution cases to be run in parallel with no-dependency executions. This is something they have been working on but is not ready yet. Not having this feature means that testing of each case is done in series which takes more time and there are some reporting challenges with failures. For example the JavaScript environment is not aware of which test case is running, so the test case ID cannot be included in logging reports (e.g. Sentry)

My aim was to achieve frontend test coverage without hiring a full time QA engineer and I was able to do this with ProdPefect and the cost was about 50% of what a QA engineer would have cost.

Considering that comparison, the rest of the Continuous Integration system comes for free in the sense of having the hourly testing compute engaged + a pass/fail dashboard for viewing results.

ProdPerfect has helped our engineering team to move even faster. Our regression test coverage is now based on real usage patterns and regularly being updated and monitored and very well integrated with our CI/CD pipeline. We are able to run the entire test suite in any environment pretty easily and in a timely manner. If and when the tests fail, it is easy to debug and find the cause. The customer service and support from ProdPerfect is top notch.

In some rare instances, there are false alarms, but that is expected from automated tools. I'd rather have occasional false alarms than letting a defect or a bug go to production.

To move fast, allowing engineers to focus on writing good quality software and unit tests and deploying with a high level of confidence.

The continuous measuring of our product and the automatic creation and maintenance of E2E test cases as we build out new features is what we like the most about ProdPerfect. ProdPerfect has proven that they can find unexpected breaks in our integration environments before we deploy to production.

There are not many downsides to ProdPerfect. Depending on your needs, their test cases may rely on established user accounts and pre-existing data. This requirement may tie your tests to a specific pre-prepared test environment. ProdPerfect allows unlimited testing in any test environment, but you have to handle the environment duplication yourself. For us, this isn't a big deal, but we would love to run ProdPerfect in all of our test environments efficiently.

Building and maintaining an automated E2E front-end test system is a full-time job for at least one person, ideally more. We needed to keep our engineering costs down as much as possible, so ProdPerfect is a good fit

- It determines the tests to write by monitoring clicks and traffic, resulting in minimal setup effort from our end and effective paths to test.

- It fully writes and maintains the tests – entirely hands off from our engineering team.

- Tests are high quality and effective – has caught a few issues that would have affected major production workflows.

- We can put them in any place we want in our pipelines – we have complete control.

- Great support and communication from their team – professional, quick to respond, friendly.

- So, so much cheaper than doing it ourselves by either hiring QA or having engineers context switch to it.

- Not as much a dislike but it would be nice to have a bit more of a complete dashboard to look at test performance over time and related metrics.

We've found it to be very low maintenance, low cost, and high quality. It's shocking that no other service like this exists already, and their execution of it is top notch.

Problems: having a cost-effective way to have a last line of defense between our unit tests and production – occasionally unit tests will miss something bigger picture. Hiring QA or having engineers maintain and write tests would be expensive.

Benefits realized: exactly that!

Our developers no longer need to write and maintain the end-to-end tests that made them less efficient. Additionally, the e2e tests from ProdPerfect are better and cover more cases, and they're updated more quickly. Much better than doing it ourselves.

Test updating on weekends/after hours does not happen, so you sometimes get stuck not being able to merge on the weekends if you have changes to interface.

The primary problem we are solving is code quality and speed of high-quality software development. By having good end-to-end tests, we identify potential problems with new code before it is merged/can be released, and we catch it at the point that the developer who wrote it can quickly identify and fix it. (As opposed to waiting until it's merged, and then having a developer who may not have written it try to find it/figure it out).

With nearly no effort we were able to get end-2-end frontend testing up and running for our application. Straight from the beginning it helped us to detect regressions and the whole test-suite keeps up-to-date with our development without any effort from our dev team - coordinating through our QA team is enough...

We needed to install a tiny tracking snippet in our application which was a bit challenging to align with our privacy regulations, but finally we managed to do...

it reduced our internal QA effort and increased the overall product quality

We use Prodperfect as part of our CI/CD pipeline - we use it as a stop-gap to guard our production environment, prior to deploying we run the prod perfect test suite - if it fails (meaning we did something wrong in our application code) then the deploy to production never happens.

This gives us an extremely high level of confidence that we can develop and deploy safely to our users

Honestly nothing - the team is great, they don't sell you a product - they form a partnership with you and in the tech space there are so many people trying to sell you so many things - this is a refreshing benefit of working with them

Just do it. It's worth it.

Deploying successfully with a high level of confidence that we have not disrupted new or existing functionality

I love the communication and explanation from ProdPerfect. Whenever I have a question, it is answered in a timely fashion.

I don't like any part of ProdPerfect. If I ever have any questions, they are answered immediately.

Ask any questions when you do not understand, they are very good at explaining.

ProdPerfect is automating some of our manual regression tests, allowing us to focus on new areas of concern.

It's simple conceivable to arrange worksheets in the primary dashboard into seconds - we keep an ideal review of continuous cycles and arrangements we are arranging. Answering to representatives works consummately.

The tests are helpful, however on the off chance that you have customers in various nations you regularly have the issue to have a few reports deciphered in numerous parts yet a few reports are simply in english.

We are saving opportunity to chip away at datasheets and are lessening time - clients uphold causes us to stay up with the latest and we are attempting to look behind the relative expenses for the end-client.

ProdPerfect allows me to focus on the things that make a difference in the marketplace for my company and pay minimum attention to things that don't. I get paid to ship new features, not to chase stuff we just broke in existing features. ProdPerfect automates the decision about what to focus regression on, then deals with the regression itself.

No user interface. We have a broad range of technologies and rely on centralized dashboards like Codacy to see across the entire product.

What do you want to spend your time on and become expert at, shipping great new features, or not breaking old features?

The main problem we're solving is with hiring and paying someone internally to write and maintain robust UI regression tests. We estimate that, in our small company, we've dodged one FTE using ProdPerfect.