Short answer: AI can do a lot of the repetitive work in QA, but it does not replace people who understand your product and your risk. Here is what AI does well, where it falls short, and how teams combine the two.
What AI can do well in QA
- Draft test cases from requirements, user stories or an existing application.
- Write and update automation scripts, for example in Playwright, faster than writing every line by hand.
- Analyse failures by grouping similar failed tests and pointing to likely causes.
- Help maintain tests when a page changes, so fewer scripts break for trivial reasons.
- Generate test data and edge-case ideas that a person might overlook.
What AI cannot replace
- Judgement about risk: deciding what matters most to your users and your business.
- Exploratory testing: a skilled tester noticing that something feels wrong.
- Understanding context: regulations, edge cases in your industry, and what a customer actually expects.
- Accountability: someone has to review AI-written tests. Generated tests can be wrong or can pass while checking the wrong thing.
Testing products that use AI
If your product includes AI features, it needs testing too: accuracy, consistent behaviour, unsafe or biased answers, and how it fails. These features behave differently from ordinary software, so they need extra test design.
The approach that works: AI plus human QA
- Use AI to produce first drafts of test cases and scripts.
- Have a QA engineer review, correct and prioritise everything before it enters your pipeline.
- Run the automated tests on every build, and keep humans on exploratory and high-risk testing.
- Measure the result: time saved, bugs found earlier, fewer failures in production.
How Stelo Technology uses AI
Our engineers pair Claude with Playwright: Claude helps design test cases and analyse failures, and Playwright runs them across browsers. Every generated test is reviewed by a QA engineer. See our AI-powered QA testing page for details.
Want to see it on your own product? Start a risk-free 2-week QA trial with Stelo Technology. We reply within 24 hours.