Jason Arbon, test.ai
How do you test all the world’s apps? Over 10 million mobile apps and about 5 billion web pages need testing. Test automation efforts are currently aimed at just one or a handful of applications at most. The majority of these apps and test cases are eerily similar — yet each app team reinvents and re-implements the same test cases from scratch.
Building test automation that executes on all apps, is a major undertaking and requires rethinking every aspect of test automation. Three major problems needed to be solved to test at this scale:
- Reuse of test artifacts and test logic
- Reliable test execution
- Unique ways to correlate and report on the test results.
Arbon explains how AI and machine learning, along with unique test infrastructure deployments and benchmarked quality reporting make this possible. Most importantly, testing at this scale has dramatic implications for app teams, software testers, and the quantification of quality itself.
See what testing at full scale looks like, and apply those lessons to your own test automation and infrastructure.
Jason Arbon, 2018 Technical Presentation, Abstract, Slides