When Humans Tested Software

In this retrospective journey, Jason explores the bygone era of human-first software testing, a time before artificial intelligence (AI) dominated software testing and quality assessments Reflecting on traditional human-based testing methodologies, this talk contrasts the historical landscape where human expertise, and labor, were the driving force, with modern AI-dominated software testing. Delving into the past, Jason reminisces on the manual and automated testing paradigms that once formed the backbone of software development. Jason highlights the challenges and limitations that testers once faced, such as time-consuming manual processes, the high potential for human error, and the difficulty in keeping pace with rapid development cycles. As the narrative progresses, Jason revisits the pivotal moments when AI began to intersect with testing, initially supporting human efforts before quickly outpacing them in efficiency, accuracy, and scope.

Jason Arbon

Jason Arbon is the CEO of Checkie.AI, where his mission is to test the world's apps. Google’s AI investment arm led the funding for his previous company (test.ai). Jason previously worked on several large-scale products: web search at Google and Bing, the web browsers Chrome and Internet Explorer, operating systems such as WindowsCE and ChromeOS, and crowd-sourced testing infrastructure and data at uTest.com. Jason has also co-authored two-books How Google Tests Software and App Quality: Secrets for Agile App Teams.