To automate a system, you must be able to programmatically observe and control it. User-level test automation has traditionally involved developing mechanisms for observing the output of a computer monitor, and controlling input via a keyboard and mouse. However, today’s applications are available on a plethora of devices, including phones, tablets, smartwatches, game consoles, and televisions. Several of these devices can have customized forms of input and output, which adds to the complexity of testing and further complicates the automation process.
Join Etienne Deguine as he explains how you can leverage AI and with commodity hardware such as a Raspberry Pi (RPi) to create scalable automated solutions for device compatibility testing. The AI-RPi approach may be applied to any system that has a graphical user interface, high definition multimedia interface, and/or a universal serial bus (USB). By combining AI with screen or video capture and USB input emulation, you can test anything with a screen. The solution has even been applied to operating systems that don’t have an automation driver and is completely built on open source.
Etienne Deguine, 2021 Technical Presentation, Presentation