High speed script execution for GUI automation using computer vision

M. Narayana (Vardhaman College of Engineering)
Raghu Ram Reddy (Jayaprakash Narayan College of Engineering)
Hyndavi Reddy N. (Vardhaman College of Engineering)

International Journal of Electrical and Computer Engineering
Vol 9, No 1: February 2019

Software testing by using open source tool like Selenium windows applications cannot be automated, citrix based applications, flash websites and games. Computer vision based automation tools can be used to automate these kinds of applications.  These automation tools works based on screenshots of GUI objects like button, radio button, text box, images, dropdowns etc. In this paper a prototype of automation tool has been developed which can execute the automation scripts much faster than existing tools like Sikuli, which takes much time to run the Automation scripts. The execution time can be reduced by using this proposed tool.