UI.Vision RPA

The combination of classic browser automation, modern computer vision, and OCR makes Ui.Vision, an open-source software, a strong tool for automating web and desktop apps. Ui.Vision blends three robotic process automation (RPA) tools into one:

(1) **Visual Browser Automation and UI Testing**

Ui.Vision's visual UI testing commands assist web designers and developers in checking and ensuring the accuracy of website layouts and canvas elements. It can identify and read images and text within canvas elements, images, and videos.

Ui.Vision also adjusts the browser window size to simulate different screen resolutions. This feature is useful for testing layouts on various browser resolutions and ensuring the visual quality of mobile, web, and native apps.

(2) **Visual Desktop Automation for Windows, Mac, and Linux**

Beyond web browser automation, Ui.Vision uses image and text recognition to automate browser extensions and desktop environments as well. It can interpret images and text on the desktop, executing actions like clicking, moving, dragging and dropping the mouse, and simulating keyboard inputs.

This desktop automation requires installing the free Ui.Vision XModules, available for Windows, Mac, and Linux. These modules provide Ui.Vision with the necessary capabilities for desktop interaction.

(3) **Selenium IDE compatible commands**

Ui.Vision includes Selenium commands for web automation, testing, form filling, and web scraping. Learning Ui.Vision also means learning Selenium, and vice versa. However, Ui.Vision differs in philosophy from the classic Selenium IDE. It acts as a record and replay tool for automated testing and as a versatile tool for web automation tasks like screen scraping, file uploads, and autofill form filling. Ui.Vision offers many features not available in the classic IDE. For example, you can run macros directly from the browser or embed them on your website for repetitive tasks.

Ui.Vision offers features not found in the classic Selenium IDE, including writing and reading CSV files (data-driven testing), visual checks for UI testing, image comparison, file download automation, OCR screen scraping, PDF testing, and capturing full web page and desktop screenshots.

**Command Line API**

Ui.Vision provides a detailed command line API for integration with other applications, often used with Jenkins, CI/CD tools, or the Windows task scheduler. It can be automated and controlled using any programming or scripting language, such as Python or PowerShell.

**Happy Automating!**

For questions and suggestions, the active Ui.Vision RPA software community forum is available at https://forum.ui.vision.