Show And Tell: Sikuli - Pattern-Matching and Automation
A truly unusual technology - the power of machine learning for automating unusual stuff
Description
SikuliX is very unusual - a scripting/automation technology that relies on pattern matching, and is available for use via Python or Java. Developed at the User Interface Design Group at MIT, is a powerful and easy-to-use technology that uses image recognition to automate just about anything that appears on-screen.
Sikuli is rather hard to slot - it offers all of the functionality of an automation or scripting tool, but it also offers some powerful and very novel image-matching functionality for truly novel use-cases that revolve around image search. In addition it has an OCR-mode, in which image matches are performed after converting those image patterns to text. This gives rise to some pretty new applications.
The OCR-functionality is powered by Tesseract, an open-source optical character recognition engine whose development is sponsored by Google.
What You Will Learn!
- Automate data-pulls from sites and sources that block other scripting tools
- Generate alerts based on Facebook/Skype and other hard-to-detect events
- Search large PDFs for images that "look like" the one you are searching for
Who Should Attend!
- Yep! Automation testers and folks look to automate repetitive tasks
- Yep! Data professionals looking to extract hard-to-pull data
- Yep! Business professionals looking to dynamically update models they've built