43: Adam Carmi: Applitools – Stress Free Automated Visual Validation Testing

Applitools – How to Create Reliable Visual Validation Tests

Test Automation is difficult. It’s even harder if you need to perform any sort of visual validations in your test script. It’s often easier and more reliable to make visual validation type test into manual tests. So how do you solve this pixel predicament?

If you have a “mission critical” or complex visual application that needs to have many visual elements tested, you should check out Applitools.

But where Applitools really shines is it’s ability to allow you to automate previously un-automatable tests and run them on a huge variety of web-browsers, devices and operating systems out there, regardless of the complexity of your applications.

With its sophisticated visual algorithm, Applitools makes visual validation easy and stress-free.

About Adam Carmi

AdamCarmiHeadshot

Adam started programming when he was eight and is passionate about all aspects of software development and testing. He is the Co-founder and VP R&D of Applitools – a company delivering a visual testing cloud service. He dedicates most of his time to developing image comparison algorithms and making large scale visual testing a reality.

Quotes & Insights from this Test Talk

  • Visual Software Testing is the process of validating the visual aspects of an application’s User Interface (UI). In addition to validating that the UI displays the correct content or data, Visual Testing focuses on validating the Layout and Appearance of each visual element of the UI and of the UI as a whole
  • With traditional functional testing, if you don’t assert it, it doesn’t get tested.
  • Stop doing regression testing and start doing progression testing.
  • Tools like UFT’s insight, Eggplant and Sikuli were designed to handle a different problem than visual validation.
  • Applitools was actually designed to validate full application pages and screens.
  • Applitools has put years of research and development into their image processing algorithms.
  • Applitools was developed from the ground up, specifically for visual validation.
  • Declaring validation points in Applitools is quick and easy. Best of all, it’s easy to update and change, making maintenance a breeze.
  • There are no visual processing settings, percentages or configurations that need to be set up in order to create visual testing with Applitools. The algorithm is completely adaptive.
  • With other visual tools, any small change to the pixels can cause scripts to fail. Applitools focuses only on the changes that a human can see, helping to reduce false failures.
  • Can handle rendering difference between different hardware and configurations like anti-aliasing, moving content on the page and image scaling.
  • Can easily tell tools’ regions to ignore things like dynamic data like dates, ads
  • Applitools allows you to automate visual validation tests that normally could only be done with manual testing
  • Can do full-page validation saving you from having to write hundreds of lines of assertions.
  • When you do full-page validation, you protect yourself from unexpected scenarios.
  • The simulation part of test automation is usually very easy, like navigating to a URL. The actual validation piece is the hard part, but Applitools makes validating the logic just as easy, if not more so, than the simulation piece.
  • Applitools works with any image, whether it’s from a web browser, mobile device or thick client application

Resources

Connect with{Name}

May I Ask You For a Favor?

Thanks again for listening to the show. If it has helped you in any way, shape or form, please share it using the social media buttons you see on the page.

Additionally, reviews for the podcast on iTunes are extremely helpful and greatly appreciated! They do matter in the rankings of the show and I read each and every one of them.
SauceLabsSponser

Special offer for TestTalks listeners, get 20 hours of automated testing for free when you sign-up with promo code testtalks14 (more info).

11comments
Applitools – How to Get Started with Visual Validation Testing | Joe Colantonio - Test Automation Selenium-UFT-QTP-SoapUI-ALM_LoadRunner and More! - March 11, 2015

[…] Adam Carmi is the co-founder of Applitools, a company that specializes in visual validation. Last week I was lucky enough to speak to him about visual validation testing on an episode of Test Talks. I think it was a great episode, and many of the things I touch on in this post you can listen to in detail in –> Episode 43 <–. […]

Reply
Nick P - March 14, 2015

Love the show! Another great episode! Thanks!!

Reply
VIDEO Applitools: Using Selenium and Maven with Applitools | Joe Colantonio - Test Automation Selenium-UFT-QTP-SoapUI-ALM_LoadRunner and More! - March 17, 2015

[…] recently interviewed Adam Carmi from Applitools on my TestTalks Podcast, and also created a blog post about visual validation testing, so I thought since we’re […]

Reply
How to Use Applitools Visual Validation with UFT | Joe Colantonio - Test Automation Selenium-UFT-QTP-SoapUI-ALM_LoadRunner and More! - March 27, 2015

[…] my last video I mentioned that I recently interviewed Adam Carmi from Applitools on my TestTalks Podcast, and showed how to use Applitools with Selenium, Java and […]

Reply
43: Adam Carmi: Applitools – Stress Free Automated Visual Validation Testing | Testing Podcast - May 28, 2015

[…] Show notes: 43: Adam Carmi: Applitools – Stress Free Automated Visual Validation Testing […]

Reply
Gary Fung - June 6, 2015

Great Podcast!! I was just curious what the future plans for Applitools would be? Perhaps integrate the tool with SauceLabs? Also how would this tool work with running concurrent test in parallel? Just a few questions I would have for Adam.

Reply
    Joe Colantonio - June 6, 2015

    Thanks Gary – I know that Applitools integrated with both SauceLabs and Browserstack and you can run your tests in parallel. Basically because Applitools is a cloud based solution as long as you have your API key specified in your test scripts you should be able to run anywhere. I can tell you that the folks at Applitools welcome emails with questions so don’t be shy to email Adam directly to ask about more info

    Reply
Be one of the first – see LeanFT and Applitools in action - Joe Colantonio - Succeeding with Test Automation Awesomeness. I’ll show you how! - July 9, 2015

[…] part of a FREE HP/Applitools webinar on Thursday, July 16th along with the creator of Applitools, Adam Carmi to demonstrate Advanced Cross-browser testing with Applitools Eyes and HP LeanFT that you need to […]

Reply
Praveen Hitnalli - December 10, 2015

Does the AppliTool support Linux platform ?
Is it possible to automate the UI of a device which piece of code is written in Linux platform ?

Reply
    Joe Colantonio - December 12, 2015

    Hi Praveen,

    Applitools Eyes is based on an innovative image processing algorithms that are technology independent and can run visual validations on all Operating Systems (including Windows, Mac OS and Linux), browsers, mobile devices and UI/UX technologies. (https://applitools.com/faq/)

    Reply
Click here to add a comment

Leave a comment: