January 2019 Mozilla Iris Report

About this Report

This is a report on the progress made in the Mozilla Iris project through January 2019.

Mozilla Iris is a new test framework developed by Mozilla’s Product Integrity group. Unlike other automated test frameworks, Iris aims to visually validate user interaction thereby freeing up manual testers from completing the mundane but very necessary tasks performed each and every product release.

Mozilla Iris running on MacOS

You can find out more by visiting the Mozilla Iris page on Github, dropping by the #qa-automation channel on Slack or by emailing us at iris@mozilla.com.

Project Stats

Iris 1.0 stats for January 2019
Iris 2.0 stats for January 2019

Key Accomplishments

  • Added support for tests to scroll until a pattern has been found
  • Improved pattern search precision to mitigate intermittent failures
  • By the numbers:
    • 28 contributors (+33% since last month)
    • 455 commits (+27% since last month)
    • 2,243 net lines of code added (-93% since last month)
    • 74 issues resolved including 50 new tests, 10 fixes, and 3 enhancements

What’s Next

In February Iris 2.0 work continues, as does finalizing the control centre redesign and adding more tests as we aim for 100% suitable test coverage for Beta by April. Deployment of Iris 1.0 to Release QA is on-going with a focus on resolving issues in the Update tests and setting up infrastructure for the functional tests.