March 2019 Mozilla Iris Report

About this Report

This is a report on the progress made in the Mozilla Iris project through March 2019.

Mozilla Iris is a new test framework developed by Mozilla’s Product Integrity group. Unlike other automated test frameworks, Iris aims to visually validate user interaction thereby freeing up manual testers from completing the mundane but very necessary tasks performed each and every product release.

Mozilla Iris running on MacOS

You can find out more by visiting the Mozilla Iris page on Github, dropping by the #qa-automation channel on Slack or by emailing us at iris@mozilla.com.

Project Stats

Iris 1.0 Development Statistics, March 2019
Iris 2.0 Development Statistics, March 2019

Key Accomplishments

  • Fixed several issues that were blocking Release QA from running Iris update tests
  • Delivered a Testrail Best Practices guide to streamline workflow from and to Iris
  • Expanded test coverage for Bookmarking in Firefox
By the NumbersChange
vs Feb
Change
vs Nov
24 Contributors-20%+118%
324 Commits to master+77%+153%
14,431 net new lines of code+54%-63%
204 issues resolved including:
115 new tests, 85 bug fixes, and 4 enhancements
+98%+218%

What’s Next

In April the Iris 2.0 team continues to drive hard refactoring Python 3 while the Iris 1.0 team continues to add more tests in its goal to achieve near-100% coverage of manual tests in Testrail. We will continue working through issues and making improvements to Release QA’s deployment in our goal to achieve full deployment for Firefox Beta on Desktop before the end of June.