Mozmill is not just another testing tool inside the automated testing framework provided by Mozilla. Instead it offers possibilities other test suites cannot fulfill. At the first glance it's really important to note that no dependencies to test enabled builds exist. That means there is no need to create a test enabled Firefox build on its own. But any official build whether if its a release or a nightly build will work out-of-the box. The installation of Mozmill has to be done only once. Afterward each build on the local system can be used to run the existing Mozmill tests immediately.
Installation of Mozmill
There are two different ways in using Mozmill to run tests within Firefox. First for new users the Mozmill add-on might be useful. While it makes it easy to play around with Mozmill and run the first tests it also offers an integreated development environment (IDE) to create, run, and debug tests. But there are limitations like the missing feature to run restart tests or reporting to a couchdb server. To get that functionality the command line client has to be installed instead.
Mozmill Test Automation
Running functional tests with Mozmill in an automated manner is a great assistance for mozQA. In the past all those tests which are located on Litmus had to be run manually. Seeing a still increasing number of manual tests it takes longer for mozQA to run all the needed tests against release candidates or nightly builds of Firefox. The way Mozmill operates can help us to automate nearly all of those tests and let them run on all platforms and across localized builds.
To handle all the work, which has to happen to have a fully automated Mozmill test suite available, the Mozmill Test Automation project has been created. Head over to the project page and see which sub-projects we are working on and how the work is coordinated.
In the following we will give tips and tricks in using Mozmill to run our existent Mozmill tests against Firefox and how you can contribute to the project by creating new or fixing broken tests. All the information you will need to start helping out can be found below.