[NEW} Added build status updates - Usability improvements for Firefox automation initiative - Status update #6

Armen Zambrano G. armenzg at mozilla.com
Wed Sep 28 17:27:17 UTC 2016


[NEW] Starting on this newsletter we will start giving you build 
automation improvements since they help with the end to end time of your 
pushes.

On this update we will look at the progress made in the last two weeks.

A reminder that this quarter’s main focus is on:
* Debugging tests on interactive workers (only Linux on TaskCluster)
* Improve end to end times on Try (Thunder Try project)

For all bugs and priorities you can check out the project management 
page for it:
https://wiki.mozilla.org/EngineeringProductivity/Projects/Debugging_UX_improvements

Status update:
Debugging tests on interactive workers
---------------------------------------------------
Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1262260

Accomplished recently:
* Fixed regression that broke the interactive wizard
* Support for Android reftests landed

Upcoming:
* Support for Android xpcshell
* Video demonstration


Thunder Try - Improve end to end times on try
---------------------------------------------

Project #1 - Artifact builds on automation
##########################################
Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1284882

Accomplished recently:
* Windows and Mac artifact builds are soon to land
* |mach try| now supports --artifact option
* Compiled-code tests jobs error-out early when run with --artifact on try

Upcoming:
* Windows and Mac artifact builds available on Try
* Fix triggering of test jobs on Buildbot with artifact build

Project #2 - S3 Cloud Compiler Cache
####################################
Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1280641

Nothing new in this edition.

Project #3 - Metrics
####################
Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1286856

Accomplished recently:

* Drill-down charts:
   http://people.mozilla.org/~klahnakoski/testfailures/docs/example1.png
* Which leads to a detailed view:
   http://people.mozilla.org/~klahnakoski/testfailures/docs/example2.png
* With optional wait times included (missing 10% outliers, so looks 
almost the same):
   http://people.mozilla.org/~klahnakoski/testfailures/docs/example3.png

Upcoming:
* Iron out interactivity bugs
* Show outliers
* Post these (static) pages to my people page
* Fix ActiveData production to handle these queries (I am currently 
using a development version of ActiveData, but that version has some 
nasty anomalies)

Project #4 - Build automation improvements
##########################################
Upcoming:
* We identified an interaction with EBS in AWS that is likely making 
several parts of automation slower than they should be 
(https://bugzilla.mozilla.org/show_bug.cgi?id=1305174)


Project #5 - Run Web platform tests from the source checkout
############################################################
Accomplished recently:
* WPT is now running from the source checkout in automation

Upcoming:
* There are still parts in automation relying on a test zip. Next steps 
is to minimize those so you can get a loner, pull any revision from any 
repo, and test WPT changes in an environment that is exactly what the 
automation tests run in.

Other
#####
Bug 1300812 - Make Mozharness downloads and unpacks actions handle 
better intermittent S3/EC2 issues
* This adds retry logic to reduce intermittent oranges

-- 
Zambrano Gasparnian, Armen
Engineering productivity
http://armenzg.blogspot.ca



More information about the firefox-dev mailing list