Usability improvements for Firefox automation initiative - Status update #5

Armen Zambrano G. armenzg at mozilla.com
Tue Sep 13 18:53:33 UTC 2016


On this update we will look at the progress made in the last two weeks.

A reminder that this quarter’s main focus is on:
* Debugging tests on interactive workers (only Linux on TaskCluster)
* Improve end to end times on Try (Thunder Try project)

For all bugs and priorities you can check out the project management 
page for it: 
https://wiki.mozilla.org/EngineeringProductivity/Projects/Debugging_UX_improvements

Status update:

Debugging tests on interactive workers
---------------------------------------------------
Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1262260

Accomplished recently:
* Support for Android mochitests on interactive loaners
* Fixed race condition when waiting for loaner to be ready

Upcoming:
* Support for Android reftests on interactive loaners
* Support for Android xpcshell on interactive loaners


Thunder Try - Improve end to end times on try
---------------------------------------------

Project #1 - Artifact builds on automation
##########################################
Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1284882

Accomplished recently:
* Landed --artifact try flag for forcing artifact builds (linux64 only 
for now)

Upcoming:
* Restrict --artifact try flag to requests that don’t involve 
compiled-code tests

Project #2 - S3 Cloud Compiler Cache
####################################
Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1280641

Most issues on the sccache rewrite have been ironed out. Another test on 
try is required to validate it.

Project #3 - Metrics
####################
Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1286856

Upcoming:
* Working on showing the high level (90th? percentile), “end-to-end” 
times. The hope is to reveal the longest running chain of jobs and 
provide a drill-down to the steps that explain the numbers. This 
particular statistic may be dubious, however, it provides something to 
build an interactive UI for other statistics.

Other
#####
Bug 1272083 - Downloading/unzipping to be performed in memory
* The initial patch landed last week
* Unfortunately few intermittents were introduced due to a bug on the code
* The new patch landed today and should clear up the intermittents 
introduced

[1] https://bugzilla.mozilla.org/show_bug.cgi?id=1290282

-- 
Zambrano Gasparnian, Armen
Engineering productivity
http://armenzg.blogspot.ca



More information about the firefox-dev mailing list