Data platform update
gfritzsche at mozilla.com
Fri Dec 23 15:22:35 UTC 2016
Data platform update
The data platform team is working on our core Telemetry system, the data
pipeline and providing core datasets, with support from the Firefox data
engineering and the Data tools team.
To make new features more visible, we intend to provide quarterly updates,
starting with this one.
What's new in the last few months?
On the data collection side, we added scalars
and added engagement measures
on top. We now support recording histograms in child processes and
We improved documentation, starting from the Telemetry wiki page
<https://wiki.mozilla.org/Telemetry> and updated onboarding
Further work happened on:
improved client-side documentation
an introduction on analyzing telemetry data
a guide on choosing a dataset
updates to examples for the longitudinal dataset
exploring how to make Firefox data more discoverable
The data pipeline work powers results for re:dash
<https://sql.telemetry.mozilla.org/> and custom analysis
<https://analysis.telemetry.mozilla.org/> among other things.
Notable recent work here includes:
dataset is now operational in re:dash
socorro crash data
<https://sql.telemetry.mozilla.org/queries/1170/source#table> is now
available in re:dash
the new dataset API
improves querying raw ping data
the self-serve analysis portal <https://analysis.telemetry.mozilla.org/>
was relaunched with improved UX
provided easy access to self-serve real-time analysis
launched a knowledge repository <https://reports.telemetry.mozilla.org>
to make reports discoverable in one place and easier to review
For the next few months, interesting projects in the pipeline include:
event telemetry <https://wiki.mozilla.org/Event_Telemetry>, which
enables recording event data into Telemetry in a common format
work to decrease data latency, allowing us to make decisions faster
adding Telemetry support for Add-ons
making it easy for new pings to show up in re:dash thanks to
enabling efficient lookup of client histories using Hbase
for Telemetry probes
creating a new crash summary dataset, to make it easier to analyze crash
Please reach out to us with any questions or concerns.
You can find us on IRC in #telemetry and #datapipeline.
The main mailing list for data topics is fhr-dev
Bugs can be filed in one of these components
You can also find us on Twitter as @MozTelemetry
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the firefox-dev