Jump to content

Metrics Platform/Custom Data Monitor

From Wikitech

This page documents the process for measuring metrics related to the adoption of Metrics Platform schemas.

Quickstart

Create "Run custom data property count script…" task

Background

schemas/event/secondary stores the JSON Schema schemas for validating events submitted by analytics instrumentation. It also stores the Metrics Platform per-platform base schemas (herein "the MP base schemas") and the Legacy EventLogging base schema.

Data Products wants to track the number of high-level metrics about the schemas used for analytics instrumentation over time. Those high-level metrics are:

  1. The number of schemas
  2. The number of schemas that include the MP base schemas
  3. The average number of so-called "custom data" per schema

Here Data Products defines custom data as any property defined in the schema that isn't in either the MP base schemas or the Legacy EventLogging base schema.

Data Products runs the script and updates the spreadsheet roughly once per quarter. The work is tracked in Phabricator. Since the work is routine, they have a template task, which can be duplicated whenever it needs to be done. Clicking the button at the top of the page will create such a duplicate task.

Retrieved from "https://wikitech.wikimedia.org/w/index.php?title=Metrics_Platform/Custom_Data_Monitor&oldid=2239786"