Performance/Runbook/Arc Lamp service
This is the runbook for deploying and monitoring Arc Lamp (formerly known as "xenon-log").
The puppet role for these services is role::webperf:profiling_tools. We currently run one
arclamp host in each core data center (Eqiad and Codfw). You can monitor these via the Grafana host overview dashboard. There's also an equivalent deployment-webperfXX host in the Beta Cluster.
Arc Lamp data originates from application servers (using php-excimer), which sent to a Redis instance on the mwlog host, from which the Arc Lamp servicec then reads it. The flame graphs are generated using brendangregg/FlameGraph.
- Index page: https://performance.wikimedia.org/php-profiling/
- Public file listing: https://performance.wikimedia.org/arclamp/svgs/daily/
- brendangregg/FlameGraph on GitHub.