Wikidata Platform
Technical documentation for the Wikidata Platform, including the Wikidata Query Service (WDQS).
See mediawiki.org for additional technical documentation and the official team page. User docs for WDQS are at wikidata:SPARQL query service.
Components
Production
- WDQS streaming producer
- WDQS streaming consumer
- WDQS streaming updater/reconciler
- Blazegraph
- Blazegraph extensions
- Query UI
- Airflow DAGs
Experiments, testing, analytics
- Deterministic traffic replayer
- Wikidata Query Service/Migration/Development Infrastructure contains documentation for setting up WDQS on local and eqiad test hosts.
Query data
See Wikidata_Platform/Query_Data for tables you can use to analyze WDQS requests.
Monitoring, SLO
- https://grafana.wikimedia.org/dashboards (main monitoring dashboard)
- SLO dashboard in Grafana
Runbooks
These runbooks are intended for WDP engineers:
- Wikidata updates not propagating to WDQS
- Wikidata Query Service/Runbook/High replication lag and query timeout
SREs also maintain various runbooks for WDQS alerts that might be of interest for WDP engineers as well.