Wikimedia infrastructure

Wikimedia infrastructure

Data centers

• Locations:
  • Eqiad data center (Ashburn, USA)
  • Codfw data center (Dallas, USA)
  • Esams data center (Amsterdam, NL)
  • Knams data center (Amsterdam, NL)
  • Ulsfo data center (San Francisco, USA)
  • Eqsin data center (Singapore, SG)
  • Drmrs data center (Marseille, FR)
• Data center operations
  • Common data center spec
  • Platform-specific doc
• Naming conventions

Networking

• Network design
• Peering
• LVS
• IP and AS allocations
• Network cheat sheet
• Wikimedia network guidelines
• Network monitoring

Global traffic routing

• CDN
• CDN/Hardware
• DNS
• HTTPS
• HAProxy
• Varnish
• Apache Traffic Server
• HTTP timeouts
• Purged
• Kafka HTTP purging
• URI path normalization
• Query string normalization
• Ncredir
• Acme-chief
• Katran

MediaWiki SRE

• Application servers
• PHP 7 and php-fpm
• Citoid
• Dumps
• Envoy
• Kafka Job Queue
• Memcached
• Mcrouter runbook
• MediaWiki HTTP cache headers
• MediaWiki On Kubernetes
• MediaWiki and EtcdConfig
• Mathoid
• Nutcracker
• Shellbox
• Redis

MediaWiki Engineering

• Parser cache
• Performance review
• …

Multimedia

• Thumbor
• Swift
• Media storage
• upload.wikimedia.org
• Media backups

Data Engineering

• Analytics Systems
• Hadoop Cluster
• Druid
• AQS
• Data Lake
• Event Platform

Search

• § Elastica
• § CirrusSearch
• § Job queue
• § Administration
• Wikidata Query Service

SRE Data Persistence

• MariaDB architecture
• MariaDB troubleshooting
• MariaDB monitoring
• MariaDB backups
• Database Runbooks
• Bacula
• Cassandra
• Swift
• Media storage
• Media backups
• Offsite Backups
• Backup Runbooks
• Orchestrator

SRE Infra Foundations

• CAS-SSO
• Conftool
  • Dbctl
• Cumin
• Package management
  • APT repository
  • Debian Packaging
  • DebMonitor
• Ganeti
• Puppet-compiler
• Homer
• Netbox
• Network Error Logging
• Reprepro
• Spicerack and cookbooks

SRE Observability

• Arc Lamp
• Logs
• MediaWiki UDP logging
• Logstash (backend)
• OpenSearch Dashboards (frontend)
• Prometheus
• Thanos
• Statsd
• Graphite
• Grafana
• Alertmanager
• Klaxon
• Wikimediastatus.net
• XHGui

Performance Team

• AS Report
• Excimer UI
• Fresnel
• Metric definitions
• performance.wikimedia.org
• Real user monitoring
• Synthetic testing
• User Journey
• Webperf: navtiming, statsv
• Web Perf Hero award 🚀

Guides:

• Frontend best practices
• Backend best practices
• more…

AWS:

• Graphite (synthetic instance)

Dedicated server/bare metal:

• Dedicated server setup
• WebPageReplay

BitBar:

• Mobile Device Lab

Event Platform

• Schema guidelines
• Event Stream Configuration
• Stream Processing/Flink
• Instrumentation tutorial
• Event Utilities (code client libraries)
• EventGate service (admin)
• EventStreams service
• schema.wikimedia.org
• stream.wikimedia.org

Release Engineering

• Jenkins
• Phabricator
• WikimediaDebug

[]

Current infographics

For older or more detailed infographics, see Infographics.

eqiad

codfw

esams

ulsfo

eqsin

drmrs

Data center diagram by Timo Tijhof (CC-BY 3.0), based on World map by Skimel (Public domain).

» Data centers

» MediaWiki at WMF

» Memcached use by MediaWiki

MediaWiki infrastructure

WMF Infrastructure overview

» Performance Team infrastructure

» Networking topology

» HTTP Caching (traffic flow from cache PoPs)

Event Platform