Wikimedia infrastructure

Wikimedia infrastructure

Data centers

• Locations:
  • Eqiad data center (Ashburn, USA)
  • Codfw data center (Dallas, USA)
  • Esams data center (Amsterdam, NL)
  • Ulsfo data center (San Francisco, USA)
  • Eqsin data center (Singapore, SG)
  • Drmrs data center (Marseille, FR)
• Data center operations
  • Common data center spec
  • Platform-specific doc
• Naming conventions

Networking

• Network design
• Peering
• LVS
• IP and AS allocations
• Network cheat sheet
• Wikimedia network guidelines
• Network monitoring

Global traffic routing

• Global traffic routing
• Caching overview
• DNS
• HTTPS
• HAProxy
• Varnish
• Apache Traffic Server
• Traffic cache hardware
• HTTP timeouts
• Purged
• MediaWiki HTTP cache headers
• Kafka HTTP purging
• URI path normalization
• Query string normalization

MediaWiki

• Application servers
• PHP 7 and php-fpm
• Dumps
• Memcached
• Mcrouter runbook
• Kafka Job Queue
• Nutcracker
• Envoy
• MediaWiki HTTP cache headers
• Redis
• Parser cache
• Statsd
• Kubernetes
• MediaWiki and EtcdConfig
• Citoid
• Mathoid

Multimedia

• Thumbor
• Swift
• Media storage
• upload.wikimedia.org
• Media backups

Data Engineering

• Analytics Systems
• Hadoop Cluster
• Druid
• AQS
• Data Lake
• Event Platform

Search

• § Elastica
• § CirrusSearch
• § Job queue
• § Administration
• Wikidata Query Service

Data Persistence

• MariaDB architecture
• MariaDB troubleshooting
• MariaDB monitoring
• MariaDB backups
• Database Runbooks
• Bacula
• Media backups
• Offsite Backups
• Backup Runbooks
• Orchestrator

Infra Foundations

• CAS-SSO
• Conftool
  • Dbctl
• Cumin
• Debmonitor
• Ganeti
• Puppet-compiler
• Homer
• Network Error Logging
• Reprepro
• Spicerack and cookbooks

Observability

• Logs
• MediaWiki UDP logging
• Logstash (backend)
• OpenSearch Dashboards (frontend)
• Prometheus
• Thanos
• Statsd
• Graphite
• Grafana
• Alertmanager
• Klaxon
• Wikimediastatus.net

[]

Current infographics

For older or more detailed infographics, see Infographics.

eqiad

codfw

esams

ulsfo

eqsin

drmrs

Open the Template:ClusterMap page.

» Data centers

» MediaWiki at WMF

» Memcached use by MediaWiki

Infrastructure overview

» Networking (Topology as of 2019)

» HTTP Caching (traffic flow from cache PoPs)