Wikimedia infrastructure

Wikimedia infrastructure

Data centers

• Locations:
  • Eqiad data center (Ashburn, USA)
  • Codfw data center (Dallas, USA)
  • Esams data center (Amsterdam, NL)
  • Knams data center (Amsterdam, NL)
  • Ulsfo data center (San Francisco, USA)
  • Eqsin data center (Singapore, SG)
  • Drmrs data center (Marseille, FR)
• Data center operations
  • Common data center spec
  • Platform-specific doc
• Naming conventions

Networking

• Network design
• Peering
• LVS
• IP and AS allocations
• Network cheat sheet
• Wikimedia network guidelines
• Network monitoring

Global traffic routing

• Global traffic routing
• Caching overview
• DNS
• HTTPS
• HAProxy
• Varnish
• Apache Traffic Server
• Traffic cache hardware
• HTTP timeouts
• Purged
• MediaWiki HTTP cache headers
• Kafka HTTP purging
• URI path normalization
• Query string normalization
• Ncredir
• Acme-chief

MediaWiki

• Application servers
• PHP 7 and php-fpm
• Dumps
• Memcached
• Mcrouter runbook
• Kafka Job Queue
• Nutcracker
• Envoy
• MediaWiki HTTP cache headers
• Redis
• Parser cache
• Statsd
• MediaWiki On Kubernetes
• MediaWiki and EtcdConfig
• Citoid
• Mathoid

Multimedia

• Thumbor
• Swift
• Media storage
• upload.wikimedia.org
• Media backups

Data Engineering

• Analytics Systems
• Hadoop Cluster
• Druid
• AQS
• Data Lake
• Event Platform

Search

• § Elastica
• § CirrusSearch
• § Job queue
• § Administration
• Wikidata Query Service

Data Persistence

• MariaDB architecture
• MariaDB troubleshooting
• MariaDB monitoring
• MariaDB backups
• Database Runbooks
• Bacula
• Media backups
• Offsite Backups
• Backup Runbooks
• Orchestrator

Infra Foundations

• CAS-SSO
• Conftool
  • Dbctl
• Cumin
• Package management
  • APT repository
  • Debian Packaging
  • DebMonitor
• Ganeti
• Puppet-compiler
• Homer
• Netbox
• Network Error Logging
• Reprepro
• Spicerack and cookbooks

Observability

• Logs
• MediaWiki UDP logging
• Logstash (backend)
• OpenSearch Dashboards (frontend)
• Prometheus
• Thanos
• Statsd
• Graphite
• Grafana
• Alertmanager
• Klaxon
• Wikimediastatus.net

Performance Team

• AS Report
• Arc Lamp
• Fresnel
• Metric definitions
• performance.wikimedia.org
• Real user monitoring
• Synthetic testing
• User Journey
• Webperf: navtiming, statsv
• Web Perf Hero award 🚀
• WikimediaDebug
• XHGui

Guides:

• Frontend best practices
• Backend best practices
• more…

AWS:

• Graphite (synthetic instance)

Dedicated server/bare metal:

• Dedicated server setup
• WebPageReplay

BitBar:

• Mobile Device Lab

[]

Current infographics

For older or more detailed infographics, see Infographics.

eqiad

codfw

esams

ulsfo

eqsin

drmrs

Data center diagram by Timo Tijhof (CC-BY 3.0), based on World map by Skimel (Public domain).

» Data centers

» MediaWiki at WMF

» Memcached use by MediaWiki

MediaWiki infrastructure

WMF Infrastructure overview

» Performance Team infrastructure

» Networking topology

» HTTP Caching (traffic flow from cache PoPs)