Wikimedia infrastructure

Wikimedia infrastructure

Data centers

• Data center locations:
  • eqiad data center (Ashburn, USA)
  • codfw data center (Dallas, USA)
  • esams data center (Amsterdam, NL)
  • ulsfo data center (San Francisco, USA)
  • eqsin data center (Singapore, SG)
  • drmrs data center (Marseille, FR)
  • magru data center (São Paulo, BR)
• Data center operations
  • Common data center spec
  • Platform-specific doc
• Naming conventions

Networking

• Network design
• Peering
• LVS
• IP and AS allocations
• Network cheat sheet
• Wikimedia network guidelines
• Network monitoring
• SONiC
• Juniper
• Network equipment lifecycle

Global traffic routing

• CDN
• CDN/Hardware
• DNS
• HTTPS
• HAProxy
• Varnish
• Apache Traffic Server
• HTTP timeouts
• Purged
• Kafka HTTP purging
• URL path normalization
• Query string normalization
• Ncredir
• Acme-chief
• Katran
• HAProxyKafka

MediaWiki SRE

• Application servers
  • PHP 7 and php-fpm
• BounceHandler
• Citoid
• Dumps
• Envoy
• EtcdConfig for MediaWiki
• External storage
• MediaWiki HTTP cache headers
• MediaWiki On Kubernetes
  • mw-cron jobs
• MediaWiki Maintenance scripts
• MediaWiki JobQueue
• Mathoid
• Memcached
  • mw-mcrouter
  • Mcrouter runbook
• Nutcracker
• Parser cache
• Redis
• Shellbox
• Videoscaling

MediaWiki Engineering

• Parser cache
• MediaWiki JobQueue
• Performance review
• performance.wikimedia.org
• Web Perf Hero award
• Guides:
  • Frontend best practices
  • Backend best practices
  • more…
• Runbooks:
  • Daily duties

Multimedia

• Thumbor
• Swift
• Media storage
• upload.wikimedia.org
• Media backups
• Videoscaling

Data Engineering

• Analytics Systems
• Hadoop Cluster
• Druid
• AQS
• Data Lake
• Event Platform

Search

• § Elastica
• § CirrusSearch
• § Streaming Updater
• § Administration
• Wikidata Query Service

SRE Data Persistence

• MariaDB architecture
  • MariaDB troubleshooting
  • MariaDB monitoring
  • MariaDB backups
  • Database Runbooks
• Bacula
  • Backup Runbooks
  • Offsite Backups
• Data Gateway
• Cassandra
• External storage
• Orchestrator
• Parser cache
• SessionStorage
• Swift
  • Media storage
  • Media backups

SRE Infra Foundations

• CAS-SSO
• Conftool
  • Dbctl
• Cumin
• Debian packaging
  • APT repository
  • DebMonitor
  • Reprepro
• Ganeti
• Puppet-compiler
• Homer
• irc.wikimedia.org
• Netbox
• Network Error Logging
• Spicerack and cookbooks

SRE Observability

• Arc Lamp
• Distributed tracing
  • Jaeger
• Logs
• MediaWiki UDP logging
• OpenSearch Dashboards (frontend)
• Logstash (backend)
• Prometheus
• performance.wikimedia.org
• Thanos
• Statsd
• Graphite
• Grafana
• Alertmanager
• Klaxon
• Wikimediastatus.net
• XHGui

Wikimedia Performance

• Performance dictionary
• Web Perf Hero award
• Performance review
• Guides:
  • Frontend best practices
  • Backend best practices
  • more…
• Tools:
  • Arc Lamp
  • AS Report
  • Excimer UI
  • Fresnel
  • performance.wikimedia.org
• Metrics:
  • Metric definitions
  • Real user monitoring
  • User Journey
• Synthetic testing
  • Run a test
  • Dedicated server setup
  • WebPageReplay
  • On demand testing
  • Graphite (synthetic instance)
• Runbooks
  • WebPageReplay
  • On demand testing
  • Graphite
  • Result storage

Event Platform

• Schema guidelines
• Event Stream Configuration
• Stream Processing/Flink
• Instrumentation tutorial
• Event Utilities (code client libraries)
• EventGate service (admin)
• EventStreams service
• schema.wikimedia.org
• stream.wikimedia.org

Release Engineering

• Fresnel
• Jenkins
• Phabricator
• WikimediaDebug
• integration.wikimedia.org

[]

Current infographics

For older or more detailed infographics, see Infographics.

codfw

eqiad

esams

ulsfo

eqsin

drmrs

magru

Data center diagram by Timo Tijhof (CC-BY 3.0), based on World map by Skimel (Public domain).

» Data centers

» MediaWiki at WMF

» Memcached use by MediaWiki

MediaWiki infrastructure

WMF Infrastructure overview

» Performance Team infrastructure

» Networking topology

» HTTP Caching (traffic flow from cache PoPs)

Event Platform

Data Platform