Wikimedia infrastructure

Wikimedia infrastructure

Data centres and PoPs Eqiad cluster‎ (Ashburn, USA) Codfw cluster‎ (Dallas, USA) Esams cluster‎ (Amsterdam, NL) Eqsin cluster (Singapore, SG) Ulsfo cluster‎ (San Francisco, USA) Networking Network design Peering Link aggregation LVS Network guidelines Network monitoring HTTP Caching Global traffic routing Varnish Apache Traffic Server Traffic cache hardware HTTP timeouts MediaWiki HTTP cache headers Kafka HTTP purging URI Path Normalization MediaWiki MediaWiki at WMF Application servers PHP 7 and php-fpm Memcached Mcrouter Nutcracker Envoy MediaWiki HTTP caching Redis Parser cache Statsd Media Thumbor Swift Media storage upload.wikimedia.org Logs MediaWiki UDP logging Logstash and Kibana Search § Elastica § CirrusSearch § Job queue § Administration [edit]

eqiad

codfw

esams

ulsfo

eqsin

» Clusters

» MediaWiki (Webrequest flow, as of 2020)

» Memcached (Memcached flow, as of 2020)

Infrastructure overview

» Networking (Topology as of 2019)

» HTTP Caching (traffic flow from cache PoPs)