Clusters

From Wikitech
Jump to: navigation, search
Wikimedia infrastructure

Data centres and PoPs


Networking

HTTP Caching

Wiki

Media

Logs

These are the current and former server clusters used by the Wikimedia Foundation, grouped by colocation facilities. Cluster names are formed from a two-letter abbreviation of the hosting provider (e.g. "eq" for Equinix) and the three-letter IATA code of the nearest major airport (e.g. "iad" for Washington Dulles).

Map of Wikimedia Foundation clusters

History

One of the Wikimedia server racks at CyrusOne (codfw).

From 2004 primary services were in Tampa, Floria in a cluster named "Pmtpa". In 2009, the Wikimedia Foundation started looking for options with better network connectivity.[1] By January 2013, the Virginia data centre (named "Eqiad") was fully operational and traffic was switched from Tampa to Virginia. In 2014, the Tampa networking (sdtpa) and application clusters (pmtpa) were shutdown. Read more about the migration on the Wikimedia Blog.

In October 2013, the foundation started looking for a new data centre facility that would be used side-by-side with Eqiad. Both for the purposes of redundancy (e.g. emergency fallback) as well as to (in the future) operate services from multiple data centres simultaneously. See also RFP/2013 Datacenter.

As of 2015, primary application services and backends (web servers, databases) are in Eqiad and Codfw.

Present

Servers in Ashburn, Virginia (eqiad).
Cluster Location Usage Since
Codfw cluster‎ Carrollton, Texas, United States (North America) Application services 2014
Eqiad cluster‎ Ashburn, Virginia, United States (North America) Application services 2010
Eqsin cluster‎ Singapore (Asia) Caching 2017[2]
Esams cluster‎ Amsterdam, Netherlands (Europe) Caching 2009[3]
Ulsfo cluster‎ San Francisco, California, United States (North America) Caching 2014[4]
Networking
Cluster Location Usage Since
eqdfw Dallas, Texas (United States) Networking 2015[5][6]
eqord Chicago, Illinois (United States) Networking 2015[5][6]
knams Amsterdam (Netherlands) Networking (for esams) 2005?[7]

Past

Cluster Location Usage Years
Lopar cluster Paris (France) Caching 2005
Pmtpa cluster Tampa, Florida (United States) Application services 2004 – 2014
San Diego San Diego (United States) Webserver 2001 – 2004
Yaseo cluster Seoul (South Korea) zhwiki and kowiki 2005 – 2009[8][9]
Networking
Cluster Location Usage Since
sdtpa Tampa, Florida (United States) Networking (for pmtpa) 2004 – 2014

See also

References

  1. Wikimedia sites to move to primary data center in Ashburn (19 January 2013), Wikimedia Blog.
  2. T156028: Name Asia Cache DC, Wikimedia Phabricator, 26 September 2017
  3. https://blog.wikimedia.org/2009/06/22/evoswitch-helps-us-improve-project-access-in-europe-and-beyond/
  4. "ULSFO going online", Deployments calendar, Week of 3 February 2014.
  5. 5.0 5.1 WMF Infrastructure Quarterly Review 2015 FQ1, page 66 "TechOps - Appendix", 15 October 2015
  6. 6.0 6.1 T91077: EQDFW/EQORD Deployment, Wikimedia Phabricator, 27 February 2015
  7. https://wikitech.wikimedia.org/w/index.php?title=Kennisnet_rackspace&oldid=13519
  8. Started on September 2005. Oldest mention in Server admin log, 9 September 2005.
  9. "Decommissioned all yaseo servers", Server admin log, 23 July 2009.