Jump to content

Obsolete:Tools/Overview

From Wikitech

This page provides an overview on available Tool Labs resources. For detailed information see: Help:Tool Labs

This page contains historical information. It may be outdated or unreliable.

System resources

Bastion hosts

Hostname IP pub IP priv Type SSH Fingerprint Purpose Comment
tools-login.wmflabs.org208.80.155.13010.68.16.7m1.medium ssh fingerprinttools userslogin only
tools-dev.wmflabs.org208.80.155.13210.68.16.8m1.medium ssh fingerprinttools userscompilation / interactive tasks
bastion-eqiad.wmflabs.org208.80.155.12910.68.16.5m1.smallssh fingerprintlabs/instance users
bastion2-eqiad.wmflabs.org208.80.155.15310.68.16.66m1.smallssh fingerprintlabs/instance users
bastion3-eqiad.wmflabs.org208.80.155.15410.68.16.67m1.smallssh fingerprintlabs/instance users
bastion-restricted-eqiad.wmflabs.org208.80.155.15510.68.16.68m1.smallssh fingerprintopsens & celebs

Proxies

Hostname IP pub IP priv Type SSH Fingerprint Purpose Comment
tools-webproxy208.80.155.13110.68.16.4m1.mediumNginx Web Proxy for ToolsNginx 1.5.0 – tools.wmflabs.org/*
dynamicproxy-gateway208.80.155.15610.68.16.65m1.smallNginx Web Proxy for InstancesNginx 1.5.0 – *.tools.wmflabs.org

Sun Grid Engine (SGE)

Hostname IP pub IP priv Type SSH Fingerprint Purpose Comment
tools-master–10.68.16.9m1.smallGrid master node
tools-shadow–10.68.16.10m1.smallGrid master backup node
tools-submit–10.68.17.1m1.smallCron submit node
tools-exec-01208.80.155.14010.68.16.30m1.largetask exec node
tools-exec-02208.80.155.14110.68.16.31m1.largetask exec node
tools-exec-03208.80.155.14210.68.16.32m1.largetask exec node
tools-exec-04208.80.155.14310.68.16.33m1.largetask exec node
tools-exec-05208.80.155.14410.68.16.34m1.largetask exec node
tools-exec-06208.80.155.14510.68.16.35m1.largetask exec node
tools-exec-07208.80.155.14610.68.16.36m1.mediumtask exec node
tools-exec-08208.80.155.14710.68.16.37m1.largetask exec node
tools-exec-09208.80.155.15210.68.17.64m1.largetask exec node
tools-exec-10208.80.155.18610.68.17.65m1.largetask exec node
tools-exec-11208.80.155.18710.68.17.144m1.xlargetask exec node
tools-exec-12208.80.155.18810.68.17.166m1.xlargetest node ubuntu-14.04-trusty
tools-exec-13208.80.155.18910.68.17.184m1.xlargetask exec node
tools-exec-cyberbot208.80.155.25510.68.16.39m1.mediumtask exec nodeCyberpower678
tools-exec-gift208.80.155.25510.68.16.40m1.mediumtask exec nodeGiftpflanze
tools-exec-wmt208.80.155.25510.68.16.41m1.mediumtask exec nodeWikimedia tasks
tools-webgrid-01208.80.155.25510.68.16.28m1.xlargeWeb Server node
tools-webgrid-02208.80.155.25510.68.17.9m1.xlargeWeb Server node
tools-webgrid-03208.80.155.25510.68.17.123m1.xlargeWeb Server node
tools-webgrid-04208.80.155.25510.68.17.174m1.xlargeWeb Server node
tools-webgrid-tomcat208.80.155.25510.68.16.29m1.xlargeJava Servlet and JavaServer node

Volumes

Volume Size Purpose Comment Browse
/home30 TB  users home directoriesFiles
/data/projecttools directoriesFiles
/shared/directory for shared resourcesFiles
/data/scratch7.3 TB  temporary user filesno redundancyFiles
/public/backups20 TB  backups scheduled by sysopsFiles
/public/dumps9.1 TB  public Wikimedia datasetsFiles
/public/keys   930 MB  ssh keysFiles

Database Servers

Hostname Type Purpose List Comment Physical host Storage Memory Monitor
tools-redisRedis 2.6Fast key-value store for caching/queueing–Port: 6379VM7 GB7 GB
tools-dbMySQL 5.5Tools datalist databasesBinary Log enabledlabsdb10058 TB32 GB
PostgreSQL 9.1OSM datalist databaseslabsdb1004
s1.labsdbMariaDB 10.0Labs replica slicelist databasesenwikilabsdb10017 TB180 GBGanglia
s2.labsdbMariaDB 10.0Labs replica slicelist databasesnl-, pl-, it-, zhwikilabsdb10027 TB180 GBGanglia
s4.labsdbcommonswiki
s5.labsdbdewiki, wikidatawiki
s3.labsdbMySQL 5.5Labs replica slicelist databases816 other wikislabsdb10037 TB180 GBGanglia
s6.labsdbMySQL 5.5Labs replica slicelist databasesfr-, ja-, ruwiki
s7.labsdbMySQL 5.5Labs replica slicelist databasescentralauth, metawiki

Tools shared resources

Resources provided by users/tools/projects for developers

Databases

Resource Purpose Maintainer Docs
meta_pMetadata for all wikis hosted in labs (on every slice)CorenList content
s51892_toolserverdb_pMetadata like toolserver.namespace (on every slice)Nosybug 48625
CatGraphIn-memory graph database for Wikipedia category structureJohannes_Kroll_(WMDE)CatGraph

Applications / Frameworks

Resource Purpose Maintainer Docs
IntuitionFramework to provide internationalization ( i18n ) for toolsKrinkledocumentation
PywikibotThis framework is a collection of tools made to fit the maintenance need on WikipediaLegoktm et al.mw:Manual:Pywikipediabot
ParsoidA bidirectional wikitext parser and runtime. Converts between wikitext and HTML/XML DOM with RDFaVariousmw:Parsoid
MWParserFromHellPython package that provides an easy-to-use and outrageously powerful parser for MediaWiki wikicodeEarwig et al.Documentation

API's

Resource Purpose Maintainer Docs
API SandboxPage to experiment with the MediaWiki web service APIVariousmw:API:Main_page
SupercountSupercount (X!'s Edit Counter) API, user & article analysisCyberpower678Documentation

Scripts / Guides / Tools

Resource Purpose Maintainer Docs
MySQL queriesMySQL sample queries to pull data from replicated databasesVarious–
OAuth-hello-worldSimple "Hello world" program to show how to use OAuthAnomiemw:Extension:OAuth
SQL OptimizerTool to check custom queries with MySQL optimizerHedonilbug 48875
QuarryTool to run SQL queries from web frontendYuviPanda

Misc

Resource Purpose Maintainer Docs
PasteWikimedia pastebin Petrb–
EtherpadWikimedia etherpadVariousEtherpad
UTF-8 encoding tableComprehensive UTF-8 encoding table with Unicode codepoints and HTML encodingweb–
StaticThis project hosts several heavily used static filesIreas–

Virtualization

Virtualization Environment

OpenStack Compute (Nova)

Virtualization hosts

Hostname CPU RAM Type Monitor Comment
virt100124170 GBCisco UCS C250 M1 / 2x Intel Xeon CPU X5650 @ 2.67GHzGanglia
virt100224170 GBCisco UCS C250 M1 / 2x Intel Xeon CPU X5650 @ 2.67GHzGanglia
virt100324170 GBCisco UCS C250 M1 / 2x Intel Xeon CPU X5650 @ 2.67GHzGanglia
virt100424170 GBCisco UCS C250 M1 / 2x Intel Xeon CPU X5650 @ 2.67GHzGanglia

Virtual box types

(also referred to as "instances" or "boxes")

Type vCPU RAM Hypervisor OS default Comment
m1.small1 x 2.6 GHz2 GBKVMUbuntu 12.04-precise (3.2-virtual x86_64)
m1.medium2 x 2.6 GHz4 GBKVMUbuntu 12.04-precise (3.2-virtual x86_64)
m1.large4 x 2.6 GHz8 GBKVMUbuntu 12.04-precise (3.2-virtual x86_64)
m1.xlarge8 x 2.6 GHz16 GBKVMUbuntu 12.04-precise (3.2-virtual x86_64)

Contact & Communication

Contact

Name IRC Default location TZ Role Comment
Marc-André PelletierCorenQuebec, CanadaUTC-5root adminTool Labs ringmaster
Andrew BogottandrewbogottMinneapolis, USUTC-6root adminLabs OpenStack, instances & stuff
Petr BenapetanCzech RepublicUTC+1adminMediaWiki, huggle, bots & stuff
Tim Landscheidtscfc_deHamburg, GermanyUTC+1adminShell accounts & stuff
  • IRC: #wikimedia-cloud connect
  • Mailing list: labs-l
Retrieved from "https://wikitech.wikimedia.org/w/index.php?title=Obsolete:Tools/Overview&oldid=1986596"