Nova Resource:Tools

From Wikitech
Jump to: navigation, search


Resource Type project
Project Name tools
Monitoring nagf
Admins
Members

Documentation

Edit documentation

Tool Labs

Description

The Tools project is one of two projects in the Tool Labs environment (the other being Toolsbeta).

Purpose

Runs end-user tools to support the projects

Anticipated traffic level

more than 1000 hits per day

Anticipated time span

indefinite

Project status

currently running

Contact address

marc@wikimedia.org

Willing to take contributors or not

willing

Subject area narrow or broad

broad


Tool Labs is a reliable, scalable hosting environment for community developers working on tools and bots that help users maintain and use wikis. The cloud-based infrastructure was developed by the Wikimedia Foundation and is supported by a dedicated group of Wikimedia Foundation staff and volunteers. Tool Labs is a part of the Labs project, which is designed to make it easier for developers and system administrators to try out improvements to Wikimedia infrastructure, including MediaWiki, and to do analytics and bot work.

Tip: Confused about the terms labs, tool labs etc? Read Wikimedia Labs vs Tool Labs.

The Tool Labs environment provides:

  • Support for Web services, continuous bots, and scheduled tasks.
  • Access to replicated production databases.
  • Easily shared management of tool accounts, where tools and bots are stored.
  • A grid engine for dispatching jobs.
  • Support for mosh, SSH, SFTP without complicated proxy setup.
  • A shared pywikibot installation.
  • Time-travel backups for short-term data recovery.
  • Version control via Gerrit and Git.
  • Support for Redis.

In general, every tool maintainer should work primarily on the Tools project (not Toolsbeta, which is for experiments to the Tool Labs environment itself).

Requesting access

After filling in the form, your request will then show up in the queue above, and will be processed shortly by one of the Tool Labs administrators.

Help-page

Tools Resources Overview

Useful links




SSH Fingerprints

tools-login: Help:SSH Fingerprints/tools-login.wmflabs.org


Topology of tools on labs Tool Labs design philosophy

Server admin log

May 22

  • 20:37 yuvipanda: deleted and depooled tools-exec-07

May 20

  • 20:09 yuvipanda: transient shinken puppet alerts because I tried to force puppet runs on all tools hosts but cancelled
  • 20:01 yuvipanda: enabling puppet on all hosts
  • 20:01 yuvipanda: tested new /etc/hosts on tools-bastion-01, puppet run produced no diffs, all good
  • 19:56 yuvipanda: copy cleaned up and regenerated /etc/hosts from tools-precise-dev to all toollabs hosts
  • 19:54 yuvipanda: copy cleaned up hosts file to /etc/hosts on tools-prec... (more)

Instances for this project

  Instance Name Instance Type Project Image Id FQDN Public IP Launch Time Puppet Class Modification dateThis property is a special property in this wiki. Number of CPUs RAM Size Amount of Storage
I-00000bd7.eqiad.wmflabs tools-exec-1410 m1.large tools ubuntu-14.04-trusty i-00000bd7.eqiad.wmflabs 208.80.155.187 30 April 2015 02:54:10 role::labs::tools::compute
toollabs::node::compute::general
base
role::labs::instance
19 May 2015 18:10:57 4 8,192 80
I-000006af.eqiad.wmflabs tools-exec-catscan m1.large tools ubuntu-14.04-trusty i-000006af.eqiad.wmflabs 20 October 2014 16:58:43 base
role::labs::instance
sudo::labs_project
role::labs::tools::compute
toollabs::node::compute::dedicated
19 May 2015 18:06:15 4 8,192 80
I-00000bc7.eqiad.wmflabs tools-exec-1208 m1.large tools ubuntu-12.04-precise i-00000bc7.eqiad.wmflabs 208.80.155.217 29 April 2015 19:26:33 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
19 May 2015 18:02:42 4 8,192 80
I-00000be9.eqiad.wmflabs tools-webgrid-lighttpd-1403 m1.large tools ubuntu-14.04-trusty i-00000be9.eqiad.wmflabs 2 May 2015 01:57:26 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::lighttpd
19 May 2015 17:50:48 4 8,192 80
I-00000bfe.eqiad.wmflabs tools-webgrid-lighttpd-1208 m1.large tools ubuntu-12.04-precise i-00000bfe.eqiad.wmflabs 2 May 2015 08:55:45 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::lighttpd
19 May 2015 17:46:36 4 8,192 80
I-00000bf3.eqiad.wmflabs tools-webgrid-lighttpd-1203 m1.large tools ubuntu-12.04-precise i-00000bf3.eqiad.wmflabs 2 May 2015 02:04:39 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::lighttpd
19 May 2015 17:38:41 4 8,192 80
I-00000bea.eqiad.wmflabs tools-webgrid-lighttpd-1404 m1.large tools ubuntu-14.04-trusty i-00000bea.eqiad.wmflabs 2 May 2015 01:57:19 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::lighttpd
19 May 2015 17:30:50 4 8,192 80
I-00000bd8.eqiad.wmflabs tools-exec-1211 m1.large tools ubuntu-12.04-precise i-00000bd8.eqiad.wmflabs 208.80.155.220 30 April 2015 04:36:42 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
19 May 2015 17:19:48 4 8,192 80
I-000008b7.eqiad.wmflabs tools-webproxy-01 m1.medium tools ubuntu-14.04-trusty i-000008b7.eqiad.wmflabs 208.80.155.131 24 February 2015 06:48:09 base
role::labs::instance
role::labs::tools::proxy
19 May 2015 17:15:33 2 4,096 40
I-000000ce.eqiad.wmflabs tools-shadow m1.small tools ubuntu-12.04-precise i-000000ce.eqiad.wmflabs 28 February 2014 04:30:35 base
role::labs::instance
exim::simple-mail-sender
sudo::labs_project
role::labs::tools::shadow
19 May 2015 17:08:05 1 2,048 20
I-00000bd0.eqiad.wmflabs tools-exec-1403 m1.large tools ubuntu-14.04-trusty i-00000bd0.eqiad.wmflabs 208.80.155.143 30 April 2015 02:13:17 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
19 May 2015 17:04:31 4 8,192 80
I-000000cd.eqiad.wmflabs tools-master m1.small tools ubuntu-12.04-precise i-000000cd.eqiad.wmflabs 28 February 2014 04:30:15 base
role::labs::instance
exim::simple-mail-sender
sudo::labs_project
role::labs::tools::master
19 May 2015 17:00:03 1 2,048 20
I-00000bd3.eqiad.wmflabs tools-exec-1406 m1.large tools ubuntu-14.04-trusty i-00000bd3.eqiad.wmflabs 208.80.155.146 30 April 2015 02:53:03 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
19 May 2015 16:49:35 4 8,192 80
I-00000bf7.eqiad.wmflabs tools-webgrid-generic-1402 m1.large tools ubuntu-14.04-trusty i-00000bf7.eqiad.wmflabs 2 May 2015 02:05:50 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::generic
19 May 2015 16:45:12 4 8,192 80
I-00000bdc.eqiad.wmflabs tools-exec-1215 m1.large tools ubuntu-12.04-precise i-00000bdc.eqiad.wmflabs 208.80.155.224 30 April 2015 04:38:52 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
19 May 2015 16:40:38 4 8,192 80
I-000000df.eqiad.wmflabs tools-exec-gift m1.medium tools ubuntu-12.04-precise (deprecated 2014-04-17) i-000000df.eqiad.wmflabs 28 February 2014 04:40:47 base
role::labs::instance
sudo::labs_project
role::labs::tools::compute
toollabs::node::compute::dedicated
19 May 2015 16:29:15 2 4,096 40
I-00000bc6.eqiad.wmflabs tools-exec-1203 m1.large tools ubuntu-12.04-precise i-00000bc6.eqiad.wmflabs 208.80.155.212 29 April 2015 19:26:23 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
19 May 2015 16:25:26 4 8,192 80
I-00000274.eqiad.wmflabs tools-submit m1.small tools ubuntu-12.04-precise (deprecated 2014-04-17) i-00000274.eqiad.wmflabs 22 March 2014 13:54:22 base
role::labs::instance
role::labs::tools::submit
role::labs::tools::toolwatcher
19 May 2015 16:21:06 1 2,048 20
I-00000bc0.eqiad.wmflabs tools-exec-1210 m1.large tools ubuntu-12.04-precise i-00000bc0.eqiad.wmflabs 208.80.155.219 29 April 2015 02:27:14 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
19 May 2015 16:17:35 4 8,192 80
I-00000bee.eqiad.wmflabs tools-webgrid-lighttpd-1408 m1.large tools ubuntu-14.04-trusty i-00000bee.eqiad.wmflabs 2 May 2015 01:59:49 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::lighttpd
19 May 2015 16:03:59 4 8,192 80
… further results