Nova Resource:Tools

From Wikitech
Jump to: navigation, search


Resource Type project
Project Name tools
Monitoring nagf
Admins
Members

Documentation

Edit documentation

Tool Labs

Description

The Tools project is one of two projects in the Tool Labs environment (the other being Toolsbeta).

Purpose

Runs end-user tools to support the projects

Anticipated traffic level

more than 1000 hits per day

Anticipated time span

indefinite

Project status

currently running

Contact address

marc@wikimedia.org

Willing to take contributors or not

willing

Subject area narrow or broad

broad


Tool Labs is a reliable, scalable hosting environment for community developers working on tools and bots that help users maintain and use wikis. The cloud-based infrastructure was developed by the Wikimedia Foundation and is supported by a dedicated group of Wikimedia Foundation staff and volunteers. Tool Labs is a part of the Labs project, which is designed to make it easier for developers and system administrators to try out improvements to Wikimedia infrastructure, including MediaWiki, and to do analytics and bot work.

Tip: Confused about the terms labs, tool labs etc? Read Wikimedia Labs vs Tool Labs.

The Tool Labs environment provides:

  • Support for Web services, continuous bots, and scheduled tasks.
  • Access to replicated production databases.
  • Easily shared management of tool accounts, where tools and bots are stored.
  • A grid engine for dispatching jobs.
  • Support for mosh, SSH, SFTP without complicated proxy setup.
  • A shared pywikibot installation.
  • Time-travel backups for short-term data recovery.
  • Version control via Gerrit and Git.
  • Support for Redis.

In general, every tool maintainer should work primarily on the Tools project (not Toolsbeta, which is for experiments to the Tool Labs environment itself).

Requesting access

After filling in the form, your request will then show up in the queue above, and will be processed shortly by one of the Tool Labs administrators.

Help-page

Tools Resources Overview

Useful links




SSH Fingerprints

tools-login: Help:SSH Fingerprints/tools-login.wmflabs.org


Topology of tools on labs Tool Labs design philosophy

Server admin log

March 31

  • 14:02 Coren: rebooting tools-submit
  • 07:07 YuviPanda: moved tools.wmflabs.org to tools-webproxy-01
  • 07:02 YuviPanda: reboot tools-webgrid-03 and tools-exec-03
  • 00:21 andrewbogott: temporarily shutting ‘toolsbeta-pam-sshd-motd-test’ down to conserve resources. It can be restarted any time.

March 30

  • 22:53 Coren: resyncing project storage with rsync
  • 22:40 Coren: reboot tools-login
  • 22:30 Coren: also bastion2
  • 22:28 Coren: reboot bastion1 so users can log in
  • 21:49 Coren: rebooting dedicated exe... (more)

Instances for this project

  Instance Name Instance Type Project Image Id FQDN Public IP Launch Time Puppet Class Modification dateThis property is a special property in this wiki. Number of CPUs RAM Size Amount of Storage
I-00000274.eqiad.wmflabs tools-submit m1.small tools ubuntu-12.04-precise (deprecated 2014-04-17) i-00000274.eqiad.wmflabs 22 March 2014 13:54:22 base
role::labs::instance
sudo::labs_project
role::labs::tools::submit
role::labs::lvm::biglogs
31 March 2015 14:10:19 1 2,048 20
I-000000e0.eqiad.wmflabs tools-exec-wmt m1.medium tools ubuntu-12.04-precise (deprecated 2014-04-17) i-000000e0.eqiad.wmflabs 28 February 2014 04:41:17 base
role::labs::instance
sudo::labs_project
role::labs::tools::compute
toollabs::node::compute::dedicated
31 March 2015 14:08:22 2 4,096 40
I-00000a04.eqiad.wmflabs tools-exec-24 m1.xlarge tools ubuntu-14.04-trusty i-00000a04.eqiad.wmflabs 28 March 2015 20:58:01 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
28 March 2015 21:02:18 8 16,384 160
I-00000a03.eqiad.wmflabs tools-exec-23 m1.xlarge tools ubuntu-14.04-trusty i-00000a03.eqiad.wmflabs 28 March 2015 20:57:30 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
28 March 2015 21:02:11 8 16,384 160
I-00000a02.eqiad.wmflabs tools-exec-22 m1.xlarge tools ubuntu-14.04-trusty i-00000a02.eqiad.wmflabs 28 March 2015 20:13:06 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
28 March 2015 20:17:14 8 16,384 160
I-00000a01.eqiad.wmflabs tools-exec-21 m1.xlarge tools ubuntu-14.04-trusty i-00000a01.eqiad.wmflabs 28 March 2015 20:12:40 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
28 March 2015 20:14:11 8 16,384 160
I-00000a00.eqiad.wmflabs tools-exec-20 m1.xlarge tools ubuntu-14.04-trusty i-00000a00.eqiad.wmflabs 28 March 2015 19:43:11 base
role::labs::instance
role::labs::tools::compute
toollabs::node::compute::general
28 March 2015 19:49:34 8 16,384 160
I-000000cb.eqiad.wmflabs tools-login m1.medium tools ubuntu-12.04-precise (deprecated 2014-04-17) i-000000cb.eqiad.wmflabs 208.80.155.130 28 February 2014 04:25:41 base
role::labs::instance
role::labs::tools::bastion
role::labs::tools::toolwatcher
23 March 2015 21:19:38 2 4,096 40
I-000000cc.eqiad.wmflabs tools-dev m1.medium tools ubuntu-12.04-precise (deprecated 2014-04-17) i-000000cc.eqiad.wmflabs 28 February 2014 04:28:13 base
role::labs::instance
role::labs::tools::bastion
23 March 2015 21:19:30 2 4,096 40
I-000006a5.eqiad.wmflabs tools-trusty m1.medium tools ubuntu-14.04-trusty (deprecated 2015-02-03) i-000006a5.eqiad.wmflabs 14 October 2014 15:27:16 base
role::labs::instance
role::labs::tools::bastion
23 March 2015 21:19:23 2 4,096 40
I-000009aa.eqiad.wmflabs tools-bastion-01 m1.large tools ubuntu-14.04-trusty i-000009aa.eqiad.wmflabs 22 March 2015 20:06:21 base
role::labs::instance
role::labs::tools::bastion
22 March 2015 20:41:07 4 8,192 80
I-00000931.eqiad.wmflabs tools-redis m1.xlarge tools ubuntu-14.04-trusty i-00000931.eqiad.wmflabs 11 March 2015 04:12:15 base
role::labs::instance
role::labs::tools::redis
11 March 2015 04:26:19 8 16,384 160
I-000008f0.eqiad.wmflabs tools-webgrid-07 m1.xlarge tools ubuntu-14.04-trusty i-000008f0.eqiad.wmflabs 28 February 2015 07:51:16 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::lighttpd
8 March 2015 23:11:14 8 16,384 160
I-00000819.eqiad.wmflabs tools-webgrid-06 m1.xlarge tools ubuntu-14.04-trusty (deprecated 2015-02-03) i-00000819.eqiad.wmflabs 1 February 2015 04:53:21 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::lighttpd
8 March 2015 23:08:36 8 16,384 160
I-000008fa.eqiad.wmflabs tools-redis-slave m1.xlarge tools ubuntu-14.04-trusty i-000008fa.eqiad.wmflabs 3 March 2015 07:11:56 base
role::labs::instance
role::labs::tools::redis::slave
3 March 2015 07:23:50 8 16,384 160
I-000008de.eqiad.wmflabs tools-webgrid-generic-02 m1.xlarge tools ubuntu-14.04-trusty i-000008de.eqiad.wmflabs 27 February 2015 15:10:37 base
role::labs::instance
role::labs::tools::compute
toollabs::node::web::generic
28 February 2015 08:15:09 8 16,384 160
I-000000ce.eqiad.wmflabs tools-shadow m1.small tools ubuntu-12.04-precise i-000000ce.eqiad.wmflabs 28 February 2014 04:30:35 base
role::labs::instance
exim::simple-mail-sender
sudo::labs_project
role::labs::tools::shadow
27 February 2015 14:01:41 1 2,048 20
I-000008b7.eqiad.wmflabs tools-webproxy-01 m1.medium tools ubuntu-14.04-trusty i-000008b7.eqiad.wmflabs 24 February 2015 06:48:09 base
role::labs::instance
role::labs::tools::proxy
27 February 2015 03:46:42 2 4,096 40
I-000000de.eqiad.wmflabs tools-exec-cyberbot m1.medium tools ubuntu-12.04-precise (deprecated 2014-04-17) i-000000de.eqiad.wmflabs 28 February 2014 04:40:25 base
role::labs::instance
sudo::labs_project
role::labs::tools::compute
toollabs::node::compute::dedicated
27 February 2015 03:18:33 2 4,096 40
I-000008b8.eqiad.wmflabs tools-webproxy-02 m1.medium tools ubuntu-14.04-trusty i-000008b8.eqiad.wmflabs base
role::labs::instance
role::labs::tools::proxy
24 February 2015 17:48:40 2 4,096 40
… further results