Nova Resource:Tools

From Wikitech
Jump to: navigation, search


Resource Type project
Project Name tools
Monitoring nagf
Admins
Members

Documentation

Edit documentation

Tool Labs

Description

The Tools project is one of two projects in the Tool Labs environment (the other being Toolsbeta).

Purpose

Runs end-user tools to support the projects

Anticipated traffic level

more than 1000 hits per day

Anticipated time span

indefinite

Project status

currently running

Contact address

Please create a Task on phabricator for support.

Tool Labs is run by:

With extra support from various people from the WMF Operations team.]]

Willing to take contributors or not

willing

Subject area narrow or broad

broad


Tool Labs is a reliable, scalable hosting environment for community developers working on tools and bots that help users maintain and use wikis. The cloud-based infrastructure was developed by the Wikimedia Foundation and is supported by a dedicated group of Wikimedia Foundation staff and volunteers. Tool Labs is a part of the Labs project, which is designed to make it easier for developers and system administrators to try out improvements to Wikimedia infrastructure, including MediaWiki, and to do analytics and bot work.

Tip: Confused about the terms labs, tool labs etc? Read Wikimedia Labs vs Tool Labs.

The Tool Labs environment provides:

  • Support for Web services, continuous bots, and scheduled tasks.
  • Access to replicated production databases.
  • Easily shared management of tool accounts, where tools and bots are stored.
  • A grid engine for dispatching jobs.
  • Support for mosh, SSH, SFTP without complicated proxy setup.
  • A shared pywikibot installation.
  • Version control via Gerrit and Git.
  • Support for Redis.

In general, every tool maintainer should work primarily on the Tools project (not Toolsbeta, which is for experiments to the Tool Labs environment itself).

Requesting access

After filling in the form, your request will then show up in the queue above, and will be processed shortly by one of the Tool Labs administrators.

Help-page

Tools Resources Overview

Useful links


SSH Fingerprints

tools-login: Help:SSH Fingerprints/tools-login.wmflabs.org


Topology of tools on labs Tool Labs design philosophy

Server admin log

2016-02-05

  • 22:01 chasemp: throttle some vm nfs write speeds
  • 16:49 scfc_de: find /data/project/wikidata-edits -group ssh-key-ldap-lookup -exec chgrp tools.wikidata-edits \{\} + (probably a remnant of the work on ssh-key-ldap-lookup last summer).
  • 16:45 scfc_de: Removed /data/project/test300 (uid/gid 52080; none of them resolves, no databases, just an unmodified pywikipedia clone inside).

2016-02-03

  • 03:00 YuviPanda: upgraded flannel on all hosts running it

2016-01-31

  • 20:01 scfc_de: tools-webgrid-generic-1405:... (more)

Instances for this project

FQDN Instance Type Image Id Public IP Number of CPUs RAM Size Amount of Storage Modification dateThis property is a special property in this wiki.
Tools-bastion-02.tools.eqiad.wmflabs ubuntu-14.04-trusty (deprecated 2015-06-13) 208.80.155.132 4 8,192 80 3 February 2016 18:02:54
Tools-docker-registry-01.tools.eqiad.wmflabs 8 16,384 160 3 February 2016 04:01:10
Tools-k8s-etcd-03.tools.eqiad.wmflabs debian-8.2-jessie 1 2,048 20 1 February 2016 23:54:30
Tools-k8s-etcd-02.tools.eqiad.wmflabs debian-8.2-jessie 1 2,048 20 1 February 2016 23:35:15
Tools-k8s-etcd-01.tools.eqiad.wmflabs debian-8.2-jessie 1 2,048 20 1 February 2016 23:25:25
Tools-flannel-etcd-03.tools.eqiad.wmflabs debian-8.2-jessie 1 2,048 20 1 February 2016 19:53:34
Tools-flannel-etcd-02.tools.eqiad.wmflabs debian-8.2-jessie 1 2,048 20 1 February 2016 02:35:08
Tools-flannel-etcd-01.tools.eqiad.wmflabs debian-8.2-jessie 1 2,048 20 1 February 2016 02:29:22
Tools-webgrid-generic-1405.tools.eqiad.wmflabs 4 8,192 80 31 January 2016 21:01:48
Tools-elastic-01.tools.eqiad.wmflabs 8 16,384 160 31 January 2016 19:01:01
Tools-worker-1003.tools.eqiad.wmflabs debian-8.2-jessie 4 8,192 80 29 January 2016 05:12:08
Tools-cron-01.tools.eqiad.wmflabs ubuntu-14.04-trusty 4 8,192 80 28 January 2016 16:02:04
Tools-webgrid-lighttpd-1206.tools.eqiad.wmflabs 4 8,192 80 27 January 2016 12:00:51
Tools-exec-1217.tools.eqiad.wmflabs 208.80.155.226 4 8,192 80 26 January 2016 22:01:35
Tools-submit.tools.eqiad.wmflabs ubuntu-12.04-precise (deprecated 2014-04-17) 1 2,048 20 23 January 2016 01:27:52
Sacrificial-kitten.tools.eqiad.wmflabs 1 2,048 20 22 January 2016 22:03:37
Tools-worker-06.tools.eqiad.wmflabs 1 2,048 20 21 January 2016 23:01:33
Tools-checker-01.tools.eqiad.wmflabs 1 2,048 20 21 January 2016 22:01:05
Tools-precise-dev.tools.eqiad.wmflabs 2 4,096 40 21 January 2016 22:01:02
Tools-web-static-02.tools.eqiad.wmflabs 4 8,192 80 21 January 2016 22:00:24
… further results