Nova Resource Talk:Tools

From Wikitech
Jump to: navigation, search

Requesting access to the Tool Labs?

Click here.


Please add me to the project. I'd create some tools (from and operate my bot. --Ricordisamoa 21:04, 15 May 2013 (UTC)

Yes check.svg Done — Coren/Marc (talk) 21:35, 15 May 2013 (UTC)

A few requests

Howdy admin-guys. Firstly, good job with the setup - I've tried migrating a few simpler tools over from the toolserver and been impressed with how simple it's been so far. I've a few minor requests which I'll post here for now (I couldn't work out your preferred method of receiving jobs - a statement on the project page along the lines of "if you need an admin to do something, click here to submit a JIRA ticket" might be useful).

  • When creating a new project, it seems to need an hour or so before one is able to 'become' the project role user. Something odd with the propagation of accounts perhaps. Perfectly acceptable, but could use documenting to avoid confusing newbies like myself.
  • The toolserver had a 'toolserver' database available on all shards containing a handful of useful reference tables. While it's no biggie to copy these into a user database, enough tools depend on them that you might end up hosting a few hundred duplicates. Could we have a similar facility here?
  • I found by trial and error that you have a sensible sftp setup. A mention of this on the project 'getting started' guide might assist other incomers.

Cheers. - tb (talk) 09:45, 24 May 2013 (UTC)

A few more, with apologies in advance and assurances that none of this is urgent - I know you're still setting up the 'big things':
  • I'm unable to explain queries in mysql ("ERROR 1345 (HY000): EXPLAIN/SHOW can not be issued; lacking privileges for underlying table"). In all fairness, the toolserver has the same quirk, but it does make testing and optimising a pain.
  • Can I check that user databases are being backed up, and that it's possible (in case of dire need only of course) to request a restore of such a backup to a temporary user database.
- tb (talk) 09:30, 25 May 2013 (UTC)
(Self-response for those that come after me; use Bugzilla (product "Wikimedia Labs", component "tools") to raise non-urgent things with the project admins. Relevant bugzilla tikets for the queries above are:
  • Unable to explain queries; 48875
  • Toolserver meta-information database 48626 & 48625
AFAIK there are no backups of the user databases either on tools-db or the replication slaves. Personally, I work on the assumption that any crashes of the database servers would be so disruptive that the user databases were the smallest problem of them all, and so I don't care for data that can be reproduced (i. e. scanning a dump, executing queries, etc.), and check static data into the repository of the tool. If your tool has user data that needs to be preserved, I would schedule a daily cron job that dumps the tables that are important to a file in the tool's directory. The latter is (somewhat) backed up (cf. Nova Resource:Tools/Help#Backups). --Tim Landscheidt (talk) 23:40, 10 June 2013 (UTC)

Remove tool wpb

Hi there, could you please remove the tool wpb? It is redundant to pb. Thanks! --ireas (talk) 14:19, 11 September 2013 (UTC)

slow slow slow!


I try to move my global contributions tool to Labs. But the Problem is, that this servers seems to be much slower than the toolserver? If I scan all wikis, I get a proxy error after +/- 1min. Now I have limited it to the first 100 wikis, it's working but very very slow. e.g. vs.

I use a new script on Labs, which should be faster because it uses MySQL JOIN's exept two querys like the old script.

From my point of view it will get hard to move the tool to here if the server speed doesn't get boosted.

Greetings, --Luxo (talk) 15:32, 6 October 2013 (UTC)

Hallo Luxo, versuche doch mal, die indizierte Tabelle revision_userindex zu nutzen. Bei mir hat das wahre Wunder bewirkt, siehe Bug 54107. --ireas (talk) 21:38, 15 October 2013 (UTC)

Current queue

any chance that someone can find the time and work through the current queue before the weekend?
Thanks, Amalthea 11:43, 17 October 2013 (UTC)

Pcount tool?

Hi! What happened to this tool? Is there a replacement or some idea of bringing it back into action? Best of wishe.--Paracel63 (talk) 16:16, 17 March 2014 (UTC)

It's working and is stable now, please report the problems on JackPotte (talk) 21:27, 25 August 2014 (UTC)

Tools offline

I just noticed that a lot of tools are offline.

Also the tool that I'm responsible for is offline and it seems like all files in /data/project/svwiktionary/public_html/ have been deleted. Why? skalman (talk) 19:30, 17 March 2014 (UTC)

Tools are in migration from pmtpa to eqiad right at this moment. See [1] and Tool_Labs/Migration_to_eqiad. --Hedonil (talk) 19:35, 17 March 2014 (UTC)


I reverted the most recent edit because I suspect the user of being a vandal (and have now blocked User:Helperf). Someone with more expertise on who should have what permissions: please check it out. sumanah (talk) 13:29, 15 May 2014 (UTC)

Starting webservice... failed.

I have hosted because the developer has abandoned it and I needed to see if it would deserve to be maintained. However the HTTP server was unstable (so I should set a cron to relaunch it regularly) and since today the following command doesn't work anymore:

tools.jackbot@tools-login:~$ webservice restart
Starting webservice... failed.

Just before it stopped, access.log displayed many different connections, probably because wikipedia:Wikipedia:Wikimedia_Labs/Toolserver_replacements redirects to it.

The error.log is empty for many hours:

2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4762
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4785
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4776
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4767
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4772
2014-08-25 02:37:00: (mod_cgi.c.590) cgi died, pid: 4737
2014-08-25 02:37:00: (server.c.1512) server stopped by UID = 0 PID = 401

So the server seems to be shutdown, how could we solve this please? JackPotte (talk) 21:34, 25 August 2014 (UTC)

Yes check.svg Done I don't know why, but it's resolved now. JackPotte (talk) 20:52, 26 August 2014 (UTC)
But this service has always been unstable and should be restarted regularly. JackPotte (talk) 10:19, 4 October 2014 (UTC)
Now I see that every tools are out of order for at least one hour, there should be a more specific error than time out on JackPotte (talk) 22:57, 7 October 2014 (UTC)
It's getting worse and worse:
tools.jackbot@tools-login:~$ qstat
error: commlib error: got select error (Connection refused)
error: unable to send message to qmaster using port 6444 on host "tools-master.eqiad.wmflabs": got send error

JackPotte (talk) 12:08, 11 October 2014 (UTC)

Edit Counters missing data

The message below was posted at Village pump (technical) regarding an issue with the edit counters but so far no-one there seems able to help. Anyone here who can shed a light on this? Thx.--Wolbo (talk) 18:18, 1 November 2014 (UTC)

Various reports have been made in the last week or so about the Xtools edit counter being down. While it seems to be operational again since a day or two I noticed that edit data from October 24 and following days appears to be missing. Example 1) I made 8 edits to the Rod Laver article on October 27 (see [revision history]) but these do not show up in the [Revision history statistics] or [Edits by user] overviews. Example 2) I made 18 edits to the All England Plate article on October 25 which do not show in the [Revision history statistics] or [Edits by user] and also do not appear on my user edit count overview (Contributions > Edit count > Top edited pages section). Note that the edits on October 24 (and the one on October 29) have been captured. Is this a known issue and will it be repaired?--Wolbo (talk) 02:16, 30 October 2014 (UTC)
This may be the same issue that I reported here. --Redrose64 (talk) 08:14, 30 October 2014 (UTC)
Perhaps. I reported the issue at Github but was informed that it was not a specific Xtools issue because other tools, like [Edits by user], also showed missing data and that it had "something to do with Labs Replication DBs". So are there people here who can take this issue on or else point me to the right place to follow-up? Thx.--Wolbo (talk) 20:46, 30 October 2014 (UTC)

Looking for a Tool Labs administrator available on the 21st of August

Hi everyone,

On August 21, I'll be giving a technical talk to ~40 people at the French WikiConvention.

Among other things (Phabricator, Gerrit…), I'll present the Wikimedia Labs and the Tool Labs. If time permits, I'd really like to get interested people to request a Tool Labs access “live” and create a simple tool with a dummy home page (eg. run a trivial SQL query and make output available to Wikipedians).

Do you think it would be possible / acceptable to have an administrator available on #wikimedia-labs at the time of the talk to process the access requests with me while people are taking a break?

The talk will last from Sunday, August 21 at 14:00 to 18:00 CEST (12 PM to 4 PM UTC), with a break around 15:45 CEST (1:45 PM UTC). I was thinking of making people request an access ASAP before the break, and if possible (ie. enough time and you being fine with the idea) start using it after the break.

I'm of course open to suggestions ;-)

Thanks in advance and best regards — Arkanosis 14:44, 14 August 2016 (UTC)

Hi again,
Just in case nobody is watching this page: cc. User:Tim Landscheidt, User:Merlijn van Deen, User:Alex Monk.
No offense taken if nobody is available or willing to do that, of course :)
Thanks again and best regards — Arkanosis 11:51, 20 August 2016 (UTC)
Sorry, I'm on holiday at the moment and can't attend this.
I'm not really a proper active administrator of tools specifically anyway, I just help out with some technical things across labs in general and projectadmin in tools recently became relevant to a specific task. --Alex Monk (talkcontribs) 22:38, 20 August 2016 (UTC)
Hi Alex :)
Thanks for you kind reply. We managed to create the accounts with the precious help of valhallasw; it was great.
I hope you're having a nice holiday :)
Best regards — Arkanosis 22:30, 21 August 2016 (UTC)
Hi Jérémie, I'll probably be around, but I can't guarantee I will respond to each request within a very short time span. I will put a reminder in my calendar for 15:45 PM CEST. Will you be around on IRC yourself? valhallasw (Merlijn van Deen) (talk) 09:40, 21 August 2016 (UTC)
Hi! Thank you very much!
I'm on IRC already :) — Arkanosis 12:08, 21 August 2016 (UTC)
Hi again valhallasw :)
Just a follow-up of yesterday's talk: 11 people have been willing to create an account on tool labs and were able to do so with your help.
All of them but one (GAllegre — we've not managed to understand why, as he was running an up-to-date Debian, and he'll probably get in touch with you to try to understand the issue) managed to log in on the bastion. Most have already created their first tool account, with one of them very close to release its first version.
Thanks again and best regards — Arkanosis 22:30, 21 August 2016 (UTC)