Tool:DrTrigonBot/Migration from TS

→ Tool Labs/Migration to eqiad#Phase III (restoring bulk copied tools), bugzilla:62976
→ migration; check Nova Resource:Tools/Help#Configuring mail -- mail forwarding and bugzilla:58796 (mw:Wikimedia Labs/Tool Labs/Roadmap en#Overview of available features in Tool Labs)
→→ migrate TS bots subster.py, subster_irc.py to labs
→→ should also get a maillist Lists.wikimedia.org, meta:Mailing_lists#Create_a_new_list in order to redirect bot mails to it, see bugzilla:61427

Migration Overview [tools/tool-labs]

WMDE Toolserver (TS)	WMF LabsConsole (labs)	Description	Status
https://toolserver.org/~drtrigon/	http://tools.wmflabs.org/drtrigonbot/ `/data/project/drtrigonbot/public_html/`	webspace root	Done^[1] (also for http://tools.wmflabs.org/)
https://toolserver.org/~drtrigon/cgi-bin/ tools:~drtrigon/cgi-bin/panel.py tools:~drtrigon/cgi-bin/substersim.py tools:~drtrigon/cgi-bin/sum_cat_disc.py tools:~drtrigon/cgi-bin/subster_mail_queue.py tools:~drtrigon/cgi-bin/filter.py tools:~drtrigon/cgi-bin/xsalt.py use with e.g.: atom2html.xslt, rss2html.xslt	http://tools.wmflabs.org/drtrigonbot/cgi-bin/ `/data/project/drtrigonbot/cgi-bin/` http://tools.wmflabs.org/drtrigonbot/cgi-bin/panel.py http://tools.wmflabs.org/drtrigonbot/cgi-bin/substersim.py http://tools.wmflabs.org/drtrigonbot/cgi-bin/sum_cat_disc.py http://tools.wmflabs.org/drtrigonbot/cgi-bin/subster_mail_queue.py http://tools.wmflabs.org/drtrigonbot/cgi-bin/filter.py http://tools.wmflabs.org/drtrigonbot/cgi-bin/xsalt.py http://tools.wmflabs.org/drtrigonbot/cgi-bin/info.py	webspace cgi	Done
drtrigon+subster@toolserver.org	bugzilla:58796 (mw:Wikimedia Labs/Tool Labs/Roadmap en#Overview of available features in Tool Labs)	webmail	OPEN (not available but "planned")
http://svn.toolserver.org/svnroot/drtrigon/ https://fisheye.toolserver.org/changelog/drtrigon	https://phabricator.wikimedia.org/diffusion/PWDT/ github mirror https://gerrit.wikimedia.org/r/#/projects/pywikibot/bots/drtrigonbot,dashboards/default	code source repo	Done^[2]^[3]^[4] (in use)
https://jira.toolserver.org/browse/DRTRIGON	https://bugzilla.wikimedia.org/describecomponents.cgi?product=Tool%20Labs%20tools https://bugzilla.wikimedia.org/describecomponents.cgi?product=Pywikibot	code issue tracker	Done, see bugzilla:55673^[5], jira archive according to maillist
`~/rewrite/`	`/data/project/drtrigonbot/pywikibot-core/`	run rewrite bot	Done (status, `script_wui.py`)
`~/pywikipedia/`	`/data/project/drtrigonbot/pywikibot-compat/`	run trunk bot	Done^[6] (`sum_disc.py`, `catimages.py` - tests running for `subster.py`, `subster_irc.py`)
cronie + queue	crontab + queue (grid engine)	setup cron jobs	Done - status
`/home/drtrigon/` (`~/`)	`/data/project/drtrigonbot/` (`~/`)	setup home tools	Done - fabfile (setup/install, backup^[7], update by git, list_large_files, ...)
Database access	Nova Resource:Tools/Help#Database access	(my)sql	Done (see sum_cat_disc.py)
https://wiki.toolserver.org/view/Default_license https://wiki.toolserver.org/view/Toollizenz/draft/en (GPL-compatible)	http://opensource.org/licenses/GPL-3.0 (may be later LGPL-3.0) some libraries other (e.g. MIT, ...)	licensing	Done ('free software' might be too strict for some libs)
https://wiki.toolserver.org/view/User:DrTrigon	(publish extension page; my git repos, pywikibot also if not done already, ...)	extension page	OPEN (open source too strict)
https://toolserver.org/~drtrigon/doc/ (containing `DrTrigonBot`)	http://tools.wmflabs.org/drtrigonbot/docs/ `/data/project/drtrigonbot/public_html/docs/` (like `logs` containing `compat`, `core`, etc.)	code docs	Done - compat docs generation works and links present
...	...	...	...

Migration Overview [bots - obsolete]

WMDE Toolserver (TS)	WMF LabsConsole (labs)	Description	Status
https://toolserver.org/~drtrigon/	http://bots.wmflabs.org/~drtrigon/ `/data/project/DrTrigonBot/public_html/` `/data/project/public_html/drtrigon/`	webspace root	Done^[8] (not setup yet)
https://toolserver.org/~drtrigon/cgi-bin/	http://bots.wmflabs.org/~drtrigon/cgi-bin/ `/data/project/public_html/drtrigon/cgi-bin/`	webspace cgi	Done (not setup yet) needs some work, e.g. panel.py?action=logstat
drtrigon+subster@toolserver.org	(mail address ???)^[9]	webmail	OPEN (not available but "planned")
http://svn.toolserver.org/svnroot/drtrigon/ https://fisheye.toolserver.org/changelog/drtrigon	(mw:Git/Creating new repositories)	code source repo	OPEN (use git-svn^[10]^[11])
https://jira.toolserver.org/browse/DRTRIGON	(https://bugzilla.wikimedia.org/enter_bug.cgi?product=Wikimedia%20Labs)	code issue tracker	OPEN (other "product"? conversion needed?)
`~/rewrite/`	`/data/project/DrTrigonBot/rewrite/`	run rewrite bot	Done (not tested yet)
`~/pywikipedia/`	`/data/project/DrTrigonBot/pywikipedia/`	run trunk bot	OPEN (run and test bots)
cronie + queue	crontab^[12] + pgrep (as well as anacron, watchdog^[13]^[14], monit or "queued" solution^[15])	setup cron jobs	Done
`~/`	`/data/project/DrTrigonBot/` and `~/`	setup home tools	OPEN (setup backup^[16] and other maintenance tools)
Database access	(January or February 2013)	(my)sql	OPEN (sql support for tools)
...	...	licensing	OPEN (open source too strict)
...	...	...	...

References

↑ Display instead of download .log files: http://stackoverflow.com/questions/3935580/htaccess-addtype-plain-text (/data/project/public_html/drtrigon/DrTrigonBot/.htaccess)
↑ http://www.kernel.org/pub/software/scm/git/docs/git-svn.html
↑ http://www.pro-linux.de/kurztipps/2/1514/git-und-subversion-gemeinsam-nutzen.html
↑ mw:Git/New repositories/Requests
↑ bugzilla:58794 - Provide upgrade path for jira users
↑ needed software installed; https://bugzilla.wikimedia.org/show_bug.cgi?id=53704
↑ According to Damianz #wikimedia-labs 2012-12-28; No backup!!! Do version control and look for the "/home" (and else, e.g. "/data") backup yourself!
↑ Display instead of download .log files: http://stackoverflow.com/questions/3935580/htaccess-addtype-plain-text (/data/project/public_html/drtrigon/DrTrigonBot/.htaccess)
↑ According to Damianz #wikimedia-labs 2012-12-28; not possible at the moment, no idea when it will be. But is some kind of planned.
↑ http://www.kernel.org/pub/software/scm/git/docs/git-svn.html
↑ http://www.pro-linux.de/kurztipps/2/1514/git-und-subversion-gemeinsam-nutzen.html
↑ http://askubuntu.com/questions/23009/reasons-why-crontab-does-not-work
↑ http://stackoverflow.com/questions/2366693/run-cron-job-only-if-it-isnt-already-running
↑ http://stackoverflow.com/questions/8084142/check-if-rpm-exists-in-bash-script-silently
↑ According to Ryan_Lane #wikimedia-labs 2012-12-29; crontab + watchdog is ok. Queue (like SGE) not needed at the moment (enough ressources) but might come in future, e.g. for db access.
↑ According to Damianz #wikimedia-labs 2012-12-28; No backup!!! Do version control and look for the "/home" (and else, e.g. "/data") backup yourself!

[1] Display instead of download .log files: http://stackoverflow.com/questions/3935580/htaccess-addtype-plain-text (/data/project/public_html/drtrigon/DrTrigonBot/.htaccess)

[2] ttp://www.kernel.org/pub/software/scm/git/docs/git-svn.html

[3] ttp://www.pro-linux.de/kurztipps/2/1514/git-und-subversion-gemeinsam-nutzen.html

[4] w:Git/New repositories/Requests

[5] ugzilla:58794 - Provide upgrade path for jira users

[6] software installed; https://bugzilla.wikimedia.org/show_bug.cgi?id=53704

[7] According to Damianz #wikimedia-labs 2012-12-28; No backup!!! Do version control and look for the "/home" (and else, e.g. "/data") backup yourself!

[8] Display instead of download .log files: http://stackoverflow.com/questions/3935580/htaccess-addtype-plain-text (/data/project/public_html/drtrigon/DrTrigonBot/.htaccess)

[9] According to Damianz #wikimedia-labs 2012-12-28; not possible at the moment, no idea when it will be. But is some kind of planned.

[10] ttp://www.kernel.org/pub/software/scm/git/docs/git-svn.html

[11] ttp://www.pro-linux.de/kurztipps/2/1514/git-und-subversion-gemeinsam-nutzen.html

[12] ttp://askubuntu.com/questions/23009/reasons-why-crontab-does-not-work

[13] ttp://stackoverflow.com/questions/2366693/run-cron-job-only-if-it-isnt-already-running

[14] ttp://stackoverflow.com/questions/8084142/check-if-rpm-exists-in-bash-script-silently

[15] According to Ryan_Lane #wikimedia-labs 2012-12-29; crontab + watchdog is ok. Queue (like SGE) not needed at the moment (enough ressources) but might come in future, e.g. for db access.

[16] According to Damianz #wikimedia-labs 2012-12-28; No backup!!! Do version control and look for the "/home" (and else, e.g. "/data") backup yourself!

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]

[15]

[16]