Tool:DrTrigonBot/Migration from TS

From Wikitech
Jump to navigation Jump to search
Tool Labs/Migration to eqiad#Phase III (restoring bulk copied tools), bugzilla:62976
→ migration; check Nova Resource:Tools/Help#Configuring mail -- mail forwarding and bugzilla:58796 (mw:Wikimedia Labs/Tool Labs/Roadmap en#Overview of available features in Tool Labs)
→→ migrate TS bots subster.py, subster_irc.py to labs
→→ should also get a maillist Lists.wikimedia.org, meta:Mailing_lists#Create_a_new_list in order to redirect bot mails to it, see bugzilla:61427

Migration Overview [tools/tool-labs]

WMDE Toolserver (TS) WMF LabsConsole (labs) Description Status
https://toolserver.org/~drtrigon/ http://tools.wmflabs.org/drtrigonbot/

/data/project/drtrigonbot/public_html/

webspace root Yes Done[1] (also for http://tools.wmflabs.org/)
https://toolserver.org/~drtrigon/cgi-bin/



http://tools.wmflabs.org/drtrigonbot/cgi-bin/

/data/project/drtrigonbot/cgi-bin/


webspace cgi Yes Done
drtrigon+subster@toolserver.org bugzilla:58796 (mw:Wikimedia Labs/Tool Labs/Roadmap en#Overview of available features in Tool Labs) webmail OPEN (not available but "planned")
http://svn.toolserver.org/svnroot/drtrigon/

https://fisheye.toolserver.org/changelog/drtrigon

https://phabricator.wikimedia.org/diffusion/PWDT/ github mirror

https://gerrit.wikimedia.org/r/#/projects/pywikibot/bots/drtrigonbot,dashboards/default

code source repo Yes Done[2][3][4] (in use)
https://jira.toolserver.org/browse/DRTRIGON https://bugzilla.wikimedia.org/describecomponents.cgi?product=Tool%20Labs%20tools

https://bugzilla.wikimedia.org/describecomponents.cgi?product=Pywikibot

code issue tracker Yes Done, see bugzilla:55673[5], jira archive according to maillist
~/rewrite/ /data/project/drtrigonbot/pywikibot-core/ run rewrite bot Yes Done (status, script_wui.py)
~/pywikipedia/ /data/project/drtrigonbot/pywikibot-compat/ run trunk bot Yes Done[6] (sum_disc.py, catimages.py - tests running for subster.py, subster_irc.py)
cronie + queue crontab + queue (grid engine) setup cron jobs Yes Done - status
/home/drtrigon/ (~/) /data/project/drtrigonbot/ (~/) setup home tools Yes Done - fabfile (setup/install, backup[7], update by git, list_large_files, ...)
Database access Nova Resource:Tools/Help#Database access (my)sql Yes Done (see sum_cat_disc.py)
https://wiki.toolserver.org/view/Default_license

https://wiki.toolserver.org/view/Toollizenz/draft/en (GPL-compatible)

http://opensource.org/licenses/GPL-3.0 (may be later LGPL-3.0)
some libraries other (e.g. MIT, ...)
licensing Yes Done ('free software' might be too strict for some libs)
https://wiki.toolserver.org/view/User:DrTrigon (publish extension page; my git repos, pywikibot also if not done already, ...) extension page OPEN (open source too strict)
https://toolserver.org/~drtrigon/doc/


(containing DrTrigonBot)

http://tools.wmflabs.org/drtrigonbot/docs/

/data/project/drtrigonbot/public_html/docs/
(like logs containing compat, core, etc.)

code docs Yes Done - compat docs generation works and links present
... ... ... ...

Migration Overview [bots - obsolete]

WMDE Toolserver (TS) WMF LabsConsole (labs) Description Status
https://toolserver.org/~drtrigon/ http://bots.wmflabs.org/~drtrigon/

/data/project/DrTrigonBot/public_html/
/data/project/public_html/drtrigon/

webspace root Yes Done[8] (not setup yet)
https://toolserver.org/~drtrigon/cgi-bin/ http://bots.wmflabs.org/~drtrigon/cgi-bin/

/data/project/public_html/drtrigon/cgi-bin/

webspace cgi Yes Done (not setup yet)

needs some work, e.g. panel.py?action=logstat

drtrigon+subster@toolserver.org (mail address ???)[9] webmail OPEN (not available but "planned")
http://svn.toolserver.org/svnroot/drtrigon/

https://fisheye.toolserver.org/changelog/drtrigon

(mw:Git/Creating new repositories) code source repo OPEN (use git-svn[10][11])
https://jira.toolserver.org/browse/DRTRIGON (https://bugzilla.wikimedia.org/enter_bug.cgi?product=Wikimedia%20Labs) code issue tracker OPEN (other "product"? conversion needed?)
~/rewrite/ /data/project/DrTrigonBot/rewrite/ run rewrite bot Yes Done (not tested yet)
~/pywikipedia/ /data/project/DrTrigonBot/pywikipedia/ run trunk bot OPEN (run and test bots)
cronie + queue crontab[12] + pgrep

(as well as anacron, watchdog[13][14], monit or "queued" solution[15])

setup cron jobs Yes Done
~/ /data/project/DrTrigonBot/ and ~/ setup home tools OPEN (setup backup[16] and other maintenance tools)
Database access (January or February 2013) (my)sql OPEN (sql support for tools)
... ... licensing OPEN (open source too strict)
... ... ... ...

References

  1. Display instead of download .log files: http://stackoverflow.com/questions/3935580/htaccess-addtype-plain-text (/data/project/public_html/drtrigon/DrTrigonBot/.htaccess)
  2. http://www.kernel.org/pub/software/scm/git/docs/git-svn.html
  3. http://www.pro-linux.de/kurztipps/2/1514/git-und-subversion-gemeinsam-nutzen.html
  4. mw:Git/New repositories/Requests
  5. bugzilla:58794 - Provide upgrade path for jira users
  6. needed software installed; https://bugzilla.wikimedia.org/show_bug.cgi?id=53704
  7. According to Damianz #wikimedia-labs 2012-12-28; No backup!!! Do version control and look for the "/home" (and else, e.g. "/data") backup yourself!
  8. Display instead of download .log files: http://stackoverflow.com/questions/3935580/htaccess-addtype-plain-text (/data/project/public_html/drtrigon/DrTrigonBot/.htaccess)
  9. According to Damianz #wikimedia-labs 2012-12-28; not possible at the moment, no idea when it will be. But is some kind of planned.
  10. http://www.kernel.org/pub/software/scm/git/docs/git-svn.html
  11. http://www.pro-linux.de/kurztipps/2/1514/git-und-subversion-gemeinsam-nutzen.html
  12. http://askubuntu.com/questions/23009/reasons-why-crontab-does-not-work
  13. http://stackoverflow.com/questions/2366693/run-cron-job-only-if-it-isnt-already-running
  14. http://stackoverflow.com/questions/8084142/check-if-rpm-exists-in-bash-script-silently
  15. According to Ryan_Lane #wikimedia-labs 2012-12-29; crontab + watchdog is ok. Queue (like SGE) not needed at the moment (enough ressources) but might come in future, e.g. for db access.
  16. According to Damianz #wikimedia-labs 2012-12-28; No backup!!! Do version control and look for the "/home" (and else, e.g. "/data") backup yourself!