Jump to content
Nova Resource : Tools.zppixbot-test/SAL
2021-03-05
10:03 wm-bot: <rhinosf1> cleanup used stuff
2021-03-02
22:19 wm-bot: <rhinosf1> MariaDB [(none)]> DROP DATABASE s54287__quotes;
2021-02-15
12:58 MacFan4000: <RhinosF1> synced access rights
2020-07-01
09:00 RhinosF1: decom complete
08:51 RhinosF1: decom
2020-06-28
21:16 MacFan4000: restarting for config changes (trying to fix stuff)
21:03 MacFan4000: restarting for config changes (trying to fix stuff)
2020-06-26
22:31 RhinosF1: starting things back up after T256502
21:21 RhinosF1: backup dbs, rm everything else python related -- T256502
21:14 RhinosF1: shut down for T256502
2020-06-24
19:32 MacFan4000: restarting for config/code change
15:46 RhinosF1: updating test to py37 -- T254246
15:16 MacFan4000: restarting for config/code change
2020-06-23
17:47 MacFan4000: restarting or config change
17:12 MacFan4000: restarting for config change
16:55 MacFan4000: restarting for config change
14:24 MacFan4000: rm -rf credentials.txt (superseded by default.cfg)
01:18 wm-bot: <macfan4000> restarting for config change
00:20 wm-bot: <macfan4000> restarting for config change
00:02 wm-bot: <macfan4000> restarting for config change
2020-06-22
23:37 wm-bot: <macfan4000> restarting for config change
23:23 wm-bot: <macfan4000> restarting for config change
23:19 wm-bot: <macfan4000> restarting for config change
23:11 wm-bot: <macfan4000> restarting for config/code changes
2020-06-21
21:24 RhinosF1: reset & updated mhphab config T255922
21:17 RhinosF1: reset & updated status.py config T255922
2020-06-20
23:05 RhinosF1: restart all pods to unfallout T255926
21:39 RhinosF1: deploy a status config change (temp due to fallout) and add new twitter api key --T255922
18:34 RhinosF1: revoke access of EK for ToU vio
2020-06-18
21:38 RhinosF1: started deployment back -- T255763
21:29 RhinosF1: stop sopel to reset pip, pyc, and mmdb -- T255763
2020-06-17
00:37 MacFan4000: restarting for config updates
00:20 MacFan4000: restarting again
00:18 MacFan4000: restart for new module/config changes and created MySQL database for quotes
2020-06-16
19:45 MacFan4000: restarting after reverting
19:37 MacFan4000: restarting for new pip module
14:48 MacFan4000: restarting
2020-06-15
16:27 MacFan4000: remove test channels
16:00 MacFan4000: restart for config/code changes
2020-06-11
23:58 MacFan4000: restarting again
23:30 MacFan4000: restarting for config/code changes
19:17 RhinosF1: i meant wikimedia/wikitech - my brain was down as well apparently
19:16 RhinosF1: restarted a few times while wikidata was down to deploy various stuff
19:16 bd808: Testing wikitech logging
10:18 RhinosF1: tools.zppixbot-test@tools-sgebastion-08:~$ grep -r -D skip "last_event_at" (in case anything seems slow, may take a while, please don't kill anything while I do it) END
10:14 RhinosF1: tools.zppixbot-test@tools-sgebastion-08:~$ grep -r -D skip "last_event_at" (in case anything seems slow, may take a while, please don't kill anything while I do it)
2020-06-10
22:19 MacFan4000: restarting for config changes (fixing typo) T255077
22:12 MacFan4000: restarting for code/config changes T255077
21:46 Texas: chmod -R g+w $HOME
2020-06-09
21:44 RhinosF1: keeping logging_channel off with debug logs and hoping the bot timesout to get some decent non log spammed logs to try and fix bug 2/3 in T254348
21:17 RhinosF1: - messing stuff up to test T254348
09:47 RhinosF1: outage over
09:47 RhinosF1: rolled back sopelbot to python 3.5 -- END due to T254348 (cc T254246 )
09:41 RhinosF1: delete deployment to begin rolling back T254246 due to T254348
08:29 RhinosF1: Recovery not expected before 10am
08:03 RhinosF1: investigating incident T254348
2020-06-08
21:30 RhinosF1: recreate deployment in py3.7 for T254246 END
21:22 RhinosF1: deleted sopel deployment to switch to py3.7 START -- T254246
17:24 wm-bot: <zppix1> re-enable reload
17:21 MacFan4000: restarted for code changes
2020-06-07
21:44 RhinosF1: remove old url config and add twitter api keys to fix T254348 - also disable reload at same tome
2020-06-06
22:12 RhinosF1: no known reason for current increase in timeouts
21:55 RhinosF1: invesigating incident
2020-06-05
21:58 MacFan4000: restarting for code and config changes
2020-06-04
15:48 MacFan4000: restarting web service as php7.3
14:49 MacFan4000: restart for config and code changes
07:35 RhinosF1: tools.zppixbot-test@tools-sgebastion-07:~/public_html/new-web/public_html/Font-Awesome$ git submodule init && git submodule update
2020-06-03
23:24 MacFan4000: restart (again)
23:21 MacFan4000: restart (again)
23:15 MacFan4000: restart (again)
23:09 MacFan4000: restart for code changes
22:17 Texas: kubectl delete pods sopeltest.bot-6876f8c6b4-pj7pq
22:16 Texas: git pull
20:37 MacFan4000: restart for config changes
18:56 Texas: restarting bot to apply changes
18:55 Texas: git pull
18:49 Texas: kubectl delete pods sopeltest.bot-6876f8c6b4-lzhmp
18:48 Texas: git pull
18:37 Texas: kubectl delete pods sopeltest.bot-6876f8c6b4-596wx
18:15 RhinosF1: python is now 3.5 due to T254348 cc T254246
18:13 Texas: kubectl delete pods sopeltest.bot-6876f8c6b4-qmpmz
18:11 Texas: chmod a+x starter-new.sh
18:01 Texas: kubectl create deployment --validate=true -f /data/project/zppixbot-test/k8s/sopelbot.yaml
17:58 RhinosF1: rolling back to python 3.5 with examknow due to T254348 cc T254246
17:58 wm-bot: <dschultz> kubectl delete deployment sopeltest.bot
13:29 RhinosF1: service restored
13:23 RhinosF1: tools.zppixbot-test@tools-sgebastion-07:~$ kubectl delete pods --all
13:07 RhinosF1: OUTAGE UNDER INVESTIGATION
10:55 RhinosF1: hack zppixbot-test public_html to live demo https://gerrit.wikimedia.org/r/602041
2020-06-02
21:20 RhinosF1: Switch to 3.7 DONE - Safe to reboot
21:04 RhinosF1: updating to python 3.7 - DO NOT RESTART
21:03 MacFan4000: add me to admins and reboot
20:59 Zppix: add Examknow to maintainers
20:40 Zppix: Add MacFan4000 to maintainers
14:52 wm-bot: <rhinosf1> reverted to python3.5
14:19 wm-bot: <rhinosf1> upgrading python to 3.7
09:52 RhinosF1: run dbclean.py for nick_id 28 & 34 - SUCESS
2020-06-01
2020-05-30
21:52 RhinosF1: Maint Complete!
21:49 wm-bot: <rhinosf1> chmod a+x starter-new.sh
21:26 RhinosF1: tools.zppixbot-test@tools-sgebastion-07:~/k8s$ take /data/project/zppixbot-test/k8s/starter-new.sh - I hate forklift's file handling at times
21:14 RhinosF1: tools.zppixbot-test tools.zppixbot-test@tools-sgebastion-07:~/.sopel$ kubectl scale --replicas=1 deployment.apps/sopeltest.bot
21:01 RhinosF1: rename starter.sh to starter-old and create starter-new - move zppixbot-test to use it for the deployment
21:00 RhinosF1: switch that to sopeltest.bot
20:59 RhinosF1: tools.zppixbot-test@tools-sgebastion-07:~/.sopel$ kubectl scale --replicas=0 deployment.apps/zppixbot-test
2020-05-29
22:10 wm-bot: <rhinosf1> dropped old logs
22:07 wm-bot: <rhinosf1> purge old *.*db files, tar+gzip logs/* and nuke the pycahce's
2020-05-28
10:07 wm-bot: <rhinosf1> tweaking stuff for testing
2020-05-27
11:45 RhinosF1: git pull & kubectl pods delete --all to sync pip3
2020-05-26
08:46 RhinosF1: added rm sopel-default.pid to starter.sh as otherwise the bot gets very angry and refuses to start
08:34 wm-bot: <rhinosf1> Successfully installed PyYAML-5.3.1 SQLAlchemy-1.3.17 certifi-2020.4.5.1 dnspython-1.16.0 geoip2-3.0.0 jedi-0.17.0 maxminddb-1.5.4 multidict-4.7.6 parso-0.7.0 praw-7.0.0 prawcore-1.3.0 pytz-2020.1 six-1.15.0 sopel-7.0.4 update-checker-0.17 urllib3-1.25.9 wcwidth-0.1.9 websocket-client-0.57.0 yarl-1.4.2
08:31 RhinosF1: tools.zppixbot-test@tools-sgebastion-07:~/.sopel$ git pull && tools.zppixbot-test@tools-sgebastion-07:~/.sopel$ /data/project/zppixbot-test/zppixbottest/bin//pip3 install -U -r /data/project/zppixbot-test/26maypip3.txt && restart pods
08:22 RhinosF1: tools.zppixbot-test@tools-sgebastion-07:~$ /data/project/zppixbot-test/zppixbottest/bin//pip3 freeze > /data/project/zppixbot-test/26maypip3.txt
08:20 RhinosF1: updating everything and deploying stuff
2020-05-22
13:20 wm-bot: <rhinosf1> ZppixBot Upgrades done for today - 1 known issue - If anything crashes after now, it's not known and/or me
10:26 wm-bot: <rhinosf1> fix a mistake in starter.sh
10:14 wm-bot: <rhinosf1> deploying phabricator update && a few other things on the way
2020-05-21
10:10 wm-bot: <rhinosf1> drop remind from exclude && git pull && reboot twice for tests when travis passes
2020-05-20
10:06 wm-bot: <rhinosf1> all services rebooted
10:02 wm-bot: <rhinosf1> drop abuse.py
09:53 wm-bot: <rhinosf1> webservice stop && kubectl delete pods --all & webservice start due to memory improperly loaded
2020-05-12
08:58 wm-bot: <rhinosf1> rolling back T250861
2020-05-05
09:22 RhinosF1: Test Bot to 240s timeout refs T250861 - rolling timeout to 300s
2020-04-29
09:22 RhinosF1: Prod Bot to 210s timeout refs T250861 - rolling timeout to 300s
2020-04-22
17:59 wm-bot: <zppix1> restart to pickup new API key
10:51 RhinosF1: Test Bot to 210s timeout refs T250861 - rolling timeout to 300s
2020-04-14
2020-04-02
10:11 RhinosF1: approved zhuyifei1999_ to debug network issues - T248960
2020-03-25
11:50 wm-bot: <rhinosf1> restarted bot, config change
11:38 RhinosF1: turn on log_raw
2020-03-23
15:46 wm-bot: <rhinosf1> restarted -test pod to deploy eee8d55
2020-03-17
22:11 PartyRhino: rebooting to sync database and config
22:04 wm-bot: <rhinosf1> rhinosf1@tools.zppixbot-test syncing files & dbs from productions
22:04 wm-bot: <rhinosf1> rhinosf1@tools.zppixbot-test syncing files
21:47 wm-bot: <rhinosf1> chmod -R g+w
2020-03-14
18:03 wm-bot: <zppix1> Finish setup of k8s, tool is now functioning as expected
2020-02-28
19:13 wm-bot: <root> Migrated to 2020 Kubernetes cluster
2020-02-11
22:26 RhinosF1: update default.cfg to test values and copy credentials from zppixbot
22:24 bd808: `chmod -R g+w $HOME/.sopel` to fix file permissions so that RhinosF1 can sftp directly to this directory
22:19 bd808: `chmod g+w $HOME/.sopel`
