20:45 wmbot~bd808@tools-sgebastion-11: Restarted wikibugs-phab job to pick up fixes for T1175, T1176, and T1177
2024-02-26
23:22 wmbot~bd808@tools-sgebastion-11: Restarted wikibugs-phab job. Pod was dead with CreateContainerConfigError state. Last pod event was kubelet pulling the image it runs in.
15:07 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart wikibugs-phab
12:11 wikibugs: Updated channels.yaml to: 64ea55e Move #data-platform-sre announcements to a dedicated channel
10:00 taavi: restart all the wikibugs services
2024-02-25
22:05 wmbot~bd808@tools-sgebastion-11: toolforge jobs restart redis2irc
2024-02-23
08:14 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
2024-02-22
11:32 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
2024-02-21
11:57 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
09:46 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
2024-02-20
11:49 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart grrrrit
11:05 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
2024-02-19
09:54 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
2024-02-18
09:52 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
2024-02-17
10:39 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
00:02 wmbot~bd808@tools-sgebastion-11: Restarted wikibugs-phab job to pick up fix for T199007
2024-02-16
12:12 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
11:16 wmbot~taavi@tools-sgebastion-11: toolforge jobs restart redis2irc
2024-02-15
11:29 wmbot~lucaswerkmeister@tools-sgebastion-10: toolforge jobs load libera/k8s-jobs.yaml # IRC was down since 9:04 UTC afaict
2024-02-14
14:11 wmbot~samtar@tools-sgebastion-10: Restarted all jobs
2024-02-12
23:20 wmbot~bd808@tools-sgebastion-11: toolforge jobs restart grrrrit
2024-02-08
22:49 bd808: Added greg-g as a co-maintainer
22:37 wmbot~bd808@tools-sgebastion-11: Did the `toolforge jobs load libera/k8s-jobs.yaml` full restart
22:31 wmbot~bd808@tools-sgebastion-11: Deleted redis2irc-84b494f447-9gvdv pod to try and fix wikibugs irc output after reports by greg-g and TimeStarling
2024-01-10
22:07 wikibugs: Updated channels.yaml to: 4787377 channels: Route #openstack-magnum phab tag to -cloud-feed
2023-12-06
19:40 wikibugs: Updated channels.yaml to: 9e1fe76 remove PAWS from #pywikibot
2023-12-05
15:12 wikibugs: Updated channels.yaml to: 27b1219 channels: Add commtech-kanban to commtech channel
2023-11-26
14:50 valhallasw: kubectl delete pod grrrrit-567d49c997-m5qzl (pod "grrrrit-567d49c997-m5qzl" deleted); kubectl get pods shows new pod grrrrit-567d49c997-xdvm2 (running 34s)
14:48 valhallasw: restarting wikibugs to deploy T350778 / r975426
2023-10-19
12:37 wikibugs: Updated channels.yaml to: cd3ece6 Remove #wikimedia-quibble (already in #wikimedia-releng)
12:34 wikibugs: Updated channels.yaml to: cd85fd5 Send Fresnel notifications to Release Engineering
2023-10-09
10:58 wikibugs: Updated channels.yaml to: ae68917 Add wikimedia-external-links to follow linkwatcher
2023-08-31
21:08 wikibugs: Updated channels.yaml to: eb75d17 wikistats: add ##RhinosF1
2023-08-11
13:00 wikibugs: Updated channels.yaml to: e5b0b95 Add Fresh and WikimediaDebug to -releng
2023-07-27
15:35 wikibugs: Updated channels.yaml to: f7360b7 Notify on superset.wmcloud.org
2023-07-25
13:05 taavi: move to php 8.2 webservice
2023-07-20
22:45 wikibugs: Updated channels.yaml to: 39a3afa Add #mediawiki-core-bots
2023-07-05
14:25 wikibugs: Updated channels.yaml to: 06dace3 Remove #wikimedia-services
2023-07-01
12:06 wikibugs: Updated channels.yaml to: 2f9a273 Add wmde-wikidata-tech to #wikidata-feed
2023-06-19
13:42 wikibugs: Updated channels.yaml to: e6b7f77 Add 'Data Platform SRE' phab ticket updates to #wikimedia-analytics
2023-05-15
18:26 taavi: restart all containers
2023-04-20
17:37 wikibugs: Updated channels.yaml to: 30368f4 Remove services.* from #wikimedia-services
17:22 wikibugs: Updated channels.yaml to: 48c57d8 Remove blocked-on-services
2023-03-15
04:35 legoktm: manually restarted
2023-01-15
23:25 wikibugs: Updated channels.yaml to: 3fc8f04 Enable phab and gerrit notifs for #countervandalism
2022-12-31
03:21 wikibugs: Updated channels.yaml to: 352103c channels: Add ##theresnotime-feed
2022-11-21
18:29 wikibugs: Updated channels.yaml to: c1a96fd Remove unrelated projects from #-fundraising
2022-10-20
19:59 wm-bot: <root> restart wikibugs (again)
19:12 wm-bot: <root> restart wikibugs
2022-10-10
21:08 wm-bot: <root> restart wikibugs
20:43 wm-bot: <root> restart wikibugs
2022-10-07
17:57 wikibugs: Updated channels.yaml to: 5c488e7 channels: route Grid-Engine-to-K8s-Migration to -cloud-feed
2022-07-15
13:34 wikibugs: Updated channels.yaml to: 108bdf1 Phab: Match abstract_wiki.* for Abstract channel
2022-06-15
18:58 taavi: full shutdown + restart
2022-05-20
03:42 wm-bot: <legoktm> restarting IRC bot to lose the tail
2022-05-13
04:48 legoktm: restarted wikibugs-phab pod, had stopped reporting
2022-05-06
17:06 wikibugs: Updated channels.yaml to: 783e242 channels: Community Tech
2022-05-05
20:12 wm-bot: <legoktm> Restart webservice so post-merge pull hook works again
20:12 wikibugs: Updated channels.yaml to: b9b4697 wikibugs: relay WikiSEO to RhinosF1's channel
2022-03-18
16:06 taavi: restarted libera-irc after it flooded out
2022-03-03
18:17 wikibugs: Updated channels.yaml to: 673df01 channels: route Cloud Services Proposals to cloud-feed
08:04 taavi: remove 'taxonomy' cron job on the stretch grid, seems to be intended to update mw:Phabricator/Projects but broken since early 2021 without anyone complaining
2022-02-28
14:05 wikibugs: Updated channels.yaml to: 1226e1d Add #wikimedia-ve for Wikimedia-Venezuela.*
2022-02-25
12:16 taavi: fixed auto updated code by restarting webservice to use php 7.4 (instead of 5.6), 5.6 container no longer trusts LE certificates
12:15 wikibugs: Updated channels.yaml to: e3f9d15 send openstack stuff to -cloud-feed
12:36 wikibugs: Updated channels.yaml to: fed690d Send #jenkins to #wikimedia-releng
2020-09-04
14:10 Reedy: rebooted due to laggy irc echoing
2020-08-26
01:11 Reedy: restarted wikibugs because of apparent irc split brain (wikibugs and wikibugs____)
2020-06-28
06:21 legoktm: restarted wb2-grrrrit
2020-06-17
17:02 wikibugs: Updated channels.yaml to: 2532535 Update zppixbot project name
2020-06-04
10:00 wm-bot: <maurelio> Restarting wb2-grrrrit, still not parsing gerrit feed
09:43 wm-bot: <maurelio> Restarting wikibugs, not listening to gerrit
2020-04-09
18:29 wikibugs: Updated channels.yaml to: 10c446c Partially revert "Drop the #wikimedia-interactive channel, no longer used"
18:04 wikibugs: Updated channels.yaml to: f3ca868 Drop the #wikimedia-interactive channel, no longer used
17:25 wikibugs: Updated channels.yaml to: 4f74ead More Product Infrastructure repos
2020-04-04
14:27 Reedy: rebooted
2020-03-12
01:09 wikibugs: Updated channels.yaml to: 60932ad Add other items RelEng cares about
2020-03-01
15:55 wikibugs: Updated channels.yaml to: 7fc88d6 Add User-revi to the channels list
2020-02-29
23:04 wm-bot: <root> Migrated to 2020 Kubernetes cluster
2020-02-24
18:18 wikibugs: Updated channels.yaml to: f109caf Move RelEng's interest in other's work out
2020-02-11
17:32 Reedy: reboot because it wasn't reporting from phab
2019-12-31
15:25 valhallasw`cloud: Tried to restart wb2-phab, but now getting an asyncio AttributeError: 'NoneType' object has no attribute 'call_exception_handler'
11:21 arturo: run `tools.wikibugs@tools-sgebastion-07:~/wikibugs2$ python3 manage.py start_jobs` as described in https://www.mediawiki.org/wiki/Wikibugswith after deleting the grid jobs
2019-03-06
19:37 valhallasw`cloud: wb2-grrrrit deployed on stretch, all happy!
19:33 valhallasw`cloud: wb2-phab deployed on stretch
19:24 valhallasw`cloud: wb2-irc deployed on stretch, seems to work.
19:16 valhallasw`cloud: Taxonomy crontab deployed on stretch
19:11 wikibugs: Updated channels.yaml to: 8c22124 Bump bs4 to 4.7.1
2019-02-20
18:13 wikibugs: Updated channels.yaml to: 43339cb Remove Quarry from #wikimedia-research
2019-02-17
07:41 wikibugs: Updated channels.yaml to: 62469f2 Update for Acme-chief project rename
2019-01-27
23:58 wikibugs: Updated channels.yaml to: 21d84d3 Send "Zuul" phabricator project updates to #wikimedia-releng
2018-11-15
20:20 wikibugs: Updated channels.yaml to: 13c6f92 Merge "Add maps items to Infrastructure team channel"
2018-11-14
19:35 wikibugs: Updated channels.yaml to: cf8f688 Add MobileFrontend board to -dev & other boards to -dev-africa
2018-10-31
01:44 gtirloni: moved gerrit updates to #wikimedia-cloud-feed
00:03 wikibugs: Updated channels.yaml to: 5f5fbb9243566dd512f1b1bf65ed60e5e08d6e92 Naming is hard
2015-08-28
05:14 wikibugs: Updated channels.yaml to: 30a3e422993291ab995a487ae1d4bbc2e7cd4013 Send Community-Tech traffic to #wikimedia-commtech
2015-08-25
18:04 wikibugs: Updated channels.yaml to: a541227fe36479f99a74f8d56586bcf4b8f55108 Send Collaboration-Team(-.*)? to #wikimedia-collaboration
2015-08-19
08:25 wikibugs: Updated channels.yaml to: b03ba14e0809cf29d6fad807c931b7b9bafb0b2f Add RelEng-Admin, CI-Config, Scap3 plus reorder
2015-08-04
17:48 wikibugs: Updated channels.yaml to: 5b039d4ec16094a553be431e4d94f0bf880cfa47 Send GlobalRename changes to #wikimedia-rename
2015-07-30
21:11 wikibugs: Updated channels.yaml to: f638b92139d824b52c8e37284b4e5bedf07cf52c Filter WMDE- out of #wikimedia-fundraising
2015-07-28
20:59 ircnotifier: legoktm: Deployed 680c8aad81158a3ddb1c4018233c07729c163cc0 Don't notify if multiple ignored actions were triggered wb2-phab
July 2
18:21 wikibugs: Updated channels.yaml to: ac57db111909071aa63faf61ff9a2a1fee1c693f xtools moved to wikimedia-xtools Change-Id: Ie84324e718d8025f4a1381f36d9ff5f4e9c5848d
17:52 valhallasw`cloud: restarting wikibugs using fab to get verbose logs & logrotate back
18:50 ircnotifier: valhallasw: Deployed f9b9d5bda60b9f1f6aac196254f8b6cfff6d58a2 Send Graph-VE MW extension project to VE channel wb2-phab, wb2-irc
May 2
12:37 wikibugs: Updated channels.yaml to: f9b9d5bda60b9f1f6aac196254f8b6cfff6d58a2 Send Graph-VE MW extension project to VE channel
May 1
22:10 wikibugs: Updated channels.yaml to: 831099cc50dbc6828c2ef5ff8f2e6aa41cd97310 Put a few things into -editing.
21:55 wikibugs: Updated channels.yaml to: b6c7fa03a61f5b27061be11900b6e432d500b765 Remove definitions for #wikimedia-mobile
April 29
16:43 ircnotifier: valhallasw: Deployed 1d785dc3ad22a434749f8ec0d466180f3de9ea52 channels: Continuous-Integration is now Continuous-Integration-Infrastructure wb2-phab, wb2-irc
April 24
21:14 wikibugs: Updated channels.yaml to: 1d785dc3ad22a434749f8ec0d466180f3de9ea52 channels: Continuous-Integration is now Continuous-Integration-Infrastructure
April 21
03:39 ircnotifier: legoktm: Deployed 8e88fc89deaa41b2a720845f5d20aa871ffa09d9 Add Blueprint skin to notify list for #wikimedia-design wb2-irc
03:39 ircnotifier: legoktm: Deployed 8e88fc89deaa41b2a720845f5d20aa871ffa09d9 Add Blueprint skin to notify list for #wikimedia-design wb2-phab
April 20
11:18 wikibugs: Updated channels.yaml to: 8e88fc89deaa41b2a720845f5d20aa871ffa09d9 Add Blueprint skin to notify list for #wikimedia-design
April 18
20:24 valhallasw`cloud: file system corruption?? channels.yaml is all \x00s and .git/objects/* is corrupt. Cleared .git/objects, git fetch --all'd and git checkout channels.yaml seems to bring wikibugs back to life
19:43 valhallasw`cloud: tools-redis doesn't respond to commands, which could explain why wb2-phab was hanging. But why is tools-redis completely broken?
19:41 valhallasw`cloud: now wb2-phab is functioning again, but wb2-irc is not reporting?! Restarting that as well
19:38 valhallasw`cloud: that is, the last message to irc. The bot is still running and doing ping/pongs. However, wikibugs.log is completely silent after that time. wb2-phab.err does have errors, but without timestamps, so it's basically useless. Restarting wb2-phab to see if that helps
19:36 valhallasw`cloud: last message in redis2irc.log was 2015-04-18 02:10:26,157
19:36 valhallasw`cloud: wikibugs has broken down again. Trying to figure out why.
April 13
19:05 wikibugs: Updated channels.yaml to: 4500101f021b8eec83899848932edaee98bd680a Merge "Tools-Labs-xTools to #xtools"
April 7
16:13 wikibugs: Updated channels.yaml to: 8a4346f6c5d0f826a9b3099d5f76339d7a64dcad Merge "Remove Quality Assurance from -releng"
April 1
20:56 wikibugs: Updated channels.yaml to: f09815aee08458b7fb283db7c7e0aed49e3b149d HACK: Always join channels on privmsg
19:45 wikibugs: Updated channels.yaml to: b2c38567b32d82881baab5c3227f14a9b8e9fff5 Send MediaWiki-API-Team and Blocked-on-MediaWiki-API-Team to #mediawiki-core
March 23
18:44 wikibugs: Updated channels.yaml to: 90eed2a902164a9a1cf7930c7d9fb599ec9ae660 Send Commons to #wikimedia-commons-tech, per Steinsplitter
March 18
11:49 ircnotifier: yuvipanda: Deployed 23240bd0dc5aebcc2a94b6f1ac268e2e3ad41114 Add more projects for devtools and mobile wb2-phab, wb2-irc
March 16
17:16 wikibugs: Updated channels.yaml to: 23240bd0dc5aebcc2a94b6f1ac268e2e3ad41114 Add more projects for devtools and mobile
March 13
22:29 legoktm: restarted wb2-irc to see if it rejoins channels properly
20:44 wikibugs: Updated channels.yaml to: 9eafe437ff005a3232e7f7e89dbb2be54437f76c tox: Rename channels env to standard py34
March 11
04:36 legoktm: restarted both wb2-phab and wb2-irc
March 10
19:30 wikibugs: Updated channels.yaml to: 614ee42338f6ab3f8d0705d3f0358523189af00e send WMT bugs to #wmt
19:14 wikibugs: Updated channels.yaml to: 614ee42338f6ab3f8d0705d3f0358523189af00e send WMT bugs to #wmt
March 3
20:02 wikibugs: Updated channels.yaml to: 6da78462504cd023e0c31babb5cc56a7eae3a88a Merge "Use brown instead of red for orange (=release) projects"
16:44 ircnotifier: legoktm: Deployed 6da78462504cd023e0c31babb5cc56a7eae3a88a Merge "Use brown instead of red for orange (=release) projects" wb2-irc
February 28
22:57 valhallasw`cloud: also restart wikibugs; it seems the PRIVMSGs in the log don't actually show up on irc
22:53 valhallasw`cloud: false alarm, messages were reported (2015-02-28 22:50:43,202 - irc3.wikibugs - DEBUG - > PRIVMSG #mediawiki-parsoid :10Parsoid, 10VisualEditor, 10VisualEditor-EditingTools, etc) which is a few minutes ago
22:52 valhallasw`cloud: restarted wb2-phab to see if we get stuff from phab again
February 24
23:16 ircnotifier: legoktm: Deployed 6da78462504cd023e0c31babb5cc56a7eae3a88a Merge "Use brown instead of red for orange (=release) projects" wb2-irc
23:16 ircnotifier: legoktm: Deployed 6da78462504cd023e0c31babb5cc56a7eae3a88a Merge "Use brown instead of red for orange (=release) projects" wb2-phab
February 22
22:54 ircnotifier: valhallasw: Deployed 6da78462504cd023e0c31babb5cc56a7eae3a88a Merge "Use brown instead of red for orange (=release) projects" wb2-irc
12:17 ircnotifier: yuvipanda: Deployed 9521ec19491d35ebc40fdccb34e75e0bd7f9399f Turn ssl off wb2-phab, wb2-irc
12:10 ircnotifier: yuvipanda: Deployed 8736032750b4fead35646ea9120621bf9d0ccb7e Only join actual channels wb2-phab, wb2-irc
12:09 ircnotifier: yuvipanda: Deployed 8736032750b4fead35646ea9120621bf9d0ccb7e Only join actual channels wb2-phab, wb2-irc
11:05 ircnotifier: yuvipanda: Deployed 2b66af26ca2a7343d0743423a4c9fcc6b8296e5e Disentangle tag lists for filtering vs display wb2-phab, wb2-irc
11:02 ircnotifier: yuvipanda: Deployed 2b66af26ca2a7343d0743423a4c9fcc6b8296e5e Disentangle tag lists for filtering vs display wb2-phab, wb2-irc
January 12
22:04 wikibugs: Updated channels.yaml to: f1ee8fb8bc64186a1613ec9f9faf0aef6315759a Merge "team-practices -> #wikimedia-teampractices"
January 11
00:06 wikibugs: Updated channels.yaml to: 2257da8655036ce4555e88c01dad4a85f0b7946e WM-Bot -> #wm-bot
January 10
22:26 wikibugs: Updated channels.yaml to: f6b5ed8212e566b726a59de69a707ebea6c70d4e Remove -qa from announce list (moved to -releng)
18:06 wikibugs: Updated channels.yaml to: 09630c2cd5beead10c0ab2bfd8df84e7337a0208 LabsDB-Auditor -> labs
January 9
18:28 wikibugs: Updated channels.yaml to: 4c4fc344a850a36ef47a7c9965c853a27863baac Make sure to reset to origin/master, and show current sha1 before doing so
January 8
10:59 wikibugs: Updated channels.yaml to: 29b1c027a31c7650094b195e70e3a4ac82c05d00 Merge "Add Wikibugs to -labs"
09:51 wikibugs: Updated channels.yaml to: 019f6b0366a97df69733f7c80303aec8058ecb79 Wikibugs should listen to the Multimedia project for the multimedia channel
06:21 valhallasw: NameError: name '_wsp_splitter' is not defined in /data/project/wikibugs/src/pywikibugs/get_unstructured.py. Apparently the line 'from email._header_value_parser import _wsp_splitter, _validate_xtext' had not made it into the git repo, and was cleared by accident on deploymeny
