Nova Resource:Cvn/SAL/Archive 4

From Wikitech

2021-11-02

  • 21:15 Krinkle: killall cvn.cvnservice on cvn-app8 and cvn-app9

2021-10-07

  • 17:58 Krinkle: killall cvn.cvnservice @ cvn-app8

2021-10-03

  • CVN: restarted bots 5, 12, 28, and 29 failed to regain nick.

2021-10-02

  • 21:31 Krinkle: krinkle@cvn-app8 Idem
  • 21:29 Krinkle: krinkle@cvn-app9 `sudo sed -i 's#mozilla/DST_Root_CA_X3.crt#!mozilla/DST_Root_CA_X3.crt#' /etc/ca-certificates.conf && sudo update-ca-certificates` ref T292289, ref https://github.com/mono/mono/issues/21233
  • 21:24 Krinkle: /cs flags #cvn-wp-es LuchoCR local_op ; verified nick and sysop at es.wikipedia
  • 21:11 Krinkle: /cs flags #cvn-wp-en tn local_op
  • 21:04 Krinkle: /cs flags #cvn-wp-en tn voiced - verified nick

2021-08-27

  • 01:49 Krinkle: /cs flags #cvn-bots AntiComposite bot_operator
  • 01:27 Krinkle: Flags +AV were set on Sarrus in #cvn-wp-da.

2021-08-07

  • CVN: restarted CVNBot5 - was not reporting

2021-07-12

2021-06-22

  • 21:42 Krinkle: flags #cvn-wp-nl Wiki13 local_op. User:Wiki13 cloak confirmed, nlwiki sysop

2021-06-20

2021-06-17

  • 02:44 Krinkle: flags #cvn-wikidata lozenge local_op (wikidatawiki sysop, confirmed User:1997kB)
  • 02:41 Krinkle: flags #cvn-ja shino_d_y local_op (jawiki sysop, confirmed User:Ohgi)

2021-06-14

2021-06-13

  • 19:10 Krinkle: Migrate CVNBot26,27,28,29 to Libera
  • 19:04 Krinkle: Migrate CVNBot21,22,23,24,25 to Libera
  • 18:54 Krinkle: flags #cvn-bots Operator873 local_op (same as Freenode, confirmed account)
  • 18:52 Krinkle: Migrate CVNBot16,17,18,19,20 to Libera
  • 18:47 Krinkle: Migrate Cubbie (now CVNBot11), and CVNBot13,14,15 to Libera
  • 18:41 Krinkle: Migrate CVNBot6,7,8,9,10 to Libera
  • 18:33 Krinkle: Migrate CVNBot4,5 to Libera
  • 18:29 Krinkle: Migrate CVNBot1,2,3 to Libera
  • 18:21 Krinkle: Migrate CVNBot12 to Libera
  • 18:05 Krinkle: flags #cvn-wp-nl natuur12 local_op (same as Freenode, confirmed account)
  • 18:02 Krinkle: Contacted operator of mastiBot (#cvn-wp-pl) to move their bot to Libera.
  • 16:55 Krinkle: flags #cvn-wikidata [1997kB] voiced (same as on Freenode, confirmed account)
  • 03:08 Krinkle: Applied cvn/bot/* cloak for CVNBots-A, CVNBots-B to CVNBots-F
  • 03:08 Krinkle: Applied cvn/bot/* cloak for cvn-clerkbot
  • 03:08 Krinkle: Migrated cvn-clerkbot to Libera (same config and channel list)
  • 00:42 Krinkle: flags #cvn-zho WhitePhosphorus local_op
  • 00:39 Krinkle: flags #cvn-zh-sw WhitePhosphorus local_op

2021-06-12

  • 23:59 Krinkle: wm-bot has been migrated to Libera (logging #countervandalism, and serving #cvn-es-scan, #cvn-wp-fa, #cvn-zh-sw and #cvn-zho)

2021-05-18

  • CVN: restarted CVNBot1 (stopped reporting)

2021-05-13

  • CVN: restart CVNBot5 - stopped reporting

2021-04-22

  • CVN: restarted CVNBot2, 3, 4, 12, and 15. Failed to regain nick.

2021-04-06

  • 20:28 Krinkle: cs access #cvn-bots add Operator873|CVN local_op
  • 20:17 Krinkle: Reboot cvn-app servers
  • CVN: restarted bots 6-10, 15, and 19 -- Failed to regain nick

2021-04-02

  • 22:18 Krinkle: #cvn-wp-es: /invite LiWa3_2 (but did not work)
  • 22:11 Krinkle: pruned two 11 year old ChanServ akick entries from #cvn-wp-es

2021-03-31

  • CVN: restarted CVNBot5 -- Last message was received on RCReader 89067.767239 seconds ago

2021-03-29

  • 21:12 Krinkle: Restarted cvn-app8 and cvn-app9
  • 21:07 Krinkle: Flags +AV were set on cyberzeus in #cvn-wp-en.
  • CVN: restarted CVNBot7-10, 15, and 19. Failed to regain nick

2021-03-25

  • CVN: restarted CVNBot5 -- Apparently wandered off the farm.

2021-03-21

  • CVN: Added Zabe to #cvn-sw and #cvn-meta (+AV)

2021-03-16

  • CVN: restarted CVNBot15 - failed to regain nick

2021-03-09

  • CVN: restarted CVNBot10 - failed to regain nick
  • CVN: restarted CVNBot5 - failed to regain nick
  • CVN: restarted CVNBot15 - failed to regain nick

2021-02-20

  • 07:38 Operator873: restarted CVNBot15 failed to regain nick

2021-02-19

  • 04:57 Operator873: restarted CVNBot15 failed to regain nick

2021-02-17

2021-02-07

  • 07:00 Cam11598: restarted CVNBot1 CVNBot10 CVNBot8 CVNBot9 CVNBot19 as they were not auth'd to Nickserv

2021-01-31

  • 17:34 Operator873: restarted CVNBot15

2021-01-29

2021-01-23

  • 22:50 Krinkle: restarted cvn-app8 and cvn-app9
  • 22:39 Operator873: CVNBot15 restarted after DC and failing to regain nick

2021-01-17

  • 00:33 Operator873: CVNBot6-7 and CVNBot9-10 restarted

2021-01-15

  • 04:50 Operator873: CVNBot15 restarted

2021-01-11

  • 18:32 tabbycat: The following wikis have been loaded to CVNBot7: niawiki, niawiktionary, diqwiktionary & bclwiktionary (new wikis created today)
  • 18:31 tabbycat: Dropped nia.wikipedia from CVNBot8 and loaded instead on CVNBot7
  • 16:00 tabbycat: Loaded nia.wikipedia to CVNBot8 (new wiki)

2021-01-07

  • 20:43 Operator873: CVNBot8-10 & 19 restarted
  • 20:40 Operator873: restarted CVNBot15

2020-12-15

  • 19:11 htz: Added the following wikis to CVNBot6: smnwiki, skrwiki, skrwiktionary, eowikivoyage and wa.wikisource
  • 15:41 SantaPaws: Added mad.wikipedia to CVNBot9 (new wiki)

2020-12-03

  • 13:01 Operator873: restarted CVNBot6-10 & 15

2020-12-01

  • 13:02 Operator873: restart CVNBot5
  • 13:02 Operator873: restarted CVNBot6-10 and 15

2020-11-19

  • 13:39 Operator873: CVNBot19 restarted
  • 13:38 Operator873: CVNBot6-10 restarted
  • 13:36 Operator873: CVNBot15 restarted

2020-11-11

  • 10:58 matanya: Matanya set flags +AV on Ivi104 in #cvn-wp-hr

2020-11-09

  • 07:22 matanya: Matanya set flags +AV on Mark7747 in #cvn-wp-hr

2020-11-04

  • 22:04 Krinkle: restarting cvn-app servers

2020-10-29

  • 17:50 Phantom873: restarted CVNBot5 in #cvn-meta
  • 17:49 Phantom873: restarted CVNBot15
  • 17:33 Operator873: restarted CVNBot6-10 and 19

2020-10-09

  • 21:52 Krinkle: /cs access #cvn-commons add AntiComposite local_op

2020-09-30

  • 20:25 Operator873: restarted CVNBot5-10
  • 20:22 Operator873: CVNBot15 restart
  • 16:33 Krinkle: restarting numerous bots that were detached from $cvn-broadcast
  • 15:15 Operator873: @Operator873 Restarted CVNBot19, 16, 10, 9, 8, 7, and 6

2020-09-23

  • 08:13 matanya: matanya set flags +AV on NovakWatchmen in #cvn-wp-hr

2020-09-19

  • 23:55 Operator873: Operator873 set flags +AV on ImprWikiImpr

2020-09-11

  • 21:05 Operator873: 16:04:41 -ChanServ- Flags +AV were set on NovakWatchmen in #cvn-meta.

2020-09-04

  • 09:39 rxy: Flags +AV were set on Mirinano in #cvn-ja.
  • 09:39 rxy: Flags +AV were set on Mirinano in #cvn-sw.

2020-08-27

  • 21:06 hauskatze: ja.wikivoyage added to CVNBot7 (new wiki)
  • 21:01 hauskatze: Dropped tr.wikinews from CVNBot9 - project closed (sync. w/ megatable)

2020-08-22

  • 21:29 Krinkle: Kill PID for CVNBot3 and CVNBot14

2020-08-14

  • 17:32 Operator873: Operator873 restart CVNBot6-9 & 19 in @cvn-sw
  • 17:30 Operator873: 12:30:23 @Operator873 CVNBot5 restart
  • 17:29 Operator873: 12:27:01 @Operator873 CVNBot15 restart

2020-08-06

  • 16:14 Operator873: Operator873 set flags +AV on sithjarjar666 in #cvn-simplewikis

2020-07-19

  • 14:59 ZI_Jony: restarted all bots due to ping timeout.

2020-07-16

  • 11:57 Operator873: 06:56:37 @Operator873 CVNBot15 restart

2020-07-13

  • 13:34 Operator873: 08:27:24 @Operator873 CVNBot15 restart

2020-06-23

  • 17:08 rxy: Flags +AV were set on WB-IRC in #cvn-sw.
  • 09:57 rxy: rxy@cvn-app8:~$ sudo kill $CVNBot21PID

2020-06-09

  • 02:00 Krinkle: Deploy CVNBot v4.0 to all cvnbot on cvn-app8
  • 01:46 Krinkle: On cvn-app9, rename 'CVNBot28__' to 'backup_CVNBot28_rxy_20190427'
  • 01:46 Krinkle: On cvn-app9, rename 'CVNBot29__' to 'backup_CVNBot29_rxy_20190427'
  • 01:37 Krinkle: Deploy CVNBot v4.0 to CVNBot23, CVNBot24, CVNBot25, CVNBot26, CVNBot27, CVNBot28, CVNBot29 on cvn-app9
  • 01:33 Krinkle: Deploy CVNBot v4.0 to CVNBot16, CVNBot17, CVNBot19, CVNBot22 on cvn-app9

2020-06-08

  • 23:40 Krinkle: Deploy CVNBot v4.0 to CVNBot6,7,8,9,10 on cvn-ap9
  • 22:30 Krinkle: Recompile CVNBot v3.1 with Mono 6.8 and upgrade all bots on cvn-app8
  • 19:53 Krinkle: Stop ghosted CVNBot29 process on cvn-app9
  • 17:19 Krinkle: Reboot cvn-app9
  • 17:04 Krinkle: Upgrading from Mono 5.18 to Mono 6.8 on cvn-app8 ("Unpacking mono-complete 6.8.0.123-0xamarin2+debian9b1 over 5.16.0.179-0xamarin1+debian9b1")
  • 17:01 Krinkle: Upgrading from Mono 5.18 to Mono 6.8 on cvn-app9 ("Unpacking mono-complete 6.8.0.123-0xamarin2+debian9b1 over 5.16.0.179-0xamarin1+debian9b1")
  • 04:49 Krinkle: Upgrade CVNBot28 to CVNBot v3.1.0 on cvn-app9
  • 03:58 Krinkle: Upgrade CVNBot24, CVNBot25, CVNBot26, CVNBot27 to CVNBot v3.1.0 on cvn-app9
  • 03:27 Krinkle: Upgrade CVNBot16, CVNBot17, CVNBot19, CVNBot22, CVNBot23 to CVNBot v3.1.0 on cvn-app9
  • 03:22 Krinkle: Upgrade CVNBot6, CVNBot7, CVNBot8, CVNBot9, CVNBot10 to CVNBot v3.1.0 on cvn-app9
  • 03:12 Krinkle: Upgrade CVNBot21, CVNBot15, CVNBot12 to CVNBot v3.1.0 on cvn-app8
  • 03:05 Krinkle: Upgrade CVNBot5, CVNBot13, CVNBot18, CVNBot20 to CVNBot v3.1.0 on cvn-app8
  • 02:57 Krinkle: Upgrade Cubbie, CVNBot1, CVNBot2 and CVNBot4 to CVNBot v3.1.0 on cvn-app8

2020-06-07

  • 19:40 Krinkle: Enabled wm-bot for channel logging

2020-06-05

  • 21:52 Krinkle: Add Cam11598 to cloud admins for cvn.wmflabs.org
  • 21:46 Cam11598: soft reboot cvn-app9
  • 20:08 Cam11598: restarted all bots due to ping timeout
  • 16:28 Operator873: 11:27 CVNBot15 restart

2020-06-04

  • 15:41 Cam11598: restarted bots 6, 7, 18, 19

2020-06-02

  • 20:59 Krinkle: Flags +AV were set on stanglavine in #cvn-sw.

2020-05-28

  • 14:26 ZI_Jony: restarted CVNBot14

2020-05-23

  • 05:04 Operator873: restarted CVNBot15

2020-05-22

  • 21:58 rxy: sudo kill $CVNBot6_pid

2020-05-21

  • 22:23 ZI_Jony: quit SULWatcher and SULWatcher2 on #cvn-unifications
  • 15:23 ZI_Jony: staff restarted CVNBot21 on #cvn-mediawiki
  • 13:51 ZI_Jony: staff restarted Cubbie on #cvn-commons-uploads
  • 11:13 ZI_Jony: restarted CVNBOT20

2020-05-19

  • 17:09 Krinkle: Quit CVNBot12 nlwiki
  • 16:33 Cam11598: restarted CVNBOT1 CVNBOT5
  • 16:33 Krinkle: Kill CVNBot18.exe on cvn-app8

2020-05-17

  • 18:50 Krinkle: Kill CVNBot1 process on cvn-app8 (netsplit?)
  • 18:40 Cam11598: cvnbot18 restarted
  • 18:22 Cam11598: 11:22:12 AM <ChanServ> Flags +AV were set on ZI_Jony in #cvn-wikidata.
  • 18:22 Cam11598: 11:21:56 AM <ChanServ> Flags +AV were set on ZI_Jony in #cvn-wp-en-newpages.
  • 18:21 Cam11598: 11:20:43 AM <ChanServ> Flags +AV were set on ZI_Jony in #cvn-wp-en.

2020-05-12

  • 19:29 Krinkle: cs access #cvn-wp-en-newpages add Galendalia voiced
  • 19:29 Krinkle: cs access #cvn-wp-en add Galendalia voiced

2020-05-11

  • 04:16 Cam11598: 9:15:33 PM <ChanServ> Flags +AV were set on DannyS712 in #cvn-meta.
  • 04:16 Cam11598: 9:14:10 PM <ChanServ> Flags +AV were set on DannyS712 in #cvn-sw.

2020-05-09

  • 19:02 Krinkle: cvn-app8: Upgrade CVNBot3 to v3.1.0 (msgs-es symlink)
  • 17:49 Krinkle: cvn-app8: Upgrade CVNBot14 to v3.1.0

2020-05-08

  • 02:07 Krinkle: cs access #cvn-wp-en add Examknow voiced

2020-05-02

  • 22:51 Cam11598: restarted bots 1, 23, 24 and cubbie

2020-04-27

  • 17:18 Cam11598: restarted bot 15
  • 16:47 Operator873: restarted CVNBot15

2020-04-23

  • 17:14 Cam11598: restarted bots 12, 24 and cubbie

2020-04-22

  • 23:01 rxy: Flags +AV were set on Kostas20142 in #cvn-unifications.
  • 23:01 rxy: Flags +AV were set on Kostas20142 in #cvn-meta.

2020-04-15

  • 22:59 rxy: Flags +AVfiotv were set on $chanacs:#wikimedia-acl-stewards in #cvn-unifications.
  • 22:57 rxy: I granted to voiced to all cvn Wikimedia related channel to all stewards ( #wikimedia-acl-stewards )

2020-03-25

  • 22:51 Krinkle: Rebooting cvn-app8, cvn-app9 and cvn-apache9

2020-02-03

  • 02:22 Cam11598: Restarted CVNBot15 and Cubbie

2020-01-25

  • 20:04 Krinkle: Reboot CVNBot1 and CVNBot14 processes (ghosted)

2019-12-30

  • 18:35 Cam11598: 10:34:57 AM CVNBot12 left (~CVNBot12@cvn/bot/cvn-bots2): "Rebooting by order of Cam11598 ..."

2019-12-29

  • 21:26 Cam11598: CVNbot12 restarted
  • 03:41 Cam11598: 7:40:35 PM <ChanServ> Flags +AV were set on RileyHuntley in #cvn-unifications.

2019-12-14

  • 03:29 Cam11598: 7:29:02 PM <ChanServ> Flags +AV were set on masumreza in #cvn-unifications.
  • 03:28 Cam11598: 7:27:57 PM <ChanServ> Flags +AV were set on masumreza in #cvn-sw.

2019-11-26

  • 11:07 hauskatze: Dropped ge.wikimedia from CVNBot19 (fishbowl); added es.wikivoyage to CVNBot6; updated SWMT Groups table on meta

2019-11-24

  • 10:36 hauskater: Loaded newly created wikis: shy.wiktionary
  • 10:35 hauskater: shy.wikipedia was rightly not loading because it does not exist, it's Wiktionary; dumb me
  • 10:29 hauskater: Unable to add shy.wikipedia. Error: "Unable to add project: Object reference not set to an instance of an object"
  • 10:28 hauskater: Loaded newly created wikis: nqo.wikipedia, mnw.wikipedia, szy.wikipedia, gcr.wikipedia and ge.wikimedia (chapter)

2019-10-25

  • 15:40 hauskater: Dropped dupe outreach.wikipedia from CVNBot7, left on CVNBot19

2019-10-21

  • 21:03 hauskater: <hauskater> CVNBot8 load ban.wikipedia ban:

2019-09-29

  • 12:14 hauskatze: Added hi.wikisource to CVNBot8
  • 12:10 hauskatze: Added atj.wikipedia to CVNBot8

2019-09-23

  • 21:40 hauskatze: Drop bg.wikinews from CVNBot10: project locked, soon to be deleted # T233322

2019-08-30

  • 20:59 Cam11598: restarted CVNbot18

2019-08-24

  • 16:58 Krinkle: cvn-app9 is consistently running out of memory while cvn-app8 is fairly flat. Maybe one of the bots is leaking memory or too many bots on one server? Which one?
  • 16:48 Krinkle: Renamed SWBot3 to CVNBot15 (#cvn-simplewikis)

2019-08-21

  • 21:39 Cam11598: restarted cvnbot3

2019-08-16

  • 19:17 Cam11598: restarted CVNBot3

2019-08-15

  • 02:37 Cam11598: 7:36:41 PM <ChanServ> Flags +AV were set on DannyS712 in #cvn-simplewikis.

2019-08-12

  • 01:14 rxy: Flags +AV were set on OhKayeSierra in #cvn-wp-en. diff

2019-08-05

  • 12:54 hauskatze: `batchgetusers` issued on CVNBot10
  • 12:54 hauskatze: Loaded wikimania.wikimedia.org on CVNBot19

2019-07-31

  • 22:20 Krinkle: Restore localised msgs for CVNBot3 (es)
  • 22:19 Krinkle: Restore localised msgs for CVNBot12 (nl), and CVNBot16 (ja)
  • 21:38 Krinkle: Upgraded CVNBot22 - CVNBot29 on cvn-app9 to 1.22.0-beta.3, https://github.com/countervandalism/CVNBot/issues/50
  • 21:01 Krinkle: cvn servers were rebooted by Wikimedia Cloud admins for routine OS and Network maintenance

2019-07-29

  • 13:49 Krinkle: The 1.22.0-beta.3 upgrade also "updated" the Console message translation file, which should have only applied to English bots. Need to restore the symlinks for non-English bots.

2019-07-24

2019-07-21

  • 20:34 Krinkle: Upgrade CVNBot20, CVNBot21, SWBot3 (cvn-app8) to 1.22.0-beta.3
  • 20:31 Krinkle: Upgrade CVNBot12, CVNBot13, CVNBot14, CVNBot18 (cvn-app8) to 1.22.0-beta.3
  • 20:27 Krinkle: Upgrade CVNBot1 - 5 (cvn-app8) to 1.22.0-beta.3
  • 20:23 Krinkle: Upgrade Cubbie (cvn-app8) to 1.22.0-beta.3
  • 19:47 Krinkle: Upgrade CVNBot4 and CVNBot5 (cvn-app8) to 1.22.0-beta.2
  • 19:46 Krinkle: Upgrade CVNBot2 and CVNBot3 (cvn-app8) to 1.22.0-beta.2
  • 19:42 Krinkle: Upgrade CVNBot1 (cvn-app8) to 1.22.0-beta.2
  • 19:37 Krinkle: Upgrade CVNBot18 (cvn-app8) to 1.22.0-beta.2, https://github.com/countervandalism/CVNBot/issues/50

2019-07-08

  • 02:30 Krinkle: kill Cubbie/CVNBot.exe processes (4) on cvn-app8

2019-07-05

  • {{safesubst:SAL entry|1=13:25 hauskatze: Had to restart all bots on #cvn-{sw,meta} due to all not reporting. Seems to have been fixed by the restart.}}

2019-07-03

  • PC: restarted CVNBot3 (Last message was received on RCReader 6783.217726 seconds ago).
  • PC: restarted CVNBot18 (Last message was received on RCReader 31833.585901 seconds ago).

2019-06-26

  • 15:43 Krinkle: kill CVNBot.exe on cvn-app8 (appears to be stuck)

2019-06-14

  • 23:02 Cam11598: restarted cvnbot3

2019-06-13

  • 17:52 Krinkle: access #cvn-wp-nl add DutchTom voiced

2019-05-29

  • 05:00 Cam11598: 9:59:32 PM <ChanServ> Flags +AV were set on xaosflux in #cvn-wp-en.

2019-05-17

  • 18:09 Joan: Restarted CVNBot18 (Last message was received on RCReader 620254.926186 seconds ago).

2019-05-09

  • 00:19 Joan: Restarted CVNBot18 (Last message was received on RCReader 104834.694264 seconds ago).

2019-05-06

  • 03:31 Joan: Restarted CVNBot18 (Last message was received on RCReader 39240.073633 seconds ago).

2019-05-04

  • 16:20 Joan: Restarted CVNBot18 (Last message was received on RCReader 56421.216589 seconds ago).

2019-05-02

  • 23:47 Joan: Restarted CVNBot18 (Last message was received on RCReader 12751.913057 seconds ago).
  • 02:01 Joan: Restarted CVNBot18 (Last message was received on RCReader 67347.377929 seconds ago).

2019-04-30

  • 18:56 Joan: Restarted CVNBot18 (Last message was received on RCReader 121068.813522 seconds ago).

2019-04-27

  • 21:39 rxy: rxy@cvn-app9: Setup CVNBot27, 28, 29
  • 20:21 Joan: CVNBot18 restarted (Last message was received on RCReader 169025.684919 seconds ago).

2019-04-25

  • 01:56 Joan: Restarted CVNBot18 (Last message was received on RCReader 109494.529249 seconds ago).

2019-04-20

  • 17:53 Joan: Restarted CVNBot18 (Last message was received on RCReader 203383.17521 seconds ago).

2019-04-18

  • 02:00 Joan: Restarted CVNBot18 (Last message was received on RCReader 20430.459044 seconds ago).

2019-04-14

  • 08:07 Cam11598: 1:06:50 AM <ChanServ> Flags +AV were set on rhinosf1 in #cvn-wp-en.
  • 07:52 Cam11598: 12:51:25 AM <ChanServ> Flags +AV were set on BRPever in #cvn-wikidata.
  • 07:51 Cam11598: 12:50:47 AM <ChanServ> Flags +AV were set on BRPever in #cvn-meta.
  • 07:49 Cam11598: 12:49:04 AM <ChanServ> Flags +AV were set on Tulsi in #cvn-wikidata.
  • 07:40 Cam11598: 12:40:10 AM <ChanServ> Flags +AV were set on Tulsi in #cvn-meta.
  • 07:40 Cam11598: 12:38:56 AM <ChanServ> Flags +AV were set on Tulsi in #cvn-wp-en.

2019-04-13

  • 18:58 Joan: Restarted CVNBot18 (Last message was received on RCReader 38511.495035 seconds ago).
  • 00:06 Joan: Restarted CVNBot18 (Last message was received on RCReader 17276.533177 seconds ago).

2019-04-11

  • 22:01 Joan: Restarted CVNBot18 (Last message was received on RCReader 12824.424476 seconds ago).
  • 17:01 Cam11598: restated 19
  • 17:00 Cam11598: restarted 17 & 18

2019-04-10

  • 05:11 Cam11598: 10:11:08 PM <ChanServ> Flags +AV were set on DannyS712 in #cvn-wp-en.

2019-04-08

  • 01:17 Cam11598: restarted cubbie, bots 21, 22, 23 and 24.

2019-04-04

  • 00:27 Joan: Restarted CVNBot18 (Last message was received on RCReader 43746.343766 seconds ago).

2019-04-03

  • 02:19 Joan: Restarted CVNBot18 (Last message was received on RCReader 64467.457585 seconds ago).

2019-04-01

  • 18:25 Joan: Restarted CVNBot18 (Last message was received on RCReader 155248.459668 seconds ago)

2019-03-28

  • 05:46 Joan: Restarted CVNBot18 (Last message was received on RCReader 44981.937625 seconds ago).

2019-03-23

  • 21:08 Krinkle: Rebooting cvn-app8 and cvn-app9 servers
  • 14:51 rxy: Flags +AV were set on Tks4Fish in #cvn-commons-uploads.
  • 00:21 Joan: Restarted CVNBot18 (Last message was received on RCReader 119010.265502 seconds ago)

2019-03-18

  • 15:51 rxy: Flags +AV were set on cohaf in #cvn-meta.
  • 15:50 rxy: Flags +AV were set on cohaf in #cvn-sw.
  • 09:32 rxy: rxy@cvn-app8:~$ sudo kill $CVNBot3PID

2019-03-16

  • 01:42 Krinkle: Transfer unused nick 'CVNBot11' from CVN-Bots2 (full; 5/5) to CVN-Bots5
  • 01:42 Krinkle: Transfer unused nick 'CVNBot15' from CVN-Bots3 (full; 5/5) to CVN-Bots5

2019-03-15

  • 18:38 Joan: Restarted CVNBot18 (Last message was received on RCReader 58851.677459 seconds ago)

2019-03-14

  • 15:31 Krinkle: Killed 4 parallel /srv/cvn/git/infrastructure/bin/cvndb-pull processes on cvn-apache9
  • 15:28 Krinkle: Killed 200 parallel cvndb-CVNBot14-publish processes on cvn-app8

2019-03-12

  • 05:20 rxy: Flags +AV were set on cohaf in #cvn-simplewikis.
  • 05:18 rxy: Flags +AV were set on Tulsi in #cvn-sw.

2019-03-11

  • 18:46 Joan: Restarted CVNBot18 (Last message was received on RCReader 29613.939513 seconds ago).

2019-03-09

  • 17:52 Joan: Restarted CVNBot18 (Last message was received on RCReader 47252.762304 seconds ago)

2019-03-08

  • 19:05 Joan: Restarted CVNBot18 (Last message was received on RCReader 64065.614616 seconds ago)

2019-03-04

  • 18:43 Joan: Flag +V were set on AsimovBot in #cvn-es-scan.
  • 18:33 Joan: Flags +AV were set on jem, DLeandroc, wiki1776 and Esteban16 in #cvn-es-scan.
  • 18:22 Joan: Restarted CVNBot18 (Last message was received on RCReader 29421.503816 seconds ago)

2019-02-28

  • 20:11 Joan: Restarted CVNBot18 (Last message was received on RCReader 22761.108125 seconds ago)
  • 15:36 rxy: Flags +AV were set on Zppix in #cvn-simplewikis.

2019-02-27

  • 23:51 Joan: Restarted CVNBot18 (Last message was received on RCReader 95275.811571 seconds ago)

2019-02-25

  • 21:43 Joan: Restarted CVNBot18 (Last message was received on RCReader 106111.888376 seconds ago)

2019-02-22

  • 05:12 Joan: Restarted CVNBot18 (Last message was received on RCReader 31518.429916 seconds ago)

2019-02-20

  • 02:17 Joan: CVNBot18 restarted (Last message was received on RCReader 57307.704279 seconds ago)

2019-02-18

  • 21:59 rxy: sudo kill $CVNBot1PID

2019-02-15

  • 22:49 Joan: Restarted CVNBot3 (Last message was received on RCReader 5729.637672 seconds ago)
  • 06:20 Joan: Restarted CVNBot18 (Last message was received on RCReader 53393.770933 seconds ago)

2019-02-05

  • 23:08 Joan: Restarted CVNBot18 (Last message was received on RCReader 131313.161477 seconds ago)

2019-01-30

  • 00:55 Joan: Restarted CVNBot18 (Last message was received on RCReader 5395.508043 seconds ago)

2019-01-26

  • 02:55 Joan: CVNBot18 restarted (Last message was received on RCReader 5385.431178 seconds ago)

2019-01-25

  • 17:51 Joan: Restarted CVNBot18 (Last message was received on RCReader 4033.703116 seconds ago)
  • 01:45 Cam11598: Flags +fiotv were set on Operator873 in #cvn-simplewikis.
  • 01:43 Cam11598: Flags +AV were set on Operator873 in #cvn-wp-en.
  • 00:38 Krinkle: Rebooting cvn-app8

2019-01-24

  • 00:37 Joan: Restarted CVNBot18 (Last message was received on RCReader 5612.850734 seconds ago)

2019-01-23

  • 15:50 Cam11598: 7:49:59 AM <@Cam11598> Cameron CVNBot18 restart
  • 15:50 Cam11598: 7:49:59 AM <CVNBot18> Last message was received on RCReader 6280.499422 seconds ago
  • 08:09 Krinkle: Rebooting cvn-app8 and cvn-app9

2019-01-21

  • 04:50 Joan: CVNBot18 restarted

2019-01-20

  • 20:49 AlexZ: restarted SWBot3

2019-01-18

  • 23:24 Joan: Restarted CVNBot18 in #cvn-wikidata (Last message was received on RCReader 3624.79361 seconds ago)
  • 03:02 Krinkle: Update /srv/cvn/git/infrastructure to latest master on cvn-app8 and cvn-app9
  • 02:58 Krinkle: access #cvn-wp-es add Joan@wikimedia/JOAN local_op
  • 02:48 Krinkle: Add CVN-ClerkBot_ to #cvn-es-scan
  • 02:34 Krinkle: #cvn-es-scan approved for Joan (m:User:JOAN), with wm-bot. Maybe later CVNBot - https://github.com/countervandalism/infrastructure/issues/21

2019-01-17

  • 00:46 Joan: Restarted CVNBot18 (Last message was received on RCReader 5003.313454 seconds ago)

2019-01-16

  • 00:27 Joan: Restarted CVNBot18 (Last message was received on RCReader 36500.416889 seconds ago)

2019-01-15

  • 03:42 rxy: rxy@cvn-app8:~$ sudo kill $CVNBot14_pid

2019-01-14

  • 03:39 rxy: Flags +AV were set on Vermont in #cvn-mediawiki.
  • 03:36 rxy: Flags +AV were set on Zhangj1079 in #cvn-wikivoyage.
  • 03:36 rxy: Flags +AV were set on Zhangj1079 in #cvn-wikidata.
  • 03:36 rxy: Flags +AV were set on Zhangj1079 in #cvn-mediawiki.
  • 03:36 rxy: Flags +AV were set on Zhangj1079 in #cvn-commons-uploads.

2019-01-13

  • 15:24 Joan: Restarted CVNBot18 in #cvn-wikidata (Last message was received on RCReader 4003.334833 seconds ago)
  • 00:27 Joan: Restarted CVNBot18 in #cvn-wikidata (Last message was received on RCReader 3666.364954 seconds ago)

2019-01-12

  • 17:59 Joan: Restarted CVNBot18 in #cvn-wikidata (Last message was received on RCReader 5893.862965 seconds ago)

2019-01-11

  • 01:34 AlexZ: Flags +AV were set on Kb03 in #cvn-unifications.

2019-01-10

  • 23:14 Joan: Restarted CVNBot18 in #cvn-wikidata (Last message was received on RCReader 3054.046536 seconds ago)
  • 19:49 Joan: Restarted CVNBot18 in #cvn-wikidata (Last message was received on RCReader 2826.897996 seconds ago)
  • 18:16 Joan: Restarted CVNBot18 in #cvn-wikidata (Last message was received on RCReader 3021.34062 seconds ago)

2019-01-09

  • 22:06 Joan: Restart CVNBot18 in #cvn-wikidata (Last message was received on RCReader 6503.673215 seconds ago)

2019-01-08

  • 22:18 Joan: Restart CVNBot18 in #cvn-wikidata
  • 02:57 Cam11598: granted Joan@wikimedia/JOAN local_op on #cvn-wikidata

2019-01-07

  • 16:40 rxy: Flags +AV were set on LakesideMiners in #cvn-unifications.

2019-01-06

  • 23:02 AlexZ: restarted CVNBot14, CVNBot18, CVNBot2, CVNBot3, CVNBot5 due to RC lag.

2019-01-04

  • 15:10 Hauskatze: restarted cvnbot3 on #cvn-wp-es
  • 11:11 rxy: Flags +AV were set on shanmugamp7 in #cvn-mediawiki.
  • 05:57 Cam11598: restarted cvnbot19
  • 05:57 Cam11598: 9:56:34 PM <�25B100+ CVNBot19> Last message was received on RCReader 5202.596163 seconds ago

2019-01-02

  • 21:14 Cam11598: restarted cvnbot19
  • 21:14 Cam11598: 1:13:20 PM <+CVNBot19> Last message was received on RCReader 4397.05632 seconds ago

2018-12-30

  • 04:40 Oshwah: Received +o in #cvn-wp-en
  • 04:38 AlexZ: unban snowycats and +o Oshwah in #CVN-wp-en

2018-12-28

  • 21:24 Cam11598: restarted cvnbot18
  • 21:24 Cam11598: 1:23:04 PM <�25B100+ CVNBot18> Last message was received on RCReader 31391.185322 seconds ago
  • 05:41 Cam11598: restarted cvnbot10
  • 05:41 Cam11598: 9:40:50 PM <�25B100+ CVNBot10> Last message was received on RCReader 80417.36911 seconds ago
  • 05:37 AlexZ: CVNBot3 restarted due to lag

2018-12-27

  • 01:55 Krinkle: Upgrade CVNBot18 to CVNBot 1.22.0-beta.1 (latest master, xbuild, cvn-app8)
  • 01:38 Cam11598: restarted cvnbot18 had no response for over 30000 seconds

2018-12-25

  • 19:04 Cam11598: CVNBot1 restarted
  • 19:04 Cam11598: 11:04:09 AM <+CVNBot1> Last message was received on RCReader 24889.420019 seconds ago
  • 18:28 Krinkle: CVNBot19 inactive over 5000 seconds. Restarted
  • 18:27 Krinkle: CVNBot 6, 8, 9, 10 were inactive over 30,000 seconds. Restarted

2018-12-24

  • 01:43 Cam11598: restarted all bots due to 6 minute lag reported by bsadaowski1

2018-12-23

  • 04:12 AlexZ: restarted CVNBot18 for not responding on rc channel
  • 04:11 AlexZ: 8:11:14 PM <+CVNBot18> Last message was received on RCReader 208260.640677 seconds ago

2018-12-20

  • 23:41 Cam11598: restarted cvnbot19, cvnbot6 cvnbot7
  • 23:40 Cam11598: 3:37:56 PM <�25B100+ CVNBot7> Last message was received on RCReader 144095.001034 seconds ago
  • 23:40 Cam11598: 3:37:47 PM <�25B100+ CVNBot6> Last message was received on RCReader 143289.512457 seconds ago
  • 23:39 Cam11598: 3:37:39 PM <�25B100+ CVNBot19> Last message was received on RCReader 1055.947407 seconds ago
  • 00:59 Cam11598: 4:57:54 PM <�25B100+ CVNBot18> Last message was received on RCReader 25099.776314 seconds ago

2018-12-17

  • 07:55 AlexZ: rebooted cvnbot18 due to no activity in 3d

2018-12-13

  • 03:30 Cam11598: 7:30:09 PM �25B100<+ CVNBot19> Last message was received on RCReader 2757.868659 seconds ago
  • 03:29 Cam11598: 7:29:41 PM <�25B100+ CVNBot18> Last message was received on RCReader 41761.804095 seconds ago
  • 03:29 Cam11598: restarted CVNBot1
  • 03:28 Cam11598: 7:28:15 PM <�25B100+ CVNBot1> Last message was received on RCReader 40284.618378 seconds ago

2018-12-09

  • 18:15 Krinkle: access #cvn-wikidata add Esteban16 voiced

2018-12-08

  • 20:05 Cam11598: 12:03:52 PM <@Cam11598> cvnbot3 restart
  • 20:05 Cam11598: 12:03:46 PM <+CVNBot3> Last message was received on RCReader 192160.850344 seconds ago
  • 20:01 Cam11598: restarted Cubbie
  • 20:01 Cam11598: 12:00:00 PM <+Cubbie> Last message was received on RCReader 191898.12268 seconds ago
  • 20:00 Cam11598: 11:59:55 AM <@Cam11598> CVNBot18 restart
  • 20:00 Cam11598: 11:59:49 AM <+CVNBot18> Last message was received on RCReader 118066.396796 seconds ago

2018-12-07

  • 08:05 AlexZ: 12:03:36 AM <+CVNBot1> Last message was received on RCReader 62547.035233 seconds ago
  • 08:04 AlexZ: CVNBot1 rebooted due to reporting no edits in 17hrs

2018-12-06

  • 00:39 AlexZ: rebooted all the bots due to lag

2018-12-04

  • 16:44 AlexZ: CVNBot3 and CVNBot18 were rebooted

2018-12-02

  • 21:25 Cam11598: restarted CVNBot19
  • 06:12 Cam11598: restarted bot #'s 2, 4, 6, 9, 14, 19 none of them appeared to be in their irc.wikimedia.org channels.
  • 06:09 Cam11598: 10:05:45 PM <+CVNBot24> Last message was received on RCReader 566110.673466 seconds ago
  • 06:05 Cam11598: 10:04:12 PM <+CVNBot19> Last message was received on RCReader 7186.456569 seconds ago
  • 06:03 Cam11598: 10:02:10 PM <+CVNBot14> Last message was received on RCReader 820278.151891 seconds ago
  • 05:59 Cam11598: 9:59:35 PM <+CVNBot9> Last message was received on RCReader 30702.16703 seconds ago
  • 05:59 Cam11598: 9:59:00 PM <+CVNBot6> Last message was received on RCReader 33346.388139 seconds ago
  • 05:58 Cam11598: 9:58:29 PM <+CVNBot4> Last message was received on RCReader 650.202431 seconds ago
  • 05:58 Cam11598: 9:57:44 PM <+CVNBot2> Last message was received on RCReader 717807.952057 seconds ago
  • 02:28 Cam11598: bots 3 & 18 restarted by rxy at about 22:00 UTC

2018-12-01

  • 07:33 AlexZ: set voice for Hian in #cvn-commons , #cvn-meta , #cvn-sw-spam , and #cvn-wp-en
  • 02:08 Cam11598: set Vermont voiced in cvn-meta

2018-11-30

  • 03:54 Cam11598: restarted bots 18, 3
  • 00:32 Cam11598: 4:32:16 PM <ChanServ> Flags +AV were set on Kb03 in #cvn-wp-en.
  • 00:23 Cam11598: restarted CVNBot1
  • 00:22 Cam11598: 4:22:35 PM <�25B100+ CVNBot1> Last message was received on RCReader 5768.530484 seconds ago

2018-11-29

  • 20:44 Cam11598: restarted CVNBots 6, 8, 10, 19 all had greater than 1,000 second delays from RC network

2018-11-28

  • 07:38 Cam11598: restarted cvnbot18 after this delay in rtrc updates: 11:37:09 PM <�25B100+ CVNBot18> Last message was received on RCReader 16351.91394 seconds ago
  • 04:39 Cam11598: 8:39:18 PM <ChanServ> Flags +AV were set on Bradv in #cvn-wp-en.
  • 04:34 Cam11598: 8:32:52 PM <ChanServ> Flags +AV were set on SQLDb in #cvn-wp-en. (SQL is an en wiki admin)

2018-11-27

  • 10:00 AlexZ: restarted bots 6,7,8 and 19 in #cvn-sw

2018-11-26

  • 16:07 AlexZ: SWBot3 rebooted by Cam11598

2018-11-10

  • 03:41 Krinkle: CVNBot4, 5 and SWBot3 were missing from broadcast link. Restart fixed it.

2018-11-07

  • 00:46 Krinkle: Rebooting cvn-app8 and cvn-app9 servers.
  • 00:44 Krinkle: Problems with bots are not due to unexpected reboot (there was no such reboot). Instead, the cause is https://phabricator.wikimedia.org/T208916 (wmflabs internal network problems).

2018-11-06

  • 23:39 Krinkle: It seems connections stopped from cvn-app bot services. Are slowly recovering now. Possible server restart?

2018-10-29

  • 15:50 rxy: reboot cvn-app9.eqiad1
  • 15:50 rxy: reboot cvn-app8.eqiad1
  • 03:51 AlexZ: Flags +AV were set on Joan in #cvn-wp-en.

2018-10-22

  • 09:46 rxy: Flags +AV were set on BRPever in #cvn-commons.

2018-10-17

  • 15:56 Cam11598: 8:55:44 AM <ChanServ> Flags +AV were set on Tks4Fish in #cvn-simplewikis.

2018-10-14

  • 19:26 Cam11598: 12:25:33 PM <ChanServ> Flags +AV were set on Operator873 in #cvn-sw.

2018-10-12

  • 20:22 Krinkle: Upgrade mono packages to latest from mono-project (5.16)
  • 20:21 Krinkle: Adding mono-project to apt sources on cvn-app8 and cvn-app9

2018-10-11

2018-10-03

  • 22:39 Krinkle: Flags -AV were set on Rodejong in #cvn-wp-da.

2018-10-02

  • 01:01 Cam11598: 6:00:28 PM <ChanServ> Flags +AV were set on Vermont in #cvn-commons.

2018-09-16

  • 05:19 rxy: Flags +AV were set on [1997kB] in #cvn-sw.

2018-09-14

  • 18:25 Krinkle: cs access #cvn-wp-en add Father_of_Lies voiced
  • 18:25 Krinkle: cs access #cvn-sw add Father_of_Lies voiced
  • 03:17 Cam11598: restarted cvnbot3

2018-09-09

  • 18:17 Krinkle: access #cvn-simplewikis add CabalBot bot

2018-08-27

  • 21:17 rxy: Flags +AV were set on Father_Of_Lies in #cvn-wp-nl.

2018-08-24

  • 17:25 rxy: rxy@cvn-app9:~$ sudo kill $CVNBot25_pid
  • 17:24 rxy: rxy@cvn-app9:~$ sudo kill $CVNBot17_pid
  • 17:24 rxy: rxy@cvn-app8:~$ sudo kill $CVNBot20_pid
  • 17:22 rxy: rxy@cvn-app8:~$ sudo kill $CVNBot5_pid
  • 17:22 rxy: rxy@cvn-app8:~$ sudo kill $CVNBot4
  • 17:16 rxy: rxy@cvn-app8:~$ sudo kill $SWBot3Pid

2018-08-10

  • 01:51 AlexZ: 6:50:28 PM <ChanServ> Matiia set flags +AV on irrationalist in #cvn-sw

2018-08-09

  • 01:06 rxy: Flags +AV were set on Esteban16 in #cvn-meta.

2018-08-05

  • 22:48 rxy: rxy@cvn-app8:~$ kill $CVNBot21_pid
  • 22:46 rxy: rxy@cvn-app8:~$ kill $CVNBot18_pid

2018-07-28

  • 04:13 rxy: Flags +AV were set on Joanmrl in #cvn-wikidata.
  • 04:13 rxy: Flags +AV were set on Joanmrl in #cvn-meta.

2018-07-25

  • 05:27 Cam11598: Flags +AV were set on PlyrStar93 in #cvn-sw.

2018-07-15

  • 08:49 rxy: (ChanServ) : Flags +AV were set on BRPever in #cvn-sw.

2018-07-12

  • 06:01 Cam11598: 10:58:09 PM <ChanServ> Flags +AV were set on Mz7 in #cvn-wp-en.
  • 06:00 AlexZ: 10:56:24 PM < ChanServ> Cam11598 (cameron11598) set flags +AV on TheSandDoctor in #cvn-wp-en (en wiki sysop)

2018-06-23

  • 03:19 Cam11598: Matia set flags +AV on Framawiki in #cvn-sw

2018-06-17

  • 21:57 Cam11598: 2:52:46 PM <@ ChanServ> AlexZ (Az1568) set flags +AV on AntiComposite in #cvn-wp-en
  • 21:56 Cam11598: 2:54:49 PM <@ ChanServ> AlexZ (Az1568) set flags +AV on Operator873 in #cvn-simplewikis

2018-06-15

2018-06-13

2018-06-10

2018-06-09

  • 18:49 Cam11598: 11:49:16 AM <@ ChanServ> Cam11598 (cameron11598) set flags +AV on Zhangj1079 in #cvn-sw
  • 16:20 rxy: Flags +AV were set on Zhangj1079 in #cvn-simplewikis. per m:Special:Diff/18114842

2018-06-04

  • 21:23 Krinkle: #cvn-wp-da add Asger1995 local_op

2018-05-27

2018-04-26

2018-02-17

  • 09:12 rxy: rxy@cvn-app8$ echo 'feedFilterUsersReg=1' >> /srv/cvn/services/cvnbot/CVNBot21/CVNBot.ini

2018-02-16

  • 00:20 Krinkle: Revoked access to 'cvn' Wikimedia Cloud VPS project for 'sactage' and 'seahorseruler' users

2018-01-28

  • 18:44 rxy: Setup CVNBot25 for #cvn-ko-scan @cvn-app9
  • 18:32 rxy: rxy@cvn-app9:/srv/cvn/git/stillalive$ sudo chmod g+w -R .
  • 18:02 rxy: rxy@cvn-app9:/srv/cvn/git/CVNBot$ sudo chmod g+w /srv/cvn/services/cvnbot/
  • 18:01 rxy: rxy@cvn-app9:/srv/cvn/git/CVNBot$ sudo chmod g+w -R .

2018-01-16

  • 21:54 rxy: "@cvn-app9:/srv/cvn/services/cvnbot/CVNBot16$ sudo chmod g+w Projects.xml" : error fixing when execute command "batchreload"

2018-01-06

2017-11-18

  • 21:40 Krinkle: Deleting cvn-apache8 (replaced by cvn-apache9)
  • 02:36 Krinkle: Shutdown now-unused cvn-apache8 instance. To be deleted later.
  • 02:36 Krinkle: Switch cvn.wmflabs.org web proxy over to new cvn-apache9 backend.
  • 02:14 Krinkle: Create and provision cvn-apache9 (Debian 9 Stretch) to replace cvn-apache8 (Ubuntu 14 Trusty)

2017-11-17

  • 01:41 Krinkle: Deleting cvn-app6 instance

2017-11-15

  • 01:20 Krinkle: cvn-app6 is now idle. Shutting down from Horizon. To be deleted next week.

2017-10-27

  • 02:13 Krinkle: Moved CVNBot16 (with Console-js.msgs) to cvn-app9

2017-10-26

  • 00:58 Krinkle: Voiced NewbieAudioVideo (Dispenser) in #cvn-sw

2017-10-25

2017-10-22

  • 07:09 Krinkle: Created cvn-app9 (Debian 9) - will replace cvn-app6 (Trusty)
  • 07:09 Krinkle: Shutting down cvn-app7 (unused, migrated bots to cvn-app8)

2017-10-16

2017-10-13

  • 18:33 Krinkle: moved CVNBot1 to cvn-app8 and upgraded to v1.22.0-alpha
  • 17:54 Krinkle: CVNBot12 is now running v1.22.0-alpha on cvn-app8 (Debian 9, Mono 4)

2017-10-12

  • 23:29 Krinkle: Disabling /etc/cron.hourly/cvn-collect-log on all servers

2017-10-11

2017-10-10

2017-10-07

  • 21:00 Krinkle: Ran sudo apt-get clean on cvn-apache8 to free up some space.
  • 20:47 Krinkle: Soft-rebooting cvn-apache8

2017-08-17

  • 18:06 Krinkle: Restarted servers to have them re-join #cvn-broadcast following the random K-like from freenode staff

2017-08-10

  • 18:26 Krinkle: CVNBot12 won't restart. Has been in a once-a-minute restart loop for the past 24 hours (log: "IRC: Closing Link: 208.80.155.139 (Connection timed out)")
  • 18:19 Krinkle: CVNBot12 is online, but not in any channel. Process is running. Restarting..

2017-01-18

2016-11-28

  • 19:25 Krinkle: Changed e-mail address of Clogger cvnwiki account from my personal gmail to cvn.admins@tools.wmflabs.org

2016-11-24

  • 03:49 Krinkle: Fix cvndb-pull.cron permissions on cvn-apache8 (caused api to not get updated every 5 minutes)

2016-11-21

  • 18:54 Krinkle: Deleted cvn-app5 instance

2016-11-19

  • 01:54 Krinkle: [horizon.wikimedia.org] Retiring cvn-app5 (removing public IP, shutting down instance). To be deleted in a few days.
  • 01:49 Krinkle: Restored CVNBot20 database from cvn-app5 (retired) to cvn-app7 (got corrupted in transfer somehow)
  • 01:43 Krinkle: CVNBot20 database backup 2 days ago (Nov 16) also corrupt.
  • 01:40 Krinkle: CVNBot20 database was corrupted for unknown reasons. Replaced with a copy of CVNBot14's database.
  • 00:15 Krinkle: 'sudo chmod 660 */CVNBot.ini' in /srv/cvn/services/cvnbot on cvn-app6 and cvn-app7
  • 00:09 Krinkle: 'sudo chmod 775 */CVNBot.exe */Lists.sqlite' in /srv/cvn/services/cvnbot on cvn-app6 and cvn-app7

2016-11-18

  • 23:06 rxy_: rxy@cvn-app7 "sudo chmod g+w -R /srv/cvn/git/stillalive" for write permission of group members
  • 23:05 rxy_: rxy@cvn-app6 "sudo chmod g+w -R /srv/cvn/git/stillalive" for write permission of group members
  • 22:56 rxy_: rxy@cvn-app6 "sudo chmod g+w /srv/cvn/services/cvnbot" for write permission of group members
  • 22:56 rxy_: rxy@cvn-app6 "sudo chgrp project-cvn /srv/cvn/services/cvnbot" for write permission of group members
  • 22:49 rxy_: rxy@cvn-app7 "sudo chmod g+w /srv/cvn/services/cvnbot" for write permission of group members
  • 22:48 rxy_: rxy@cvn-app7 "sudo chgrp project-cvn /srv/cvn/services/cvnbot" for write permission of group members

2016-11-16

  • 02:17 Krinkle: Moving CVNBot1, CVNBot4, CVNBot5, CVNBot12, and CVNBot13 from cvn-app5 to cvn-app7
  • 02:02 Krinkle: Moving Cubbie and SWBot3 from cvn-app5 to cvn-app7
  • 01:55 Krinkle: Moving CVNBot21 (#cvn-mediawiki) from cvn-app5 to new cvn-app7
  • 00:57 Krinkle: Provisioning cvn-app7

2016-11-15

  • 06:13 Krinkle: Creating cvn-app7 (m1.large; ubuntu-14.04-trusty) - replacement for cvn-app5 (m1.xlarge; ubuntu-12.04-precise)
  • 06:00 Krinkle: Decom cvn-app4 (created 2014; ubuntu-12.04-precise) - all bots migrated to cvn-app6 (ubuntu-14.04-trusty)
  • 06:00 Krinkle: Moving CVNBot23 from cvn-app4 to cvn-app6
  • 05:55 Krinkle: Moving CVNBot9, CVNBot10, and CVNBot19 from cvn-app4 to cvn-app6
  • 05:40 Krinkle: Moving CVNBot6, CVNBot7, and CVNBot8 from cvn-app4 to cvn-app6
  • 05:17 Krinkle: Moving CVNBot3 from cvn-app4 to cvn-app6

2016-09-25

  • 11:09 rxy: "rxy@cvn-app4:~$ sudo kill $CVNBot3pid" for restarting.
  • 11:09 rxy: "rxy@cvn-app5:~$ sudo kill $CVNBot4pid, $CVNBot14pid, $CVNBot17pid" for restarting.

2016-08-22

  • 18:58 rxy: rebooting cvn-app4.eqiad.wmflabs

2016-08-07

  • 00:21 rxy: "sudo kill $CVNBot16pid" for restarting.

2016-06-03

  • 21:34 Krinkle: cvn-app6 is now up and running. 1/10 bots from cvn-app4 (CVNBot2) has been migrated to it. No other bots are migrated yet as cvn-app6 does not yet have a dedicated IP and therefore is subject to the shared freenode limit for labs.

2016-05-04

  • 10:47 Krinkle: cvn-app6 (trusty) running stable. Migration from cvn-app4 to continue as planned.
  • 10:47 Krinkle: Restarted CVNBot14 (#cvn-commons) - IRC connection was lost

2016-04-23

  • 02:00 Krinkle: Provision cvn-app6 based on infrastructure setup.yaml

2016-04-22

  • 17:26 Krinkle: Creating cvn-app6 (Ubuntu 14 Trusty, Size: Large) as migration target for cvn-app4 (*deprecated* Ubuntu 12 Precise, Size: Extra large)

2016-04-12

  • 11:24 rxy: setup CVNBot23 in cvn-app4

2016-04-02

  • 05:44 Krinkle: Edit CVNBot19 Projects.xml configuration: Correct projectName for test.wikidata.org to 'testwikidata.wikipedia' (per legacy wmgRC2UDPPrefix override)
  • 05:14 Krinkle: rsync'ed CVNBot3 from cvn-app5 to cvn-app4
  • 05:14 Krinkle: rsync'ed CVNBot2 from cvn-app5 to cvn-app4
  • 05:14 Krinkle: rsync'ed CVNBot19 from cvn-app5 to cvn-app4

2016-02-22

  • 14:48 rxy: "sudo rm /var/lib/puppet/state/agent_catalog_run.lock" for fix to puppet failure.

2016-02-18

2015-11-28

  • 19:35 rxy: Setting up Cubbie in cvn-app5.

2015-09-11

  • 23:57 Krinkle: Restore localised messages (nl) for CVNBot12

2015-06-05

  • 17:00 Krinkle: Unscheduled reboot of cvn-app5. Bots are having trouble writing to local disk.

2015-04-24

  • 19:03 Krinkle: Restarted cvn-app4. Somehow it became unreachable for over an hour.
  • 18:11 Krinkle: Promoted Rxy from member to projectadmin

2015-04-23

  • 17:13 andrewbogott: rebooted cvn-app5 and cvn-app4 (not at the same time) because I suspect them of running amok
  • 15:42 andrewbogott: migrating cvn-app4 to labvirt1001 in an attempt to redistribute load a bit

2015-04-22

  • 12:47 andrewbogott: migrating cvn-app4 and cvn-app5 to labvirt1005 and labvirt1006, respectively. Seems to be working now.
  • 03:00 Krinkle: Archived cvn-apache5 access logs to /data/project/cvn-common/backup/cvn-apache5-accesslogs.tar.gz
  • 02:54 Krinkle: https://cvn.wmflabs.org now points to cvn-apache8 (UbuntuTrusty; Apache 2.4). The old cvn-apache5 (UbuntuPrecise; Apache 2.2) will be deleted shortly after archiving web logs to NFS.

2015-04-21

  • 21:26 Krinkle: Apply role::labs::lvm::srv via Hiera
  • 21:01 andrewbogott: cold-migrating cvn-app4 to labvirt1005

2014-09-20

  • 14:43 andrewbogott: moved cvn-apache5 to virt1007

2014-06-12

  • 01:51 Krinkle: Disabled role::labs::lvm::mnt, and enabled role::labs::lvm::srv instead (separate changes)
  • 01:12 Krinkle: Enable role role::labs::lvm::mnt on all cvn instances

2014-05-04

  • 18:30 Krinkle: CVNBot1 (feeds #cvn-wp-en; migrated from rcbot) is now hosted in Wikimedia Labs, runs on cvn-app4.

2014-04-23

  • 04:12 Krinkle: Renamed KrinkleBot2 to CVNBot2 (assigned NickServ account CVN-Bots, shard0)
  • 03:50 Krinkle: CVNBot13 (feeds #cvn-wp-da; migrated from KyluBot) is now hosted in Wikimedia Labs, runs on cvn-app5.
  • 03:50 Krinkle: CVNBot12 (feeds #cvn-wp-nl; migrated from KrinkleBot7) is now hosted in Wikimedia Labs, runs on cvn-app4.
  • 03:50 Krinkle: Installed pidentd package on cnv-app servers.

2014-03-28

  • 00:00 Krinkle: Migrated web services from pmtpa to eqiad. cvn-apache*.pmtpa.wmflabs can be deleted.

2014-03-27

  • 19:11 Krinkle: Migrated all applications from pmtpa to eqiad. cvn-app*.pmtpa can be shut down.
  • 17:36 Krinkle: Installing packages on new eqiad instances (cvn-app4, cvn-app5, cvn-apache5)

2014-03-18

  • 05:34 Krinkle: Finished migration of all bots from the old and small app server (cvn-app1) to the large cvn-app2. Instance to be decomissioned.
  • 05:26 Krinkle: Created cvn-app3 as the first cvn server in wmflabs-eqiad. Don't use for now (not yet set up with proper packages), but will replace cvn-app1 and cvn-app2 from pmtpa soon.

2014-02-18

  • 20:45 Krinkle: Setting up cvn-app2 as app server (same packages as on cvn-app1)
  • 20:42 Krinkle: Deleted cvn-apache3, re-creating as cvn-apache4 with 'web' security group
  • 17:52 Krinkle: Setting up cvn-apache3 as web server

2014-02-13

  • 23:34 Krinkle: Apache instances keeps going brain dead (time out, no significant spike in ganglia, just gradually going OOM). Rebooted again..

2013-10-21

2013-10-14

2013-10-10

  • 05:16 Krinkle: Moving CVNBot14 from cvn@willow.toolserver.org to cvn-app1.wmflabs

2013-06-28

  • 17:29 Krinkle: Rebooted cvn-app1

2013-06-10

  • 23:23 Krinkle: Added seahorseruler to cvn access group.

2013-04-24

  • 14:03 matanya: rebooted by krinkle due to out of memory
  • 13:25 matanya: migrating Cluekie from Toolserver to labs

2013-04-10

  • 21:40 Krinkle: CVNBot-nl and CVNBot-es were down because it was unable to open i18n files. Files restored from git, bots automatically started by stillalive.

2013-04-4

2013-04-01

  • 22:11 Krinkle: cvn-app1 went OOM and kernel failed because of it (/home and /data unavailable). stillalive has auto-started the bots and we're back up.

2013-03-29

  • 00:19 Krinkle: Installing python-twisted-words and python-mysqldb from apt on cvn-app1 (for cvnclerkbot.py)

2013-03-28

  • 23:40 Krinkle: Installing mysql-server and mysql-client from apt on cvn-app1 (for cvnclerkbot.py)
  • 23:06 Krinkle: Installing subversion from apt on cvn-app1 (for pywikipedia)

2013-03-25

  • 14:04 Krinkle: gluster had another hickup, /data became unaccessible ("Transport endpoint is not connected"). Bots down for almost 24 hours. Rebooting the instance fixed it.

2013-02-27

  • 16:55 Krinkle: Pool configuration pushed to github: https://github.com/countervandalism/stillalive/blob/master/localSettings-cvn.json
  • 16:54 Krinkle: Add cvn-app1 to application pool.
  • 16:12 Krinkle: Depooling cvn-apache1 from application
  • 16:11 Krinkle: Installing php5-cli and mono-complete on cvn-app1
  • 08:05 Krinkle: cvn-apache2 is getting too small for all the cvn apps (wasn't supposed to run them in the first place, just apache). Created instance cvn-app1 with more cpu/memory. Moving over application pool later today.

2013-02-26

  • 13:02 Krinkle: Installing package "mono-complete"