Nova Resource:Git/SAL
Appearance
2020-05-08
- 14:58 andrewbogott: deleting project for T236569
2020-05-07
- 14:46 mutante: deleted instances gerrit-test7 and puppet-paladox T236569
- 07:59 mutante: - shutting down instance puppet-paladox, backups created and uploaded to deploy-1002 in devtools (T236569)
- 07:55 mutante: - shutting down instance gerrit-test7, backups created and uploaded to deploy1002 in devtools, disassociating floating IP (T236569)
2020-05-06
- 15:35 mutante: - instance gerrit-test7 was reachable and suddenly it wasn't, paladox suggested it is ferm but it's unclear what changed anything, rebooting it
2020-01-15
- 20:56 mutante: deleting instance gerrit-mysql (used be icinga2 for ores, but ores has prod icinga checks at least) T236569
- 19:38 mutante: shutting down and deleting instance 'jenkins-slave-02' (T236569)
- 19:36 mutante: shutting down and deleting instance 'gerrit-test' (T236569)
2019-11-08
- 12:58 paladox: rebuilding gerrit-test6 as gerrit-test7
2019-11-07
- 18:40 paladox: rebuilding gerrit-test5 as gerrit-test6 (with buster) to re-test T200739
2019-10-11
- 13:16 Zppix: apt update and apt full-upgrade ran on all *.git.wmflabs instances
2019-10-04
- 15:00 Zppix: Reset password for user Halfak per IRC request
2019-09-28
- 14:58 Zppix: sudo service ircecho restart due to bot pingout and not restarting self
2019-09-26
- 20:21 Zppix: Upgrade all instances to linux-image-4.19.0-0.bpo.6-amd64
2019-09-25
- 20:50 Zppix: create new web auth creds for accraze for Icinga2
2019-09-17
- 15:12 Zppix: deploy gerrit:537463 for T233114 on gerrit-mysql
2019-09-16
- 21:19 Zppix: deploy gerrit:537202 for T232921 on gerrit-mysql
2019-09-15
- 17:13 Zppix: cd /etc/puppet/modules/icinga2; git pull on puppet-paladox. puppet agent -tv on gerrit-mysql to deploy gerrit:536775 T232921
2019-09-08
- 23:06 Zppix: run apt full-upgrade on all instances
2019-05-08
- 07:50 paladox: rebuilding jenkins-slave-01 as jenkins-slave-02 - T222668
2019-05-06
- 22:54 Zppix: Started downtime for alerts for jenkins-slave01 on icinga2 until may 20 due to T222176
2019-05-02
- 12:50 Zppix: deployed gerrit:507552 T222289
2019-04-19
- 13:57 paladox: disabling puppet on gerrit-test5 temporarily
2019-04-18
- 16:26 paladox: rebuilding gerrit-test3 as gerrit-test5 due to removal of a kernel during a upgrade to stretch.
- 15:27 paladox: upgrading gerrit-test3 to debian 9 (stretch)
2019-03-25
- 17:45 Zppix: running apt full-upgrade on gerrit-mysql, gerrit-test, gerrit-test3, jenkins-slave-01, and puppet-paladox
2019-03-22
- 17:51 paladox: deploy new session plugin to gerrit-test3 T218739
2019-03-21
- 18:17 Zppix: Rebooting gerrit-test.git and gerrit-mysql.git to try to troubleshoot issue with Icinga2 not properly executing checks suddenly
2019-03-18
- 14:54 Zppix: updated apt repo for packages.sury.org to update apt.gpg key for apt repo on Jenkins-slave-01.git.
2019-03-15
- 17:51 Zppix: Prune old logs in /var/log on puppet-paladox
2019-03-07
- 21:56 paladox: setting up multi-site up on gerrit-test3 T217174
- 21:13 paladox: disabling puppet on gerrit-test3 (preparing for multi master)
2019-03-06
- 19:05 Zppix: Ran sync; echo 3 > /proc/sys/vm/drop_caches on gerrit-test.git
- 10:45 mutante: - gerrit-test3 - re-enabling disabled puppet
2019-03-05
- 19:49 paladox: enabling kafka on gerrit-test3 in mwvagrant for the multi master gerrit setup.
- 19:11 Zppix: Ran apt full-upgrade, apt autoclean, and apt autoremove on gerrit-mysql.git
- 19:01 Zppix: Ran apt full-upgrade, apt autoclean, and apt autoremove on gerrit-test.git, gerrit-test3.git, puppet-paladox.git, and jenkins-slave-01.git
2019-02-05
- 17:35 paladox: temporarily disabling puppet on gerrit-test3 whilst trying T211139
2018-12-18
- 18:56 paladox: upgrading gerrit-new.wmflabs.org to not use ReviewDB any more.
2018-11-16
- 22:35 paladox: upgrading gerrit-test.wmflabs.org to gerrit 2.16
2018-11-15
- 01:11 paladox: removing the old ui ( https://gerrit-review.googlesource.com/c/gerrit/+/116790 ) from gerrit-new.wmflabs.org
2018-11-13
- 18:45 paladox: applying https://gerrit.wikimedia.org/r/c/operations/puppet/+/472720 (and restarting gerrit on gerrit-test3)
2018-10-23
- 21:50 paladox: upgrading gerrit.git.wmflabs.org (gerrit-test3) to 2.16rc0 (basically 2.16rc1)
2018-10-08
- 21:50 paladox: upgrading gerrit to 2.16 (master) on gerrit-new.wmflabs.org per T206407
- 21:39 paladox: upgrading gerrit to 2.15.5 on gerrit-test.wmflabs.org per T206407
2018-09-28
- 18:00 paladox: systemctl start gerrit after upgrade on gerrit-test3
- 17:56 paladox: upgrading gerrit to 2.16 (master branch) on gerrit-test3 to test T205346 T200739
- 17:53 paladox: systemctl stop gerrit on gerrit-test3
2018-09-18
- 16:19 arturo: make myself projectadmin
2018-09-17
- 01:42 andrewbogott: migrating project to eqiad1-r
2018-05-31
- 20:22 paladox: sudo service gerrit start after upgrade to 2.15
- 20:19 paladox: java -jar gerrit.war init -d review_site on gerrit-test3
- 20:18 paladox: sudo service gerrit stop on gerrit-test3
- 19:43 paladox: cherry picking https://gerrit.wikimedia.org/r/#/c/436607/ onto phab-tin for scap deploy
- 19:16 paladox: preparing gerrit-test3 for upgrade to 2.15 (testing T174034 and T177201)
2018-04-06
- 21:52 paladox: re enable puppet on gerrit-test3
- 21:27 paladox: disabling puppet on gerrit-test3 to test avatar stuff for gerrit
2018-03-17
- 20:11 paladox: upgraded gerrit-new yesturday night to include a majour new change https://gerrit-review.googlesource.com/c/gerrit/+/128411 + more fixes
2018-03-16
- 18:08 paladox: upgrading gerrit on gerrit-new.wmflabs.org/r/ to latest master version (includes ui tweeks + lots and lots of bug fixes)
2018-03-12
- 19:49 paladox: starting gerrit on gerrit-test3 after upgrade from 2.14.6 to 2.14.7
- 19:40 paladox: deploying https://gerrit.wikimedia.org/r/#/c/418966/ to gerrit-test3
2018-02-27
- 13:43 paladox: upgrading puppet-paladox to stretch.
2018-02-09
- 16:49 paladox: testing some gitiles changes on gerrit-test3 (so disabling puppet)
2018-02-06
- 18:17 paladox: deploying from gerrit master which includes a new desgn for polygerrit's change list on gerrit-new.wmflabs.org
2018-02-05
- 16:03 paladox: upgrade to gerrit 2.15 rc2 (stable-2.15 branch) on gerrit-test.wmflabs.org (also migrate to notedb from reviewdb (not completly migrate))
- 16:02 paladox: set notedb to automigrate on gerrit-test.wmflabs.org (gerrit-test)
2018-02-03
- 00:38 paladox: renabled puppet on gerrit-test3
2018-02-02
- 23:31 paladox: disabling puppet on gerrit-test3 for T186370
2018-01-25
- 14:34 Zppix: apt full-upgrade on jenkins-slave-01.git.eqiad.wmflabs
2018-01-18
- 22:10 Zppix: Deployed https://gerrit.wikimedia.org/r/404879 to gerrit-mysql for T185148
- 22:08 Zppix: Deployed https://gerrit.wikimedia.org/r/405201 to gerrit-mysql
2018-01-17
- 19:11 Zppix: maint. Window over hosts back up
- 19:08 Zppix: starting Maint. Window, shut down all hosts
2018-01-11
- 21:15 paladox: upgraded gerrit on gerrit-new.wmflabs.org to include the new edit preference (merged upstream).
2018-01-04
- 22:43 paladox: upgrading all instances to linux-image-4.9.0-5-amd64 (security)
2017-12-22
- 17:01 paladox: migrating gerrit-new.wmflabs.org (gerrit) to notedb.
- 16:49 paladox: install new code-mirror plugin in gerrit-new.wmflabs.org for polygerrit ui.
- 16:47 paladox: upgrading gerrit-test (gerrit-new.wmflabs.org) to latest head in gerrit.
2017-12-21
- 16:16 Zppix: restarted gerrit-mysql to restart icinga2-wm because I cant ssh into any vps hosts because i have no access to an desktop
2017-12-17
- 20:00 Zppix: Maintaince window for GIT over, E795 all hosts are back to normal functioning state!
- 19:00 Zppix: commencing maintaince window for all GIT hosts, E795
- 04:02 Zppix: Sent notices out to Wikimedia Scoring Platform to inform them about monthly maintaince window (https://phabricator.wikimedia.org/E795 ). Which effect all git hosts and services, such as Icinga2-wm.
2017-12-16
- 22:11 paladox: gerrit-test3 ldap down recreating mediawiki-vagrant with stretch after accidentially destroying the jessie one.
2017-12-14
- 17:42 Zppix: deployed Gerrit:398294 to denote ORES Experimental Hosts for #wikimedia-ai alerts. T182880
2017-12-11
- 22:16 paladox: recreating puppet-paladox3 as puppet-paladox
- 21:47 paladox: doing mass upgrades of puppet to puppet4.
- 21:46 paladox: upgrading puppet client on gerrit-test3 to puppet 4.
- 21:37 paladox: upgrading puppet client on gerrit-test to puppet 4.
- 21:16 paladox: upgrading puppetmaster on puppet-paladox3 to puppet 4
2017-12-07
- 22:39 Zppix: Hosts are all online and functional (Completed at 4:39 PM UTC-6)
- 22:33 Zppix: Executing planned host(s) restarts via Horizon (Starting at 4:33 PM UTC-6)
- 01:42 paladox: systemctl start gerrit on gerrit-test3
2017-12-06
- 22:11 paladox: systemctl stop gerrit on gerrit-test3
- 21:58 paladox: testing https://gerrit.wikimedia.org/r/395820 on gerrit-test3
2017-11-19
- 13:30 paladox: upgrading icinga2 to 2.8.0
2017-11-09
- 21:57 Zppix: added a new host, puppetdb-phabricator.phabricator.eqiad.wmflabs, as it is apart of a currently moderated project, and per maintainer request. Done 3:55 CST UTC-6
2017-10-25
- 12:49 paladox: upgrading gerrit-test3 to latest 2.14.6 pre release
2017-10-19
- 18:39 paladox: deploying https://gerrit.wikimedia.org/r/#/c/363734/ upgrading gerrit to 2.14.6-pre on gerrit-test3 and installing lfs plugin
2017-10-17
- 12:38 paladox: starting gerrit-new.wmflabs.org up with ldap auth
- 12:24 paladox: switching gerrit-test gerrit-new.wmflabs.org to ldpa using gerrit-test3 gerrit-test3.git.eqiad.wmflabs:1389 (mediawiki vagrant).
2017-10-16
- 21:13 paladox: deployed https://gerrit.wikimedia.org/r/#/c/384612/
2017-10-12
- 20:07 paladox: gerrit-test3 systemd start gerrit 2.14 update completed successfully T156120
- 20:04 paladox: gerrit-test3 on gerrit 2.14 now https://phabricator.wikimedia.org/P6113
- 19:51 paladox: stopping gerrit on gerrit-test3 (https://gerrit2.git.wmflabs.org) systemctl stop gerrit
- 19:34 paladox: preparing gerrit-test3 for the gerrit 2.14 update. testing 2.13 -> 2.14 update for T156120
2017-10-01
- 21:59 madhuvishy: Cold migrating gerrit-test3 from labvirt1015 to labvirt1017
2017-09-29
- 20:22 paladox: gerrit-test3 going down for maint.
- 20:16 Zppix: All hosts back up, and operational. No reported errors.
- 20:13 Zppix: Performing a rolling restart of all hosts.
2017-09-20
- 21:25 paladox: switching slave = true on gerrit-test3
- 20:57 paladox: disabling puppet on gerrit-test3 temp, trying to reproduce the slave issue in prod for gerrit
2017-09-11
- 15:47 paladox: recreating gerrit-test3.
- 15:44 paladox: revoking puppet for gerrit-test3.
2017-09-07
- 21:20 Zppix: created accounts for the Wikimedia Scoring Platform team due to recreation of auth database
2017-09-04
- 20:26 paladox: upgrading gerrit from 2.14.3-pre to 2.14-4-pre (2.14.3 was released, but i built from the 2.14 branch).
2017-08-11
- 14:26 paladox: upgrading gerrit-test3 to gerrit 2.14.3 pre
2017-08-02
- 18:07 paladox: enable puppet again on gerrit-mysql - deploying https://gerrit.wikimedia.org/r/#/c/369681/
- 15:20 paladox: disabling puppet on gerrit-mysql temp for icinga2 update (changed configuation needs change in the repo)
2017-08-01
- 17:53 paladox: upgrading gerrit on gerrit-new.wmflabs.org to 2.14.2-2449-gc8fa38496c (bazel build release) (master branch). Testing wikimedia branding for prod and the move change feature
2017-07-27
- 16:50 paladox: restarting gerrit-test3 gerrit to pickup https://gerrit.wikimedia.org/r/#/c/368196/
- 16:49 paladox: cherrypicking https://gerrit.wikimedia.org/r/#/c/368196/ to see if it has side affects
2017-07-24
- 10:32 paladox: upgrading gerrit to 2.14.2 final on gerrit-test3
2017-07-21
- 00:49 paladox: switch ldap on gerrit to gerrit-test3.git.eqiad.wmflabs
- 00:48 paladox: installed mediawiki vagrant for ldap
2017-07-20
- 23:31 paladox: applying role::openldap::labtest to gerrit-test3
- 23:21 paladox: shut down gerrit temp on gerrit-test3 for preperations for installing local ldap
2017-07-19
- 22:15 paladox: restart icinga2 to pick up ldap new cert.
- 22:14 paladox: restart gerrit on gerrit-test and gerrit-test3
- 22:13 paladox: restart apache on all instances
- 21:29 bd808: Synced puppet with upstream, forced puppet run, restarted nscd and nslcd
2017-07-18
- 12:29 paladox: upgrade gerrit-test3 to latest from stable-2.14 branch and cherry-pick this https://gerrit-review.googlesource.com/#/c/112550/
2017-07-06
- 12:47 paladox: upgrade puppet-phabricator to stretch from jessie using https://linuxconfig.org/how-to-upgrade-debian-8-jessie-to-debian-9-stretch
2017-07-05
- 18:37 Zppix: restarting gerrit-test3 weird gerrit.service issues with limited helpful logs
- 17:56 paladox: upgrading puppet-paladox3 to stretch from jessie using https://linuxconfig.org/how-to-upgrade-debian-8-jessie-to-debian-9-stretch
2017-06-30
- 14:19 paladox: upgrading gerrit on gerrit-test3 to gerrit 2.14.2 (pre)
2017-06-26
- 11:13 paladox: upgrade gerrit-test from jessie -> stretch following https://linuxconfig.org/how-to-upgrade-debian-8-jessie-to-debian-9-stretch
2017-06-23
- 21:58 paladox: restarting gerrit-mysql, will startup as stretch
- 21:28 paladox: upgrading gerrit-mysql to stretch (jessie -> stretch) sed -i 's/jessie/stretch/g' /etc/apt/sources.list apt-get update apt-get upgrade apt-get dist-upgrade
2017-06-16
- 17:56 Zppix: running apt-get dist-upgrade on gerrit-mysql to ensure running on latest packages and updates
2017-06-09
- 16:48 paladox: moving gerrit-test3 back to gerrit 2.14.1 for testing after finding a possible fix for T152640
2017-06-07
- 18:06 paladox: gerrit-test3 saving backup of gerrit 2.14 and downgrading to 2.13.8 to try and reproduce T152640
2017-05-30
- 18:27 paladox: running apt-get dist-upgrade on jenkins-slave-01
- 17:52 paladox: upgrading jenkins-slave-01 to stretch (jessie -> stretch upgrade using this guide https://linuxconfig.org/how-to-upgrade-debian-8-jessie-to-debian-9-stretch)
2017-05-16
- 16:24 paladox: upgrading gerrit on gerrit-test3 to 2.14.1 (stable-2.14 branch, not released yet)
2017-05-10
- 12:44 Zppix: updating puppet-paladox3 instance using 'apt-get distupgrade'
2017-04-26
- 17:08 paladox: upgrade complete and works.
- 16:59 paladox: forgot to mention im doing this on gerrit-test3
- 16:40 paladox: upgrading gerrit from 2.13.4 to 2.14.0 to test
2016-12-19
- 21:39 mutante: created instance puppet-paladox so he can use puppet::self for testing his suggested pupppet changes
2016-10-20
- 19:45 paladox: doing -XX:+UseConcMarkSweepGC works in gerrit-test3, just gerrit-test is playing up, calling this a success.
- 17:15 paladox: gerrit-test using just -XX:+UseG1GC failed but doing -Xmx50m -Xms50m -XX:+UseG1GC -XX:MaxGCPauseMillis=200 worked.
- 16:57 paladox: testing –XX:+UseG1GC on jvm on gerrit-test (gerrit) and if successful will hopefulyl roll out to production
2016-08-31
- 18:16 mutante: gerrit-test3 can be replicated following docs at P3637
- 18:15 mutante: gerrit-mysql instance has been setup following docs at P3939
2016-08-24
- 10:33 paladox_: upgrading gerrit on gerrit-test
2016-08-12
- 20:17 paladox: reenable puppet on gerrit-test3, test was success :).
- 19:54 paladox: disabling puppet temp on gerrit-test3 for change https://gerrit.wikimedia.org/r/#/c/302980/ (Owner ostriches)
2016-08-09
- 20:58 paladox: re enabling puppet on gerrit-test3
2016-08-08
- 20:59 paladox: disabled acme-setup in gerrit-test3
- 20:57 paladox: enabling puppet on gerrit-test3 again
2016-08-07
- 16:59 paladox: disabling puppet on gerrit-test3, testing a change that will allow https to run on labs.
2016-08-05
- 22:52 paladox: live testing gerrit-test3 changes things and disabling puppet for temp now
2016-08-03
- 20:51 paladox: recreating gerrit-test3 instance
2016-08-02
- 19:30 paladox: adding Alex Monk (Krenair) to project
2016-07-28
- 21:08 paladox: starting gerrit-test seeing if it will log to phabricator (phab-01)
- 20:59 paladox: taking gerrit-test down again to test its-phabricator bot
- 20:04 paladox: started gerrit-test again with another fix
- 20:00 paladox: taking gerrit-test down again so i can fix the regix of its-phabricator
- 19:59 paladox: gerrit-test started with bin/gerrit.sh run
- 19:56 paladox: starting gerrit-test
2016-07-12
- 18:48 mutante: deleted instance git-phab-03
- 18:48 mutante: deleted instance git-phab
- 13:17 paladox: deleting instance git-redirects-01.git.eqiad.wmflabs (I forgot to do that the other day)
2016-07-09
- 12:12 paladox: setting up zuul
2016-07-08
- 22:24 paladox: reinstalling jenkins
- 21:43 paladox: configuring gerrit settings on users account on gerrit
- 21:43 paladox: Reinstalled gerrit on gerrit-test instance
- 16:34 andrewbogott: deleting gerrit-test and adding a new instance, gerrit-test-2
- 14:57 paladox: upgrade zuul to 2.1.0-151-g30a433b-wmf1jessie1 on gerrit-test
- 14:13 paladox: generating zuul 2.1.0-151-g30a433b-wmf1jessie1 package for jessie using jenkins-slave-01 instance.
2016-07-05
- 14:01 paladox: loggin what i did yesturday with hashar, we setup zuul and gerrit properly.
2016-07-04
- 13:30 paladox: installing Gearman plugin in jenkins on gerrit-test instance
- 11:34 paladox: deleting git-phab4 instance not needed and will free space in labs.
2016-06-15
- 17:40 paladox: upgrading git-phab-3 instances phabricator, libphutil and arcanist to master branch.
2016-06-14
- 18:14 paladox: restarting apache2.