Nova Resource:Git/SAL

From Wikitech

2020-05-08

  • 14:58 andrewbogott: deleting project for T236569

2020-05-07

  • 14:46 mutante: deleted instances gerrit-test7 and puppet-paladox T236569
  • 07:59 mutante: - shutting down instance puppet-paladox, backups created and uploaded to deploy-1002 in devtools (T236569)
  • 07:55 mutante: - shutting down instance gerrit-test7, backups created and uploaded to deploy1002 in devtools, disassociating floating IP (T236569)

2020-05-06

  • 15:35 mutante: - instance gerrit-test7 was reachable and suddenly it wasn't, paladox suggested it is ferm but it's unclear what changed anything, rebooting it

2020-01-15

  • 20:56 mutante: deleting instance gerrit-mysql (used be icinga2 for ores, but ores has prod icinga checks at least) T236569
  • 19:38 mutante: shutting down and deleting instance 'jenkins-slave-02' (T236569)
  • 19:36 mutante: shutting down and deleting instance 'gerrit-test' (T236569)

2019-11-08

  • 12:58 paladox: rebuilding gerrit-test6 as gerrit-test7

2019-11-07

  • 18:40 paladox: rebuilding gerrit-test5 as gerrit-test6 (with buster) to re-test T200739

2019-10-11

  • 13:16 Zppix: apt update and apt full-upgrade ran on all *.git.wmflabs instances

2019-10-04

  • 15:00 Zppix: Reset password for user Halfak per IRC request

2019-09-28

  • 14:58 Zppix: sudo service ircecho restart due to bot pingout and not restarting self

2019-09-26

  • 20:21 Zppix: Upgrade all instances to linux-image-4.19.0-0.bpo.6-amd64

2019-09-25

  • 20:50 Zppix: create new web auth creds for accraze for Icinga2

2019-09-17

2019-09-16

2019-09-15

  • 17:13 Zppix: cd /etc/puppet/modules/icinga2; git pull on puppet-paladox. puppet agent -tv on gerrit-mysql to deploy gerrit:536775 T232921

2019-09-08

  • 23:06 Zppix: run apt full-upgrade on all instances

2019-05-08

  • 07:50 paladox: rebuilding jenkins-slave-01 as jenkins-slave-02 - T222668

2019-05-06

  • 22:54 Zppix: Started downtime for alerts for jenkins-slave01 on icinga2 until may 20 due to T222176

2019-05-02

2019-04-19

  • 13:57 paladox: disabling puppet on gerrit-test5 temporarily

2019-04-18

  • 16:26 paladox: rebuilding gerrit-test3 as gerrit-test5 due to removal of a kernel during a upgrade to stretch.
  • 15:27 paladox: upgrading gerrit-test3 to debian 9 (stretch)

2019-03-25

  • 17:45 Zppix: running apt full-upgrade on gerrit-mysql, gerrit-test, gerrit-test3, jenkins-slave-01, and puppet-paladox

2019-03-22

  • 17:51 paladox: deploy new session plugin to gerrit-test3 T218739

2019-03-21

  • 18:17 Zppix: Rebooting gerrit-test.git and gerrit-mysql.git to try to troubleshoot issue with Icinga2 not properly executing checks suddenly

2019-03-18

  • 14:54 Zppix: updated apt repo for packages.sury.org to update apt.gpg key for apt repo on Jenkins-slave-01.git.

2019-03-15

  • 17:51 Zppix: Prune old logs in /var/log on puppet-paladox

2019-03-07

  • 21:56 paladox: setting up multi-site up on gerrit-test3 T217174
  • 21:13 paladox: disabling puppet on gerrit-test3 (preparing for multi master)

2019-03-06

  • 19:05 Zppix: Ran sync; echo 3 > /proc/sys/vm/drop_caches on gerrit-test.git
  • 10:45 mutante: - gerrit-test3 - re-enabling disabled puppet

2019-03-05

  • 19:49 paladox: enabling kafka on gerrit-test3 in mwvagrant for the multi master gerrit setup.
  • 19:11 Zppix: Ran apt full-upgrade, apt autoclean, and apt autoremove on gerrit-mysql.git
  • 19:01 Zppix: Ran apt full-upgrade, apt autoclean, and apt autoremove on gerrit-test.git, gerrit-test3.git, puppet-paladox.git, and jenkins-slave-01.git

2019-02-05

  • 17:35 paladox: temporarily disabling puppet on gerrit-test3 whilst trying T211139

2018-12-18

  • 18:56 paladox: upgrading gerrit-new.wmflabs.org to not use ReviewDB any more.

2018-11-16

  • 22:35 paladox: upgrading gerrit-test.wmflabs.org to gerrit 2.16

2018-11-15

2018-11-13

2018-10-23

  • 21:50 paladox: upgrading gerrit.git.wmflabs.org (gerrit-test3) to 2.16rc0 (basically 2.16rc1)

2018-10-08

  • 21:50 paladox: upgrading gerrit to 2.16 (master) on gerrit-new.wmflabs.org per T206407
  • 21:39 paladox: upgrading gerrit to 2.15.5 on gerrit-test.wmflabs.org per T206407

2018-09-28

  • 18:00 paladox: systemctl start gerrit after upgrade on gerrit-test3
  • 17:56 paladox: upgrading gerrit to 2.16 (master branch) on gerrit-test3 to test T205346 T200739
  • 17:53 paladox: systemctl stop gerrit on gerrit-test3

2018-09-18

  • 16:19 arturo: make myself projectadmin

2018-09-17

  • 01:42 andrewbogott: migrating project to eqiad1-r

2018-05-31

  • 20:22 paladox: sudo service gerrit start after upgrade to 2.15
  • 20:19 paladox: java -jar gerrit.war init -d review_site on gerrit-test3
  • 20:18 paladox: sudo service gerrit stop on gerrit-test3
  • 19:43 paladox: cherry picking https://gerrit.wikimedia.org/r/#/c/436607/ onto phab-tin for scap deploy
  • 19:16 paladox: preparing gerrit-test3 for upgrade to 2.15 (testing T174034 and T177201)

2018-04-06

  • 21:52 paladox: re enable puppet on gerrit-test3
  • 21:27 paladox: disabling puppet on gerrit-test3 to test avatar stuff for gerrit

2018-03-17

2018-03-16

  • 18:08 paladox: upgrading gerrit on gerrit-new.wmflabs.org/r/ to latest master version (includes ui tweeks + lots and lots of bug fixes)

2018-03-12

2018-02-27

  • 13:43 paladox: upgrading puppet-paladox to stretch.

2018-02-09

  • 16:49 paladox: testing some gitiles changes on gerrit-test3 (so disabling puppet)

2018-02-06

  • 18:17 paladox: deploying from gerrit master which includes a new desgn for polygerrit's change list on gerrit-new.wmflabs.org

2018-02-05

  • 16:03 paladox: upgrade to gerrit 2.15 rc2 (stable-2.15 branch) on gerrit-test.wmflabs.org (also migrate to notedb from reviewdb (not completly migrate))
  • 16:02 paladox: set notedb to automigrate on gerrit-test.wmflabs.org (gerrit-test)

2018-02-03

  • 00:38 paladox: renabled puppet on gerrit-test3

2018-02-02

  • 23:31 paladox: disabling puppet on gerrit-test3 for T186370

2018-01-25

  • 14:34 Zppix: apt full-upgrade on jenkins-slave-01.git.eqiad.wmflabs

2018-01-18

2018-01-17

  • 19:11 Zppix: maint. Window over hosts back up
  • 19:08 Zppix: starting Maint. Window, shut down all hosts

2018-01-11

  • 21:15 paladox: upgraded gerrit on gerrit-new.wmflabs.org to include the new edit preference (merged upstream).

2018-01-04

  • 22:43 paladox: upgrading all instances to linux-image-4.9.0-5-amd64 (security)

2017-12-22

  • 17:01 paladox: migrating gerrit-new.wmflabs.org (gerrit) to notedb.
  • 16:49 paladox: install new code-mirror plugin in gerrit-new.wmflabs.org for polygerrit ui.
  • 16:47 paladox: upgrading gerrit-test (gerrit-new.wmflabs.org) to latest head in gerrit.

2017-12-21

  • 16:16 Zppix: restarted gerrit-mysql to restart icinga2-wm because I cant ssh into any vps hosts because i have no access to an desktop

2017-12-17

  • 20:00 Zppix: Maintaince window for GIT over, E795 all hosts are back to normal functioning state!
  • 19:00 Zppix: commencing maintaince window for all GIT hosts, E795
  • 04:02 Zppix: Sent notices out to Wikimedia Scoring Platform to inform them about monthly maintaince window (https://phabricator.wikimedia.org/E795 ). Which effect all git hosts and services, such as Icinga2-wm.

2017-12-16

  • 22:11 paladox: gerrit-test3 ldap down recreating mediawiki-vagrant with stretch after accidentially destroying the jessie one.

2017-12-14

  • 17:42 Zppix: deployed Gerrit:398294 to denote ORES Experimental Hosts for #wikimedia-ai alerts. T182880

2017-12-11

  • 22:16 paladox: recreating puppet-paladox3 as puppet-paladox
  • 21:47 paladox: doing mass upgrades of puppet to puppet4.
  • 21:46 paladox: upgrading puppet client on gerrit-test3 to puppet 4.
  • 21:37 paladox: upgrading puppet client on gerrit-test to puppet 4.
  • 21:16 paladox: upgrading puppetmaster on puppet-paladox3 to puppet 4

2017-12-07

  • 22:39 Zppix: Hosts are all online and functional (Completed at 4:39 PM UTC-6)
  • 22:33 Zppix: Executing planned host(s) restarts via Horizon (Starting at 4:33 PM UTC-6)
  • 01:42 paladox: systemctl start gerrit on gerrit-test3

2017-12-06

2017-11-19

  • 13:30 paladox: upgrading icinga2 to 2.8.0

2017-11-09

  • 21:57 Zppix: added a new host, puppetdb-phabricator.phabricator.eqiad.wmflabs, as it is apart of a currently moderated project, and per maintainer request. Done 3:55 CST UTC-6

2017-10-25

  • 12:49 paladox: upgrading gerrit-test3 to latest 2.14.6 pre release

2017-10-19

2017-10-17

  • 12:38 paladox: starting gerrit-new.wmflabs.org up with ldap auth
  • 12:24 paladox: switching gerrit-test gerrit-new.wmflabs.org to ldpa using gerrit-test3 gerrit-test3.git.eqiad.wmflabs:1389 (mediawiki vagrant).

2017-10-16

2017-10-12

2017-10-01

  • 21:59 madhuvishy: Cold migrating gerrit-test3 from labvirt1015 to labvirt1017

2017-09-29

  • 20:22 paladox: gerrit-test3 going down for maint.
  • 20:16 Zppix: All hosts back up, and operational. No reported errors.
  • 20:13 Zppix: Performing a rolling restart of all hosts.

2017-09-20

  • 21:25 paladox: switching slave = true on gerrit-test3
  • 20:57 paladox: disabling puppet on gerrit-test3 temp, trying to reproduce the slave issue in prod for gerrit

2017-09-11

  • 15:47 paladox: recreating gerrit-test3.
  • 15:44 paladox: revoking puppet for gerrit-test3.

2017-09-07

  • 21:20 Zppix: created accounts for the Wikimedia Scoring Platform team due to recreation of auth database

2017-09-04

  • 20:26 paladox: upgrading gerrit from 2.14.3-pre to 2.14-4-pre (2.14.3 was released, but i built from the 2.14 branch).

2017-08-11

  • 14:26 paladox: upgrading gerrit-test3 to gerrit 2.14.3 pre

2017-08-02

  • 18:07 paladox: enable puppet again on gerrit-mysql - deploying https://gerrit.wikimedia.org/r/#/c/369681/
  • 15:20 paladox: disabling puppet on gerrit-mysql temp for icinga2 update (changed configuation needs change in the repo)

2017-08-01

  • 17:53 paladox: upgrading gerrit on gerrit-new.wmflabs.org to 2.14.2-2449-gc8fa38496c (bazel build release) (master branch). Testing wikimedia branding for prod and the move change feature

2017-07-27

2017-07-24

  • 10:32 paladox: upgrading gerrit to 2.14.2 final on gerrit-test3

2017-07-21

  • 00:49 paladox: switch ldap on gerrit to gerrit-test3.git.eqiad.wmflabs
  • 00:48 paladox: installed mediawiki vagrant for ldap

2017-07-20

  • 23:31 paladox: applying role::openldap::labtest to gerrit-test3
  • 23:21 paladox: shut down gerrit temp on gerrit-test3 for preperations for installing local ldap

2017-07-19

  • 22:15 paladox: restart icinga2 to pick up ldap new cert.
  • 22:14 paladox: restart gerrit on gerrit-test and gerrit-test3
  • 22:13 paladox: restart apache on all instances
  • 21:29 bd808: Synced puppet with upstream, forced puppet run, restarted nscd and nslcd

2017-07-18

2017-07-06

2017-07-05

2017-06-30

  • 14:19 paladox: upgrading gerrit on gerrit-test3 to gerrit 2.14.2 (pre)

2017-06-26

2017-06-23

  • 21:58 paladox: restarting gerrit-mysql, will startup as stretch
  • 21:28 paladox: upgrading gerrit-mysql to stretch (jessie -> stretch) sed -i 's/jessie/stretch/g' /etc/apt/sources.list apt-get update apt-get upgrade apt-get dist-upgrade

2017-06-16

  • 17:56 Zppix: running apt-get dist-upgrade on gerrit-mysql to ensure running on latest packages and updates

2017-06-09

  • 16:48 paladox: moving gerrit-test3 back to gerrit 2.14.1 for testing after finding a possible fix for T152640

2017-06-07

  • 18:06 paladox: gerrit-test3 saving backup of gerrit 2.14 and downgrading to 2.13.8 to try and reproduce T152640

2017-05-30

2017-05-16

  • 16:24 paladox: upgrading gerrit on gerrit-test3 to 2.14.1 (stable-2.14 branch, not released yet)

2017-05-10

  • 12:44 Zppix: updating puppet-paladox3 instance using 'apt-get distupgrade'

2017-04-26

  • 17:08 paladox: upgrade complete and works.
  • 16:59 paladox: forgot to mention im doing this on gerrit-test3
  • 16:40 paladox: upgrading gerrit from 2.13.4 to 2.14.0 to test

2016-12-19

  • 21:39 mutante: created instance puppet-paladox so he can use puppet::self for testing his suggested pupppet changes

2016-10-20

  • 19:45 paladox: doing -XX:+UseConcMarkSweepGC works in gerrit-test3, just gerrit-test is playing up, calling this a success.
  • 17:15 paladox: gerrit-test using just -XX:+UseG1GC failed but doing -Xmx50m -Xms50m -XX:+UseG1GC -XX:MaxGCPauseMillis=200 worked.
  • 16:57 paladox: testing –XX:+UseG1GC on jvm on gerrit-test (gerrit) and if successful will hopefulyl roll out to production

2016-08-31

  • 18:16 mutante: gerrit-test3 can be replicated following docs at P3637
  • 18:15 mutante: gerrit-mysql instance has been setup following docs at P3939

2016-08-24

  • 10:33 paladox_: upgrading gerrit on gerrit-test

2016-08-12

2016-08-09

  • 20:58 paladox: re enabling puppet on gerrit-test3

2016-08-08

  • 20:59 paladox: disabled acme-setup in gerrit-test3
  • 20:57 paladox: enabling puppet on gerrit-test3 again

2016-08-07

  • 16:59 paladox: disabling puppet on gerrit-test3, testing a change that will allow https to run on labs.

2016-08-05

  • 22:52 paladox: live testing gerrit-test3 changes things and disabling puppet for temp now

2016-08-03

  • 20:51 paladox: recreating gerrit-test3 instance

2016-08-02

  • 19:30 paladox: adding Alex Monk (Krenair) to project

2016-07-28

  • 21:08 paladox: starting gerrit-test seeing if it will log to phabricator (phab-01)
  • 20:59 paladox: taking gerrit-test down again to test its-phabricator bot
  • 20:04 paladox: started gerrit-test again with another fix
  • 20:00 paladox: taking gerrit-test down again so i can fix the regix of its-phabricator
  • 19:59 paladox: gerrit-test started with bin/gerrit.sh run
  • 19:56 paladox: starting gerrit-test

2016-07-12

  • 18:48 mutante: deleted instance git-phab-03
  • 18:48 mutante: deleted instance git-phab
  • 13:17 paladox: deleting instance git-redirects-01.git.eqiad.wmflabs (I forgot to do that the other day)

2016-07-09

  • 12:12 paladox: setting up zuul

2016-07-08

  • 22:24 paladox: reinstalling jenkins
  • 21:43 paladox: configuring gerrit settings on users account on gerrit
  • 21:43 paladox: Reinstalled gerrit on gerrit-test instance
  • 16:34 andrewbogott: deleting gerrit-test and adding a new instance, gerrit-test-2
  • 14:57 paladox: upgrade zuul to 2.1.0-151-g30a433b-wmf1jessie1 on gerrit-test
  • 14:13 paladox: generating zuul 2.1.0-151-g30a433b-wmf1jessie1 package for jessie using jenkins-slave-01 instance.

2016-07-05

  • 14:01 paladox: loggin what i did yesturday with hashar, we setup zuul and gerrit properly.

2016-07-04

  • 13:30 paladox: installing Gearman plugin in jenkins on gerrit-test instance
  • 11:34 paladox: deleting git-phab4 instance not needed and will free space in labs.

2016-06-15

  • 17:40 paladox: upgrading git-phab-3 instances phabricator, libphutil and arcanist to master branch.

2016-06-14

  • 18:14 paladox: restarting apache2.
Retrieved from "https://wikitech.wikimedia.org/w/index.php?title=Nova_Resource:Git/SAL&oldid=1865588"