Release Engineering/SAL/Archive 9

From Wikitech

2023-12-23

  • 09:55 hashar: gerrit: deleted repository `test/🤖` | T353977

2023-12-22

2023-12-21

2023-12-20

2023-12-17

2023-12-15

  • 20:43 dancy: Rebooting gitlab-runner-1002.devtools. It was overloaded by a quibble job.

2023-12-14

2023-12-13

2023-12-11

  • 21:17 James_F: Zuul: [design/codex] Switch to Node 18 for T352768

2023-12-07

  • 11:25 jelto: run gitlab-settings and update GitLab favicon - T349167
  • 02:08 James_F: Switching deployment-mwlog01 off in Beta Cluster for T345566
  • 00:24 James_F: Created deployment-mwlog02 on Bullseye in Beta Cluster for T345566

2023-12-05

2023-11-30

  • 17:09 tgr: added Dreamy_Jazz to members
  • 09:28 jelto: update GitLab login logo on GitLab with a Wikimedia flavored one - T349167
  • 07:41 jelto: update GitLab logo on GitLab production with a Wikimedia flavored one - T349167
  • 07:39 jelto: update GitLab logo on GitLab Replicas with a Wikimedia flavored one - T349167

2023-11-29

2023-11-27

  • 18:44 James_F: Zuul: Add experimental PHP 8.3 jobs everywhere for T339349
  • 18:29 James_F: Docker: Publishing initial PHP 8.3 images for T339350.
  • 18:21 dancy: Restarted gitlab-phabricator tool on toolforge.
  • 08:56 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/976697 "Remove BetaFeature dependency for the Popups extension" - T351708

2023-11-22

2023-11-21

  • 19:28 James_F: Zuul: [mediawiki/extensions/DoubleWiki] Move to non-Wikimedia section for T351675
  • 13:12 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/976208 | Archive mediawiki/tools/mwdumper | T351228
  • 10:38 jnuche: integration-castor05: removed npm cache with sudo rm -rf /srv/castor/castor-mw-ext-and-skins/master/mwgate-node16-docker

2023-11-20

  • 02:36 James_F: Zuul: Archive operations/debs/pybal for T347623

2023-11-19

2023-11-17

2023-11-16

  • 23:44 TheresNoTime: Add `DJackson` access, T351433

2023-11-15

2023-11-13

  • 17:25 James_F: jjb: Manually deleted acme-chief-tox-docker for T347623
  • 17:24 James_F: Zuul: Archive acme-chief and certcentral projects for T347623

2023-11-09

2023-11-08

  • 15:27 James_F: Zuul: [mediawiki/extensions/DonationInterface] Promote phan to voting for T224763

2023-11-07

  • 22:58 James_F: Zuul: [mediawiki/extensions/JWTAuth] Disable browser tests
  • 22:24 James_F: Zuul: [mediawiki/extensions/JWTAuth] Enable CI
  • 02:48 James_F: Zuul: [mediawiki/extensions/DonationInterface] Add phan deps for T224763
  • 02:41 James_F: Zuul: [mediawiki/extensions/DonationInterface] Add phan as experimental for T224763

2023-11-06

  • 15:42 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/971593 Move active extensions out of archived section
  • 15:41 James_F: Zuul: [mediawiki/extensions/TemplateStyles] Add CodeEditor for phan
  • 15:24 James_F: Zuul: [mediawiki/extensions/UploadWizard] Add CodeEditor for phan

2023-11-01

  • 17:45 dancy: Upgraded gitlab-cloud-runners to v16.3.1
  • 15:04 dancy: Upgrading kubernetes from v1.25.14 to v1.26.9 in gitlab-cloud-runners.

2023-10-30

  • 20:29 James_F: Ran `sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwgate-node16-docker/` on integration-castor05 too for T349986
  • 20:27 James_F: Ran jforrester@integration-castor05:~$ sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwext-node16-rundoc-docker to clean out corrupted cache
  • 11:18 hashar: integration-castor05: clearing corrupted npm cache: `sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwgate-node16-docker` # T349986

2023-10-27

  • 21:26 tgr: set up deployment-rdb01 for redis (T340908)
  • 16:03 James_F: Zuul: Archive the RevisionCommentSupplement extension for T343616
  • 16:03 James_F: Zuul: Archive the WikiLexicalData extension for T271379
  • 15:59 James_F: Zuul: Add VisualEditor as dependency to AtMentions
  • 15:57 James_F: Zuul: [mediawiki/extensions/CloudflarePurge] Add basic CI
  • 15:55 James_F: Zuul: Add Valerio Bozzolan to email_allowlist
  • 14:58 dancy: Rebooted deployment-snapshot03.deployment-prep.eqiad1.wikimedia.cloud to fix beta-scap-sync-world

2023-10-26

  • 14:57 dancy: Created imageupdatebot Gerrit account
  • 07:38 hashar: integrastion-castor05: `sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwext-node16-rundoc-docker` # T348243

2023-10-25

  • 15:56 hashar: doc: removed Graphviz MediaWiki extension code coverage following its archival: `sudo -u doc-uploader rm -fR /srv/doc/cover-extensions/GraphViz/` # T335254
  • 14:25 hashar: Reloaded Zuul to enable Sonar Codehealth on SecurePoll, Thanks, UniversalLanguageSelector, WikimediaApiPortal # T321837
  • 11:34 hashar: gerrit: deleted mediawiki/services/cp-jobqueue mediawiki/tools/bundle mediawiki/tools/secpm
  • 09:30 hashar: mediawiki-core-doxygen-docker had intermittent failure due to `integration-agent-docker-1057` refusing ssh connection since Oct 24th 13:00 # T349681
  • 08:44 hashar: integration: disconnected agent https://integration.wikimedia.org/ci/computer/integration%2Dagent%2Ddocker%2D1057/ due to T349681

2023-10-24

  • 18:44 James_F: tools.deployment-prep Re-configure deployment-docker-wikifunctions01 to drop statsd metrics writing, no longer supported, per T349648
  • 13:17 hashar: Gerrit: change `integration/jenkins-job-builder-config` and `integration/zuul-config` from hidden to read-only with a description prefixed `[ARCHIVED] ` - T349543
  • 13:11 hashar: Gerrit: deleted empty repositories `cloud/toolforge/toolforge-build-api` `cloud/toolforge/toolforge-build-cli` and associated GitHub mirrors # T349543
  • 13:00 James_F: Zuul: Archive the SemanticImageAnnotator extension for T332473

2023-10-23

  • 09:49 godog: turn off deployment-prometheus05 - T344974

2023-10-20

  • 02:12 Krinkle: Add "Logs generated by test" console section to Jenkins

2023-10-18

2023-10-17

  • 10:10 hashar: Removing `puppet-compiler-node` label from the PCC workers, superseded by `puppet5-compiler-node` label | T236373

2023-10-16

2023-10-14

2023-10-13

2023-10-12

2023-10-11

  • 13:29 James_F: Zuul: [mediawiki/extensions/Checklists] Add basic composer CI

2023-10-09

2023-10-06

2023-10-05

  • 16:37 bvibber: brion batch-running TimedMediaHandler requeueTranscodes.php to clean up old VP8 WebM files

2023-10-04

2023-10-03

  • 12:07 hashar: Upgrading Quibble jobs to Quibble 1.5.6
  • 08:14 hashar: Reloaded Zuul at 2d225e5 for a series of patches enabling Hallowelt extensions
  • 07:51 hashar: Reloaded Zuul to enable SonarQube on Nostalgia, ProofreadPage, TwoColConflict and UrlShortener # T321837
  • 07:28 hashar: Reloaded Zuul to enable SonarQube on Nostalgia, ProofreadPage, TwoColConflict and UrlShortener # T321837

2023-10-02

2023-09-29

  • 16:35 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/962063
  • 13:46 wm-bot2: dcaro@urcuchillay END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0)
  • 13:38 wm-bot2: dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console
  • 13:33 wm-bot2: dcaro@urcuchillay END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0)
  • 13:30 wm-bot2: dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console
  • 12:33 wm-bot2: dcaro@urcuchillay END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0)
  • 12:31 wm-bot2: dcaro@urcuchillay START - Cookbook wmcs.openstack.cloudvirt.vm_console
  • 11:58 hashar: Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/961778 "add edit-analytics and page-analytics" T336391 T336385 T336415
  • 11:55 hashar: Reloading Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/961778 "add edit-analytics and page-analytics"

2023-09-28

  • 15:27 hashar: Reenabling castor-save-workspace-cache job # T345924
  • 15:26 hashar: Rettaching integration-castor05 to Jenkins after its ssh host fingerprint got changed when I recreated the instance # T345924
  • 14:48 James_F: Zuul: Add Terasail to the allow list
  • 14:25 hashar: integration: resizing `integration-castor05` from `g3.cores8.ram36.disk20` to `g3.cores8.ram36.disk20.4xiops` ( +4xiops) # T345924

2023-09-26

  • 17:20 James_F: Zuul: Drop browser test jobs on REL1_35 branches
  • 07:39 hashar: integration: `sudo cumin --force 'name:docker' 'rm -f /mnt/home/jenkins-deploy/.ssh/config'` # T328543#9198204

2023-09-25

  • 23:25 brennen: gitlab: disabling separate 2fa policies for groups under /repos (T347295)

2023-09-22

2023-09-21

  • 16:02 hashar: Tag Quibble 1.5.6 @ d16af16 # T342088
  • 12:57 James_F: Zuul: [mediawiki/extensions/GoogleTagManager] Add basic CI
  • 09:25 hashar: gerrit: mark apps/firefox and apps/firefox/wikipedia read-only and archived # T132973

2023-09-20

2023-09-15

2023-09-13

2023-09-12

2023-09-11

2023-09-08

2023-09-07

  • 19:20 hashar: Reloaded Zuul to enable codehealth on MinervaNeue, MonoBook, OATHAuth and ReplaceText # T321837
  • 14:27 James_F: Zuul: [wikimedia/fundraising/SmashPig] Drop PHP73 testing

2023-09-06

  • 19:12 dancy: jjb: jjb-deleted kask-* trigger-kask-* jobs (T335691)
  • 12:16 jnuche: Restarting Jenkins CI to apply plugin security update

2023-09-05

  • 18:15 James_F: Zuul: Add Mormegil to CI allow list

2023-09-04

2023-09-01

  • 15:08 jbond: Updated CI Job operations-puppet-tests-buster-docker to use 0.8.12 (tox 3.*) # T345152
  • 15:07 hashar: Successfully published image docker-registry.wikimedia.org/releng/zuul-cloner:0.3.0 # T278203

2023-08-31

2023-08-30

  • 22:06 James_F: Docker: Rebuilding mediawiki-phan-taint-check-demo for v0.2.0, now on bullseye
  • 13:51 James_F: dev_images: Build/deploying new cirrus-elasticsearch images
  • 08:48 hashar: Reloaded Zuul to enable SonarQube codehealth check for ConfirmEdit, DonationInterface, RevisionSlider and TimedMediaHandler mediawiki extensions # T321837

2023-08-29

  • 20:25 James_F: Zuul: Mark wikimedia/bots/jouncebot as archived for T345182
  • 18:22 dduvall: destroying and recreating the gitlab-cloud-runner _staging_ cluster due to changes to the nodepool sizes and instance types (which terraform cannot handle). production cluster should remain unaffected

2023-08-25

2023-08-24

2023-08-23

2023-08-21

2023-08-16

  • 05:30 James_F: Zuul: Add UserMerge phan dep for Echo and AbuseFilter, and test dep for AbuseFilter too
  • 05:29 James_F: Zuul: Add CodeEditor phan dep for Scribunto and Gadgets
  • 05:29 James_F: Zuul: Add MobileFrontend phan dep for PageImages
  • 05:20 James_F: Zuul: Add BetaFeatures phan dep for VE and DT

2023-08-15

  • 12:19 thcipriani: (correction) gerrit.wikimedia.org -p 29418 gerrit close-connection <oldest-jenkinsbot-connection>
  • 12:19 thcipriani: gerrit.wikimedia.org -p 29418 gerrit <oldest-jenkinsbot-connection>

2023-08-12

  • 08:46 taavi: reloading zuul for 948197

2023-08-11

2023-08-08

2023-08-07

  • 16:11 dancy: Updating docker-pkg files on contint primary for T338952

2023-07-31

  • 11:16 James_F: jjb: Manually deleted ~30 jjb definitions for analytics/datahub, plus the now-empty datahub view in Jenkins, for T341194
  • 11:09 James_F: Zuul: [analytics/datahub] Mark as archived, moved to GitLab in T341194
  • 10:53 jnuche: reenabled beta-code-update-eqiad job after freeing up some disk space. See: https://phabricator.wikimedia.org/T343114
  • 08:23 jnuche: temporarily disabled failing beta-code-update-eqiad job

2023-07-28

  • 20:35 Daimona: Dropping campaign_events.ce_answers_status in beta wikishared # T342939
  • 18:05 andrewbogott: removing ::lvs::realserver::realserver_ips: from hiera for deployment-restbase-bullseye.deployment-prep.eqiad1.wikimedia.cloud because it's preventing puppet from compiling
  • 17:57 andrewbogott: deleting deployment-thcipriani.deployment-prep.eqiad1.wikimedia.cloud, no longer used according to Tyler
  • 17:38 andrewbogott: deleting deployment-mdb02.deployment-prep.eqiad1.wikimedia.cloud, seems abandoned by a departed staff member
  • 17:18 andrewbogott: but not fixing deployment-mdb02.deployment-prep.eqiad1.wikimedia.cloud because it seems like mariadb was never set up there in the first place
  • 17:16 andrewbogott: fixed miscellaneous puppet issues on four or five hosts
  • 00:35 Daimona: Adding default to campaign_events.ce_answers_status because the column will be dropped soon # T342939

2023-07-27

2023-07-26

2023-07-25

  • 07:52 jnuche: Deployed rev2 of sec patch for T340221

2023-07-24

  • 22:44 Daimona: Changing index on the ce_question_aggregation DB table in beta wikishared # T342479

2023-07-20

2023-07-19

  • 14:45 hashar: Updating all Jenkins phan jobs to use `docker run --memory 7G` # T342100

2023-07-18

  • 08:17 urbanecm: deployment-prep: Create `centralauth.global_user_autocreate_serial` based on `extensions/CentralAuth/schema/mysql/db_patches/patch-global_user_autocreate_serial.sql` (T342034)
  • 05:26 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/938914

2023-07-17

  • 21:34 maryum: Deployed patch for T340221
  • 09:55 hashar: Reloaded Zuul to enable codehealth on MediaWiki extension ImageMap | T321837
  • 09:41 hashar: Reloaded Zuul to enable codehealth on MediaWiki extensions CodeEditor, Scribunto and SecureLinkFixer | T321837
  • 05:58 hashar: Reloaded Zuul to enable CI on HTMLTemplates, ImageMapEdit and WarnNotRecentlyUpdated MediaWiki extensions

2023-07-14

  • 19:13 James_F: jjb: First testing on quibble-vendor-mysql-php74-noselenium-docker
  • 18:56 James_F: Docker: Building and publishing quibble images # T90875 T227900 T341840
  • 18:45 James_F: Tag Quibble 1.5.5 @ 85009d62de # T90875 T227900 T341840
  • 13:10 Daimona: Dropping default from campaign_events.event_answers_status column in beta wikishared # T341642
  • 11:23 Reedy: Updating development images on contint primary for various commits...

2023-07-13

  • 10:06 hashar: Restarting CI Jenkins for plugin update
  • 10:04 hashar: integration: updating Matrix Combination CI Jenkins plugin from 1.31 to 1.32 to fix: grey ball images are broken since Jenkins-2.333 (JENKINS-69777) # T236373
  • 09:32 hashar: integration: on CI Jenkins, removed the Node and Label parameter plugin, it doesn't have the features I was looking for. T236373
  • 08:00 hashar: integration: on CI Jenkins installing Node and Label parameter and updating the Token macro plugin T236373
  • 08:00 hashar: integration: on CI Jenkins installing Node and Label parameter and updating the Token macro plugin

2023-07-12

  • 20:33 taavi: zuul: revert 904488 just in case
  • 20:23 taavi: reloading zuul for 904488
  • 11:47 Daimona: Adding new column for the CampaignEvents extension in beta wikishared # T341642

2023-07-11

2023-07-10

2023-07-08

  • 17:31 taavi: reloading zuul for 936360

2023-07-07

2023-07-06

  • 13:09 hashar: integration: removed Jenkins builds legacy symlinks `sudo -u jenkins rm /srv/jenkins/builds/*/last*` . They got replaced by a `permalinks` text file and are no more used since Jenkins 2.190.1 ( 83a465e )

2023-07-05

  • 15:45 James_F: Manually added Docker label to new integration agents
  • 15:40 James_F: Manually added Docker label to integration-agent-docker-1054 to test; instantly got jobs assigned.
  • 14:00 Lucas_WMDE: added $wgCampaignEventsProgramsAndEventsDashboardAPISecret to beta PrivateSettings (T320258)
  • 13:34 hashar: Building dev-images for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/40
  • 12:11 hashar: Building dev-images for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/36 | "Install Xdebug from Debian package, update source of php72 and php74" | T338208
  • 11:59 hashar: Successfully published image docker-registry.discovery.wmnet/dev/fundraising-civiproxy-buster-php73-apache2:0.0.1-1-s4
  • 11:55 hashar: Building dev-images
  • 10:59 fabfur: shutting down and removing unused deployment-cache-text07 and deployment-cache-upload07

2023-07-04

2023-07-03

2023-07-01

  • 00:26 thcipriani: integration: sudo cumin --force 'name:docker' 'docker buildx prune --force'

2023-06-30

  • 20:27 James_F: Zuul: [mediawiki/extensions/Flow] Drop from extension gate
  • 18:49 James_F: Docker: [node14] Update node from 14.17.5 to 14.21.3 for T332387
  • 18:33 James_F: Docker: [helm-linter] Switch to envoy 1.23.10 for T300324

2023-06-29

  • 18:04 hashar: Deleted integration-agent-docker-1039 after an attempt to migrate it to a new flavor with larger ephemeral disk. Our OpenStack is unable to resize ephemeral disks :-\
  • 15:22 Daimona: Not adding new columns because the table definition is wrong
  • 15:20 Daimona: Adding new columns for the CampaignEvents extension in beta wikishared # T340694
  • 15:09 hashar: integration: sudo cumin --force 'name:docker' 'docker buildx prune --force'

2023-06-28

2023-06-27

  • 20:38 hashar: integration-agent-docker-1035: `docker buildx prune` T338317
  • 13:47 Daimona: Creating new DB tables on beta wikishared for the CampaignEvents extension # T339997
  • 12:23 TheresNoTime: deployment-prep: ran `sudo apt install /home/samtar/php7.4-wikidiff2_1.14.0-0+wmf1+buster1_amd64.deb` on `deployment-mediawiki[11-12]` for T340542, watching logs
  • 11:36 fabfur: removing old (text|upload) instance references from hieradata (horizon)
  • 08:33 hashar: Deleted beta-mediawiki-config-update-eqiad Jenkins job. No more used since August 2022 / T314378
  • 05:21 hashar: Reloaded Zuul to enable Sonar Codehealth on ArticlePlaceholder, CentralAuth, GeoData, GlobalUserPage # T321837

2023-06-26

  • 13:11 hashar: Updated wmf-quibble* jobs to run `npm cache verify` in order to garbage collect the npm cache before saving it. https://gerrit.wikimedia.org/r/c/integration/config/+/932195 | T340092
  • 12:41 fabfur: switch floating IP from deployment-cache-text07 to deployment-cache-text08 (bullseye upgrade: T327742) (fix sec group)
  • 12:25 fabfur: reverted floating IP switch
  • 12:14 fabfur: switch floating IP from deployment-cache-text07 to deployment-cache-text08 (bullseye upgrade: T327742)

2023-06-23

  • 15:49 brennen: first gitlab-settings configure-projects run for a while, may have unexpected consequences.

2023-06-22

  • 11:02 fabfur: switch floating IP from deployment-cache-upload07 to deployment-cache-upload08 (bullseye upgrade: T327742)

2023-06-21

  • 15:36 hashar: Reenabling deployment-prep Jenkins jobs # T340030
  • 15:07 James_F: Zuul: Revert "Enable the parsoid extension when testing Flow"
  • 14:43 TheresNoTime: deployment-prep: `[samtar@deployment-deploy03]$ sudo disable-puppet "T340030"` T340030, seeing if it *is* puppet to blame here
  • 13:56 TheresNoTime: deployment-prep: Pulled `skins/`, then `sudo -u jenkins-deploy scap prep auto --verbose` T340030
  • 13:44 TheresNoTime: deployment-prep: `[samtar@deployment-deploy03 php-master (master *% u=)]$ sudo -u jenkins-deploy scap prep auto --no-log-message --verbose` T340030
  • 13:28 TheresNoTime: deployment-prep: `[samtar@deployment-deploy03 php-master (master *% u=)]$ sudo rm -rfv /srv/mediawiki-staging/php-master/*` T340030
  • 13:08 TheresNoTime: deployment-prep: `[samtar@deployment-deploy03 mediawiki-staging (master u=)]$ sudo puppet agent -tv` T340030, nb. taking a while to do corrective actions..
  • 12:47 TheresNoTime: deployment-prep: `[samtar@deployment-deploy03 ~]$ sudo -u jenkins-deploy scap prep auto --no-log-message --verbose` T340030

2023-06-20

2023-06-18

  • 06:33 hashar: integration: clean out a job castor cache for T339812: `sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwext-node16-rundoc-docker`

2023-06-16

  • 13:50 vgutierrez: replaced buster acme-chief[03,04] with bullseye acme-chief[05,06]
  • 07:18 hashar: Restarted Zuul for a system lib update

2023-06-15

  • 17:42 taavi: removed phab admin rights from mutante (@dzahn) per request in T339174
  • 15:06 hashar: integration-agent-pkgbuilder-1001 and integration-agent-pkgbuilder-1002: clearing pbuilder apt cache: `rm /srv/pbuilder/aptcache/*/*.deb` # T339171

2023-06-14

  • 21:39 Krinkle: Unroll local patch c7d03fe1d2f5 from 2016 adding `modules/secret/secrets/phabricator/phab_deploy_private_key` in deploy-puppetmaster04:/var/lib/git/labs/private.git. This references https://gerrit.wikimedia.org/r/c/operations/puppet/+/432528 which is "no longer needed as of 2019".
  • 21:38 Krinkle: Unroll local patch 772ed98 from 2018 adding `modules/secret/secrets/phabricator/swift_key` in deploy-puppetmaster04:/var/lib/git/labs/private.git. This references https://gerrit.wikimedia.org/r/c/operations/puppet/+/432528 which is "no longer needed as of 2019".
  • 21:20 Krinkle: Unroll local patch from 2018 for `profile::cache::kafka::certificate::ssl_key_password` in deploy-puppetmaster04:/var/lib/git/labs/private.git. This was already obsoleted by a (different) value in Horizon.
  • 21:17 Krinkle: Unroll local patch from 2018 for `profile::maps::osm_master::kartotherian_pass` in deploy-puppetmaster04:/var/lib/git/labs/private.git, move to Horizon
  • 21:09 Krinkle: Unroll local patch from 2017 to disable `puppetdb::password::replication` in deploy-puppetmaster04:/var/lib/git/labs/private.git, move to Horizon
  • 21:06 Krinkle: Unroll 5 local patches for global_account_keys in deploy-puppetmaster04:/var/lib/git/labs/private.git, move to Horizon and rename to match prod. Fixes T336191.
  • 21:05 Krinkle: Unroll local patch for osm_password in deploy-puppetmaster04:/var/lib/git/labs/private.git, move to Horizon.
  • 21:04 Krinkle: Unroll local patch for puppetdb::password::rw in deploy-puppetmaster04:/var/lib/git/labs/private.git, move to Horizon.
  • 16:26 hashar: integration-agent-docker-1025: rm -fR /srv/jenkins/workspace/*
  • 16:26 hashar: integration-agent-docker-1037: rm -fR /srv/jenkins/workspace/*
  • 07:46 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/924900 # T309376
  • 07:39 hashar: Reloaded Zuul with no change to potentially account for the new `[connection gerrit-reporter]` added by https://gerrit.wikimedia.org/r/c/operations/puppet/+/924884 # T309376

2023-06-13

  • 08:52 hashar: Reloaded Zuul to enable Sonar Codehealth on Math, MultimediaViewer, UploadsLink and UploadWizard # T321837
  • 07:03 hashar: contint: on both zuul merger: `sudo -u zuul rm -fR /srv/zuul/git/operations/homer
  • 07:01 hashar: contint: on both zuul merger: `sudo -u zuul rm -fR /srv/zuul/git/operations/homer/*`

2023-06-09

  • 15:21 TheresNoTime: deployment-prep: `[samtar@deployment-deploy03 ~]$ sudo -u jenkins-deploy scap prep auto --no-log-message`
  • 15:11 TheresNoTime: deployment-prep: `[samtar@deployment-deploy03 ~]$ scap sync-world --no-log-message`
  • 06:31 hashar: deployment-prep: disabled all three beta cluster jobs since some TLS certificates are broken causing jobs to fail https://gerrit.wikimedia.org/r/928703

2023-06-08

2023-06-07

  • 16:41 hashar: jjb: reverting '*maven-release*' and '*java8*' Jenkins jobs to previous java8 docker images # T338343
  • 12:43 hashar: integration-agent-docker-1036: `docker buildx prune` to reclaim 21G of disk space # T338317

2023-06-06

2023-06-05

  • 23:09 mutante: contint* - PHP upgraded to version 7.4
  • 23:02 James_F: Zuul: [integration/docroot] Drop PHP 7.3 CI, box now runs 7.4
  • 22:22 James_F: Dockerfiles: [maven-java8] Update gerrit.wikimedia.org IP for T326368
  • 12:41 hashar: Reloaded Zuul to enable SonarQube codehealth on WikimediaMessages, WikimediaIncubator, WikimediaEvents and WikimediaMaintenance # T321837
  • 09:15 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/927122 # T337749

2023-06-02

  • 21:44 mutante: based on T336427#8890714 pending a response, everything already copied to gerrit1003, and extra paths being added to Bacule... shell access to gerrit1001 will be removed next week
  • 18:16 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/926593

2023-06-01

  • 13:48 James_F: doc: `sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/GWToolset/` for T337062
  • 13:34 James_F: Zuul: [wikidata/query/flink-rdf-streaming-updater] Archive
  • 13:18 Daimona: Dropping campaign_events.event_tracking_tool_id and campaign_events.event_tracking_tool_event_id on beta wikishared # T336362

2023-05-26

2023-05-25

  • 17:30 hashar: gerrit2002 replication eventually has completed at some point: `Replication completed with some errors!` # T334521
  • 16:44 hashar: gerrit2002: creating lucene indices: `java -jar /var/lib/gerrit2/review_site/bin/gerrit.war reindex --index groups` # T334521
  • 16:37 hashar: ssh -p 29418 gerrit.wikimedia.org replication start --url gerrit2002 --all --wait # T334521
  • 16:27 brennen: phab1004: sudo systemctl restart php7.3-fpm.service && sudo systemctl restart phd

2023-05-24

  • 10:09 eoghan: Switching doc.wikimedia.org from doc1002 -> doc1003, T319477
  • 09:24 Daimona: Creating new DB table on beta wikishared for the CampaignEvents extension # T336362

2023-05-23

  • 21:48 brennen: https://phab.wmflabs.org/ now running phorge 2023.17
  • 13:54 TheresNoTime: (deployment-prep) `samtar@deployment-mwmaint02:~$ mwscript resetUserEmail.php --wiki=metawiki Diskdance [snip]` T337172

2023-05-21

2023-05-17

  • 09:53 hashar: integration-agent-docker-1029: erased a few files under `/srv`. I suspect the 36GBytes partition is not large enough nowadays for multiple concurrent builds of MediaWiki # T336840
  • 03:12 brennen: gitlab-webhooks restart after failed webhook requests (presumably earlier outage)

2023-05-16

2023-05-12

2023-05-11

2023-05-10

  • 23:19 brennen: reconfigured and restarted gitlab-webhooks to use CodeReviewBot for messages instead of gerritbot (T327424)

2023-05-09

2023-05-05

2023-05-04

2023-05-03

2023-05-02

2023-05-01

  • 17:20 brennen: experimenting with ldap user sync on gitlab.devtools

2023-04-28

  • 19:56 dancy: Ran `git submodule sync` as jenkins-deploy in deployment-deploy03:/srv/mediawiki-staging/php-master/extensions for T335602

2023-04-27

  • 17:10 James_F: Zuul: [wvui] Mark repo as archived for T310244

2023-04-26

  • 16:51 James_F: Zuul: Add Kevin Wilke to CI allow list

2023-04-25

  • 21:23 mutante: gerrit1003 - sudo -u gerrit2 /usr/bin/scap deploy-local --repo gerrit/gerrit -D log_json:False (manually it works, but that's the same command that puppet is supposed to run !?) - T257317 T326368

2023-04-24

  • 21:37 TheresNoTime: (deployment-prep) Add volume to `deployment-mwmaint02` (`mwmaint`) and moved `/srv` - T327853

2023-04-23

  • 16:55 Krinkle: Fix profile::tlsproxy::envoy::global_cert_name in Horizon for webperf host to use '%{facts.fqdn}' instead of performance.discovery.wmnet as the latter doesn't resolve / would be an invalid cert for https://deployment-webperf21, ref T291015

2023-04-22

2023-04-21

  • 10:04 Lucas_WMDE: `sudo systemctl reload nginx` on deployment-elastic09, deployment-elastic10, deployment-elastic11 # T335181

2023-04-20

2023-04-19

  • 13:59 James_F: Beta: Setting `namespace: repos/abstract-wiki/wikifunctions image_name: function-orchestrator` on deployment-docker-wikifunctions01 for T334998
  • 10:56 joe: Updating docker-pkg files on contint primary for helm-linter

2023-04-18

  • 17:35 mutante: doc2001 - systemctl reset-failed - cleared monitoring for systemd state - remnants from PHP7.3 after upgrade to 7.4
  • 17:08 James_F: Zuul, jjb: [mediawiki/services/function-orchestrator] Archive, moved to GitLab for T334397

2023-04-17

  • 13:37 James_F: Zuul: [mediawiki/services/function-schemata] Mark as archived for T281500

2023-04-12

2023-04-10

  • 20:00 thcipriani: restarting zuul due to due to stuck gerrit ssh-connections
  • 18:44 thcipriani: restart zuul-merger

2023-04-09

  • 13:22 lucaswerkmeister: lucaswerkmeister@deployment-mwmaint02:~$ mwscript createAndPromote metawiki --custom-groups=oauthadmin --force 'Lucas Werkmeister' # made myself OAuth admin so I can manage the clients used to test m3api-oauth2

2023-04-06

  • 19:49 James_F: Zuul: Add all @wikia/fandom domains to the CI allow list

2023-04-05

2023-04-04

2023-04-03

  • 14:14 James_F: Zuul: [mediawiki/extensions/ContentStabilization] Add BlueSpiceBookshelf dep
  • 11:10 hashar: Switching Jenkins jobs to Quibble 1.5.4 | https://gerrit.wikimedia.org/r/905190
  • 10:25 hashar: Building Docker images for Quibble 1.5.4 https://gerrit.wikimedia.org/r/905167
  • 10:20 hashar: Tag Quibble 1.5.4 @ 0a37ce9 # T332930 T331280 T333412
  • 08:11 hashar: gtlab: runner-1030: running `docker volume prune` to discard all volumes metadata after they have been manually deleted from `/var/lib/docker` ( Reclaimed 13.92GB) | T333586
  • 08:11 hashar: gtlab: runner-1030: running `docker volume prune` to discard all volumes metadata after they have been manually deleted from `/var/lib/docker` ( Reclaimed 13.92GB) | T33586

2023-03-31

2023-03-29

2023-03-23

  • 13:22 James_F: Gerrit: Deleting mediawiki/extensions/PageProperties duplicate 'main' branch, development work is in 'master'.

2023-03-22

  • 21:14 taavi: taavi@deployment-mwmaint02:~$ mwscript extensions/OATHAuth/maintenance/UpdateForMultipleDevicesSupport.php metawiki --force # T242031
  • 20:34 taavi: cat /srv/mediawiki/php-master/extensions/OATHAuth/sql/mysql/tables-generated.sql | sql centralauth --write # T242031

2023-03-20

  • 21:43 brennen: phabricator: setting sbassett to administrator per T331928

2023-03-19

  • 22:34 TheresNoTime: (beta) `samtar@deployment-kafka-logging01:~$ sudo systemctl restart kafka.service`, noticed beta-logs wasn't showing logs from ~14:00UTC in T332507
  • 22:10 TheresNoTime: (beta) `GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, REFERENCES, INDEX, ALTER, CREATE TEMPORARY TABLES, LOCK TABLES, EXECUTE, CREATE VIEW, SHOW VIEW, CREATE ROUTINE, ALTER ROUTINE, EVENT, TRIGGER ON mainstash.* TO 'wikiadmin'@'172.16.%';` T322469
  • 14:43 hashar: deployment-prep: databases update hourly job times out, filed T332507

2023-03-17

  • 23:00 urbanecm: deployment-prep: Reboot deployment-elastic10, deployment-elastic11 (T332455)
  • 22:58 urbanecm: deployment-prep: Reboot deployment-elastic09 (T332455)
  • 10:36 mutante: disabled phab user 'Cloudduck1233'

2023-03-16

2023-03-15

  • 09:01 dwalden: (deployment-prep) `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for T327708
  • 08:09 hashar: Refreshing all Jenkins jobs to catch up with various changes made in the last few days
  • 08:01 hashar: Switching Jenkins jobs to Quibble 1.5.3 | https://gerrit.wikimedia.org/r/c/integration/config/+/898807 | T331061, T331621
  • 07:50 hashar: Cleared Jenkins workspaces on integration-agent-docker-1034

2023-03-14

  • 16:54 hashar: Building Docker images for Quibble 1.5.3
  • 16:41 hashar: Tag Quibble 1.5.3 @ df49e8a04f5 # T331621 T331061
  • 16:00 hashar: updating Docker images for https://gerrit.wikimedia.org/r/c/integration/config/+/898787
  • 07:25 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki en_rtlwiki --category='Pages that use Phonos'` for T326163
  • 07:24 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiktionary --category='Pages that use Phonos'` for T326163
  • 07:17 dwalden: `dwalden@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for T326163
  • 02:44 James_F: MediaWiki being branched to REL1_40 from fd3ce76 for T329079

2023-03-13

  • 17:57 James_F: Moved deployment-docker-cpjobqueue01 from v0.9.5 to v0.10.5 of change-prop whilst debugging T326192
  • 17:44 James_F: Manually changed cloudmetrics1002 to cloudmetrics1003 on deployment-docker-cpjobqueue01 whilst debugging T326192
  • 17:41 brennen: gitlab: removing dzahn (mutante) as member of /repos to test notification behavior

2023-03-12

  • 23:01 James_F: Zuul: [mediawiki/extensions/Tabber] Fix archived extension
  • 23:01 James_F: Zuul: Add CI for EImage, SearchParserFunction, and StandardWikitext extensions
  • 22:57 James_F: Zuul: Add Want to the CI whitelist
  • 10:23 taavi: reload zuul for https://gerrit.wikimedia.org/r/897068 T328240

2023-03-11

  • 01:22 TheresNoTime: `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, T324233`

2023-03-10

  • 21:08 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/896431
  • 16:37 TheresNoTime: `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, T324233`
  • 15:07 TheresNoTime: (deployment-prep) `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, T324233
  • 14:37 TheresNoTime: (deployment-prep) clear lock
  • 14:28 TheresNoTime: (deployment-prep) `[samtar@deployment-deploy03 ~]$ scap lock --all --verbose Debugging issue with extension maintenance script, T324233`

2023-03-09

2023-03-08

2023-03-07

  • 17:52 TheresNoTime: (deployment-prep) Ctrl+C'd `mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'`, taking "a long time", saw `GlobalVarConfig::get: undefined option: 'PhonosStoreFilesAsMp3'`, T326163
  • 17:48 TheresNoTime: (deployment-prep) `samtar@deployment-mwmaint02:~$ mwscript maintenance/refreshLinks.php --wiki enwiki --category='Pages that use Phonos'` for T326163
  • 08:17 hashar: Updating Jenkins jobs for JJB updgrade from 4.1.0 to 4.2.0 | https://gerrit.wikimedia.org/r/c/integration/config/+/893765

2023-03-06

  • 13:48 hashar: Freed 3G of disk on deployment-mwmaint02 by deleting `/srv/mediawiki/php-master/cache/l10n/upstream/.~tmp~` T327853
  • 13:44 hashar: Beta cluster no more updates due to deployment-mwmaint02 having a disk too small | T327853
  • 12:42 hashar: Updating Jenkins jobs to Quibble 1.5.2
  • 12:24 hashar: Building Docker images for Quibble 1.5.2 | https://gerrit.wikimedia.org/r/894617
  • 12:15 hashar: Tag Quibble 1.5.2 @ 932b48cab06c # T331236 T331061 T323750

2023-03-05

  • 14:09 lucaswerkmeister: manually deleted mediainfo slots of two pages on beta commons (T331214#8666432)

2023-03-03

2023-03-02

  • 22:01 zabe: enable read-only mode and create dump of all databases # T331019
  • 21:54 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db12 # T331019
  • 16:35 zabe: create volume db13 and attach to deployment-db13 # T331019
  • 16:29 zabe: create deployment-db13 as g3.cores8.ram16.disk20 # T331019
  • 16:24 zabe: shutoff deployment-db09 # T331019
  • 16:13 zabe: failover deployment-prep master from deployment-db09 to deployment-db11 # T331019
  • 14:00 hashar: gerrit: removed old replication tasks from /var/lib/gerrit2/review_site/data/replication/ref-updates/waiting (most from August 5th 2022)
  • 12:41 Lucas_WMDE: wikidata/query-builder/deploy.git: deleted master branch (was ed287d5 ) # T330752
  • 12:39 Luca: wikidata/query-builder/deploy.git: changed HEAD from master to production # T330752
  • 12:13 zabe: delete deploymentwiki # T198673

2023-03-01

2023-02-28

2023-02-27

2023-02-25

  • 22:57 James_F: Zuul: [mediawiki/tools/minus-x] Use lib template (add doxygen and coverage)
  • 22:56 James_F: Zuul: [mediawiki/tools/phpunit-patch-coverage] Use lib template (add doxygen)

2023-02-24

  • 15:26 andrewbogott: deleting long-shutoff stretch instance deployment-imagescaler03.deployment-prep.eqiad1.wikimedia.cloud -- T289883
  • 01:49 James_F: Zuul: [mediawiki/tools/codesniffer] Use lib template (add doxygen)

2023-02-23

  • 22:15 James_F: Docker: [quibble-buster] Re-use node from the node image rather than our own
  • 21:13 James_F: Docker: [node16] Upgrade node from 16.16.0 to 16.19.1
  • 14:11 hashar: Update Jenkins jobs to use Quibble 1.5.0 and have some to use the new reporting-url parameter
  • 14:00 taavi: update quibble* jenkins jobs for 891303
  • 07:49 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/891317 Make tox-docker a voting job for operations/mediawiki-config

2023-02-22

2023-02-21

  • 18:55 James_F: Zuul: [mediawiki/extensions/Flow] Also run with BetaFeatures
  • 16:04 James_F: Zuul: [mediawiki/extensions/GrowthExperiments] Add JS doc build/publish jobs T329034
  • 15:07 James_F: Zuul: [mediawiki/services/jobrunner] Use lib template (add doxygen and coverage)
  • 13:50 hashar: Updating docker-pkg files for https://gerrit.wikimedia.org/r/890817
  • 11:30 hashar: Reloaded Zuul to enable Sonar Codehealth Checks on CheckUser, DiscussionTools and ContentTranslation | T321837

2023-02-20

2023-02-16

  • 10:31 jnuche: restarted Zuul to clear stale events

2023-02-15

2023-02-14

  • 16:23 taavi: make Dreamy Jazz a mediawiki/* +2'er T329000
  • 15:02 zabe: deployment-db12: start replicating from deployment-db09 # T329577
  • 14:04 zabe: delete deployment-db10 and volume db10 # T329577
  • 11:38 zabe: deployment-db11: start replicating from deployment-db09 # T329577
  • 02:19 zabe: deployment-db12: import dump into mariadb # T329577
  • 02:16 zabe: rsync dump from deployment-db09 to deployment-db12 # T329577
  • 02:09 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db12 # T329577
  • 01:50 zabe: create volume db12 and attach to deployment-db12 # T329577
  • 01:38 zabe: create deployment-db12 as g3.cores8.ram16.disk20 # T329577
  • 01:14 zabe: deployment-db11: import dump into mariadb # T329577
  • 01:06 zabe: rsync dump from deployment-db09 to deployment-db11 # T329577
  • 00:22 zabe: install mariadb 10.6 via role::mariadb::beta on deployment-db11 # T329577

2023-02-13

  • 23:48 zabe: create volume db11 and attach to deployment-db11 # T329577
  • 23:44 zabe: shutoff deployment-db10 # T329577
  • 23:35 zabe: create deployment-db11 as g3.cores8.ram16.disk20 # T329577
  • 23:20 zabe: created backup of all databases on deployment-db09 # T329577
  • 22:29 dancy: Disabled beta-scap-sync-world and beta-update-databases-eqiad Jenkins jobs
  • 19:57 zabe: zabe@deployment-deploy03:~$ sudo keyholder arm

2023-02-10

  • 21:52 James_F: Zuul: [operations/software/homer/deploy] Add CI for T277440
  • 03:21 James_F: Zuul: [wikimedia/fundraising/crm/civicrm] Mark as archived for T324732

2023-02-08

2023-02-07

  • 19:13 James_F: Zuul: Configure support for forthcoming REL1_40 branches for T329077

2023-02-06

2023-02-03

  • 03:35 Krinkle: Delete empty GitHub repositories that were created as mirror of a Gerrit repo but are empty and more than 5 years old

2023-02-02

  • 15:53 James_F: Zuul: [operations/debs/gdnsd] Add debian-glue CI for T321309
  • 12:19 hashar: gerrit: deleted erroneous project which had a leading space ' research/navigation-vectors'. Done over ssh with: `ssh -p 29418 gerrit.wikimedia.org delete-project delete --yes-really-delete "' research/navigation-vectors'"`

2023-01-31

  • 20:30 brennen: deploy1002:/srv/deployment/phabricator/deployment: updating previous phabricator remotes to gitlab
  • 18:21 James_F: Zuul: [wikimedia/fundraising/crm] Make composer php74 voting via teamplate
  • 18:11 James_F: Zuul: [wikimedia/fundraising/crm] Switch to generic composer job
  • 18:06 James_F: Zuul: Switch FR things on mwgate-composer-php73-docker to php74 for T326372

2023-01-30

2023-01-27

2023-01-25

  • 21:35 dancy: runner-1030.gitlab-runners.eqiad1.wikimedia.cloud has been re-registered as an instance-wide runner. T327949
  • 19:37 dancy: Taking runner-1030.gitlab-runners.eqiad1.wikimedia.cloud offline for T327949

2023-01-24

  • 22:08 James_F: Zuul: Drop fundraising/REL1_35 jobs, everything has moved to REL1_39 now T326372
  • 22:04 James_F: Zuul: Make fundraising/REL1_39 jobs voting for T326372
  • 17:19 thcipriani: restarting ci jenkins for updates
  • 17:15 thcipriani: restarted releases-jenkins for plugin updates

2023-01-23

  • 20:04 hashar: gerrit: changed mediawiki/tools/code-utils merge strategy from `fast-forward` only to `Rebase if necessary` *
  • 15:29 James_F: Docker: Building new version of helm-linter image with sextant installed for T292818

2023-01-20

2023-01-19

  • 20:01 James_F: Zuul: Add Izno to the CI allowlist
  • 19:10 zabe: zabe@deployment-mwmaint02:~$ foreachwiki migrateRevisionCommentTemp.php # T299954
  • 19:10 zabe: zabe@deployment-mwmaint02:~$ foreachwiki migrateRevisionCommentTemp.php
  • 19:10 taavi: deployment-prep: pruned bunch of stale puppet certificates and puppetdb entries
  • 19:02 andrewbogott: deleting long-shutdown stretch instances: deployment-echostore01, deployment-ms-fe03, deployment-prometheus02
  • 17:42 jeena: restarting zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/879907

2023-01-18

2023-01-17

2023-01-16

2023-01-13

2023-01-12

2023-01-10

2023-01-09

  • 19:56 James_F: Zuul: Fix extension-quibble-only-standalone to not run vendor jobs on branches
  • 16:30 wm-bot2: Increased quotas by 6 cores (T326568) - cookbook ran by arturo@nostromo
  • 10:34 hashar: Restarted zuul-merger on contint1002 it was listening but not processing any requests

2023-01-08

  • 19:10 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/876355
  • 00:21 Krinkle: Mark various Gerrit repos under mediawiki/tools/ as read-only "ARCHIVED" that are 6y+ inactive, in prep for enabling Codesearch for this prefix

2023-01-07

2023-01-06

2023-01-05

2023-01-04

2023-01-03


Archives

Retrieved from "https://wikitech.wikimedia.org/w/index.php?title=Release_Engineering/SAL/Archive_9&oldid=2137372"