Release Engineering/SAL
2025-03-14
- 21:36 Reedy: deployed https://gerrit.wikimedia.org/r/1127982
- 16:55 Lucas_WMDE: manually killed job https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php81/2928/console which had been stuck since 16:33 UTC, blocking gate-and-submit :(
2025-03-13
- 21:29 dancy: Finished gitlab cloud runners k8s production cluster upgrade (T388836)
- 20:42 dancy: Finished gitlab cloud runners k8s staging cluster upgrade (T388836)
- 20:09 dancy: Starting gitlab cloud runners k8s production cluster upgrade (T388836)
- 19:26 dancy: Starting gitlab cloud runners k8s staging cluster upgrade (T388836)
2025-03-11
- 22:54 bd808: Deleted unattached volumes: alert01, db09, deploy03, mwmaint, ores02, parsoid14-srv, prometheus05
- 22:39 bd808: Released unused floating IPs 185.15.56.9 and 185.15.56.97 back to global pool
- 22:08 bd808: Updated mail.beta.wmflabs.org service name to point to 185.15.56.115
- 22:04 bd808: Deleted orphan parsoid-external-ci-access.beta.wmflabs.org. DNS record
- 21:53 bd808: Deleted dangling prometheus-beta.wmcloud.org web proxy
- 21:50 bd808: Deleted dangling w-beta.wmflabs.org web proxy
- 21:42 bd808: Deleted unused "deployment-parsoid" Prefix Puppet configuration
- 20:48 James_F: Docker: [quibble-bullseye-php81 & php81] Use PCRE2 backport from component/php81, for T386006
- 13:19 James_F: Zuul: [mediawiki/extensions/ActiveAbstract] Mark as archived, for T382069
- 03:54 eileen: civicrm upgraded from f2222fcd to ec20a105
2025-03-10
- 15:20 James_F: Zuul: [mediawiki/services/servicelib-node] Mark as archived, for T388424
- 13:47 hashar: gerrit: removed leftover empty directory `/srv/gerrit/plugins/lfs`. Data have been migrated to `/srv/gerrit/plugins/lfs` as part of moving Gerrit data out of `/`. See T333143
2025-03-08
- 01:22 James_F: Zuul: [php-session-serializer] Enable PHP 8.4 as voting, for T368270
2025-03-07
- 21:00 James_F: Zuul: [mediawiki/libs/Shellbox] Enable PHP 8.4 as voting, for T386570
- 20:53 James_F: Zuul: [wikipeg] Enable PHP 8.4 as voting, for T386570
- 20:07 James_F: Zuul: [mediawiki/libs/Equivset] Enable PHP 8.4 as voting, for T387806
2025-03-05
- 00:21 dancy: Reeanbled beta-scap-sync-world (T166010)
2025-03-04
- 23:26 dancy: Disabling beta-scap-sync-world for noise reduction while dealing with T166010
- 22:10 James_F: Zuul: [mediawiki/services/example-node-api] Mark as archived, for T387933
- 01:42 James_F: Zuul: [mediawiki/tools/phan/SecurityCheckPlugin] Disable on PHP 8.4, for T386570
- 01:13 James_F: Zuul: Add WgevaertWikiBase to CI allowlist
- 01:03 James_F: Zuul: Start testing in PHP 8.4 for 'mediawiki-php-library' repos, for T386108
2025-02-28
- 18:20 dancy: Upgrading gitlab-runner to v17.7.1 in production gitlab-cloud-runners (T386297)
- 18:12 dancy: Upgrading gitlab-runner to v17.7.1 in staging gitlab-cloud-runners (T386297)
- 17:52 dancy: Upgraded scap to 4.138.0 in beta cluster
- 16:43 bd808: Deleted now dangling parsoid.svc.deployment-prep.eqiad1.wikimedia.cloud. DNS record (T385849)
- 16:40 bd808: Deleted deployment-parsoid14.deployment-prep.eqiad1.wikimedia.cloud (T385849)
- 16:39 bd808: Deleted parsoid-external-ci-access.wmcloud.org proxy (T385849)
- 16:37 bd808: Deleted deployment-alert01.deployment-prep.eqiad1.wikimedia.cloud (T385849)
- 16:36 bd808: Deleted deployment-bastion.deployment-prep.eqiad1.wikimedia.cloud (T385849)
2025-02-27
- 01:11 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1123063 T386476
2025-02-26
- 20:21 James_F: jforrester@doc1003:~$ sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/LdapAuthentication/ #T376097
- 20:18 James_F: Zuul: [mediawiki/extensions/LdapAuthentication] Mark as archived, for T376097
- 13:20 hashar: Updating Quibble jobs to 1.13.0. "Skip execution upon a success cache hit" which would make some jobs to skip tests entirely when a set of commits/image is known to have previously passed # T383243 | dduvall
- 11:06 hashar: Tag Quibble 1.13.0 @ 0ac128f # T383243
- 09:11 hashar: deployment-prep: cherry picking https://gerrit.wikimedia.org/r/c/operations/puppet/+/1122901 "php: use component/pcre2 when using Php 8.1" to fix php # T387276
- 01:55 bd808: `./jjb-update 'integration-quibble-fullrun-*-php81' '*-php81-phan' '*php81*'`
- 01:16 Reedy: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/1122700 T386006
2025-02-25
- 20:25 James_F: Docker: [php81] Update PHP to 8.1.31-1+wmf11u4, for T386006
- 14:07 James_F: Docker: [php81] Upgrade Wikimedia's PHP to 8.1.31-1+wmf11u3 & PCRE to 10.42 for T386006
2025-02-24
- 01:02 jeena: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/73
2025-02-22
- 11:27 taavi: rebooting integration-agent-docker-1047 which thinks it is gerrit
2025-02-21
- 22:54 brennen: gitlab: removing expiration date for 14 tokens expiring in 2025 (T385930)
- 22:36 brennen: gitlab: set require_personal_access_token_expiry and service_access_tokens_expiration_enforced to false
2025-02-20
- 20:15 dancy: Updated buildkitd to v0.20.0 in gitlab-cloud-runners (T386955)
- 20:15 dancy: Updated buildkitd to v0.20.0 in gitlab-cloud-runners
2025-02-19
- 21:28 dancy: Reenabled https://integration.wikimedia.org/ci/view/Beta/job/beta-scap-sync-world/ (T386851)
- 19:35 dduvall: restarting jenkins to fix git related issues following java update (T386755)
- 15:47 dancy: Disabled the https://integration.wikimedia.org/ci/job/beta-scap-sync-world/ job to reduce noise while the problem is being debugged.
2025-02-18
- 16:49 dancy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/1119815
- 16:11 James_F: Zuul: [operations/debs/dnsdist] Revert archival
2025-02-13
- 13:57 James_F: Zuul: [mediawiki/extensions/CirrusSearch] Drop WikibaseCirrusSearch dep, for T386015
2025-02-12
- 17:22 James_F: Zuul: Add User:Michi j to CI allowlist
- 17:21 James_F: Zuul: Add Dragoniez to CI allowlist
2025-02-11
- 15:43 James_F: Zuul: Make PHP 8.4 voting on lib repos where it already passes, for T386108
2025-02-10
- 14:27 James_F: Zuul: Add Bunnypranav to CI allowlist
2025-02-08
- 00:07 bd808: Added `profile::maps::osm_master::disable_waterlines_import_timer: false` to deployment-maps prefix hiera (T385921)
2025-02-07
- 22:14 brennen: phab/phorge: replaced mr-widget token in deployed config (T385480)
- 21:33 bd808: Added `profile::restbase::parsoid_uri: https://phabricator.wikimedia.org/T385902` to deployment-restbase prefix puppet (T385902)
- 01:34 bd808: Cherry-picked https://gerrit.wikimedia.org/r/c/operations/puppet/+/1117997 to deployment-puppetmaster (T385849)
- 00:42 bd808: Shutoff deployment-parsoid14 to see if anything breaks/anyone yells (T385849)
2025-02-06
- 23:53 bd808: Updated citoid-beta.wmflabs.org to point to deployment-docker-citoid02
- 23:50 bd808: Deleted beta-prometheus.wmflabs.org; it was pointed to an IP now owned by the mdwikioffline project.
- 23:43 bd808: Deleted recently orphaned spiderpig.wmcloud.org proxy after discussion with dancy
- 16:20 bd808: Rebooted deployment-sessionstore06 (T385803)
- 12:07 andrewbogott: rebooting all servers for T385264
2025-02-05
- 19:17 James_F: Zuul: [mediawiki/extensions/DonationInterface] Switch CI from PHP74 to PHP82
- 18:23 James_F: Zuul: [mediawiki/extensions/cldr] Raise FR-special job to REL1_43
- 18:22 James_F: Zuul: [mediawiki/extensions/DonationInterface] Raise FR-special job to REL1_43
- 18:11 James_F: Zuul: [labs/tools/heritage] Fold template into this, only user
- 18:08 James_F: Zuul: [mediawiki/extensions/FundraisingEmailUnsubscribe] Test in PHP 8.2+ only
- 17:29 James_F: Zuul: [mediawiki/core] Test fundraising branches against PHP 8.2
- 17:19 James_F: Zuul: [mediawiki/extensions/FundraisingEmailUnsubscribe] Mark as non-prod
2025-02-03
- 12:34 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1115782
2025-01-30
- 15:12 James_F: Zuul: [mediawiki/extensions/Wikibase] Only inject EntitySchema on 1.43+, for T385175
- 01:39 James_F: Zuul: [mediawiki/core] Remove composer variant from wmf branches
- 00:42 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1115131
2025-01-29
- 18:03 James_F: Zuul: Make FR REL1_43-php82 voting for cldr and FEU
- 17:54 James_F: Zuul: Add FR REL1_43-php82 as experimental to other extensions
- 17:40 James_F: Zuul: [mediawiki/extensions/cldr] Add FR REL1_43-php82 as experimental
- 17:40 James_F: Zuul: [mediawiki/extensions/cldr] Re-enable FR-tech job as voting, passes fine
- 16:57 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1115064
- 16:33 hashar: gerrit: marked all legacy Puppet modules as read-only ( https://gerrit.wikimedia.org/r/admin/repos/q/filter:operations/puppet/ ) and removed the associated GitHub mirrors that existed for some of them
2025-01-28
- 17:46 dancy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/1113550 (T383337)
- 17:38 dancy: Updating docker-pkg files on contint primary for https://gerrit.wikimedia.org/r/c/integration/config/+/1113549 (T383337)
- 10:07 hashar: Manually cleaned integration-agent-docker-1043
2025-01-27
- 18:17 hashar: Cleaned disk on integration-agent-docker-1051
2025-01-25
- 09:20 taavi: reloading zuul for https://gerrit.wikimedia.org/r/1113739
2025-01-24
- 21:44 James_F: Revert "Zuul: Switch Fundraising jobs to REL1_43"
2025-01-23
- 16:31 dancy: Updating production gitlab-cloud-runners to v17.6.1
- 16:23 dancy: Updating staging gitlab-cloud-runners to v17.6.1
2025-01-22
- 18:14 James_F: Zuul: [mediawiki/extensions/WikiLambda] Add Wikibase as a phan dependency
2025-01-20
- 09:55 hashar: Updating Quibble jobs to enable success cache experiment - T383243
- 08:20 hashar: Updating all Jenkins jobs to update Quibble to 1.12.0
2025-01-17
- 16:59 dduvall: Building Docker images for Quibble 1.12.0
- 15:00 hashar: Building Docker images for Quibble 1.12.0
- 12:56 hashar: Tag Quibble 1.12.0 @ 633099e # T365978, T383243
2025-01-14
- 17:14 brennen: integration project: create integration-agent-docker-1059 for T383254
- 16:50 brennen: integration project: create integration-agent-docker-1058 for T383254
2025-01-10
- 15:55 dancy: Updating gitlab-cloud-runners (prod) to v17.5.5 (T383263)
- 15:49 dancy: Updating gitlab-cloud-runners (staging) to v17.5.5
2025-01-09
- 22:20 brennen: gitlab: Feature.enable(:kubernetes_agent_protected_branches) - https://docs.gitlab.com/ee/user/clusters/agent/ci_cd_workflow.html#restrict-access-to-the-agent-to-protected-branches
- 18:08 James_F: Docker: [node22] Update Node to v22.13.0, & switch base image to bookworm, for T383337
- 17:01 James_F: Docker: [node20] Update Node to v20.18.1, & switch base image to bookworm, for T383337
- 15:13 James_F: Docker: [sury-php] Re-platform to bookworm
2025-01-08
- 22:07 hashar: castor: deleting potentially corrupted npm cache. On integration-castor05: sudo rm -fR /srv/castor/castor-mw-ext-and-skins/master/{wmf-quibble-selenium-php74,quibble-vendor-mysql-php74-selenium}/npm # T383237
2025-01-07
- 22:07 hashar: Deleted /srv/zuul/git/operations/dumps/dcat on both contint1002 and contint2002 # T157818
- 19:00 bd808: `/usr/local/sbin/clean-stale-puppet-certs --clean` (T383153)
- 18:53 taavi: taavi@deployment-puppetserver-1:~$ sudo puppetserver ca clean --certname maps-master01.maps-experiments.eqiad1.wikimedia.cloud # T383153
- 18:50 taavi: taavi@deployment-puppetserver-1:~$ sudo puppet node clean geoshapes.maps-experiments.eqiad1.wikimedia.cloud # T383153
- 18:30 bd808@cloudcumin1001: END (FAIL) - Cookbook wmcs.vps.remove_instance (exit_code=1) for instance deployment-etcd04
- 18:30 bd808@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance deployment-etcd04
- 14:48 hashar: Manually renamed wikibase-daily-npm-audit-daily-node18-npmaudit to node20 variant and refresh the config with JJB
- 14:33 James_F: Zuul: [mediawiki/extensions/WikiLambda] Only run standalone jobs in master
2025-01-06
- 20:16 andrewbogott: removed the (non-existent?) role::mw_rc_irc from puppet config for deployment-ircd03.deployment-prep.eqiad1.wikimedia.cloud
- 19:35 bd808: Manually generated missing en_US.UTF-8 locale on deployment-maps-master02.deployment-prep.eqiad1.wikimedia.cloud (T361381)
- 19:32 bd808: Added `postgresql::postgis::postgresql_postgis_package: postgresql-15-postgis-3` to deployment-maps Prefix Puppet to work around default parameter problem (T361381)
- 19:31 bd808: Issued new Puppet cert for deployment-maps-master02.deployment-prep.eqiad1.wikimedia.cloud (T361381)
- 19:27 bd808: Added `postgresql::postgis::postgresql_postgis_package: ignored` to deployment-maps Prefix Puppet to work around default parameter problem (T361381)
- 19:15 brennen: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/71 (T382709)
- 19:11 bd808: Added placeholders for `graphite_host` and `statsd` to deployment-webperf Prefix Puppet
- 18:53 bd808: Fixed missing profile::swift::global_account_keys::{codfw, eqiad} placeholders breaking deployment-ms-* puppet runs
- 18:38 bd808: Fixed incorrect deployment-restbase prefix puppet setting that was causing puppet run failures
- 18:19 bd808: Issued a new Puppet client cert for traindev01.deployment-prep.eqiad1.wikimedia.cloud
- 14:58 James_F: Zuul: Drop CI for REL1_41 branch, now EOL per T376550
- 09:03 hashar: gerrit: flushed diff_intraline, diff_summary, gerrit_file_diff and git_file_diff caches after having turned on diff3 style # T359821
2025-01-02
- 11:27 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/1105679 # T374113