Jump to content

Release Engineering/SAL

From Wikitech

2026-04-10

  • 23:22 James_F: jforrester@contint1002:~$ zuul enqueue --trigger gerrit --pipeline postmerge --project mediawiki/extensions/ReadingLists --change 1269498,2 # T422976
  • 23:20 James_F: Zuul: [mediawiki/extensions/ReadingLists] Publish JS coverage, for T422976
  • 23:13 James_F: Zuul: Migrate a few straggler Node 20 MediaWiki things to Node 24
  • 23:01 James_F: Zuul: Move all MediaWiki things from mediawiki-node20 to mediawiki-node24
  • 21:59 James_F: Docker: Bump Node base images to March releases and cascade; Upgrade Quibble images from Node 20 to Node 24
  • 10:24 hashar: Updating all Quibble jobs to 1.17.1
  • 10:22 hashar: Updated PostgreSQL jobs to Quibble 1.17.1 # T422110
  • 10:22 hashar: Updated apitesting job to Quibble 1.17.1 # T422843 T418743
  • 09:51 hashar: Tag Quibble 1.17.1 @ 0a1ab3b

2026-04-09

2026-04-08

2026-04-07

  • 22:25 dduvall: adding new pipelinelib labels to ci nodes (T422234)
  • 20:05 hashar: Triggered a build of https://integration.wikimedia.org/ci/job/mediawiki-core-doxygen/
  • 17:06 dduvall: added `Docker` label to `contint` jenkins nodes (T422507)
  • 17:05 dduvall: restored missing `pipelinelib` labels on `integration-agent-docker-` CI hosts (T422507)
  • 16:53 bd808: Unblock 73.0.0.0/8 (T422498)
  • 12:36 hashar: jjb: use $CASTOR_HOST for Quibble success cache. https://gerrit.wikimedia.org/r/1268545 | This causes the Quibble jobs to use a new instance for the success cache, which is empty # T383243 T421114
  • 12:17 hashar: Migrated Castor from integration-castor05 to integration-castor06. Updated CASTOR_HOST in Jenkins and moved the Cinder volume to the new instance # T421114
  • 11:14 hashar: Added Bookworm based Jenkins agents to the pool Hostnames 1090, 1091, 1092 and 1093 # T421114
  • 10:09 hashar: Added Bookworm based Jenkins agents to the pool Hostnames 1083 to 1089 # T421114
  • 07:23 hashar: CI Jenkins: removed `blubber` label from all agents after having moved PipelineLib to use the `Docker` label | T422234

2026-04-06

2026-04-03

2026-04-02

  • 16:50 thcipriani: restart jenkins
  • 15:15 bd808: Unblock 82.216.0.0/16 (T421508)
  • 15:07 bd808: Unblock 95.90.0.0/15 (T421485)
  • 11:19 James_F: Zuul: [oojs/ui] Drop ooui-ruby2.7-rake job, we're abandoning Ruby use there

2026-04-01

  • 22:01 bd808: Unblock 109.144.0.0/12 (T422019)
  • 20:16 bd808: Unblock 93.192.0.0/10 (T421894)
  • 19:25 dancy: Updating buildkitd to v0.29.0 in gitlab-cloud-runners (prod) (T415284)
  • 17:57 brennen: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/97 (T420441)
  • 17:39 bd808: Unblock 94.134.0.0/15 (T421866)
  • 16:31 dancy: Upgrade buildkit to 0.29.0 in staging gitlab-cloud-runners (T415284)
  • 10:47 taavi: integration-castor05: free up a bit of disk space by deleting cache for AhoCorasick/ CLDRPluralRuleParser/ HtmlFormatter/ RelPath/ RunningStat/ IPSet/

2026-03-30

  • 22:01 bd808: Unblock 78.20.0.0/14 (T421586)
  • 21:04 bd808: Unblock 95.88.0.0/15 (T421774)
  • 20:49 bd808: Unblock 95.89.191.0/24 (T421774)
  • 20:29 bd808: Unblock 73.162.0.0/16 (T421549)
  • 13:10 hashar: gerrit: abandon mediawiki/core changes that are 2+years old and are attached to a task (`Bug: Txxxx`)
  • 11:37 hashar: Reloaded Zuul to to add 3 persons to the allow list
  • 10:43 James_F: Docker: Re-pushing to try to create quibble-coverage 1.16.0-s2

2026-03-27

  • 21:00 James_F: Docker: [quibble-bullseye] Drop Python 2 from images
  • 11:28 hashar: deployment-prep: removed block for `143.176.0.0/15` and blocked subblock `143.176.0.0/16` instead. This unblocks `143.177.0.0/16` # T421420
  • 00:18 bd808: Unblock 95.90.238.0/23 (T421447)

2026-03-26

2026-03-25

2026-03-24

  • 19:40 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1255746
  • 15:34 brennen: gitlab1004: manual test run of `configure-projects` with cleared issue allowlist (T412882)
  • 15:26 bd808: Unblock 47.194.0.0/16 (T421127)
  • 12:53 hashar: integration: deleted old Puppet 5 compiler agents from Jenkins ( pcc-worker1014.puppet-diffs.eqiad1.wikimedia.cloud , pcc-worker1015.puppet-diffs.eqiad1.wikimedia.cloud , pcc-worker1016.puppet-diffs.eqiad1.wikimedia.cloud ) # T367399
  • 07:42 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1259755

2026-03-23

  • 15:28 Lucas_WMDE: ssh integration-castor05.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node20 # fix failure seen in mediawiki-node20 90272

2026-03-22

2026-03-21

2026-03-20

  • 21:21 bd808: Unblock 103.159.218.0/24 (T420530)
  • 14:59 James_F: Zuul: [mediawiki/extensions/AbuseFilter] Add dependency on CodeMirror, for T399673

2026-03-19

  • 16:54 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1255777
  • 16:01 Krinkle: Hoist l10n-bot rights from labs/tools parent to labs parent to reduce duplication in other labs/ repos
  • 15:50 Krinkle: Create labs/xtools repo (branch: main, parent: labs, owner: labs-xtools), ref T402086

2026-03-18

  • 21:11 dcausse: T403775: reindexing all wikis to enable new sorting options
  • 21:08 dcausse: restarting opensearch on deployment-cirrussearch(12|13|14) instances to pickup new plugin versions
  • 14:56 James_F: Zuul: Handle wmf/next the same way as wmf/branch_cut_pretest
  • 14:52 James_F: Zuul: [GrowthExperiments] drop duplicate VisualEditor dep
  • 14:52 James_F: Zuul: [search/*] Add experimental Java 25 jobs

2026-03-17

  • 22:50 James_F: Zuul: [mediawiki/extensions/JsonForms] Add quibble jobs
  • 21:27 James_F: Zuul: search: Update opensearch plugins for Java 11/17, for T420407
  • 20:20 bd808: Resize deployment-sessionstore06 from g4.cores1.ram2.disk20 to g4.cores2.ram4.disk20 (T415021)
  • 16:43 James_F: Zuul: [BlueSpicePermissionManager] Add …ConfigManager & …UserManager deps
  • 14:36 James_F: Zuul: [mediawiki/extensions/ArticleGuidance]: Add SpamBlacklist as phan dep, for T420015

2026-03-13

  • 13:59 andrewbogott: deleting ptr record 117.0.16.172.in-addr.arpa. -- accidental duplicate for deployment-kafka-logging01.deployment-prep.eqiad1.wikimedia.cloud
  • 13:04 elukey: re-create kafka-logging-01 in deployment-prep on trixie and Kafka 3.7 (was running on buster)
  • 09:13 elukey: upgrade kafka-jumbo and kafka-main to Confluent 7.7 in deployment-prep (pre-requisite before being able to upgrade to Trixie)

2026-03-12

  • 21:23 bd808: Hard reboot deployment-sessionstore06 (T415021)
  • 01:14 James_F: Docker: [helm-linter] Bump for Envoy 1.35.9, for T419637

2026-03-11

2026-03-10

  • 17:39 dduvall: deployed reggie v1.18.0 to gitlab-cloud-runner production
  • 17:11 hashar: Updated MediaWiki coverage jobs so that they now keep "Generate a local configuration by running `composer phpunit:config`" message # T419073
  • 16:41 dduvall: deployed reggie v1.18.0 to gitlab-cloud-runner staging
  • 08:21 codders: integration: integration-castor05: rm -fR /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node20

2026-03-09

  • 21:53 bd808: Reboot deployment-shellbox01 on the off chance that is makes the new permissions error go away (T419440)
  • 13:13 James_F: Zuul: [mediawiki/extensions/WikiShare] Mark as archived, for T413589
  • 13:11 James_F: Zuul: [mediawiki/extensions/Memento] Mark as archived, for T369991
  • 13:10 James_F: Zuul: [mediawiki/extensions/QuickGV] Mark as archived, for T413348
  • 13:10 James_F: Zuul: [mediawiki/extensions/SemanticImageInput] Mark as archived, for T413588
  • 13:09 James_F: Zuul: [mediawiki/extensions/SidebarDonateBox] Mark as archived, for T413587
  • 13:07 James_F: Zuul: [mediawiki/extensions/SemanticSifter] Mark as archived, for T413586
  • 13:06 James_F: Zuul: [mediawiki/extensions/GoogleAdSense] Mark as archived, for T413585
  • 13:04 James_F: Zuul: [mediawiki/extensions/SecurityAPI] Mark as archived, for T418008
  • 12:50 James_F: Zuul: [mediawiki/extensions/CheckUser] Add DiscussionTools dependency
  • 12:50 James_F: Zuul: [mediawiki/skins/MinervaNeue] Add dependencies for TestKitchen
  • 10:40 hashar: gerrit: mediawiki/vendor: converted `es6` and `es710` branches to tags # T417804
  • 09:24 hashar: Updating Quibble jobs to 1.16.0 | https://gerrit.wikimedia.org/r/c/integration/config/+/1248880 | T417399 T417409 T418461
  • 09:15 hashar: updating all CI Jenkins jobs using `./jjb-update`

2026-03-06

2026-03-05

  • 14:41 James_F: Zuul: [mediawiki/skins/MinervaNeue] Add TestKitchen as a dependency for T418053
  • 08:01 hashar: Reloaded Zuul to rename wikibase-client / wikibase-repo jobs | https://gerrit.wikimedia.org/r/1238317
  • 00:04 James_F: Docker: [quibble-coverage] Use local PHPUnit config, for T345481

2026-03-04

  • 21:16 James_F: Zuul: [mediawiki/core] Make PHP 8.5 voting on master branch, for T411814
  • 21:10 James_F: Zuul: [mediawiki/vendor] Make PHP 8.5 voting on master branch, for T411814
  • 19:48 brennen: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/96 (T419004)
  • 18:50 James_F: Revert "Zuul: [mediawiki/extensions/MobileFrontend] Add ParserMigration dependency", for T419043
  • 16:23 James_F: Zuul: [mediawiki/services/parsoid] Make PHP 8.4 voting
  • 15:37 James_F: Docker: [rake-ruby2.7] Add libffi-dev too, for T418463
  • 13:59 James_F: Docker: [rake-ruby2.7] Add ruby-ffi for T418463
  • 13:54 hashar: SIGKILL Zuul cause it can't gracefully stop most probably due to being locked attempting to report back to Gerrit # T419009
  • 13:49 hashar: Stopping Zuul # T419009
  • 13:41 hashar: Took a Zuul stack dump on contint1002.wikimedia.org using SIGUSR1 # T419009

2026-03-03

  • 23:52 James_F: Zuul: [mediawiki/extensions/WikimediaMessages] Drop MetricsPlatform phan dep
  • 23:52 James_F: Zuul: [mediawiki/extensions/WikimediaEvents] Drop MetricsPlatform phan dep

2026-03-02

  • 22:13 James_F: Zuul: Enforce PHP 8.4 in MW extensions and skins for development branch, for T386108
  • 14:05 James_F: Zuul: [mediawiki/extensions/MobileFrontend] Add ParserMigration dependency, for T415451
  • 13:48 James_F: Zuul: […/WikimediaEvents] Drop LoginNotify dependency, now unused, for T404334
  • 10:16 Lucas_WMDE: ssh integration-castor05.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/quibble-vendor-mysql-php83-selenium/Cypress/15.8.2/ # T418718

2026-02-28

  • 21:33 hashar: gerrit: triggering replication to GitHub for all of `mediawiki/skins` # T418675
  • 21:33 hashar: gerrit: triggering replication to GitHub for all of `mediawiki/extensions` # T418675

2026-02-27

  • 15:53 dancy: Updating gitlab-cloud-runners (staging and prod) to gitlab-runner 18.9.0.

2026-02-26

2026-02-25

2026-02-24

  • 15:55 brennen: devtools: test deploy phab/phorge to test instance (T418256)

2026-02-23

2026-02-20

  • 21:47 bd808: Unblock 168.184.84.0/24 (T418020)
  • 17:13 bd808: Unblock 122.187.64.0/18 (T417964)
  • 14:35 James_F: Zuul: [mediawiki/extensions/Monstranto] Move out of Wikimedia prod section

2026-02-19

2026-02-18

2026-02-17

2026-02-16

  • 15:27 hashar: Manually cleaned some old workspaces on integration-agent-docker-1042

2026-02-12

  • 20:07 James_F: Zuul: Enable PHP 8.5 jobs for most MW libraries, for T406326
  • 19:33 James_F: Docker: [php83] Re-build with upstream's new 8.3.30 release and cascade
  • 19:31 James_F: Zuul: Add PHP 8.5 CI job to various things noted as blocked by Phan, for T410941, T406326
  • 16:35 Krinkle: Disable publishing noise on tasks from repos Bcp47, clover-diff, ScopedCallback, and IDLeDOM. Ref T143162
  • 15:53 dancy: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/87
  • 11:21 James_F: Zuul: [mediawiki/libs/shellbox] Add direct Phan job, for T416064

2026-02-10

  • 20:16 dancy: Rebooted k3s.catalyst-dev (it was unresponsive, but the reboot hasn't helped)

2026-02-09

2026-02-05

  • 17:58 James_F: Zuul: […/WikimediaCustomizations] Add six new dependencies for T404334
  • 15:35 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1237254
  • 15:18 James_F: Zuul: […/OATHAuth] Add dependency and phan dependency on CentralAuth

2026-02-04

  • 12:54 James_F: Zuul: [mediawiki/extensions/Petition] Add CLDR dependency
  • 10:03 hashar: Restarted Jenkins on releases2003.codfw.wmnet

2026-02-02

  • 21:17 hashar: Reloaded Zuul for https://gerrit.wikimedia.org/r/c/integration/config/+/1234926 "re-enable master jobs for some BlueSpice repos - T403196"
  • 21:05 bd808: Unblock 85.146.0.0/17 (T416079)
  • 19:47 James_F: Zuul: […/WikimediaCustomizations] Add cldr phan dependency, for T404334
  • 17:33 bd808: Unblock 188.188.0.0/15 (T416095)
  • 17:26 bd808: Unblock 85.94.84.0/22 (T416105)
  • 17:09 bd808: Unblock 94.234.0.0/16 (T416165)
  • 16:51 dancy: Update gitlab-runners to alpine-v18.6.6 (T415214)
  • 16:27 bd808: Unblock 47.231.208.0/21 (T416010)
  • 11:39 James_F: Zuul: […/WikimediaCustomizations] Add five new phan dependencies, for T404334
  • 09:45 Lucas_WMDE: ssh integration-castor05.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node20 # fix failure seen in mediawiki-node20 58532, 58557

2026-01-31

  • 21:49 James_F: Deleted Jenkins's job entry for castor-save-workspace-cache 6193776 and this seems to have unstuck things for T416078?
  • 21:45 James_F: Running `sudo systemctl restart jenkins` on contint for T416078
  • 21:44 James_F: Fighting T416078, took integration-castor-5 offline, disconnected, sshed in to kill threads, then reconnected; no change in aspect.
  • 19:03 Reedy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1235380

2026-01-28

  • 21:26 James_F: jforrester@doc1004:~$ sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/WebAuthn # T415832
  • 21:11 bd808: Unblock 181.160.0.0/15 & 186.40.128.0/17 (T415820)
  • 17:01 bd808: Unblock 102.182.0.0/16 (T415782)

2026-01-27

  • 16:45 James_F: Zuul: Switch skin-quibble template with identical extension-quibble, for T402398
  • 16:18 James_F: Zuul: [ArticleGuidance] mention it will be in production
  • 15:55 James_F: Docker: [quibble-bullseye] Update to Quibble 1.15.0
  • 15:12 James_F: Docker: [quibble-coverage] Pass PHPUnit config location explicitly, for T395470
  • 09:18 hashar: integration: on integration-castor05, deleted caches for old MediaWiki branches
  • 09:15 hashar: integration: on pkgbuilder instances, removed Buster cow images, aptcache and hooks. `sudo cumin --force -p 0 'name:pkgbuilder' 'rm -fR /srv/pbuilder/{base-buster-amd64.cow,hooks/buster,aptcache/buster-amd64}'` # T397209
  • 09:14 hashar: integration: cleaned up old workspaces under /srv/jenkins/workspace

2026-01-26

  • 23:27 bd808: Unblock 66.130.0.0/15 (T415596)
  • 22:52 bd808: Unblock 45.16.0.0/12 (T415467)
  • 14:46 hashar: gerrit: changed `operations/software/permissions` project type from `CODE` to `PERMISSIONS` by pointing `HEAD` to `refs/meta/config`

2026-01-22

  • 17:36 James_F: Docker: [quibble-coverage] Stop using legacy PHPUnit entrypoint (T395470) & Stop excluding Dump/ParserFuzz/Stub groups (T415230)
  • 15:11 James_F: Zuul: [mediawiki/extensions/Math] Add a standalone job, for T415230

2026-01-20

2026-01-17

2026-01-16

  • 16:33 dancy: Deleting deployment-mx03.deployment-prep (T412975)

2026-01-15

  • 14:50 James_F: jforrester@doc1004:~$ sudo -u doc-uploader rm -rf /srv/doc/cover-extensions/ArticleSummaries/ # T413232

2026-01-14

2026-01-13

  • 15:04 James_F: Zuul: Make quibble-for-mediawiki-core-vendor-mysql-php84 voting, for T386108

2026-01-12

  • 21:33 zabe: zabe@deployment-mwmaint03:~$ foreachwiki migrateLinksTable.php --table imagelinks # T413668
  • 21:06 bd808: Unblock 66.81.168.0/21 (T414303)
  • 17:42 dancy: Turned off instance deployment-prep.deployment-mx03
  • 11:44 Lucas_WMDE: ssh integration-castor05.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node20 # fix failure seen in mediawiki-node20 46331, 46344

2026-01-10

2026-01-09

  • 17:33 thcipriani: re-enabling beta update jobs after test bad extension-list T411516
  • 17:09 thcipriani: disabling beta update jobs to test bad extension-list T411516)

2026-01-08

2026-01-07

2026-01-06

2026-01-05

  • 23:57 bd808: Unblock 185.233.104.0/22 (T413472)
  • 23:51 bd808: Unblock 45.62.112.0/21 (T413079)
  • 23:44 bd808: Unblock 85.134.200.0/21 (T413067)
  • 19:03 dancy: Updated buildkitd to v0.26.3 in gitlab-cloud-runners
  • 14:27 taavi: reload zuul for 1223191
  • 13:57 James_F: Zuul: [mediawiki/php/wmerrors] Enable PHP 8.5 testing, for T410921

2026-01-03

2026-01-02

2026-01-01

Server Admin Log logged from #wikimedia-relengconnect for Beta Cluster, Continuous integration and various other Release Engineering projects.

Archives