Portal:Toolforge/Ongoing Efforts/Toolforge Workgroup/Reports
Toolforge Workgroup
Reports
Reports include both decision records and progress reports on the implementation of Toolforge and related projects. These reports are intended to keep team members and interested community members updated on progress of the project.
For a log of new user-facing features and fixes, you can check the Portal:Toolforge/Changelog instead.
Decision records
Ongoing
Decided
- Decision Request: To strictly enforce semantic versioning rules for toolforge services' APIs or not - Decided on 2024-09-26
- Decision request - What to use for toolforge components api task execution - Decided on 2024-07-11
- Decision request - kubernetes upgrade workgroup - Decided on 2024-06-06
- Decision request - Toolforge policy agent enforcement model - Decided on 2024-05-14
- Decision request - Toolforge policy agent - Decided on 2024-04-30
- Decision request - Update python team best practices - Decided on 2024-04-18
- Decision request – Toolforge CLI consolidation - Decided on 2024-01-30
- Decision request – Toolforge (re)architecture - Decided on 2023-10-11
- Decision request - How to allow installing system libraries on buildpack-based images - Decided on 2023-06-08
- Decision request - Find a standard place for all the toolforge-related config files - Decided on 2023-05-26
- Decision request - Toolforge envvars/secrets service - Decided on 2023-05-26
- Decision request - What buildpacks to allow and include for toolforge build service beta - Decided on 2023-03-10
- Decision request - Choose a lang for the toolforge build service API - Decided on 2023-02-23
- Decision request - Toolforge build service to move to an API design - Decided on 2023-02-06
- Pre-create harbor namespaces - Decided on 2022-12-15
- How to manage quotas in Toolforge Build Service - Decided on 2022-05-04
Progress reports
Read the latest sync meeting notes.
Previous years meeting notes (read-only).
2024
- 2024-09-24: Upgrade to k8s 1.27 done \o/, focusing on two workflows, getting webservice migrated to the jobs API, and getting the components-api bootstrapped.
- 2024-07-16: Upgrade to k8s 1.25 finished \o/, focus on the last changes to the API paths before declaring it stable for users (sometime next week).
- 2024-06-04: Maintain-kubeusers refactor has been deployed unblocking the creation of kyverno policies, continue with the API auth investigation and the api consolidation, jobs have
--port
support now, so we can continue with the effort to move webservices to jobs-api, and we have our first functional tests. - 2024-05-22: Continue with the API auth investigation, the api consolidation, move of webservices to jobs-api, and migration from PSP to kyverno policies.
- 2024-04-20: Start on the toolforge API auth scheme definition to unblocks the
compontents api
and continue working on the upgrade to kubernetes 1.24. - 2024-04-16: Focus on enabling users to use the API, and start working on the first
components-api
tasks. - 2024-04-03: Keep focusing on the grid-migration issues (few left), and enabling users to use the APIs (api consolidation), upgrades to k8s went well, keep working on
jobs-api
refactor to add webservice and unblock the consolidated API, and refinement forcomponents
api. Keep an eye on what prod does to move from PSPs so we can reuse (task T279110). - 2024-03-19: The grid has been turned off (yay!), focus on cleanup + user requests, all the phab subprojects have been merged, focus on
jobs-api
refactor to add webservice, and refinement forcomponents
api. Start thinking on a session for the upcoming hackathon. - 2024-02-20: Merge all the phabricator subprojects into the general toolforge for ease of management/visibility, keep focusing on helping/unblocking users moving out of the grid, start refining user stories for orchestration API and unified API, migration to bullseye+containerd almost done, starting to plan upgrade to k8s v1.24 (should be simple).
- 2024-02-06: Decided to start defining the details for the 2024 user stories, and continue focusing on supporting people migrating from the grid.
- 2024-01-23: Continue focus on grid migration, last review of the 2024 toolforge user stories and high view (working doc), investigate how to expose a unified OpenAPI definition (task T354745), and start working on the details for the next quarter tasks (working doc).
- 2024-01-09: Focusing on support for tools migrating off-grid, starting to define the next steps for toolforge with a focus on push to deploy (see this).
2023
- 2023-10-10: Beta is almost there, keep on working on stats and operationalization, and start thinking on the action plan for the toolforge (re)architecture decision request.
- 2023-09-26: Focus on getting statistics from the APIs, and fixing the local development environment
- 2023-09-13: Focus on the beta rollout, improve user experience and add metrics to the services
- 2023-08-29: Focus on the second beta rollout, database credentials on envvars and harbor stability
- 2023-08-08: Focus on getting the database credentials on the envvars service to do the second beta rollout
2022
- 2022-09-27: We started working on the Toolforge Build Service [beta] project!
Communication and support
Support and administration of the WMCS resources is provided by the Wikimedia Foundation Cloud Services team and Wikimedia movement volunteers. Please reach out with questions and join the conversation:
- Chat in real time in the IRC channel #wikimedia-cloud connect or the bridged Telegram group
- Discuss via email after you have subscribed to the cloud@ mailing list
- Subscribe to the cloud-announce@ mailing list (all messages are also mirrored to the cloud@ list)
- Read the News wiki page
Use a subproject of the #Cloud-Services Phabricator project to track confirmed bug reports and feature requests about the Cloud Services infrastructure itself
Read the Cloud Services Blog (for the broader Wikimedia movement, see the Wikimedia Technical Blog)