Test Kitchen/List of active and archived experiments
This page provides a public list of planned, active, and archived experiments on Test Kitchen, including contact information (Phabricator and email) for the teams that are running the tests. While this system isn't automated, we aim to make it so in the future.
Instructions for all tables:
- Add new entries at the top.
- Use FY##/## notation for fiscal year. For example: Fiscal Year 2025–2026 would be FY25/26.
- If you have documented a decision about a feature on the feature's project page, a brief summary (e.g. "Release to all users") and a link to the project page (in the Details column) are sufficient.
Proposed experiments
| OKR | Experiment name | Experiment owner | Phabricator |
|---|---|---|---|
| FY25/26 WE 3.1.6 | MinT for Wikireaders | WMF Language and Product Localization
pginer@wikimedia.org |
T359072 |
| FY25/26 WE2 | Article Creation | pginer@wikimedia.org | |
| FY25/26 WE1 | Revise Tone Newcomer | Growth Team - sgimenez@wikimedia.org |
Active experiments
Or very soon to be active:
| OKR | Experiment name | Experiment owner | Phabricator | Details (links OK) |
|---|---|---|---|---|
| FY2025-26 WE4.2 | hCaptcha Editing A/B Test | WMF Product Security and Integrity
kharlan@wikimedia.org |
T405586 | |
| FY2025-26 WE3.3.4 | Reading Lists | WMF Reader Experiences
stoyofuku@wikimedia.org |
T397532 | |
| FY2025-26 WE4.2.7 | hCaptcha A/B Test | WMF Product Safety and Integrity
emill@wikimedia.org |
T405239 | |
| FY2025-26 WE4.2.7 | hCaptcha Editing A/B Test | WMF Product Safety and Integrity
kharlan@wikimedia.org |
T405586 | |
| FY2025-26 WE3.1 | Image Browsing | WMF Reader Growth
mfossati@wikimedia.org |
T403034 |
|
Completed experiments
wmf/nda LDAP groups. Results require membership in analytics-privatedata-users POSIX group to view. Learn more about data access.
If an experiment has concluded but no decision has been made yet based on the obtained results, use "Pending" in the Summary of decision column:
| OKR | Experiment name | Experiment owner | Phabricator | Details (links OK) | Summary of decision |
|---|---|---|---|---|---|
| FY2025-26 SDS2.1.6 | Levelling Up Notifications | WMF Growth Team
sgimeno@wikimedia.org |
T400047 | ||
| FY25/26 WE 3.1.6 | MinT for Wikireaders A/A Test | WMF Language and Product Localization
kcvelaga@wikimedia.org |
T359072 | ||
| FY24/25 WE 1.7.2 | RC/Watchlists Grouping Toggle | WMF Moderator Tools
kgraessle@wikimedia.org |
T396789 | ||
| FY25/26 WE 3.2.3 | Donate Button A/B Test | WMF Reader Experience
stoyofuku@wikimedia.org |
T395716 | ||
| FY25/26 WE 3.6.1 | Reader Retention Baseline | WMF Reader Growth
ksarabia@wikimedia.org |
T399227 | (WMF Internal) Logged-Out Reader Retention: Metric Definitions and Baseline Data Collection | |
| FY25/26 SDS 2.1.1 | Synthetic A/A logged-in test (JS SDK) | WMF Experiment Platform
phuedx@wikimedia.org |
T397140 | System is OK to use for A/B tests on logged-in users | |
| Essential Work | Logged-in Synthetic A/A Test (PHP SDK) | WMF Experiment Platform
phuedx@wikimedia.org |
T397143 | System is OK to use for A/B tests on logged-in users | |
| FY24/25 SDS 2.4 | Synthetic A/A Test 2 | WMF Experiment Platform
phuedx@wikimedia.org |
T397138 | System is OK to use for A/B tests | |
| FY24/25 SDS 2.4 | SDS 2.4.11 Synthetic A/A Test | WMF Experiment Platform
phuedx@wikimedia.org |
T392313 | System is OK to use for A/B tests, after T396474 is resolved |