Search Platform/Weekly Updates/2025-05-09
Highlights
Shipped: did we release anything this week?
As part of the migration from Elasticsearch to OpenSearch, our codfw cluster is fully migrated.
Blockers: does this essential workstream have any unresolved blockers or dependencies? is anything preventing us from doing our work?
- N/A
Lessons learned: Did we learn anything in the course of doing this work that can be applied to other work?
- We had an incident as part of the migration from Elasticsearch to OpenSearch, where completion search (type ahead search) was broken for a short period of time. Full analysis and incident report will follow.
Community collab: Did we do anything in this essential workstream this week in collaboration with the community or because the community asked us to?
A few language analysis improvements at the request of our communities:
- Search term entered without diacritics on Czech Wikipedia does not list expected match - https://phabricator.wikimedia.org/T293398
- At Vietnamese wikis, Special:Search should not redirect based on case-folding - https://phabricator.wikimedia.org/T78485 (This was fixed as part of our work on ICU folding - https://phabricator.wikimedia.org/T332342)
What else was accomplished in this essential workstream this week?
Elasticsearch -> OpenSearch migration
- Build updated opensearch-madvise .deb and update puppet with new cli argument - https://phabricator.wikimedia.org/T390592
- Update opensearch-madvise to take a path argument - https://phabricator.wikimedia.org/T390118
- Build and deploy updated opensearch plugins deb - https://phabricator.wikimedia.org/T390100
Analyze fulltext search abandonment
- Classify fulltext search abandonment: English, French, Spanish - https://phabricator.wikimedia.org/T375554
Language improvements
- Search term entered without diacritics on Czech Wikipedia does not list expected match - https://phabricator.wikimedia.org/T293398
- At Vietnamese wikis, Special:Search should not redirect based on case-folding - https://phabricator.wikimedia.org/T78485 (This was fixed as part of our work on ICU folding - https://phabricator.wikimedia.org/T332342)
Misc / Operations
- Many pages do not appear in typeahead search results (autocomplete / search suggestions) - https://phabricator.wikimedia.org/T393663
- Refactor the HivePartition logic from mjolnir to discolytics. - https://phabricator.wikimedia.org/T390061
- Production Error: TypeError: array_flip(): Argument #1 ($array) must be of type array, null given - https://phabricator.wikimedia.org/T391090