Search Platform/Weekly Updates/2025-10-10
Appearance
Highlights
- Managed to guide the RDF Streaming Updater (flink stream processor for Wikidata updates) through a k8s cluster update without getting stuck in an non-restorable state
- Added ability to route users to different completion indices for A/B testing
Shipped: did we release anything this week?
- T404605 Plan flink-app recovery process (upcoming wikikube eqiad upgrade) (Resolved)
- T390268 Add the ability to A/B test features of the Cirrus CompletionSuggester built at index time (Resolved)
Blockers: does this essential workstream have any unresolved blockers or dependencies? is anything preventing us from doing our work?
N/A
Lessons learned: Did we learn anything in the course of doing this work that can be applied to other work?
While working on an a search profile to embrace human error in search queries T343148, focus was on improving the retrieval query that feeds the ML-Ranker (click-relevance+) using neural networks. That worked to some extend, but the results are still bad. We might also look into dropping unimportant tokens/entities/words instead of ORing everything (which creates massive recall).
Community collab: Did we do anything in this essential workstream this week in collaboration with the community or because the community asked us to?
N/A