Incidents/2021-03-14 MediaWiki API

From Wikitech
Jump to navigation Jump to search

document status: final


On March 14 2021 the MediaWiki API were overloaded and ran out of php-fpm processes. This caused an API outage on all API servers from 17:00 to 17:26 UTC. The root cause of the outage were queries against commons that caused database s4 on server db1144 to be overloaded. Db1144 also serves queries to contributions, recentchanges, watchlist and other MediaWiki features. Task: T277417

Processlist on db1144

The queries against commons were analyzed for inefficiencies but seem to be well written and optimized SQL. See task: T277416


  • Improve traceability of commons queries: T193050 (filed in 2018)