Portal:Toolforge/Admin/Runbooks/ToolforgeWebConnectionLimit
The procedures in this runbook require admin permissions to complete.
The ToolforgeWebConnectionLimit alert fires when the Toolforge web HAProxy hits the configured limit for the maximum number of requests it can handle.
Debugging
The ToolforgeWebHighErrorRate runbook is a good place to start, as that alert is very closely related. The alert links to the HAProxy Grafana dashboard with the correct server already selected.
Common issues
Traffic increases
Previously the limit used to be reached during particularly high amounts of (scraper) traffic, but since then the limits have been raised so that should no longer be possible; thus it is very likely that the limit being reached is a sign of some wider infrastructure issue.