Jump to content

Nova Resource:Deployment-prep/Blocked help

From Wikitech

The Beta Cluster websites are protected against various types of abuse by configuration in our Content Delivery Network (CDN) edge. This page describes various ways that your request may have been blocked and what you might be able to do to prevent similar problems in the future.

HTTP 403 Forbidden

Requests from your IP have been blocked

Requests from your IP have been blocked, please see https://wikitech.wikimedia.org/wiki/Beta/Blocked_help for more information.

This error usually means that your IP address is included in a network that has been blocked by the Beta Cluster administrators. The Beta Cluster started receiving large amounts of unwanted bot traffic in early 2025. These bots are aggressively crawling the various Beta Cluster wikis despite the robots.txt for each wiki including instructions not to crawl any pages at all.

If you have found this page and read it, congratulations! you are probably a human and we can try to give you some relief from this problem. We need to know the IP addresses you are trying access the Beta Cluster wikis from and some reason (any reason really) that you are trying to use the wikis. Please use our unblock report template to request that we unblock your IP addresses.

Scripted requests from your IP have been blocked

Scripted requests from your IP have been blocked, please see https://meta.wikimedia.org/wiki/User-Agent_policy. In case of further questions, please see https://wikitech.wikimedia.org/wiki/Beta/Blocked_help for more information.

This error usually means that your bot is not sending a User-Agent header or that it is sending a generic scripting toolkit User-Agent such as "python-requests/xx.yy". See Policy:Wikimedia Foundation User-Agent Policy for advice on sending a more distinctive User-Agent header.

HTTP 429 Too Many Requests

Too Many Requests. Please see https://wikitech.wikimedia.org/wiki/Beta/Blocked_help for more information.

This error usually means that your IP address has sent more requests to our servers in the recent past than we can reasonably process. This may happen because your bot or web browser is operating from behind a shared IP address used by many others and we are unable to tell one client's traffic from another. It may also mean that a script or other workflow you are attempting is just too fast for our servers to handle fairly when mixed with other traffic.

The advice at Robot policy for accessing the Wikimedia project wikis are generally applicable to the Beta Cluster too. For this HTTP 429 case check for a Retry-After header giving you advice about how many seconds to wait before requesting additional pages from our servers.

See also