url-downloader

From Wikitech
Jump to navigation Jump to search

url-downloader is a Squid caching proxy for HTTP requests. It was originally created for MediaWiki's upload-by-URL functionality.

Service

See also url_downloader in Puppet.
  • For eqiad: Hosted on urldownloader100[12].wikimedia.org
  • For codfw: Hosted on urldownloader200[12].wikimedia.org

In both datacenters only one url-downloader is active at any time, and is pointed at via the DNS record for url-downloader.$DC.wikimedia.org, and exposed at url-downloader.$DC.wikimedia.org:8080.

url-downloader.wikimedia.org:8080 points to eqiad for backward-compatibility.

See also