Jump to content

Portal:Data Services/Admin/Dumps

From Wikitech

The clouddumps servers serve dumps to clients running in Cloud VPS and the internet. See also Dumps/Dump servers.

Interfaces

Cloud VPS NFS
Some Cloud VPS instances mount NFS shares from all clouddumps servers. The dumps_dist_active_vps hiera variable controls the symlinks in /public/dumps which clients are meant to use.
Production NFS
Some wikiprod hosts (e.g. stat*) mount dumps as NFS shares. Again these mount both hosts, but confusingly the dumps_dist_active_web hiera variable is used to control the user-facing symlinks.
Web
Clients on the internet can download dumps via the web server, which is accessed via the dumps.wikimedia.org service name (which points to the dumps LVS service).
rsync
Mirrors have rsync access to the dumps shares. They use the dumps-rsync.wikimedia.org service name,[1] which points to the dumps LVS service.

Failover

Web/rsync

The web and rsync servers are load-balanced via LVS and the pool status can be managed via conftool.

NFS

To failover an NFS server to the other node you need to:

  1. Update the dumps_dist_active_vps or dumps_dist_active_web Hiera variable (depending on which server you are failing over)
  2. Wait for a full Puppet cycle or two for most VMs to pick it up

References and footnotes

  1. T415193