Portal:Data Services/Admin/Dumps

From Wikitech

The clouddumps servers serve dumps clients to Cloud VPS and the internet.

Interfaces

Cloud VPS NFS
Some Cloud VPS instances mount NFS shares from all clouddumps servers. The dumps_dist_active_vps hiera variable controls the symlinks in /public/dumps which clients are meant to use.
Production NFS
Some wikiprod hosts (e.g. stat*) mount dumps as NFS shares. Again these mount both hosts, but confusingly the dumps_dist_active_web hiera variable is used to control the user-facing symlinks.
Web
Clients on the internet can download dumps via the web server, which is accessed via the dumps.wikimedia.org service name. The dumps_dist_active_web and profile::dumps::distribution::web::is_primary_server hiera variables need to match the main DNS entry.
rsync
Mirrors have rsync access to the dumps shares. They use the dumps.wikimedia.org service name.

Failover

Web/rsync

To failover the web/rsync server to the other node you need to:

  1. Update the dumps.wikimedia.org CNAME to point to the other server
  2. Update Hiera data:
    • Update dumps_dist_active_web Hiera variable to point to the other server
    • Update profile::dumps::distribution::web::is_primary_server to false on the old server and to true on the new one
  3. Wait for DNS TTL to expire (which should be longer than a full Puppet cycle)

Cloud VPS NFS

To failover the Cloud VPS NFS server to the other node you need to:

  1. Update the dumps_dist_active_vps Hiera variable
  2. Wait for a full Puppet cycle or two for most VMs to pick it up