From Wikitech
Jump to navigation Jump to search

Data Requests

The job of the Analytics team is to provide infrastructure and services so you can put/get your statistics into a system via a fairly simple code snippet. We are an infrastructure team that provides analytics infrastructure. Please have in mind that the analytics team does not provide teams with numbers to measure their KPIs against. We will support your data access request, grant access to our systems if it pertains and help you as needed be. You can find us on IRC on #wikimedia-analytics.

Please see the Research FAQ on Meta to understand who at WMF owns research-related processes and resources, and on where to find data or statistics about a specific Product Audience (such as editors or readers).

How do I transfer files between stat boxes?

There is an rsync server set up on stat boxes that allow for writes in the /srv directories. So:

stat1005$ rsync -av /path/to/files/ stat1006.eqiad.wmnet::srv/path/to/files/

Note the special '::srv’ on the destination. :: indicates an rsync module name. In this case, ::a works exactly the same.

How do I transfer public files from stat boxes to labs?

NOTE: This is not working yet.

You probably want to take a new dataset that should be public and put it in some cool GUI in labs where it is easier to show off. An rsync module has been set up on a host (labstore1003). You may push files here via rsync, and then mount an NFS directory on your labs host:

# Copy files to labstore1003 from a production stat* box
stat1005$ rsync -av --delete /home/$USER/my_dataset labstore1003.eqiad.wmnet::statistics/$USER/my_dataset

If your labs project instances don't already have /public/statistics mounted, then you will need to make a commit to the operations/puppet repository in modules/labstore/files/nfs-mounts.yaml to enable this.