This page contains information about dumps and Toolforge
Dumps generated by Wikimedia projects
Toolforge has access to a directory storing the dumps generated by Wikimedia projects: public Wikimedia datasets.
The most recent two dumps can be found in:
This directory is read-only, but you can copy the files to your tool's home directory if necessary. Ideally you can find (or build!) a library that can be used to read data from the dumps without decompressing them. See meta:Data dumps/Other tools for some examples.
- Can be manually downloaded from the Wikimedia downloads server, or from mirrors which may have better bandwidth.
/public/dumps/pagecounts-rawcontains some years of the pagecount/projectcount data.
Dumps in general
- Portal:Data Services#Wikimedia_Dumps
- meta:Data dumps
- Operational runbooks for maintaining the Dumps generation system
Communication and support
We communicate and provide support through several primary channels. Please reach out with questions and to join the conversation.
|Phabricator Workboard||#Cloud-Services||Task tracking and bug reporting|
|IRC Channel||#wikimedia-cloud connect||General discussion and support|
|Mailing List||cloud@||Information about ongoing initiatives, general discussion and support|
|Announcement emails||cloud-announce@||Information about critical changes (all messages mirrored to cloud@)|
|News wiki page||News||Information about major near-term plans|
|Blog||Clouds & Unicorns||Learning more details about some of our work|