File:Backing up Wikipedia Databases.pdf
Original file (1,500 × 843 pixels, file size: 3.93 MB, MIME type: application/pdf, 52 pages)
Summary
Slides presented at Percona Live Europe Open Source Database Conference 2019, Amsterdam, 2019-10-01. Authors: Manuel Aróstegui & Jaime Crespo.
<<Imagine a world where all Wikipedia articles disappear due to a human error or software bug. Sounds unreal? According to some estimations, it would take an excess of hundreds of million person-hours to be written again. To prevent that scenario from ever happening, our SRE team at Wikimedia recently refactored the relational database recovery system.
In this session, we will discuss how we backup 550TB of MariaDB data without impacting the 15 billion page views per month we get. We will cover what were our initial plans to replace the old infrastructure, how we achieved recovering 2TB databases in less than 30 minutes while maintaining per-table granularity, as well as the different types of backups we implemented. Lastly, we will talk about lessons learned, what went well, how our original plans changed and future work.>>
More info about Database backups at MariaDB/Backups.
Licensing
This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license. | ||
|
File history
Click on a date/time to view the file as it appeared at that time.
Date/Time | Thumbnail | Dimensions | User | Comment | |
---|---|---|---|---|---|
current | 10:07, 2 October 2019 | 1,500 × 843, 52 pages (3.93 MB) | JCrespo (WMF) (talk | contribs) | Slides presented at Percona Live Europe Open Source Database Conference 2019, Amsterdam, 2019-10-01. Imagine a world where all Wikipedia articles disappear due to a human error or software bug. Sounds unreal? According to some estimations, it would take an excess of hundreds of million person-hours to be written again. To prevent that scenario from ever happening, our SRE team at Wikimedia recently refactored the relational database recovery system. In this session, we will discuss how we b... |
You cannot overwrite this file.
File usage
The following file is a duplicate of this file (more details):
- File:Backing up Wikipedia Databases.pdf from Wikimedia Commons
The following page uses this file: