File:Backing up Wikipedia Databases.pdf

From Wikitech
Go to page
next page →
next page →
next page →

Original file(1,500 × 843 pixels, file size: 3.93 MB, MIME type: application/pdf, 52 pages)

Summary

Slides presented at Percona Live Europe Open Source Database Conference 2019, Amsterdam, 2019-10-01. Authors: Manuel Aróstegui & Jaime Crespo.

<<Imagine a world where all Wikipedia articles disappear due to a human error or software bug. Sounds unreal? According to some estimations, it would take an excess of hundreds of million person-hours to be written again. To prevent that scenario from ever happening, our SRE team at Wikimedia recently refactored the relational database recovery system.

In this session, we will discuss how we backup 550TB of MariaDB data without impacting the 15 billion page views per month we get. We will cover what were our initial plans to replace the old infrastructure, how we achieved recovering 2TB databases in less than 30 minutes while maintaining per-table granularity, as well as the different types of backups we implemented. Lastly, we will talk about lessons learned, what went well, how our original plans changed and future work.>>

More info about Database backups at MariaDB/Backups.

Licensing

w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work).
  • share alike – If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one.

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current10:07, 2 October 2019Thumbnail for version as of 10:07, 2 October 20191,500 × 843, 52 pages (3.93 MB)Jcrespo (talk | contribs)Slides presented at Percona Live Europe Open Source Database Conference 2019, Amsterdam, 2019-10-01. Imagine a world where all Wikipedia articles disappear due to a human error or software bug. Sounds unreal? According to some estimations, it would take an excess of hundreds of million person-hours to be written again. To prevent that scenario from ever happening, our SRE team at Wikimedia recently refactored the relational database recovery system. In this session, we will discuss how we b...

The following file is a duplicate of this file (more details):

The following page uses this file:

Metadata