EventLogging/Storage/PurgeData

This page contains historical information. It may be outdated or unreliable.

Read the newest data retention and auto-purging criteria and implementation here:

https://wikitech.wikimedia.org/wiki/Analytics/EventLogging/Data_retention_and_auto-purging

Schemas that can be purged

These are the schemas that can be purged:

Should we move this to wikitech?

[https://docs.google.com/a/wikimedia.org/spreadsheets/d/1RAhDbppfWDQsUXXr7r_5-7GFMgdwqbk28i1Df70Q4oU/edit#gid=0]

Purging mechanism

Sean Pringle scheduled the purging of data via the MariaDB using the Event Scheduler [1]

CREATE TABLE purge_schedule (
 table_name varchar(100) NOT NULL,
 days tinyint(3) unsigned NOT NULL
);

Then for each EL table you would do:

INSERT INTO purge_schedule VALUES ('MultimediaTiming_7193302', 30);