Analytics/Systems/Cluster/Mysql Meta
Jump to navigation
Jump to search
The Analytics Mysql Meta instance is a Mariadb database currently running on the Analytics Hadoop coordinator host (an-coord1001), that hosts some low volume db schemas related to Hadoop tools like Hive, Oozie, Druid, etc..
Databases
MariaDB [(none)]> show databases;
+-----------------------------------+
| Database |
+-----------------------------------+
| druid |
| druid_public_eqiad |
| hive_metastore |
| hue |
| oozie |
| superset_production |
| superset_staging |
+-----------------------------------+
Dependent services
The Mariadb instance collects metadata about the following systems:
- Both Druid clusters (Analytics/Systems/Druid)
- Superset staging and live hosts (Analytics/Systems/Superset)
- Hue (Analytics/Cluster/Hue)
- Oozie (Analytics/Systems/Cluster/Oozie)
- Hive Server2 and Metastore (Analytics/Systems/Cluster/Hive)
Backup
All the databases are periodically backed up in /srv/backup/mysql/analytics-meta on the Analytics Hadoop Master Standby (an-master1002). Daily snapshots are backed up into HDFS at /wmf/data/archive/backup/mysql/analytics-meta/.
