User:Elukey/Analytics/AQS Tasks

This page should contain tutorials for small tasks related to the AQS cluster.

Restbase code that conflicts in aqs100[456]

Code on branch: https://gerrit.wikimedia.org/r/#/c/309602/4

The new aqs cluster, aqs100[456], does not use DTCS for compaction so a manual code removal is needed to prevent inconsistencies/errors. This is the end result:

elukey@aqs1004:$ cd /srv/deployment/analytics/aqs/deploy/src
elukey@aqs1004:/srv/deployment/analytics/aqs/deploy/src$ git diff HEAD
diff --git a/sys/pageviews.js b/sys/pageviews.js
index 990e135..5826e6a 100644
--- a/sys/pageviews.js
+++ b/sys/pageviews.js
@@ -48,11 +48,6 @@ var tableSchemas = {
             { attribute: 'granularity', type: 'hash' },
             { attribute: 'timestamp', type: 'range', order: 'asc' },
         ],
-        options: {
-            updates: {
-                pattern: 'timeseries'
-            }
-        }
     },
     project: {
         table: tables.project,

Loading one month of data from oozie

https://etherpad.wikimedia.org/p/backfilling_aqs

Insert test data

Execute /srv/deployment/analytics/aqs/deploy/scripts/insert_monitoring_fake_data.cql

Create aqsloader user

CREATE USER IF NOT EXISTS aqsloader WITH PASSWORD '$password_in_here';

GRANT SELECT ON ALL KEYSPACES TO 'aqsloader';
GRANT MODIFY ON ALL KEYSPACES TO 'aqsloader';

And then on one aqs host:

cqlsh -u cassandra -f ./adduser.cql aqs1004-b.eqiad.wmnet
..
..