Analytics/Systems/Cluster/Hardware

From Wikitech
Jump to navigation Jump to search

Information about the Analytics Cluster hardware and infrastructure.


Docs

Hardware Specs

Out of date as of October 2018.

By Host

Type # Hosts Processors Memory Disk
Dell PowerEdge R420 3 analytics1001, analytics1002, analytics1003 16 core Intel(R) Xeon(R) CPU E5-2450 v2 @ 2.50GHz 64G RAM 4 * 2T
Dell PowerEdge R720 12 aqs100{1,2,3},kafka10{12,13,14,18,20,22} 12 core EW-2620 @ 2.00GHz 48G RAM 24T = 12 * 2T
Dell PowerEdge R720 29 analytics1028 - analytics1057 12 core EW-2620 @ 2.00GHz 64G RAM 48T = 12 * 4T, + 2 SSDs

By Machine Type

Type Dell PowerEdge R420 Dell PowerEdge R720 Dell PowerEdge R720
Hosts analytics1001, analytics1002, analytics1003 aqs100{1,2,3},kafka10{12,13,14,18,20,22} analytics1028-analytics1057
Processors 16 core Intel(R) Xeon(R) CPU E5-2450 v2 @ 2.50GHz 12 core EW-2620 @ 2.00GHz 12 core EW-2620 @ 2.00GHz
Memory 64G RAM 48G RAM 64G RAM
Disk 4 * 2T 24T = 12 * 2T 48T = 12 * 4T + 2 SSDs

Roles

Role Host
Hadoop master (primary NameNode) an-master1001
Hadoop standby master (standby NameNode) an-master1002
Cluster coordinator (Hive, Oozie, MySQL, Camus crons, other crons, HDFS balancer) an-coord1001
Hadoop workers (DataNodes) analytics1028–analytics1077
Hue and YARN web interfaces analytics-tool1001
Turnilo analytics-tool1002
Superset analytics-tool1003
Analytics Query Service aqs1004–aqs1009
Analytics Kafka brokers kafka1012–1014, kafka1020–1023

Up to date as of October 2018.