This is an overview of our currently deployed and active cache hardware at the Traffic layer.
Deployed Hardware Classes
We have purchased and retired multiple classes of server hardware over the years in staggered timeframes. In the general case we'll always have multiple overlapping classes of hardware as various warranty and support periods expire. These are the currently-active hardware configuration classes:
| Label |
Model |
CPU Type/Speed |
Phys Cores |
RAM |
Cache Storage |
NIC speed, type, driver |
DC Ops Config
|
| L |
Dell R430 |
2x Xeon E5-2650 v4 @ 2.20GHz |
24 |
384 GB |
2x Intel S3710 800GB SSD |
10G, BCM57810, bnx2x |
Legacy
|
| F |
Dell R440 |
2x Xeon Gold 5118 @ 2.3Ghz |
24 |
384 GB |
1x Samsung PM1725b 1.6TB NVMe (HHHL Card) |
10G, BCM57412, bnxt |
F-10G, add custom Cache Storage card
|
Note: The first batch of F-config hosts (all 16 in eqiad) had a slightly different Cache Storage config: "1x Samsung PM1725a 1.6TB NVMe (U.2 SFF)"
Deployed Server Hardware by Datacenter and Cluster
| Datacenter |
text |
upload |
total
|
| eqiad |
8xF |
8xF |
16xF
|
| codfw |
8xF |
8xF |
16xF
|
| esams |
8xF |
8xF |
16xF
|
| ulsfo |
6xL |
6xL |
12xL
|
| eqsin |
6xL + 2xF |
6xL + 2xF |
12xL + 4xF = 16
|
| total |
12xL + 26xF = 38 |
12xL + 26xF = 38 |
24xL + 52xF = 76
|
Known upcoming changes
- drmrs - New site being built out in Marseille, to come online in late 2021. 16xF, but with bnxt NICs upgraded to 25G models
- ulsfo - Being expanded with 4xF in late 2021 to increase capacity/redundancy, just like we did earlier with eqsin