CDN/Hardware

From Wikitech
< CDN

This is an overview of our currently deployed and active cache hardware at the Traffic layer.

Hardware classes

We have purchased and retired multiple classes of server hardware over the years in staggered timeframes. In the general case we'll always have multiple overlapping classes of hardware as various warranty and support periods expire. These are the currently-active hardware configuration classes:

Label Model CPU Type/Speed Phys Cores RAM Cache storage NIC speed, type, driver DC Ops Config
F2 Dell R440 2x Xeon Gold 5118 @ 2.3Ghz 24 384 GB 1x Samsung PM1725b 1.6TB NVMe (HHHL Card) 10G, BCM57412, bnxt F-10G, +storage card
F3 Dell R440 2x Xeon Gold 5118 @ 2.3Ghz 24 384 GB 1x Samsung PM1725b 1.6TB NVMe (HHHL Card) 10/25G, BCM57412, bnxt F-10G, +storage card, +10/25G NIC variant
F4S Dell R450 2x Xeon Gold 5318Y @ 2.1Ghz 48 512 GB 1x 6.4TB NVMe Card 10/25G, BCM57414, bnxt F (*)
F4D Dell R450 2x Xeon Gold 5318Y @ 2.1Ghz 48 512 GB 2x 6.4TB NVMe Card 10/25G, BCM57414, bnxt F (*)
  • F4: The new DC Ops Config F from mid-2022 is exclusive to these edge cache roles, and thus our F4 config using it includes the storage cards and NIC upgrades as part of its base definition.
  • F4S configs are being phased out early by upgrading them to F4D by adding the extra storage card. They should all be F4D well before we get to the next refresh of drmrs, at which point we'll probably just go back to calling them all F4.

Deployed hardware

Currently deployed hardware by data center and caching cluster.

Current as of March 2024
Data center cache_text cache_upload total Next refresh (~5y out, CY)
eqiad 8x F4D 8x F4D 16x F4D Q4 2028
codfw 8x F2 8x F2 16x F2 Q1 2025
esams 8x F4D 8x F4D 16x F4D Q3 2028
ulsfo 8x F4S 8x F4D 16x F4x Q4 2027
eqsin 8x F4S 8x F4D 16x F4x Q4 2027
drmrs 8x F3 8x F3 16x F3 Q4 2026
magru 8x F4D 8x F4D 16x F4D Q2 2029
Totals 56 56 112