storage2

From Wikitech
storage2
Location: pmtpa
Status
Overall:
This device has been decommissioned.
Icinga?: host status services status
Hardware
Memory: 16 GBytes
CPU: 2 x AMD Opteron(tm) Processor 248
Software

storage2 is a 16 GB box with a 3ware 9550SX-16ML storage controller, and 16 500 GB SATA drives.

As of March 18, 2008, it is serving our publicly available data sets as download.wikimedia.org.

As of July 24, 2009, it has had three drives replaced due to a degraded state and the filesystem had to be rebuilt.

These include

Services

Daemons:

Jobs:

  • AWstats to track the downloads of our clients
    • standard ubuntu install with config files in /etc/awstats/awstats.conf
    • runs every 12 hours through cron

Bonnie results

A single JBOD drive, JFS: 

Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
storage1     32072M 48674  83 52395   7 23678   3 47038  80 63308   5 182.6   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  2648   5 +++++ +++  3107   7  1740  10 +++++ +++  1117   4
storage1,32072M,48674,83,52395,7,23678,3,47038,80,63308,5,182.6,0,16,2648,5,+++++,+++,3107,7,1740,10,+++++,+++,1117,4

A single RAID-10 array over 16 disks on one controller, LVM, JFS: 

Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
storage2     32072M 56214  96 134296  20 46691   7 50508  86 265700  26 620.6   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 10795  26 +++++ +++ 11982  27  4039  26 +++++ +++  6044  28
storage2,32072M,56214,96,134296,20,46691,7,50508,86,265700,26,620.6,0,16,10795,26,+++++,+++,11982,27,4039,26,+++++,+++,6044,28

A single RAID-10 array over 16 disks on one controller, LVM, JFS, 3ware performance profile: 

Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
storage2     32072M 57131  98 238231  37 51066   7 50014  86 236461  22 634.3   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  4813  11 +++++ +++ 21782  46  7894  52 +++++ +++  5674  25
storage2,32072M,57131,98,238231,37,51066,7,50014,86,236461,22,634.3,0,16,4813,11,+++++,+++,21782,46,7894,52,+++++,+++,5674,25

A single RAID-10 array over 16 disks on one controller, LVM, JFS, 3ware performance profile, NCQ enabled: 

Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
storage2     32072M 57366  98 239127  35 52581   8 48502  82 262786  24 422.3   0
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16  4597  10 +++++ +++ 22378  51  6972  51 +++++ +++  5488  28
storage2,32072M,57366,98,239127,35,52581,8,48502,82,262786,24,422.3,0,16,4597,10,+++++,+++,22378,51,6972,51,+++++,+++,5488,28

A single RAID-10 array over 16 disks on one controller, LVM, Reiserfs, 3ware performance profile, NCQ enabled: 

Version  1.03       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
storage2     32072M           299268  93 62118  15           185330  25 580.9   1
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16 27900  98 +++++ +++ 23333  99 26874 100 +++++ +++ 21485  99
storage2,32072M,,,299268,93,62118,15,,,185330,25,580.9,1,16,27900,98,+++++,+++,23333,99,26874,100,+++++,+++,21485,99

External links

Retrieved from "https://wikitech.wikimedia.org/w/index.php?title=Storage2&oldid=1990217"