Obsolete:Virt node upgrade schedule
This page contains historical information. It may be outdated or unreliable.
In order to address kernel bugs, each Labs virtualization host requires rebooting over the coming weeks. Here is the schedule, along with the affected instances. Note that affected instance lists are as of August 10th; any instances created after August 10th will be allocated amongst these hosts at the whim of the instance scheduler.
When a virt host is rebooted, all hosted VMs will power off. Downtime will vary per instance, but should not exceed 40 minutes.
Wednesday, 2015-08-12, 15:00 UTC: Labvirt1001 reboot
Rebooter: Andrew Bogott
Done
Affected Instances
| citoidtest | ACTIVE | - | Running | public=10.68.16.182 | | conf | ACTIVE | - | Running | public=10.68.18.87, 208.80.155.233 | | deployment-bastion | ACTIVE | - | Running | public=10.68.16.58, 208.80.155.191 | | deployment-cache-text02 | ACTIVE | - | Running | public=10.68.16.16 | | deployment-elastic08 | ACTIVE | - | Running | public=10.68.17.188 | | deployment-memc03 | ACTIVE | - | Running | public=10.68.16.15 | | deployment-parsoid05 | ACTIVE | - | Running | public=10.68.16.120 | | deployment-pdf01 | ACTIVE | - | Running | public=10.68.16.73 | | deployment-restbase01 | ACTIVE | - | Running | public=10.68.17.227 | | deployment-salt | ACTIVE | - | Running | public=10.68.16.99 | | deployment-urldownloader | ACTIVE | - | Running | public=10.68.16.135 | | diffengine | ACTIVE | - | Running | public=10.68.17.127 | | educationdashboard-i18n | SHUTOFF | - | Shutdown | public=10.68.16.235 | | ee-flow-extra | ACTIVE | - | Running | public=10.68.16.102 | | etcd01 | ACTIVE | - | Running | public=10.68.16.130 | | etcd03 | ACTIVE | - | Running | public=10.68.16.132 | | firstinstance | SHUTOFF | - | NOSTATE | public=10.68.16.212 | | graphite-trusty | ACTIVE | - | Running | public=10.68.17.181 | | huggle-d2 | ACTIVE | - | Running | public=10.68.17.194 | | icinga | ACTIVE | - | Running | public=10.68.16.195 | | integration-raita | ACTIVE | - | Running | public=10.68.16.53 | | integration-slave-trusty-1013 | ACTIVE | - | Running | public=10.68.18.28 | | integration-slave-trusty-1015 | ACTIVE | - | Running | public=10.68.18.30 | | k8s-worker-02 | ACTIVE | - | Running | public=10.68.18.91 | | kartotherian1 | ACTIVE | - | Running | public=10.68.16.117 | | language-replag-slave | SHUTOFF | - | Shutdown | public=10.68.16.248 | | maps-tiles2 | ACTIVE | - | Running | public=10.68.17.110 | | mobile-browser-tests | ACTIVE | - | Running | public=10.68.16.149 | | mwreview-proxy-test | ACTIVE | - | Running | public=10.68.16.83 | | osmit-cruncher1 | ACTIVE | - | Running | public=10.68.17.92 | | puppet-jmm-debdeploy-precise | ACTIVE | - | Running | public=10.68.18.106 | | puppet-mailman | ACTIVE | - | Running | public=10.68.17.177 | | sentry-builder | ACTIVE | - | Running | public=10.68.18.82 | | staging-eventlogging | ACTIVE | - | Running | public=10.68.16.199 | | staging-ms-be03 | ACTIVE | - | Running | public=10.68.17.249 | | staging-rdb01 | ACTIVE | - | Running | public=10.68.17.193 | | staging-tin | ACTIVE | - | Running | public=10.68.16.110 | | stashbot-logstash | ACTIVE | - | Running | public=10.68.18.101 | | tools-bastion-02 | ACTIVE | - | Running | public=10.68.16.44, 208.80.155.132 | | tools-exec-1201 | ACTIVE | - | Running | public=10.68.17.49, 208.80.155.203 | | tools-exec-1202 | ACTIVE | - | Running | public=10.68.16.57, 208.80.155.211 | | tools-exec-1204 | ACTIVE | - | Running | public=10.68.17.88, 208.80.155.213 | | tools-exec-1206 | ACTIVE | - | Running | public=10.68.17.105, 208.80.155.215 | | tools-exec-1209 | ACTIVE | - | Running | public=10.68.17.129, 208.80.155.218 | | tools-exec-1213 | ACTIVE | - | Running | public=10.68.17.252, 208.80.155.222 | | tools-exec-1217 | ACTIVE | - | Running | public=10.68.18.20, 208.80.155.226 | | tools-exec-1218 | ACTIVE | - | Running | public=10.68.18.19, 208.80.155.227 | | tools-exec-1408 | ACTIVE | - | Running | public=10.68.18.14, 208.80.155.152 | | tools-exec-cyberbot | ACTIVE | - | Running | public=10.68.16.39 | | tools-webgrid-generic-1404 | ACTIVE | - | Running | public=10.68.18.53 | | tools-webgrid-lighttpd-1409 | ACTIVE | - | Running | public=10.68.18.43 | | tools-webgrid-lighttpd-1410 | ACTIVE | - | Running | public=10.68.18.44 | | toolsbeta-exec-101 | ACTIVE | - | Running | public=10.68.16.7 | | toolsbeta-exec-201 | ACTIVE | - | Running | public=10.68.16.250 | | wikidata-mobile | ACTIVE | - | Running | public=10.68.18.41 | | wikispy | ACTIVE | - | Running | public=10.68.17.119 | | wlmjurytool2014 | ACTIVE | - | Running | public=10.68.17.134 | | wmt-exec | ACTIVE | - | Running | public=10.68.17.236 |
Thursday, 2015-08-13, 15:00 UTC: Labvirt1002 reboot
Rebooter: Andrew Bogott Done
Affected Instances
| accounts-application3 | ACTIVE | - | Running | public=10.68.17.95 | | agent3 | ACTIVE | - | Running | public=10.68.18.62, 208.80.155.231 | | appservice | ACTIVE | - | Running | public=10.68.17.120 | | compiler | ACTIVE | - | Running | public=10.68.17.214 | | contactpage-test | ACTIVE | - | Running | public=10.68.17.8 | | cvn-apache8 | ACTIVE | - | Running | public=10.68.17.35 | | dan-druid | ACTIVE | - | Running | public=10.68.16.163 | | deployment-cache-bits01 | ACTIVE | - | Running | public=10.68.16.12 | | deployment-cache-upload02 | ACTIVE | - | Running | public=10.68.17.51 | | deployment-cache-upload04 | ACTIVE | - | Running | public=10.68.18.109, 208.80.155.136 | | deployment-db1 | ACTIVE | - | Running | public=10.68.16.193 | | deployment-elastic06 | ACTIVE | - | Running | public=10.68.17.186 | | deployment-eventlogging02 | ACTIVE | - | Running | public=10.68.16.52 | | deployment-kafka02 | ACTIVE | - | Running | public=10.68.17.156 | | deployment-mathoid | ACTIVE | - | Running | public=10.68.17.222 | | deployment-mediawiki03 | ACTIVE | - | Running | public=10.68.17.55 | | deployment-memc04 | ACTIVE | - | Running | public=10.68.17.69 | | deployment-pdf02 | ACTIVE | - | Running | public=10.68.16.129 | | deployment-sca01 | ACTIVE | - | Running | public=10.68.17.54 | | deployment-videoscaler01 | ACTIVE | - | Running | public=10.68.16.211 | | educationdashboard2 | SHUTOFF | - | Shutdown | public=10.68.17.162 | | ee-jenkins-test | ACTIVE | - | Running | public=10.68.16.122 | | elasticsearch-tests | ACTIVE | - | Running | public=10.68.17.0 | | flow1 | SHUTOFF | - | Shutdown | public=10.68.17.46 | | graphtest | ACTIVE | - | Running | public=10.68.17.175 | | integration-dev | ACTIVE | - | Running | public=10.68.16.227 | | integration-puppetmaster | ACTIVE | - | Running | public=10.68.16.42 | | integration-saltmaster | ACTIVE | - | Running | public=10.68.18.24 | | integration-slave-trusty-1016 | ACTIVE | - | Running | public=10.68.18.34 | | labs-bootstrapvz-jessie | ACTIVE | - | Running | public=10.68.16.107 | | labs-vmbuilder-lucid | SHUTOFF | - | Shutdown | public=10.68.16.119 | | labs-vmbuilder-trusty | ACTIVE | - | Running | public=10.68.17.100, 208.80.155.165 | | language-replag-wiki | ACTIVE | - | Running | public=10.68.16.249 | | mailman-three | ACTIVE | - | Running | public=10.68.16.32, 208.80.155.230 | | maps-tiles3 | ACTIVE | - | Running | public=10.68.16.103 | | math | ACTIVE | - | Running | public=10.68.17.118 | | megachron-three | ACTIVE | - | Running | public=10.68.16.50, 208.80.155.150 | | metamorphosis-kafka-01 | ACTIVE | - | Running | public=10.68.17.220 | | nginx-dev1 | SHUTOFF | - | Shutdown | public=10.68.16.180 | | osrm | ACTIVE | - | Running | public=10.68.17.185 | | otrs-test2 | ACTIVE | - | Running | public=10.68.16.109 | | phab-02 | ACTIVE | - | Running | public=10.68.17.250 | | sentry-alpha | ACTIVE | - | Running | public=10.68.18.25 | | staging-db01 | ACTIVE | - | Running | public=10.68.17.238 | | staging-elastic03 | ACTIVE | - | Running | public=10.68.17.217 | | staging-mc1 | ACTIVE | - | Running | public=10.68.17.60 | | staging-ms-fe01 | ACTIVE | - | Running | public=10.68.18.0 | | staging-rdb1 | ACTIVE | - | Running | public=10.68.16.234 | | stashbot-deploy | ACTIVE | - | Running | public=10.68.18.92 | | tools-exec-1203 | ACTIVE | - | Running | public=10.68.16.133, 208.80.155.212 | | tools-exec-1210 | ACTIVE | - | Running | public=10.68.17.147, 208.80.155.219 | | tools-exec-1214 | ACTIVE | - | Running | public=10.68.17.253, 208.80.155.223 | | tools-exec-1402 | ACTIVE | - | Running | public=10.68.17.205, 208.80.155.141 | | tools-exec-1405 | ACTIVE | - | Running | public=10.68.18.3, 208.80.155.145 | | tools-exec-gift | ACTIVE | - | Running | public=10.68.16.40 | | tools-services-01 | ACTIVE | - | Running | public=10.68.16.29 | | tools-submit | ACTIVE | - | Running | public=10.68.17.1 | | tools-web-static-02 | ACTIVE | - | Running | public=10.68.16.216 | | tools-webgrid-generic-1403 | ACTIVE | - | Running | public=10.68.18.52 | | tools-webgrid-lighttpd-1204 | ACTIVE | - | Running | public=10.68.18.49 | | tools-webgrid-lighttpd-1209 | ACTIVE | - | Running | public=10.68.17.152 | | tools-webgrid-lighttpd-1401 | ACTIVE | - | Running | public=10.68.16.34 | | tools-webgrid-lighttpd-1405 | ACTIVE | - | Running | public=10.68.17.65 | | tools-webgrid-lighttpd-1408 | ACTIVE | - | Running | public=10.68.18.42 | | wikibrain0 | ACTIVE | - | Running | public=10.68.16.60 | | wikitech-test-network | SHUTOFF | - | Shutdown | public=10.68.16.51 | | wt-test-api | SHUTOFF | - | Shutdown | public=10.68.17.16 | | wt-test-compute | SHUTOFF | - | Shutdown | public=10.68.17.18 | | wt-test-controller | SHUTOFF | - | Shutdown | public=10.68.17.19 | | zerotests | ACTIVE | - | Running | public=10.68.16.178 |
Friday, 2015-08-14, 15:00 UTC: Labvirt1003 reboot
Rebooter: Andrew Bogott Done
Affected Instances
| accounts-appserver2 | ACTIVE | - | Running | public=10.68.16.54 | | butterfly-m4m | ACTIVE | - | Running | public=10.68.17.165 | | contributors-metrics | ACTIVE | - | Running | public=10.68.16.141, 208.80.155.168 | | deployment-cxserver03 | ACTIVE | - | Running | public=10.68.16.150 | | deployment-db2 | ACTIVE | - | Running | public=10.68.17.94 | | deployment-mediawiki01 | ACTIVE | - | Running | public=10.68.17.170 | | deployment-mx | ACTIVE | - | Running | public=10.68.17.78, 208.80.155.193 | | deployment-redis01 | ACTIVE | - | Running | public=10.68.16.177 | | deployment-sentry2 | ACTIVE | - | Running | public=10.68.17.204 | | deployment-zookeeper01 | ACTIVE | - | Running | public=10.68.17.157 | | etcd02 | ACTIVE | - | Running | public=10.68.16.131 | | gilded-yak | ACTIVE | - | Running | public=10.68.18.8 | | hadoop-dev-master | ACTIVE | - | Running | public=10.68.18.85 | | huggle-win32 | ACTIVE | - | Running | public=10.68.17.56 | | integration-publisher | ACTIVE | - | Running | public=10.68.16.255 | | integration-slave-trusty-1021 | ACTIVE | - | Running | public=10.68.16.8 | | integration-slave-trusty-1022 | ACTIVE | - | Running | public=10.68.18.67 | | integration-slave-trusty-1023 | ACTIVE | - | Running | public=10.68.18.10 | | integration-zuul-server | ACTIVE | - | Running | public=10.68.17.180 | | kafka20 | ACTIVE | - | Running | public=10.68.16.118 | | kafka21 | ACTIVE | - | Running | public=10.68.17.240 | | labs-vmbuilder-precise | ACTIVE | - | Running | public=10.68.16.115 | | language-dev | ACTIVE | - | Running | public=10.68.16.78 | | language-testlink | ACTIVE | - | Running | public=10.68.16.252 | | maps-warper | ACTIVE | - | Running | public=10.68.17.33 | | mapsslave01 | ACTIVE | - | Running | public=10.68.17.160 | | marathon-master-01 | ACTIVE | - | Running | public=10.68.17.197 | | marathon-slave-02 | ACTIVE | - | Running | public=10.68.18.57 | | master | ACTIVE | - | Running | public=10.68.16.153 | | mobile-hierator4 | ACTIVE | - | Running | public=10.68.18.55 | | officetools | ACTIVE | - | Running | public=10.68.16.43, 208.80.155.161 | | openocr-01 | ACTIVE | - | Running | public=10.68.18.102 | | otrs-test | ACTIVE | - | Running | public=10.68.16.236 | | pronunciationrecording | ACTIVE | - | Running | public=10.68.17.41 | | puppet-jmm-debdeploy-smaster | ACTIVE | - | Running | public=10.68.18.108 | | puppettest | ACTIVE | - | Running | public=10.68.16.220 | | quarry-main-01 | ACTIVE | - | Running | public=10.68.17.14 | | rcm-1 | ACTIVE | - | Running | public=10.68.18.81 | | reading-web-staging-2 | ACTIVE | - | Running | public=10.68.17.72 | | reflex | ACTIVE | - | Running | public=10.68.18.6 | | relic | ACTIVE | - | Running | public=10.68.16.162, 208.80.155.197 | | sca1 | ACTIVE | - | Running | public=10.68.16.206 | | sectools-web1 | SHUTOFF | - | Shutdown | public=10.68.16.168 | | securepoll-farm | ACTIVE | - | Running | public=10.68.17.178 | | signwriting-ase-wiki | ACTIVE | - | Running | public=10.68.17.99, 208.80.155.178 | | staging-elastic01 | ACTIVE | - | Running | public=10.68.16.96 | | staging-mc2 | ACTIVE | - | Running | public=10.68.17.71 | | staging-ms-be01 | ACTIVE | - | Running | public=10.68.17.245 | | staging-mw01 | ACTIVE | - | Running | public=10.68.18.1 | | staging-rdb2 | ACTIVE | - | Running | public=10.68.16.240 | | staging-restbase04 | ACTIVE | - | Running | public=10.68.17.167 | | staging-restbase07 | ACTIVE | - | Running | public=10.68.17.173 | | structured-wikiquote | ACTIVE | - | Running | public=10.68.17.3 | | swift-c1-ms-be03 | ACTIVE | - | Running | public=10.68.17.233 | | swift-c1-ms-fe01 | ACTIVE | - | Running | public=10.68.17.221 | | swift-c1-ms-fe02 | ACTIVE | - | Running | public=10.68.17.224 | | test-prometheus2 | ACTIVE | - | Running | public=10.68.16.41 | | testlabs-migrate-test | ACTIVE | - | Running | public=10.68.18.59 | | testtest | ACTIVE | - | Running | public=10.68.17.15 | | tools-checker-02 | ACTIVE | - | Running | public=10.68.16.17, 208.80.155.229 | | tools-exec-1216 | ACTIVE | - | Running | public=10.68.17.255, 208.80.155.225 | | tools-exec-1219 | ACTIVE | - | Running | public=10.68.18.40, 208.80.155.228 | | tools-exec-1407 | ACTIVE | - | Running | public=10.68.18.16, 208.80.155.147 | | tools-mail | ACTIVE | - | Running | public=10.68.16.27, 208.80.155.162 | | tools-services-02 | ACTIVE | - | Running | public=10.68.18.36 | | tools-webgrid-generic-1401 | ACTIVE | - | Running | public=10.68.18.51 | | tools-webgrid-lighttpd-1202 | ACTIVE | - | Running | public=10.68.18.46 | | tools-webgrid-lighttpd-1207 | ACTIVE | - | Running | public=10.68.16.215 | | tools-webgrid-lighttpd-1210 | ACTIVE | - | Running | public=10.68.17.163 | | tools-webgrid-lighttpd-1402 | ACTIVE | - | Running | public=10.68.16.35 | | tools-webgrid-lighttpd-1407 | ACTIVE | - | Running | public=10.68.17.251 | | topicmaps-beta-launch | ACTIVE | - | Running | public=10.68.17.128 | | ttmserver-elasticsearch01 | ACTIVE | - | Running | public=10.68.17.73 | | ttmserver-salt01 | ACTIVE | - | Running | public=10.68.17.115 | | vagrant009 | ACTIVE | - | Running | public=10.68.18.79 | | wdq-mm-01 | ACTIVE | - | Running | public=10.68.16.218 | | wikidata-wdq-mm | ACTIVE | - | Running | public=10.68.16.56 | | wikimetrics1 | ACTIVE | - | Running | public=10.68.16.80 |
Monday, 2015-08-17, 15:00 UTC: Labvirt1004 reboot
Rebooter: Andrew Bogott
Affected Instances
| accounts-db2 | ACTIVE | - | Running | public=10.68.16.55 | | bd808-vagrant | ACTIVE | - | Running | public=10.68.17.190 | | ci-dib-jessie-wikimedia-73.contintcloud.eqiad.wmflabs | ACTIVE | - | Running | public=10.68.18.33 | | cocytus | ACTIVE | - | Running | public=10.68.17.148 | | conventionextension-test | SHUTOFF | - | Shutdown | public=10.68.16.144 | | cvn-app4 | ACTIVE | - | Running | public=10.68.17.45, 208.80.155.176 | | deployment-apertium01 | ACTIVE | - | Running | public=10.68.16.79 | | deployment-elastic05 | ACTIVE | - | Running | public=10.68.17.182 | | deployment-jobrunner01 | ACTIVE | - | Running | public=10.68.17.96 | | deployment-mediawiki02 | ACTIVE | - | Running | public=10.68.16.127 | | deployment-redis02 | ACTIVE | - | Running | public=10.68.16.231 | | deployment-stream | ACTIVE | - | Running | public=10.68.17.106, 208.80.155.138 | | deployment-zotero01 | ACTIVE | - | Running | public=10.68.17.102 | | developer-doc-devhub | ACTIVE | - | Running | public=10.68.16.156 | | dumps-2 | ACTIVE | - | Running | public=10.68.16.171 | | encoding01 | ACTIVE | - | Running | public=10.68.16.137 | | fishbone | ACTIVE | - | Running | public=10.68.16.233 | | flow-tests | ACTIVE | - | Running | public=10.68.17.196 | | gsoc2014-fonttailor-small1 | ACTIVE | - | Running | public=10.68.16.11 | | integration-slave-precise-1011 | ACTIVE | - | Running | public=10.68.17.70 | | ircnotifier-test-01 | ACTIVE | - | Running | public=10.68.16.241 | | jon-staging | ACTIVE | - | Running | public=10.68.17.90 | | labels | ACTIVE | - | Running | public=10.68.18.58 | | language-apertium | ACTIVE | - | Running | public=10.68.17.121 | | language-tutkimus | ACTIVE | - | Running | public=10.68.17.50 | | maps-wma1 | ACTIVE | - | Running | public=10.68.16.70 | | marathon-puppetmaster | ACTIVE | - | Running | public=10.68.17.9 | | marathon-slave-01 | ACTIVE | - | Running | public=10.68.18.56 | | moses1 | ACTIVE | - | Running | public=10.68.17.140 | | newsletter-test | ACTIVE | - | Running | public=10.68.18.35 | | ogvjs-testing | ACTIVE | - | Running | public=10.68.17.192 | | ores-worker-02 | ACTIVE | - | Running | public=10.68.18.76 | | packager | ACTIVE | - | Running | public=10.68.16.161 | | puppet-jmm-debdeploy-trusty | ACTIVE | - | Running | public=10.68.18.107 | | puppet-jmm-salt-client03 | ACTIVE | - | Running | public=10.68.17.206 | | recommendations | ACTIVE | - | Running | public=10.68.17.213 | | staging-elastic02 | ACTIVE | - | Running | public=10.68.17.200 | | staging-mx | ACTIVE | - | Running | public=10.68.17.132 | | staging-sca01 | ACTIVE | - | Running | public=10.68.17.230 | | staging-wdqs3 | ACTIVE | - | Running | public=10.68.18.88 | | tools-exec-1211 | ACTIVE | - | Running | public=10.68.17.64, 208.80.155.220 | | tools-exec-1212 | ACTIVE | - | Running | public=10.68.17.166, 208.80.155.221 | | tools-exec-1215 | ACTIVE | - | Running | public=10.68.17.254, 208.80.155.224 | | tools-exec-1403 | ACTIVE | - | Running | public=10.68.17.239, 208.80.155.143 | | tools-exec-1406 | ACTIVE | - | Running | public=10.68.18.13, 208.80.155.146 | | tools-master | ACTIVE | - | Running | public=10.68.16.9 | | tools-shadow | ACTIVE | - | Running | public=10.68.16.10 | | tools-webgrid-generic-1402 | ACTIVE | - | Running | public=10.68.18.50 | | tools-webgrid-lighttpd-1203 | ACTIVE | - | Running | public=10.68.18.47 | | tools-webgrid-lighttpd-1208 | ACTIVE | - | Running | public=10.68.16.239 | | tools-webgrid-lighttpd-1403 | ACTIVE | - | Running | public=10.68.17.191 | | tools-webgrid-lighttpd-1404 | ACTIVE | - | Running | public=10.68.17.144 | | tools-webproxy-01 | ACTIVE | - | Running | public=10.68.17.139 |
Tuesday, 2015-08-18, 15:00 UTC: Labvirt1006 reboot
Rebooter: Andrew Bogott
Affected Instances
| cvn-app5 | ACTIVE | - | Running | public=10.68.16.170, 208.80.155.177 | | cvresearch-bots | ACTIVE | - | Running | public=10.68.16.90 | | deployment-cache-bits04 | ACTIVE | - | Running | public=10.68.18.64, 208.80.155.137 | | deployment-cache-mobile03 | ACTIVE | - | Running | public=10.68.16.13 | | deployment-cache-text04 | ACTIVE | - | Running | public=10.68.18.103, 208.80.155.135 | | deployment-elastic07 | ACTIVE | - | Running | public=10.68.17.187 | | deployment-memc02 | ACTIVE | - | Running | public=10.68.16.14 | | deployment-parsoidcache02 | ACTIVE | - | Running | public=10.68.16.145 | | deployment-restbase02 | ACTIVE | - | Running | public=10.68.17.189 | | deployment-upload | ACTIVE | - | Running | public=10.68.16.189 | | dumps-3 | ACTIVE | - | Running | public=10.68.17.32 | | dumps-stats | ACTIVE | - | Running | public=10.68.17.199 | | fulltext-pup | ACTIVE | - | Running | public=10.68.16.203 | | halva | ACTIVE | - | Running | public=10.68.17.30 | | integration-slave-precise-1013 | ACTIVE | - | Running | public=10.68.17.209 | | k8s-worker-01 | ACTIVE | - | Running | public=10.68.18.86 | | k8s-worker-03 | ACTIVE | - | Running | public=10.68.18.93 | | mapsmaster666 | ACTIVE | - | Running | public=10.68.17.241 | | mhn2 | ACTIVE | - | Running | public=10.68.16.33 | | multimedia-alpha | ACTIVE | - | Running | public=10.68.16.108 | | mwoffliner2 | ACTIVE | - | Running | public=10.68.17.82, 208.80.155.202 | | outreachdashboard | ACTIVE | - | Running | public=10.68.16.172 | | slatetest | ACTIVE | - | Running | public=10.68.16.157 | | sn1per-tests | ACTIVE | - | Running | public=10.68.18.99 | | staging-elastic04 | ACTIVE | - | Running | public=10.68.17.223 | | staging-ms-be02 | ACTIVE | - | Running | public=10.68.17.246 | | staging-palladium | ACTIVE | - | Running | public=10.68.17.158 | | staging-stream | ACTIVE | - | Running | public=10.68.16.222 | | swift-c1-ms-be02 | ACTIVE | - | Running | public=10.68.17.229 | | testlabs-duplicatetest | ACTIVE | - | Running | public=10.68.18.60 | | tools-bastion-01 | ACTIVE | - | Running | public=10.68.17.228, 208.80.155.130 | | tools-exec-1205 | ACTIVE | - | Running | public=10.68.17.91, 208.80.155.214 | | tools-exec-1207 | ACTIVE | - | Running | public=10.68.17.113, 208.80.155.216 | | tools-exec-1208 | ACTIVE | - | Running | public=10.68.16.151, 208.80.155.217 | | tools-exec-1401 | ACTIVE | - | Running | public=10.68.17.202, 208.80.155.140 | | tools-exec-1404 | ACTIVE | - | Running | public=10.68.18.12, 208.80.155.144 | | tools-exec-1409 | ACTIVE | - | Running | public=10.68.18.17, 208.80.155.186 | | tools-exec-1410 | ACTIVE | - | Running | public=10.68.18.18, 208.80.155.187 | | tools-exec-catscan | ACTIVE | - | Running | public=10.68.17.23 | | tools-web-static-01 | ACTIVE | - | Running | public=10.68.18.78, 208.80.155.174 | | tools-webgrid-lighttpd-1201 | ACTIVE | - | Running | public=10.68.18.45 | | tools-webgrid-lighttpd-1205 | ACTIVE | - | Running | public=10.68.18.48 | | tools-webgrid-lighttpd-1206 | ACTIVE | - | Running | public=10.68.18.54 | | tools-webgrid-lighttpd-1406 | ACTIVE | - | Running | public=10.68.17.195 | | tools-webproxy-02 | ACTIVE | - | Running | public=10.68.17.145, 208.80.155.131, 208.80.155.142 | | wikistats-petcow | ACTIVE | - | Running | public=10.68.17.124 | | wm-bot | ACTIVE | - | Running | public=10.68.16.25, 208.80.155.190 | | wsexport | ACTIVE | - | Running | public=10.68.16.95, 208.80.155.158 |
Wednesday, 2015-08-19, 15:00 UTC: Labvirt1007 reboot
Rebooter: Andrew Bogott
Affected Instances
| accounts-mwoauth | ACTIVE | - | Running | public=10.68.17.44 | | android-build | ACTIVE | - | Running | public=10.68.17.7 | | android-builder | ACTIVE | - | Running | public=10.68.16.204 | | bastion-restricted-01 | ACTIVE | - | Running | public=10.68.18.66, 208.80.155.155 | | bbdevel | ACTIVE | - | Running | public=10.68.17.31 | | cassandra-dev | ACTIVE | - | Running | public=10.68.18.9 | | catalogcompiler | ACTIVE | - | Running | public=10.68.16.24 | | cg-puppetmaster | ACTIVE | - | Running | public=10.68.17.133 | | civi-casey | ACTIVE | - | Running | public=10.68.17.86 | | commonsarchive-test | ACTIVE | - | Running | public=10.68.16.207 | | commonsarchive-varnish | ACTIVE | - | Running | public=10.68.17.75 | | compiler01 | ACTIVE | - | Running | public=10.68.16.38 | | cvresearch-web | ACTIVE | - | Running | public=10.68.16.91 | | cxserver | ACTIVE | - | Running | public=10.68.17.38 | | dannyb | ACTIVE | - | Running | public=10.68.16.139 | | db01 | ACTIVE | - | Running | public=10.68.16.196 | | deployment-cache-mobile04 | ACTIVE | - | Running | public=10.68.18.110, 208.80.155.139 | | deployment-puppetmaster | ACTIVE | - | Running | public=10.68.16.63 | | docker-dev | ACTIVE | - | Running | public=10.68.18.73 | | drmf | ACTIVE | - | Running | public=10.68.17.17 | | drmf2015 | ACTIVE | - | Running | public=10.68.17.218 | | fastcci-master | ACTIVE | - | Running | public=10.68.16.81 | | filippo-test-jessie | ACTIVE | - | Running | public=10.68.17.243 | | gadgets | ACTIVE | - | Running | public=10.68.16.22 | | gather-browser-tests | ACTIVE | - | Running | public=10.68.16.66 | | grantreview-dev | ACTIVE | - | Running | public=10.68.16.158 | | hhvm-build1 | ACTIVE | - | Running | public=10.68.17.111 | | hhvm-test | ACTIVE | - | Running | public=10.68.17.161 | | incident-test | ACTIVE | - | Running | public=10.68.17.109 | | integration-labsvagrant | ACTIVE | - | Running | public=10.68.16.4 | | integration-lightslave-jessie-1002 | ACTIVE | - | Running | public=10.68.17.184 | | integration-slave-precise-1014 | ACTIVE | - | Running | public=10.68.18.38 | | integration-slave-trusty-1014 | ACTIVE | - | Running | public=10.68.18.29 | | integration-slave-trusty-1017 | ACTIVE | - | Running | public=10.68.17.136 | | k8s-etcd-01 | ACTIVE | - | Running | public=10.68.18.39 | | k8s-master-01 | ACTIVE | - | Running | public=10.68.17.225 | | kafka200 | ACTIVE | - | Running | public=10.68.16.138 | | kafka201 | ACTIVE | - | Running | public=10.68.17.34 | | kafka202 | ACTIVE | - | Running | public=10.68.17.59 | | kafka203 | ACTIVE | - | Running | public=10.68.17.116 | | kafka22 | ACTIVE | - | Running | public=10.68.16.84 | | labels-test | ACTIVE | - | Running | public=10.68.16.123 | | language-cx2 | ACTIVE | - | Running | public=10.68.16.20 | | language-mleb-legacy | ACTIVE | - | Running | public=10.68.16.202 | | mailman-puppet | ACTIVE | - | Running | public=10.68.16.134 | | map | ACTIVE | - | Running | public=10.68.16.181 | | mapsmaster01 | ACTIVE | - | Running | public=10.68.17.79 | | mathoid | ACTIVE | - | Running | public=10.68.16.28 | | mathoid2 | ACTIVE | - | Running | public=10.68.16.194 | | mediahandler-tests-mol | ACTIVE | - | Running | public=10.68.16.105 | | mediawiki-verp | ACTIVE | - | Running | public=10.68.16.254 | | megacron-two | ACTIVE | - | Running | public=10.68.16.49, 208.80.155.149 | | mira | ACTIVE | - | Running | public=10.68.17.215 | | mlp | ACTIVE | - | Running | public=10.68.16.3 | | mobile-hierator2 | ACTIVE | - | Running | public=10.68.18.26 | | multimedia-perf | ACTIVE | - | Running | public=10.68.16.23 | | mw-core-wbstatus | ACTIVE | - | Running | public=10.68.16.169 | | mwoffliner3 | ACTIVE | - | Running | public=10.68.16.64, 208.80.155.205 | | mwui | ACTIVE | - | Running | public=10.68.16.61 | | nemobis | ACTIVE | - | Running | public=10.68.17.131 | | nodepool-t105406 | ACTIVE | - | Running | public=10.68.17.142 | | opengrok-web | ERROR | - | Shutdown | public=10.68.16.184 | | openid-wiki | SHUTOFF | - | Shutdown | public=10.68.16.185 | | ores-compute | ACTIVE | - | Running | public=10.68.18.23 | | ores-web-02 | ACTIVE | - | Running | public=10.68.16.242 | | pcar-client12 | ACTIVE | - | Running | public=10.68.16.67 | | pcar-client14 | ACTIVE | - | Running | public=10.68.17.81 | | pcar-pm7 | ACTIVE | - | Running | public=10.68.16.76 | | phab-pup-test | ACTIVE | - | Running | public=10.68.17.211, 208.80.155.210 | | phab-test | ACTIVE | - | Running | public=10.68.16.247 | | phab09 | ACTIVE | - | Running | public=10.68.16.179 | | phragile | ACTIVE | - | Running | public=10.68.16.121 | | proofreadpage | ACTIVE | - | Running | public=10.68.16.36 | | property-suggester | ACTIVE | - | Running | public=10.68.16.253 | | pubsubhubbub | ACTIVE | - | Running | public=10.68.16.69 | | puppet-certchange | ACTIVE | - | Running | public=10.68.17.201 | | puppet-compiler02 | ACTIVE | - | Running | public=10.68.16.221 | | puppet-jmm-debdeploy-jessie | ACTIVE | - | Running | public=10.68.18.105 | | puppet-jmm-firewall-host1 | ACTIVE | - | Running | public=10.68.17.114 | | puppet-jmm-firewall-host2 | ACTIVE | - | Running | public=10.68.17.146 | | puppet-jmm-jessie | ACTIVE | - | Running | public=10.68.16.232 | | puppet-jmm-salt-client01 | ACTIVE | - | Running | public=10.68.17.153 | | quarry-runner-01 | ACTIVE | - | Running | public=10.68.17.29 | | rcm-2 | ACTIVE | - | Running | public=10.68.16.68 | | scantools | ACTIVE | - | Running | public=10.68.17.130 | | search-datavis | ACTIVE | - | Running | public=10.68.16.192 | | secondinstance | SHUTOFF | - | NOSTATE | public=10.68.16.213 | | sentry-deploy | ACTIVE | - | Running | public=10.68.17.28 | | shaved-yak | ACTIVE | - | Running | public=10.68.17.97 | | shiny | ACTIVE | - | Running | public=10.68.17.20 | | signwriting-ase-wikipedia | ACTIVE | - | Running | public=10.68.16.88 | | sn1per-tests-medium | ACTIVE | - | Running | public=10.68.18.97 | | social-tools1 | ACTIVE | - | Running | public=10.68.16.219 | | st-trusty | ACTIVE | - | Running | public=10.68.18.5 | | staging-mc3 | ACTIVE | - | Running | public=10.68.17.98 | | staging-restbase01 | ACTIVE | - | Running | public=10.68.17.67 | | staging-restbase06 | ACTIVE | - | Running | public=10.68.17.172 | | staging-restbase10 | ACTIVE | - | Running | public=10.68.17.183 | | staging-test-tin | ACTIVE | - | Running | public=10.68.16.223 | | suggester2 | ACTIVE | - | Running | public=10.68.17.52 | | suggesty | ACTIVE | - | Running | public=10.68.18.89 | | task | ACTIVE | - | Running | public=10.68.16.188, 208.80.155.173 | | test-carbon-c-relay | ACTIVE | - | Running | public=10.68.17.4 | | test-grafana1 | ACTIVE | - | Running | public=10.68.16.176 | | test-mem01 | ACTIVE | - | Running | public=10.68.17.87 | | testnfs | ACTIVE | - | Running | public=10.68.16.2 | | toolsbeta-mail | ACTIVE | - | Running | public=10.68.16.113 | | toolsbeta-master | ACTIVE | - | Running | public=10.68.16.146 | | toolsbeta-puppetmaster3 | ACTIVE | - | Running | public=10.68.16.92 | | toolsbeta-webproxy-01 | ACTIVE | - | Running | public=10.68.16.175 | | toolsbeta-wikitech-test4-scfc | ACTIVE | - | Running | public=10.68.18.61 | | toro | ACTIVE | - | Running | public=10.68.17.42 | | unicorn | ACTIVE | - | Running | public=10.68.16.46, 208.80.155.134 | | urlshortener | ACTIVE | - | Running | public=10.68.17.37 | | wbdocs | ACTIVE | - | Running | public=10.68.17.53 | | wdq-wikidata | ACTIVE | - | Running | public=10.68.17.219 | | wikibanner | ACTIVE | - | Running | public=10.68.17.248 | | wikidata-builder1 | ACTIVE | - | Running | public=10.68.17.150 | | wikidata-topics | ACTIVE | - | Running | public=10.68.16.112 | | wikilabels-01 | ACTIVE | - | Running | public=10.68.17.198 | | wikilabels-test | ACTIVE | - | Running | public=10.68.17.203 | | wikimania-scholarships | ACTIVE | - | Running | public=10.68.16.82 | | wikimetrics-staging1 | ACTIVE | - | Running | public=10.68.16.77 | | xtools-a | ACTIVE | - | Running | public=10.68.16.165 |
Thursday, 2015-08-20, 15:00 UTC: Labvirt1008 reboot
Rebooter: Andrew Bogott
Affected Instances
| aa-jessietest | ACTIVE | - | Running | public=10.68.16.85 | | accounts-appserver4 | ACTIVE | - | Running | public=10.68.17.5 | | annotator | ACTIVE | - | Running | public=10.68.17.40 | | appserver | ACTIVE | - | Running | public=10.68.17.74 | | bastion-02 | ACTIVE | - | Running | public=10.68.18.65, 208.80.155.153 | | bastion-restricted-02 | ACTIVE | - | Running | public=10.68.18.68 | | client | ACTIVE | - | Running | public=10.68.18.4 | | commonsarchive-production | ACTIVE | - | Running | public=10.68.16.155 | | confd-jessie | ACTIVE | - | Running | public=10.68.17.47 | | confd-precise | ACTIVE | - | Running | public=10.68.18.27 | | dan-pentaho | ACTIVE | - | Running | public=10.68.17.80 | | dannyb-large | ACTIVE | - | Running | public=10.68.17.104 | | deployment-fluorine | ACTIVE | - | Running | public=10.68.16.198 | | deployment-logstash2 | ACTIVE | - | Running | public=10.68.16.147 | | deployment-sca02 | ACTIVE | - | Running | public=10.68.16.173 | | drmf-ecf | ACTIVE | - | Running | public=10.68.17.212 | | dumps-1 | ACTIVE | - | Running | public=10.68.16.230 | | dynamicproxy-02 | ACTIVE | - | Running | public=10.68.16.174 | | dynamicproxy-gateway | ACTIVE | - | Running | public=10.68.16.65, 208.80.155.156 | | editor-campaigns | ACTIVE | - | Running | public=10.68.16.226 | | educationdashboard | ACTIVE | - | Running | public=10.68.16.136 | | extdist-02 | ACTIVE | - | Running | public=10.68.16.18 | | fabu | ACTIVE | - | Running | public=10.68.16.164, 208.80.155.181 | | fastcci-main | ACTIVE | - | Running | public=10.68.17.84 | | fastcci-puppetmaster | ACTIVE | - | Running | public=10.68.17.13 | | fastcci-worker1 | ACTIVE | - | Running | public=10.68.16.71 | | filippo-test-trusty | ACTIVE | - | Running | public=10.68.17.22 | | gptest1 | ACTIVE | - | Running | public=10.68.16.62 | | graph3 | ACTIVE | - | Running | public=10.68.17.154, 208.80.155.201 | | huggle-pg | ACTIVE | - | Running | public=10.68.17.231 | | integration-slave-jessie-1001 | ACTIVE | - | Running | public=10.68.16.72 | | integration-slave-trusty-1011 | ACTIVE | - | Running | public=10.68.17.244 | | jitsu | ACTIVE | - | Running | public=10.68.16.114 | | jzerebecki-vagrant-wd | ACTIVE | - | Running | public=10.68.16.246 | | kafka-jessie01 | ACTIVE | - | Running | public=10.68.16.140 | | kafka-test | ACTIVE | - | Running | public=10.68.18.31 | | language-cx | ACTIVE | - | Running | public=10.68.17.151 | | language-lcmd | ACTIVE | - | Running | public=10.68.17.63 | | language-mleb-stable | ACTIVE | - | Running | public=10.68.17.141 | | limn1 | ACTIVE | - | Running | public=10.68.16.94 | | logstash01 | ACTIVE | - | Running | public=10.68.18.90 | | mailman-jessie | ACTIVE | - | Running | public=10.68.17.216, 208.80.155.206 | | math-ru | ACTIVE | - | Running | public=10.68.17.123 | | mathosphere | ACTIVE | - | Running | public=10.68.17.26, 208.80.155.185 | | mediahandler-tests-static | ACTIVE | - | Running | public=10.68.17.21 | | mwoffliner1 | ACTIVE | - | Running | public=10.68.16.224, 208.80.155.198 | | nginx-dev2 | ACTIVE | - | Running | public=10.68.17.125 | | ores-lb-02 | ACTIVE | - | Running | public=10.68.18.74 | | ores-redis-02 | ACTIVE | - | Running | public=10.68.18.77 | | ores-worker-01 | ACTIVE | - | Running | public=10.68.18.75 | | ores-worker-04 | ACTIVE | - | Running | public=10.68.18.84 | | orgchart | ACTIVE | - | Running | public=10.68.17.48 | | overpass-wiki | ACTIVE | - | Running | public=10.68.16.6 | | parsoid-spof | ACTIVE | - | Running | public=10.68.17.24, 208.80.155.167 | | pcar-director4 | ACTIVE | - | Running | public=10.68.17.58 | | performance-dev | ACTIVE | - | Running | public=10.68.17.103 | | phab-01 | ACTIVE | - | Running | public=10.68.16.201 | | phab-03 | ACTIVE | - | Running | public=10.68.18.72 | | phab-pup | ACTIVE | - | Running | public=10.68.16.75 | | piramido | ACTIVE | - | Running | public=10.68.17.43 | | postgis-test | ACTIVE | - | Running | public=10.68.17.247 | | proba | ACTIVE | - | Running | public=10.68.16.143 | | puppet-jmm-firewall-pmaster | ACTIVE | - | Running | public=10.68.17.101 | | puppet-jmm-salt-client04 | ACTIVE | - | Running | public=10.68.18.22 | | puppet-jmm-salt-master | ACTIVE | - | Running | public=10.68.16.101 | | puppet-jmm-ubuntu1204 | ACTIVE | - | Running | public=10.68.16.30 | | puppetmaster | ACTIVE | - | Running | public=10.68.17.207 | | reflex2 | ACTIVE | - | Running | public=10.68.16.183, 208.80.155.207 | | services-bot | ACTIVE | - | Running | public=10.68.17.117 | | services-deploy | ACTIVE | - | Running | public=10.68.16.214 | | signwriting-icon-server-2 | ACTIVE | - | Running | public=10.68.17.168, 208.80.155.159 | | special-pm-instance | ACTIVE | - | Running | public=10.68.17.122 | | staging-cache-text01 | ACTIVE | - | Running | public=10.68.17.66 | | staging-restbase02 | ACTIVE | - | Running | public=10.68.17.137 | | staging-restbase03 | ACTIVE | - | Running | public=10.68.17.83 | | staging-restbase05 | ACTIVE | - | Running | public=10.68.17.171 | | staging-restbase09 | ACTIVE | - | Running | public=10.68.17.179 | | stashbot-elastic02 | ACTIVE | - | Running | public=10.68.18.100 | | sul-test | ACTIVE | - | Running | public=10.68.17.76 | | test-labs-vagrant | ACTIVE | - | Running | public=10.68.17.107 | | tools-mailrelay-02 | ACTIVE | - | Running | public=10.68.17.61, 208.80.155.188 | | tools-redis-01 | ACTIVE | - | Running | public=10.68.18.70 | | tools-shadow-01 | ACTIVE | - | Running | public=10.68.16.87 | | toolsbeta-exec-01 | ACTIVE | - | Running | public=10.68.17.89 | | toolsbeta-jessie-test4 | ACTIVE | - | Running | public=10.68.17.138 | | toolsbeta-webgrid-04 | ACTIVE | - | Running | public=10.68.17.12, 208.80.155.133 | | torproxy | ACTIVE | - | Running | public=10.68.18.15 | | towtruck | ACTIVE | - | Running | public=10.68.17.25 | | uploadwizard-osm-equiad | ACTIVE | - | Running | public=10.68.16.100 | | utrs-base | ACTIVE | - | Running | public=10.68.16.124 | | vagrant03 | ACTIVE | - | Running | public=10.68.18.80 | | wdq-beta | ACTIVE | - | Running | public=10.68.16.86 | | wdqs-puppetmaster | ACTIVE | - | Running | public=10.68.18.32 | | wikidataquality | ACTIVE | - | Running | public=10.68.16.26 | | wikisource-dev | ACTIVE | - | Running | public=10.68.16.89, 208.80.155.157 | | wikistream-web | ACTIVE | - | Running | public=10.68.16.237, 208.80.155.169 | | wlm-apache1 | SHUTOFF | - | Shutdown | public=10.68.16.243 | | wmt-apache | ACTIVE | - | Running | public=10.68.17.237 | | wmt-bastion | ACTIVE | - | Running | public=10.68.17.234 | | xtools-b | ACTIVE | - | Running | public=10.68.16.238 |