Obsolete:HPshutdowns

This is documentation of spontaneous instance shutdowns on the new HP virt nodes. With any luck a pattern will emerge.

Possible culprits:

https://bugzilla.redhat.com/show_bug.cgi?format=multiple&id=1029743

Dec 23 05:45:01, instance tools-uwsgi-01 aka i-000007b9 aka 6f8ead40-b3c9-4abe-86a1-407a410f9843

On virt1010.

Instance syslog:

   Dec 23 05:33:20 tools-uwsgi-01 puppet-agent[30719]: (/Stage[main]/Toollabs::Hba/Exec[make-shosts]/returns) executed successfully
   Dec 23 05:33:25 tools-uwsgi-01 puppet-agent[30719]: (/Stage[main]/Toollabs::Exec_environ/Package[libthreads-perl]/ensure) ensure changed 'purged' to 'latest'
   Dec 23 05:33:26 tools-uwsgi-01 puppet-agent[30719]: Finished catalog run in 81.45 seconds
   Dec 23 05:35:01 tools-uwsgi-01 CRON[1293]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
   Dec 23 05:39:01 tools-uwsgi-01 CRON[1468]: (root) CMD (  [ -x /usr/lib/php5/maxlifetime ] && [ -x /usr/lib/php5/sessionclean ] && [ -d /var/lib/php5 ] && /usr/lib/php5/sessionclean /var/lib/php5 $(/usr/lib/php5/maxlifetime))
   Dec 23 05:45:01 tools-uwsgi-01 CRON[1722]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1)
   Dec 23 06:00:02 tools-uwsgi-01 rsyslogd: [origin software="rsyslogd" swVersion="7.4.4" x-pid="1037" x-info="http://www.rsyslog.com"] start
   Dec 23 06:00:02 tools-uwsgi-01 rsyslogd: rsyslogd's groupid changed to 104
   Dec 23 06:00:02 tools-uwsgi-01 rsyslogd: rsyslogd's userid changed to 101

qemu:

   qemu-system-x86_64: /build/buildd/qemu-2.0.0+dfsg/kvm-all.c:984: kvm_irqchip_commit_routes: Assertion `ret == 0' failed.
   2014-12-23 05:45:54.460+0000: shutting down

libvirt:

   2014-12-23 05:45:53.476+0000: 64000: error : virProcessGetAffinity:433 : cannot get CPU affinity of process 2000: No such process
   2014-12-23 05:45:54.460+0000: 63995: error : qemuMonitorIO:656 : internal error: End of file from monitor

nova-compute:

   2014-12-23 05:45:57.239 5932 WARNING nova.compute.manager [-] [instance: 6f8ead40-b3c9-4abe-86a1-407a410f9843] Instance shutdown by itself. Calling the stop API.
   2014-12-23 05:45:57.480 5932 WARNING nova.context [req-3dc7e426-b22b-43b3-8d9b-e4c226160d4a None None] Arguments dropped when creating context: {'user': None, 'tenant': None}
   2014-12-23 05:45:57.488 5932 INFO nova.virt.libvirt.driver [-] [instance: 6f8ead40-b3c9-4abe-86a1-407a410f9843] Instance destroyed successfully.