[prev in list] [next in list] [prev in thread] [next in thread] 

List:       libvirt-users
Subject:    [libvirt-users] Live migration of instance using KVM hypervisor fails
From:       "Gurjar, Unmesh" <Unmesh.Gurjar () nttdata ! com>
Date:       2012-04-12 14:16:47
Message-ID: C2F1FD20FE83284AA0E9E36639ECDAEBE56EB7 () MAIL703 ! KDS ! KEANE ! COM
[Download RAW message or body]

Hi,

I am trying to migrate a running instance, but it fails with the following error:
$ virsh migrate  --live instance-00000008 qemu+tcp://10.2.3.150/system --verbose
error: operation failed: migration job: unexpectedly failed

I can see following in the instance specific qemu log directory \
(/var/log/libvirt/qemu/instance-00000008.log) on the destination host: 2012-04-12 \
03:57:26.211: starting up LC_ALL=C \
PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin QEMU_AUDIO_DRV=none \
/usr/bin/kvm -S -M pc-0.14 -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 \
-name instance-00000008 -uuid 86b357d0-b76d-4cde-a0d1-90fb65508ff2 -nodefconfig \
-nodefaults -chardev \
socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-00000008.monitor,server,nowait \
-mon chardev=charmonitor,id=monitor,mode=readline -rtc base=utc -boot c -kernel \
/opt/stack/nova/mnt_instances/instance-00000008/kernel -initrd \
/opt/stack/nova/mnt_instances/instance-00000008/ramdisk -append root=/dev/vda \
console=ttyS0 -drive \
file=/opt/stack/nova/mnt_instances/instance-00000008/disk,if=none,id=drive-virtio-disk0,format=qcow2,cache=none \
-device virtio-blk-pci,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0 \
-netdev tap,ifname=tap57b16714-9a,script=,id=hostnet0 -device \
rtl8139,netdev=hostnet0,id=net0,mac=fa:16:3e:45:b3:c6,bus=pci.0,addr=0x3 -chardev \
file,id=charserial0,path=/opt/stack/nova/mnt_instances/instance-00000008/console.log \
-device isa-serial,chardev=charserial0,id=serial0 -chardev pty,id=charserial1 -device \
isa-serial,chardev=charserial1,id=serial1 -usb -device usb-tablet,id=input0 -vnc \
127.0.0.1:0 -k en-us -vga cirrus -incoming tcp:0.0.0.0:49169 -device \
virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5 Domain id=20 is tainted: \
high-privileges Domain id=20 is tainted: shell-scripts
char device redirected to /dev/pts/17
2012-04-12 03:57:26.850: shutting down
can't delete tap57b16714-9a from eth1: Operation not supported
SIOCSIFADDR: Permission denied
SIOCSIFFLAGS: Permission denied
SIOCSIFFLAGS: Permission denied
/etc/qemu-ifdown: could not launch network script

Libvirt version on both hosts:
$ libvirtd --version
libvirtd (libvirt) 0.9.2
$ virsh --version
0.9.2

Here are my libvirtd.conf details:
listen_tls = 0
listen_tcp = 1
unix_sock_group = "libvirtd"
unix_sock_rw_perms = "0770"
auth_unix_ro = "none"
auth_unix_rw = "none"
auth_tcp = "none"

Would be great if someone can point out the issue here.

Note: I have disable apparmor for libvirtd profile and am able to list the instances \
running on the remote host (from both the servers).

Thanks & Regards,
Unmesh Gurjar | Lead Engineer | Vertex Software Private Ltd. | w. +91.20.6604.1500 x \
379 | m. +91.982.324.7631 | \
unmesh.gurjar@nttdata.com<mailto:unmesh.gurjar@nttdata.com> | Follow us on \
Twitter@NTTDATAAmericas


______________________________________________________________________
Disclaimer:This email and any attachments are sent in strictest confidence for the \
sole use of the addressee and may contain legally privileged, confidential, and \
proprietary data.  If you are not the intended recipient, please advise the sender by \
replying promptly to this email and then delete and destroy this email and any \
attachments without any further use, copying or forwarding


[Attachment #3 (text/html)]

<html xmlns:v="urn:schemas-microsoft-com:vml" \
xmlns:o="urn:schemas-microsoft-com:office:office" \
xmlns:w="urn:schemas-microsoft-com:office:word" \
xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" \
xmlns="http://www.w3.org/TR/REC-html40"> <head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-family:"Calibri","sans-serif";}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">I am trying to migrate a running instance, but it fails with the \
following error:<o:p></o:p></p> <p class="MsoNormal" style="margin-left:.5in">$ virsh \
migrate&nbsp; --live instance-00000008 qemu&#43;tcp://10.2.3.150/system \
--verbose<o:p></o:p></p> <p class="MsoNormal" style="margin-left:.5in">error: \
operation failed: migration job: unexpectedly failed<o:p></o:p></p> <p \
class="MsoNormal"><o:p>&nbsp;</o:p></p> <p class="MsoNormal">I can see following in \
the instance specific qemu log directory \
(/var/log/libvirt/qemu/instance-00000008.log) on the destination host:<o:p></o:p></p> \
<p class="MsoNormal" style="margin-left:.5in">2012-04-12 03:57:26.211: starting \
up<o:p></o:p></p> <p class="MsoNormal" style="margin-left:.5in">LC_ALL=C \
PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin QEMU_AUDIO_DRV=none \
/usr/bin/kvm -S -M pc-0.14 -enable-kvm -m 512 -smp 1,sockets=1,cores=1,threads=1 \
                -name instance-00000008 -uuid 86b357d0-b76d-4cde-a0d1-90fb65508ff2
 -nodefconfig -nodefaults -chardev \
socket,id=charmonitor,path=/var/lib/libvirt/qemu/instance-00000008.monitor,server,nowait \
-mon chardev=charmonitor,id=monitor,mode=readline -rtc base=utc -boot c -kernel \
                /opt/stack/nova/mnt_instances/instance-00000008/kernel
 -initrd /opt/stack/nova/mnt_instances/instance-00000008/ramdisk -append \
root=/dev/vda console=ttyS0 -drive \
file=/opt/stack/nova/mnt_instances/instance-00000008/disk,if=none,id=drive-virtio-disk0,format=qcow2,cache=none \
                -device \
                virtio-blk-pci,bus=pci.0,addr=0x4,drive=drive-virtio-disk0,id=virtio-disk0
                
 -netdev tap,ifname=tap57b16714-9a,script=,id=hostnet0 -device \
rtl8139,netdev=hostnet0,id=net0,mac=fa:16:3e:45:b3:c6,bus=pci.0,addr=0x3 -chardev \
file,id=charserial0,path=/opt/stack/nova/mnt_instances/instance-00000008/console.log \
                -device isa-serial,chardev=charserial0,id=serial0
 -chardev pty,id=charserial1 -device isa-serial,chardev=charserial1,id=serial1 -usb \
-device usb-tablet,id=input0 -vnc 127.0.0.1:0 -k en-us -vga cirrus -incoming \
tcp:0.0.0.0:49169 -device \
virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x5<o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in">Domain id=20 is tainted: high-privileges<o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in">Domain id=20 is tainted: \
shell-scripts<o:p></o:p></p> <p class="MsoNormal" style="margin-left:.5in">char \
device redirected to /dev/pts/17<o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in">2012-04-12 03:57:26.850: shutting down<o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in">can't delete tap57b16714-9a from eth1: \
Operation not supported<o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in">SIOCSIFADDR: Permission denied<o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in">SIOCSIFFLAGS: Permission \
denied<o:p></o:p></p> <p class="MsoNormal" style="margin-left:.5in">SIOCSIFFLAGS: \
Permission denied<o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in">/etc/qemu-ifdown: could not launch network \
script<o:p></o:p></p> <p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Libvirt version on both hosts:<o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in">$ libvirtd --version<o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in">libvirtd (libvirt) 0.9.2<o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in">$ virsh --version<o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in">0.9.2<o:p></o:p></p>
<p class="MsoNormal"><o:p>&nbsp;</o:p></p>
<p class="MsoNormal">Here are my libvirtd.conf details:<o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in">listen_tls = 0<o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in">listen_tcp = 1<o:p></o:p></p>
<p class="MsoNormal" style="margin-left:.5in">unix_sock_group = \
&quot;libvirtd&quot;<o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in">unix_sock_rw_perms = &quot;0770&quot;<o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in">auth_unix_ro = \
&quot;none&quot;<o:p></o:p></p> <p class="MsoNormal" \
style="margin-left:.5in">auth_unix_rw = &quot;none&quot;<o:p></o:p></p> <p \
class="MsoNormal" style="margin-left:.5in">auth_tcp = &quot;none&quot;<o:p></o:p></p> \
<p class="MsoNormal"><o:p>&nbsp;</o:p></p> <p class="MsoNormal">Would be great if \
someone can point out the issue here.<o:p></o:p></p> <p \
class="MsoNormal"><o:p>&nbsp;</o:p></p> <p class="MsoNormal">Note: I have disable \
apparmor for libvirtd profile and am able to list the instances running on the remote \
host (from both the servers).<o:p></o:p></p> <p \
class="MsoNormal"><o:p>&nbsp;</o:p></p> <p class="MsoNormal"><span \
style="font-size:10.0pt;font-family:&quot;Arial&quot;,&quot;sans-serif&quot;">Thanks \
&amp; Regards,<o:p></o:p></span></p> <p class="MsoNormal"><b><span \
style="font-size:10.0pt;font-family:&quot;Arial&quot;,&quot;sans-serif&quot;">Unmesh \
Gurjar</span></b><span \
style="font-size:10.0pt;font-family:&quot;Arial&quot;,&quot;sans-serif&quot;"> | Lead \
Engineer | </span><span \
style="font-size:10.0pt;font-family:&quot;Arial&quot;,&quot;sans-serif&quot;;color:black">Vertex \
Software Private Ltd. | <b>w.</b> &#43;91.20.6604.1500 x 379 | <b>m.</b> \
&#43;91.982.324.7631 | <a href="mailto:unmesh.gurjar@nttdata.com"> \
unmesh.gurjar@nttdata.com</a> | </span><span \
style="font-size:10.0pt;font-family:&quot;Arial&quot;,&quot;sans-serif&quot;">Follow \
us on Twitter@NTTDATAAmericas<b><o:p></o:p></b></span></p> <p \
class="MsoNormal"><o:p>&nbsp;</o:p></p> </div>
<br clear="both">
______________________________________________________________________<BR>
Disclaimer:This email and any attachments are sent in strictest confidence for the \
sole use of the addressee and may contain legally privileged, confidential, and \
proprietary data.  If you are not the intended recipient, please advise the sender by \
replying promptly to this email and then delete and destroy this email and any \
attachments without any further use, copying or forwarding<BR> </body>
</html>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic