[prev in list] [next in list] [prev in thread] [next in thread]
List: libvirt-users
Subject: [libvirt-users] Libvirt and Glusterfs
From: Pierre-Gilles Mialon <pmialon () gmail ! com>
Date: 2013-04-30 12:33:23
Message-ID: CAFaty86H8bfSmMGf6sP-Hfn2T3WB9AP_6xLuh+pxzk-TTm=N+g () mail ! gmail ! com
[Download RAW message or body]
Hi,
On a Fedora 18, I try to launch a VM with QEMU-GlusterFS native integration.
I have enable fedora-virt-preview repo, and gluster-alpha3 repo.
Below the list of installed package :
glusterfs-3.4.0-0.3.alpha3.fc18.x86_64
glusterfs-devel-3.4.0-0.3.alpha3.fc18.x86_64
glusterfs-fuse-3.4.0-0.3.alpha3.fc18.x86_64
glusterfs-server-3.4.0-0.3.alpha3.fc18.x86_64
ipxe-roms-qemu-20130103-2.git717279a.fc18.noarch
libvirt-1.0.4-1.fc18.x86_64
libvirt-client-1.0.4-1.fc18.x86_64
libvirt-daemon-1.0.4-1.fc18.x86_64
libvirt-daemon-config-network-1.0.4-1.fc18.x86_64
libvirt-daemon-config-nwfilter-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-interface-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-libxl-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-lxc-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-network-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-nodedev-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-nwfilter-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-qemu-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-secret-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-storage-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-uml-1.0.4-1.fc18.x86_64
libvirt-daemon-driver-xen-1.0.4-1.fc18.x86_64
libvirt-python-1.0.4-1.fc18.x86_64
qemu-common-1.4.1-2.fc18.x86_64
qemu-img-1.4.1-2.fc18.x86_64
qemu-kvm-1.4.1-2.fc18.x86_64
qemu-system-arm-1.4.1-2.fc18.x86_64
qemu-system-x86-1.4.1-2.fc18.x86_64
I have recompiled Qemu with –enable-glusterfs .
Here the content of my /etc/glusterfs/glusterd.vol
volume management
type mgmt/glusterd
option working-directory /var/lib/glusterd
option transport-type socket
option transport.socket.nodelay on
option transport.socket.keepalive-time 10
option transport.socket.keepalive-interval 2
option transport.socket.read-fail-log off
option rpc-auth.ports.insecure yes
option rpc-auth-allow-insecure on
end-volume
I have defined the following line in my domain.xml
<disk type='network' device='disk'>
<driver name='qemu' cache='none'/>
<source protocol='gluster' name='gv1/test.img'>
<host name='127.0.0.1' transport='tcp' />
</source>
<target dev='vda' bus='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05'
function='0x0'/>
</disk>
# virsh start test
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
QEMU_AUDIO_DRV=spice /usr/bin/qemu-kvm -name test -S -M pc-i440fx-1.4 -m
1024 -smp 1,sockets=1,cores=1,threads=1 -uuid
4c8686bc-9da9-c61d-cd85-8b2865ea4124 -no-user-config -nodefaults -chardev
socket,id=charmonitor,path=/var/lib/libvirt/qemu/test.monitor,server,nowait
-mon chardev=charmonitor,id=monitor,mode=control -rtc base=utc -no-shutdown
-boot order=dc,menu=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2
-device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x4 -drive
file=gluster://
127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none-device
virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0
-netdev tap,fd=26,id=hostnet0,vhost=on,vhostfd=27 -device
virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:cf:d2:62,bus=pci.0,addr=0x3
-chardev pty,id=charserial0 -device
isa-serial,chardev=charserial0,id=serial0 -chardev
spicevmc,id=charchannel0,name=vdagent -device
virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.spice.0
-device usb-tablet,id=input0 -spice
port=5900,addr=127.0.0.1,disable-ticketing,seamless-migration=on -vga qxl
-global qxl-vga.ram_size=67108864 -global qxl-vga.vram_size=67108864
-device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x6
char device redirected to /dev/pts/4 (label charserial0)
qemu-system-x86_64: -drive file=gluster://
127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none:
Gluster connection failed for server=127.0.0.1 port=24007 volume=gv1
image=test.img transport=tcp
qemu-system-x86_64: -drive file=gluster://
127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none:
could not open disk image gluster://127.0.0.1:24007/gv1/test.img: No data
available
2013-04-30 10:39:44.466+0000: shutting down
but launching qemu with commant line work great :
# qemu-system-x86_64 -name test -M pc-i440fx-1.4 -m 1024 -smp 1 -drive
file=gluster://
127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none-device
virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0
Am I missing something ?
Regards,
--
Pierre-Gilles Mialon
[Attachment #3 (text/html)]
<div dir="ltr">Hi, <div><br></div><div>On a Fedora 18, I try to launch a VM with \
QEMU-GlusterFS native integration.</div><div style><br></div><div style>I have enable \
fedora-virt-preview repo, and gluster-alpha3 repo.</div> <div style><br></div><div \
style>Below the list of installed package :</div><div \
style>glusterfs-3.4.0-0.3.alpha3.fc18.x86_64<br></div><div \
style><div>glusterfs-devel-3.4.0-0.3.alpha3.fc18.x86_64</div><div>glusterfs-fuse-3.4.0-0.3.alpha3.fc18.x86_64</div>
<div>glusterfs-server-3.4.0-0.3.alpha3.fc18.x86_64</div><div>ipxe-roms-qemu-20130103- \
2.git717279a.fc18.noarch</div><div>libvirt-1.0.4-1.fc18.x86_64</div><div>libvirt-client-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-1.0.4-1.fc18.x86_64</div>
<div>libvirt-daemon-config-network-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-confi \
g-nwfilter-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-driver-interface-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-driver-libxl-1.0.4-1.fc18.x86_64</div>
<div>libvirt-daemon-driver-lxc-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-driver-ne \
twork-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-driver-nodedev-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-driver-nwfilter-1.0.4-1.fc18.x86_64</div>
<div>libvirt-daemon-driver-qemu-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-driver-s \
ecret-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-driver-storage-1.0.4-1.fc18.x86_64</div><div>libvirt-daemon-driver-uml-1.0.4-1.fc18.x86_64</div>
<div>libvirt-daemon-driver-xen-1.0.4-1.fc18.x86_64</div><div>libvirt-python-1.0.4-1.f \
c18.x86_64</div><div>qemu-common-1.4.1-2.fc18.x86_64</div><div>qemu-img-1.4.1-2.fc18.x86_64</div><div>qemu-kvm-1.4.1-2.fc18.x86_64</div>
<div>qemu-system-arm-1.4.1-2.fc18.x86_64</div><div>qemu-system-x86-1.4.1-2.fc18.x86_64</div><div><br></div></div><div>I \
have recompiled Qemu with –enable-glusterfs . <br></div><div><br></div><div \
style>Here the content of my /etc/glusterfs/glusterd.vol</div> <div \
style><br></div><div style><div>volume management</div><div> type \
mgmt/glusterd</div><div> option working-directory /var/lib/glusterd</div><div> \
option transport-type socket</div><div> option transport.socket.nodelay on</div> \
<div> option transport.socket.keepalive-time 10</div><div> option \
transport.socket.keepalive-interval 2</div><div> option \
transport.socket.read-fail-log off</div><div> option rpc-auth.ports.insecure \
yes</div><div> option rpc-auth-allow-insecure \
on</div><div>end-volume</div><div><br></div></div><div><br></div><div style>I have \
defined the following line in my domain.xml</div><div><div><br></div><div><div> \
<disk type='network' device='disk'></div> <div> \
<driver name='qemu' cache='none'/></div><div> \
<source protocol='gluster' name='gv1/test.img'></div><div> \
<host name='127.0.0.1' transport='tcp' /></div> <div> \
</source></div><div> <target dev='vda' \
bus='virtio'/></div><div> <address type='pci' \
domain='0x0000' bus='0x00' slot='0x05' \
function='0x0'/></div> <div> \
</disk></div></div><div><br></div><div><br></div><div style># virsh start \
test</div><div><br></div><div><div>LC_ALL=C \
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin QEMU_AUDIO_DRV=spice \
/usr/bin/qemu-kvm -name test -S -M pc-i440fx-1.4 -m 1024 -smp \
1,sockets=1,cores=1,threads=1 -uuid 4c8686bc-9da9-c61d-cd85-8b2865ea4124 \
-no-user-config -nodefaults -chardev \
socket,id=charmonitor,path=/var/lib/libvirt/qemu/test.monitor,server,nowait -mon \
chardev=charmonitor,id=monitor,mode=control -rtc base=utc -no-shutdown -boot \
order=dc,menu=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device \
virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x4 -drive file=gluster://<a \
href="http://127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none">127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none</a> \
-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0 \
-netdev tap,fd=26,id=hostnet0,vhost=on,vhostfd=27 -device \
virtio-net-pci,netdev=hostnet0,id=net0,mac=52:54:00:cf:d2:62,bus=pci.0,addr=0x3 \
-chardev pty,id=charserial0 -device isa-serial,chardev=charserial0,id=serial0 \
-chardev spicevmc,id=charchannel0,name=vdagent -device \
virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.spice.0 \
-device usb-tablet,id=input0 -spice \
port=5900,addr=127.0.0.1,disable-ticketing,seamless-migration=on -vga qxl -global \
qxl-vga.ram_size=67108864 -global qxl-vga.vram_size=67108864 -device \
virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x6</div> <div>char device redirected \
to /dev/pts/4 (label charserial0)</div><div>qemu-system-x86_64: -drive \
file=gluster://<a href="http://127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-di \
sk0,cache=none">127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none</a>: \
Gluster connection failed for server=127.0.0.1 port=24007 volume=gv1 image=test.img \
transport=tcp</div> <div>qemu-system-x86_64: -drive file=gluster://<a \
href="http://127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none">127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none</a>: \
could not open disk image gluster://<a \
href="http://127.0.0.1:24007/gv1/test.img">127.0.0.1:24007/gv1/test.img</a>: No data \
available</div> <div>2013-04-30 10:39:44.466+0000: shutting \
down</div></div><div><br></div><div style>but launching qemu with commant line work \
great :</div><div style># qemu-system-x86_64 -name test -M pc-i440fx-1.4 -m 1024 \
-smp 1 -drive file=gluster://<a \
href="http://127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none">127.0.0.1:24007/gv1/test.img,if=none,id=drive-virtio-disk0,cache=none</a> \
-device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0 \
</div> <div style><br></div><div style><br></div><div style>Am I missing something \
?</div><div><br></div><div style>Regards,</div><div style><br></div><div \
style><br></div><div><br></div>-- <br>Pierre-Gilles Mialon </div></div>
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic