[prev in list] [next in list] [prev in thread] [next in thread]
List: gluster-users
Subject: Re: [Gluster-users] SMB copies failing with GlusterFS 3.10
From: Alastair Neil <ajneil.tech () gmail ! com>
Date: 2017-11-28 15:07:54
Message-ID: CA+SarwpnTSJA8ToXzK66kfF5v3dpZyPc++W_bDh95FB3Sj0xmQ () mail ! gmail ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
What is the volume configuration, is it replicated, distributed,
distribute-replicate, disperse?
have you tried setting:
performance.strict-write-ordering to on?
On 14 November 2017 at 06:24, Brett Randall <brett.randall@gmail.com> wrote:
> Hi all
>
> We've got a brand new 6-node GlusterFS 3.10 deployment (previous 20 nodes
> were GlusterFS 3.6). Running on CentOS 7 using legit repos, so
> glusterfs-3.10.7-1.el7.x86_64 is the base.
>
> Our issue is that when we create a file with a Gluster client, e.g. a Mac
> or Windows machine, it works fine. However if we copy a file from a Mac or
> Windows machine to the Samba share, it fails with a complaint that the file
> already exists, even though it doesn't (or didn't). It appears as though
> the file is tested to see if it exists, and it doesn't, so then the client
> goes and tries to create the file but at that stage it DOES exist, maybe
> something to do with the previous stat? Anyway, it is repeatable and
> killing us! NFS clients work fine on any platform, but SMB does not. There
> aren't that many client-side options for SMB mounts so the solution has to
> be server-side.
>
> Here is a pcap of the copy attempt from one computer:
>
> https://www.dropbox.com/s/yhn3s1qbxtdvnoh/sambacap.pcapng?dl=0
>
> You'll see a the request to look for the file which results in a
> STATUS_OBJECT_NAME_NOT_FOUND (good), followed by a STATUS_SHARING_VIOLATION
> (???) followed by a STATUS_OBJECT_NAME_COLLISION (bad).
>
> Here are the options from the volume:
>
> Options Reconfigured:
>
> nfs.acl: off
>
> features.cache-invalidation: on
>
> storage.batch-fsync-delay-usec: 0
>
> transport.address-family: inet6
>
> nfs.disable: on
>
> performance.stat-prefetch: off
>
> server.allow-insecure: on
>
> ganesha.enable: ganesha-nfs
>
> user.smb: enable
>
> Any thoughts on why samba isn't enjoying our copies?
>
> Thanks!
>
> Brett.
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users@gluster.org
> http://lists.gluster.org/mailman/listinfo/gluster-users
>
[Attachment #5 (text/html)]
<div dir="ltr"><div>What is the volume configuration, is it replicated, distributed, \
distribute-replicate, disperse? <br></div><div><br></div><div>have you tried \
setting:</div><div>performance.strict-write-ordering to on?<br></div></div><div \
class="gmail_extra"><br><div class="gmail_quote">On 14 November 2017 at 06:24, Brett \
Randall <span dir="ltr"><<a href="mailto:brett.randall@gmail.com" \
target="_blank">brett.randall@gmail.com</a>></span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc \
solid;padding-left:1ex"><div dir="ltr">Hi all<div><br></div><div>We've got a \
brand new 6-node GlusterFS 3.10 deployment (previous 20 nodes were GlusterFS 3.6). \
Running on CentOS 7 using legit repos, so glusterfs-3.10.7-1.el7.x86_64 is the \
base.</div><div><br></div><div>Our issue is that when we create a file with a Gluster \
client, e.g. a Mac or Windows machine, it works fine. However if we copy a file from \
a Mac or Windows machine to the Samba share, it fails with a complaint that the file \
already exists, even though it doesn't (or didn't). It appears as though the \
file is tested to see if it exists, and it doesn't, so then the client goes and \
tries to create the file but at that stage it DOES exist, maybe something to do with \
the previous stat? Anyway, it is repeatable and killing us! NFS clients work fine on \
any platform, but SMB does not. There aren't that many client-side options for \
SMB mounts so the solution has to be server-side.</div><div><br></div><div>Here is a \
pcap of the copy attempt from one computer:</div><div><br></div><div><a \
href="https://www.dropbox.com/s/yhn3s1qbxtdvnoh/sambacap.pcapng?dl=0" \
target="_blank">https://www.dropbox.com/s/<wbr>yhn3s1qbxtdvnoh/sambacap.<wbr>pcapng?dl=0</a><br></div><div><br></div><div>You'll \
see a the request to look for the file which results in a \
STATUS_OBJECT_NAME_NOT_FOUND (good), followed by a STATUS_SHARING_VIOLATION (???) \
followed by a STATUS_OBJECT_NAME_COLLISION (bad).</div><div><br></div><div>Here are \
the options from the volume:</div><div><br></div><div>
<p class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">Options Reconfigured:</span></p> \
<p class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">nfs.acl: off</span></p> <p \
class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">features.cache-invalidation: \
on</span></p> <p class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">storage.batch-fsync-delay-<wbr>usec: \
0</span></p> <p class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">transport.address-family: \
inet6</span></p> <p class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">nfs.disable: on</span></p> <p \
class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">performance.stat-prefetch: \
off</span></p> <p class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">server.allow-insecure: \
on</span></p> <p class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">ganesha.enable: \
ganesha-nfs</span></p> <p class="m_1024355695247659473gmail-p1" \
style="margin:0px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:no \
rmal;font-weight:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale \
Mono";color:rgb(40,254,20);background-color:rgba(0,0,0,0.9)"><span \
class="m_1024355695247659473gmail-s1" \
style="font-variant-ligatures:no-common-ligatures">user.smb: \
enable</span></p></div><div><br></div><div>Any thoughts on why samba isn't \
enjoying our copies?</div><div><br></div><div>Thanks!</div><span class="HOEnZb"><font \
color="#888888"><div><br></div><div>Brett.</div></font></span></div> \
<br>______________________________<wbr>_________________<br> Gluster-users mailing \
list<br> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" \
target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br></blockquote></div><br></div>
_______________________________________________
Gluster-users mailing list
Gluster-users@gluster.org
http://lists.gluster.org/mailman/listinfo/gluster-users
[prev in list] [next in list] [prev in thread] [next in thread]
Configure |
About |
News |
Add a list |
Sponsored by KoreLogic