[prev in list] [next in list] [prev in thread] [next in thread] 

List:       zeromq-dev
Subject:    Re: [zeromq-dev] ZMQ TCP optimization
From:       Martin Hurton <hurtonm () gmail ! com>
Date:       2013-06-30 7:19:13
Message-ID: CALdZE=tJGnde1RFDR1=FcWN9T-XyVprEt7u173SGRiQjaLZZuw () mail ! gmail ! com
[Download RAW message or body]

Hi Ori, thanks for update. I pushed a patch that may affect the TCP
window scale option. Could you try with master and let me know if it
affects the throughput? Thanks.

- Martin

On Thu, Jun 27, 2013 at 6:37 PM, Ori Barak <oribarak@microsoft.com> wrote:
> Got the problem solved.
> 
> One of the machines had the auto scaling option disabled. I enabled it and also set \
> big value to the sender\receiver buffer size and I got much higher QPS now. 
> Thanks,
> Ori
> 
> -----Original Message-----
> From: zeromq-dev-bounces@lists.zeromq.org \
>                 [mailto:zeromq-dev-bounces@lists.zeromq.org] On Behalf Of Ori Barak
> Sent: Wednesday, June 26, 2013 7:02 PM
> To: ZeroMQ development list
> Subject: Re: [zeromq-dev] ZMQ TCP optimization
> 
> Hi,
> 
> Thanks for the help Martin,
> Enclosed are first couple in pcapng format hope it's fine.
> 
> It looks as if windo size scaling factor is -2 (no window scaling used). I've tried \
> not using the SND\RECVBUF option and also tried setting it with very high value but \
> didn't see any difference. 
> Thanks,
> Ori
> 
> -----Original Message-----
> From: zeromq-dev-bounces@lists.zeromq.org \
>                 [mailto:zeromq-dev-bounces@lists.zeromq.org] On Behalf Of Martin \
>                 Hurton
> Sent: Wednesday, June 26, 2013 2:37 PM
> To: ZeroMQ development list
> Subject: Re: [zeromq-dev] ZMQ TCP optimization
> 
> Hi Ori, could you please capture the first 10 packets when you connect to the \
> remote server for me. I would like to check something. Thanks. 
> - mh
> 
> On Wed, Jun 26, 2013 at 10:05 AM, Ori Barak <oribarak@microsoft.com> wrote:
> > Hi,
> > 
> > 
> > 
> > I have an application running on windows using ZMQ Push\Pull TCP sockets.
> > 
> > The client\server machines I use have a 1 GB bandwidth.
> > 
> > When sending messages between 2 close servers (round trip time <1ms) I
> > get a rate of about  ~110MB/sec. When sending messages between two
> > remote servers (round trip ~70ms) I get ~1.5MB/sec. I was under the
> > impression that the RTT shouldn't affect much on the throughput since
> > the TCP window scaling option is enabled in windows by default
> > (http://en.wikipedia.org/wiki/TCP_window_scale_option ) thus window
> > size can increase up to 1,073,725,440 bytes which basically means the
> > RTT should have little effect.
> > 
> > 
> > 
> > If I open multiple channels on the client side on the same destination
> > port I can get more utilization but I would rather have a single
> > channel working faster.
> > 
> > 
> > 
> > Any ZMQ\TCP configuration I can change to increase network utilization?
> > 
> > 
> > 
> > Thanks,
> > 
> > Ori
> > 
> > 
> > 
> > 
> > 
> > 
> > _______________________________________________
> > zeromq-dev mailing list
> > zeromq-dev@lists.zeromq.org
> > http://lists.zeromq.org/mailman/listinfo/zeromq-dev
> > 
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
> _______________________________________________
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
_______________________________________________
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev


[prev in list] [next in list] [prev in thread] [next in thread]