[prev in list] [next in list] [prev in thread] [next in thread]
List: usrp-users
Subject: Re: [USRP-users] about 10 Gig ethernet configuration
From: =?windows-1252?Q?Marcus_M=FCller?= via USRP-users <usrp-users () lists ! ettus ! com>
Date: 2015-10-27 17:16:17
Message-ID: 562FB161.4080608 () ettus ! com
[Download RAW message or body]
[Attachment #2 (multipart/alternative)]
That's a trick worth keeping! Thanks.
On 10/27/2015 04:18 PM, Peter Witkowski via USRP-users wrote:
> We were having similar issues on our end.
>
> I ended up needing to maximize the number of descriptors used by the
> Intel driver. Dropped packets (Ds) went away totally.
>
> Here's the command (where ethN is the connection to your USRP):
> ethtool -G ethN rx 4096 tx 4096
>
> -Pete Witkowski
>
> On Mon, Oct 26, 2015 at 4:05 AM, Michael West via USRP-users
> <usrp-users@lists.ettus.com <mailto:usrp-users@lists.ettus.com>> wrote:
>
> Hi Sanjoy,
>
> I agree with Marcus. It looks like the governor is not working.
> The performance governor should be setting the CPU frequency to
> its highest value.
>
> Try setting the frequency by running:
> > cpufreq-set -r -f 3200000000
> or setting the min frequency by running:
> > cpufreq-set -r -d 3200000000
>
> Regards,
> Michael
>
> On Mon, Oct 26, 2015 at 12:43 AM, Sanjoy Basak
> <sanjoybasak14@gmail.com <mailto:sanjoybasak14@gmail.com>> wrote:
>
> Hi Michael,
> The OS is native. Ubuntu 14.4.3.
>
>
> On Mon, Oct 26, 2015 at 9:37 AM, Michael West
> <michael.west@ettus.com <mailto:michael.west@ettus.com>> wrote:
>
> Is the OS native or are you using a virtual machine?
>
> On Sun, Oct 25, 2015 at 1:30 PM, Marcus Müller
> <marcus.mueller@ettus.com
> <mailto:marcus.mueller@ettus.com>> wrote:
>
> Hm, that looks as if the CPU governor doesn't actually
> do its job...
>
> On 25.10.2015 17:44, Sanjoy Basak wrote:
> > Hi Marcus,
> > Thanks for the reply.
> >
> > I tried this
> > sudo sysctl -w net.core.wmem_max = 536870912
> > sudo sysctl -w net.core.rmem_max = 536870912
> >
> > Now
> > net.core.rmem_max = 536870912
> > net.core.wmem_max = 536870912
> >
> > Even now it shows drop at 25 MSps as previous.
> >
> > I tried cpufreq-info again. It's always at
> > performance. However, the cpu freq at different core
> > is different. I am also putting the output here. Is
> > it making any issue? Should the cpufreq at each core
> > be at maximum?
> >
> > analyzing CPU 0:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 0
> > CPUs which need to have their frequency coordinated
> > by software: 0
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 1.85 GHz.
> > analyzing CPU 1:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 1
> > CPUs which need to have their frequency coordinated
> > by software: 1
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.24 GHz.
> > analyzing CPU 2:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 2
> > CPUs which need to have their frequency coordinated
> > by software: 2
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.25 GHz.
> > analyzing CPU 3:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 3
> > CPUs which need to have their frequency coordinated
> > by software: 3
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.77 GHz.
> > analyzing CPU 4:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 4
> > CPUs which need to have their frequency coordinated
> > by software: 4
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.18 GHz.
> > analyzing CPU 5:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 5
> > CPUs which need to have their frequency coordinated
> > by software: 5
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 1.95 GHz.
> > analyzing CPU 6:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 6
> > CPUs which need to have their frequency coordinated
> > by software: 6
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.12 GHz.
> > analyzing CPU 7:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 7
> > CPUs which need to have their frequency coordinated
> > by software: 7
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.39 GHz.
> > analyzing CPU 8:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 8
> > CPUs which need to have their frequency coordinated
> > by software: 8
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.53 GHz.
> > analyzing CPU 9:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 9
> > CPUs which need to have their frequency coordinated
> > by software: 9
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.79 GHz.
> > analyzing CPU 10:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 10
> > CPUs which need to have their frequency coordinated
> > by software: 10
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.24 GHz.
> > analyzing CPU 11:
> > driver: intel_pstate
> > CPUs which run at the same hardware frequency: 11
> > CPUs which need to have their frequency coordinated
> > by software: 11
> > maximum transition latency: 0.97 ms.
> > hardware limits: 1.20 GHz - 3.20 GHz
> > available cpufreq governors: performance, powersave
> > current policy: frequency should be within 1.20 GHz
> > and 3.20 GHz.
> > The governor "performance" may
> > decide which speed to use
> > within this range.
> > current CPU frequency is 2.21 GHz.
> >
> >
> > Best regards
> > Sanjoy
> >
> > On Sun, Oct 25, 2015 at 10:22 AM, Marcus Müller
> > <marcus.mueller@ettus.com
> > <mailto:marcus.mueller@ettus.com>> wrote:
> >
> > Hi Sanjoy,
> >
> > Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
> > eth2 9000 0 1084 0 0 0 1153 0 0 0 BMRU
> >
> >
> > You get 1153 packets that were dropped due to not
> > being picked up on RX side.
> > I was first not quite sure who really defines
> > this value, whether it's the network hardware or
> > the linux kernel itself, but after reading
> > netstat code and linux kernel code, it seems that
> > netstat kind of mislabels what is called
> > "rx_fifo_errors" in the kernel as "RX-OVR". That
> > didn't make things more intuitive researching
> > (because of course there's also a overrun field
> > in the stats struct in the netdev in the kernel... ).
> > The good news: rx_fifo_errors is not something
> > the Intel ixgbe driver modifies -- which means it
> > doesn't seem to be a hardware counter on packets
> > that weren't fetched from the card.
> >
> > So, could you share what
> >
> > sysctl net.core.rmem_max net.core.wmem_max
> >
> >
> > says? It's the maximum memory that your linux
> > might allocate for receive and transmit buffers
> > on the card.
> >
> > sudo sysctl -w net.core.rmem_max $(( 512 * 2**20 ))
> > sudo sysctl -w net.core.wmem_max $(( 512 * 2**20 ))
> >
> > should set the sizes to 512MB (cave: only til
> > next reboot). Could you try with that?
> >
> > Best regards,
> > Marcus
> >
> >
> > On 24.10.2015 18:28, Sanjoy Basak wrote:
> > > Hi Marcus,
> > > Thanks a lot for the quick reply. The kernel
> > > version is 3.19.0-31-generic
> > >
> > > I just checked again at 30s, 25MSps. I got 4 D
> > > and 5 D for 2 consecutive initiations.
> > >
> > > *@30sec*
> > >
> > > Setting RX Rate: 25.000000 Msps...
> > >
> > > Actual RX Rate: 25.000000 Msps...
> > >
> > > Setting RX Freq: 2000.000000 MHz...
> > >
> > > Actual RX Freq: 2000.000000 MHz...
> > >
> > > Waiting for "lo_locked": ++++++++++ locked.
> > >
> > > Press Ctrl + C to stop streaming...
> > >
> > > DGot an overflow indication. Please consider the
> > > following:
> > >
> > > Your write medium must sustain a rate of
> > > 100.000000MB/s.
> > >
> > > Dropped samples will not be written to the file.
> > >
> > > Please modify this example for your purposes.
> > >
> > > This message will not appear again.
> > >
> > > DDDD
> > >
> > > Done!
> > >
> > >
> > > *@240 sec*
> > >
> > > Setting RX Rate: 25.000000 Msps...
> > >
> > > Actual RX Rate: 25.000000 Msps...
> > >
> > > Setting RX Freq: 2000.000000 MHz...
> > >
> > > Actual RX Freq: 2000.000000 MHz...
> > >
> > > Waiting for "lo_locked": ++++++++++ locked.
> > >
> > > Press Ctrl + C to stop streaming...
> > >
> > > DGot an overflow indication. Please consider the
> > > following:
> > >
> > > Your write medium must sustain a rate of
> > > 100.000000MB/s.
> > >
> > > Dropped samples will not be written to the file.
> > >
> > > Please modify this example for your purposes.
> > >
> > > This message will not appear again.
> > >
> > > DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD
> > >
> > > Done!
> > >
> > >
> > > This is the netstat right after restarting the
> > > computer
> > >
> > > netstat -i eth2
> > >
> > > Kernel Interface table
> > >
> > > Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK
> > > TX-ERR TX-DRP TX-OVR Flg
> > >
> > > eth0 1500 0 9 0 0 0 26 0 0 0 BMRU
> > >
> > > eth1 1500 0 0 0 0 0 0 0 0 0 BMU
> > >
> > > eth2 9000 0 1084 0 0 0 1153 0 0 0 BMRU
> > >
> > > lo 65536 0 177 0 0 0 177 0 0 0 L
> > >
> > >
> > > And this is netstat after
> > >
> > > ./rx_samples_to_file --duration 240 --rate 200e6
> > > --freq=2e9 --file /dev/null
> > >
> > > which gave a lot of D (did not count how many
> > > but a lot)
> > >
> > > Kernel Interface table
> > >
> > > Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK
> > > TX-ERR TX-DRP TX-OVR Flg
> > >
> > > eth0 1500 0 94 0 0 0 30 0 0 0 BMRU
> > >
> > > eth1 1500 0 0 0 0 0 0 0 0 0 BMU
> > >
> > > eth2 9000 0 24190524 936 0 0 355025 0 0 0 BMRU
> > >
> > > lo 65536 0 183 0 0 0 183 0 0 0 LRU
> > >
> > >
> > > Best regards
> > >
> > > Sanjoy
> > >
> > >
> > >
> > >
> > > On Sat, Oct 24, 2015 at 5:31 PM, Marcus Müller
> > > <marcus.mueller@ettus.com
> > > <mailto:marcus.mueller@ettus.com>> wrote:
> > >
> > > Hi Sanjoy,
> > >
> > > Two observations:
> > > Your routing table looks fine.
> > >
> > > Then, these rx_samples... results are
> > > interesting. Basically, 30s of 200MS/s are 8
> > > times the amount of packets as 30s at
> > > 25MS/s; however the former produces 53
> > > sequence errors, and the latter only 3.
> > > That's off by a factor of 2. To verify,
> > > could you try 240s at 25MS/s?
> > > If this holds, the sequence errors would
> > > seem to be load-related. Kernel version
> > > currently used (uname -r)?
> > > Let's analyze where things go missing. Could
> > > you compare the output of "netstat -i eth2"
> > > before and after a rx_samples_to_file run
> > > that produced lots of D?
> > >
> > > Best regards,
> > > Marcus
> > >
> > >
> > > Am 24. Oktober 2015 15:58:28 MESZ, schrieb
> > > Sanjoy Basak <sanjoybasak14@gmail.com
> > > <mailto:sanjoybasak14@gmail.com>>:
> > >
> > > Hi Micheal,
> > > I made the cpu governor to performance.
> > > This is always performance now, does not
> > > change. We did not buy the cable from
> > > ettus.
> > > We bought DeLOCK Twinaxial-Kabel SFP+ M
> > > SFP+ M 3,0m SFF-8431 86222 from a store
> > > here.
> > >
> > > Hi Rob,
> > > Thanks for the command. I am not really
> > > sure which cable you used. But I am
> > > still having drop of packets. I don't
> > > have any other cable right now to test.
> > >
> > >
> > > Hi Marcus,
> > > I tried your suggestions. I put the
> > > output here.
> > >
> > > *ip route *
> > >
> > > 192.168.40.0/24 <http://192.168.40.0/24>
> > > dev eth2 proto kernel scope link src
> > > 192.168.40.1 metric 1
> > >
> > >
> > > I don't get any drop at this.
> > >
> > > rx_samples_to_file --rate 200e6 --file
> > > /dev/null --nsamps $(( 2 * 1000 * 1000 ))
> > >
> > > Setting RX Rate: 200.000000 Msps...
> > >
> > > Actual RX Rate: 200.000000 Msps...
> > >
> > > Setting RX Freq: 0.000000 MHz...
> > >
> > > Actual RX Freq: 340.000000 MHz...
> > >
> > > Waiting for "lo_locked": ++++++++++ locked.
> > >
> > > Done!
> > >
> > >
> > > However with
> > >
> > > ./rx_samples_to_file --duration 30
> > > --rate 200e6 --freq=2e9 --file /dev/null
> > >
> > > Setting RX Rate: 200.000000 Msps...
> > >
> > > Actual RX Rate: 200.000000 Msps...
> > >
> > > Setting RX Freq: 2000.000000 MHz...
> > >
> > > Actual RX Freq: 2000.000000 MHz...
> > >
> > > Waiting for "lo_locked": ++++++++++ locked.
> > >
> > > Press Ctrl + C to stop streaming...
> > >
> > > DGot an overflow indication. Please
> > > consider the following:
> > >
> > > Your write medium must sustain a rate of
> > > 800.000000MB/s.
> > >
> > > Dropped samples will not be written to
> > > the file.
> > >
> > > Please modify this example for your
> > > purposes.
> > >
> > > This message will not appear again.
> > >
> > > DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD
> > >
> > >
> > > Done!
> > >
> > >
> > > Even at 25 MSps I got drop of packet
> > >
> > > ./rx_samples_to_file --duration 30
> > > --rate 25e6 --freq=2e9 --file /dev/null
> > >
> > > Setting RX Rate: 25.000000 Msps...
> > >
> > > Actual RX Rate: 25.000000 Msps...
> > >
> > > Setting RX Freq: 2000.000000 MHz...
> > >
> > > Actual RX Freq: 2000.000000 MHz...
> > >
> > > Waiting for "lo_locked": ++++++++++ locked.
> > >
> > > Press Ctrl + C to stop streaming...
> > >
> > > DGot an overflow indication. Please
> > > consider the following:
> > >
> > > Your write medium must sustain a rate
> > > of 100.000000MB/s.
> > >
> > > Dropped samples will not be written to
> > > the file.
> > >
> > > Please modify this example for your
> > > purposes.
> > >
> > > This message will not appear again.
> > >
> > > DD
> > >
> > > Done!
> > >
> > >
> > > But with 1 Gig interface with 25 MSps I
> > > am not getting any drop
> > >
> > > ./rx_samples_to_file --duration 30
> > > --rate 25e6 --freq=2e9 --file /dev/null
> > >
> > > Setting RX Rate: 25.000000 Msps...
> > >
> > > Actual RX Rate: 25.000000 Msps...
> > >
> > > Setting RX Freq: 2000.000000 MHz...
> > >
> > > Actual RX Freq: 2000.000000 MHz...
> > >
> > > Waiting for "lo_locked": ++++++++++ locked.
> > >
> > > Press Ctrl + C to stop streaming...
> > >
> > > Done!
> > >
> > >
> > > I hope raid is not making an issue here,
> > > as I don't see any indication when I
> > > tried with 1 Gig interface.
> > >
> > > Please let me know from seeing the
> > > output what you think making the trouble.
> > >
> > >
> > > Best regards
> > > Sanjoy
> > >
> > >
> > > On Sat, Oct 24, 2015 at 1:48 AM, Michael
> > > West <michael.west@ettus.com
> > > <mailto:michael.west@ettus.com>> wrote:
> > >
> > > I was corrected regarding the 10 GbE
> > > copper cables. The long copper
> > > cables were failing our tests due to
> > > a bug in the IP used for the 10 GbE
> > > in the FPGA image that has since
> > > been resolved. We are currently
> > > using cables up to 3m with no
> > > problems. We have found some 5m
> > > cables work and some don't depending
> > > on the quality of the cable. The 10
> > > GbE cables and NICs sold on the
> > > Ettus website all work well.
> > >
> > > Regards,
> > > Michael
> > >
> > >
> > >
> > >
> > > On Fri, Oct 23, 2015 at 3:47 PM,
> > > Marcus Müller
> > > <marcus.mueller@ettus.com
> > > <mailto:marcus.mueller@ettus.com>>
> > > wrote:
> > >
> > > So to understand this
> > >
> > > TX much more stable than RX, and
> > > RX showing not a single "O" (a
> > > proper overflow) but a lot of
> > > "D" packet errors (which are, in
> > > fact, either very serious packet
> > > losses, or package reordering).
> > > It's probably the cable, or your
> > > network stack might be up to no
> > > good.
> > >
> > > Could you share the output of
> > >
> > > ip route
> > >
> > > Also, it's possible that some
> > > default firewall rule makes your
> > > CPU break a sweat; you could try
> > > to bypass firewall for the eth2
> > > device
> > >
> > > sudo iptables -A INPUT -i eth2
> > > -j ACCEPT
> > >
> > > (this is *not* permanent).
> > > If that doesn't help, maybe
> > > inspecting the packets captured
> > > with "wireshark" might help. For
> > > example, set up wireshark to
> > > listen to eth2, power up the
> > > USRP; you should see a few
> > > packets being exchanged on the
> > > interface.
> > > Then run
> > >
> > > rx_samples_to_file --rate 200e6
> > > --file /dev/null --nsamps $(( 2
> > > * 1000 * 1000 ))
> > >
> > > then stop the capture. Did you
> > > see "D"s? If yes, I'd like to
> > > have a look at the captured
> > > data; please save it. We'll
> > > figure out a way to exchange it.
> > >
> > > Best regards,
> > > Marcus
> > > On 23.10.2015 21:21, Sanjoy
> > > Basak wrote:
> > > > Hi Michael, Neel and Marcus,
> > > >
> > > > Thanks a lot for the
> > > > suggestions. I tried each of
> > > > those.
> > > > I updated the kernel to
> > > > 3.19.0-31-generic.
> > > >
> > > > CPU governors, I set to
> > > > performance as instruction
> > > > given in this link.
> > > > http://files.ettus.com/manual/page_usrp_x3x0_config.html#x3x0cfg_hostpc_pwr
> > > > Now, after setting it to
> > > > performance and restarting, if
> > > > I check with cpu-freq, I find
> > > > all governers are set at
> > > > performance. But after a
> > > > while(5/10 mins later) if I
> > > > check again cpu-freq info, I
> > > > see all governers are set to
> > > > powersave.
> > > > Could you please tell me why
> > > > and how to configure it properly?
> > > >
> > > > I tried with benchmark_rate to
> > > > check the performance. With
> > > > tx-rate till 200 MSps I do not
> > > > get any overflow/underflow.
> > > > However with rx-rate 25/50/100
> > > > MSps I get drop of packets. I
> > > > made a direct connection from
> > > > computer to the X310. No switch
> > > > is used.
> > > >
> > > > On the contrary with
> > > > shorter(copper) cable at 1Gig
> > > > interface I do not get any drop
> > > > of packets at 25MSps (on both
> > > > tx_rate and rx_rate).
> > > > Is 3m copper cable really bad?
> > > >
> > > > We don't have fibre cable right
> > > > now. We already ordered. I hope
> > > > we will get it next week and
> > > > check how it is. We don't have
> > > > any SFP+ 10 Gig interface. So
> > > > can't really test 10 gig
> > > > interface with short 10 gig
> > > > copper cable.
> > > >
> > > > These are the benchmark_rate
> > > > results for 10 Gig interface
> > > >
> > > >
> > > > Testing receive rate 25.000000
> > > > Msps on 1 channels
> > > > DDDDDDDD
> > > > Benchmark rate summary:
> > > > Num received samples:
> > > > 249845308
> > > > Num dropped samples: 15968
> > > > Num overflows detected: 0
> > > > Num transmitted samples: 0
> > > > Num sequence errors: 0
> > > > Num underflows detected: 0
> > > >
> > > >
> > > > Testing receive rate 100.000000
> > > > Msps on 1 channels
> > > > DDDDDDDDDDDDDDDDDDDDD
> > > > Benchmark rate summary:
> > > > Num received samples:
> > > > 999934124
> > > > Num dropped samples: 41916
> > > > Num overflows detected: 0
> > > > Num transmitted samples: 0
> > > > Num sequence errors: 0
> > > > Num underflows detected: 0
> > > >
> > > > I also used this command
> > > > sudo ethtool -C eth2 rx-usecs
> > > > 16 rx-frames 20
> > > >
> > > > Please let me know what you
> > > > think occurring the problem and
> > > > whether replacing copper cable
> > > > with short fibre cable solves
> > > > the problem.
> > > >
> > > > Best regards
> > > > Sanjoy
> > > >
> > > >
> > > > On Wed, Oct 21, 2015 at 12:27
> > > > PM, Marcus Müller
> > > > <usrp-users@lists.ettus.com
> > > > <mailto:usrp-users@lists.ettus.com>>
> > > > wrote:
> > > >
> > > > Hi Sanjoy,
> > > >
> > > > furthermore, and I found
> > > > that to be crucial on my
> > > > system, you should make
> > > > sure that your 10GE card
> > > > doesn't generate an
> > > > interrupt for every packet
> > > > it receives (your
> > > > application will pull these
> > > > packets as fast as
> > > > possible, anyway).
> > > > On linux, you'd do
> > > >
> > > > sudo ethtool -c {name of
> > > > ethernet interface, e.g. eth1}
> > > >
> > > > to see the coalescing
> > > > options available with your
> > > > device and kernel version,
> > > > and modify a setting using
> > > >
> > > > sudo ethtool -C {name of
> > > > ethernet interface, e.g.
> > > > eth1} {name of setting}
> > > > {new value of setting}
> > > >
> > > > For example, I set
> > > > "rx_usecs" (microseconds to
> > > > wait between triggering an
> > > > interrupt) to 16, and
> > > > "rx_frames" to 20 or so --
> > > > your milage might vary,
> > > > depending on your
> > > > application, OS and also a
> > > > few hardware factors.
> > > >
> > > > Best regards,
> > > > Marcus
> > > >
> > > >
> > > > On 19.10.2015 21:56,
> > > > Michael West via USRP-users
> > > > wrote:
> > > > > Also, check the CPU
> > > > > governor and make sure it
> > > > > is set to "performance".
> > > > >
> > > > > Your output indicates
> > > > > frame errors on the
> > > > > interface, which could be
> > > > > due to the cable. If
> > > > > possible, try using a
> > > > > shorter copper cable or
> > > > > switch to a fibre cable.
> > > > > With 10 GbE over copper,
> > > > > the shorter the better.
> > > > > If you need the length,
> > > > > you should be using fibre.
> > > > >
> > > > > If you still have issues,
> > > > > please provide a little
> > > > > more information: Are you
> > > > > connected directly with
> > > > > the X310 or through a
> > > > > switch? How are you
> > > > > testing the performance?
> > > > > Are you using your own
> > > > > application or
> > > > > benchmark_rate? If your
> > > > > own application, what is
> > > > > it doing with the received
> > > > > data (processing it with
> > > > > the same thread or
> > > > > different thread, saving
> > > > > to disk, etc...)?
> > > > >
> > > > > Regards,
> > > > > Michael
> > > > >
> > > > > On Mon, Oct 19, 2015 at
> > > > > 12:51 PM, Neel Pandeya via
> > > > > USRP-users
> > > > > <usrp-users@lists.ettus.com <mailto:usrp-users@lists.ettus.com>>
> > > > > wrote:
> > > > >
> > > > > Hello Sanjoy:
> > > > >
> > > > > That Intel X520 10GbE
> > > > > card with Ubuntu
> > > > > 14.04.3 should be
> > > > > working well for you.
> > > > >
> > > > > Could you try
> > > > > upgrading to kernel
> > > > > 3.16 or 3.19, and let
> > > > > us know your results?
> > > > >
> > > > > To upgrade to kernel
> > > > > 3.16, run "sudo
> > > > > apt-get install
> > > > > linux-generic-lts-utopic".
> > > > >
> > > > > To upgrade to kernel
> > > > > 3.19, run "sudo
> > > > > apt-get install
> > > > > linux-generic-lts-vivid".
> > > > >
> > > > > After the upgrade, be
> > > > > sure to reboot the system.
> > > > >
> > > > > Also, check that you
> > > > > have the CPU governors
> > > > > set to "performance",
> > > > > and that you have the
> > > > > highest clock rate set.
> > > > >
> > > > > --Neel
> > > > >
> > > > >
> > > > >
> > > > > On 19 October 2015 at
> > > > > 12:03, Sanjoy Basak
> > > > > via USRP-users
> > > > > <usrp-users@lists.ettus.com
> > > > > <mailto:usrp-users@lists.ettus.com>>
> > > > > wrote:
> > > > >
> > > > > Hi Experts,
> > > > > We recently bought
> > > > > a 10 Gig ethernet
> > > > > card (X510-DA2)
> > > > > and Twinaxial-Kabel SFP+
> > > > > M SFP+ M 3,0m. I
> > > > > installed it in
> > > > > our pc (OS: Ubuntu
> > > > > Mate 14.04.3 LTS)
> > > > > and can
> > > > > communicate with
> > > > > X310/SBX-120
> > > > > properly. However,
> > > > > the performance we
> > > > > are getting is
> > > > > quite poor. I am
> > > > > getting dropped
> > > > > packets (D O)
> > > > > mostly at 25,50
> > > > > MSps and goes
> > > > > quite crazy at 100
> > > > > MSps and sometimes
> > > > > even at lower
> > > > > sample rates.
> > > > > Previously I
> > > > > tested with 1 Gig
> > > > > ethernet, at 25
> > > > > MSps I could
> > > > > stream without any
> > > > > drop/late packet
> > > > > or underrun.
> > > > > The CPU uses or
> > > > > network uses is
> > > > > also not reaching
> > > > > 100%.
> > > > >
> > > > > Could you please
> > > > > tell me what to
> > > > > check/correct so I
> > > > > can stream at 100
> > > > > MSps without any
> > > > > error?
> > > > >
> > > > > I am putting the
> > > > > ifconfig and
> > > > > ethtool results
> > > > > and the kernel
> > > > > version(3.16.0-30-generic)
> > > > >
> > > > > eth2 Link
> > > > > encap:Ethernet
> > > > > HWaddr
> > > > > 90:e2:ba:a6:a9:dd
> > > > > inet6
> > > > > addr:
> > > > > fe80::92e2:baff:fea6:a9dd/64
> > > > > Scope:Link
> > > > > UP
> > > > > BROADCAST
> > > > > MULTICAST
> > > > > MTU:9000 Metric:1
> > > > > RX
> > > > > packets:4530726
> > > > > errors:146
> > > > > dropped:0
> > > > > overruns:0 frame:146
> > > > > TX
> > > > > packets:6811057
> > > > > errors:0 dropped:0
> > > > > overruns:0 carrier:0
> > > > >
> > > > > collisions:0
> > > > > txqueuelen:1000
> > > > > RX
> > > > > bytes:26331306938
> > > > > (26.3 GB) TX
> > > > > bytes:35856233935
> > > > > (35.8 GB)
> > > > >
> > > > > Settings for eth2:
> > > > > Supported ports: [
> > > > > FIBRE ]
> > > > > Supported link
> > > > > modes:
> > > > > 10000baseT/Full
> > > > > Supported pause
> > > > > frame use: No
> > > > > Supports
> > > > > auto-negotiation: No
> > > > > Advertised link
> > > > > modes:
> > > > > 10000baseT/Full
> > > > > Advertised pause
> > > > > frame use: No
> > > > > Advertised
> > > > > auto-negotiation: No
> > > > > Speed: 10000Mb/s
> > > > > Duplex: Full
> > > > > Port: Other
> > > > > PHYAD: 0
> > > > > Transceiver: external
> > > > > Auto-negotiation: off
> > > > > Cannot get
> > > > > wake-on-lan
> > > > > settings:
> > > > > Operation not
> > > > > permitted
> > > > > Current message
> > > > > level: 0x00000007 (7)
> > > > > drv probe link
> > > > > Link detected: yes
> > > > >
> > > > > Our computer
> > > > > config is:
> > > > > Processor:
> > > > > 12*Intel(R) Xeon
> > > > > (R) CPU E5-2620 v3
> > > > > @2.40 GHz
> > > > > RAM: 65871 MB
> > > > > SSD raid 5
> > > > >
> > > > >
> > > > > Best regards
> > > > > Sanjoy
> > > > >
> > > > > _______________________________________________
> > > > > USRP-users mailing
> > > > > list
> > > > > USRP-users@lists.ettus.com
> > > > > <mailto:USRP-users@lists.ettus.com>
> > > > > http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com
> > > > >
> > > > >
> > > > >
> > > > > _______________________________________________
> > > > > USRP-users mailing list
> > > > > USRP-users@lists.ettus.com
> > > > > <mailto:USRP-users@lists.ettus.com>
> > > > > http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > _______________________________________________
> > > > > USRP-users mailing list
> > > > > USRP-users@lists.ettus.com <mailto:USRP-users@lists.ettus.com>
> > > > > http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com
> > > >
> > > >
> > > > _______________________________________________
> > > > USRP-users mailing list
> > > > USRP-users@lists.ettus.com
> > > > <mailto:USRP-users@lists.ettus.com>
> > > > http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com
> > > >
> > > >
> > >
> > >
> > >
> > >
> > > --
> > > Sent from my Android device with K-9 Mail.
> > > Please excuse my brevity.
> > >
> > >
> >
> >
>
>
>
>
>
> _______________________________________________
> USRP-users mailing list
> USRP-users@lists.ettus.com <mailto:USRP-users@lists.ettus.com>
> http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com
>
>
>
> _______________________________________________
> USRP-users mailing list
> USRP-users@lists.ettus.com
> http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com
[Attachment #5 (text/html)]
<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
That's a trick worth keeping! Thanks.<br>
<br>
<div class="moz-cite-prefix">On 10/27/2015 04:18 PM, Peter Witkowski
via USRP-users wrote:<br>
</div>
<blockquote
cite="mid:CAN1Qg3OY6uU0q5vuQ012MWqL1zPwFx6DawbEErd_+qzC-dvA+Q@mail.gmail.com"
type="cite">
<div dir="ltr">
<div>
<div>
<div>We were having similar issues on our end.<br>
<br>
</div>
I ended up needing to maximize the number of descriptors
used by the Intel driver. Dropped packets (Ds) went away
totally.<br>
<br>
</div>
Here's the command (where ethN is the connection to your
USRP):<br>
</div>
<pre>ethtool -G ethN rx 4096 tx 4096</pre>
<div>
<div>
<div>
<div>
<div class="gmail_extra"><br>
</div>
<div class="gmail_extra">-Pete Witkowski<br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Oct 26, 2015 at 4:05
AM, Michael West via USRP-users <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:usrp-users@lists.ettus.com"
target="_blank">usrp-users@lists.ettus.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px
0px 0px 0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div>Hi Sanjoy,</div>
<div><br>
</div>
<div>I agree with Marcus. It looks like the
governor is not working. The performance
governor should be setting the CPU frequency
to its highest value.</div>
<div><br>
</div>
<div>Try setting the frequency by running:</div>
<div>> cpufreq-set -r -f 3200000000</div>
<div>or setting the min frequency by running:</div>
<div>> cpufreq-set -r -d 3200000000</div>
<div><br>
</div>
<div>Regards,</div>
<div>Michael</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Oct 26, 2015 at
12:43 AM, Sanjoy Basak <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:sanjoybasak14@gmail.com"
target="_blank">sanjoybasak14@gmail.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div dir="ltr">Hi Michael,
<div>The OS is native. Ubuntu 14.4.3. </div>
<div><br>
</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Mon, Oct 26,
2015 at 9:37 AM, Michael West <span
dir="ltr"><<a
moz-do-not-send="true"
href="mailto:michael.west@ettus.com"
\
target="_blank">michael.west@ettus.com</a>></span> wrote:<br>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;padding-left:1ex;border-left:1px
solid rgb(204,204,204)">
<div dir="ltr">Is the OS native or are
you using a virtual machine?</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Oct
25, 2015 at 1:30 PM, Marcus Müller
<span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:marcus.mueller@ettus.com"
\
target="_blank">marcus.mueller@ettus.com</a>></span> wrote:<br>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;padding-left:1ex;border-left:1px
solid rgb(204,204,204)">
<div bgcolor="#FFFFFF"
text="#000000"> Hm, that looks
as if the CPU governor doesn't
actually do its job...<br>
<br>
<div>On 25.10.2015 17:44,
Sanjoy Basak wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Marcus,
<div>Thanks for the reply.</div>
<div><br>
<div>I tried this </div>
<div>sudo sysctl -w
net.core.wmem_max =
536870912<br>
</div>
<div>sudo sysctl -w
net.core.rmem_max =
536870912<br>
</div>
<div><br>
</div>
<div>Now </div>
<div>
<div>net.core.rmem_max
= 536870912</div>
<div>net.core.wmem_max
= 536870912</div>
</div>
<div><br>
</div>
<div>Even now it shows
drop at 25 MSps as
previous.</div>
<div><br>
</div>
<div>I tried
cpufreq-info again.
It's always at
performance. However,
the cpu freq at
different core is
different. I am also
putting the output
here. Is it making any
issue? Should the
cpufreq at each core
be at maximum?</div>
</div>
<div><br>
</div>
<div>
<div>analyzing CPU 0:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 0</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 0</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 1.85 GHz.</div>
<div>analyzing CPU 1:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 1</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 1</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.24 GHz.</div>
<div>analyzing CPU 2:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 2</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 2</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.25 GHz.</div>
<div>analyzing CPU 3:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 3</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 3</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.77 GHz.</div>
<div>analyzing CPU 4:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 4</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 4</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.18 GHz.</div>
<div>analyzing CPU 5:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 5</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 5</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 1.95 GHz.</div>
<div>analyzing CPU 6:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 6</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 6</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.12 GHz.</div>
<div>analyzing CPU 7:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 7</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 7</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.39 GHz.</div>
<div>analyzing CPU 8:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 8</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 8</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.53 GHz.</div>
<div>analyzing CPU 9:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 9</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 9</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.79 GHz.</div>
<div>analyzing CPU 10:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 10</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 10</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.24 GHz.</div>
<div>analyzing CPU 11:</div>
<div> driver:
intel_pstate</div>
<div> CPUs which run at
the same hardware
frequency: 11</div>
<div> CPUs which need
to have their
frequency coordinated
by software: 11</div>
<div> maximum
transition latency:
0.97 ms.</div>
<div> hardware limits:
1.20 GHz - 3.20 GHz</div>
<div> available cpufreq
governors:
performance, powersave</div>
<div> current policy:
frequency should be
within 1.20 GHz and
3.20 GHz.</div>
<div>
The governor
"performance" may
decide which speed to
use</div>
<div>
within this range.</div>
<div> current CPU
frequency is 2.21 GHz.</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Best regards</div>
<div>Sanjoy</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On
Sun, Oct 25, 2015 at
10:22 AM, Marcus Müller
<span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:marcus.mueller@ettus.com" \
target="_blank">marcus.mueller@ettus.com</a>></span> wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px 0px
0px
\
0.8ex;padding-left:1ex;border-left:1px solid
rgb(204,204,204)">
<div bgcolor="#FFFFFF"
text="#000000"> Hi
Sanjoy,<br>
<br>
<pre \
style="line-height:100%;margin-bottom:0in">Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR \
TX-OK TX-ERR TX-DRP TX-OVR Flg eth2 9000 0 1084 0 0 0 1153 0 0 0 BMRU
</pre>
You get 1153 packets
that were dropped
due to not being
picked up on RX
side.<br>
I was first not
quite sure who
really defines this
value, whether it's
the network hardware
or the linux kernel
itself, but after
reading netstat code
and linux kernel
code, it seems that
netstat kind of
mislabels what is
called
"rx_fifo_errors" in
the kernel as
"RX-OVR". That
didn't make things
more intuitive
researching (because
of course there's
also a overrun field
in the stats struct
in the netdev in the
kernel... ).<br>
The good news:
rx_fifo_errors is
not something the
Intel ixgbe driver
modifies -- which
means it doesn't
seem to be a
hardware counter on
packets that weren't
fetched from the
card.<br>
<br>
So, could you share
what <br>
<br>
<pre>sysctl net.core.rmem_max \
net.core.wmem_max </pre> <br>
says? It's the
maximum memory that
your linux might
allocate for receive
and transmit buffers
on the card. <br>
<br>
<pre>sudo sysctl -w \
net.core.rmem_max $(( 512 * 2**20 )) sudo sysctl -w net.core.wmem_max $(( 512 * \
2**20 ))
</pre>
<div>should set the
sizes to 512MB
(cave: only til
next reboot).
Could you try with
that? <br>
<br>
Best regards,<br>
Marcus
<div>
<div><br>
<br>
On 24.10.2015
18:28, Sanjoy
Basak wrote:<br>
</div>
</div>
</div>
<div>
<div>
<blockquote
type="cite">
<div dir="ltr">Hi
Marcus,
<div>Thanks a
lot for the
quick reply. <span
style="line-height:100%">The kernel version is 3.19.0-31-generic</span></div>
<div><span
\
style="line-height:100%"><br> </span></div>
<div>I just
checked again
at 30s,
25MSps. I got
4 D and 5 D
for 2
consecutive
initiations.</div>
<div>
<p
\
style="line-height:100%;margin-bottom:0in"><b>@30sec</b></p> <p
\
style="line-height:100%;margin-bottom:0in">Setting
RX Rate:
25.000000
Msps... </p>
<p
\
style="line-height:100%;margin-bottom:0in">Actual
RX Rate:
25.000000
Msps...</p>
<p
\
style="line-height:100%;margin-bottom:0in">Setting
RX Freq:
2000.000000
MHz... </p>
<p
\
style="line-height:100%;margin-bottom:0in">Actual
RX Freq:
2000.000000
MHz...</p>
<p
\
style="line-height:100%;margin-bottom:0in">Waiting
for
"lo_locked":
++++++++++
locked. </p>
<p
\
style="line-height:100%;margin-bottom:0in"><span style="line-height:100%">Press Ctrl \
+ C to stop streaming...</span><br> </p>
<p
\
style="line-height:100%;margin-bottom:0in">DGot
an overflow
indication.
Please
consider the
following: </p>
<p
\
style="line-height:100%;margin-bottom:0in"> Your write
medium must
sustain a rate
of
100.000000MB/s.
</p>
<p
\
style="line-height:100%;margin-bottom:0in"> Dropped
samples will
not be written
to the file. </p>
<p
\
style="line-height:100%;margin-bottom:0in"> Please modify
this example
for your
purposes. </p>
<p
\
style="line-height:100%;margin-bottom:0in"> This message
will not
appear again.
</p>
<p
\
style="line-height:100%;margin-bottom:0in">DDDD
</p>
<p
\
style="line-height:100%;margin-bottom:0in">Done!</p> <p
\
style="line-height:100%;margin-bottom:0in"><br> </p>
<p
\
style="line-height:100%;margin-bottom:0in"><b>@240
sec</b></p>
<p
\
style="line-height:100%;margin-bottom:0in">Setting
RX Rate:
25.000000
Msps... </p>
<p
\
style="line-height:100%;margin-bottom:0in">Actual
RX Rate:
25.000000
Msps...</p>
<p
\
style="line-height:100%;margin-bottom:0in">Setting
RX Freq:
2000.000000
MHz... </p>
<p
\
style="line-height:100%;margin-bottom:0in">Actual
RX Freq:
2000.000000
MHz...</p>
<p
\
style="line-height:100%;margin-bottom:0in">Waiting
for
"lo_locked":
++++++++++
locked.</p>
<p
\
style="line-height:100%;margin-bottom:0in">Press
Ctrl + C to
stop
streaming... </p>
<p
\
style="line-height:100%;margin-bottom:0in">DGot
an overflow
indication.
Please
consider the
following: </p>
<p
\
style="line-height:100%;margin-bottom:0in"> Your write
medium must
sustain a rate
of
100.000000MB/s.
</p>
<p
\
style="line-height:100%;margin-bottom:0in"> Dropped
samples will
not be written
to the file. </p>
<p
\
style="line-height:100%;margin-bottom:0in"> Please modify
this example
for your
purposes. </p>
<p
\
style="line-height:100%;margin-bottom:0in"> This message
will not
appear again.
</p>
<p
\
style="line-height:100%;margin-bottom:0in">DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD
</p>
<p
\
style="line-height:100%;margin-bottom:0in"> </p>
<p
\
style="line-height:100%;margin-bottom:0in">Done!</p> <p
\
style="line-height:100%;margin-bottom:0in"><br> </p>
<p
\
style="line-height:100%;margin-bottom:0in">This
is the netstat
right after
restarting the
computer</p>
<p
\
style="line-height:100%;margin-bottom:0in">netstat
-i eth2 </p>
<p
\
style="line-height:100%;margin-bottom:0in">Kernel
Interface
table </p>
<p
\
style="line-height:100%;margin-bottom:0in">Iface
MTU Met RX-OK
RX-ERR RX-DRP
RX-OVR TX-OK
TX-ERR TX-DRP
TX-OVR Flg </p>
<p
\
style="line-height:100%;margin-bottom:0in">eth0
1500 0 9 0 0 0
26 0 0 0 BMRU
</p>
<p
\
style="line-height:100%;margin-bottom:0in">eth1
1500 0 0 0 0 0
0 0 0 0 BMU </p>
<p
\
style="line-height:100%;margin-bottom:0in">eth2
9000 0 1084 0
0 0 1153 0 0 0
BMRU </p>
<p
\
style="line-height:100%;margin-bottom:0in"> </p>
<p
\
style="line-height:100%;margin-bottom:0in">lo
65536 0 177 0
0 0 177 0 0 0
L</p>
<p
\
style="line-height:100%;margin-bottom:0in"><br> </p>
<p
\
style="line-height:100%;margin-bottom:0in">And
this is
netstat after</p>
<p
\
style="line-height:100%;margin-bottom:0in">./rx_samples_to_file
--duration
240 --rate
200e6
--freq=2e9
--file
/dev/null</p>
<p
\
style="line-height:100%;margin-bottom:0in">which
gave a lot of
D (did not
count how many
but a lot) </p>
<p
\
style="line-height:100%;margin-bottom:0in">Kernel
Interface
table </p>
<p
\
style="line-height:100%;margin-bottom:0in">Iface
MTU Met RX-OK
RX-ERR RX-DRP
RX-OVR TX-OK
TX-ERR TX-DRP
TX-OVR Flg </p>
<p
\
style="line-height:100%;margin-bottom:0in">eth0
1500 0 94 0 0
0 30 0 0 0
BMRU </p>
<p
\
style="line-height:100%;margin-bottom:0in">eth1
1500 0 0 0 0 0
0 0 0 0 BMU </p>
<p
\
style="line-height:100%;margin-bottom:0in">eth2
9000 0
24190524 936 0
0 355025 0 0 0
BMRU </p>
<p
\
style="line-height:100%;margin-bottom:0in"> </p>
<p
\
style="line-height:100%;margin-bottom:0in">lo
65536 0 183 0
0 0 183 0 0 0
LRU</p>
<p
\
style="line-height:100%;margin-bottom:0in"><br> </p>
<p
\
style="line-height:100%;margin-bottom:0in">Best
regards</p>
<p
\
style="line-height:100%;margin-bottom:0in">Sanjoy</p> <p
\
style="line-height:100%;margin-bottom:0in"><br> </p>
<p
\
style="line-height:100%;margin-bottom:0in"><br> </p>
</div>
</div>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Sat, Oct 24,
2015 at 5:31
PM, Marcus
Müller <span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:marcus.mueller@ettus.com"
\
target="_blank">marcus.mueller@ettus.com</a>></span> wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
\
0.8ex;padding-left:1ex;border-left:1px solid
rgb(204,204,204)">
<div>Hi
Sanjoy,<br>
<br>
Two
observations:<br>
Your routing
table looks
fine.<br>
<br>
Then, these
rx_samples...
results are
interesting.
Basically, 30s
of 200MS/s are
8 times the
amount of
packets as 30s
at 25MS/s;
however the
former
produces 53
sequence
errors, and
the latter
only 3. That's
off by a
factor of 2.
To verify,
could you try
240s at
25MS/s? <br>
If this holds,
the sequence
errors would
seem to be
load-related.
Kernel version
currently used
(uname -r)?<br>
Let's analyze
where things
go missing.
Could you
compare the
output of
"netstat -i
eth2" before
and after a
rx_samples_to_file
run that
produced lots
of D?<br>
<br>
Best regards,<br>
Marcus
<div>
<div><br>
<br>
<div
class="gmail_quote">Am
24. Oktober
2015 15:58:28
MESZ, schrieb
Sanjoy Basak
<<a
moz-do-not-send="true"
href="mailto:sanjoybasak14@gmail.com" \
target="_blank">sanjoybasak14@gmail.com</a>>:
<blockquote
class="gmail_quote"
style="margin:0pt
0pt 0pt
\
0.8ex;padding-left:1ex;border-left:1px solid
rgb(204,204,204)">
<div dir="ltr">Hi
Micheal,
<div>I made
the cpu
governor to
performance.
This is always
performance
now, does not
change. We did
not buy the
cable from
ettus. </div>
<div>We
bought <span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">DeLOCK
Twinaxial-Kabel
SFP+ M SFP+ M
3,0m SFF-8431
86222 from a
store here.</span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"><br> </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">Hi
Rob,</span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">Thanks
for the
command. I am
not really
sure which
cable you
used. But I am
still having
drop of
packets. I
don't have any
other cable
right now to
test. </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"><br> </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"><br> </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">Hi
Marcus,</span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">I tried your
suggestions. I
put the output
here.</span></div>
<div>
<p
\
style="line-height:100%;margin-bottom:0in"><b>ip
route </b></p>
<p
\
style="line-height:100%;margin-bottom:0in"><a moz-do-not-send="true" \
href="http://192.168.40.0/24" target="_blank">192.168.40.0/24</a> dev eth2 proto
kernel scope
link src
192.168.40.1
metric 1</p>
<p
\
style="line-height:100%;margin-bottom:0in"><br> </p>
<p
\
style="line-height:100%;margin-bottom:0in">I don't get any
drop at this.</p>
<p
\
style="line-height:100%;margin-bottom:0in"><span \
style="line-height:normal;font-size:12.8px">rx_samples_to_file --rate 200e6 --file
/dev/null
--nsamps $(( 2
* 1000 * 1000
))</span><br>
</p>
<p
\
style="margin-bottom:0in"><span style="font-size:12.8px">Setting RX Rate: 200.000000 \
Msps...</span></p> <p
\
style="margin-bottom:0in"><span style="font-size:12.8px">Actual RX Rate: 200.000000 \
Msps...</span></p> <p
\
style="margin-bottom:0in"><span style="font-size:12.8px">Setting RX Freq: 0.000000 \
MHz...</span><br> </p>
<p
\
style="margin-bottom:0in"><span style="font-size:12.8px">Actual RX Freq: 340.000000 \
MHz...</span></p> <p
\
style="margin-bottom:0in"><span style="font-size:12.8px">Waiting for "lo_locked": \
++++++++++ locked.</span><br> </p>
<p
\
style="margin-bottom:0in"><span style="font-size:12.8px">Done!</span></p>
<p
\
style="margin-bottom:0in"><span style="font-size:12.8px"><br>
</span></p>
<p
\
style="line-height:100%;margin-bottom:0in">However
with</p>
<p
\
style="line-height:100%;margin-bottom:0in"> </p>
<p
\
style="line-height:100%;margin-bottom:0in">./rx_samples_to_file
--duration
30 --rate
200e6
--freq=2e9
--file
/dev/null</p>
<p
\
style="line-height:100%;margin-bottom:0in">Setting
RX Rate:
200.000000
Msps... </p>
<p
\
style="line-height:100%;margin-bottom:0in">Actual
RX Rate:
200.000000
Msps... </p>
<p
\
style="line-height:100%;margin-bottom:0in"> </p>
<p
\
style="line-height:100%;margin-bottom:0in">Setting
RX Freq:
2000.000000
MHz... </p>
<p
\
style="line-height:100%;margin-bottom:0in">Actual
RX Freq:
2000.000000
MHz... </p>
<p
\
style="line-height:100%;margin-bottom:0in"> </p>
<p
\
style="line-height:100%;margin-bottom:0in">Waiting
for
"lo_locked":
++++++++++
locked. </p>
<p
\
style="line-height:100%;margin-bottom:0in"> </p>
<p
\
style="line-height:100%;margin-bottom:0in">Press
Ctrl + C to
stop
streaming... </p>
<p
\
style="line-height:100%;margin-bottom:0in">DGot
an overflow
indication.
Please
consider the
following: </p>
<p
\
style="line-height:100%;margin-bottom:0in"> Your write
medium must
sustain a rate
of
800.000000MB/s.
</p>
<p
\
style="line-height:100%;margin-bottom:0in"> Dropped
samples will
not be written
to the file. </p>
<p
\
style="line-height:100%;margin-bottom:0in"> Please modify
this example
for your
purposes. </p>
<p
\
style="line-height:100%;margin-bottom:0in"> This message
will not
appear again.
</p>
<p
\
style="line-height:100%;margin-bottom:0in">DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD
</p>
<p
\
style="line-height:100%;margin-bottom:0in"><span \
style="line-height:100%">Done!</span></p> <p
\
style="line-height:100%;margin-bottom:0in"><span style="line-height:100%"><br>
</span></p>
<p
\
style="line-height:100%;margin-bottom:0in">Even
at 25 MSps I
got drop of
packet</p>
<p
\
style="line-height:100%;margin-bottom:0in">./rx_samples_to_file
--duration 30
--rate 25e6
--freq=2e9
--file
/dev/null<br>
</p>
<p
\
style="margin-bottom:0in"><span style="line-height:13px">Setting RX Rate: 25.000000 \
Msps...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Actual RX Rate: 25.000000 \
Msps...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Setting RX Freq: 2000.000000 \
MHz...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Actual RX Freq: 2000.000000 \
MHz...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Waiting for "lo_locked": \
++++++++++ locked.</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Press Ctrl + C to stop \
streaming...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">DGot an overflow indication. \
Please consider
the following:</span></p>
<p
\
style="margin-bottom:0in"><span style="line-height:13px"> Your write medium must \
sustain a rate of
100.000000MB/s.</span></p>
<p
\
style="margin-bottom:0in"><span style="line-height:13px"> Dropped samples will not \
be written to the file.</span></p>
<p
\
style="margin-bottom:0in"><span style="line-height:13px"> Please modify this example \
for your purposes.</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px"> This message will not \
appear again.</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">DD</span></p>
<p
\
style="margin-bottom:0in"><span style="line-height:13px">Done!</span></p>
<p
\
style="margin-bottom:0in"><span style="line-height:13px"><br>
</span></p>
<p
\
style="line-height:100%;margin-bottom:0in">But
with 1 Gig
interface with
25 MSps I am
not getting
any drop</p>
<p
\
style="line-height:100%;margin-bottom:0in">./rx_samples_to_file
--duration 30
--rate 25e6
--freq=2e9
--file
/dev/null<br>
</p>
<p
\
style="margin-bottom:0in"><span style="line-height:13px">Setting RX Rate: 25.000000 \
Msps...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Actual RX Rate: 25.000000 \
Msps...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Setting RX Freq: 2000.000000 \
MHz...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Actual RX Freq: 2000.000000 \
MHz...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Waiting for "lo_locked": \
++++++++++ locked.</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Press Ctrl + C to stop \
streaming...</span></p> <p
\
style="margin-bottom:0in"><span style="line-height:13px">Done!</span></p>
</div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"><br> </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">I hope raid is
not making an
issue here, as
I don't see
any indication
when I tried
with 1 Gig
interface.</span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"><br> </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">Please
let me know
from </span><span
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"> </span><span
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">seeing
the output
what you think
making the
trouble. </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"><br> </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"><br> </span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">Best
regards</span></div>
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif">Sanjoy</span></div> \
<div><span
\
style="color:rgb(0,0,0);font-family:Arial,Helvetica,sans-serif"><br> </span></div>
</div>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Sat, Oct 24,
2015 at 1:48
AM, Michael
West <span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:michael.west@ettus.com"
\
target="_blank">michael.west@ettus.com</a>></span> wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
\
0.8ex;padding-left:1ex;border-left:1px solid
rgb(204,204,204)">
<div dir="ltr">
<div>
<div>I was
corrected
regarding the
10 GbE copper
cables. The
long copper
cables were
failing our
tests due to a
bug in the IP
used for the
10 GbE in the
FPGA image
that has since
been
resolved. We
are currently
using cables
up to 3m with
no problems.
We have found
some 5m cables
work and some
don't
depending on
the quality of
the cable.
The 10 GbE
cables and
NICs sold on
the Ettus
website all
work well.<br>
<br>
</div>
Regards,<br>
</div>
Michael<br>
<div>
<div><br>
<br>
<br>
</div>
</div>
</div>
<div>
<div>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Fri, Oct 23,
2015 at 3:47
PM, Marcus
Müller <span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:marcus.mueller@ettus.com"
\
target="_blank">marcus.mueller@ettus.com</a>></span> wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
\
0.8ex;padding-left:1ex;border-left:1px solid
rgb(204,204,204)">
<div
bgcolor="#FFFFFF"
text="#000000">
So to
understand
this <br>
<br>
TX much more
stable than
RX, and RX
showing not a
single "O" (a
proper
overflow) but
a lot of "D"
packet errors
(which are, in
fact, either
very serious
packet losses,
or package
reordering).<br>
It's probably
the cable, or
your network
stack might be
up to no good.
<br>
<br>
Could you
share the
output of <br>
<br>
ip route<br>
<br>
Also, it's
possible that
some default
firewall rule
makes your CPU
break a sweat;
you could try
to bypass
firewall for
the eth2
device<br>
<br>
sudo iptables
-A INPUT -i
eth2 -j ACCEPT<br>
<br>
(this is *not*
permanent).<br>
If that
doesn't help,
maybe
inspecting the
packets
captured with
"wireshark"
might help.
For example,
set up
wireshark to
listen to
eth2, power up
the USRP; you
should see a
few packets
being
exchanged on
the interface.<br>
Then run<br>
<br>
rx_samples_to_file
--rate 200e6
--file
/dev/null
--nsamps $(( 2
* 1000 * 1000
))<br>
<br>
then stop the
capture. Did
you see "D"s?
If yes, I'd
like to have a
look at the
captured data;
please save
it. We'll
figure out a
way to
exchange it.<br>
<br>
Best regards,<br>
Marcus <br>
<div>
<div>
<div>On
23.10.2015
21:21, Sanjoy
Basak wrote:<br>
</div>
<blockquote
type="cite">
<div dir="ltr">Hi Michael,
Neel
and Marcus,
<div><br>
<div>Thanks a
lot for the
suggestions. I
tried each of
those. </div>
<div>I updated
the kernel to
3.19.0-31-generic. </div>
<div><br>
</div>
<div>CPU <span
style="font-family:verdana,sans-serif;font-size:12.8px">governors, I set
to performance
as instruction
given in this
link. </span></div>
<div><font
face="verdana,
sans-serif"><span
style="font-size:12.8px"><a moz-do-not-send="true"
href="http://files.ettus.com/manual/page_usrp_x3x0_config.html#x3x0cfg_hostpc_pwr"
target="_blank">http://files.ettus.com/manual/page_usrp_x3x0_config.html#x3x0cfg_hostpc_pwr</a></span></font><br>
</div>
<div><span
\
style="font-family:verdana,sans-serif;font-size:12.8px">Now,
after setting
it to
performance
and
restarting, if
I check with
cpu-freq, I
find all
governers are
set at
performance.
But after a
while(5/10
mins later) if
I check again
cpu-freq info,
I see all
governers are
set to
powersave. </span></div>
<div><span
\
style="font-family:verdana,sans-serif;font-size:12.8px">Could
you please
tell me why
and how to
configure it
properly?</span></div>
<div><br>
</div>
<div>I tried
with
benchmark_rate
to check the
performance.
With tx-rate
till 200 MSps
I do not get
any
overflow/underflow.
However with
rx-rate
25/50/100 MSps
I get drop of
packets. I
made a direct
connection
from computer
to the X310.
No switch is
used.</div>
<div><br>
</div>
<div>On the
contrary with
shorter(copper)
cable at 1Gig
interface I do
not get any
drop of
packets at
25MSps (on
both tx_rate
and rx_rate). </div>
<div>Is 3m
copper cable
really bad? </div>
<div><br>
</div>
<div>
<div>We don't
have fibre
cable right
now. We
already
ordered. I
hope we will
get it next
week and check
how it is. We
don't have any
SFP+ 10 Gig
interface. So
can't really
test 10 gig
interface with
short 10 gig
copper cable.</div>
</div>
<div>
<p
\
style="line-height:100%;margin-bottom:0in">These
are the
benchmark_rate
results for 10
Gig interface</p>
<p
\
style="line-height:100%;margin-bottom:0in"><br> </p>
</div>
<div>
<div>
<div>Testing
receive rate
25.000000 Msps
on 1 channels</div>
<div>DDDDDDDD</div>
<div>Benchmark
rate summary:</div>
<div> Num
received
samples:
249845308</div>
<div> Num
dropped
samples:
15968</div>
<div> Num
overflows
detected: 0</div>
<div> Num
transmitted
samples: 0</div>
<div> Num
sequence
errors: 0</div>
<div> Num
underflows
detected: 0</div>
</div>
<div><br>
</div>
<div><br>
</div>
<div>Testing
receive rate
100.000000
Msps on 1
channels </div>
<div>DDDDDDDDDDDDDDDDDDDDD \
</div> <div>Benchmark
rate summary: </div>
<div> Num
received
samples:
999934124 </div>
<div> Num
dropped
samples:
41916 </div>
<div> Num
overflows
detected: 0 </div>
<div> Num
transmitted
samples: 0 </div>
<div> Num
sequence
errors: 0 </div>
<div> Num
underflows
detected: 0</div>
</div>
<div><br>
</div>
<div> I also
used this
command</div>
</div>
<div>sudo
ethtool -C
eth2 rx-usecs
16 rx-frames
20<br>
</div>
<div><br>
</div>
<div>Please
let me know
what you think
occurring the
problem and
whether replacing
copper cable
with short
fibre cable
solves the
problem.</div>
<div><br>
</div>
<div>Best
regards</div>
<div>Sanjoy</div>
<div><br>
</div>
</div>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Wed, Oct 21,
2015 at 12:27
PM, Marcus
Müller <span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:usrp-users@lists.ettus.com"
\
target="_blank">usrp-users@lists.ettus.com</a>></span> wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
\
0.8ex;padding-left:1ex;border-left:1px solid
rgb(204,204,204)">
<div
bgcolor="#FFFFFF"
text="#000000">
Hi Sanjoy,<br>
<br>
furthermore,
and I found
that to be
crucial on my
system, you
should make
sure that your
10GE card
doesn't
generate an
interrupt for
every packet
it receives
(your
application
will pull
these packets
as fast as
possible,
anyway).<br>
On linux,
you'd do <br>
<br>
sudo ethtool
-c {name of
ethernet
interface,
e.g. eth1}<br>
<br>
to see the
coalescing
options
available with
your device
and kernel
version,<br>
and modify a
setting using<br>
<br>
sudo ethtool
-C {name of
ethernet
interface,
e.g. eth1}
{name of
setting} {new
value of
setting}<br>
<br>
For example, I
set "rx_usecs"
(microseconds
to wait
between
triggering an
interrupt) to
16, and
"rx_frames" to
20 or so --
your milage
might vary,
depending on
your
application,
OS and also a
few hardware
factors.<br>
<br>
Best regards,<br>
Marcus
<div>
<div><br>
<br>
<div>On
19.10.2015
21:56, Michael
West via
USRP-users
wrote:<br>
</div>
<blockquote
type="cite">
<div dir="ltr">
<div>
<div>Also,
check the CPU
governor and
make sure it
is set to
"performance".<br>
<br>
Your output
indicates
frame errors
on the
interface,
which could be
due to the
cable. If
possible, try
using a
shorter copper
cable or
switch to a
fibre cable.
With 10 GbE
over copper,
the shorter
the better.
If you need
the length,
you should be
using fibre.<br>
<br>
If you still
have issues,
please provide
a little more
information:
Are you
connected
directly with
the X310 or
through a
switch? How
are you
testing the
performance?
Are you using
your own
application or
benchmark_rate?
If your own
application,
what is it
doing with the
received data
(processing it
with the same
thread or
different
thread, saving
to disk,
etc...)?<br>
<br>
</div>
Regards,<br>
</div>
Michael</div>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Mon, Oct 19,
2015 at 12:51
PM, Neel
Pandeya via
USRP-users <span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:usrp-users@lists.ettus.com"
\
target="_blank">usrp-users@lists.ettus.com</a>></span> wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
\
0.8ex;padding-left:1ex;border-left:1px solid
rgb(204,204,204)">
<div dir="ltr">
<div
\
style="font-family:verdana,sans-serif">Hello Sanjoy:<br>
<br>
</div>
<div
\
style="font-family:verdana,sans-serif">That Intel X520
10GbE card
with Ubuntu
14.04.3 should
be working
well for you.<br>
<br>
Could you try
upgrading to
kernel 3.16 or
3.19, and let
us know your
results?<br>
<br>
To upgrade to
kernel 3.16,
run "<span
\
style="font-family:monospace,monospace">sudo
apt-get
install
\
linux-generic-lts-utopic</span>".<br> <br>
To upgrade to
kernel 3.19,
run "<span
\
style="font-family:monospace,monospace">sudo
apt-get
install
\
linux-generic-lts-vivid</span>".<br> <br>
</div>
<div
\
style="font-family:verdana,sans-serif">After the upgrade,
be sure to
reboot the
system.<br>
<br>
</div>
<div
\
style="font-family:verdana,sans-serif">Also, check that you
have the CPU
governors set
to
"performance",
and that you
have the
highest clock
rate set.<br>
</div>
<div
\
style="font-family:verdana,sans-serif"><br> </div>
<div
\
style="font-family:verdana,sans-serif">--Neel<br> <br>
<br>
</div>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">
<div>
<div>On 19
October 2015
at 12:03,
Sanjoy Basak
via USRP-users
<span
dir="ltr"><<a
moz-do-not-send="true" href="mailto:usrp-users@lists.ettus.com"
\
target="_blank">usrp-users@lists.ettus.com</a>></span> wrote:<br>
</div>
</div>
<blockquote
class="gmail_quote"
style="margin:0px
0px 0px
\
0.8ex;padding-left:1ex;border-left:1px solid
rgb(204,204,204)">
<div>
<div>
<div dir="ltr">Hi
Experts,
<div>We
recently
bought a 10
Gig ethernet
card
(X510-DA2)
and <span>Twinaxial-Kabel
SFP+ M SFP+ M
3,0m. I
installed it
in our pc (OS:
Ubuntu Mate
14.04.3 LTS)
and can
communicate
with
X310/SBX-120
properly.
However, the
performance we
are getting is
quite poor. I
am getting
dropped
packets (D O)
mostly at
25,50 MSps and
goes quite
crazy at 100
MSps and
sometimes even
at lower
sample rates. </span></div>
<div><span>Previously
I tested with
1 Gig
ethernet, at
25 MSps I
could stream
without any
drop/late
packet or
underrun. </span></div>
<div><span>The
CPU uses or
network uses
is also not
reaching
100%. </span></div>
<div><span><br>
</span></div>
<div><span>Could
you please
tell me what
to
check/correct
so I can
stream at 100
MSps without
any error?</span></div>
<div><span><br>
</span></div>
<div><span>I
am putting the
ifconfig and
ethtool
results and
the kernel
version(</span><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px">3.16.0-30-generic</span></font><span>)</span></div> \
<div><span><br> </span></div>
<div>
<div><font
face="Times
New Roman,
serif"><span
style="font-size:16px">eth2
Link
encap:Ethernet
HWaddr
90:e2:ba:a6:a9:dd
</span></font></div>
<div><font
face="Times
New Roman,
serif"><span
style="font-size:16px">
inet6
addr:
\
fe80::92e2:baff:fea6:a9dd/64
\
Scope:Link</span></font></div> <div><font
face="Times
New Roman,
serif"><span
style="font-size:16px">
UP
BROADCAST
MULTICAST
MTU:9000
\
Metric:1</span></font></div> <div><font
face="Times
New Roman,
serif"><span
style="font-size:16px">
RX
packets:4530726
errors:146
dropped:0
overruns:0
\
frame:146</span></font></div> <div><font
face="Times
New Roman,
serif"><span
style="font-size:16px">
TX
packets:6811057
errors:0
dropped:0
overruns:0
\
carrier:0</span></font></div> <div><font
face="Times
New Roman,
serif"><span
style="font-size:16px">
collisions:0
txqueuelen:1000 \
</span></font></div> <div><font
face="Times
New Roman,
serif"><span
style="font-size:16px">
RX
bytes:26331306938
(26.3 GB) TX
bytes:35856233935
(35.8 \
GB)</span></font></div> <div><br>
</div>
</div>
<div>
<div>
<div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px">Settings
for \
eth2:</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Supported ports: [ \
FIBRE ]</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Supported link \
modes: 10000baseT/Full </span></font></div>
<div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Supported pause \
frame use: No</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Supports \
auto-negotiation: No</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Advertised link \
modes:
10000baseT/Full \
</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Advertised pause \
frame use: No</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Advertised \
auto-negotiation: No</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Speed: \
10000Mb/s</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Duplex: \
Full</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Port: \
Other</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>PHYAD: \
0</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Transceiver: \
external</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Auto-negotiation: \
off</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px">Cannot
get
wake-on-lan
settings:
Operation not
\
permitted</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Current message \
level: 0x00000007
(7)</span></font></div>
<div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span> drv probe \
link</span></font></div> <div><font
face="Times
New Roman,
serif"><span
\
style="font-size:16px"><span style="white-space:pre-wrap"> </span>Link detected: \
yes</span></font></div> </div>
<div><br>
</div>
<div>Our
computer
config is:</div>
<div>Processor:
12*Intel(R)
Xeon (R) CPU
E5-2620 v3
@2.40 GHz</div>
<div>RAM:
65871 MB</div>
<div>SSD raid
5</div>
<div><br>
</div>
<div><br>
</div>
<div>Best
regards</div>
<span><font
color="#888888">
</font>
<div><font
\
color="#888888">Sanjoy</font></div> </span></div>
</div>
<br>
</div>
</div>
_______________________________________________<br>
USRP-users
mailing list<br>
<a
moz-do-not-send="true"
href="mailto:USRP-users@lists.ettus.com" \
target="_blank">USRP-users@lists.ettus.com</a><br> <a
moz-do-not-send="true"
href="http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com"
target="_blank">http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
<br>
_______________________________________________<br>
USRP-users
mailing list<br>
<a
moz-do-not-send="true"
href="mailto:USRP-users@lists.ettus.com" \
target="_blank">USRP-users@lists.ettus.com</a><br> <a
moz-do-not-send="true"
href="http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com"
target="_blank">http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<fieldset></fieldset>
<br>
\
<pre>_______________________________________________ USRP-users mailing list
<a moz-do-not-send="true" href="mailto:USRP-users@lists.ettus.com" \
target="_blank">USRP-users@lists.ettus.com</a> <a moz-do-not-send="true" \
href="http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com" \
target="_blank">http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com</a>
</pre>
</blockquote>
<br>
</div>
</div>
</div>
<br>
_______________________________________________<br>
USRP-users
mailing list<br>
<a
moz-do-not-send="true"
href="mailto:USRP-users@lists.ettus.com" \
target="_blank">USRP-users@lists.ettus.com</a><br> <a
moz-do-not-send="true"
href="http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com"
target="_blank">http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> </font></span></font></span></font></span></font></span></div>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> </font></span></font></span></font></span></font></span></blockquote>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> </font></span></font></span></font></span></font></span></div>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> <br>
\
</font></span></font></span></font></span></font></span></div>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> </font></span></font></span></font></span></font></span></div>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> <span><font color="#888888"> -- <br>
Sent from my
Android device
with K-9 Mail.
Please excuse
my \
brevity.</font></span></font></span></font></span></font></span></font></span></div>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> </font></span></font></span></font></span></font></span></blockquote>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> </font></span></font></span></font></span></font></span></div>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> <br>
\
</font></span></font></span></font></span></font></span></div>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> </font></span></font></span></font></span></font></span></blockquote>
<span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> <br>
\
</font></span></font></span></font></span></font></span></div> <span class=""><font
color="#888888"><span><font color="#888888"><span><font color="#888888"><span><font
color="#888888"> </font></span></font></span></font></span></font></span></div>
<span class=""><font
color="#888888"><span><font
color="#888888"><span><font color="#888888"><span><font color="#888888">
\
</font></span></font></span></font></span></font></span></div> <span class=""><font
color="#888888"><span><font
color="#888888"><span><font color="#888888"><span><font color="#888888">
\
</font></span></font></span></font></span></font></span></blockquote> <span \
class=""><font
color="#888888"><span><font
color="#888888"><span><font
color="#888888"><span><font color="#888888"> \
</font></span></font></span></font></span></font></span></div> <span class=""><font
color="#888888"><span><font
color="#888888"><span><font
color="#888888"><span><font color="#888888"> <br>
\
</font></span></font></span></font></span></font></span></div> <span class=""><font
color="#888888"><span><font
color="#888888"><span><font
color="#888888">
\
</font></span></font></span></font></span></blockquote> <span class=""><font
color="#888888"><span><font
color="#888888"><span><font
color="#888888"> <br>
\
</font></span></font></span></font></span></div> <span class=""><font
color="#888888"><span><font
color="#888888">
\
</font></span></font></span></blockquote> </div>
<span class=""><font color="#888888"><span><font
color="#888888"><br>
</font></span></font></span></div>
<span class=""><font color="#888888">
</font></span></blockquote>
</div>
<span class=""><font color="#888888"><br>
</font></span></div>
</blockquote>
</div>
<br>
</div>
<br>
_______________________________________________<br>
USRP-users mailing list<br>
<a moz-do-not-send="true"
\
href="mailto:USRP-users@lists.ettus.com">USRP-users@lists.ettus.com</a><br> <a \
moz-do-not-send="true" \
href="http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com"
rel="noreferrer" \
target="_blank">http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com</a><br>
<br>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
USRP-users mailing list
<a class="moz-txt-link-abbreviated" \
href="mailto:USRP-users@lists.ettus.com">USRP-users@lists.ettus.com</a> <a \
class="moz-txt-link-freetext" \
href="http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com">http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com</a>
</pre>
</blockquote>
<br>
</body>
</html>
_______________________________________________
USRP-users mailing list
USRP-users@lists.ettus.com
http://lists.ettus.com/mailman/listinfo/usrp-users_lists.ettus.com
[prev in list] [next in list] [prev in thread] [next in thread]