From owner-freebsd-cloud@freebsd.org Wed Feb 17 05:13:18 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 35589AAB889; Wed, 17 Feb 2016 05:13:18 +0000 (UTC) (envelope-from dvrao.584@gmail.com) Received: from mail-io0-x22c.google.com (mail-io0-x22c.google.com [IPv6:2607:f8b0:4001:c06::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F2EB5159C; Wed, 17 Feb 2016 05:13:17 +0000 (UTC) (envelope-from dvrao.584@gmail.com) Received: by mail-io0-x22c.google.com with SMTP id g203so23842088iof.2; Tue, 16 Feb 2016 21:13:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=CM0uuKGH7sQEUd+IQxFK0ZhEdApFDNDknZT17YOUGi8=; b=cLDqdKWFpMXcGE7psVtHS29vx5XQ6uxlrykhI53il28a7GkaJW6G4Cyz7Yznc8qIGr EWociaCmm/ZuxRVt4txt/3S6RM5RHRlaCVcHTZQOdcHcitJdZVnC2cSOsVeQBGE5MjgD QbZiIvg7+WKqWui3DqgsF2rHhbo/k64PrMwx+CvHlUlAOAntpQA452F4NVE79ZFck67v unllD4ulwwqqIraSK4JkoMC+r84Wov+8CSYvOeQZvGSSNBEsYR/sWjJFiYQGDD1JbO0D PCewQrQy87hK4b7oFJzUuU8xMNtFDQm1tPDOReUNbK715FhY74sSzLVd9485iimXDj2X 2bOQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=CM0uuKGH7sQEUd+IQxFK0ZhEdApFDNDknZT17YOUGi8=; b=geqYRokyNSv1nSH9U8aCzEBgoxjrEyyDCBG/cGg8glzUIX7G984QoHZiOfV7DCebdk CiXmdAvXjTlLaFufNEh8x2DCvYjcDvYWmT4gADIeZow2vBCA/HEa92/YT66v5glcKedC FK4Rdoerj9/4ty7Z1k1DPzfMEAhNYefBB7lHVLcGfQ23JDaVVW5wcRuXq9Ghe3svqqdV PDeWUvYP/Rx70q/5FN6oce7e4g7xqnNwXJhBBE58yT/mFPfFofLrZJx1QP0GjCNUc+bA EWp4Kv5daOenSqJ2kTsSDBmk3+eC2n1Jfi3cqtA9JWCd7fzP19mrz58T5MCTOG4tALT+ CwEw== X-Gm-Message-State: AG10YOQJsO37yFDh7ux+sRmBBsMHupIGwan/dl4RbZcATAoYy8vXdrUptB6UclEuLz8kRiOS8PBQaWA02W4p9A== MIME-Version: 1.0 X-Received: by 10.60.62.243 with SMTP id b19mr20015762oes.28.1455685997368; Tue, 16 Feb 2016 21:13:17 -0800 (PST) Received: by 10.60.96.3 with HTTP; Tue, 16 Feb 2016 21:13:17 -0800 (PST) In-Reply-To: References: <686449bd2840e86a391cc6f4771c3403@mam.nameserver.sk> Date: Wed, 17 Feb 2016 10:43:17 +0530 Message-ID: Subject: Re: SCP issue on FreeBSD From: Venkateswara Rao Dokku To: Juraj Bocinec Cc: freebsd-drivers@freebsd.org, owner-freebsd-drivers@freebsd.org, freebsd-cloud@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Feb 2016 05:13:18 -0000 This beahavior is only seen on the FreeBSD guest which is running on KVM. When we run the same guest on Xen, ESX hypervisors the issue is not seen. Is there any issue with FreeBSD + VirtIO combined? Any help is much appreciated. On Tue, Feb 16, 2016 at 10:13 AM, Venkateswara Rao Dokku < dvrao.584@gmail.com> wrote: > root@test:~ # sysctl -a | grep send > kern.cam.ada.send_ordered: 1 > kern.cam.da.send_ordered: 1 > net.local.stream.sendspace: 8192 > net.inet.ip.sendsourcequench: 0 > net.inet.igmp.sendlocal: 1 > net.inet.igmp.sendra: 1 > net.inet.tcp.sendspace: 65536 > net.inet.tcp.sendbuf_max: 262144 > net.inet.tcp.sendbuf_inc: 16384 > net.inet.tcp.sendbuf_auto: 1 > net.inet.sctp.sendspace: 233016 > net.raw.sendspace: 8192 > root@test:~ # sysctl -a | grep recv > net.local.stream.recvspace: 8192 > net.local.dgram.recvspace: 4096 > net.inet.igmp.recvifkludge: 1 > net.inet.tcp.recvspace: 65536 > net.inet.tcp.recvbuf_max: 262144 > net.inet.tcp.recvbuf_inc: 16384 > net.inet.tcp.recvbuf_auto: 1 > net.inet.udp.recvspace: 42080 > net.inet.sctp.recvspace: 233016 > net.inet.raw.recvspace: 9216 > net.raw.recvspace: 8192 > net.wlan.recv_bar: 1 > hw.cs.recv_delay: 570 > > On Tue, Feb 16, 2016 at 10:13 AM, Venkateswara Rao Dokku < > dvrao.584@gmail.com> wrote: > >> I dont think that is causing the problem. >> I have the send/receive buffers equal on my system. >> >> >> On Wed, Feb 10, 2016 at 12:41 AM, Juraj Bocinec >> wrote: >> >>> Greetings, i'm no expert but doesn't this have to do something with >>> network send/receive buffers? They're not set the same by default: >>> >>> [root@schizo /etc]# sysctl -a|grep send >>> kern.cam.ada.ada_send_ordered: 1 >>> kern.cam.da.da_send_ordered: 1 >>> net.local.stream.sendspace: 8192 >>> net.inet.ip.sendsourcequench: 0 >>> net.inet.igmp.sendlocal: 1 >>> net.inet.igmp.sendra: 1 >>> net.inet.tcp.sendspace: 32768 >>> net.inet.tcp.sendbuf_max: 262144 >>> net.inet.tcp.sendbuf_inc: 8192 >>> net.inet.tcp.sendbuf_auto: 1 >>> net.inet.sctp.sendspace: 233016 >>> net.raw.sendspace: 8192 >>> [root@schizo /etc]# sysctl -a|grep recv >>> net.local.stream.recvspace: 8192 >>> net.local.dgram.recvspace: 4096 >>> net.inet.igmp.recvifkludge: 1 >>> net.inet.tcp.recvspace: 65536 >>> net.inet.tcp.recvbuf_max: 262144 >>> net.inet.tcp.recvbuf_inc: 16384 >>> net.inet.tcp.recvbuf_auto: 1 >>> net.inet.udp.recvspace: 42080 >>> net.inet.sctp.recvspace: 233016 >>> net.inet.raw.recvspace: 9216 >>> net.raw.recvspace: 8192 >>> >>> Juraj Bocinec >>> >>> On 2016-02-09 05:39, Venkateswara Rao Dokku wrote: >>> >>>> Hi, >>>> >>>> I am using FreeBSD 8.4 as guest on top of the linux (ubuntu 14.10) >>>> host. I >>>> observed that, the Pushing a file from FreeBSD is giving good >>>> performance >>>> over Puling a file from other linux box to FreeBSD. >>>> >>>> root@test:~ # *scp ns-10.5-57.7.gz root@10.102.38.202:/root* >>>> root@10.102.38.202's password: >>>> ns-10.5-57.7.gz >>>> 100% >>>> 126MB *63.0MB/s* 00:02 >>>> root@test:~ #* scp root@10.102.38.202:/root/ns-10.5-57.7.gz* . >>>> root@10.102.38.202's password: >>>> ns-10.5-57.7.gz >>>> 100% >>>> 126MB *11.5MB/s* 00:11 >>>> >>>> Why there is a difference between these two?. Any tuning needs to be >>>> done >>>> on the FreeBSD guest to get these two almost same? >>>> >>>> To see, whether its specific to FreeBSD I did the same experiment with >>>> Linux(Ubuntu 14.10) as guest on top of Linux(same host as above). Here >>>> the >>>> output is almost same. >>>> >>>> root@ubuntu:~# *scp root@10.102.38.202:/root/ns-11.1-14.4.gz .* >>>> root@10.102.38.202's password: >>>> ns-11.1-14.4.gz >>>> 100% >>>> 130MB *64.8MB/s* 00:02 >>>> root@ubuntu:~# *scp ns-11.1-14.4.gz root@10.102.38.202:/roo*t >>>> root@10.102.38.202's password: >>>> ns-11.1-14.4.gz >>>> 100% 130MB *64.8MB/s* 00:02 >>>> >>>> >>>> Moreover, in most cases Linux performance is better than FreeBSD. Is >>>> Ubuntu >>>> gives good performance when compared to FreeBSD? >>>> >>>> Any help is much appreciated. >>>> Thanks. >>>> >>> >>> >> >> >> -- >> Thanks & Regards, >> Venkateswara Rao Dokku. >> >> > > > -- > Thanks & Regards, > Venkateswara Rao Dokku. > > -- Thanks & Regards, Venkateswara Rao Dokku.