From owner-freebsd-net@FreeBSD.ORG Sat Sep 14 03:23:22 2013 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 194F1790 for ; Sat, 14 Sep 2013 03:23:22 +0000 (UTC) (envelope-from barney_cordoba@yahoo.com) Received: from nm48-vm2.bullet.mail.gq1.yahoo.com (nm48-vm2.bullet.mail.gq1.yahoo.com [67.195.87.190]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id DC4B82D93 for ; Sat, 14 Sep 2013 03:23:21 +0000 (UTC) Received: from [98.137.12.55] by nm48.bullet.mail.gq1.yahoo.com with NNFMP; 14 Sep 2013 03:23:15 -0000 Received: from [208.71.42.198] by tm15.bullet.mail.gq1.yahoo.com with NNFMP; 14 Sep 2013 03:23:14 -0000 Received: from [127.0.0.1] by smtp209.mail.gq1.yahoo.com with NNFMP; 14 Sep 2013 03:23:14 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1379128994; bh=uNLNF+xp7oqjMSE1ID2sh8fmYNH6uDIhvSrV4woujGw=; h=X-Yahoo-Newman-Id:X-Yahoo-Newman-Property:X-YMail-OSG:X-Yahoo-SMTP:X-Rocket-Received:Subject:References:From:Content-Transfer-Encoding:Content-Type:In-Reply-To:Message-Id:Date:Cc:To:Mime-Version:X-Mailer; b=wyUQasFFw9CQhob2Kjtmj9MvsKxyZlXN+c4D7aDOkZ7y93Wtsw+u/rvp1rLVpcNWb+I0Jl4QoTtcS3S+3zbiPcR03FE15C+YgROgm7VAwj0xQ1h6i/4XRlC9DooK/thEAv+TtVmN+hYELJ7Wl+A7I6q9caaYY91Yv5MpAwKSGIA= X-Yahoo-Newman-Id: 861575.67445.bm@smtp209.mail.gq1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: 5e_DUFsVM1mKMaXEDKYgrEqPJIX_aqV._y37IFCg0uouCWq .jeIMTv4U5BniQEfqoWHyGrDS5yUvG6YePIXbkwtI6BRE2gfUVWCg6Vy7NVQ g.SbYQcCmebj5AU6lerHNgMej4V17ZCR_6ohECiuAUG05RE3LTEK9UFUnYrQ MJGi_yDPyp2RIiGiguVtgxGDEG9yvU2PJdx0q0hDJ9ArVFgJIjezYys8v4at kPBskHmIk.bGS2YQ9xG2cGg67BHWzzpxM.xKBTNPDo1Bn9IedGWeSWrtFD3p AM.h9Fso.XYuIbpqbZC8gpnhCzeDnoou1EMuj6_rOGy.t50YBwuWsuwwZhT3 m4fs5an6uHclBdktuG_hTDFMlKSiHkFYP.8WS..5r50hgLUT8XgzE3rQ_HUt tnIeJAeHFm_5eFaYiHi5ywHNNYb7hDRw_0_Lw1SuCDDf3foioTBi2mds7s1x ItAOAX.oEnZV2dbYb53wqV_nNUZ.1sHIPwL0p4TjoQt5Z_qoejICT5Y2yvCd 3_diug3e5F1KgOzo2eGiT3Zqao8kYxlC62DpoIiWPjXdiWpuPdXnC1yP0eCc QvPHlYRlnyqO4klpLLgGRMyYBpKBZpZvYLsPyBfzGV7EapxamqtdglKq9buf Qx0r8JJk4vnO_at51iN1PEkTdiqmTyspucfASvId78OFfBo0F3iOWah2AW1C cBn7_e8t7cMjgKsKSbVmSB8q0e0lrH3edmKXggnw- X-Yahoo-SMTP: JS53x9KswBBbHwiASGkeEr3kN4kAksMTpmFe X-Rocket-Received: from [10.70.11.35] (barney_cordoba@166.147.111.164 with ) by smtp209.mail.gq1.yahoo.com with SMTP; 13 Sep 2013 20:23:14 -0700 PDT Subject: Re: TSO help or hindrance ? (was Re: TSO and FreeBSD vs Linux) References: <979862494.17918795.1378299005617.JavaMail.root@uoguelph.ca> <52275136.1010105@sentex.net> <1378852936.95477.YahooMailNeo@web121601.mail.ne1.yahoo.com> <522FA2C3.7010109@sentex.net> From: Barney Cordoba Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii In-Reply-To: <522FA2C3.7010109@sentex.net> Message-Id: <596C2208-BC2A-417B-B46F-300D5886C087@yahoo.com> Date: Fri, 13 Sep 2013 23:08:11 -0400 To: Mike Tancsa Mime-Version: 1.0 (1.0) X-Mailer: iPhone Mail (9A406) Cc: FreeBSD Net , Rick Macklem , David Wolfskill X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Sep 2013 03:23:22 -0000 Didn't read down far enough. There are def issues and gains are probably mo= stly in a lab with 9k frames. Turn it off. CPUs and buses are fast.=20 BC On Sep 10, 2013, at 6:52 PM, Mike Tancsa wrote: > On 9/10/2013 6:42 PM, Barney Cordoba wrote: >> NFS has been broken since Day 1, so lets not come to conclusions about >> anything >> as it relates to NFS. >=20 > iSCSI is NFS ? >=20 > ---Mike >=20 >>=20 >> BC >>=20 >> ------------------------------------------------------------------------ >> *From:* Mike Tancsa >> *To:* Rick Macklem >> *Cc:* FreeBSD Net ; David Wolfskill >> *Sent:* Wednesday, September 4, 2013 11:26 AM >> *Subject:* TSO help or hindrance ? (was Re: TSO and FreeBSD vs Linux) >>=20 >> On 9/4/2013 8:50 AM, Rick Macklem wrote: >>> David Wolfskill wrote: >>>>=20 >>>>=20 >>>> I noticed that when I tried to write files to NFS, I could write >>>> small >>>> files OK, but larger ones seemed to ... hang. >>>> * "ifconfig -v em0" showed flags TSO4 & VLAN_HWTSO turned on. >>>> * "sysctl net.inet.tcp.tso" showed "1" -- enabled. >>>>=20 >>>> As soon as I issued "sudo net.inet.tcp.tso=3D0" ... the copy worked >>>> without >>>> a hitch or a whine. And I was able to copy all 117709618 bytes, not >>>> just >>>> 2097152 (2^21). >>>>=20 >>>> Is the above expected? It came rather as a surprise to me. >>>>=20 >>> Not surprising to me, I'm afraid. When there are serious NFS problems >>> like this, it is often caused by a network fabric issue and broken >>> TSO is at the top of the list w.r.t. cause. >>=20 >>=20 >> I was just experimenting a bit with iSCSI via FreeNAS and was a little >> disappointed at the speeds I was getting. So, I tried disabling tso on >> both boxes and it did seem to speed things up a bit. Data and testing >> methods attached in a txt file. >>=20 >> I did 3 cases. >>=20 >> Just boot up FreeNAS and the initiator without tweaks. That had the >> worst performance. >> disable tso on the nic as well as via sysctl on both boxes. That had the >> best performance. >> re-enable tso on both boxes. That had better performance than the first >> case, but still not as good as totally disabling it. I am guessing >> something is not quite being re-enabled properly ? But its different >> than the other two cases ?!? >>=20 >> tgt is FreeNAS-9.1.1-RELEASE-x64 (a752d35) and initiator is r254328 9.2 >> AMD64 >>=20 >> The FreeNAS box has 16G of RAM, so the file is being served out of cache >> as gstat shows no activity when sending out the file >>=20 >>=20 >>=20 >> ---Mike >>=20 >>=20 >> --=20 >> ------------------- >> Mike Tancsa, tel +1 519 651 3400 >> Sentex Communications, mike@sentex.net >> Providing Internet services since 1994 www.sentex.net >> Cambridge, Ontario Canada http://www.tancsa.com/ >>=20 >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org >> " >>=20 >=20 >=20 > --=20 > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/ > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"