Date: Sat, 4 Mar 2000 18:39:45 +0100 From: =?iso-8859-1?Q?R=E9mi_Guyomarch?= <rguyom@mail.dotcom.fr> To: jayanth <jayanth@yahoo-inc.com> Cc: Jonathan Lemon <jlemon@flugsvamp.com>, freebsd-net@FreeBSD.ORG Subject: Re: TCP performance problems, Linux faster than FreeBSD ? Message-ID: <20000304183945.A8539@pingoo.ifn.fr> In-Reply-To: <20000303122641.B23208@yahoo-inc.com>; from jayanth@yahoo-inc.com on Fri, Mar 03, 2000 at 12:26:41PM -0800 References: <local.mail.freebsd-net/20000303165052.C23732@pingoo.ifn.fr> <200003031759.LAA03466@prism.flugsvamp.com> <20000303194730.A26727@pingoo.ifn.fr> <20000303125536.A307@prism.flugsvamp.com> <20000303195724.A26837@pingoo.ifn.fr> <20000303135950.C307@prism.flugsvamp.com> <20000303122641.B23208@yahoo-inc.com>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --] On Fri, Mar 03, 2000 at 12:26:41PM -0800, jayanth wrote: > Was the SACK feature being used for the connection from the Linux > machine ? The server doesn't support SACKs, they're never used. Here's the firsts SYN, SYN/ACK packets between Linux and MS : pingoo.3677 > ms.http: S 3483693259:3483693259(0) win 32120 <mss 1460,sackOK,timestamp 214997503 0,nop,wscale 0> (DF) ms.http > pingoo.3677: S 2736466138:2736466138(0) ack 3483693260 win 8760 <mss 1460> (DF) I tried to turn off delayed acks, but the result was worst. Without delayed acks I'm getting nearly 75% of dups (ie 700k of data comming in for a 400k download). I think the problem has something to do with the implementation of delayed acks. Linux start straight with a 190-200 ms delay, effectively catching two incoming packets per ack, but FreeBSD (very) slowly converge to 200 ms delayed acks, and in fact nearly always send one ack per incoming packet, even when packets are comming in in the right order and when there's no loss. Example : ( pingoo == Linux diabolo == FreeBSD ) 07:12:45.742513 pingoo.3822 > ms.http: S 393821375:393821375(0) win 32120 <mss 1460,sackOK,timestamp 196403495 0,nop,wscale 0> (DF) 07:12:45.936571 ms.http > pingoo.3822: S 3743388946:3743388946(0) ack 393821376 win 8760 <mss 1460> (DF) 07:12:45.938128 pingoo.3822 > ms.http: . ack 1 win 0 07:12:45.939322 pingoo.3822 > ms.http: . ack 1 win 32120 (DF) 07:12:45.941606 pingoo.3822 > ms.http: P 1:142(141) ack 1 win 32120 (DF) 07:12:46.564479 ms.http > pingoo.3822: . 1461:2921(1460) ack 142 win 8619 (DF) 07:12:46.756086 pingoo.3822 > ms.http: . ack 2921 win 32120 (DF) ** delay = 192 ms 07:12:47.034305 ms.http > pingoo.3822: . 2921:4381(1460) ack 142 win 8619 (DF) 07:12:47.225883 ms.http > pingoo.3822: . 4381:5841(1460) ack 142 win 8619 (DF) 07:12:47.230551 pingoo.3822 > ms.http: . ack 5841 win 30660 (DF) ** delay = 196 ms 07:12:47.424586 ms.http > pingoo.3822: . 5841:7301(1460) ack 142 win 8619 (DF) 07:12:47.615558 ms.http > pingoo.3822: . 7301:8761(1460) ack 142 win 8619 (DF) 07:12:47.620234 pingoo.3822 > ms.http: . ack 8761 win 30660 (DF) ** delay = 195 ms 07:10:23.402821 diabolo.1709 > ms.http: S 2634625287:2634625287(0) win 32768 <mss 1460,nop,wscale 0,nop,nop,timestamp 116903 0> (DF) 07:10:23.592814 ms.http > diabolo.1709: S 3713510269:3713510269(0) ack 2634625288 win 8760 <mss 1460> (DF) 07:10:23.594282 diabolo.1709 > ms.http: . ack 1 win 0 07:10:23.596408 diabolo.1709 > ms.http: . ack 1 win 33580 (DF) 07:10:23.596623 diabolo.1709 > ms.http: P 1:142(141) ack 1 win 33580 (DF) 07:10:24.074478 ms.http > diabolo.1709: . 1:1461(1460) ack 142 win 8619 (DF) 07:10:24.142724 diabolo.1709 > ms.http: . ack 1461 win 33580 (DF) ** delay = 68 ms 07:10:24.267165 ms.http > diabolo.1709: . 1461:2921(1460) ack 142 win 8619 (DF) 07:10:24.342698 diabolo.1709 > ms.http: . ack 2921 win 33580 (DF) ** delay = 76 ms 07:10:24.700596 ms.http > diabolo.1709: . 2921:4381(1460) ack 142 win 8619 (DF) 07:10:24.742697 diabolo.1709 > ms.http: . ack 4381 win 33580 (DF) ** delay = 42 ms 07:10:24.892056 ms.http > diabolo.1709: . 4381:5841(1460) ack 142 win 8619 (DF) 07:10:24.942675 diabolo.1709 > ms.http: . ack 5841 win 33580 (DF) ** delay = 51 ms 07:10:25.083231 ms.http > diabolo.1709: . 5841:7301(1460) ack 142 win 8619 (DF) 07:10:25.142714 diabolo.1709 > ms.http: . ack 7301 win 33580 (DF) ** delay = 59 ms 07:10:25.274200 ms.http > diabolo.1709: . 7301:8761(1460) ack 142 win 8619 (DF) 07:10:25.342674 diabolo.1709 > ms.http: . ack 8761 win 33580 (DF) ** delay = 68 ms 07:10:25.599938 ms.http > diabolo.1709: . 8761:10221(1460) ack 142 win 8619 (DF) 07:10:25.742716 diabolo.1709 > ms.http: . ack 10221 win 33580 (DF) ** delay = 142 ms 07:10:25.793099 ms.http > diabolo.1709: . 10221:11681(1460) ack 142 win 8619 (DF) 07:10:25.942744 diabolo.1709 > ms.http: . ack 11681 win 33580 (DF) ** delay = 150 ms 07:10:25.982986 ms.http > diabolo.1709: . 11681:13141(1460) ack 142 win 8619 (DF) 07:10:26.142719 diabolo.1709 > ms.http: . ack 13141 win 33580 (DF) ** delay = 160 ms 07:10:26.173861 ms.http > diabolo.1709: . 13141:14601(1460) ack 142 win 8619 (DF) 07:10:26.342753 diabolo.1709 > ms.http: . ack 14601 win 33580 (DF) ** delay = 169 ms 07:10:26.372413 ms.http > diabolo.1709: . 14601:16061(1460) ack 142 win 8619 (DF) 07:10:26.542712 diabolo.1709 > ms.http: . ack 16061 win 33580 (DF) ** delay = 170 ms 07:10:26.562574 ms.http > diabolo.1709: . 16061:17521(1460) ack 142 win 8619 (DF) 07:10:26.742702 diabolo.1709 > ms.http: . ack 17521 win 33580 (DF) ** delay = 180 ms 07:10:26.760342 ms.http > diabolo.1709: . 17521:18981(1460) ack 142 win 8619 (DF) 07:10:26.942714 diabolo.1709 > ms.http: . ack 18981 win 33580 (DF) ** delay = 182 ms [-- Attachment #2 --] kG8tcpdump-fbsd ݪf7*-˲e>jrS0Wf&*з?LR)˚TR[~e˲2VL?io|Zo/z/_U*oǏo|ۿ럿ު ?ooo?AQ[5nmNeYGS_@qMsȯ$Jk#mn~%W)rVWez\ AQI}7?vH߱h[L\L桁/RJ]ʔX3VY/QqFZ}rma915ZI{gޤ, 53ѽYri>.5蝆ZL'I/;8k֫IIM" ʆbZcB9صppP@0)i"#j) ߞ>'d֫Nu-}̀Q ss\>ӄÃ[/Zk5IGqGGo҂fwE<))I{R=18 s\FUe{y*s`t16KOIitd6uz'/HB@YY0ֿ"il5j^4gz{%}EM7.ѹJRsKEMق2s@tNHjX`t1-%%5&j$6%KRR^jQ-v %^>`$ rc^BV/јdѴ*ֽ9*?>@R tR$#THc.l\i%'I3]O[<\Ҭ1s'Vz1 ŬO+I,w|28JbEC?fʹ$hEdQ$`˧aP#Ax,qyWgVgDVanoF IJF0;jlO%- qQ0X\⚋F> Qp8GwcOnٵa]+x}:uIstG[(of֘KkaqTg0;j3 qZMff('%Y9eϒbhg9جF B^]$% %Q(z[:>p2HS l0q8fG}Dײ@,ɬ``JJ"rdxsԒQ%DQnpGѵ:EѬLIu-B.1Qk25qun sRR2Ŏl踣OqPI5%)IEkt]CGq = U^c\"t:Qj99ۢE>vL?0kVLZI_U}@5szF14v&L\|d99iF>¯$L(-Y 2#"/nZ"IIX(樥S7>Zflڨu͐Z4.㪣64}lg;"h$R֒4rꨥ$ xswQMz阹՟TLj.h@`4pvzR'56J&;,nwsp$ ۺ/-G%;5KoRQtJ=mwseF=, g.n>wt5s\H;T¶3֪6PDk(TBp-v5$yuxGaCUoTՉUfAFjz?)UΎ"fls3Jn\m:(5Q=fi>xb$a5)gUrfC߶z6h`PŹd3>', {.lHt;:e(͡j2ΤZ6ș9zuQ}H'C@=Y~D$`s;:*X ,5垁0r~2n'W6ˎ h=,+Qu~xRЎzyGGYg?<sYh G]g-)E K-D4CUͥ[} #grhCn|wp>v!Rek̩;HQf#;~b>!T@A1r<cSb6[ἠBy,L#TÖU56$K"ˁhJF>*E]Tq.-nj^Resۊj 5JXOkJuprj=44;jcUïte mK,Ԣs@|{},5\UmW]8rK+-?fG/ۢν@h_u!;upQ#Hz7*m# ٱm# Ѯwwttu nUKhTNbUGFy;NyGl nj9TQnCv@-aY@~#e.(YnJR@!oY'7Y$[*"0R<cg Cv-rQy&aUR@,IU9$aLbnU- $: i48ΔF^cwpԶ*DnUR DZuY"%:lI oZ'њpd;:Xr͡r[ m>\(FXTE]e;8j[ -mU= d/]9J:ȑ0d-n谗4ttܖB-DkQ)ȉUzږ(1͡^G4p+vsxGGY F/ח*X>ne/=Qn9Tܖ~@ G@/B*FЮ}gYsv]ڰ͡g6HJ#{%6h}a9TInKH#Jo#Hpstt>;=W"Ufe5JR9f- $Yv;::,bDjn;, [n/(=CxmC䎦7g)#M_5Qa FnU#rv,yBGֻ9jX6_\?k9Q-riuC*wtۨa?ss/SF6ȞK`RFyGG'nUK`3? mxɦT#rGx%:,T.)/BR(^)mv世ܖ,9VN깄#{ Uةr9P%#eLU蚤aVV# Cj}I[Qk.mnH_R%X|a+J*63*)@L D7_r|+jud!Y@RiBGwh~yQ/{|m4EHcs|C:o7h6CVv0GuX7șK;Rk>yLC}49Ti.㩣v'g-ls|G&y's/T(<$;֑"UfU=FL7QDIwpt>6_>ATMJ%&;k(d#oneO͡V<+0%, [.HV)ؼVw4|8̷ ][tqݒ,RΧmQ}lhd>挒T 3dW׃+wtt Z #T8%UigaFjۼ/;d{xn{CU%]*fgɹd!kTLCBGٓT5f9r|GZ:8&kPdeLTv|,91U'1^ё"Gk+N:ڱd%T+̷ҪMJ=PŹd>v!Y@JvmU`NacGJ<gd7'5\8H%r;syGG{f|YPIr\2ߑc^˰:GHnU-tGTY@\2ߑ]n*7h{\ Κ-IU.D_{'d!7訝U9Ti.ekZ4I"f;$gnUb (d [u^aGUzn QDo\rߑ$\it ,a9T\rwt,Nb, 5wv>Q=FEֶ.IUT*cGwtTf^6_ޠ9 Fm, {i但sw.gns6$#@~x, g.mȁ7G1 V%|?rIĮm^S\ۑ?/1 mQmUK`aij, 9v$~{Gwpt<Lj?R'ĥK`!C9T\!Xˮd;dk;8:q+Z@APFL%UV](raS%}]&?*DV}N`p}j1jJ9Uquҧ؝hv92J-p{M Ω"b"~I<\T!.NOU*~0`_̆Fxe#ͧX"" UB%j/}:{oao79P%Vl7XȀ?dTV1eGU2#@erd~sTPɱ9EU [TY|QeHiU-q\TqIU]fXvDXEbaːj+qLp9(GKiEk= !&UV\P¼Eb ݼ>]BUiRKQ9U}QEK|TՇe<_ReA[TaHBooT XmerL Kr5zM!H+¹1H?f*+eU&XCVKY8*JA3Ufn_UյCH(}o8T9TxjEc}X.4kwhaWJveGRլn, ,쓆7Gwpt>)͡s.D 5Y@4mq^I&פEV,C"<},p%Uz pt;6[xnzM4nֲm^- Q HjߚxӇK͡ #VRUfakYY1s+q6>>~Ts"k]MvD5/f( Z^ntqvԡ>k1I*GVJr"J}N5nU4jR}Fd QnW䬥ފlޗQn"nUxi4h}JX@ʔ4rcTtpF9TR2@UU%wʣJTO>XGb--ʪGGm6H+Cf6 @,-[N#$^6r:Jxoˁ*IUXYxK:9T11rrQ}ōtfJ^Zn7d_v2aPrUY5Ũ6wo,CbAJ\y͇|HVq;.~9v$״/<5VTV3E [-- Attachment #3 --] dG8tcpdump-linux ]/7Se[/\su`?Avv`N&$'鶤@ \*Iۼz _@Og[oy@ oڷoos۟嗷N???_~ǟz[7[HqgG ƺ ~!g9rBkAMJV,/h[:7$rl+=oZYF_ӿ@S#`AIk&w$ikDf}JhLLH$GDf}PHxLNL@į&"&̏LH̭Df}]$2?xчf Ei4Lsa[+^VPKڡdPwZK"vc92(;@DܺVRy_PmǸT/"[KXGI_}2[ ezG(#(3,)BJzG:E=4R>F.7~+VG X)U=($^BeE(yB11c4I"sxO_FM~+0~{ijln@:z=fEGo| Igp7~h {Ű_[ՠX;A BgY[ܒ ɧUq.bEx֫@&sј54Es݂8C(ùH`v#"]hu|ނS[jN-(miD#_>֠d_ JwPSVsa{!=7-0ʼn 5)0܂"n.K fd>|.߯%>xAЄ=;PD/ՠiKٜ2csKWi A3.aUm2+:!XSԹ܂7=٪~Js[J[߁Z:c[.1P:\Rlf:q Wb5Wc5(\<ʠl]wMB?YxNu jj./Bjj~:v#QX6PZ _E&f~b?0+qjP>c"u%]ѶP46J{PD[dYOY7z7~n-ezG(_D/E(LRRwF_T-Ɲ wIS.d$<CcQjUb[w!*}܂|JuLc(ҙFRSE>ԘbC[:G+BJdP:$tק"%p5zjGcɖRE*N7Hg8l)-AYzG(an_.PC1 7A>ui) ' >TѺE:΄3O7VKzG(};IREQnA Il6K%uM{}[P-6,Qe^i8,Eo+郮w[/heނ:GdKIk.b(:yxJf6zEN7fk^jA&]m5N7fg*Byx6v#4K7Vo/ 3Woc<lʟJ2#\5VQ6J]t.%,:5Y6!{ʧLQY1NVcyˆJR/5P bPsC5g,D1-yǺ$h2הZeuGwT=g3BBSw? 4Rdy).LaciˆOi<LqKZɰձYQPӼjLQ Ǣ#uUSYzG(0=O>Su$݂p{/Z))0SwPSwW1stUgttS\19'}J-5tJȟ)Unk"i+\KYu* ʢ(az'[)x1%͆+d7d iGP;B NZVHngzG(\r__|ͯkՑĵ 7֪hp>;BtyjtXaK}MqR*Cɓ-%IBƫ52{MqQ:PԫsnVC?VL< ֺudK>DzBHl:ak ]q7Ot{PCSFZ(S0gŬKp3V+"3AfSM8<*yXq_5Ÿfd߳b#L^]L}^&ZAxMZ+hwla1Մ6Yg?d1/ciONa_pYU8OyDvMZirɝœdᖓr4T+=\xŧՙ&s`-xb<N rɔfR+Se1=`?bn S^zժTS)Z28"AmGj}4-x蚺{\<6qx{4M]GAK8mk r$'^5q=.II7MHe5z5pٞmA wߣ'b4I?[~s+)6^K5uּ5҃5>x6"ي9V|6 Ļ\JtZAkr_|Ҳ9)ךU_Wz<O56z8tKdzK9{\KP \P;c5 qm 1KfoPrىHVJ隒w.p.j\<Vrtoq͖4*3Yp-f-(>9jJ.4q~^1>܁kJ3M}(mYĭ~*F\<jev~? 5zeE*1bOGa^W.dt\~=5keY\3y,S KjYY'q#v$q{e?\ߕ.xySegBG5,RZ}K<pW3>#q+Պ2Lcj`g m~{+rs8<rَ1/;{]5+2MSҲ-x5[D2"=\.x%^z-x&i<r`m\Xf?a^x̩W Z跽rQ-٘uIVzJb(r߯p#k\Z~+תҪ}*uL;V ]sXƵV2OkgwhPKSM..xwjki~OiG.*W.e2Կ\^mJ_n\ƫs# n\|G.+ת%gC:_u#mRqT>@\2 1{Zxv~]~կfgcOʅ4O܂G.S^&W^\٭p;Q;s=_ \{va|m8J5ۜSm\gwUZbϖDr-Ko5z3l4{XCȅ5.v")\wrE._+5\.=>+LP #.x"sr{pr ~oG.`R^hYҊ\[ڙZx0\[ev|+L(rҾVOE]\.xB*|Ԟ=fZG~ Q0[@%<\Иˊ75(r|{@#̇@I\[%R.XTLh퐋^v+lxX+j~o#9x'Qnl,pRP䲓ӻ{OހKF.qIx"%mH%|~1[Ҁ?jhK}B?A}ނ.gxڶW>[k\}3N{#2{>\6ߣl4rр"ck5|}hrZL˶rM]3<&b5̭Yo.q 0K<E.]֮tNzo{\\/%"WiOhְ3C.W.z!]ek`+r!.\L5UM-Y奅URPb1m#פq?`RZv(QjB~+=mJ ~Áfshg.ۺZ-7sE.c.xbjGWP-x:# O54\g2gq{ZDE.ɹ+VwM̯nd9?^ G.xb>{n\(Pr\vd핋A\i-<r.-p{XDWc̘ke$Xko+3v0 ~bc {\Xj~Ikk k41Xkp^\D\f\Tsu7j^k}a.xmп^F-uK\Kj%Xj]st{3y{cU5t!_0z-{-xlY$faI%.~.xҿߣ+bc)cA:_u{ZpzH<r|kbcyN<r!kS -.o%@kVTLs.{R.Z]S$v(ᢉ42~)r 㲿Hkú>Fx슱Viwӱu2kuk 6Х~-j.q b9p9 װ~ݽָsOs~kuљb!|}a?*[ev!'X6A_صi<rNÜmY!(rj(aWYvtv#h28+תZ;V^kvy̵<֪q*rRMkn\PvBzM<ptkھk~\;5^^;n#Iq5jqº\\^f-^Gq?\ؿkתk}^[5)j1߾k\-x%wm{Z̷}FJO55{XSk1 <[5,reQ>=ByԽIegWߏkƦ0Ol{Zܸh)Wڙ%K@t;UAΔ< ;d56].ڃX&xW\z-qr˥jqݹ\]'1{p\\o.h=F.o\ ^:].?q%އ ^jڹq^Jr\'7ɻMu0(w~{&3\+oG;5;W卛xB\}7-5rKycjL:كk ^b[I*x:+'NsyfyD15/i7 ^o͛#-52 &x<jj>sTʵ{s\/aWÍnڦ,on.h?2jZv.?3>qӥԜ2rq&p)j.@wkb."5G &a"B rk:zm 2hzfr-j\pQ7Y;0 pH~_Sq=3)RK Zߋu9&|/kvh?\Uzѕ^wo Rwk~oN˽v0W6 }!qՃ?17^$\I.^uߋ'McW} vjOq717FP!WpkoNȵ}K*T?|O>w5y8*3V*W+*ك$t7*T1jnuP\.Mbm|7[r(^R+\Q_F6[1]Ի*}OmB{ȹ*|/VQs]p+]]C{`چyeȥGZ\{K)xOedkۑ6}M(bɡWU*O>XzqUb5|a\{3ٓMx!&fuMnRc&fF ^Ũ1%EBI?ոwuuvDǂ=f)#*Ba41jNΡ%3GLiCXOD|ݾfblf5+]<=| ߤibHT@\ &(?}5%R+N=*:.(CI 6WWA`X̤\1W%cl5B`^%dYd>K'˻2!⎛ D#X*9ki=Jy+STs݀KF9BӹYa0I=k"A i2czkG3teϰ%Q`5tѹϵ+l=;/.j2X_m1p:oqO[)fҷx#Qĥuk a7Uw U$FĀ닋O;KW((>\[,1b.^ʱvڃK$d/a5Gݯ$]]he\wK]ѯ ^6!ʪ=$\9cWuE{pmAo3-tySս&FͳK\o`6nwW?`ty4t!},VY껥j͜:"P;.].ړkb̹ӻb]H5{`h}&FMpJfܯ㭷%bbb;E͵߷5eWV⋗VT* j89\suJF2ӻbSȪ#SrkQs ؏/ -H֊x^Œ#wzbBx\,az\u"qZ=ט3$.XLpX2%U&I1h0Um+tzWWeIiϜĶI1j2mbIV:A|yKB`rq06+,r/a(觇`{6)qd$kN{z}U_sK6W|kͥ zhelp
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20000304183945.A8539>
