Date: Fri, 5 Nov 2010 18:18:27 +0100 From: =?ISO-8859-1?Q?Ermal_Lu=E7i?= <eri@freebsd.org> To: Ricky Charlet <RCharlet@adaranet.com> Cc: "altq@csl.sony.co.jp" <altq@csl.sony.co.jp>, "freebsd-pf@freebsd.org" <freebsd-pf@freebsd.org> Subject: Re: Questioning altq (cbq) performance above 4Mb on gif or above 40 Mb on e1000 Message-ID: <AANLkTi=pga3UpDJ2dzHseb%2BQpX98vtVmjxi430vQvqpP@mail.gmail.com> In-Reply-To: <32AB5C9615CC494997D9ABB1DB12783C024C6FC07B@SJ-EXCH-1.adaranet.com> References: <32AB5C9615CC494997D9ABB1DB12783C024C6FC071@SJ-EXCH-1.adaranet.com> <32AB5C9615CC494997D9ABB1DB12783C024C6FC07B@SJ-EXCH-1.adaranet.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Fri, Nov 5, 2010 at 1:33 AM, Ricky Charlet <RCharlet@adaranet.com> wrot=
e:
> Has anyone out there run altq with cbq with bandwidth limits set around 4=
0 ~ 50 Mb and seen it work well (actual through put allowed to come near th=
at speed)?
>
> Thanks
> ---
> Ricky Charlet
> Adara Networks
> USA 408-433-4942
>
I can suggest to try with higher hz and increase queue lengths in altq.
By default they are 50 which is quite low in that regard.
>
>> -----Original Message-----
>> From: owner-freebsd-pf@freebsd.org [mailto:owner-freebsd-
>> pf@freebsd.org] On Behalf Of Ricky Charlet
>> Sent: Wednesday, November 03, 2010 9:47 PM
>> To: 'freebsd-pf@freebsd.org'; 'altq@csl.sony.co.jp'
>> Subject: Questioning altq (cbq) performance above 4Mb on gif or above
>> 40 Mb on e1000
>>
>> Howdy,
>>
>> (FreeBsd 8.0REL plus a modified e1000 driver borrowing the 8.1 altq
>> capabilities, amd64, 8 core)
>>
>> =A0 =A0 =A0 =A0 I have been measuring altq performance on my system. I s=
et a
>> cbq bandwith limit for a queue, match traffic to the queue with an
>> appropriate rule and pump data.
>>
>> =A0 =A0 =A0 =A0 Without altq enabled, my traffic gen tool (nuttcp) can p=
ump
>> 800Mb across my gig links.
>>
>> =A0 =A0 =A0 =A0 With altq(cbq) setting bandwith limits (no borrow), up t=
o about
>> 40Mb on em0 altq keeps up. But from 40Mb bandwith limit and up, altq
>> seems to slow down my traffic much slower than the bandwidth limits.
>>
>> =A0 =A0 =A0 =A0 Same effect is observed on gif interfaces (where my real
>> interest lies) but much worse. With altq(cbq) setting bandwith limits
>> (no borrow), up to about 4Mb on gif0 altq keeps up. But from 4Mb
>> bandwidth limit and up, altq seems to slow down my traffic much lower
>> than the bandwidth limits.
>>
>> =A0 =A0 =A0 =A0 I have a large file of sample data in excel formant whic=
h I'd
>> like to share. Is there an appropriate way to share it with this list?
>>
>> =A0 =A0 =A0 =A0 I know I'm not cpu bound (97% idle while nuttcp pushes 8=
00Mb
>> traffic and altq configured with a bandwidth limit of 50Mb actually
>> passes 30Mb.)
>>
>> =A0 =A0 =A0 =A0 I sort of suspect I'm mutex bound but have no idea how t=
o test
>> that.
>>
>>
>>
>> =A0(1) this config allows about 4Mb tcp traffic to pass:
>> ----------cut------------------
>> altq on em0 cbq bandwidth 100Mb queue { queue1, queue2 }
>> queue queue1 =A0bandwidth 1Mb priority 7 cbq =A0(default)
>> queue queue2 bandwidth 50Mb priority 1 cbq
>> pass out quick on gif10 inet proto tcp no state queue queue2
>> pass out quick on gif10 proto icmp queue queue2
>> ----------paste----------------
>>
>> (2) this config allows about 40 Mb tcp traffic to pass
>> ----------cut------------------
>> altq on em0 cbq bandwidth 100Mb queue { queue1, queue2 }
>> queue queue1 =A0bandwidth 1Mb priority 7 cbq =A0(default)
>> queue queue2 bandwidth 50Mb priority 1 cbq
>> pass out quick on em0 inet proto tcp no state queue queue2
>> pass out quick on em0 proto icmp queue queue2
>> ----------paste----------------
>>
>> =A0 =A0 =A0 =A0 Yes, I send appropriate traffic in each case to be 'caug=
ht' by
>> the tcp pass out rule wether it be found on a gif or an em.
>>
>>
>> =A0 =A0 =A0 =A0 My goal is to get 'expected' behavior (a bandwidth limit=
of 40
>> Mb allows 40Mb to pass) at T3 link speed (45Mb). Is this a reasonable
>> expectation? Any ideas about config jigs or tests to run?
>>
>>
>>
>> ---
>> Ricky Charlet
>> Adara Networks
>> USA 408-433-4942
>>
>>
>> _______________________________________________
>> freebsd-pf@freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-pf
>> To unsubscribe, send any mail to "freebsd-pf-unsubscribe@freebsd.org"
> _______________________________________________
> freebsd-pf@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-pf
> To unsubscribe, send any mail to "freebsd-pf-unsubscribe@freebsd.org"
>
--=20
Ermal
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?AANLkTi=pga3UpDJ2dzHseb%2BQpX98vtVmjxi430vQvqpP>