Date: Sat, 30 Jun 2012 16:53:33 -0700 From: Oleg Moskalenko <oleg.moskalenko@citrix.com> To: FreeBSD Current <freebsd-current@freebsd.org> Subject: RE: [HEADS-UP] BSD sort is the default sort in -CURRENT Message-ID: <031222CBCF33214AB2EB4ABA279428A3012CA28AEB94@SJCPMAILBOX01.citrite.net> In-Reply-To: <031222CBCF33214AB2EB4ABA279428A3012CA28AEB84@SJCPMAILBOX01.citrite.net> References: <4FEAA280.2070705@FreeBSD.org> <4FEAA599.9070107@FreeBSD.org> <031222CBCF33214AB2EB4ABA279428A3012CA28AEB6D@SJCPMAILBOX01.citrite.net> <4FEAC5B1.30104@FreeBSD.org> <4FEB6D2B.4090508@FreeBSD.org> <031222CBCF33214AB2EB4ABA279428A3012CA28AEB84@SJCPMAILBOX01.citrite.net>
next in thread | previous in thread | raw e-mail | index | archive | help
I am going to post the ministat results of my tests:
1) Text sort of 167-Mb file (1,000,000 random lines, each contains several =
fields,=20
each field is either a floating point number or a binary string with ran=
dom=20
symbols between 0 and 255).=20
Sorted on second field (-k 2,2 option):
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D
x OGNU
+ NGNU
* NBSD (multi-threaded)
+--------------------------------------------------+
| x * + |
| x x * +++ |
|xxxxx x * ** * +++* * * *|
| |_A_| |_______M_|AA___________| |
+--------------------------------------------------+
N Min Max Median Avg Stddev
x 10 5.758 5.937 5.848 5.8508 0.057276716
+ 10 6.29 6.366 6.332 6.3302 0.02123833
Difference at 95.0% confidence
0.4794 +/- 0.0405862
8.19375% +/- 0.693687%
(Student's t, pooled s =3D 0.0431954)
* 10 6.067 7.228 6.225 6.3449 0.35979422
Difference at 95.0% confidence
0.4941 +/- 0.242055
8.445% +/- 4.13713%
(Student's t, pooled s =3D 0.257616)
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
2) Same file, numeric sort on the same field (-k 2,2 -n option):
x OGNU.n
+ NGNU.n
* NBSD.n (multi-threaded)
+--------------------------------------------------+
|**** * x x x +++|
|**** * xx x x ++++|
| |MA_| |__A_| |A |
+--------------------------------------------------+
N Min Max Median Avg Stddev
x 10 7.142 7.338 7.216 7.2179 0.066727389
+ 10 8.231 8.307 8.271 8.2677 0.022701199
Difference at 95.0% confidence
1.0498 +/- 0.0468287
14.5444% +/- 0.648785%
(Student's t, pooled s =3D 0.0498392)
* 10 6.91 7.094 6.98 6.9864 0.061449528
Difference at 95.0% confidence
-0.2315 +/- 0.0602683
-3.2073% +/- 0.834983%
(Student's t, pooled s =3D 0.0641428)
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
On these two tests, all three program produced the same output.
So, on text sort, NBSD is slightly slower than GNU; on simple numeric
sort, NBSD is slightly faster.
I did not use ministat for complex numeric sort (-g) because the performanc=
e=20
difference is huge (in favor of NBSD) and it would make no sense.
Thanks
Oleg
> -----Original Message-----
> From: owner-freebsd-current@freebsd.org [mailto:owner-freebsd-
> current@freebsd.org] On Behalf Of Oleg Moskalenko
> Sent: Wednesday, June 27, 2012 6:45 PM
> To: FreeBSD Current
> Subject: RE: [HEADS-UP] BSD sort is the default sort in -CURRENT
>=20
> Hi
>=20
> As promised, I am supplying an example of comparison between several
> sort programs.
>=20
> The test file is a randomly generated 1,000,000 lines, each line
> contain a single floating point number.
>=20
> We are going to sort it three ways - as text, as -n numeric sort, and
> as -g numeric sort, with 4 programs:
> 1) Old BSD/GNU sort 5.3.0
> 2) New GNU sort 8.15
> 3) New BSD sort, single threaded
> 4) New BSD sort, multi-threaded
>=20
> The system is a 3-CPUs system, 1.5Gb of RAM, FreeBSD version 8.2. All
> times are in seconds. Locale C.
>=20
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>=20
> TEXT SORT
>=20
> sys user real
> Old BSD/GNU sort: 0.0 1.692 2.008
> New GNU sort: 0.0 2.279 1.605
> New BSD sort, st: 0.0 1.964 2.300
> New BSD sort, mt: 0.0 2.385 1.897
>=20
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>=20
> NUMERIC SORT -n
>=20
> sys user real
> Old BSD/GNU sort: 0.0 4.357 4.674
> New GNU sort: 0.0 8.839 5.134
> New BSD sort, st: 0.0 5.308 5.592
> New BSD sort, mt: 0.0 4.581 2.489
>=20
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>=20
> NUMERIC SORT -g
>=20
> sys user real
> Old BSD/GNU sort: 0.0 45.378 45.630
> New GNU sort: ~450 ~121 ~300
> New BSD sort, st: 0.33 4.334 5.992
> New BSD sort, mt: 11.140 4.624 8.983
>=20
> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>=20
> Thanks
> Oleg
>=20
>=20
>=20
>=20
>=20
> _______________________________________________
> freebsd-current@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-current
> To unsubscribe, send any mail to "freebsd-current-
> unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?031222CBCF33214AB2EB4ABA279428A3012CA28AEB94>