Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 17 Oct 2012 10:11:16 -0700
From:      Oleg Moskalenko <oleg.moskalenko@citrix.com>
To:        'Dennis Glatting' <freebsd@penx.com>, Gabor Kovesdan <gabor@FreeBSD.org>
Cc:        "current@FreeBSD.org" <current@FreeBSD.org>
Subject:   RE: [HEADSUP] Upcoming GNU sort removal
Message-ID:  <031222CBCF33214AB2EB4ABA279428A3012CA5381C0F@SJCPMAILBOX01.citrite.net>
In-Reply-To: <1349406553.89315.5.camel@btw.pki2.com>
References:  <506D6AA3.7010504@FreeBSD.org> <1349362250.83035.3.camel@btw.pki2.com>  <506DB65D.7000009@FreeBSD.org> <1349406553.89315.5.camel@btw.pki2.com>

index | next in thread | previous in thread | raw e-mail

Currently the sort structures in the sort utility use 32-bits counters. With Tb files, this may be the limitation point. I can take a look into fixing that.

Oleg

From: Dennis Glatting [mailto:freebsd@penx.com]
Sent: Thursday, October 04, 2012 8:09 PM
To: Gabor Kovesdan
Cc: current@FreeBSD.org; Oleg Moskalenko
Subject: Re: [HEADSUP] Upcoming GNU sort removal

On Thu, 2012-10-04 at 18:16 +0200, Gabor Kovesdan wrote:



Em 04-10-2012 16:50, Dennis Glatting escreveu:

> On Thu, 2012-10-04 at 12:53 +0200, Gabor Kovesdan wrote:

>> > Hi,

>> >

>> > it has been more than 3 months ago that BSD sort became default in HEAD

>> > and no serious complaints have been raised against it since then so I

>> > plan to permanently remove GNU sort from head in the next days. If you

>> > have any objection, please raise it now.

>> >

> Initially I had problems with multi TB files (--unique, five to ten

> files) but I haven't had to do that in two(?) months. I will be getting

> back to that project in a month or so.

>

> It challanges a system's resources. :)



And did it go much better with base GNU sort? It's quite an extreme

case... :) Multi GB is also rare not speaking about multi TB...



Yes. However my problem now is ZFS stability -- typically locking up, case example today:


last pid: 67998;  load averages:  0.00,  0.00,  0.00    up 1+19:50:51  19:02:10
80 processes:  1 running, 79 sleeping
CPU:  0.0% user,  0.0% nice,  0.0% system,  0.0% interrupt,  100% idle
Mem: 146M Active, 2765M Inact, 35G Wired, 371M Buf, 86G Free
ARC: 32G Total, 4141M MRU, 27G MFU, 55M Anon, 485M Header, 614M Other
Swap: 233G Total, 233G Free

  PID USERNAME    THR PRI NICE   SIZE    RES STATE   C   TIME   WCPU COMMAND
17517 root         17  42    4   217M   128M tx->tx 21  25.3H  0.00% pbzip2
17568 root         17  52    4   201M   116M tx->tx 24  25.2H  0.00% pbzip2
17508 root         17  46    4   201M   116M tx->tx 33  24.6H  0.00% pbzip2
17544 root         17  52    4   205M   120M tx->tx 37  24.6H  0.00% pbzip2
17532 root         17  52    4   209M   123M tx->tx 35  24.5H  0.00% pbzip2

etc.

help

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?031222CBCF33214AB2EB4ABA279428A3012CA5381C0F>