From owner-svn-src-head@freebsd.org Sat Apr 15 01:30:19 2017 Return-Path: Delivered-To: svn-src-head@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7EC36D3D1BB; Sat, 15 Apr 2017 01:30:19 +0000 (UTC) (envelope-from freebsd@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (br1.CN84in.dnsmgr.net [69.59.192.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 681ACA27; Sat, 15 Apr 2017 01:30:19 +0000 (UTC) (envelope-from freebsd@pdx.rh.CN85.dnsmgr.net) Received: from pdx.rh.CN85.dnsmgr.net (localhost [127.0.0.1]) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3) with ESMTP id v3F1UHg1009182; Fri, 14 Apr 2017 18:30:17 -0700 (PDT) (envelope-from freebsd@pdx.rh.CN85.dnsmgr.net) Received: (from freebsd@localhost) by pdx.rh.CN85.dnsmgr.net (8.13.3/8.13.3/Submit) id v3F1UHpR009181; Fri, 14 Apr 2017 18:30:17 -0700 (PDT) (envelope-from freebsd) From: "Rodney W. Grimes" Message-Id: <201704150130.v3F1UHpR009181@pdx.rh.CN85.dnsmgr.net> Subject: Re: svn commit: r316938 - head/sbin/savecore In-Reply-To: <20170414202918.GD5039@wkstn-mjohnston.west.isilon.com> To: Mark Johnston Date: Fri, 14 Apr 2017 18:30:17 -0700 (PDT) CC: Alan Somers , Ngie Cooper , "src-committers@freebsd.org" , "svn-src-all@freebsd.org" , "svn-src-head@freebsd.org" Reply-To: rgrimes@freebsd.org X-Mailer: ELM [version 2.4ME+ PL121h (25)] MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-BeenThere: svn-src-head@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SVN commit messages for the src tree for head/-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Apr 2017 01:30:19 -0000 > On Fri, Apr 14, 2017 at 01:49:51PM -0600, Alan Somers wrote: > > On Fri, Apr 14, 2017 at 1:41 PM, Ngie Cooper wrote: > > > Author: ngie > > > Date: Fri Apr 14 19:41:48 2017 > > > New Revision: 316938 > > > URL: https://svnweb.freebsd.org/changeset/base/316938 > > > > > > Log: > > > savecore: fix space calculation with respect to `minfree` in check_space(..) > > > > > > - Use strtoll(3) instead of atoi(3), because atoi(3) limits the > > > representable data to INT_MAX. Check the values received from > > > strtoll(3), trimming trailing whitespace off the end to maintain > > > POLA. > > > - Use `KiB` instead of `kB` when describing free space, total space, > > > etc. I am now fully aware of `KiB` being the IEC standard for 1024 > > > bytes and `kB` being the IEC standard for 1000 bytes. > > > - Store available number of KiB in `available` so it can be more > > > easily queried and compared to ensure that there are enough KiB to > > > store the dump image on disk. > > > - Print out the reserved space on disk, per `minfree`, so end-users > > > can troubleshoot why check_space(..) is reporting that there isn't > > > enough free space. > > > > > > MFC after: 7 weeks > > > Reviewed by: Anton Rang (earlier diff), cem (earlier diff) > > > Tested with: positive/negative cases (see review); make tinderbox > > > Sponsored by: Dell EMC Isilon > > > Differential Revision: D10379 > > > > The free space calculation is still uselessly conservative, because it > > doesn't account for the fact that core dumps will always be either > > spare or compressed. The result is that savecore will frequently > > refuse to save corefiles even when there's plenty of space. I > > proposed removing the space check altogether in > > https://reviews.freebsd.org/D2587. However, I agreed to wait until > > after the compressed core dump feature was merged, because then mostly > > accurate space checks will be possible. AFAIK the compressed core > > dump feature still hasn't been finished. > > I had held off on it for a while because it was going to conflict with > the work to add encrypted dump support, which of course has finished. > > The patch to add compression support is here and should largely still > work: > https://people.freebsd.org/~markj/patches/core-compression/20141110-kern_dump.diff > > I've been hesitant about pushing it forward: > - The dump_write* APIs need some simplification after the addition of > encrypted dump support and support for dumping to 4Kn drives. > - I'm not sure how encryption should compose with compression. It seems > intuitively obvious that we should compress before encrypting if the > compression is to be of any use, but I don't know enough to know > whether the compression might somehow compromise the effectiveness of > the encryption. > > If anyone has some insight on the second of these two points, I'd > appreciate hearing it. I have a large amount of reworking and modulization of the dump code incuding intergration of your (markj) compressed dumps. Layer isnt implemented but is in the plan. I should not of held off on the net dump code as it got smashed by encrypted dumps, then again by the libif'ing for all the Intel drives that had been netdump modified. Basically now starting over :-( Minidump is an lkm for me, and main dump is almost an lkm for me too. -- Rod Grimes rgrimes@freebsd.org