From owner-svn-src-all@freebsd.org Fri Apr 14 20:46:51 2017 Return-Path: Delivered-To: svn-src-all@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DC2AFD3AE36; Fri, 14 Apr 2017 20:46:51 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pf0-x244.google.com (mail-pf0-x244.google.com [IPv6:2607:f8b0:400e:c00::244]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A386CD98; Fri, 14 Apr 2017 20:46:51 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mail-pf0-x244.google.com with SMTP id i5so16482288pfc.3; Fri, 14 Apr 2017 13:46:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:mime-version:from:in-reply-to:date:cc:message-id:references :to; bh=8BWiGTiW0VOVw6dRH/rMAUFkS4N3ARiMg1FyOTVnKn8=; b=IjqSuRymmJcPpTXp86aYz02cxnxBhFi3SE75ZmmNZcM/oJvPFL87B5PiANktf/kvJ4 UbC/DnrWxSt34wP67ltRiviGaAiyBWo7P/Y56Zo33rgpH7uNeeK3+v0YBkYH7Y6zwaHw w318Zxp8F7BIs09AZarkUtkIken8aGkO/DpGs7YCBDWt53zyzjFOK0mGimzVdG0CCsaN GI0LsD4YXmdKD8LHDs1/sF8UlUn6y+ogoIFryjOyrEQfkDtBmNgUAYO84VsymSlkIfNc EJ2KhaRrhpxnFs1la7hwu8VVVJb9RvXhUCWElYE+FTYDj7aNdNqYGpgFpNfRs4TwwX/E Dh8A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:mime-version:from:in-reply-to:date:cc :message-id:references:to; bh=8BWiGTiW0VOVw6dRH/rMAUFkS4N3ARiMg1FyOTVnKn8=; b=RUN5A/Wds4ojq1HFGEgktWzr3WbiDOhdSqYO9d0D1UJ0N5Eqf/tI4dzl7jn9q831Bw MMss7/1yhs8zTUoB12YyS5JxRNBrYeBpnJuPjrWh2V16LhoFcuKjeJn+3O9TQ00PB8jU HnG8zWGu6TH5gKYdF2X5ewi7RQI7tB20Uyjt3dcJEUAStw7YAREf5i6UL4BoxA6hzN94 HHjz2c2VGBG1MsIFQbg0gHwEvbaOciyw04uZbRYTKttwyqnOe2GfEe5Od0kiI7LolI/t W7ejudmYCuH+IgPBy7XPVXfO18QTmvMRQ17rASHqMaL3BxuReFUdzaCoXYTnzgvJjUDu TIsQ== X-Gm-Message-State: AN3rC/7XO+VjfUjTuyyDc8CYjRQ/fUb1J9n68ojRsc8U594/HupEzjP3 GndwswhuD6w5oQ== X-Received: by 10.98.214.12 with SMTP id r12mr8621067pfg.204.1492202811246; Fri, 14 Apr 2017 13:46:51 -0700 (PDT) Received: from pinklady.local (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id p11sm4806807pfl.4.2017.04.14.13.46.49 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Fri, 14 Apr 2017 13:46:49 -0700 (PDT) Subject: Re: svn commit: r316938 - head/sbin/savecore Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Content-Type: multipart/signed; boundary="Apple-Mail=_A2F74109-396E-4EE1-B8D1-4DB860669382"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail From: "Ngie Cooper (yaneurabeya)" In-Reply-To: Date: Fri, 14 Apr 2017 13:46:49 -0700 Cc: "src-committers@freebsd.org" , Alan Somers , "svn-src-all@freebsd.org" , Slawa Olhovchenkov , "svn-src-head@freebsd.org" , Ngie Cooper Message-Id: <15ABDD42-E2C4-4519-B736-04A56FA8C2D0@gmail.com> References: <201704141941.v3EJfmCW003347@repo.freebsd.org> <20170414201431.GF20974@zxy.spb.ru> <0CAE4B1C-228B-4C71-86E9-4337753DFF74@lerctr.org> <12820BAB-D8BA-4EDE-89BC-4BDB56B1E57A@gmail.com> To: Larry Rosenman X-Mailer: Apple Mail (2.3124) X-BeenThere: svn-src-all@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "SVN commit messages for the entire src tree \(except for " user" and " projects" \)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Apr 2017 20:46:52 -0000 --Apple-Mail=_A2F74109-396E-4EE1-B8D1-4DB860669382 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Apr 14, 2017, at 13:43, Larry Rosenman wrote: >=20 > On 4/14/17, 3:39 PM, "Ngie Cooper (yaneurabeya)" = = wrote: >=20 >> On Apr 14, 2017, at 13:37, Larry Rosenman wrote: >>=20 >> On 4/14/17, 3:33 PM, "Ngie Cooper (yaneurabeya)" = wrote: >>=20 >>> On Apr 14, 2017, at 13:26, Larry Rosenman wrote: >>>=20 >>> On 4/14/17, 3:19 PM, "Ngie Cooper (yaneurabeya)" = = wrote: >>>=20 >>>> On Apr 14, 2017, at 13:14, Slawa Olhovchenkov = wrote: >>>>=20 >>>> On Fri, Apr 14, 2017 at 01:49:51PM -0600, Alan Somers wrote: >>>>=20 >>>>> On Fri, Apr 14, 2017 at 1:41 PM, Ngie Cooper = wrote: >>>>>> Author: ngie >>>>>> Date: Fri Apr 14 19:41:48 2017 >>>>>> New Revision: 316938 >>>>>> URL: https://svnweb.freebsd.org/changeset/base/316938 >>>>>>=20 >>>>>> Log: >>>>>> savecore: fix space calculation with respect to `minfree` in = check_space(..) >>>>>>=20 >>>>>> - Use strtoll(3) instead of atoi(3), because atoi(3) limits the >>>>>> representable data to INT_MAX. Check the values received from >>>>>> strtoll(3), trimming trailing whitespace off the end to maintain >>>>>> POLA. >>>>>> - Use `KiB` instead of `kB` when describing free space, total = space, >>>>>> etc. I am now fully aware of `KiB` being the IEC standard for = 1024 >>>>>> bytes and `kB` being the IEC standard for 1000 bytes. >>>>>> - Store available number of KiB in `available` so it can be more >>>>>> easily queried and compared to ensure that there are enough KiB = to >>>>>> store the dump image on disk. >>>>>> - Print out the reserved space on disk, per `minfree`, so = end-users >>>>>> can troubleshoot why check_space(..) is reporting that there = isn't >>>>>> enough free space. >>>>>>=20 >>>>>> MFC after: 7 weeks >>>>>> Reviewed by: Anton Rang (earlier diff), cem = (earlier diff) >>>>>> Tested with: positive/negative cases (see review); make = tinderbox >>>>>> Sponsored by: Dell EMC Isilon >>>>>> Differential Revision: D10379 >>>>>=20 >>>>> The free space calculation is still uselessly conservative, = because it >>>>> doesn't account for the fact that core dumps will always be either >>>>> spare or compressed. The result is that savecore will frequently >>>>> refuse to save corefiles even when there's plenty of space. I >>>>> proposed removing the space check altogether in >>>>> https://reviews.freebsd.org/D2587. However, I agreed to wait = until >>>>> after the compressed core dump feature was merged, because then = mostly >>>>> accurate space checks will be possible. AFAIK the compressed core >>>>> dump feature still hasn't been finished. >>>>=20 >>>> Is posible (in the future) to use multiple swaps (on multiple = disks) >>>> for save core dumps? >>>=20 >>> Multiple swap devices is already handled by savecore(8), if one = uses fstab(5) or dumpon(8). Otherwise, you must invoke savecore(8) on = individual devices. >>>=20 >>> As far as saving to multiple disks is concerned, I would hope that = one is using a redundancy capable filesystem (zfs) or RAID-like = technology (gmirror, graid, LSI Fusion=E2=80=99s RAID product line) to = stripe and/or mirror the data across multiple disks. >>=20 >> =E2=80=A6 >>=20 >>> How do I use multiple devices to have the system dump on all of my = swap? I got a message about not enough space, but there (I think) was = enough between multiple drives=E2=80=A6. >>=20 >> Something like: >>=20 >> - Create a zpool >> - Mount zpool to /crashdumps >> - Change dumpdir in /etc/rc.conf to be /crashdumps, e.g., echo = =E2=80=98dumpdir=3D/crashdumps=E2=80=99 >>=20 >> ? >> HTH, >> -Ngie >>=20 >> PS The issue with lack of space might be the issue that Alan = brought up earlier with compressed dumps and overly conservative free = space checks, or it might be the fact that dumpdir (default: /var/crash) = is full. >>=20 >>=20 >> I was talking about the actual crashdump to swap by the system. = /var/crash has 10T of space (my root pool). >=20 > If your memory is bigger than your swap, you=E2=80=99re = unfortunately not able to save the mini dump if the size of the saved = pages exceed the space on swap. I think this is where markj=E2=80=99s = compressed dumps feature will come in handy. > Thanks! > -Ngie >=20 >=20 > Yeah, I have the following: > borg.lerctr.org /home/ler $ swapctl -l > Device: 1024-blocks Used: > /dev/mfid0p3 8388608 0 > /dev/mfid1p3 8388608 0 > /dev/mfid2p3 8388608 0 > /dev/mfid3p3 8388608 0 > /dev/mfid4p3 8388608 0 > /dev/mfid5p3 8388608 0 > borg.lerctr.org /home/ler $ sysctl hw.physmem > hw.physmem: 137368682496 > borg.lerctr.org /home/ler $ >=20 > SO 6 8G partitions (48G), but the dump is larger than 8G. Yup, that=E2=80=99s not going to work. Since you=E2=80=99re using = mfi(4), I=E2=80=99d try creating another 48GB large RAID-0 volume to = help deal with that issue. Cheers, -Ngie --Apple-Mail=_A2F74109-396E-4EE1-B8D1-4DB860669382 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQIcBAEBCgAGBQJY8TU5AAoJEPWDqSZpMIYV/ZsP/R26qszjM8/4ZKtWuVhoNk5x fqKWa2SccHz3QgKomh13v92Yi+omgxUKxjrG3hoya0gs3ijDuAATu0ulbgp6NMMe a874IZZ+vZ6LxBS0+r3urcurqp26vmBDwqIj7OEC2IY7l6gmbErhAwbwLspJs06w tS1xxsmE7SSXnVMmUPHR5HAE/mLcMtI1evLZfHOoI7e6gHqtCSfDuA8od8UZDQse v7s1jdGJPIyRqifnTahrvx6nKEUU1zd3p2zCundIOARiIviCfNWHJyJ91SvQlIte cL8F2dvGhw6ORSRvKfj/45W0si/20vXT/3H/sNB2r3MQmWjGKx9jQhWPJgYrQoW7 ZiDFt6bBTeNmiiWCJijjCpLJM64dE4zjZ1rXx5YRgxPrasnVknE1MPNd93OTq/FB OuWA26NDPvzMRrAnjSKSxiEjUmkLtlbGzOJt7ekRqMjDl3GkJRheBTJblaMW1n1I qr4+G++kvWiuxBpmtW8tZlBRnEKLEEyiAU9MGi+WqzzM0pvovJa+/NfeBpV+NwUN RBrvhSEOOevBCSN5821BMfkwVt42ozwINLHyg6vkV+MgR4wZ8jEfz8Ns61ChtRX5 gb19gawJcIw4VrB8dp3Z1gXHLoK/nbFBlpycM14GUOiLxG9dLFY7pIjBrlM9+jjX lXzqkxuEqsjnRjqUXnQP =O4ss -----END PGP SIGNATURE----- --Apple-Mail=_A2F74109-396E-4EE1-B8D1-4DB860669382--