From owner-freebsd-questions@freebsd.org Sun Jul 12 21:44:43 2015 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7A6E099B9B8 for ; Sun, 12 Jul 2015 21:44:43 +0000 (UTC) (envelope-from dereks@lifeofadishwasher.com) Received: from mail-qg0-x22f.google.com (mail-qg0-x22f.google.com [IPv6:2607:f8b0:400d:c04::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 365D010A0 for ; Sun, 12 Jul 2015 21:44:43 +0000 (UTC) (envelope-from dereks@lifeofadishwasher.com) Received: by qgef3 with SMTP id f3so99440770qge.0 for ; Sun, 12 Jul 2015 14:44:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lifeofadishwasher.com; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=50MKZQSmdcKCS1Ay9ID+PtmE9eFDXbAqhzOQa8s5yrk=; b=H2vhcu2WsUHg5fgk3X7aJvZ749Ed4LSmwDj3q1h2k6xmVm903EEdVetpFeBqpvDZFk Wxwr/tW+hkw7iOhB//DuD20Ssv2D/6pnZbBZjU4aXkARS2y5xEdckpwY1FxwMddgnCou /lfChg7sG/YWaK7gCE+zM02FavlL6uetJHJic= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=50MKZQSmdcKCS1Ay9ID+PtmE9eFDXbAqhzOQa8s5yrk=; b=R1S1OLluoUa5UJO3N/SUF2Uqpji3f2Uw7oGgb56b2EBxc7GYvqrzTMiOYsqT8misg+ XWtpb32mE5uwpfBJfIPliB7YBAFHrRkWiKuLC5UiNRc0Hyd6F/IZBprgQr/MVPoyyhOD 09PSP1bh+5VUMB7hwKTjP0igBBYkq6Eu1o0r4opGwZTtZ7t6pDr787wnKZhNwvpG1HYk b7duRlmvCGSVkee2cvRQ4NAvMp7l6bx7YcPu0eRx6tSAYr4nqjWnNI+xVUIXPA9IyXBf DPBohzpU0aUTYYn7bZ8yle4ZYf/3o9sC+zgh98kWyYHXmaILtefw0vsV+VLDf14dtn+f LUdQ== X-Gm-Message-State: ALoCoQnQ2x+7ZoiHFd+yWktR55MVplQrrATyIpRC7vgwbn6y+LjLi7Ch8xg3Gslnvd94FJlK5ql+ X-Received: by 10.140.233.140 with SMTP id e134mr52076575qhc.63.1436737482084; Sun, 12 Jul 2015 14:44:42 -0700 (PDT) Received: from lifeofadishwasher.com (c-71-206-246-125.hsd1.pa.comcast.net. [71.206.246.125]) by smtp.gmail.com with ESMTPSA id 20sm1960870qkp.39.2015.07.12.14.44.39 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 12 Jul 2015 14:44:41 -0700 (PDT) Received: by lifeofadishwasher.com (sSMTP sendmail emulation); Sun, 12 Jul 2015 17:44:39 -0400 Date: Sun, 12 Jul 2015 17:44:39 -0400 From: Derek Schrock To: Dan Busarow Cc: freebsd-questions@freebsd.org Subject: Re: freebsd-update and whatis Message-ID: <20150712214439.GA25794@ircbsd> References: <20150712130057.45FA6BCFE10@alisocreek.buildingonline.net> <55A273D9.5080108@buildingonline.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <55A273D9.5080108@buildingonline.com> User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Jul 2015 21:44:43 -0000 Ran in the same problem and if anyone disagrees please correct me this is all based off my observations. Your whatis database file is being rebuilt on a weekly basis and your system has some third party or orphaned base files. /etc/periodic/weekly/320.whatis is ran on a weekly basis: $ fgrep weekly /etc/crontab # Perform daily/weekly/monthly maintenance. 15 4 * * 6 root periodic weekly You can see this by running freebsd-update, 320.whatis, then freebsd-update again: # freebsd-update fetch Looking up update.FreeBSD.org mirrors... 5 mirrors found. Fetching metadata signature for 10.1-RELEASE from update5.freebsd.org... done. Fetching metadata index... done. Inspecting system... done. Preparing to download files... done. The following files will be updated as part of updating to 10.1-RELEASE-p14: /usr/share/man/whatis # freebsd-update install Installing updates... done. # freebsd-update fetch Looking up update.FreeBSD.org mirrors... 5 mirrors found. Fetching metadata signature for 10.1-RELEASE from update5.freebsd.org... done. Fetching metadata index... done. Inspecting system... done. Preparing to download files... done. No updates needed to update system to 10.1-RELEASE-p14. # /etc/periodic/weekly/320.whatis Rebuilding whatis database: # freebsd-update fetch Looking up update.FreeBSD.org mirrors... 5 mirrors found. Fetching metadata signature for 10.1-RELEASE from update6.freebsd.org... done. Fetching metadata index... done. Inspecting system... done. Preparing to download files... done. The following files will be updated as part of updating to 10.1-RELEASE-p14: /usr/share/man/whatis But why is your base not in sync with the environment that builds the freebsd-update binaries? When you run freebsd-update there's a possibility that between updates (more likely between major updates) there's a chance old files were removed. These could be libs, include, binaries, man pages (in this case). ex: Upgrade from 9.X to 10.X pkg_* was removed including the binaries, support, and man files among other things that changed in 9->10. I haven't tested this yet however freebsd-update.conf does have an option: AllowDelete The single parameter following this keyword must be ``yes'' or ``no'' and specifies whether freebsd-update is allowed to delete files, directories, and symlinks as part of updates downloaded. I don't know if this cleans the no older used/orphaned files it doesn't appear to retroactively clean up if you've had it off. I believe another option is to use /usr/src/Makefile if you have /usr/src (or a checked out source tree). I don't know if using github.com/freebsd/freebsd/ releng/10.1 or stable/10 branch is correct. Using a system installed /usr/src that's updated via freebsd-update might be the correct way to go. ex: $ fgrep delete-old Makefile # delete-old - Delete obsolete directories/files. # delete-old-dirs - Delete obsolete directories. # delete-old-files - Delete obsolete files. # delete-old-libs - Delete obsolete libraries. # 9. `make delete-old' # 11. `make delete-old-libs' (in case no 3rd party program uses them # anymore) delete-old delete-old-dirs delete-old-files delete-old-libs \ # git branch master releng/10.1 * stable/10 # make delete-old >>> Removing old files (only deletes safe to delete libs) remove /usr/share/man/man9/NDHASGIANT.9.gz? ..... I would like to know the best way to clean up old/orphaned base files. - freebsd-update (but then how do you clean up from previous updates when you had AllowDelete set to the default value no?). - /usr/src/Makefile # make -C /usr/src/ delete-old # delete-old{,-dirs,-files,-libs) I believe the only risk here is if you delete a lib that's still being used by a third party utility - or some other method I didn't mention. Parsing INDEX files from freebsd-update server might be an option however very risky. Side note: It appears there was once a handbook article for delete-old and delete-old-{dirs,files,libs} however it was removed. Should it return? On Sun, Jul 12, 2015 at 08:04:09AM -0600, Dan Busarow wrote: > I have 9 servers running 9.3-RELEASE p19 > > They are all pretty much identical at the / and /usr level with > differences in /usr/local > > On two of these servers, freebsd-update keeps updating > /usr/share/man/whatis after periodic weekly updates whatis > > The other 7 don't care. > > I know I can add /usr/share/man/whatis to freebsd-update.com IgnorePaths > > But.. what I'd really like to know is what may have triggered this > behavior only on two out of 9 servers? > > Thanks, > Dan > > > -------- Forwarded Message -------- > Subject: alisocreek.buildingonline.net security updates > Date: Sun, 12 Jul 2015 06:00:57 -0700 (PDT) > From: Charlie Root > To: root@buildingonline.net > > Looking up update.FreeBSD.org mirrors... none found. > Fetching metadata signature for 9.3-RELEASE from update.FreeBSD.org... done. > Fetching metadata index... done. > Inspecting system... done. > Preparing to download files... done. > > The following files will be updated as part of updating to 9.3-RELEASE-p19: > /usr/share/man/whatis > > > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org"