From owner-freebsd-hackers@FreeBSD.ORG Sun Jun 13 06:11:47 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 07DC01065672 for ; Sun, 13 Jun 2010 06:11:47 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: from mail-vw0-f54.google.com (mail-vw0-f54.google.com [209.85.212.54]) by mx1.freebsd.org (Postfix) with ESMTP id B03378FC1B for ; Sun, 13 Jun 2010 06:11:46 +0000 (UTC) Received: by vws20 with SMTP id 20so2882717vws.13 for ; Sat, 12 Jun 2010 23:11:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=eLhE7+T9bLsC5p3c/ExCrhZKsWFNNBLrQ+Kmmg3wOSo=; b=PCyZ2BtFSOLL8e1JQQhevuwJcGqcTJSOl5WqyloE1Ks5LX48dd0uSoJhmA2PyHPbI1 LQ7569VYzELENaGNcI30fvaZCopoOr2RT+tE06Ow/pARBvLqDYa+LzS41mP7gvTAGg71 5OlTcacdzznT3+FFdwdBSdZGK8f4HkhFPj8Uo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=iTCIYDUL84wHWDGH11/1rQ2A4cmq3vOuS5pUNhjyiDI25OrQYK2E0FzcePDuRwCKqP PCA+f8INka5CccFb+CbeY4BJZBmOHYOgKszQHd1X+K8EcHhors9Z7KONT7bTQ5sNOcLU J0TSqLg3KgdXsMOLp6NQ+TYhAAuRLNf4WCW0g= MIME-Version: 1.0 Received: by 10.224.65.152 with SMTP id j24mr1341224qai.52.1276409505713; Sat, 12 Jun 2010 23:11:45 -0700 (PDT) Received: by 10.229.233.74 with HTTP; Sat, 12 Jun 2010 23:11:45 -0700 (PDT) Date: Sat, 12 Jun 2010 23:11:45 -0700 Message-ID: From: Garrett Cooper To: FreeBSD-Hackers Content-Type: text/plain; charset=ISO-8859-1 Subject: Resolving lib build dependencies in src a non-race condition prone way? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Jun 2010 06:11:47 -0000 I might be completely missing the boat as to what needs to be done here, but the current code in Makefile.inc1, and lib/Makefile appears very race condition prone: >From Makefile.inc1: _prebuild_libs= ${_kerberos5_lib_libasn1} ${_kerberos5_lib_libheimntlm} \ ${_kerberos5_lib_libhx509} ${_kerberos5_lib_libkrb5} \ ${_kerberos5_lib_libroken} \ lib/libbz2 lib/libcom_err lib/libcrypt \ lib/libexpat \ ${_lib_libgssapi} ${_lib_libipx} \ lib/libkiconv lib/libkvm lib/libmd \ lib/ncurses/ncurses lib/ncurses/ncursesw \ lib/libopie lib/libpam ${_lib_libthr} \ lib/libradius lib/libsbuf lib/libtacplus \ lib/libutil ${_lib_libypclnt} lib/libz lib/msun \ ${_secure_lib_libcrypto} ${_secure_lib_libssh} \ ${_secure_lib_libssl} >From lib/Makefile: SUBDIR_ORDERED= ${_csu} \ libc \ libbsm \ libauditd \ libcom_err \ libcrypt \ libelf \ libkvm \ msun \ libmd \ ncurses \ ${_libnetgraph} \ libradius \ librpcsvc \ libsbuf \ libtacplus \ libutil \ ${_libypclnt} SUBDIR= ${SUBDIR_ORDERED} \ libalias \ libarchive \ ${_libatm} \ Note that if in Makefile.inc1 I place a library like libarchive, then the process will fall over in itself (this is the case in my perforce branch today) trying to fulfill prerequisites (libbz2, liblzma, libz). If I place the dependencies in SUBDIR_ORDERED in lib/Makefile, then I risk bringing in a race condition where a high enough -j value will cause the build to fail as well. The other thing that's curious is instead of building in the logic to build the prerequisite libraries in the leaf Makefiles, make just currently fails as follows: ===> lib/libpkg (all) make: don't know how to make /usr/obj/scratch/freebsd/perforce/pkg_install-enhancements/tmp/usr/lib/libarchive.a. Stop I was wondering why the DPADD code wasn't properly building prerequisites beforehand, but it appears that the only code that defines the targets are the respective lib Makefiles themselves. So, to just confirm this: Is there a race condition issue that's currently handled by explicit manual ordering of the targets? - If yes, could it be fixed by adding in bits to link back the lib make invocations at Makefile.inc1, or similar, i.e.: LIBARCHIVE_SRCDIR= lib/libarchive ${LIBARCHIVE}: .for i in depend obj all install ${MAKE} -C ${SRCDIR}${LIBARCHIVE_SRCDIR} $i .endfor ? (I realize that using the variable ${SRCDIR} won't function in all contexts, so it probably be something like ${TOP_SRCDIR}, keeping parity with an autotools-like paradigm -- but the name doesn't really matter too much right now). - If no, what am I doing wrong? Thanks, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Mon Jun 14 03:32:35 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 80DC6106566B for ; Mon, 14 Jun 2010 03:32:35 +0000 (UTC) (envelope-from imp@bsdimp.com) Received: from harmony.bsdimp.com (bsdimp.com [199.45.160.85]) by mx1.freebsd.org (Postfix) with ESMTP id 2BD318FC12 for ; Mon, 14 Jun 2010 03:32:35 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by harmony.bsdimp.com (8.14.3/8.14.1) with ESMTP id o5E3SNPu025067; Sun, 13 Jun 2010 21:28:23 -0600 (MDT) (envelope-from imp@bsdimp.com) Date: Sun, 13 Jun 2010 21:28:25 -0600 (MDT) Message-Id: <20100613.212825.29593248112292292.imp@bsdimp.com> To: yanefbsd@gmail.com From: "M. Warner Losh" In-Reply-To: References: X-Mailer: Mew version 6.3 on Emacs 22.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: Resolving lib build dependencies in src a non-race condition prone way? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jun 2010 03:32:35 -0000 In message: Garrett Cooper writes: : - If no, what am I doing wrong? There's a script in tools that will build the _prebuild_libs. You'll need to use tools/make/make_libdeps.sh. src/lib/Makefile I tihnk is mostly obsolete, and certainly would have some issues working properly. We don't really use it in the build, at least to resolve build order dependencies. Warner From owner-freebsd-hackers@FreeBSD.ORG Mon Jun 14 04:43:12 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EB7711065673 for ; Mon, 14 Jun 2010 04:43:12 +0000 (UTC) (envelope-from sudakov+freebsd@sibptus.tomsk.ru) Received: from relay2.tomsk.ru (relay2.tomsk.ru [212.73.124.8]) by mx1.freebsd.org (Postfix) with ESMTP id 4801F8FC14 for ; Mon, 14 Jun 2010 04:43:11 +0000 (UTC) X-Virus-Scanned: by clamd daemon 0.93.1 for FreeBSD at relay2.tomsk.ru Received: from admin.sibptus.tomsk.ru (account sudakov@sibptus.tomsk.ru [212.73.125.240] verified) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.13) with ESMTPSA id 13968350 for freebsd-hackers@freebsd.org; Mon, 14 Jun 2010 11:43:09 +0700 Received: from admin.sibptus.tomsk.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.tomsk.ru (8.13.6/8.13.6) with ESMTP id o5E4h97A004716 for ; Mon, 14 Jun 2010 11:43:09 +0700 (OMSST) (envelope-from sudakov+freebsd@sibptus.tomsk.ru) Received: (from sudakov@localhost) by admin.sibptus.tomsk.ru (8.13.6/8.13.6/Submit) id o5E4h8QY004715 for freebsd-hackers@freebsd.org; Mon, 14 Jun 2010 11:43:08 +0700 (OMSST) (envelope-from sudakov+freebsd@sibptus.tomsk.ru) X-Authentication-Warning: admin.sibptus.tomsk.ru: sudakov set sender to sudakov+freebsd@sibptus.tomsk.ru using -f Date: Mon, 14 Jun 2010 11:43:08 +0700 From: Victor Sudakov To: freebsd-hackers@freebsd.org Message-ID: <20100614044308.GA4670@admin.sibptus.tomsk.ru> Mail-Followup-To: Victor Sudakov , freebsd-hackers@freebsd.org References: <4B3CC72F.9030904@andric.com> <4B408745.3030309@andric.com> <20100103154503.GA63734@admin.sibptus.tomsk.ru> <20100103221655.GA76049@server.vk2pj.dyndns.org> <20100104130315.GA79633@admin.sibptus.tomsk.ru> <20100104133657.GA47668@owl.midgard.homeip.net> <20100104143749.GA80433@admin.sibptus.tomsk.ru> <20100104223631.GC41129@server.vk2pj.dyndns.org> <20100105064720.GA94590@admin.sibptus.tomsk.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20100105064720.GA94590@admin.sibptus.tomsk.ru> User-Agent: Mutt/1.4.2.3i Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://vas.tomsk.ru/vas.asc Subject: Re: "Checksum mismatch -- will transfer entire file" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jun 2010 04:43:13 -0000 Victor Sudakov wrote: [dd] > > But to hell with this. I started the topic because I think something > is wrong with SVN to CVS export, which upsets cvsup and causes > "Checksum mismatch" errors. Is anybody willing to look at it? I see nobody is ever going to fix this? Cvsup mails me a bunch of "Checksum mismatch" errors on every run, with a risk of overlooking real errors. How do others deal with this noise? Do you grep cvsup output or what? -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN sip:sudakov@sibptus.tomsk.ru From owner-freebsd-hackers@FreeBSD.ORG Mon Jun 14 08:41:39 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0CD8010656C6 for ; Mon, 14 Jun 2010 08:41:39 +0000 (UTC) (envelope-from gljennjohn@googlemail.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id 7E5788FC0C for ; Mon, 14 Jun 2010 08:41:37 +0000 (UTC) Received: by fxm7 with SMTP id 7so2777599fxm.13 for ; Mon, 14 Jun 2010 01:41:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:cc:subject :message-id:in-reply-to:references:reply-to:x-mailer:mime-version :content-type:content-transfer-encoding; bh=BDnz6YtM3U/0CUT4w3nK+zUKyyuzTB+kiNI1cLjIb+U=; b=vMR5l1BINHGwg0TL6/fQx3MsqpCCyyHafo0tiy6mwsATRLpGJ6d+Yx0JjSHvxwY5Yt t6xn2DST/RAzz6rsU3scRFeUh51CDXCvVK2bWS16jcchh5M8mio8trGCrEEGB4wnnffX Pw0J1Gj/wWB7wR2lt3QD3oycLQ9VXNutgXtw4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:in-reply-to:references:reply-to :x-mailer:mime-version:content-type:content-transfer-encoding; b=cUNmwo9oaoPFjTZwHafsIUGwj6LbBD1eJfNBB++eWFmUgPKRc1ONb+dyV1iFhESA8H wPVQjfQjfJBavXVY9R3vXB5qEC6oNRT54kTBNIdeiseTdkYFn1sckLhYsTzHBfoDFyKZ 99Yw5uIIxcIaJSCEwBj6CSOG0518BI9cshQe8= Received: by 10.102.243.22 with SMTP id q22mr1554068muh.9.1276504897070; Mon, 14 Jun 2010 01:41:37 -0700 (PDT) Received: from ernst.jennejohn.org (p578E2617.dip.t-dialin.net [87.142.38.23]) by mx.google.com with ESMTPS id n10sm5814627mue.12.2010.06.14.01.41.36 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 14 Jun 2010 01:41:36 -0700 (PDT) Date: Mon, 14 Jun 2010 10:41:35 +0200 From: Gary Jennejohn To: Victor Sudakov Message-ID: <20100614104135.6df9dc8d@ernst.jennejohn.org> In-Reply-To: <20100614044308.GA4670@admin.sibptus.tomsk.ru> References: <4B3CC72F.9030904@andric.com> <4B408745.3030309@andric.com> <20100103154503.GA63734@admin.sibptus.tomsk.ru> <20100103221655.GA76049@server.vk2pj.dyndns.org> <20100104130315.GA79633@admin.sibptus.tomsk.ru> <20100104133657.GA47668@owl.midgard.homeip.net> <20100104143749.GA80433@admin.sibptus.tomsk.ru> <20100104223631.GC41129@server.vk2pj.dyndns.org> <20100105064720.GA94590@admin.sibptus.tomsk.ru> <20100614044308.GA4670@admin.sibptus.tomsk.ru> X-Mailer: Claws Mail 3.7.5 (GTK+ 2.18.7; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: "Checksum mismatch -- will transfer entire file" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: gljennjohn@googlemail.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jun 2010 08:41:39 -0000 On Mon, 14 Jun 2010 11:43:08 +0700 Victor Sudakov wrote: > Victor Sudakov wrote: > > [dd] > > > > > But to hell with this. I started the topic because I think something > > is wrong with SVN to CVS export, which upsets cvsup and causes > > "Checksum mismatch" errors. Is anybody willing to look at it? > > I see nobody is ever going to fix this? Cvsup mails me a bunch of > "Checksum mismatch" errors on every run, with a risk of overlooking > real errors. > > How do others deal with this noise? Do you grep cvsup output or what? > I just ignore these errors. I've never seen a problem as a result. -- Gary Jennejohn From owner-freebsd-hackers@FreeBSD.ORG Mon Jun 14 11:11:55 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DC2761065676 for ; Mon, 14 Jun 2010 11:11:55 +0000 (UTC) (envelope-from dmitryluhtionov@gmail.com) Received: from mail-ww0-f54.google.com (mail-ww0-f54.google.com [74.125.82.54]) by mx1.freebsd.org (Postfix) with ESMTP id 703308FC0A for ; Mon, 14 Jun 2010 11:11:55 +0000 (UTC) Received: by wwb22 with SMTP id 22so4461212wwb.13 for ; Mon, 14 Jun 2010 04:11:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=XFFp+sT9HPL5ywSMTMXbAnQO5YMjbU4HM9KwRU4BX5k=; b=GovsCM6pgzI/LN7tD8U7sCQFyKwLV4kzTIcOBUpgMImQ3a6xl1XLmdLlNazosKcLCx vEHFRiSmOV8C2cGykAs2Rly2FjGJN+fE7y5iJQVk1OwzQBgn4PCY3ca7L90TBA+BR+Lh b5iDYmj46R2xQz6iDWWGkYYKslbQ7EAMqbGZA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=suKsbp3/2wm8T3gAC4UYpm/cbhyJQiC9wG5UkSmyaTSD3z6/8ZFM8rDRExLCSSLKhu /oqY2tLjhJTv8qwZsdZtYNGjW/hCKVBN59LVNx/Rm3NqWOWCaT1DBZGHBIe4VZXKGsol y058K3WG6Hr3QicKYAraKnKvBVJ2CQgvrVz7A= MIME-Version: 1.0 Received: by 10.216.86.3 with SMTP id v3mr2057213wee.12.1276513914325; Mon, 14 Jun 2010 04:11:54 -0700 (PDT) Received: by 10.216.48.203 with HTTP; Mon, 14 Jun 2010 04:11:54 -0700 (PDT) Date: Mon, 14 Jun 2010 14:11:54 +0300 Message-ID: From: Dmitry Luhtionov To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Subject: GEOM_DEBUG kernel option X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jun 2010 11:11:56 -0000 I introduce new kernel option GEOM_DEBUG Its enabled on default, but disable it reduce runtime kernel size and slightly improve performance by disabling debug stuff in compile time On my amd64 machine compiling modules without GEOM_DEBUG option reduce size geom_mirror.ko from 130 to 77 kilobytes geom_label.ko from 44.5 to 33 kilobytes http://193.34.20.243/geom.20100611.patch From owner-freebsd-hackers@FreeBSD.ORG Mon Jun 14 08:25:16 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B06E7106564A for ; Mon, 14 Jun 2010 08:25:16 +0000 (UTC) (envelope-from dmitryluhtionov@gmail.com) Received: from mail-wy0-f182.google.com (mail-wy0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 4518F8FC19 for ; Mon, 14 Jun 2010 08:25:16 +0000 (UTC) Received: by wyb33 with SMTP id 33so4302413wyb.13 for ; Mon, 14 Jun 2010 01:25:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=78Xx1ctOpMWDANBgKHFH4Jtt3hDMV5K6SOc1iORxAy0=; b=xTqdrYOyB8tfbbmFthgxx5AwyCRubS73hlqhDLCke4+Bd0WvDGmUu5Ow5TILnaNQNK tv3xGke7HI6j4M8bE98OulO7qD9JKZuMqSMMektg+3zv6d6+6VWnu7B886IPyStHF/Ea kPfz327o6dF2gHY+5uMnWNVunwLn3GIFBwr0E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=tWVv+XT4EDdBNz5paNxPu7cpq+TqaBrS+7fXUWDeDHNgF6TZmQsshHK2PCwdXZ+2lD AvO5L14DfXYhUaP55vKlPF+rFFWBbrlLf1QVQzHBjWE5ZT2uzDGe+YCaeH5reoy/eVQe Q/FIxPRlE/2n47aniLBECTWoQQkBJWCzUUdv8= MIME-Version: 1.0 Received: by 10.216.156.79 with SMTP id l57mr1852469wek.46.1276502154313; Mon, 14 Jun 2010 00:55:54 -0700 (PDT) Received: by 10.216.48.203 with HTTP; Mon, 14 Jun 2010 00:55:54 -0700 (PDT) Date: Mon, 14 Jun 2010 10:55:54 +0300 Message-ID: From: Dmitry Luhtionov To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Mailman-Approved-At: Mon, 14 Jun 2010 11:17:54 +0000 Subject: GEOM_DEBUG kernel option X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jun 2010 08:25:16 -0000 I introduce new kernel option GEOM_DEBUG Its enabled on default, but disable it reduce runtime kernel size and slightly improve perfomance by disabling debug stuff in compile time On my amd64 machine compiling modules without GEOM_DEBUG option reduce size geom_mirror.ko from 130 to 77 kilobytes geom_label.ko from 44.5 to 33 kilobytes http://193.34.20.243/geom.20100611.patch From owner-freebsd-hackers@FreeBSD.ORG Mon Jun 14 17:43:11 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 973791065680 for ; Mon, 14 Jun 2010 17:43:11 +0000 (UTC) (envelope-from seanbru@yahoo-inc.com) Received: from mrout2-b.corp.re1.yahoo.com (mrout2-b.corp.re1.yahoo.com [69.147.107.21]) by mx1.freebsd.org (Postfix) with ESMTP id 6BE908FC1A for ; Mon, 14 Jun 2010 17:43:11 +0000 (UTC) Received: from [127.0.0.1] (proxy8.corp.yahoo.com [216.145.48.13]) by mrout2-b.corp.re1.yahoo.com (8.13.8/8.13.8/y.out) with ESMTP id o5EHgaor047114 for ; Mon, 14 Jun 2010 10:42:37 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; s=serpent; d=yahoo-inc.com; c=nofws; q=dns; h=subject:from:reply-to:to:content-type:date:message-id: mime-version:x-mailer; b=sOP68UEeKFatY6BlX8QC//6M0cIH+/PGXyeN94J3vM4L0tlWW/ZXlbgJFLYhO5i5 From: Sean Bruno To: freebsd-hackers Content-Type: multipart/mixed; boundary="=-tQs3kSxSYUzf+T4LUJ0T" Date: Mon, 14 Jun 2010 10:42:36 -0700 Message-ID: <1276537356.2527.19.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.28.3 (2.28.3-1.fc12) Subject: RFT Exposing Zone Sleeps X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: sbruno@freebsd.org List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jun 2010 17:43:11 -0000 --=-tQs3kSxSYUzf+T4LUJ0T Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit So, after some modifications and guidance from rwatson, alc and others, I've modified this patch a bit. The end result is that a sleep on slab alloc counter is displayed with a "vmstat -z". This can be used for diagnostics of low memory situations and has been VERY handy at Yahoo. I've removed the sysctl to eliminate some heartache, moved the sleep count into a proper place in the data structure, properly instrumented the debugger function and returned the #ifdef. Patch provided against -current. Tested on amd64 and x86 Sean --=-tQs3kSxSYUzf+T4LUJ0T Content-Disposition: attachment; filename="sleep_stat.diff" Content-Type: text/x-patch; name="sleep_stat.diff"; charset="UTF-8" Content-Transfer-Encoding: 7bit Index: usr.bin/vmstat/vmstat.c =================================================================== --- usr.bin/vmstat/vmstat.c (revision 209161) +++ usr.bin/vmstat/vmstat.c (working copy) @@ -1294,16 +1294,17 @@ memstat_strerror(error)); } } - printf("%-20s %8s %8s %8s %8s %8s %8s\n\n", "ITEM", "SIZE", - "LIMIT", "USED", "FREE", "REQUESTS", "FAILURES"); + printf("%-20s %6s %6s %8s %8s %8s %4s %4s\n\n", "ITEM", "SIZE", + "LIMIT", "USED", "FREE", "REQ", "FAIL", "SLEEP"); for (mtp = memstat_mtl_first(mtlp); mtp != NULL; mtp = memstat_mtl_next(mtp)) { strlcpy(name, memstat_get_name(mtp), MEMTYPE_MAXNAME); strcat(name, ":"); - printf("%-20s %8llu, %8llu, %8llu, %8llu, %8llu, %8llu\n", name, + printf("%-20s %6llu, %6llu,%8llu,%8llu,%8llu,%4llu,%4llu\n",name, memstat_get_size(mtp), memstat_get_countlimit(mtp), memstat_get_count(mtp), memstat_get_free(mtp), - memstat_get_numallocs(mtp), memstat_get_failures(mtp)); + memstat_get_numallocs(mtp), memstat_get_failures(mtp), + memstat_get_sleeps(mtp)); } memstat_mtl_free(mtlp); printf("\n"); Index: lib/libmemstat/memstat.h =================================================================== --- lib/libmemstat/memstat.h (revision 209161) +++ lib/libmemstat/memstat.h (working copy) @@ -139,6 +139,7 @@ uint64_t memstat_get_count(const struct memory_type *mtp); uint64_t memstat_get_free(const struct memory_type *mtp); uint64_t memstat_get_failures(const struct memory_type *mtp); +uint64_t memstat_get_sleeps(const struct memory_type *mtp); void *memstat_get_caller_pointer(const struct memory_type *mtp, int index); void memstat_set_caller_pointer(struct memory_type *mtp, Index: lib/libmemstat/memstat.c =================================================================== --- lib/libmemstat/memstat.c (revision 209161) +++ lib/libmemstat/memstat.c (working copy) @@ -188,6 +188,7 @@ mtp->mt_count = 0; mtp->mt_free = 0; mtp->mt_failures = 0; + mtp->mt_sleeps = 0; mtp->mt_zonefree = 0; mtp->mt_kegfree = 0; @@ -304,6 +305,13 @@ return (mtp->mt_failures); } +uint64_t +memstat_get_sleeps(const struct memory_type *mtp) +{ + + return (mtp->mt_sleeps); +} + void * memstat_get_caller_pointer(const struct memory_type *mtp, int index) { Index: lib/libmemstat/memstat_internal.h =================================================================== --- lib/libmemstat/memstat_internal.h (revision 209161) +++ lib/libmemstat/memstat_internal.h (working copy) @@ -65,6 +65,7 @@ uint64_t mt_count; /* Number of current allocations. */ uint64_t mt_free; /* Number of cached free items. */ uint64_t mt_failures; /* Number of allocation failures. */ + uint64_t mt_sleeps; /* Number of allocation sleeps. */ /* * Caller-owned memory. Index: lib/libmemstat/memstat_uma.c =================================================================== --- lib/libmemstat/memstat_uma.c (revision 209161) +++ lib/libmemstat/memstat_uma.c (working copy) @@ -208,6 +208,7 @@ mtp->mt_numallocs = uthp->uth_allocs; mtp->mt_numfrees = uthp->uth_frees; mtp->mt_failures = uthp->uth_fails; + mtp->mt_sleeps = uthp->uth_sleeps; for (j = 0; j < maxcpus; j++) { upsp = (struct uma_percpu_stat *)p; @@ -402,6 +403,7 @@ mtp->mt_numallocs = uz.uz_allocs; mtp->mt_numfrees = uz.uz_frees; mtp->mt_failures = uz.uz_fails; + mtp->mt_sleeps = uz.uz_sleeps; if (kz.uk_flags & UMA_ZFLAG_INTERNAL) goto skip_percpu; for (i = 0; i < mp_maxid + 1; i++) { Index: sys/vm/uma_int.h =================================================================== --- sys/vm/uma_int.h (revision 209161) +++ sys/vm/uma_int.h (working copy) @@ -327,6 +327,7 @@ u_int64_t uz_allocs UMA_ALIGN; /* Total number of allocations */ u_int64_t uz_frees; /* Total number of frees */ u_int64_t uz_fails; /* Total number of alloc failures */ + u_int64_t uz_sleeps; /* Total number of alloc sleeps */ uint16_t uz_fills; /* Outstanding bucket fills */ uint16_t uz_count; /* Highest value ub_ptr can have */ Index: sys/vm/uma.h =================================================================== --- sys/vm/uma.h (revision 209161) +++ sys/vm/uma.h (working copy) @@ -600,7 +600,8 @@ u_int64_t uth_allocs; /* Zone: number of allocations. */ u_int64_t uth_frees; /* Zone: number of frees. */ u_int64_t uth_fails; /* Zone: number of alloc failures. */ - u_int64_t _uth_reserved1[3]; /* Reserved. */ + u_int64_t uth_sleeps; /* Zone: number of alloc sleeps. */ + u_int64_t _uth_reserved1[2]; /* Reserved. */ }; struct uma_percpu_stat { Index: sys/vm/uma_core.c =================================================================== --- sys/vm/uma_core.c (revision 209161) +++ sys/vm/uma_core.c (working copy) @@ -1396,6 +1396,7 @@ zone->uz_allocs = 0; zone->uz_frees = 0; zone->uz_fails = 0; + zone->uz_sleeps = 0; zone->uz_fills = zone->uz_count = 0; zone->uz_flags = 0; keg = arg->keg; @@ -2283,6 +2284,7 @@ */ if (full && !empty) { zone->uz_flags |= UMA_ZFLAG_FULL; + zone->uz_sleeps++; msleep(zone, zone->uz_lock, PVM, "zonelimit", hz/100); zone->uz_flags &= ~UMA_ZFLAG_FULL; continue; @@ -3094,13 +3096,13 @@ */ static void uma_zone_sumstat(uma_zone_t z, int *cachefreep, u_int64_t *allocsp, - u_int64_t *freesp) + u_int64_t *freesp, u_int64_t *sleepsp) { uma_cache_t cache; - u_int64_t allocs, frees; + u_int64_t allocs, frees, sleeps; int cachefree, cpu; - allocs = frees = 0; + allocs = frees = sleeps = 0; cachefree = 0; CPU_FOREACH(cpu) { cache = &z->uz_cpu[cpu]; @@ -3113,12 +3115,15 @@ } allocs += z->uz_allocs; frees += z->uz_frees; + sleeps += z->uz_sleeps; if (cachefreep != NULL) *cachefreep = cachefree; if (allocsp != NULL) *allocsp = allocs; if (freesp != NULL) *freesp = frees; + if (sleepsp != NULL) + *sleepsp = sleeps; } #endif /* DDB */ @@ -3226,6 +3231,7 @@ uth.uth_allocs = z->uz_allocs; uth.uth_frees = z->uz_frees; uth.uth_fails = z->uz_fails; + uth.uth_sleeps = z->uz_sleeps; if (sbuf_bcat(&sbuf, &uth, sizeof(uth)) < 0) { ZONE_UNLOCK(z); mtx_unlock(&uma_mtx); @@ -3277,32 +3283,33 @@ #ifdef DDB DB_SHOW_COMMAND(uma, db_show_uma) { - u_int64_t allocs, frees; + u_int64_t allocs, frees, sleeps; uma_bucket_t bucket; uma_keg_t kz; uma_zone_t z; int cachefree; - db_printf("%18s %8s %8s %8s %12s\n", "Zone", "Size", "Used", "Free", - "Requests"); + db_printf("%18s %8s %8s %8s %12s %8s\n", "Zone", "Size", "Used", "Free", + "Requests", "Sleeps"); LIST_FOREACH(kz, &uma_kegs, uk_link) { LIST_FOREACH(z, &kz->uk_zones, uz_link) { if (kz->uk_flags & UMA_ZFLAG_INTERNAL) { allocs = z->uz_allocs; frees = z->uz_frees; + sleeps = z->uz_sleeps; cachefree = 0; } else uma_zone_sumstat(z, &cachefree, &allocs, - &frees); + &frees, &sleeps); if (!((z->uz_flags & UMA_ZONE_SECONDARY) && (LIST_FIRST(&kz->uk_zones) != z))) cachefree += kz->uk_free; LIST_FOREACH(bucket, &z->uz_full_bucket, ub_link) cachefree += bucket->ub_cnt; - db_printf("%18s %8ju %8jd %8d %12ju\n", z->uz_name, + db_printf("%18s %8ju %8jd %8d %12ju %8ju\n", z->uz_name, (uintmax_t)kz->uk_size, (intmax_t)(allocs - frees), cachefree, - (uintmax_t)allocs); + (uintmax_t)allocs, sleeps); } } } --=-tQs3kSxSYUzf+T4LUJ0T-- From owner-freebsd-hackers@FreeBSD.ORG Mon Jun 14 20:05:53 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 28C821065678 for ; Mon, 14 Jun 2010 20:05:53 +0000 (UTC) (envelope-from mailnull@mips.inka.de) Received: from mail-in-16.arcor-online.net (mail-in-16.arcor-online.net [151.189.21.56]) by mx1.freebsd.org (Postfix) with ESMTP id CF9A18FC1A for ; Mon, 14 Jun 2010 20:05:52 +0000 (UTC) Received: from mail-in-15-z2.arcor-online.net (mail-in-15-z2.arcor-online.net [151.189.8.32]) by mx.arcor.de (Postfix) with ESMTP id 00ED561CFF for ; Mon, 14 Jun 2010 22:05:51 +0200 (CEST) Received: from mail-in-16.arcor-online.net (mail-in-16.arcor-online.net [151.189.21.56]) by mail-in-15-z2.arcor-online.net (Postfix) with ESMTP id E29BD33E370 for ; Mon, 14 Jun 2010 22:05:50 +0200 (CEST) Received: from lorvorc.mips.inka.de (dslb-094-217-097-206.pools.arcor-ip.net [94.217.97.206]) by mail-in-16.arcor-online.net (Postfix) with ESMTPS id D4FF329EB4 for ; Mon, 14 Jun 2010 22:05:49 +0200 (CEST) X-DKIM: Sendmail DKIM Filter v2.8.2 mail-in-16.arcor-online.net D4FF329EB4 Received: from lorvorc.mips.inka.de (localhost [127.0.0.1]) by lorvorc.mips.inka.de (8.14.4/8.14.3) with ESMTP id o5EK5naF065191 for ; Mon, 14 Jun 2010 22:05:49 +0200 (CEST) (envelope-from mailnull@lorvorc.mips.inka.de) Received: (from mailnull@localhost) by lorvorc.mips.inka.de (8.14.4/8.14.4/Submit) id o5EK5nZd065190 for freebsd-hackers@freebsd.org; Mon, 14 Jun 2010 22:05:49 +0200 (CEST) (envelope-from mailnull) From: naddy@mips.inka.de (Christian Weisgerber) Date: Mon, 14 Jun 2010 20:05:49 +0000 (UTC) Message-ID: References: <4B3CC72F.9030904@andric.com> <20100104223631.GC41129@server.vk2pj.dyndns.org> <20100105064720.GA94590@admin.sibptus.tomsk.ru> <20100614044308.GA4670@admin.sibptus.tomsk.ru> Originator: naddy@mips.inka.de (Christian Weisgerber) To: freebsd-hackers@freebsd.org Subject: Re: "Checksum mismatch -- will transfer entire file" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jun 2010 20:05:53 -0000 Victor Sudakov wrote: > I see nobody is ever going to fix this? Cvsup mails me a bunch of > "Checksum mismatch" errors on every run, with a risk of overlooking > real errors. It is particularly egregious when a tag is laid down, like today. csup(1) ends up refetching a big chunk of the tree from scratch because so many files have these spurious checksum mismatches. Personally, I don't care too much, but quite a bit of mirror bandwidth is wasted this way. > How do others deal with this noise? Do you grep cvsup output or what? I optimistically assume that there are no real errors and I run csup without -s once a week or so, just in case. -- Christian "naddy" Weisgerber naddy@mips.inka.de From owner-freebsd-hackers@FreeBSD.ORG Tue Jun 15 02:28:41 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54D621065672 for ; Tue, 15 Jun 2010 02:28:41 +0000 (UTC) (envelope-from sudakov+freebsd@sibptus.tomsk.ru) Received: from relay2.tomsk.ru (relay2.tomsk.ru [212.73.124.8]) by mx1.freebsd.org (Postfix) with ESMTP id A40198FC15 for ; Tue, 15 Jun 2010 02:28:40 +0000 (UTC) X-Virus-Scanned: by clamd daemon 0.93.1 for FreeBSD at relay2.tomsk.ru Received: from admin.sibptus.tomsk.ru (account sudakov@sibptus.tomsk.ru [212.73.125.240] verified) by relay2.tomsk.ru (CommuniGate Pro SMTP 5.1.13) with ESMTPSA id 13971178 for freebsd-hackers@freebsd.org; Tue, 15 Jun 2010 09:28:38 +0700 Received: from admin.sibptus.tomsk.ru (sudakov@localhost [127.0.0.1]) by admin.sibptus.tomsk.ru (8.13.6/8.13.6) with ESMTP id o5F2Sbom024213 for ; Tue, 15 Jun 2010 09:28:38 +0700 (OMSST) (envelope-from sudakov+freebsd@sibptus.tomsk.ru) Received: (from sudakov@localhost) by admin.sibptus.tomsk.ru (8.13.6/8.13.6/Submit) id o5F2Sb4S024212 for freebsd-hackers@freebsd.org; Tue, 15 Jun 2010 09:28:37 +0700 (OMSST) (envelope-from sudakov+freebsd@sibptus.tomsk.ru) X-Authentication-Warning: admin.sibptus.tomsk.ru: sudakov set sender to sudakov+freebsd@sibptus.tomsk.ru using -f Date: Tue, 15 Jun 2010 09:28:37 +0700 From: Victor Sudakov To: freebsd-hackers@freebsd.org Message-ID: <20100615022837.GB23583@admin.sibptus.tomsk.ru> Mail-Followup-To: Victor Sudakov , freebsd-hackers@freebsd.org References: <4B408745.3030309@andric.com> <20100103154503.GA63734@admin.sibptus.tomsk.ru> <20100103221655.GA76049@server.vk2pj.dyndns.org> <20100104130315.GA79633@admin.sibptus.tomsk.ru> <20100104133657.GA47668@owl.midgard.homeip.net> <20100104143749.GA80433@admin.sibptus.tomsk.ru> <20100104223631.GC41129@server.vk2pj.dyndns.org> <20100105064720.GA94590@admin.sibptus.tomsk.ru> <20100614044308.GA4670@admin.sibptus.tomsk.ru> <09f445615c18768df17418f06d872a46.squirrel@www.noacks.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <09f445615c18768df17418f06d872a46.squirrel@www.noacks.org> User-Agent: Mutt/1.4.2.3i Organization: AO "Svyaztransneft", SibPTUS X-PGP-Key: http://vas.tomsk.ru/vas.asc Subject: Re: "Checksum mismatch -- will transfer entire file" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 02:28:41 -0000 Jonathan Noack wrote: > >> But to hell with this. I started the topic because I think something > >> is wrong with SVN to CVS export, which upsets cvsup and causes > >> "Checksum mismatch" errors. Is anybody willing to look at it? > > > > I see nobody is ever going to fix this? Cvsup mails me a bunch of > > "Checksum mismatch" errors on every run, with a risk of overlooking > > real errors. > > > > How do others deal with this noise? Do you grep cvsup output or what? > > Seems like newer versions of CVS break assumptions made by CVSup on the > ordering of branch revisions: > http://lists.freebsd.org/pipermail/freebsd-hubs/2009-August/002083.html > > "So, in short I don't see any easy solutions to this, and especially given > the fact that in the long run CVS/CVSup will probably be replaced by > something else for distributing FreeBSD source, I don't think it will be > that easy to find someone to "fix" either CVSup or CVS." Thanks for the link. Somebody wrote here that the problem was perhaps in the svn2cvs script, but Simon's post gives a different outlook. Maybe nobody is going to fix CVSup (is it not actively developed already?), but csup is relatively recent and alive. Once it has a CVS mode, maybe it could be adjusted? -- Victor Sudakov, VAS4-RIPE, VAS47-RIPN sip:sudakov@sibptus.tomsk.ru From owner-freebsd-hackers@FreeBSD.ORG Mon Jun 14 21:20:49 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 45A691065674 for ; Mon, 14 Jun 2010 21:20:49 +0000 (UTC) (envelope-from noackjr@alumni.rice.edu) Received: from smtp113.biz.mail.sp1.yahoo.com (smtp113.biz.mail.sp1.yahoo.com [69.147.92.226]) by mx1.freebsd.org (Postfix) with SMTP id 1B6DA8FC19 for ; Mon, 14 Jun 2010 21:20:49 +0000 (UTC) Received: (qmail 3438 invoked from network); 14 Jun 2010 20:54:09 -0000 Received: from optimator.noacks.org (noackjr@75.145.250.173 with login) by smtp113.biz.mail.sp1.yahoo.com with SMTP; 14 Jun 2010 13:54:09 -0700 PDT X-Yahoo-SMTP: VnOecJeswBCMn50HlEMYJKFtvXTL X-YMail-OSG: THMe7uoVM1kHtxbabsRKVnOt7j4ToKLRP.SnEAidC_lX3J.hCDYUuWQ6LpLw36rqncdhHiMxPQX757rtGKVrhbhmy85n.bj_uriP5Nx06JIRYXX4QTOiQxWM6CG5Is9Qk1IuA3fL5rO5RFVNzQbnOfxIP9HuFhDGyYNCSXqRKVbvhaVY7CX4kxu6duTDdR_IlwR2KP3NybIy5VYqbY2vzZaUEMgPhFFdOFwjJWjvCL5Tw4OpGJJeWLX4uBnlyzn94trY2YAlDoaQWM8Pk81wxX4dkRDhN8ZfSGW.Eep_c86LicdR3JE.BaqoxgHUtujtePcLy42EJtgnUZ5DibdwA.unww-- X-Yahoo-Newman-Property: ymail-3 Received: from optimator.noacks.org (localhost [127.0.0.1]) by optimator.noacks.org (Postfix) with ESMTP id 669A861CD; Mon, 14 Jun 2010 16:54:08 -0400 (EDT) Received: from optimator.noacks.org ([127.0.0.1]) by optimator.noacks.org (optimator.noacks.org [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 6AbV9NnegC7i; Mon, 14 Jun 2010 16:54:06 -0400 (EDT) Received: from www.noacks.org (localhost [127.0.0.1]) by optimator.noacks.org (Postfix) with ESMTP id 10B8A60CE; Mon, 14 Jun 2010 16:54:06 -0400 (EDT) Received: from 192.168.1.10 (SquirrelMail authenticated user noackjr) by www.noacks.org with HTTP; Mon, 14 Jun 2010 16:54:06 -0400 Message-ID: <09f445615c18768df17418f06d872a46.squirrel@www.noacks.org> In-Reply-To: <20100614044308.GA4670@admin.sibptus.tomsk.ru> References: <4B3CC72F.9030904@andric.com> <4B408745.3030309@andric.com> <20100103154503.GA63734@admin.sibptus.tomsk.ru> <20100103221655.GA76049@server.vk2pj.dyndns.org> <20100104130315.GA79633@admin.sibptus.tomsk.ru> <20100104133657.GA47668@owl.midgard.homeip.net> <20100104143749.GA80433@admin.sibptus.tomsk.ru> <20100104223631.GC41129@server.vk2pj.dyndns.org> <20100105064720.GA94590@admin.sibptus.tomsk.ru> <20100614044308.GA4670@admin.sibptus.tomsk.ru> Date: Mon, 14 Jun 2010 16:54:06 -0400 From: "Jonathan Noack" To: "Victor Sudakov" , freebsd-hackers@freebsd.org User-Agent: SquirrelMail/1.4.20 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-Mailman-Approved-At: Tue, 15 Jun 2010 02:35:31 +0000 Cc: Subject: Re: "Checksum mismatch -- will transfer entire file" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: noackjr@alumni.rice.edu List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Jun 2010 21:20:49 -0000 On Mon, June 14, 2010 00:43, Victor Sudakov wrote: > Victor Sudakov wrote: >> But to hell with this. I started the topic because I think something >> is wrong with SVN to CVS export, which upsets cvsup and causes >> "Checksum mismatch" errors. Is anybody willing to look at it? > > I see nobody is ever going to fix this? Cvsup mails me a bunch of > "Checksum mismatch" errors on every run, with a risk of overlooking > real errors. > > How do others deal with this noise? Do you grep cvsup output or what? Seems like newer versions of CVS break assumptions made by CVSup on the ordering of branch revisions: http://lists.freebsd.org/pipermail/freebsd-hubs/2009-August/002083.html "So, in short I don't see any easy solutions to this, and especially given the fact that in the long run CVS/CVSup will probably be replaced by something else for distributing FreeBSD source, I don't think it will be that easy to find someone to "fix" either CVSup or CVS." -Jon From owner-freebsd-hackers@FreeBSD.ORG Tue Jun 15 11:14:45 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 388B21065673 for ; Tue, 15 Jun 2010 11:14:45 +0000 (UTC) (envelope-from gljennjohn@googlemail.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id AD5A38FC17 for ; Tue, 15 Jun 2010 11:14:44 +0000 (UTC) Received: by fxm7 with SMTP id 7so3671931fxm.13 for ; Tue, 15 Jun 2010 04:14:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:cc:subject :message-id:in-reply-to:references:reply-to:x-mailer:mime-version :content-type:content-transfer-encoding; bh=94CCHLJ3JCUuEuo2LqQJAzOaJAp/7971bSrshDNGqv4=; b=dtk8dbzzW940bKjvutwkiq9z7YjO50LmeSNFPZC6iXr5rc85NsdCxQwOug38d6VtNZ 86vt9dBEV4U5MnK/K3La7dV3vSWC+WOydYKyNMWW6Sel+bqiqgnyqAmmjxbHDRbEPrJo Hi7+Jrp+o4YpWwWL1EYFKAZvOxE9udXq9jahQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:cc:subject:message-id:in-reply-to:references:reply-to :x-mailer:mime-version:content-type:content-transfer-encoding; b=SPLb8u15/MI9nmqIOuqLSY4QC287+fbosMZ0KFlB4zMe89LJ6Ze22CHLYNG0rIOgFZ 2JAXI0ODtjswlmRW2DWh1c/a/qc/dS5bIMc9zjO2aadld0LRfTrWIKUz6FhyIy1be+S7 jVN4BAl0pmzDFIwiucwyjwnnGdRPmSYCOLiCU= Received: by 10.223.4.217 with SMTP id 25mr6963461fas.60.1276600483126; Tue, 15 Jun 2010 04:14:43 -0700 (PDT) Received: from ernst.jennejohn.org (p578E29DC.dip.t-dialin.net [87.142.41.220]) by mx.google.com with ESMTPS id n6sm6016671fam.7.2010.06.15.04.14.42 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 15 Jun 2010 04:14:42 -0700 (PDT) Date: Tue, 15 Jun 2010 13:14:41 +0200 From: Gary Jennejohn To: Victor Sudakov Message-ID: <20100615131441.5b82d4eb@ernst.jennejohn.org> In-Reply-To: <20100615022837.GB23583@admin.sibptus.tomsk.ru> References: <4B408745.3030309@andric.com> <20100103154503.GA63734@admin.sibptus.tomsk.ru> <20100103221655.GA76049@server.vk2pj.dyndns.org> <20100104130315.GA79633@admin.sibptus.tomsk.ru> <20100104133657.GA47668@owl.midgard.homeip.net> <20100104143749.GA80433@admin.sibptus.tomsk.ru> <20100104223631.GC41129@server.vk2pj.dyndns.org> <20100105064720.GA94590@admin.sibptus.tomsk.ru> <20100614044308.GA4670@admin.sibptus.tomsk.ru> <09f445615c18768df17418f06d872a46.squirrel@www.noacks.org> <20100615022837.GB23583@admin.sibptus.tomsk.ru> X-Mailer: Claws Mail 3.7.5 (GTK+ 2.18.7; amd64-portbld-freebsd9.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: "Checksum mismatch -- will transfer entire file" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: gljennjohn@googlemail.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 11:14:45 -0000 On Tue, 15 Jun 2010 09:28:37 +0700 Victor Sudakov wrote: > Jonathan Noack wrote: > > >> But to hell with this. I started the topic because I think something > > >> is wrong with SVN to CVS export, which upsets cvsup and causes > > >> "Checksum mismatch" errors. Is anybody willing to look at it? > > > > > > I see nobody is ever going to fix this? Cvsup mails me a bunch of > > > "Checksum mismatch" errors on every run, with a risk of overlooking > > > real errors. > > > > > > How do others deal with this noise? Do you grep cvsup output or what? > > > > Seems like newer versions of CVS break assumptions made by CVSup on the > > ordering of branch revisions: > > http://lists.freebsd.org/pipermail/freebsd-hubs/2009-August/002083.html > > > > "So, in short I don't see any easy solutions to this, and especially given > > the fact that in the long run CVS/CVSup will probably be replaced by > > something else for distributing FreeBSD source, I don't think it will be > > that easy to find someone to "fix" either CVSup or CVS." > > Thanks for the link. Somebody wrote here that the problem was perhaps > in the svn2cvs script, but Simon's post gives a different outlook. > > Maybe nobody is going to fix CVSup (is it not actively developed > already?), but csup is relatively recent and alive. Once it has a CVS > mode, maybe it could be adjusted? > csup already has a CVS mode, at least in 9-current. I don't use older versions of FreeBSD so I don't know whether it supports CVS there. -- Gary Jennejohn From owner-freebsd-hackers@FreeBSD.ORG Tue Jun 15 13:55:22 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5ADA3106564A for ; Tue, 15 Jun 2010 13:55:22 +0000 (UTC) (envelope-from mailnull@mips.inka.de) Received: from mail-in-12.arcor-online.net (mail-in-12.arcor-online.net [151.189.21.52]) by mx1.freebsd.org (Postfix) with ESMTP id 09E9D8FC17 for ; Tue, 15 Jun 2010 13:55:21 +0000 (UTC) Received: from mail-in-02-z2.arcor-online.net (mail-in-02-z2.arcor-online.net [151.189.8.14]) by mx.arcor.de (Postfix) with ESMTP id 2911E267ED for ; Tue, 15 Jun 2010 15:55:20 +0200 (CEST) Received: from mail-in-01.arcor-online.net (mail-in-01.arcor-online.net [151.189.21.41]) by mail-in-02-z2.arcor-online.net (Postfix) with ESMTP id 7B95A175745 for ; Tue, 15 Jun 2010 15:55:19 +0200 (CEST) Received: from lorvorc.mips.inka.de (dslb-094-218-182-107.pools.arcor-ip.net [94.218.182.107]) by mail-in-01.arcor-online.net (Postfix) with ESMTPS id 3FDFA5A520 for ; Tue, 15 Jun 2010 15:55:19 +0200 (CEST) X-DKIM: Sendmail DKIM Filter v2.8.2 mail-in-01.arcor-online.net 3FDFA5A520 Received: from lorvorc.mips.inka.de (localhost [127.0.0.1]) by lorvorc.mips.inka.de (8.14.4/8.14.3) with ESMTP id o5FDtI4S098778 for ; Tue, 15 Jun 2010 15:55:18 +0200 (CEST) (envelope-from mailnull@lorvorc.mips.inka.de) Received: (from mailnull@localhost) by lorvorc.mips.inka.de (8.14.4/8.14.4/Submit) id o5FDtIsM098777 for freebsd-hackers@freebsd.org; Tue, 15 Jun 2010 15:55:18 +0200 (CEST) (envelope-from mailnull) From: naddy@mips.inka.de (Christian Weisgerber) Date: Tue, 15 Jun 2010 13:55:18 +0000 (UTC) Message-ID: References: <4B408745.3030309@andric.com> <09f445615c18768df17418f06d872a46.squirrel@www.noacks.org> <20100615022837.GB23583@admin.sibptus.tomsk.ru> <20100615131441.5b82d4eb@ernst.jennejohn.org> Originator: naddy@mips.inka.de (Christian Weisgerber) To: freebsd-hackers@freebsd.org Subject: Re: "Checksum mismatch -- will transfer entire file" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 13:55:22 -0000 Gary Jennejohn wrote: > csup already has a CVS mode, at least in 9-current. I don't use older > versions of FreeBSD so I don't know whether it supports CVS there. It does at least down to 7.x. -- Christian "naddy" Weisgerber naddy@mips.inka.de From owner-freebsd-hackers@FreeBSD.ORG Tue Jun 15 15:08:57 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 63664106566B for ; Tue, 15 Jun 2010 15:08:57 +0000 (UTC) (envelope-from b.yordanov@exsisto.com) Received: from exaxrb1.exsisto.com (exaxrb1.exsisto.com [81.29.192.98]) by mx1.freebsd.org (Postfix) with ESMTP id A92A88FC1E for ; Tue, 15 Jun 2010 15:08:56 +0000 (UTC) Received: (qmail 20162 invoked by uid 507); 15 Jun 2010 16:42:14 +0200 Received: by simscan 1.4.0 ppid: 20159, pid: 20160, t: 0.0440s scanners: clamav: 0.96.1/m:52/d:7874 Received: from unknown (HELO ?192.168.1.100?) (b.yordanov@exsisto.com@87.120.222.131) by exaxrb1.exsisto.com with AES128-SHA encrypted SMTP; 15 Jun 2010 16:42:14 +0200 From: Boyko Yordanov Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Date: Tue, 15 Jun 2010 17:42:12 +0300 To: freebsd-hackers@freebsd.org Message-Id: Mime-Version: 1.0 (Apple Message framework v1078) X-Mailer: Apple Mail (2.1078) Subject: CLONE_NEWNS or similar in freebsd? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 15:08:57 -0000 Hi List, I have an app that uses linux's clone() syscall (with the CLONE_NEWNS = flag). I need to migrate this app to freebsd. Is there similar functionality in freebsd? For what I read fork() and = rfork() wont do the trick. I need the children to have their own private = mount namespaces. Thanks! Boyko= From owner-freebsd-hackers@FreeBSD.ORG Tue Jun 15 18:05:33 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5926E106567D for ; Tue, 15 Jun 2010 18:05:33 +0000 (UTC) (envelope-from b.yordanov@exsisto.com) Received: from exaxrb1.exsisto.com (exaxrb1.exsisto.com [81.29.192.98]) by mx1.freebsd.org (Postfix) with ESMTP id B6EC68FC25 for ; Tue, 15 Jun 2010 18:05:32 +0000 (UTC) Received: (qmail 5226 invoked by uid 507); 15 Jun 2010 20:05:28 +0200 Received: by simscan 1.4.0 ppid: 5223, pid: 5224, t: 0.1160s scanners: clamav: 0.96.1/m:52/d:7874 Received: from unknown (HELO ?192.168.0.103?) (b.yordanov@exsisto.com@77.70.122.245) by exaxrb1.exsisto.com with AES128-SHA encrypted SMTP; 15 Jun 2010 20:05:28 +0200 Mime-Version: 1.0 (Apple Message framework v1078) Content-Type: text/plain; charset=us-ascii From: Boyko Yordanov In-Reply-To: <4C17AF4A.3090600@elischer.org> Date: Tue, 15 Jun 2010 21:05:24 +0300 Content-Transfer-Encoding: quoted-printable Message-Id: References: <4C17AF4A.3090600@elischer.org> To: Julian Elischer X-Mailer: Apple Mail (2.1078) Cc: freebsd-hackers@freebsd.org Subject: Re: CLONE_NEWNS or similar in freebsd? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 18:05:33 -0000 On Jun 15, 2010, at 7:50 PM, Julian Elischer wrote: > Since we are not Linux guru's, can you define EXACTLY what that does = and exactly what subset of that YOU need. (and why). >=20 > we may be able to achieve the same final effect in a different way. Hi Julian! Yes, of course, I apologize for not exposing any details = about the expected results at first place. Here is the case: In a typical Linux environment my application is spawning children with = the clone() syscall. clone(), with the CLONE_NEWNS flag, allows the = child to gain its own private mount namespace. This means that when a = child mounts a directory (with mount() or nmount() in freebsd) and then = it "dies", the directories that it mounted do not persist in the = "fathers" process environment. Dirs are mounted only from the child = perspective and other processes do not see these mounts nor can they = interact with the mounted dirs. For what I'm aware, with Linux this can = be achieved with either clone() or unshare(), but for what I read none = of these exists in freebsd. rfork() for example spawns a child that does not have this private = namespace, and thus when the child mounts a directory and then it dies, = the directories that it had mounted remain mounted on the system = (visible for all other processes). So if I run the program on freebsd = I'll end up having thousands of mounted directories (a couple per child) = in a while. What I am trying to achieve is either the children having their private = mount namespaces (so that they do not leave their directories behind = mounted) or eventually unmounting the dirs when the mounts are no longer = needed.. seems a solution too, although a child is executing execve() = after the dirs are mounted, so I am not sure how to unmount the dirs = when the executed process exits. Hope this makes it more clear, I really appreciate any help on this. Boyko= From owner-freebsd-hackers@FreeBSD.ORG Tue Jun 15 20:25:55 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 93DC4106564A for ; Tue, 15 Jun 2010 20:25:55 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id D83CB8FC14 for ; Tue, 15 Jun 2010 20:25:54 +0000 (UTC) Received: from porto.topspin.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id XAA04470; Tue, 15 Jun 2010 23:25:12 +0300 (EEST) (envelope-from avg@icyb.net.ua) Received: from localhost.topspin.kiev.ua ([127.0.0.1]) by porto.topspin.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1OOch6-000DSL-5L; Tue, 15 Jun 2010 23:25:12 +0300 Message-ID: <4C17E1A7.90307@icyb.net.ua> Date: Tue, 15 Jun 2010 23:25:11 +0300 From: Andriy Gapon User-Agent: Thunderbird 2.0.0.24 (X11/20100603) MIME-Version: 1.0 To: Boyko Yordanov References: In-Reply-To: X-Enigmail-Version: 0.96.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: CLONE_NEWNS or similar in freebsd? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 15 Jun 2010 20:25:55 -0000 on 15/06/2010 17:42 Boyko Yordanov said the following: > Hi List, > > I have an app that uses linux's clone() syscall (with the CLONE_NEWNS flag). > I need to migrate this app to freebsd. > > Is there similar functionality in freebsd? For what I read fork() and rfork() > wont do the trick. I need the children to have their own private mount > namespaces. I am afraid that FreeBSD doesn't have this capability. There is a single mount namespace per whole system image. BTW, I am intrigued, in what situations this flag is useful? -- Andriy Gapon From owner-freebsd-hackers@FreeBSD.ORG Wed Jun 16 00:22:30 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E5F0C106564A for ; Wed, 16 Jun 2010 00:22:30 +0000 (UTC) (envelope-from julian@elischer.org) Received: from out-0.mx.aerioconnect.net (out-0-33.mx.aerioconnect.net [216.240.47.93]) by mx1.freebsd.org (Postfix) with ESMTP id C7DFB8FC15 for ; Wed, 16 Jun 2010 00:22:30 +0000 (UTC) Received: from idiom.com (postfix@mx0.idiom.com [216.240.32.160]) by out-0.mx.aerioconnect.net (8.13.8/8.13.8) with ESMTP id o5G0M7PL013729; Tue, 15 Jun 2010 17:22:07 -0700 X-Client-Authorized: MaGic Cook1e X-Client-Authorized: MaGic Cook1e X-Client-Authorized: MaGic Cook1e Received: from julian-mac.elischer.org (h-67-100-89-137.snfccasy.static.covad.net [67.100.89.137]) by idiom.com (Postfix) with ESMTP id 95BBC2D6011; Tue, 15 Jun 2010 17:22:06 -0700 (PDT) Message-ID: <4C181946.7040405@elischer.org> Date: Tue, 15 Jun 2010 17:22:30 -0700 From: Julian Elischer User-Agent: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.4; en-US; rv:1.9.1.9) Gecko/20100317 Thunderbird/3.0.4 MIME-Version: 1.0 To: Andriy Gapon References: <4C17E1A7.90307@icyb.net.ua> In-Reply-To: <4C17E1A7.90307@icyb.net.ua> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.67 on 216.240.47.51 Cc: freebsd-hackers@freebsd.org, Boyko Yordanov Subject: Re: CLONE_NEWNS or similar in freebsd? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Jun 2010 00:22:31 -0000 On 6/15/10 1:25 PM, Andriy Gapon wrote: > on 15/06/2010 17:42 Boyko Yordanov said the following: >> Hi List, >> >> I have an app that uses linux's clone() syscall (with the CLONE_NEWNS flag). >> I need to migrate this app to freebsd. >> >> Is there similar functionality in freebsd? For what I read fork() and rfork() >> wont do the trick. I need the children to have their own private mount >> namespaces. > > > I am afraid that FreeBSD doesn't have this capability. > There is a single mount namespace per whole system image. > BTW, I am intrigued, in what situations this flag is useful? > See his other email for more detail on what he wants. I have not heard of this before and you are correct in that we do not have this capacity. I have considered giving jails the capacity to have their own 'real /' i.e. have a totally different filesystem name space (not just a chroot). Then when the jail is removed then namespace would disappear. but that's sort of different. Julian From owner-freebsd-hackers@FreeBSD.ORG Wed Jun 16 08:10:17 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8D9341065674 for ; Wed, 16 Jun 2010 08:10:17 +0000 (UTC) (envelope-from b.yordanov@exsisto.com) Received: from exaxrb1.exsisto.com (exaxrb1.exsisto.com [81.29.192.98]) by mx1.freebsd.org (Postfix) with ESMTP id EB55F8FC1D for ; Wed, 16 Jun 2010 08:10:16 +0000 (UTC) Received: (qmail 2969 invoked by uid 507); 16 Jun 2010 10:10:13 +0200 Received: by simscan 1.4.0 ppid: 2964, pid: 2965, t: 0.1181s scanners: clamav: 0.96.1/m:52/d:7874 Received: from unknown (HELO ?192.168.1.100?) (b.yordanov@exsisto.com@94.26.39.44) by exaxrb1.exsisto.com with AES128-SHA encrypted SMTP; 16 Jun 2010 10:10:13 +0200 Mime-Version: 1.0 (Apple Message framework v1078) Content-Type: text/plain; charset=us-ascii From: Boyko Yordanov In-Reply-To: <4C181946.7040405@elischer.org> Date: Wed, 16 Jun 2010 11:10:12 +0300 Content-Transfer-Encoding: quoted-printable Message-Id: <9F69CF52-3793-439E-BEC8-BE9926C4EBA8@exsisto.com> References: <4C17E1A7.90307@icyb.net.ua> <4C181946.7040405@elischer.org> To: Julian Elischer X-Mailer: Apple Mail (2.1078) Cc: freebsd-hackers@freebsd.org, Andriy Gapon Subject: Re: CLONE_NEWNS or similar in freebsd? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Jun 2010 08:10:17 -0000 On Jun 16, 2010, at 3:22 AM, Julian Elischer wrote: > On 6/15/10 1:25 PM, Andriy Gapon wrote: >> on 15/06/2010 17:42 Boyko Yordanov said the following: >>> Hi List, >>>=20 >>> I have an app that uses linux's clone() syscall (with the = CLONE_NEWNS flag). >>> I need to migrate this app to freebsd. >>>=20 >>> Is there similar functionality in freebsd? For what I read fork() = and rfork() >>> wont do the trick. I need the children to have their own private = mount >>> namespaces. >>=20 >>=20 >> I am afraid that FreeBSD doesn't have this capability. >> There is a single mount namespace per whole system image. >> BTW, I am intrigued, in what situations this flag is useful? >>=20 >=20 >=20 > See his other email for more detail on what he wants. > I have not heard of this before and you are correct in that we do not = have this capacity. > I have considered giving jails the capacity to have their own 'real /' = i.e. have a totally different filesystem name space (not just a = chroot). Then when the jail is removed then namespace would disappear. = but that's sort of different. >=20 > Julian It is different indeed (running in a jail). If I am not wrong, the CLONE_NEWNS flag is something that Linux took = from the Plan 9 system. As it seems I'l have to think of some other way to achieve this = functionality or just use a different app, although I am not sure if = there is anything similar available. It is a custom version of apaches suexec that mounts vhosts directories = and chroots for security reasons. When it exits it leaves the vhost dirs = mounted on a freebsd system. I prefer this custom suexec because there = are several extra features I rely on, like choosing the php version to = execute per vhost etc.. There are for sure other options, like = mod_chroot or else.. I'm just feeling familiar w/ this one and I thought = there might be a solution that I missed. Thanks! Boyko= From owner-freebsd-hackers@FreeBSD.ORG Wed Jun 16 16:35:42 2010 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A3CC91065676; Wed, 16 Jun 2010 16:35:42 +0000 (UTC) (envelope-from danger@FreeBSD.org) Received: from services.syscare.sk (services.syscare.sk [188.40.39.36]) by mx1.freebsd.org (Postfix) with ESMTP id 5B5CC8FC22; Wed, 16 Jun 2010 16:35:42 +0000 (UTC) Received: from services.syscare.sk (services [188.40.39.36]) by services.syscare.sk (Postfix) with ESMTP id CB0162C839; Wed, 16 Jun 2010 18:15:58 +0200 (CEST) X-Virus-Scanned: amavisd-new at rulez.sk Received: from services.syscare.sk ([188.40.39.36]) by services.syscare.sk (services.rulez.sk [188.40.39.36]) (amavisd-new, port 10024) with ESMTP id w7m+4RZtbzeW; Wed, 16 Jun 2010 18:15:56 +0200 (CEST) Received: from danger-mbp.local (bband-dyn49.178-40-157.t-com.sk [178.40.157.49]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: danger@rulez.sk) by services.syscare.sk (Postfix) with ESMTPSA id 57AB12C825; Wed, 16 Jun 2010 18:15:56 +0200 (CEST) Message-ID: <4C18F8BB.4040006@FreeBSD.org> Date: Wed, 16 Jun 2010 18:15:55 +0200 From: Daniel Gerzo Organization: The FreeBSD Project User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.4) Gecko/20100616 Lanikai/3.1.1pre MIME-Version: 1.0 To: current@freebsd.org, hackers@freebsd.org, questions@freebsd.org Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: HEADSUP: Call for FreeBSD Status Reports - 2Q/2010 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Jun 2010 16:35:42 -0000 Dear all, I would like to remind you that the next round of status reports covering the second quarter of 2010 is due on July 15th, 2010. This initiative is very welcome in our community. Therefore, I would like to ask you to submit your status reports soon, so that we can compile the report on time. Do not hesitate and write us a few lines - a short description about what you are working on, what are your plans and goals, so we can inform our community about your great work! Check out the reports from past to get some inspiration of what your submission should look like. If you know about a project that should be included in the status report, please let us know as well, so we can poke the responsible people to provide us with something useful. Updates to submissions from the last report are welcome too. Note that the submissions are accepted from anyone involved with the FreeBSD community, you do not have to be a FreeBSD committer. Submissions about anything related to FreeBSD are very welcome! Please email us the filled-in XML template to be found at http://www.freebsd.org/news/status/report-sample.xml to monthly@FreeBSD.org, or alternatively use our web based form located at http://www.freebsd.org/cgi/monthly.cgi. For more information, please visit http://www.freebsd.org/news/status/. We are looking forward to see your submissions! -- S pozdravom / Best regards Daniel Gerzo, FreeBSD committer From owner-freebsd-hackers@FreeBSD.ORG Thu Jun 17 19:49:37 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8AAD01065670 for ; Thu, 17 Jun 2010 19:49:37 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.186]) by mx1.freebsd.org (Postfix) with ESMTP id 1CB068FC17 for ; Thu, 17 Jun 2010 19:49:36 +0000 (UTC) Received: from vampire.homelinux.org (dslb-088-066-042-132.pools.arcor-ip.net [88.66.42.132]) by mrelayeu.kundenserver.de (node=mrbap1) with ESMTP (Nemesis) id 0LtlI5-1PQLFI3okH-010hFE; Thu, 17 Jun 2010 21:49:35 +0200 Received: (qmail 41468 invoked from network); 17 Jun 2010 19:49:29 -0000 Received: from f8x64.laiers.local (192.168.4.188) by router.laiers.local with SMTP; 17 Jun 2010 19:49:29 -0000 From: Max Laier Organization: FreeBSD To: Nick Rogers Date: Thu, 17 Jun 2010 21:49:28 +0200 User-Agent: KMail/1.13.3 (FreeBSD/8.0-RELEASE-p2; KDE/4.4.3; amd64; ; ) References: <201006092330.30750.max@love2party.net> In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Message-Id: <201006172149.28855.max@love2party.net> X-Provags-ID: V01U2FsdGVkX19aio+q/0DbLjdySkkItbtn4je83IkcNb9TAKq t3NM9rsMJAguHSJrs2+E9WsOxjPOMZIUdzSEO57vtWRpfPoqZv tQz0Gx5UOaURl2S8TaHIg== Cc: freebsd-hackers@freebsd.org Subject: Re: arp(8) performance w/ many aliases assigned to an interface X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Jun 2010 19:49:37 -0000 Hello Nick, On Wednesday 09 June 2010 23:56:27 Nick Rogers wrote: > Can this change make it into 8.1-RELEASE? just MFCed it to stable/8. It will, however, not make it to 8.1-Release. As it is not a bug fix, just a performance improvement, it is not considered a candidate for the release branch at this late time - sorry. Thanks for your report again, Max From owner-freebsd-hackers@FreeBSD.ORG Fri Jun 18 03:38:39 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 89B13106566C for ; Fri, 18 Jun 2010 03:38:39 +0000 (UTC) (envelope-from ncrogers@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 432858FC12 for ; Fri, 18 Jun 2010 03:38:39 +0000 (UTC) Received: by iwn7 with SMTP id 7so783299iwn.13 for ; Thu, 17 Jun 2010 20:38:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type; bh=shtYaqTDRyu5WtQr+msjPiwg/mvzUnd5yHmQ3Rcktis=; b=s8xQoabENK5iAJ0qrAq1N0/9tYT1HArmG5KKnpvkXDUbR8GinqHKCs1kejRRGnuNzd NFfw1ui43UQ+2LqpdxTeWwi06vybgKvbSCpLPKu4iiMoc5OhDnutWRsEF6uJxSP5KYwc JDUySU8UZD2cIC6yFvHGb6V74g2AgV4gNn3oY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=lbspcbScdcuKWgmXXwe8F5G4yvClBK3BVOwdMy+O9jMroaXUQDTUQdOx6meaUK6jus MyeSp7bYNVKvt5GmdA0NnSOl1mcE5j1OsLkV+IwGqrMdUACcKSZpPJqFUIykkxC0IZyi Z+QF4M1SkUF1hAGkWVpEWQR/nn4GlgtKa9om4= MIME-Version: 1.0 Received: by 10.231.130.137 with SMTP id t9mr524015ibs.142.1276832318266; Thu, 17 Jun 2010 20:38:38 -0700 (PDT) Received: by 10.231.130.37 with HTTP; Thu, 17 Jun 2010 20:38:38 -0700 (PDT) In-Reply-To: <201006172149.28855.max@love2party.net> References: <201006092330.30750.max@love2party.net> <201006172149.28855.max@love2party.net> Date: Thu, 17 Jun 2010 23:38:38 -0400 Message-ID: From: Nick Rogers To: Max Laier Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-hackers@freebsd.org Subject: Re: arp(8) performance w/ many aliases assigned to an interface X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jun 2010 03:38:39 -0000 On Thu, Jun 17, 2010 at 3:49 PM, Max Laier wrote: > Hello Nick, > > On Wednesday 09 June 2010 23:56:27 Nick Rogers wrote: > > Can this change make it into 8.1-RELEASE? > > just MFCed it to stable/8. It will, however, not make it to 8.1-Release. > As > it is not a bug fix, just a performance improvement, it is not considered a > candidate for the release branch at this late time - sorry. > > Thanks for your report again, > Max > No worries, at least its in there now. Thanks again for committing the change and keeping me apprised. From owner-freebsd-hackers@FreeBSD.ORG Sat Jun 19 03:55:03 2010 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3849C106564A for ; Sat, 19 Jun 2010 03:55:03 +0000 (UTC) (envelope-from peterjeremy@acm.org) Received: from mail13.syd.optusnet.com.au (mail13.syd.optusnet.com.au [211.29.132.194]) by mx1.freebsd.org (Postfix) with ESMTP id C051C8FC14 for ; Sat, 19 Jun 2010 03:55:02 +0000 (UTC) Received: from server.vk2pj.dyndns.org (c211-30-160-13.belrs4.nsw.optusnet.com.au [211.30.160.13]) by mail13.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id o5J3swNG023967 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 19 Jun 2010 13:54:59 +1000 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.4/8.14.4) with ESMTP id o5J3sv3K025621; Sat, 19 Jun 2010 13:54:57 +1000 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.4/8.14.4/Submit) id o5J3svMa025620; Sat, 19 Jun 2010 13:54:57 +1000 (EST) (envelope-from peter) Date: Sat, 19 Jun 2010 13:54:57 +1000 From: Peter Jeremy To: freebsd-hackers@freebsd.org, file@mx.gw.com Message-ID: <20100619035457.GA63510@server.vk2pj.dyndns.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="BOKacYhQ+x31HxR3" Content-Disposition: inline X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.20 (2009-06-14) Cc: Subject: Poor file(1) performance X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Jun 2010 03:55:03 -0000 --BOKacYhQ+x31HxR3 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable I recently had reason to run file(1) (file-5.03 on FreeBSD 8-stable) on a large number of files and felt the performance wasn't up to par. When I investigated further, I found that about 95% of the runtime related to the two regex's to recognize REXX files: # OS/2 batch files are REXX. the second regex is a bit generic, oh well # the matched commands seem to be common in REXX and uncommon elsewhere 100 regex/c =3D^[\ \t]{0,10}call[\ \t]{1,10}rxfunc OS/2 REXX batch file text 100 regex/c =3D^[\ \t]{0,10}say\ ['"] OS/2 REXX batch file text Since REXX files are not present in my environment, I can avoid the issue by just commenting out the offending lines. Someone with more expertise in magic(5) might be able to suggest a better fix. --=20 Peter Jeremy --BOKacYhQ+x31HxR3 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.14 (FreeBSD) iEYEARECAAYFAkwcP5EACgkQ/opHv/APuIewSgCcDVrNVUEwmNakzKpRvMEFlWkh QgsAnjpvKCYtn1nYbzXdiFfU+rEQzFTY =BXDH -----END PGP SIGNATURE----- --BOKacYhQ+x31HxR3-- From owner-freebsd-hackers@FreeBSD.ORG Sat Jun 19 15:48:27 2010 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2654E1065672; Sat, 19 Jun 2010 15:48:26 +0000 (UTC) (envelope-from jh@FreeBSD.org) Received: from gw03.mail.saunalahti.fi (gw03.mail.saunalahti.fi [195.197.172.111]) by mx1.freebsd.org (Postfix) with ESMTP id A0B588FC16; Sat, 19 Jun 2010 15:48:26 +0000 (UTC) Received: from a91-153-117-195.elisa-laajakaista.fi (a91-153-117-195.elisa-laajakaista.fi [91.153.117.195]) by gw03.mail.saunalahti.fi (Postfix) with SMTP id D19C12164DD; Sat, 19 Jun 2010 18:48:22 +0300 (EEST) Date: Sat, 19 Jun 2010 18:48:22 +0300 From: Jaakko Heinonen To: freebsd-hackers@FreeBSD.org Message-ID: <20100619154822.GA1166@a91-153-117-195.elisa-laajakaista.fi> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) Cc: phk@FreeBSD.org Subject: [patch] extending alloc_unr(9) to allocate specific unit numbers X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Jun 2010 15:48:27 -0000 Hi, I wrote a patch to extend the kernel unit number allocator for allocating specific unit numbers. The patch adds a new function alloc_unr_specific() which returns the requested unit number if it is free and -1 if the number is already allocated or out of the range. Unlike alloc_unr(), alloc_unr_specific() may allocate memory and thus sleep. The patch is here: http://people.freebsd.org/~jh/patches/alloc_unr_specific.diff I think that this functionality has been requested by some people. Reviews/comments? As an example here is md(4) converted to use alloc_unr() / alloc_unr_specific(): http://people.freebsd.org/~jh/patches/md-alloc_unr.diff -- Jaakko