From owner-freebsd-hackers@FreeBSD.ORG Sun Jul 26 08:48:56 2009 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F0E07106566B for ; Sun, 26 Jul 2009 08:48:56 +0000 (UTC) (envelope-from gabor@kovesdan.org) Received: from server.mypc.hu (server.mypc.hu [87.229.73.95]) by mx1.freebsd.org (Postfix) with ESMTP id ABD858FC12 for ; Sun, 26 Jul 2009 08:48:56 +0000 (UTC) (envelope-from gabor@kovesdan.org) Received: from localhost (localhost [127.0.0.1]) by server.mypc.hu (Postfix) with ESMTP id 3397E14D9216 for ; Sun, 26 Jul 2009 10:33:37 +0200 (CEST) X-Virus-Scanned: amavisd-new at t-hosting.hu Received: from server.mypc.hu ([127.0.0.1]) by localhost (server.mypc.hu [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 5wbOm4OwEQW7 for ; Sun, 26 Jul 2009 10:33:36 +0200 (CEST) Received: from [192.168.2.102] (unknown [84.78.89.246]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by server.mypc.hu (Postfix) with ESMTPSA id E11A114D5649 for ; Sun, 26 Jul 2009 10:33:35 +0200 (CEST) Message-ID: <4A6C1508.7020309@kovesdan.org> Date: Sun, 26 Jul 2009 10:34:16 +0200 From: =?ISO-8859-1?Q?G=E1bor_K=F6vesd=E1n?= User-Agent: Thunderbird 2.0.0.21 (X11/20090516) MIME-Version: 1.0 To: hackers@FreeBSD.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Mailman-Approved-At: Sun, 26 Jul 2009 14:49:52 +0000 Cc: Subject: bsd.lib.mk question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Jul 2009 08:48:57 -0000 Hi, I wonder if there's a conventional way of building _only_ shared libraries using bsd.lib.mk. At default, it builds static, shared and profiled libraries, which is a waste of time because I only need shared libraries, which I use as on-demand loadable modules. Adjusting _LIBS after the inclusion of bsd.lib.mk doesn't help and there are no knobs to control the behaviour. What should I do? Thanks, Gábor From owner-freebsd-hackers@FreeBSD.ORG Sun Jul 26 17:01:08 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C8BBF106566C for ; Sun, 26 Jul 2009 17:01:08 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: from palm.hoeg.nl (mx0.hoeg.nl [IPv6:2001:7b8:613:100::211]) by mx1.freebsd.org (Postfix) with ESMTP id 6A1E98FC18 for ; Sun, 26 Jul 2009 17:01:08 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: by palm.hoeg.nl (Postfix, from userid 1000) id 4969F1CF34; Sun, 26 Jul 2009 19:01:07 +0200 (CEST) Date: Sun, 26 Jul 2009 19:01:07 +0200 From: Ed Schouten To: =?iso-8859-1?Q?G=E1bor_K=F6vesd=E1n?= Message-ID: <20090726170107.GE83812@hoeg.nl> References: <4A6C1508.7020309@kovesdan.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="a+b56+3nqLzpiR9O" Content-Disposition: inline In-Reply-To: <4A6C1508.7020309@kovesdan.org> User-Agent: Mutt/1.5.20 (2009-06-14) Cc: FreeBSD Hackers Subject: Re: bsd.lib.mk question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Jul 2009 17:01:09 -0000 --a+b56+3nqLzpiR9O Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi Gabor, * G=E1bor K=F6vesd=E1n wrote: > I wonder if there's a conventional way of building _only_ shared > libraries using bsd.lib.mk. At default, it builds static, shared and > profiled libraries, which is a waste of time because I only need > shared libraries, which I use as on-demand loadable modules. > Adjusting _LIBS after the inclusion of bsd.lib.mk doesn't help and > there are no knobs to control the behaviour. What should I do? Be sure to look at the Makefiles used by the PAM modules (lib/libpam/modules). I guess NO_PROFILE and NO_INSTALLLIB should be sufficient. --=20 Ed Schouten WWW: http://80386.nl/ --a+b56+3nqLzpiR9O Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkpsi9MACgkQ52SDGA2eCwXpTACfbd+rQvHJ6DKKQeGvU4XYkXLC 4k4An32OSvX9WiBZYOLDwnI157Fxo7oe =SHWj -----END PGP SIGNATURE----- --a+b56+3nqLzpiR9O-- From owner-freebsd-hackers@FreeBSD.ORG Sun Jul 26 15:39:54 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 76E6D106566C for ; Sun, 26 Jul 2009 15:39:54 +0000 (UTC) (envelope-from gal.diskin@intel.com) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by mx1.freebsd.org (Postfix) with ESMTP id 5604A8FC19 for ; Sun, 26 Jul 2009 15:39:54 +0000 (UTC) (envelope-from gal.diskin@intel.com) Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga101.fm.intel.com with ESMTP; 26 Jul 2009 08:10:26 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="4.43,272,1246863600"; d="scan'208,217";a="711176705" Received: from irsmsx601.ger.corp.intel.com ([163.33.7.164]) by fmsmga001.fm.intel.com with ESMTP; 26 Jul 2009 08:14:43 -0700 Received: from hasmsx601.ger.corp.intel.com (10.184.10.125) by irsmsx601.ger.corp.intel.com (163.33.7.164) with Microsoft SMTP Server (TLS) id 8.1.358.0; Sun, 26 Jul 2009 16:11:28 +0100 Received: from hasmsx502.ger.corp.intel.com ([10.184.10.97]) by hasmsx601.ger.corp.intel.com ([10.184.10.125]) with mapi; Sun, 26 Jul 2009 18:11:27 +0300 From: "Diskin, Gal" To: "freebsd-hackers@freebsd.org" Date: Sun, 26 Jul 2009 18:11:25 +0300 Thread-Topic: ptrace question Thread-Index: AcoOA1e3XgfwxwsHSYeK05jNFYzSsg== Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US MIME-Version: 1.0 X-Mailman-Approved-At: Sun, 26 Jul 2009 17:33:54 +0000 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: ptrace question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Jul 2009 15:39:54 -0000 Hi, I'm using ptrace to execute one application under the control of another (s= urprisingly :P). I'm trying to find the number of the last system call exec= uted in the traced process from the tracing process. In Linux this is done = using "orig_eax" (or "orig_rax") but as far as I can tell it does not have = a counterpart in FreeBSD (correct me if I'm wrong). I've looked at the kern= el sources in hope of finding out how the conversion was done in the Linux = emulation layer. The file linux_ptrace.c (http://fxr.watson.org/fxr/source/= i386/linux/linux_ptrace.c?v=3DFREEBSD72#L118) seems to be the place the con= version is taking place. However, in spite the comment at the top of the co= nversion function mentioning that the translation is not straightforward, t= he translation done is simply copying eax to orig_eax. My question is: Is there a way to find the number of the last system call e= xecuted in the traced application from the tracing application (using ptrac= e)? Thanks, Gal Diskin --------------------------------------------------------------------- Intel Israel (74) Limited This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. From owner-freebsd-hackers@FreeBSD.ORG Sun Jul 26 17:49:52 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D17F71065670 for ; Sun, 26 Jul 2009 17:49:52 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (skuns.zoral.com.ua [91.193.166.194]) by mx1.freebsd.org (Postfix) with ESMTP id 6C4618FC13 for ; Sun, 26 Jul 2009 17:49:52 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id n6QHnl0f061259 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 26 Jul 2009 20:49:47 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.3/8.14.3) with ESMTP id n6QHnktP072021; Sun, 26 Jul 2009 20:49:46 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.3/8.14.3/Submit) id n6QHnkkR072020; Sun, 26 Jul 2009 20:49:46 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Sun, 26 Jul 2009 20:49:46 +0300 From: Kostik Belousov To: "Diskin, Gal" Message-ID: <20090726174946.GR55190@deviant.kiev.zoral.com.ua> References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="6XNUmp/j7fdcibPl" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: clamav-milter 0.95.2 at skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua Cc: "freebsd-hackers@freebsd.org" Subject: Re: ptrace question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Jul 2009 17:49:53 -0000 --6XNUmp/j7fdcibPl Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Sun, Jul 26, 2009 at 06:11:25PM +0300, Diskin, Gal wrote: > Hi, > I'm using ptrace to execute one application under the control > of another (surprisingly :P). I'm trying to find the number > of the last system call executed in the traced process from > the tracing process. In Linux this is done using "orig_eax" > (or "orig_rax") but as far as I can tell it does not have a > counterpart in FreeBSD (correct me if I'm wrong). I've looked > at the kernel sources in hope of finding out how the conversion > was done in the Linux emulation layer. The file linux_ptrace.c > (http://fxr.watson.org/fxr/source/i386/linux/linux_ptrace.c?v=FREEBSD7 > 2#L118) seems to be the place the conversion is taking place. However, > in spite the comment at the top of the conversion function mentioning > that the translation is not straightforward, the translation done is > simply copying eax to orig_eax. > > My question is: Is there a way to find the number of the last system > call executed in the traced application from the tracing application > (using ptrace)? Are you trying to trace linux process, or native freebsd ? And, is the tracer linux process, or freebsd one ? It seems that you are talking about linux process, note that linux PTRACE_SYSCALL is not implemented in linuxolator. For native FreeBSD tracers, you can use PT_TO_SCE, that stops the process at the syscall entry, PT_TO_SCX, that stops at the syscall exit. Most likely, truss source code is most illustrative in the usage. The flags allow to trace both freebsd and linux processes. After the process is stopped, you should get registers of the traced process. Upon syscall entry, %eax contains syscall number. --6XNUmp/j7fdcibPl Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkpslzoACgkQC3+MBN1Mb4i59gCglETQ+dOGLx8bmMeaF7iPeCGO 5hQAoJ7aZFoUZXbcSI9mrZ8IBa6MdmS+ =98D9 -----END PGP SIGNATURE----- --6XNUmp/j7fdcibPl-- From owner-freebsd-hackers@FreeBSD.ORG Sun Jul 26 23:34:42 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BFB8A106566B for ; Sun, 26 Jul 2009 23:34:42 +0000 (UTC) (envelope-from bright@elvis.mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id AE61D8FC14 for ; Sun, 26 Jul 2009 23:34:42 +0000 (UTC) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id D354E1A3C6E; Sun, 26 Jul 2009 16:15:34 -0700 (PDT) Date: Sun, 26 Jul 2009 16:15:34 -0700 From: Alfred Perlstein To: hackers@freebsd.org Message-ID: <20090726231534.GI21885@elvis.mu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i Cc: Subject: distributed scm+freebsd svn? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Jul 2009 23:34:43 -0000 Hello hackers, Does anyone here use one of the distributed SCMs to manage contributions to FreeBSD in an easy manner? Any pointers to a setup you have? I thought "git" was supposed to make this easy, but going over the docs leaves me with a lot of questions. I'm hoping to be able to basically: sync into my "distributed repo". allow a third party access to it. easily commit upstream back into svn from a branch in my distributed scm. -- - Alfred Perlstein VMOA #5191, 03 vmax, 92 gs500, ch250 - FreeBSD From owner-freebsd-hackers@FreeBSD.ORG Mon Jul 27 09:45:48 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CFE27106566B for ; Mon, 27 Jul 2009 09:45:48 +0000 (UTC) (envelope-from gal.diskin@intel.com) Received: from mga03.intel.com (mga03.intel.com [143.182.124.21]) by mx1.freebsd.org (Postfix) with ESMTP id A02E38FC08 for ; Mon, 27 Jul 2009 09:45:48 +0000 (UTC) (envelope-from gal.diskin@intel.com) Received: from azsmga001.ch.intel.com ([10.2.17.19]) by azsmga101.ch.intel.com with ESMTP; 27 Jul 2009 02:45:47 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="4.43,276,1246863600"; d="scan'208";a="169236111" Received: from irsmsx601.ger.corp.intel.com ([163.33.7.164]) by azsmga001.ch.intel.com with ESMTP; 27 Jul 2009 02:45:46 -0700 Received: from irsmsx501.ger.corp.intel.com (163.33.7.70) by irsmsx601.ger.corp.intel.com (163.33.7.164) with Microsoft SMTP Server (TLS) id 8.1.358.0; Mon, 27 Jul 2009 10:44:56 +0100 Received: from hasmsx601.ger.corp.intel.com (10.184.10.125) by irsmsx501.ger.corp.intel.com (163.33.7.70) with Microsoft SMTP Server (TLS) id 8.1.358.0; Mon, 27 Jul 2009 10:44:56 +0100 Received: from hasmsx502.ger.corp.intel.com ([10.184.10.97]) by hasmsx601.ger.corp.intel.com ([10.184.10.125]) with mapi; Mon, 27 Jul 2009 12:44:54 +0300 From: "Diskin, Gal" To: Kostik Belousov Date: Mon, 27 Jul 2009 12:44:53 +0300 Thread-Topic: ptrace question Thread-Index: AcoOGX5VOiZqs70jTKGqQIaFbIFKOgAe3vLg Message-ID: References: <20090726174946.GR55190@deviant.kiev.zoral.com.ua> In-Reply-To: <20090726174946.GR55190@deviant.kiev.zoral.com.ua> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-hackers@freebsd.org" Subject: RE: ptrace question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jul 2009 09:45:49 -0000 Hi Kostik, I'm tracing a native FreeBSD process. I tried looking at the Linux code to = find a hint how to port my existing Linux code to FreeBSD.=20 This is exactly what I was looking for - Thank you! Thanks, Gal -----Original Message----- From: Kostik Belousov [mailto:kostikbel@gmail.com]=20 Sent: Sunday, July 26, 2009 8:50 PM To: Diskin, Gal Cc: freebsd-hackers@freebsd.org Subject: Re: ptrace question On Sun, Jul 26, 2009 at 06:11:25PM +0300, Diskin, Gal wrote: > Hi, > I'm using ptrace to execute one application under the control > of another (surprisingly :P). I'm trying to find the number > of the last system call executed in the traced process from > the tracing process. In Linux this is done using "orig_eax" > (or "orig_rax") but as far as I can tell it does not have a > counterpart in FreeBSD (correct me if I'm wrong). I've looked > at the kernel sources in hope of finding out how the conversion > was done in the Linux emulation layer. The file linux_ptrace.c > (http://fxr.watson.org/fxr/source/i386/linux/linux_ptrace.c?v=3DFREEBSD7 > 2#L118) seems to be the place the conversion is taking place. However, > in spite the comment at the top of the conversion function mentioning > that the translation is not straightforward, the translation done is > simply copying eax to orig_eax. > > My question is: Is there a way to find the number of the last system > call executed in the traced application from the tracing application > (using ptrace)? Are you trying to trace linux process, or native freebsd ? And, is the tracer linux process, or freebsd one ? It seems that you are talking about linux process, note that linux PTRACE_SYSCALL is not implemented in linuxolator. For native FreeBSD tracers, you can use PT_TO_SCE, that stops the process at the syscall entry, PT_TO_SCX, that stops at the syscall exit. Most likely, truss source code is most illustrative in the usage. The flags allow to trace both freebsd and linux processes. After the process is stopped, you should get registers of the traced process. Upon syscall entry, %eax contains syscall number. --------------------------------------------------------------------- Intel Israel (74) Limited This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. From owner-freebsd-hackers@FreeBSD.ORG Mon Jul 27 10:05:58 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F04ED106564A; Mon, 27 Jul 2009 10:05:57 +0000 (UTC) (envelope-from stas@FreeBSD.org) Received: from mx0.deglitch.com (backbone.deglitch.com [IPv6:2001:16d8:fffb:4::abba]) by mx1.freebsd.org (Postfix) with ESMTP id A38A28FC14; Mon, 27 Jul 2009 10:05:57 +0000 (UTC) (envelope-from stas@FreeBSD.org) Received: from stasss.yandex.ru (dhcp170-227-red.yandex.net [95.108.170.227]) by mx0.deglitch.com (Postfix) with ESMTPSA id CCDAC8FC2B; Mon, 27 Jul 2009 14:05:55 +0400 (MSD) Date: Mon, 27 Jul 2009 14:05:50 +0400 From: Stanislav Sedov To: Alfred Perlstein Message-Id: <20090727140550.585aa384.stas@FreeBSD.org> In-Reply-To: <20090726231534.GI21885@elvis.mu.org> References: <20090726231534.GI21885@elvis.mu.org> Organization: The FreeBSD Project X-Mailer: carrier-pigeon Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA1"; boundary="Signature=_Mon__27_Jul_2009_14_05_50_+0400_cdipQ9bF.P8+olX3" Cc: hackers@freebsd.org Subject: Re: distributed scm+freebsd svn? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jul 2009 10:05:58 -0000 --Signature=_Mon__27_Jul_2009_14_05_50_+0400_cdipQ9bF.P8+olX3 Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, 26 Jul 2009 16:15:34 -0700 Alfred Perlstein mentioned: > Hello hackers, >=20 > Does anyone here use one of the distributed SCMs > to manage contributions to FreeBSD in an easy > manner? >=20 > Any pointers to a setup you have? >=20 > I thought "git" was supposed to make this easy, but > going over the docs leaves me with a lot of questions. >=20 > I'm hoping to be able to basically: > sync into my "distributed repo". > allow a third party access to it. > easily commit upstream back into svn from a branch > in my distributed scm. > Hi, Alfred! As far as I know there's a lot of people in the communtity use distributed SCMs to work with FreeBSD repo: both git and mercurial are popular. I only used mercurial so I can share my experience only on this SCM. Since I started using it (about 2 years ago) I explored a number of possible ways to keep my repo in sync with FreeBSD one to make merges easier starting from hourly syncs by simple "cvsup + hg commit" (outlined at wiki) and ending by full repository conversions. Luckily enough after switch to subversion it is now possibleto convert the full repo with all history both to git and hg without much problem. Currently I'm using the Hg convert extentsion bundled into the default mercurial install. I made the result of conversion available here: http://repoman.deglitch.com/bsdhg/FreeBSD/base/ It is updated regularly (every 15 minutes) from the local svn mirror. The size of converted repo is about 885 MiB (with all known branches and tags and entire history). =20 Some points to note if you will try do the initial conversion yourself: 1) Use memory disk for repository storage. That will spedup things a lot (an order of magnitude). 2) Hg convert extension expect the default svn layout (i.e. trunk/ for head, tags/ for tags and branches/ for branches). FreeBSD doesn't follow this layout so I had to tweak the application by hand to allow it to found our branches. It is possible to use command line switches to point it to your trunk, tags and branches location, but as we effectively have two root-level folders for branches (stable/ and releng/) it doesn't work wel= l, so I had to add yet one switch to point to another branches folder. 3) Using local svn mirror is usually preferrable for performance matters. For development I usually do a branch clone (either from "head" branch, or some "stable" branch depending what I'm going to work on) by "hg clone" command and then do my work in that branch (ordiary commit/pull/push workflow, nothing specific). Whenever I need to sync with head I do a pull from the parent branch (e.g. hg pull -r head ssh://stas@repoman.deglitch.com/bsdhg/FreeBSD/base/) and then hg merge -r head. This works like a charm for any kind of work I do. When there's a need to get a diff between the stock FreeBSD tree and you tree you can achieve this by using hg diff -r "youbranch" -r "head". I do not perform commits directly from mercurial, but there're extensions to do this, afaik. This just doesn't sound useful much for me. Access to 3rd party users can be granted the same way it is done in other source control systems. I prefer the plain ssh access for this task by configuring a jail with repository access and creating users accounts with limited access and the special wrapper instead of login shell which allows execution of the limited set of commands. Today such kind of shell is already included into the distribution so there's no need to hack up your own version.=20 --=20 Stanislav Sedov ST4096-RIPE --Signature=_Mon__27_Jul_2009_14_05_50_+0400_cdipQ9bF.P8+olX3 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- iQIcBAEBAgAGBQJKbXwCAAoJEKN82nOYvCd08acP/0lKkNzGwaVxFvvA+kaxl64o vXWfbne1phMMBfEQ3eWXDk8hDWmjnuQwbLXcE3dW4VqUD3ITwTTdfoJ998sPDQ5p qU0+2Y+sVyiAsgu3mxoeiuHr4qZZMXFrKQU9w37IV8+EFAgngJ7HuqybiMEUS0ds aLh1CY9DjoELaMnLoTwK/e8Fy0bLycWljVU0ncOVfYZmLCgjBmayMzeWhJ8JrWkY wnPs9C91Nib/HN7ZlUxc2PQr6EJNwkzmBLsWoC0vmeMixuf9VwrN3E5xYd9VJnDC OLNVg3+5790oZSCSgo7+NcP3R/skyAJetoNjhf6v2gXd9uoJseG8BJVMWV+X5HTe 6qes9xfs6Vw44VsUqy1aS+V/tYNl70smoMmgq4YH6bi0iCaaYLJMDYj/zk+mRGd1 NvcZ4mHEuat00P0Msjzbrr7icJd3ScYkhOqorRigsHjW3q7imua1rjcuve7Ep0JB 5c08oRGlzUKkCamNk8Rum8g0w/nWzQVb6PDAP6SsTiIzpwMXuSOYxyPmpdUWfj1c y4Bp/3eRK7gocjnkarQ3+7xXQsHEEzFihRlyz/LeRrrjSezWKWP2E6xAvWwcJKSF ig6cWIZcWnUizGtBzAPhJ6+nE5juYDSGepXixBGErdDCIxL+9yTMObe2A1G+ODS8 vhKrdA40dSjhJCJcym1j =lAzV -----END PGP SIGNATURE----- --Signature=_Mon__27_Jul_2009_14_05_50_+0400_cdipQ9bF.P8+olX3-- From owner-freebsd-hackers@FreeBSD.ORG Mon Jul 27 10:33:00 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 679B1106564A for ; Mon, 27 Jul 2009 10:33:00 +0000 (UTC) (envelope-from avg@freebsd.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id A8A898FC1B for ; Mon, 27 Jul 2009 10:32:59 +0000 (UTC) (envelope-from avg@freebsd.org) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id NAA03799; Mon, 27 Jul 2009 13:17:35 +0300 (EEST) (envelope-from avg@freebsd.org) Message-ID: <4A6D7EBE.7080304@freebsd.org> Date: Mon, 27 Jul 2009 13:17:34 +0300 From: Andriy Gapon User-Agent: Thunderbird 2.0.0.22 (X11/20090630) MIME-Version: 1.0 To: Alfred Perlstein References: <20090726231534.GI21885@elvis.mu.org> In-Reply-To: <20090726231534.GI21885@elvis.mu.org> X-Enigmail-Version: 0.95.7 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: hackers@freebsd.org Subject: Re: distributed scm+freebsd svn? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jul 2009 10:33:00 -0000 on 27/07/2009 02:15 Alfred Perlstein said the following: > Hello hackers, > > Does anyone here use one of the distributed SCMs > to manage contributions to FreeBSD in an easy > manner? > > Any pointers to a setup you have? > > I thought "git" was supposed to make this easy, but > going over the docs leaves me with a lot of questions. > > I'm hoping to be able to basically: > sync into my "distributed repo". > allow a third party access to it. > easily commit upstream back into svn from a branch > in my distributed scm. I am using git for all of the above. It works quite satisfactory, but there is one major annoyance - git-svn doesn't understand svn mergeinfo. As such merges done in svn are not recorded in git. And MFC done in git (e.g. via cherry-pick) won't get propagated as svn merge on dcommit. Some info on my setup. I have 3 git repositories: - main one ("svn"), it is used for git-svn syncing and it tracks head, stable/7 and stable/6 svn branches; - "stable7", used for stable/7 development; - "head", used for head/current development; I think of "stable7" and "head" repositories as heavy-wait branches. In these repositories I have a master branch where I track svn through "svn" repository and I also have "light-weight" git branches for topic development. Typical work-cycle (e.g. for head): 1. develop in a topic branch of "head" repository 2. once development goal is achieved merge changes to master branch 3. rebase changes so that all commits are on top of all svn commits (and not interlaced with them) 4. further improve local commits, e.g. split, merge, change commit messages, etc 5. test and review 6. push changes to the corresponding branch of "svn" repository 7. dcommit in "svn" repository, changes go to svn This works quite well for head development and also for local changes that are not meant to go to svn. Unfortunately, as I said in the beginning, I have to use svn for doing "official" (svn) MFCs. Local MFCs via git always stay local. P.S. I am looking for a distributed solution (mercurial, bazaar?) that won't take away what I have with git, but would correctly work with svn mergeinfo. -- Andriy Gapon From owner-freebsd-hackers@FreeBSD.ORG Mon Jul 27 20:18:29 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A86431065697; Mon, 27 Jul 2009 20:18:29 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from hercules.mthelicon.com (hercules.mthelicon.com [IPv6:2001:49f0:2023::2]) by mx1.freebsd.org (Postfix) with ESMTP id 79AB48FC28; Mon, 27 Jul 2009 20:18:29 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from feathers.peganest.com (feathers.peganest.com [78.33.110.3]) (authenticated bits=0) by hercules.mthelicon.com (8.14.3/8.14.3) with ESMTP id n6RKIMY7075567 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Mon, 27 Jul 2009 20:18:24 GMT (envelope-from ken@mthelicon.com) From: Pegasus Mc Cleaft Organization: Feathers To: current@freebsd.org, hackers@freebsd.org Date: Mon, 27 Jul 2009 21:18:22 +0100 User-Agent: KMail/1.11.4 (FreeBSD/8.0-BETA2; KDE/4.2.4; amd64; ; ) MIME-Version: 1.0 Content-Type: Text/Plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200907272118.22188.ken@mthelicon.com> X-Spam-Status: No, score=-2.6 required=5.0 tests=BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on hercules.mthelicon.com Cc: Subject: Fatal trap 12 ever since r195851 on AMD64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jul 2009 20:18:30 -0000 Hello Current, I dont know if there is a current issue with other systems or if it is localized to me, but ever since > r195914 I am getting a fatal trap on boot. The process is always in the swapper and is always a 12. System is AMD64 Core2-Quad, 4 Gigs, gptzfsboot from a mirror with zraid's mounted for /usr, /usr/home, etc.. Is anyone else seeing this as well? FreeBSD 8.0-BETA2 #137 r195914: Mon Jul 27 19:10:17 BST 2009 Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x288 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff805c482d stack pointer = 0x28:0xffffffff81076c90 frame pointer = 0x28:0xffffffff81076cc0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (swapper) trap number = 12 panic: page fault cpuid = 0 Uptime: 1s Cannot dump. Device not defined or unavailable. Automatic reboot in 15 seconds - press a key on the console to abort Peg From owner-freebsd-hackers@FreeBSD.ORG Mon Jul 27 20:23:43 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BFF7E106566C; Mon, 27 Jul 2009 20:23:43 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from hercules.mthelicon.com (hercules.mthelicon.com [IPv6:2001:49f0:2023::2]) by mx1.freebsd.org (Postfix) with ESMTP id 8F1078FC08; Mon, 27 Jul 2009 20:23:43 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from feathers.peganest.com (feathers.peganest.com [78.33.110.3]) (authenticated bits=0) by hercules.mthelicon.com (8.14.3/8.14.3) with ESMTP id n6RKNbwU075617 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Mon, 27 Jul 2009 20:23:38 GMT (envelope-from ken@mthelicon.com) From: Pegasus Mc Cleaft Organization: Feathers To: freebsd-current@freebsd.org Date: Mon, 27 Jul 2009 21:23:36 +0100 User-Agent: KMail/1.11.4 (FreeBSD/8.0-BETA2; KDE/4.2.4; amd64; ; ) References: <200907272118.22188.ken@mthelicon.com> In-Reply-To: <200907272118.22188.ken@mthelicon.com> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200907272123.36633.ken@mthelicon.com> X-Spam-Status: No, score=-3.2 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on hercules.mthelicon.com Cc: hackers@freebsd.org, current@freebsd.org Subject: Re: Fatal trap 12 ever since r195851 on AMD64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jul 2009 20:23:44 -0000 ACK! Sorry.. I messed up the revision number in the message body... On Monday 27 July 2009 21:18:22 Pegasus Mc Cleaft wrote: > I dont know if there is a current issue with other systems or if it is > localized to me, but ever since > r195914 I am getting a fatal trap on ^r195815 Peg From owner-freebsd-hackers@FreeBSD.ORG Mon Jul 27 20:28:10 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 72EB010656A8; Mon, 27 Jul 2009 20:28:09 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from hercules.mthelicon.com (hercules.mthelicon.com [IPv6:2001:49f0:2023::2]) by mx1.freebsd.org (Postfix) with ESMTP id CB3188FC12; Mon, 27 Jul 2009 20:28:08 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from feathers.peganest.com (feathers.peganest.com [78.33.110.3]) (authenticated bits=0) by hercules.mthelicon.com (8.14.3/8.14.3) with ESMTP id n6RKS2Qj075690 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Mon, 27 Jul 2009 20:28:03 GMT (envelope-from ken@mthelicon.com) From: Pegasus Mc Cleaft Organization: Feathers To: freebsd-hackers@freebsd.org Date: Mon, 27 Jul 2009 21:28:01 +0100 User-Agent: KMail/1.11.4 (FreeBSD/8.0-BETA2; KDE/4.2.4; amd64; ; ) References: <200907272118.22188.ken@mthelicon.com> <200907272123.36633.ken@mthelicon.com> In-Reply-To: <200907272123.36633.ken@mthelicon.com> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200907272128.01928.ken@mthelicon.com> X-Spam-Status: No, score=-3.2 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on hercules.mthelicon.com Cc: hackers@freebsd.org, freebsd-current@freebsd.org, current@freebsd.org Subject: Re: Fatal trap 12 ever since r195851 on AMD64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jul 2009 20:28:17 -0000 Crud! Just shoot me! I'm very sorry about this.. Typing to fast and not checking.. On Monday 27 July 2009 21:23:36 Pegasus Mc Cleaft wrote: > ACK! Sorry.. I messed up the revision number in the message body... > > On Monday 27 July 2009 21:18:22 Pegasus Mc Cleaft wrote: > > I dont know if there is a current issue with other systems or if it is > > localized to me, but ever since > r195914 I am getting a fatal trap on > > ^r195815 ^r195851 (triple checked this time) From owner-freebsd-hackers@FreeBSD.ORG Mon Jul 27 20:28:10 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 72EB010656A8; Mon, 27 Jul 2009 20:28:09 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from hercules.mthelicon.com (hercules.mthelicon.com [IPv6:2001:49f0:2023::2]) by mx1.freebsd.org (Postfix) with ESMTP id CB3188FC12; Mon, 27 Jul 2009 20:28:08 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from feathers.peganest.com (feathers.peganest.com [78.33.110.3]) (authenticated bits=0) by hercules.mthelicon.com (8.14.3/8.14.3) with ESMTP id n6RKS2Qj075690 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Mon, 27 Jul 2009 20:28:03 GMT (envelope-from ken@mthelicon.com) From: Pegasus Mc Cleaft Organization: Feathers To: freebsd-hackers@freebsd.org Date: Mon, 27 Jul 2009 21:28:01 +0100 User-Agent: KMail/1.11.4 (FreeBSD/8.0-BETA2; KDE/4.2.4; amd64; ; ) References: <200907272118.22188.ken@mthelicon.com> <200907272123.36633.ken@mthelicon.com> In-Reply-To: <200907272123.36633.ken@mthelicon.com> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200907272128.01928.ken@mthelicon.com> X-Spam-Status: No, score=-3.2 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on hercules.mthelicon.com Cc: hackers@freebsd.org, freebsd-current@freebsd.org, current@freebsd.org Subject: Re: Fatal trap 12 ever since r195851 on AMD64 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jul 2009 20:28:17 -0000 Crud! Just shoot me! I'm very sorry about this.. Typing to fast and not checking.. On Monday 27 July 2009 21:23:36 Pegasus Mc Cleaft wrote: > ACK! Sorry.. I messed up the revision number in the message body... > > On Monday 27 July 2009 21:18:22 Pegasus Mc Cleaft wrote: > > I dont know if there is a current issue with other systems or if it is > > localized to me, but ever since > r195914 I am getting a fatal trap on > > ^r195815 ^r195851 (triple checked this time) From owner-freebsd-hackers@FreeBSD.ORG Mon Jul 27 21:59:44 2009 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 26009106566B for ; Mon, 27 Jul 2009 21:59:44 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.delphij.net (delphij-pt.tunnel.tserv2.fmt.ipv6.he.net [IPv6:2001:470:1f03:2c9::2]) by mx1.freebsd.org (Postfix) with ESMTP id BEFF38FC13 for ; Mon, 27 Jul 2009 21:59:43 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.geekcn.org (tarsier.geekcn.org [211.166.10.233]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by tarsier.delphij.net (Postfix) with ESMTPS id 007335C024 for ; Tue, 28 Jul 2009 05:59:42 +0800 (CST) Received: from localhost (tarsier.geekcn.org [211.166.10.233]) by tarsier.geekcn.org (Postfix) with ESMTP id CD1C855CD952; Tue, 28 Jul 2009 05:59:42 +0800 (CST) X-Virus-Scanned: amavisd-new at geekcn.org Received: from tarsier.geekcn.org ([211.166.10.233]) by localhost (mail.geekcn.org [211.166.10.233]) (amavisd-new, port 10024) with ESMTP id rY4XlBq3y-iY; Tue, 28 Jul 2009 05:58:49 +0800 (CST) Received: from charlie.delphij.net (adsl-76-237-33-62.dsl.pltn13.sbcglobal.net [76.237.33.62]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tarsier.geekcn.org (Postfix) with ESMTPSA id 1AF6155CD94F; Tue, 28 Jul 2009 05:58:42 +0800 (CST) DomainKey-Signature: a=rsa-sha1; s=default; d=delphij.net; c=nofws; q=dns; h=message-id:date:from:reply-to:organization:user-agent: mime-version:to:cc:subject:references:in-reply-to: x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=Y4Trgk7JaRvRS6dfX880eRnPVHq4CZidrMOIKH3lo10MMAXbz6ZCjFDFH/Xr4w95j rSHjK1ERZOMvbQaXFnz0g== Message-ID: <4A6E2301.8080308@delphij.net> Date: Mon, 27 Jul 2009 14:58:25 -0700 From: Xin LI Organization: The FreeBSD Project User-Agent: Thunderbird 2.0.0.22 (X11/20090701) MIME-Version: 1.0 To: =?ISO-8859-1?Q?G=E1bor_K=F6vesd=E1n?= References: <4A6C1508.7020309@kovesdan.org> In-Reply-To: <4A6C1508.7020309@kovesdan.org> X-Enigmail-Version: 0.95.7 OpenPGP: id=18EDEBA0; url=http://www.delphij.net/delphij.asc Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit Cc: hackers@FreeBSD.org Subject: Re: bsd.lib.mk question X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: d@delphij.net List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jul 2009 21:59:44 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Gábor Kövesdán wrote: > Hi, > > I wonder if there's a conventional way of building _only_ shared > libraries using bsd.lib.mk. At default, it builds static, shared and > profiled libraries, which is a waste of time because I only need shared > libraries, which I use as on-demand loadable modules. Adjusting _LIBS > after the inclusion of bsd.lib.mk doesn't help and there are no knobs to > control the behaviour. What should I do? If you define LIB= (or, not define it at all), and define both SHLIB and SHLIB_MAJOR, then only shared library is being built and installed. Example: LIB= SHLIB= test SHLIB_MAJOR= 0 Would build libtest.so.0, but no libtest.a nor libtest_p.a. Cheers, - -- Xin LI http://www.delphij.net/ FreeBSD - The Power to Serve! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.12 (FreeBSD) iEYEARECAAYFAkpuIwEACgkQi+vbBBjt66C50gCgul420W4siZi3VBA2ZnHxNz4J UesAoMIoSzqF0rE6TzvZ5/D0vyjbTc71 =Y5xW -----END PGP SIGNATURE----- From owner-freebsd-hackers@FreeBSD.ORG Tue Jul 28 02:42:17 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4A9481065728 for ; Tue, 28 Jul 2009 02:42:17 +0000 (UTC) (envelope-from dougb@FreeBSD.org) Received: from mail2.fluidhosting.com (mx21.fluidhosting.com [204.14.89.4]) by mx1.freebsd.org (Postfix) with ESMTP id CB1358FC15 for ; Tue, 28 Jul 2009 02:42:16 +0000 (UTC) (envelope-from dougb@FreeBSD.org) Received: (qmail 3019 invoked by uid 399); 28 Jul 2009 02:15:33 -0000 Received: from localhost (HELO ?192.168.0.100?) (dougb@dougbarton.us@127.0.0.1) by localhost with ESMTPAM; 28 Jul 2009 02:15:33 -0000 X-Originating-IP: 127.0.0.1 X-Sender: dougb@dougbarton.us Date: Mon, 27 Jul 2009 19:15:31 -0700 (PDT) From: Doug Barton To: "Aryeh M. Friedman" In-Reply-To: <4A47E2B3.8040103@gmail.com> Message-ID: References: <4A47CC07.1080506@gmail.com> <20090628170140.7169d64b@bhuda.mired.org> <4A47E2B3.8040103@gmail.com> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) X-message-flag: Outlook -- Not just for spreading viruses anymore! X-OpenPGP-Key-ID: 0xD5B2F0FB Organization: http://www.FreeBSD.org/ MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-hackers@freebsd.org, Mike Meyer Subject: Re: dynamic and static DNS in the samie name server X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Jul 2009 02:42:17 -0000 On Sun, 28 Jun 2009, Aryeh M. Friedman wrote: > Thanks for attempting to help me find the right place to post but in my > experience -questions@ tends to be about "standard" usage not "non-standard" > usage questions thus I asked here... yes I am using BIND (the base system > one) Actually you're both wrong. :) If this were a FreeBSD question then -questions would indeed have been the right list, but it's actually a BIND question which means it belongs on bind-users@isc.org. Good luck, Doug From owner-freebsd-hackers@FreeBSD.ORG Tue Jul 28 06:08:23 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 227041065670; Tue, 28 Jul 2009 06:08:23 +0000 (UTC) (envelope-from fullermd@over-yonder.net) Received: from thyme.infocus-llc.com (server.infocus-llc.com [206.156.254.44]) by mx1.freebsd.org (Postfix) with ESMTP id ECB798FC08; Tue, 28 Jul 2009 06:08:22 +0000 (UTC) (envelope-from fullermd@over-yonder.net) Received: from draco.over-yonder.net (c-75-65-240-232.hsd1.ms.comcast.net [75.65.240.232]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by thyme.infocus-llc.com (Postfix) with ESMTPSA id 0C5E537B624; Tue, 28 Jul 2009 00:48:51 -0500 (CDT) Received: by draco.over-yonder.net (Postfix, from userid 100) id 2B28C61C41; Tue, 28 Jul 2009 00:48:50 -0500 (CDT) Date: Tue, 28 Jul 2009 00:48:50 -0500 From: "Matthew D. Fuller" To: Andriy Gapon Message-ID: <20090728054850.GB76759@over-yonder.net> References: <20090726231534.GI21885@elvis.mu.org> <4A6D7EBE.7080304@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4A6D7EBE.7080304@freebsd.org> X-Editor: vi X-OS: FreeBSD User-Agent: Mutt/1.5.20-fullermd.4 (2009-06-14) X-Virus-Scanned: clamav-milter 0.95.2 at thyme.infocus-llc.com X-Virus-Status: Clean Cc: hackers@freebsd.org Subject: Re: distributed scm+freebsd svn? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Jul 2009 06:08:23 -0000 On Mon, Jul 27, 2009 at 01:17:34PM +0300 I heard the voice of Andriy Gapon, and lo! it spake thus: > > P.S. I am looking for a distributed solution (mercurial, bazaar?) > that won't take away what I have with git, but would correctly work > with svn mergeinfo. I use bazaar, but I don't use the svn integration. AIUI, bzr-svn will _write_ mergeinfo records for merges it creates and pushes into svn, but I don't know whether it reads existing ones. And a great deal of the existing mergeinfo in the BSD repo will be for cherrypicked revs, which aren't recorded anyway, so I don't know how much it would really gain. Vendor branch imports, maybe, but MFC's are right out. -- Matthew Fuller (MF4839) | fullermd@over-yonder.net Systems/Network Administrator | http://www.over-yonder.net/~fullermd/ On the Internet, nobody can hear you scream. From owner-freebsd-hackers@FreeBSD.ORG Tue Jul 28 16:33:00 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F34D5106564A for ; Tue, 28 Jul 2009 16:32:59 +0000 (UTC) (envelope-from simon@comsys.ntu-kpi.kiev.ua) Received: from comsys.ntu-kpi.kiev.ua (comsys.ntu-kpi.kiev.ua [77.47.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id 6C3A98FC0A for ; Tue, 28 Jul 2009 16:32:56 +0000 (UTC) (envelope-from simon@comsys.ntu-kpi.kiev.ua) Received: from pm513-1.comsys.ntu-kpi.kiev.ua (pm513-1.comsys.ntu-kpi.kiev.ua [10.18.52.101]) (authenticated bits=0) by comsys.ntu-kpi.kiev.ua (8.13.7/8.13.7) with ESMTP id n6SFtqYD080117 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 28 Jul 2009 18:55:52 +0300 (EEST) Received: by pm513-1.comsys.ntu-kpi.kiev.ua (Postfix, from userid 1001) id 7092F1CC39; Tue, 28 Jul 2009 18:55:38 +0300 (EEST) Date: Tue, 28 Jul 2009 18:55:38 +0300 From: Andrey Simonenko To: Andrew Brampton Message-ID: <20090728155538.GA77306@pm513-1.comsys.ntu-kpi.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.20 (2009-06-14) X-Virus-Scanned: ClamAV version 0.93.1, clamav-milter version 0.93.1 on comsys.ntu-kpi.kiev.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.1.4 X-Spam-Checker-Version: SpamAssassin 3.1.4 (2006-07-25) on comsys.ntu-kpi.kiev.ua Cc: freebsd-hackers@freebsd.org Subject: Re: vm_map_protect / pmap_protect Can't lower protection X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Jul 2009 16:33:00 -0000 Hello Andrew, On Mon, Jul 20, 2009 at 04:14:02PM +0100, Andrew Brampton wrote: > However, memguard_unguard doesn't work correctly. It first calls > vm_map_protect with a read-write flag. > vm_map_protect correctly updates the vm_map_entry, and then calls > pmap_protect to set the actual pte. > pmap_protect is lazy and notices that we are reducing the protection > on the page and therefore does nothing. It assumes that later that a > page fault will occur, call vm_fault, and then fix up the pte then. As I remember, pmap_protect() is used for removing permissions, it cannot be used (even in initial versions of pmap code) for lowering permissions. pmap_enter() can be used to lower permissions, this is even written in its comments. From owner-freebsd-hackers@FreeBSD.ORG Wed Jul 29 00:34:01 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6A1C61065675 for ; Wed, 29 Jul 2009 00:34:01 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from shell.rawbw.com (shell.rawbw.com [198.144.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id 3E7B98FC18 for ; Wed, 29 Jul 2009 00:34:01 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from eagle.syrec.org (c-24-6-210-150.hsd1.ca.comcast.net [24.6.210.150]) (authenticated bits=0) by shell.rawbw.com (8.13.6/8.13.6) with ESMTP id n6T0Y0i2015034 for ; Tue, 28 Jul 2009 17:34:00 -0700 (PDT) Message-ID: <4A6F98F7.2080304@rawbw.com> Date: Tue, 28 Jul 2009 17:33:59 -0700 From: Yuri User-Agent: Thunderbird 2.0.0.22 (X11/20090724) MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: How to profile the disk io performed through mmaps? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: yuri@rawbw.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Jul 2009 00:34:02 -0000 I have a file mmapped to memory area and partially modified this way. Is there a way to know what are the actual disk writes/reads done on the file in this scenario? Would kqueue events on file's vnode be triggered for mmapped writes? Yuri From owner-freebsd-hackers@FreeBSD.ORG Wed Jul 29 08:49:47 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 075611065673 for ; Wed, 29 Jul 2009 08:49:47 +0000 (UTC) (envelope-from stas@FreeBSD.org) Received: from mx0.deglitch.com (backbone.deglitch.com [IPv6:2001:16d8:fffb:4::abba]) by mx1.freebsd.org (Postfix) with ESMTP id AEDA78FC15 for ; Wed, 29 Jul 2009 08:49:46 +0000 (UTC) (envelope-from stas@FreeBSD.org) Received: from stasss.yandex.ru (dhcp170-227-red.yandex.net [95.108.170.227]) by mx0.deglitch.com (Postfix) with ESMTPSA id 0A8908FC27; Wed, 29 Jul 2009 12:49:45 +0400 (MSD) Date: Wed, 29 Jul 2009 12:49:39 +0400 From: Stanislav Sedov To: yuri@rawbw.com Message-Id: <20090729124939.0082e1d6.stas@FreeBSD.org> In-Reply-To: <4A6F98F7.2080304@rawbw.com> References: <4A6F98F7.2080304@rawbw.com> Organization: The FreeBSD Project X-Mailer: carrier-pigeon Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA1"; boundary="Signature=_Wed__29_Jul_2009_12_49_39_+0400_0NgXkESJ9dBJJAZe" Cc: freebsd-hackers@freebsd.org Subject: Re: How to profile the disk io performed through mmaps? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Jul 2009 08:49:47 -0000 --Signature=_Wed__29_Jul_2009_12_49_39_+0400_0NgXkESJ9dBJJAZe Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, 28 Jul 2009 17:33:59 -0700 Yuri mentioned: > I have a file mmapped to memory area and partially modified this way. >=20 > Is there a way to know what are the actual disk writes/reads done on the= =20 > file in this scenario? > Would kqueue events on file's vnode be triggered for mmapped writes? Yes, it should be possible to monitor files written to via mmapped region with EVFILT_VNODE kevents. Please note, however, that changes to mmapped region may be propagated to the files not immediately depending on the region attributes. --=20 Stanislav Sedov ST4096-RIPE --Signature=_Wed__29_Jul_2009_12_49_39_+0400_0NgXkESJ9dBJJAZe Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- iQIcBAEBAgAGBQJKcA0oAAoJEKN82nOYvCd03pAP/2DGZOQuXZEETVt2Lp/+G8AS iV5aE5xWi6dtQ2/e5Ybdjc6BQ4XROyU4xiQOOmiuSsKjlnv6o49pO+GHtXbA6NJI y0+gdsS5vbleylSX4PHBrqLmkZN2NpHdkyHsjXp5spbRkNmtu7gDR8lKPQPFL920 Cmv+VspHt5Vpbevm6OApmhYl/tNL9QlmdqOuQC504QYEFdKoMzHGuoKmJBQg+dNy mVFe30YM/snaI9n1bFkb8K814T6+1vR+ou5RP47f8MlZsIVWJfa7qKzZmVTQC/CO pHd20RHdZjnpo0W/gXF3/Z5yGbwh18F2cX0CxJUJIhyoI5Efz62cO4lSFsX3ECBU jdLi6GMEFPALEUCmrtmAiwgYf1nxv6dxCl9xDARYs+Bi+hOLnjIkrMPCsvH4KkfP AaTSWIWXn6CnygWAYJjpTTvH5S1Mt8nUeQY9sc8Z/rjg7fWW1cP9g1i7KcGBXfzj dHjqIY/oqs6c7zGiI7FoR6TzSVS2R/3FFSVUjWsDJf9aEQFgPoq34376sfGT8NnQ CywHbLWvwanVyzu1QJtpG6Pdh8RXB0PwTE/hTdr64A4F809cWyEJVjJzADylNgAD KLi7PNe1Re+Nc8s/Y4OyuEMklWDtCECRIj5NicEqdg/r3BbDR5YZC12DrTMKr1Yy nb8qPr7/TB41WA86m0la =eAnC -----END PGP SIGNATURE----- --Signature=_Wed__29_Jul_2009_12_49_39_+0400_0NgXkESJ9dBJJAZe-- From owner-freebsd-hackers@FreeBSD.ORG Wed Jul 29 16:49:14 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C4ABC106567A for ; Wed, 29 Jul 2009 16:49:14 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from shell.rawbw.com (shell.rawbw.com [198.144.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id 950588FC17 for ; Wed, 29 Jul 2009 16:49:14 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from eagle.syrec.org (c-24-6-210-150.hsd1.ca.comcast.net [24.6.210.150]) (authenticated bits=0) by shell.rawbw.com (8.13.6/8.13.6) with ESMTP id n6TGnDXs096471; Wed, 29 Jul 2009 09:49:13 -0700 (PDT) Message-ID: <4A707D88.7090703@rawbw.com> Date: Wed, 29 Jul 2009 09:49:12 -0700 From: Yuri User-Agent: Thunderbird 2.0.0.22 (X11/20090724) MIME-Version: 1.0 To: Stanislav Sedov References: <4A6F98F7.2080304@rawbw.com> <20090729124939.0082e1d6.stas@FreeBSD.org> In-Reply-To: <20090729124939.0082e1d6.stas@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: How to profile the disk io performed through mmaps? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: yuri@rawbw.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Jul 2009 16:49:15 -0000 Stanislav Sedov wrote: > Yes, it should be possible to monitor files written to via mmapped region > with EVFILT_VNODE kevents. Please note, however, that changes to mmapped > region may be propagated to the files not immediately depending on the > region attributes. > But is there any command line utility that wraps kqueue functionality or I have to write my own code to do this? Yuri From owner-freebsd-hackers@FreeBSD.ORG Wed Jul 29 17:23:18 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 86DDF1065694; Wed, 29 Jul 2009 17:23:18 +0000 (UTC) (envelope-from oliver.pntr@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.156]) by mx1.freebsd.org (Postfix) with ESMTP id E8D2D8FC2E; Wed, 29 Jul 2009 17:23:17 +0000 (UTC) (envelope-from oliver.pntr@gmail.com) Received: by fg-out-1718.google.com with SMTP id 13so287864fge.12 for ; Wed, 29 Jul 2009 10:23:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=Z8jtcgvAK8cYAzRfyQwfZiViQuUDY+ovNRNQSLFMG5k=; b=gqwKqGd2PcVKHR0wsrPUXoap8RthPxu2ax32ooCk4cIy9DntxFku8N70xOMofNM2cQ RPgM6YfcZbM1po9uP4d5if6xs9r7Euu7Q+5ixwochoCWQQqDfu/Com5LiK45LQCTVS+q OgCmhb8XFWc4lp1TI3fwp9kgrBDlg2GC0fVZs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=kwkgaCCL4hhBLzbgcHubfwVQ1rdoSmGMu/upGwUOowxI4vPU/V2joOww6uktUwSkmI k7nSrpEP4it0LQ3rb/7OWvJM6qJ2t4y3rspA0l1jYfCJtaN4xGZ7nwOWWUmIY1R966Ni 8Y4qNqsUsf1Petxg4vUzQ3VXg3KSgshG3vX+o= MIME-Version: 1.0 Received: by 10.86.28.2 with SMTP id b2mr25003fgb.40.1248886342142; Wed, 29 Jul 2009 09:52:22 -0700 (PDT) Date: Wed, 29 Jul 2009 18:52:22 +0200 Message-ID: <6101e8c40907290952p4bc65ebh4e039063130dfcf0@mail.gmail.com> From: Oliver Pinter To: ports@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: hackers@freebsd.org Subject: breaked kde3 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Jul 2009 17:23:19 -0000 [New Thread 0x800a020b0 (LWP 100411)] [Switching to Thread 0x800a020b0 (LWP 100411)] [KCrash handler] #6 0x000000080ca93364 in jpeg_CreateDecompress () from /usr/local/lib/compat/pkg/libjpeg.so.9 #7 0x0000000807744490 in read_jpeg_image () from /usr/local/lib/libqt-mt.so.3 #8 0x0000000807514890 in QImageIO::read () from /usr/local/lib/libqt-mt.so.3 #9 0x0000000807514fc3 in QImage::load () from /usr/local/lib/libqt-mt.so.3 #10 0x000000080d449ac1 in KBackgroundRenderer::doWallpaper () from /usr/local/lib/libkdeinit_kdesktop.so #11 0x000000080d44a6fb in KBackgroundRenderer::render () from /usr/local/lib/libkdeinit_kdesktop.so #12 0x000000080d44a9e5 in KBackgroundRenderer::qt_invoke () from /usr/local/lib/libkdeinit_kdesktop.so #13 0x000000080753a16e in QObject::activate_signal () from /usr/local/lib/libqt-mt.so.3 #14 0x000000080753adb9 in QObject::activate_signal () from /usr/local/lib/libqt-mt.so.3 #15 0x00000008075560ca in QTimer::event () from /usr/local/lib/libqt-mt.so.3 #16 0x00000008074ec149 in QApplication::internalNotify () from /usr/local/lib/libqt-mt.so.3 #17 0x00000008074ecb11 in QApplication::notify () from /usr/local/lib/libqt-mt.so.3 #18 0x000000080b5a62c6 in KApplication::notify () from /usr/local/lib/libkdecore.so.6 #19 0x00000008074e386f in QEventLoop::activateTimers () from /usr/local/lib/libqt-mt.so.3 #20 0x00000008074a992d in QEventLoop::processEvents () from /usr/local/lib/libqt-mt.so.3 #21 0x00000008074ff24a in QEventLoop::enterLoop () from /usr/local/lib/libqt-mt.so.3 #22 0x00000008074ff12e in QEventLoop::exec () from /usr/local/lib/libqt-mt.so.3 #23 0x000000080d40d0e1 in kdemain () from /usr/local/lib/libkdeinit_kdesktop.so #24 0x00000000004079d0 in execpath_avoid_loops () #25 0x00000000004081a7 in execpath_avoid_loops () #26 0x00000000004086f5 in execpath_avoid_loops () #27 0x0000000000408f2b in main () From owner-freebsd-hackers@FreeBSD.ORG Wed Jul 29 19:29:49 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5B12C106566C; Wed, 29 Jul 2009 19:29:49 +0000 (UTC) (envelope-from mail@0xabadba.be) Received: from mail-qy0-f191.google.com (mail-qy0-f191.google.com [209.85.221.191]) by mx1.freebsd.org (Postfix) with ESMTP id 0B2B68FC0C; Wed, 29 Jul 2009 19:29:48 +0000 (UTC) (envelope-from mail@0xabadba.be) Received: by qyk29 with SMTP id 29so1377090qyk.3 for ; Wed, 29 Jul 2009 12:29:48 -0700 (PDT) MIME-Version: 1.0 Received: by 10.220.100.194 with SMTP id z2mr275660vcn.38.1248894276221; Wed, 29 Jul 2009 12:04:36 -0700 (PDT) X-Originating-IP: [209.6.245.2] In-Reply-To: <20090728054850.GB76759@over-yonder.net> References: <20090726231534.GI21885@elvis.mu.org> <4A6D7EBE.7080304@freebsd.org> <20090728054850.GB76759@over-yonder.net> From: james toy Date: Wed, 29 Jul 2009 15:04:16 -0400 Message-ID: <61c92c7d0907291204g730020d6jb7237e7db2b9aa79@mail.gmail.com> To: "Matthew D. Fuller" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: hackers@freebsd.org, Andriy Gapon Subject: Re: distributed scm+freebsd svn? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Jul 2009 19:29:49 -0000 Hello, I think the most important thing (other than compatibility) is that you use something that you work well with. Sure a lot of these VCS systems have advantages over the other; however, space is cheap -- git packs vs. mercurials way of packing is a minor detail compared to how useful the vcs is to you. That said I've used git, hg, and svn for freebsd development and use them extensively all over. In fact I've just finished a port of hg and hg-git (allows you to use hg to maintain a git repository) and find that its a very nice way to control all of my repositories with one program. I think the only real way to do development that you plan to try to merge is with freebsd-subversion; however, I'm sure there are people with varying views of this sentiment. Both git and hg have svn integration, so it really is up to you -- and if some functionality is missing -- you can always add it ;) have a good day and respectfully, james++ On Tue, Jul 28, 2009 at 01:48, Matthew D. Fuller wrote: > On Mon, Jul 27, 2009 at 01:17:34PM +0300 I heard the voice of > Andriy Gapon, and lo! it spake thus: >> >> P.S. I am looking for a distributed solution (mercurial, bazaar?) >> that won't take away what I have with git, but would correctly work >> with svn mergeinfo. > > I use bazaar, but I don't use the svn integration. =C2=A0AIUI, bzr-svn wi= ll > _write_ mergeinfo records for merges it creates and pushes into svn, > but I don't know whether it reads existing ones. =C2=A0And a great deal o= f > the existing mergeinfo in the BSD repo will be for cherrypicked revs, > which aren't recorded anyway, so I don't know how much it would really > gain. =C2=A0Vendor branch imports, maybe, but MFC's are right out. > > > -- > Matthew Fuller =C2=A0 =C2=A0 (MF4839) =C2=A0 | =C2=A0fullermd@over-yonder= .net > Systems/Network Administrator | =C2=A0http://www.over-yonder.net/~fullerm= d/ > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 On the Internet, nobody can hear you s= cream. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org= " > From owner-freebsd-hackers@FreeBSD.ORG Wed Jul 29 20:05:10 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 43B591065672; Wed, 29 Jul 2009 20:05:10 +0000 (UTC) (envelope-from stas@FreeBSD.org) Received: from mx0.deglitch.com (backbone.deglitch.com [IPv6:2001:16d8:fffb:4::abba]) by mx1.freebsd.org (Postfix) with ESMTP id E7B608FC12; Wed, 29 Jul 2009 20:05:09 +0000 (UTC) (envelope-from stas@FreeBSD.org) Received: from orion.SpringDaemons.com (unknown [77.232.3.143]) by mx0.deglitch.com (Postfix) with ESMTPA id 2E22D8FC2B; Thu, 30 Jul 2009 00:05:08 +0400 (MSD) Received: from orion (localhost [127.0.0.1]) by orion.SpringDaemons.com (Postfix) with SMTP id 3BA8839C4F; Thu, 30 Jul 2009 00:06:09 +0400 (MSD) Date: Thu, 30 Jul 2009 00:06:09 +0400 From: Stanislav Sedov To: yuri@rawbw.com Message-Id: <20090730000609.c9a1bea2.stas@FreeBSD.org> In-Reply-To: <4A707D88.7090703@rawbw.com> References: <4A6F98F7.2080304@rawbw.com> <20090729124939.0082e1d6.stas@FreeBSD.org> <4A707D88.7090703@rawbw.com> Organization: The FreeBSD Project X-Mailer: carrier-pigeon Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA1"; boundary="Signature=_Thu__30_Jul_2009_00_06_09_+0400_bB1CRnDO9lVfkJcc" Cc: Stanislav Sedov , freebsd-hackers@freebsd.org Subject: Re: How to profile the disk io performed through mmaps? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Jul 2009 20:05:10 -0000 --Signature=_Thu__30_Jul_2009_00_06_09_+0400_bB1CRnDO9lVfkJcc Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, 29 Jul 2009 09:49:12 -0700 Yuri mentioned: > Stanislav Sedov wrote: > > Yes, it should be possible to monitor files written to via mmapped regi= on > > with EVFILT_VNODE kevents. Please note, however, that changes to mmapp= ed > > region may be propagated to the files not immediately depending on the > > region attributes. > > =20 >=20 >=20 > But is there any command line utility that wraps kqueue functionality or= =20 > I have > to write my own code to do this? >=20 I'm not sure, but FAM should be able to detect these. gamin, for instance, uses kqueue to monitor events. You may be willing to try it. --=20 Stanislav Sedov ST4096-RIPE --Signature=_Thu__30_Jul_2009_00_06_09_+0400_bB1CRnDO9lVfkJcc Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- iQIcBAEBAgAGBQJKcKuxAAoJEKN82nOYvCd0jqoQAJNnjQC4in2T8IZ2lmuUIeWT SVgJzn3rmKLZsoOIRwwGdhZ0NoQjSws4LRyE6wKwkgpEgwQgUpfqW7fMEfB16ew/ W7mjbvC1c5+fvL3MfVKCrYdq1g9/CzfBMRJc0CicJLmG3Dvz4Fzd1NPmwDcfAIS8 K9HPDnfWz1RkLjSw2vvSuGdcFFxoqY0gnUv5D3WFdbFVfF3yxe2e8ZyvC/K2D0Db tT3aSQkCLPtvVNZI7FinAYspkPJJBx4Xg9A5vr9YVDSLcPa27VYtfvULoez1vZ4I uvxyWtamaPvJD1Sy92nAXqO/nFntNeuj5RiYoSbBkXLNskpbmJF2fx89BICesMzx 8BLkwVy2qfDPLrz2CwUPNkXwaYJke5yUt7nS+oTU37LuxR9NXfwscAu+a75LQXKn C3a5vnEl8EYUyBzmuzCt7OGqTfK+TPMXmH8DuFfRWT3LlW6CKp4Keoauoa4bvLee YzaPnwwEN+mKeS82Qi0Ue2kMr+UzaUGyyyyPQ3pyIAlBVFwNrs6+Ua8Y8RcnOYRq MXfJsSNXn0wBGylHffzS38GN5JiboKkhL8DBOYIdTigKX4bt8wiJ4VbH7zB3al8Y i+QqfvXzRbaqHMGmUOAnDEQapSQmvtdoEAfU0Tjm0qR75ERuHlAoZ+42+IIKFMll oI2GXy5RzhSWAnwuix/D =xaFQ -----END PGP SIGNATURE----- --Signature=_Thu__30_Jul_2009_00_06_09_+0400_bB1CRnDO9lVfkJcc-- From owner-freebsd-hackers@FreeBSD.ORG Wed Jul 29 20:39:20 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 14075106566B; Wed, 29 Jul 2009 20:39:20 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from shell.rawbw.com (shell.rawbw.com [198.144.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id 005EF8FC16; Wed, 29 Jul 2009 20:39:19 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from eagle.syrec.org (c-24-6-210-150.hsd1.ca.comcast.net [24.6.210.150]) (authenticated bits=0) by shell.rawbw.com (8.13.6/8.13.6) with ESMTP id n6TKdITq054150; Wed, 29 Jul 2009 13:39:18 -0700 (PDT) Message-ID: <4A70B375.1050900@rawbw.com> Date: Wed, 29 Jul 2009 13:39:17 -0700 From: Yuri User-Agent: Thunderbird 2.0.0.22 (X11/20090724) MIME-Version: 1.0 To: Stanislav Sedov References: <4A6F98F7.2080304@rawbw.com> <20090729124939.0082e1d6.stas@FreeBSD.org> In-Reply-To: <20090729124939.0082e1d6.stas@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: How to profile the disk io performed through mmaps? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: yuri@rawbw.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Jul 2009 20:39:20 -0000 Stanislav Sedov wrote: > Yes, it should be possible to monitor files written to via mmapped region > with EVFILT_VNODE kevents. Please note, however, that changes to mmapped > region may be propagated to the files not immediately depending on the > region attributes. > From kqueue(2) I don't see how to get details (offsets/sizes) of write/extend events on the file. When I ask filter EVFILT_VNODE to monitor events NOTE_EXTEND and NOTE_WRITE kevent returns when any of them occur and it even ors NOTE_EXTEND and NOTE_WRITE flags in the output kevent structure. It gives no further details. So my question is largely open: how to monitor actual reads/writes on the file? Yuri From owner-freebsd-hackers@FreeBSD.ORG Sat Aug 1 16:06:45 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9CD96106566B for ; Sat, 1 Aug 2009 16:06:45 +0000 (UTC) (envelope-from linda.messerschmidt@gmail.com) Received: from mail-qy0-f191.google.com (mail-qy0-f191.google.com [209.85.221.191]) by mx1.freebsd.org (Postfix) with ESMTP id 56B9E8FC20 for ; Sat, 1 Aug 2009 16:06:44 +0000 (UTC) (envelope-from linda.messerschmidt@gmail.com) Received: by qyk29 with SMTP id 29so3477014qyk.3 for ; Sat, 01 Aug 2009 09:06:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type:content-transfer-encoding; bh=yYJfpj8Mru8Q+FHDqk5yq3w7sMAYoJHTf+ikwI/RwaQ=; b=SSRDp6bAK4Ix/Llfg0Ie3IGiHMIG9ko2DIlzCwH9zSIE0wqcrcSKxO5dhRsQKl13sC f6HXH5PqZtQPa9Md9vFmgwdHGXiS655Lpk4vMc+SoLFVQ+5x7R2zZONUTaSj5XbQ46ml GqRGQLkBR+8BirGHC9OdTmGZJIIY6db6nGo8Y= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type :content-transfer-encoding; b=V+z1yj0UK1mInQrv/gG6TNQkezpmqqOGY4PYFW21eK09kEw+zLxbjlQxKpfuzfa+Vp qJ1PpFmiMPlIIFCM2PT3z66bDegoGL4/uC6slqVzrTA/Geh8akOvFkLtQ1PE0xtfUEoI 2tbfpW8WFpLJcqgGDjz+RUKYCJn4ea0b90BGw= MIME-Version: 1.0 Received: by 10.229.99.208 with SMTP id v16mr700722qcn.75.1249141279143; Sat, 01 Aug 2009 08:41:19 -0700 (PDT) Date: Sat, 1 Aug 2009 11:41:19 -0400 Message-ID: <237c27100908010841g5abd3183w479121b2ba7b0c91@mail.gmail.com> From: Linda Messerschmidt To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Subject: Where have all the vnodes gone? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Aug 2009 16:06:46 -0000 (Reposted from freebsd-questions due to no replies.) With the last few releases, I've noticed a distinct trend toward disappearing vnodes on one of the machines I look after. This machine isn't doing a whole lot. It runs a couple of small web sites, and once an hour it rsync's some files from one NFS mount to another, but the rsync doesn't stay running; it restarts every hour and runs for 10-15 minutes. I set it to log the number of vnodes every ten minutes and this is what I got: 00:47:59 vfs.numvnodes: 39337 00:57:59 vfs.numvnodes: 40568 01:07:59 vfs.numvnodes: 44554 01:17:59 vfs.numvnodes: 52141 01:27:59 vfs.numvnodes: 55713 01:37:59 vfs.numvnodes: 58643 01:47:59 vfs.numvnodes: 60792 01:57:59 vfs.numvnodes: 67130 02:07:59 vfs.numvnodes: 76035 02:17:59 vfs.numvnodes: 84349 02:27:59 vfs.numvnodes: 92187 02:37:59 vfs.numvnodes: 98114 02:47:59 vfs.numvnodes: 116854 02:57:59 vfs.numvnodes: 124842 03:07:59 vfs.numvnodes: 164173 03:17:59 vfs.numvnodes: 172257 03:27:59 vfs.numvnodes: 178388 03:37:59 vfs.numvnodes: 183066 03:47:59 vfs.numvnodes: 190092 03:57:59 vfs.numvnodes: 198322 04:07:59 vfs.numvnodes: 204598 04:17:59 vfs.numvnodes: 208311 04:27:59 vfs.numvnodes: 214207 04:37:59 vfs.numvnodes: 221028 04:47:59 vfs.numvnodes: 227792 04:57:59 vfs.numvnodes: 233214 05:07:59 vfs.numvnodes: 240112 05:17:59 vfs.numvnodes: 247572 05:27:59 vfs.numvnodes: 256090 05:37:59 vfs.numvnodes: 262720 05:47:59 vfs.numvnodes: 269755 05:57:59 vfs.numvnodes: 274986 06:07:59 vfs.numvnodes: 279879 06:17:59 vfs.numvnodes: 287039 06:27:59 vfs.numvnodes: 291984 06:37:59 vfs.numvnodes: 294267 06:47:59 vfs.numvnodes: 296658 06:57:59 vfs.numvnodes: 299086 07:07:59 vfs.numvnodes: 301825 07:17:59 vfs.numvnodes: 309060 07:27:59 vfs.numvnodes: 312955 07:37:59 vfs.numvnodes: 317400 07:47:59 vfs.numvnodes: 320047 At that point the machine crashed with: panic: kmem_malloc(16384): kmem_map too small: 334745600 total allocated If I don't tune kern.maxvnodes up to the point where it panics, then eventually it runs out of vnodes and all sorts of stuff gets stuck in vlruwk. The machine in question is running 7.2-RELEASE-p3, but I already upgraded it from 7.1 trying to get this to go away, so it's a problem that's been around for awhile. My guess is that they're leaking in the kernel somewhere because of the rsync, because there's just not much else going on, but unless I can figure out how many vnodes are being used on a per-process basis, I can't make any headway on proving or disproving that. I do know that according to fstat, there are only 1000-1500 descriptors open at any given time, and kern.openfiles ranges 250-500. So I'm just mystified what the other 300000+ could be. Is there any way to figure out where all these vnodes are going? TIA for any advice! From owner-freebsd-hackers@FreeBSD.ORG Sat Aug 1 17:37:24 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 443C6106566C for ; Sat, 1 Aug 2009 17:37:24 +0000 (UTC) (envelope-from asmrookie@gmail.com) Received: from mail-fx0-f210.google.com (mail-fx0-f210.google.com [209.85.220.210]) by mx1.freebsd.org (Postfix) with ESMTP id BFDD78FC08 for ; Sat, 1 Aug 2009 17:37:23 +0000 (UTC) (envelope-from asmrookie@gmail.com) Received: by fxm6 with SMTP id 6so649638fxm.43 for ; Sat, 01 Aug 2009 10:37:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=XkfxmeUkLUabi1SXFGXAWt/bF2h1fCZlrEDiAS6s/LU=; b=hM93WEbsrDQs+iJFw+2cFnIdBZjRYulJgqnTdF8rf9CvK8ytldRmP84qCKloHbFPRg dTMMYAK++ioq74tNpHBbM/xMTaClNrC0iE3KCGZYRriagQL4vh+KyFV/EEqixN/30zKO ez0XUHBQCJADoVI23J3eLw1K8+HVLhx2BKmjo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=AjCm4iQsif/44tKE6X6vdQhKOYVvrCUu3V3RsOqUa9W7BpR4KlhWksgPovKcZ0wytK zXxjE55frT9gOX2oU/g325sGoC1/NNRC2QAErk2lp9hHi1jqS4HlIYrnTbIsB1rJ8c7z CG0KF4BoLhsdhne0Yom4Q8vsgXUC1JimYwNZ4= MIME-Version: 1.0 Sender: asmrookie@gmail.com Received: by 10.223.124.147 with SMTP id u19mr2000271far.28.1249146850759; Sat, 01 Aug 2009 10:14:10 -0700 (PDT) In-Reply-To: <237c27100908010841g5abd3183w479121b2ba7b0c91@mail.gmail.com> References: <237c27100908010841g5abd3183w479121b2ba7b0c91@mail.gmail.com> Date: Sat, 1 Aug 2009 19:14:10 +0200 X-Google-Sender-Auth: ebb0fd75c9b3a52b Message-ID: <3bbf2fe10908011014r2fda9245xc7c5f71fcc544d10@mail.gmail.com> From: Attilio Rao To: Linda Messerschmidt Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: Where have all the vnodes gone? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Aug 2009 17:37:24 -0000 2009/8/1 Linda Messerschmidt : > (Reposted from freebsd-questions due to no replies.) > > With the last few releases, I've noticed a distinct trend toward > disappearing vnodes on one of the machines I look after. > > This machine isn't doing a whole lot. It runs a couple of small web > sites, and once an hour it rsync's some files from one NFS mount to > another, but the rsync doesn't stay running; it restarts every hour > and runs for 10-15 minutes. > > I set it to log the number of vnodes every ten minutes and this is what I got: > > 00:47:59 vfs.numvnodes: 39337 > 00:57:59 vfs.numvnodes: 40568 > 01:07:59 vfs.numvnodes: 44554 > 01:17:59 vfs.numvnodes: 52141 > 01:27:59 vfs.numvnodes: 55713 > 01:37:59 vfs.numvnodes: 58643 > 01:47:59 vfs.numvnodes: 60792 > 01:57:59 vfs.numvnodes: 67130 > 02:07:59 vfs.numvnodes: 76035 > 02:17:59 vfs.numvnodes: 84349 > 02:27:59 vfs.numvnodes: 92187 > 02:37:59 vfs.numvnodes: 98114 > 02:47:59 vfs.numvnodes: 116854 > 02:57:59 vfs.numvnodes: 124842 > 03:07:59 vfs.numvnodes: 164173 > 03:17:59 vfs.numvnodes: 172257 > 03:27:59 vfs.numvnodes: 178388 > 03:37:59 vfs.numvnodes: 183066 > 03:47:59 vfs.numvnodes: 190092 > 03:57:59 vfs.numvnodes: 198322 > 04:07:59 vfs.numvnodes: 204598 > 04:17:59 vfs.numvnodes: 208311 > 04:27:59 vfs.numvnodes: 214207 > 04:37:59 vfs.numvnodes: 221028 > 04:47:59 vfs.numvnodes: 227792 > 04:57:59 vfs.numvnodes: 233214 > 05:07:59 vfs.numvnodes: 240112 > 05:17:59 vfs.numvnodes: 247572 > 05:27:59 vfs.numvnodes: 256090 > 05:37:59 vfs.numvnodes: 262720 > 05:47:59 vfs.numvnodes: 269755 > 05:57:59 vfs.numvnodes: 274986 > 06:07:59 vfs.numvnodes: 279879 > 06:17:59 vfs.numvnodes: 287039 > 06:27:59 vfs.numvnodes: 291984 > 06:37:59 vfs.numvnodes: 294267 > 06:47:59 vfs.numvnodes: 296658 > 06:57:59 vfs.numvnodes: 299086 > 07:07:59 vfs.numvnodes: 301825 > 07:17:59 vfs.numvnodes: 309060 > 07:27:59 vfs.numvnodes: 312955 > 07:37:59 vfs.numvnodes: 317400 > 07:47:59 vfs.numvnodes: 320047 > > At that point the machine crashed with: > > panic: kmem_malloc(16384): kmem_map too small: 334745600 total allocated > > If I don't tune kern.maxvnodes up to the point where it panics, then > eventually it runs out of vnodes and all sorts of stuff gets stuck in > vlruwk. > > The machine in question is running 7.2-RELEASE-p3, but I already > upgraded it from 7.1 trying to get this to go away, so it's a problem > that's been around for awhile. > > My guess is that they're leaking in the kernel somewhere because of > the rsync, because there's just not much else going on, but unless I > can figure out how many vnodes are being used on a per-process basis, > I can't make any headway on proving or disproving that. I do know > that according to fstat, there are only 1000-1500 descriptors open at > any given time, and kern.openfiles ranges 250-500. So I'm just > mystified what the other 300000+ could be. > > Is there any way to figure out where all these vnodes are going? It seems you can reproduce it easilly. Can you please provide KTR traces of KTR_VFS? Thanks, Attilio -- Peace can only be achieved by understanding - A. Einstein From owner-freebsd-hackers@FreeBSD.ORG Sat Aug 1 17:44:54 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 66A8E106566B for ; Sat, 1 Aug 2009 17:44:54 +0000 (UTC) (envelope-from asmrookie@gmail.com) Received: from mail-bw0-f206.google.com (mail-bw0-f206.google.com [209.85.218.206]) by mx1.freebsd.org (Postfix) with ESMTP id D722A8FC0A for ; Sat, 1 Aug 2009 17:44:53 +0000 (UTC) (envelope-from asmrookie@gmail.com) Received: by bwz2 with SMTP id 2so1635310bwz.43 for ; Sat, 01 Aug 2009 10:44:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:content-transfer-encoding; bh=yEhKF/p7Ym2Lo6nZuUGjcVZ4ewJxb/0VUQiigwX5F3M=; b=tPVlLC+4oEx8pwGFDcrmSXcJ/BCd6ugpo0FOyznzt61XOfxN9yItlMsLdgpi+LjEJ1 22TwP5yC+z8yoB3SRzR9LXSWIr2SJ0EowIEcgpN1RDSnej4EuvFMoyQl5Ka3u80oKRdO qijwS0Lg3IZNyYwZ6ozRIZAU3C20r58sn/vJg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=hTWugCELg1xlKgH5PjM8BHXywLu6IJ0yjp6yHjViLGfXumKdP/pyuZT2WvLbGmD/zg t2HL15qyudrLa4wbfdidFsoeuP+E8VhQfXvz5I+zWiRpB50TL1P3uSOh9bHbbQmX+Ogg nHeDQphM6ZJjokjvKzRLEMM20shM32hsgzDUI= MIME-Version: 1.0 Sender: asmrookie@gmail.com Received: by 10.223.105.16 with SMTP id r16mr540502fao.2.1249146802897; Sat, 01 Aug 2009 10:13:22 -0700 (PDT) In-Reply-To: <237c27100908010841g5abd3183w479121b2ba7b0c91@mail.gmail.com> References: <237c27100908010841g5abd3183w479121b2ba7b0c91@mail.gmail.com> Date: Sat, 1 Aug 2009 19:13:22 +0200 X-Google-Sender-Auth: 6df4a9afffb1e553 Message-ID: <3bbf2fe10908011013g2ba221c1raa07698886b4413c@mail.gmail.com> From: Attilio Rao To: Linda Messerschmidt Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: Where have all the vnodes gone? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Aug 2009 17:44:54 -0000 2009/8/1 Linda Messerschmidt : > (Reposted from freebsd-questions due to no replies.) > > With the last few releases, I've noticed a distinct trend toward > disappearing vnodes on one of the machines I look after. > > This machine isn't doing a whole lot. It runs a couple of small web > sites, and once an hour it rsync's some files from one NFS mount to > another, but the rsync doesn't stay running; it restarts every hour > and runs for 10-15 minutes. > > I set it to log the number of vnodes every ten minutes and this is what I got: > > 00:47:59 vfs.numvnodes: 39337 > 00:57:59 vfs.numvnodes: 40568 > 01:07:59 vfs.numvnodes: 44554 > 01:17:59 vfs.numvnodes: 52141 > 01:27:59 vfs.numvnodes: 55713 > 01:37:59 vfs.numvnodes: 58643 > 01:47:59 vfs.numvnodes: 60792 > 01:57:59 vfs.numvnodes: 67130 > 02:07:59 vfs.numvnodes: 76035 > 02:17:59 vfs.numvnodes: 84349 > 02:27:59 vfs.numvnodes: 92187 > 02:37:59 vfs.numvnodes: 98114 > 02:47:59 vfs.numvnodes: 116854 > 02:57:59 vfs.numvnodes: 124842 > 03:07:59 vfs.numvnodes: 164173 > 03:17:59 vfs.numvnodes: 172257 > 03:27:59 vfs.numvnodes: 178388 > 03:37:59 vfs.numvnodes: 183066 > 03:47:59 vfs.numvnodes: 190092 > 03:57:59 vfs.numvnodes: 198322 > 04:07:59 vfs.numvnodes: 204598 > 04:17:59 vfs.numvnodes: 208311 > 04:27:59 vfs.numvnodes: 214207 > 04:37:59 vfs.numvnodes: 221028 > 04:47:59 vfs.numvnodes: 227792 > 04:57:59 vfs.numvnodes: 233214 > 05:07:59 vfs.numvnodes: 240112 > 05:17:59 vfs.numvnodes: 247572 > 05:27:59 vfs.numvnodes: 256090 > 05:37:59 vfs.numvnodes: 262720 > 05:47:59 vfs.numvnodes: 269755 > 05:57:59 vfs.numvnodes: 274986 > 06:07:59 vfs.numvnodes: 279879 > 06:17:59 vfs.numvnodes: 287039 > 06:27:59 vfs.numvnodes: 291984 > 06:37:59 vfs.numvnodes: 294267 > 06:47:59 vfs.numvnodes: 296658 > 06:57:59 vfs.numvnodes: 299086 > 07:07:59 vfs.numvnodes: 301825 > 07:17:59 vfs.numvnodes: 309060 > 07:27:59 vfs.numvnodes: 312955 > 07:37:59 vfs.numvnodes: 317400 > 07:47:59 vfs.numvnodes: 320047 > > At that point the machine crashed with: > > panic: kmem_malloc(16384): kmem_map too small: 334745600 total allocated > > If I don't tune kern.maxvnodes up to the point where it panics, then > eventually it runs out of vnodes and all sorts of stuff gets stuck in > vlruwk. > > The machine in question is running 7.2-RELEASE-p3, but I already > upgraded it from 7.1 trying to get this to go away, so it's a problem > that's been around for awhile. > > My guess is that they're leaking in the kernel somewhere because of > the rsync, because there's just not much else going on, but unless I > can figure out how many vnodes are being used on a per-process basis, > I can't make any headway on proving or disproving that. I do know > that according to fstat, there are only 1000-1500 descriptors open at > any given time, and kern.openfiles ranges 250-500. So I'm just > mystified what the other 300000+ could be. > > Is there any way to figure out where all these vnodes are going? > > TIA for any advice! > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > -- Peace can only be achieved by understanding - A. Einstein