From owner-freebsd-hackers@FreeBSD.ORG Sun May 25 15:46:02 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 627521065681 for ; Sun, 25 May 2008 15:46:02 +0000 (UTC) (envelope-from stefan@fafoe.narf.at) Received: from viefep20-int.chello.at (viefep20-int.chello.at [62.179.121.40]) by mx1.freebsd.org (Postfix) with ESMTP id 9FB038FC17 for ; Sun, 25 May 2008 15:46:00 +0000 (UTC) (envelope-from stefan@fafoe.narf.at) Received: from lizard.fafoe.narf.at ([213.47.85.26]) by viefep20-int.chello.at (InterMail vM.7.08.02.02 201-2186-121-104-20070414) with ESMTP id <20080525154559.MHIW17529.viefep20-int.chello.at@lizard.fafoe.narf.at>; Sun, 25 May 2008 17:45:59 +0200 Received: by lizard.fafoe.narf.at (Postfix, from userid 1001) id 7A666BE00; Sun, 25 May 2008 17:45:37 +0200 (CEST) Date: Sun, 25 May 2008 17:45:37 +0200 From: Stefan Farfeleder To: John E Hein Message-ID: <20080525154537.GB1026@lizard.fafoe.narf.at> Mail-Followup-To: John E Hein , Mike Meyer , hackers@freebsd.org References: <20080309152712.42752293@bhuda.mired.org> <20080516074433.GA1032@lizard.fafoe.narf.at> <20080516101143.3545937c@bhuda.mired.org> <20080516141307.GB1032@lizard.fafoe.narf.at> <18489.32903.477434.465037@gromit.timing.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <18489.32903.477434.465037@gromit.timing.com> User-Agent: Mutt/1.5.17 (2007-11-01) Cc: hackers@freebsd.org, Mike Meyer Subject: Re: Why doesn't autoconf like our /bin/sh? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 May 2008 15:46:02 -0000 On Sun, May 25, 2008 at 09:06:47AM -0600, John E Hein wrote: > FWIW, it seems bash and sh report line number differently. > > # grep -n ^ ~/tmp/ln > 1:#!/bin/sh > 2:echo f line: $LINENO > 3:f() > 4:{ > 5:echo f line: $LINENO > 6:} > 7: > 8:f > 9:echo main line: $LINENO > 10:f > > > # /bin/sh ~/tmp/ln > f line: 2 > f line: 3 > main line: 9 > f line: 3 > > > # bash ~/tmp/ln > f line: 2 > f line: 5 > main line: 9 > f line: 5 Yes, I know. I think it is a bug in bash as SUSv3 states: "Set by the shell to a decimal number representing the current sequential line number (numbered starting with 1) within a script or function before it executes each command." Stefan From owner-freebsd-hackers@FreeBSD.ORG Sun May 25 15:58:39 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5E2AB1065677 for ; Sun, 25 May 2008 15:58:39 +0000 (UTC) (envelope-from jhein@timing.com) Received: from Daffy.timing.com (daffy.timing.com [206.168.13.218]) by mx1.freebsd.org (Postfix) with ESMTP id 22EEB8FC15 for ; Sun, 25 May 2008 15:58:39 +0000 (UTC) (envelope-from jhein@timing.com) Received: from gromit.timing.com (gromit.timing.com [206.168.13.209]) by Daffy.timing.com (8.13.1/8.13.1) with ESMTP id m4PFwab9076279; Sun, 25 May 2008 09:58:36 -0600 (MDT) (envelope-from jhein@timing.com) Received: from gromit.timing.com (localhost [127.0.0.1]) by gromit.timing.com (8.14.2/8.14.2) with ESMTP id m4PFwYQ7088807; Sun, 25 May 2008 09:58:34 -0600 (MDT) (envelope-from jhein@gromit.timing.com) Received: (from jhein@localhost) by gromit.timing.com (8.14.2/8.14.2/Submit) id m4PFwYwJ088804; Sun, 25 May 2008 09:58:34 -0600 (MDT) (envelope-from jhein) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <18489.36010.220739.891583@gromit.timing.com> Date: Sun, 25 May 2008 09:58:34 -0600 From: John E Hein To: Stefan Farfeleder In-Reply-To: <20080525154537.GB1026@lizard.fafoe.narf.at> References: <20080309152712.42752293@bhuda.mired.org> <20080516074433.GA1032@lizard.fafoe.narf.at> <20080516101143.3545937c@bhuda.mired.org> <20080516141307.GB1032@lizard.fafoe.narf.at> <18489.32903.477434.465037@gromit.timing.com> <20080525154537.GB1026@lizard.fafoe.narf.at> X-Mailer: VM 7.19 under Emacs 22.1.1 X-Virus-Scanned: ClamAV version 0.91.2, clamav-milter version 0.91.2 on Daffy.timing.com X-Virus-Status: Clean Cc: hackers@freebsd.org, Mike Meyer Subject: Re: Why doesn't autoconf like our /bin/sh? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 May 2008 15:58:39 -0000 Stefan Farfeleder wrote at 17:45 +0200 on May 25, 2008: > On Sun, May 25, 2008 at 09:06:47AM -0600, John E Hein wrote: > > FWIW, it seems bash and sh report line number differently. > > > > # grep -n ^ ~/tmp/ln > > 1:#!/bin/sh > > 2:echo f line: $LINENO > > 3:f() > > 4:{ > > 5:echo f line: $LINENO > > 6:} > > 7: > > 8:f > > 9:echo main line: $LINENO > > 10:f > > > > > > # /bin/sh ~/tmp/ln > > f line: 2 > > f line: 3 > > main line: 9 > > f line: 3 > > > > > > # bash ~/tmp/ln > > f line: 2 > > f line: 5 > > main line: 9 > > f line: 5 > > Yes, I know. I think it is a bug in bash as SUSv3 states: > > "Set by the shell to a decimal number representing the current > sequential line number (numbered starting with 1) within a script or > function before it executes each command." Okay. Not knowing more context, I guess the 'or' (script or function) leaves things somewhat subject to interpretation. From owner-freebsd-hackers@FreeBSD.ORG Sun May 25 16:09:20 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D8AD9106566B for ; Sun, 25 May 2008 16:09:20 +0000 (UTC) (envelope-from jhein@timing.com) Received: from Daffy.timing.com (w.timing.com [206.168.13.218]) by mx1.freebsd.org (Postfix) with ESMTP id A0C258FC16 for ; Sun, 25 May 2008 16:09:20 +0000 (UTC) (envelope-from jhein@timing.com) Received: from gromit.timing.com (gromit.timing.com [206.168.13.209]) by Daffy.timing.com (8.13.1/8.13.1) with ESMTP id m4PF6oXF069151; Sun, 25 May 2008 09:06:50 -0600 (MDT) (envelope-from jhein@timing.com) Received: from gromit.timing.com (localhost [127.0.0.1]) by gromit.timing.com (8.14.2/8.14.2) with ESMTP id m4PF6maf087639; Sun, 25 May 2008 09:06:48 -0600 (MDT) (envelope-from jhein@gromit.timing.com) Received: (from jhein@localhost) by gromit.timing.com (8.14.2/8.14.2/Submit) id m4PF6l9O087636; Sun, 25 May 2008 09:06:47 -0600 (MDT) (envelope-from jhein) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <18489.32903.477434.465037@gromit.timing.com> Date: Sun, 25 May 2008 09:06:47 -0600 From: John E Hein To: Stefan Farfeleder In-Reply-To: <20080516141307.GB1032@lizard.fafoe.narf.at> References: <20080309152712.42752293@bhuda.mired.org> <20080516074433.GA1032@lizard.fafoe.narf.at> <20080516101143.3545937c@bhuda.mired.org> <20080516141307.GB1032@lizard.fafoe.narf.at> X-Mailer: VM 7.19 under Emacs 22.1.1 X-Virus-Scanned: ClamAV version 0.91.2, clamav-milter version 0.91.2 on Daffy.timing.com X-Virus-Status: Clean Cc: hackers@freebsd.org, Mike Meyer Subject: Re: Why doesn't autoconf like our /bin/sh? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 May 2008 16:09:20 -0000 Stefan Farfeleder wrote at 16:13 +0200 on May 16, 2008: > On Fri, May 16, 2008 at 10:11:43AM -0400, Mike Meyer wrote: > > On Fri, 16 May 2008 09:44:33 +0200 > > Stefan Farfeleder wrote: > > > > > On Sun, Mar 09, 2008 at 03:27:12PM -0400, Mike Meyer wrote: > > > > I've stumbled on to an obscure problem with autoconf 2.61, and I'm not > > > > sure quite what to do with it. I've already sent mail to the autoconf > > > > folks, but I'd like to understand what's going on. > > > > > > > > The problem is that, on a FreeBSD system with only /bin/sh and the > > > > ports zsh as installed shells, if you have SHELL set to zsh when > > > > invoking the autoconf-generated configure script, the script produces > > > > a broken Makefile. It doesn't generate an error, it just complains > > > > that: > > > > > > Can you please retry? /bin/sh now supports expanding $LINENO which was > > > often the reason for configure not liking it. > > > > Which branch, and how recently? > > HEAD and yesterday. FWIW, it seems bash and sh report line number differently. # grep -n ^ ~/tmp/ln 1:#!/bin/sh 2:echo f line: $LINENO 3:f() 4:{ 5:echo f line: $LINENO 6:} 7: 8:f 9:echo main line: $LINENO 10:f # /bin/sh ~/tmp/ln f line: 2 f line: 3 main line: 9 f line: 3 # bash ~/tmp/ln f line: 2 f line: 5 main line: 9 f line: 5 From owner-freebsd-hackers@FreeBSD.ORG Sun May 25 22:15:07 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AF81C106566B for ; Sun, 25 May 2008 22:15:07 +0000 (UTC) (envelope-from kayve@sfsu.edu) Received: from iron1.sfsu.edu (iron1.sfsu.edu [130.212.10.35]) by mx1.freebsd.org (Postfix) with ESMTP id 8F1938FC1C for ; Sun, 25 May 2008 22:15:07 +0000 (UTC) (envelope-from kayve@sfsu.edu) X-onepass: IPPSC X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApoEAIB7OUiC1Apk/2dsb2JhbACreA Received: from smtp01.sfsu.edu ([130.212.10.100]) by iron1.sfsu.edu with ESMTP; 25 May 2008 14:46:45 -0700 Received: from libra.sfsu.edu ([130.212.10.238]) by mail05a.sfsu.edu (Lotus Domino Release 7.0.3HF378) with ESMTP id 2008052514464339-1082 ; Sun, 25 May 2008 14:46:43 -0700 Date: Sun, 25 May 2008 14:46:43 -0700 (PDT) From: KAYVEN RIESE To: hackers@freebsd.org Message-ID: MIME-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on MAIL05a/SERVERS/SFSU(Release 7.0.3HF378 | February 28, 2008) at 05/25/2008 14:46:43, Serialize by Router on SMTP01/SERVERS/SFSU(Release 7.0.3HF378 | February 28, 2008) at 05/25/2008 14:46:44, Serialize complete at 05/25/2008 14:46:44 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Subject: "Hackers" Documentation X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 May 2008 22:15:07 -0000 A couple of people on this list came to an agreement that "hackers" is appropriately understood as being for "developers." Well. I made my decision to subscribe based on the "documentation" here: http://tinyurl.com/623qw Namely: freebsd-hackers General technical discussion Googling "hackers" gives me 42.4 million hits. Wikipedia gives: * Hacker (computing) has a spectrum of meanings: o Hacker (computer security), someone who breaks computer and network security o Hacker (free and open source software), a programmer in the free software and open source movement o Hacker (hobbyist), an enthusiastic home computer hobbyist. Hmm.. I think I at very least belong to that third category. Personally, I take issue with the first defintion, but the facts are that most "laypersons" understand hackers in that way. I would say it is a "cracker" who breaks into a computer and not a "hacker". Somebody instilled this idea in me, I forget who. Anyway. I won't belabor this point further here. Thank you for your time. *----------------------------------------------------------* Kayven Riese, BSCS, MS (Physiology and Biophysics) (415) 902 5513 cellular http://kayve.net Webmaster http://ChessYoga.org *----------------------------------------------------------* From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 14:52:06 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 517C3106564A for ; Mon, 26 May 2008 14:52:06 +0000 (UTC) (envelope-from mathieu.prevot@gmail.com) Received: from hu-out-0506.google.com (hu-out-0506.google.com [72.14.214.236]) by mx1.freebsd.org (Postfix) with ESMTP id B625B8FC2A for ; Mon, 26 May 2008 14:52:05 +0000 (UTC) (envelope-from mathieu.prevot@gmail.com) Received: by hu-out-0506.google.com with SMTP id 34so2997296hue.8 for ; Mon, 26 May 2008 07:52:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; bh=Tm6ZdSmPilQOAlnHfyAl8ttD1XdA7ZS5IGKLvn/33G4=; b=Z9U1E//ryaSRVoYbtiXdsuuOG2X0jvdtBeVkk158UIzd7MayemsqbSn4zMcKJWAnE+l/Y7LYtNkJ+oT19WL30pEuJG70ofl6jbWtEii+aTQg7012uD4bFdQMpYW9NrxTvo/D8E/TIFHKjcGuuw6c20zoaHnI7mzQ6n3e2HaQGlM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=Crmp/5j2rUNiZfkfbqMSWC6k0iSrZ5q0JCqNDFkgG7sx9JPclIzew/zEp+uODvF6HMkS7kugryEN2JGGCDX0cfiayP6HxKSVvnUWyaCtlWAql6aNJdv1DXOO+6CVbxhCUTD5N0UO2s8mmoN23RKZSVIRbcJKvdD8Brr3hyVZEpc= Received: by 10.82.152.16 with SMTP id z16mr102923bud.39.1211813524887; Mon, 26 May 2008 07:52:04 -0700 (PDT) Received: by 10.82.170.10 with HTTP; Mon, 26 May 2008 07:52:04 -0700 (PDT) Message-ID: <3e473cc60805260752o2f573cf2h12910a45cf6849e6@mail.gmail.com> Date: Mon, 26 May 2008 16:52:04 +0200 From: "Mathieu Prevot" To: hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Subject: network bitrate of a poll of processes X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 14:52:06 -0000 Hi, I would like to know the bitrate of a pool of child processes that use a network connection, how can I have something like netstat -w1 provide but at the process level ? Thanks Mathieu From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 15:16:16 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BD2271065670 for ; Mon, 26 May 2008 15:16:16 +0000 (UTC) (envelope-from dan@dan.emsphone.com) Received: from dan.emsphone.com (dan.emsphone.com [199.67.51.101]) by mx1.freebsd.org (Postfix) with ESMTP id 80C498FC14 for ; Mon, 26 May 2008 15:16:16 +0000 (UTC) (envelope-from dan@dan.emsphone.com) Received: from dan.emsphone.com (smmsp@localhost [127.0.0.1]) by dan.emsphone.com (8.14.3/8.14.2) with ESMTP id m4QFGFZ8005098 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Mon, 26 May 2008 10:16:15 -0500 (CDT) (envelope-from dan@dan.emsphone.com) Received: (from dan@localhost) by dan.emsphone.com (8.14.3/8.14.2/Submit) id m4QFGFr8005097; Mon, 26 May 2008 10:16:15 -0500 (CDT) (envelope-from dan) Date: Mon, 26 May 2008 10:16:15 -0500 From: Dan Nelson To: Mathieu Prevot Message-ID: <20080526151614.GA5582@dan.emsphone.com> References: <3e473cc60805260752o2f573cf2h12910a45cf6849e6@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3e473cc60805260752o2f573cf2h12910a45cf6849e6@mail.gmail.com> X-OS: FreeBSD 7.0-STABLE User-Agent: Mutt/1.5.18 (2008-05-17) Cc: hackers@freebsd.org Subject: Re: network bitrate of a poll of processes X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 15:16:16 -0000 In the last episode (May 26), Mathieu Prevot said: > Hi, > > I would like to know the bitrate of a pool of child processes that use > a network connection, how can I have something like netstat -w1 > provide but at the process level ? If you can segregate them to their own UID, you can use an ipfw "count ip from any to any uid 6666" rule to count the packets. Another option would be to jail them to a dedicated IP address and count traffic on that IP. -- Dan Nelson dnelson@allantgroup.com From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 15:54:22 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AC1271065670 for ; Mon, 26 May 2008 15:54:22 +0000 (UTC) (envelope-from mathieu.prevot@gmail.com) Received: from hu-out-0506.google.com (hu-out-0506.google.com [72.14.214.232]) by mx1.freebsd.org (Postfix) with ESMTP id 31F5C8FC13 for ; Mon, 26 May 2008 15:54:21 +0000 (UTC) (envelope-from mathieu.prevot@gmail.com) Received: by hu-out-0506.google.com with SMTP id 34so3032874hue.8 for ; Mon, 26 May 2008 08:54:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; bh=iFylUVcDRnyAF/RTyQt20juA6oCX1/i1nGdib3JTNvU=; b=QlpORqFd4RGs8yqoYfLnH+nIgSq9FdX36qli7J9twCzThmSnMbe9SmwBN5WsJFFOW8VWjHW3VBajcYYA54pBAfrkEvlJsHQn3Y8t4+5bmn59++dMGQP/1h/yqdDDJ4T631EN9AbqedNlZ+q3q2ELrepK0xI1u9oYLDQMUrkYfTY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=a1YQ2sMV9TeXa2pdHqbDHJI37zCcFk7HcFOQvWrEfYcTYbEzCMKkM2nwPtIDsUy4LBrhKgBg/jVT+QTHHeOUGVk8DXfuXqq25c02Uv7pNmLSjQawq+rw5UMMXHkDOgesKnbrFvrwH40fO5r4uWYU3qbBhAvwGqSi88Y1Mds81N8= Received: by 10.82.191.3 with SMTP id o3mr160687buf.17.1211808419071; Mon, 26 May 2008 06:26:59 -0700 (PDT) Received: by 10.82.170.10 with HTTP; Mon, 26 May 2008 06:26:59 -0700 (PDT) Message-ID: <3e473cc60805260626k2469143ay9b0d52ea4044938b@mail.gmail.com> Date: Mon, 26 May 2008 15:26:59 +0200 From: "Mathieu Prevot" To: hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Subject: flush file descriptor in a sh script while passing through a pipe X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 15:54:22 -0000 Hi, Let's be an example. With 1) I have a progress bar that is updated regularly but with 2) I have to wait for the end of the download (the next \n character ?) ... 1) wget http://tinyurl.com/5ztnb2 2) wget http://tinyurl.com/5ztnb2 --progress=bar:force 2>&1 | sed '/^Location/d;/^HTTP/d;/^--/d' I would like the progress bar to be updated through sed ... how can I flush the file descriptor from sh or with a tiny command/signal ? Thanks Mathieu From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 16:14:19 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2D1741065675 for ; Mon, 26 May 2008 16:14:19 +0000 (UTC) (envelope-from mathieu.prevot@gmail.com) Received: from hu-out-0506.google.com (hu-out-0506.google.com [72.14.214.232]) by mx1.freebsd.org (Postfix) with ESMTP id 72D3E8FC24 for ; Mon, 26 May 2008 16:14:18 +0000 (UTC) (envelope-from mathieu.prevot@gmail.com) Received: by hu-out-0506.google.com with SMTP id 34so3043773hue.8 for ; Mon, 26 May 2008 09:14:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=vplZCM1mUkL/HSyJKE3kN/boO6xRuwDG+rZaG+U3wJA=; b=QS5Em+qGyJ7vN9rM8xR8kObKQneed2Fc+sX4T7A0rqYFqJNPJCktPnD9kFVxgLYxMkcUlf2hmMvA8HZi+5+zEGATL4z8xWpLLWug19U2d8KXIjefnqG1ApUHybrcKjCyDM4SJ2xsf+Clxir3sm5wqGgQQsQAsTBK818Y3axrG1s= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=uQAaMN+/gMzwjVSsLGwIKhw6mw6H27OWAFu/27lrmmHtqcIHxJ2hE6bT13ayqecSZ0QCwuVJAd4ioXZQJEw7hZXOT7UkGt6k6dqjCD3nDOwPwKWqOMtHoAdFB2jrSY1XbBMQyGIpgqlHU1ZKo+KTvtwzwBQrtcmqLTlj1iMTVlY= Received: by 10.82.118.1 with SMTP id q1mr171649buc.52.1211818454183; Mon, 26 May 2008 09:14:14 -0700 (PDT) Received: by 10.82.170.10 with HTTP; Mon, 26 May 2008 09:14:14 -0700 (PDT) Message-ID: <3e473cc60805260914r537f113eh8d840a94c0a5d958@mail.gmail.com> Date: Mon, 26 May 2008 18:14:14 +0200 From: "Mathieu Prevot" To: "Dan Nelson" In-Reply-To: <20080526151614.GA5582@dan.emsphone.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <3e473cc60805260752o2f573cf2h12910a45cf6849e6@mail.gmail.com> <20080526151614.GA5582@dan.emsphone.com> Cc: hackers@freebsd.org Subject: Re: network bitrate of a poll of processes X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 16:14:19 -0000 2008/5/26 Dan Nelson : > In the last episode (May 26), Mathieu Prevot said: >> Hi, >> >> I would like to know the bitrate of a pool of child processes that use >> a network connection, how can I have something like netstat -w1 >> provide but at the process level ? > > If you can segregate them to their own UID, you can use an ipfw "count > ip from any to any uid 6666" rule to count the packets. Another option > would be to jail them to a dedicated IP address and count traffic on > that IP. Both are nice... thank you. And don't you have something more portable ie. that could run on "any" posix os - like a sh script that use standard tools - and that doesn't need root user intervention ? Mathieu From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 17:59:50 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E5C24106566B for ; Mon, 26 May 2008 17:59:50 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 576A38FC25 for ; Mon, 26 May 2008 17:59:50 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.1/8.14.1) with ESMTP id m4QHxm6j091705; Mon, 26 May 2008 19:59:48 +0200 (CEST) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.1/8.14.1/Submit) id m4QHxmpi091704; Mon, 26 May 2008 19:59:48 +0200 (CEST) (envelope-from olli) Date: Mon, 26 May 2008 19:59:48 +0200 (CEST) Message-Id: <200805261759.m4QHxmpi091704@lurza.secnetix.de> From: Oliver Fromme To: freebsd-hackers@FreeBSD.ORG, mathieu.prevot@gmail.com In-Reply-To: <3e473cc60805260626k2469143ay9b0d52ea4044938b@mail.gmail.com> X-Newsgroups: list.freebsd-hackers User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.2-STABLE-20070808 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Mon, 26 May 2008 19:59:48 +0200 (CEST) Cc: Subject: Re: flush file descriptor in a sh script while passing through a pipe X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-hackers@FreeBSD.ORG, mathieu.prevot@gmail.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 17:59:51 -0000 Mathieu Prevot wrote: > Let's be an example. With 1) I have a progress bar that is updated > regularly but with 2) I have to wait for the end of the download (the > next \n character ?) ... > > 1) > wget http://tinyurl.com/5ztnb2 > > 2) > wget http://tinyurl.com/5ztnb2 --progress=bar:force 2>&1 | sed > '/^Location/d;/^HTTP/d;/^--/d' > > I would like the progress bar to be updated through sed ... how can I > flush the file descriptor from sh or with a tiny command/signal ? There are two problems with that. The first problem is the fact that wget's output is fully buffered when output is a pipe (not a tty). Some programs have an option for unbuffered or line-buffered output (e.g. tcpdump -l), but unfortunately wget does not. In fact most programs don't have such an option. There's a little trick that "emulates" a tty environment for a process so it thinks that its standard output is a tty, so output will be unbuffered: Simply run it inside script(1). I've needed that for myself occasionally so I've made a small alias for this: alias intty='script -qt0 /dev/null Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 776EC1065753 for ; Mon, 26 May 2008 18:34:12 +0000 (UTC) (envelope-from maxim@macomnet.ru) Received: from mp2.macomnet.net (mp2.macomnet.net [195.128.64.6]) by mx1.freebsd.org (Postfix) with ESMTP id 62AAA8FC0A for ; Mon, 26 May 2008 18:34:11 +0000 (UTC) (envelope-from maxim@macomnet.ru) Received: from localhost (localhost.int.ru [127.0.0.1] (may be forged)) by mp2.macomnet.net (8.13.7/8.13.8) with ESMTP id m4QI2JUQ004488; Mon, 26 May 2008 22:02:20 +0400 (MSD) (envelope-from maxim@macomnet.ru) Date: Mon, 26 May 2008 22:02:19 +0400 (MSD) From: Maxim Konovalov To: Steven Hartland In-Reply-To: Message-ID: <20080526220157.J35550@mp2.macomnet.net> References: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: freebsd-hackers@freebsd.org Subject: Re: Using sendmsg for SCM_CREDS results in EINVAL on PF_INET socket X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 18:34:13 -0000 On Sun, 18 May 2008, 20:56+0100, Steven Hartland wrote: > sendmsg is not documented as ever returning EINVAL but yet when > using the following code to send credentials to a remote host > results in EINVAL from sendmsg. > > I suspect that SCM_CREDS is only valid for PF_LOCAL / PF_UNIX > sockets and not PF_INET sockets and hence the code in dbus > is actually invalid. > > Can anyone confirm this is the case or not? > [...] confirmed :-) -- Maxim Konovalov From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 18:47:57 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9DB931065679 for ; Mon, 26 May 2008 18:47:57 +0000 (UTC) (envelope-from kris@FreeBSD.org) Received: from weak.local (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id EE7858FC1A; Mon, 26 May 2008 18:47:56 +0000 (UTC) (envelope-from kris@FreeBSD.org) Message-ID: <483B05DB.3000309@FreeBSD.org> Date: Mon, 26 May 2008 20:47:55 +0200 From: Kris Kennaway User-Agent: Thunderbird 2.0.0.14 (Macintosh/20080421) MIME-Version: 1.0 To: Steven Hartland References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: Using sendmsg for SCM_CREDS results in EINVAL on PF_INET socket X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 18:47:57 -0000 Steven Hartland wrote: > sendmsg is not documented as ever returning EINVAL but yet when > using the following code to send credentials to a remote host > results in EINVAL from sendmsg. > > I suspect that SCM_CREDS is only valid for PF_LOCAL / PF_UNIX > sockets and not PF_INET sockets and hence the code in dbus > is actually invalid. > > Can anyone confirm this is the case or not? What would it even mean to send credentials to a remote host over an AF_INET socket? Kris From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 19:49:18 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F071C1065672; Mon, 26 May 2008 19:49:18 +0000 (UTC) (envelope-from dillon@apollo.backplane.com) Received: from apollo.backplane.com (apollo.backplane.com [216.240.41.2]) by mx1.freebsd.org (Postfix) with ESMTP id BD6B28FC23; Mon, 26 May 2008 19:49:18 +0000 (UTC) (envelope-from dillon@apollo.backplane.com) Received: from apollo.backplane.com (localhost [127.0.0.1]) by apollo.backplane.com (8.14.1/8.14.1) with ESMTP id m4QJaS8Z074047; Mon, 26 May 2008 12:36:28 -0700 (PDT) Received: (from dillon@localhost) by apollo.backplane.com (8.14.1/8.13.4/Submit) id m4QJaS7Q074045; Mon, 26 May 2008 12:36:28 -0700 (PDT) Date: Mon, 26 May 2008 12:36:28 -0700 (PDT) From: Matthew Dillon Message-Id: <200805261936.m4QJaS7Q074045@apollo.backplane.com> To: Kris Kennaway References: <483B05DB.3000309@FreeBSD.org> Cc: freebsd-hackers@freebsd.org, Steven Hartland Subject: Re: Using sendmsg for SCM_CREDS results in EINVAL on PF_INET socket X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 19:49:19 -0000 :> using the following code to send credentials to a remote host :> results in EINVAL from sendmsg. :> :> I suspect that SCM_CREDS is only valid for PF_LOCAL / PF_UNIX :> sockets and not PF_INET sockets and hence the code in dbus :> is actually invalid. :> :> Can anyone confirm this is the case or not? : :What would it even mean to send credentials to a remote host over an :AF_INET socket? : :Kris The only way to do it is to do a connect-back to a secure port. In otherwords, to use the identd protocol. Control messages like SCM_CREDS (and descriptor passing for that matter) only work over local protocol sockets. -Matt Matthew Dillon From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 20:03:25 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 18632106564A for ; Mon, 26 May 2008 20:03:25 +0000 (UTC) (envelope-from mspitzer@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.172]) by mx1.freebsd.org (Postfix) with ESMTP id DD2198FC1E for ; Mon, 26 May 2008 20:03:24 +0000 (UTC) (envelope-from mspitzer@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so1740425wfg.7 for ; Mon, 26 May 2008 13:03:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=zicnhXz7h/Ew//xjjG2GGwrCsfHVf37ZO4BQ5DcB7Nc=; b=Nyvs9/aB9RXqgh/jrEGguokNW4n1KrAMlwuZ6MFI3IVrUKotUDlf42Hb4PS1k2p44hiO7UgdYLKMHg4sm5/5wMTyESi3d0zDRB/QgJ2F4S5duM0EnO24PR2RBgS5FkDGqdfbMoL3w+q/Fb15JxmSDyh0GVFVwJdkppbcmplqQUY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=AG8dXJyjXrEIbMQQoXf5qlccpmBwsBAVyNDMgmlXnEaTxZYTp48Ti04thMEIYtr6cCn6CrrhFR2KjeCFecXd4Ses1ER4VZapeflKoFX9ELbly7f04zhBqqKUhQ2+a5ddjfI7VgoxnNQpixPLjyz7/vs32zd2iTDVptBW+PoBHYI= Received: by 10.142.108.14 with SMTP id g14mr144557wfc.181.1211830648702; Mon, 26 May 2008 12:37:28 -0700 (PDT) Received: by 10.143.123.5 with HTTP; Mon, 26 May 2008 12:37:28 -0700 (PDT) Message-ID: <8c50a3c30805261237y6573a2c9ra4af56477d93af78@mail.gmail.com> Date: Mon, 26 May 2008 15:37:28 -0400 From: "Marc Spitzer" To: "Mathieu Prevot" In-Reply-To: <3e473cc60805260914r537f113eh8d840a94c0a5d958@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <3e473cc60805260752o2f573cf2h12910a45cf6849e6@mail.gmail.com> <20080526151614.GA5582@dan.emsphone.com> <3e473cc60805260914r537f113eh8d840a94c0a5d958@mail.gmail.com> Cc: hackers@freebsd.org, Dan Nelson Subject: Re: network bitrate of a poll of processes X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 20:03:25 -0000 On Mon, May 26, 2008 at 12:14 PM, Mathieu Prevot wrote: > 2008/5/26 Dan Nelson : >> In the last episode (May 26), Mathieu Prevot said: >>> Hi, >>> >>> I would like to know the bitrate of a pool of child processes that use >>> a network connection, how can I have something like netstat -w1 >>> provide but at the process level ? >> >> If you can segregate them to their own UID, you can use an ipfw "count >> ip from any to any uid 6666" rule to count the packets. Another option >> would be to jail them to a dedicated IP address and count traffic on >> that IP. > > Both are nice... thank you. And don't you have something more portable > ie. that could run on "any" posix os - like a sh script that use > standard tools - and that doesn't need root user intervention ? > > Mathieu I do not think so, firewall for example is controlled by root. And users do not generally have detailed access to other users information. You can look into the BASM framework to track what your apps are doing and if you know the behavior to expect you can use netflow/argus/tcpdump to track that and post process the logs in each case into something useful. What are you trying to do, details do help? Thanks, marc -- Freedom is nothing but a chance to be better. Albert Camus From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 20:11:20 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6D6B4106566B; Mon, 26 May 2008 20:11:20 +0000 (UTC) (envelope-from joel@FreeBSD.org) Received: from mail.automatvapen.se (mail.automatvapen.se [88.131.73.154]) by mx1.freebsd.org (Postfix) with ESMTP id 1AF7E8FC13; Mon, 26 May 2008 20:11:20 +0000 (UTC) (envelope-from joel@FreeBSD.org) Received: from localhost (localhost [127.0.0.1]) by mail.automatvapen.se (Postfix) with ESMTP id ABB362FD0CD; Mon, 26 May 2008 21:55:07 +0200 (CEST) X-Virus-Scanned: amavisd-new at automatvapen.se Received: from mail.automatvapen.se ([127.0.0.1]) by localhost (tor.automatvapen.se [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hJJhtrU92Tkv; Mon, 26 May 2008 21:55:04 +0200 (CEST) Received: from joel-dahls-macbook.local (unknown [172.20.20.239]) by mail.automatvapen.se (Postfix) with ESMTP id 32EEB2FCDD0; Mon, 26 May 2008 21:55:04 +0200 (CEST) Message-ID: <483B1598.2010006@FreeBSD.org> Date: Mon, 26 May 2008 21:55:04 +0200 From: Joel Dahl User-Agent: Thunderbird 2.0.0.14 (Macintosh/20080421) MIME-Version: 1.0 To: Nick Barkas References: <20080422075642.GA72273@freebsdmall.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: hackers@freebsd.org Subject: Re: Please welcome our Summer of Code Students X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 20:11:20 -0000 (Catching up on old mail) Nick Barkas skrev: > Hi everyone > I'm Nick Barkas, and will be working on making memory usage for > dirhash dynamic. I'm a master's student studying scientific computing > at Kungliga Tekniska högskolan (Royal Institute of Technology) in > Stockholm. I have been using FreeBSD for several years and I am very > happy to get this chance to spend a lot of time hacking on it, > learning more about what goes on in the kernel, and hopefully making > UFS2 faster. Välkommen! :-) (Which means "Welcome" for those of you not familiar with the Swedish language) -- Joel From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 20:19:33 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C0E28106566C; Mon, 26 May 2008 20:19:33 +0000 (UTC) (envelope-from prvs=1032b0b9a9=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id 29EE18FC15; Mon, 26 May 2008 20:19:32 +0000 (UTC) (envelope-from prvs=1032b0b9a9=killing@multiplay.co.uk) DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=multiplay.co.uk; s=Multiplay; t=1211832140; x=1212436940; q=dns/txt; h=Received: Message-ID:From:To:Cc:References:Subject:Date:MIME-Version: Content-Type:Content-Transfer-Encoding; bh=jGDRGflsVNGCOi0auRLAT hjRw1FjAoBDpg5E63+l668=; b=Bw8BxKNfIFMlOV7zuiskVZR4NMtOJdeTTdTtA 2CLCKBFI1JfOH3aPyvhHurqMj6k+Rgvz9ia1LGvCkeVB54Cs4/fmv1d+e7BXQI30 u4N/qY0Ien7D9M3faQDoMDilgXOdixZ8fac7oslcbJWF+QAmZwJDMJm37sIAS1EC OCByxU= X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-14.7 required=6.0 tests=BAYES_00, FORGED_MUA_OUTLOOK, USER_IN_WHITELIST,USER_IN_WHITELIST_TO autolearn=ham version=3.1.8 Received: from r2d2 by mail1.multiplay.co.uk (MDaemon PRO v9.6.5) with ESMTP id md50005670992.msg; Mon, 26 May 2008 21:02:17 +0100 X-Authenticated-Sender: Killing@multiplay.co.uk X-MDRemoteIP: 212.135.219.182 X-Return-Path: prvs=1032b0b9a9=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk Message-ID: <7EB9398C5B46415B96D2C20A2E261E13@multiplay.co.uk> From: "Steven Hartland" To: "Matthew Dillon" , "Kris Kennaway" References: <483B05DB.3000309@FreeBSD.org> <200805261936.m4QJaS7Q074045@apollo.backplane.com> Date: Mon, 26 May 2008 21:02:14 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="Windows-1252"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5512 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5512 X-Spam-Processed: mail1.multiplay.co.uk, Mon, 26 May 2008 21:02:19 +0100 X-MDAV-Processed: mail1.multiplay.co.uk, Mon, 26 May 2008 21:02:20 +0100 Cc: freebsd-hackers@freebsd.org Subject: Re: Using sendmsg for SCM_CREDS results in EINVAL on PF_INET socket X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 20:19:33 -0000 ----- Original Message ----- From: "Matthew Dillon" >>> >>>[...] >>>confirmed :-) >>> >:> using the following code to send credentials to a remote host > :> results in EINVAL from sendmsg. > :> > :> I suspect that SCM_CREDS is only valid for PF_LOCAL / PF_UNIX > :> sockets and not PF_INET sockets and hence the code in dbus > :> is actually invalid. > :> > :> Can anyone confirm this is the case or not? > : > :What would it even mean to send credentials to a remote host over an > :AF_INET socket? > : > :Kris > > The only way to do it is to do a connect-back to a secure port. In > otherwords, to use the identd protocol. > > Control messages like SCM_CREDS (and descriptor passing for that matter) > only work over local protocol sockets. Thank you for the confirmation guys. I'll look to create a patch I can submit to the dbus project to disable the use of SCM_CREDS when using PF_UNIX sockets. Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 20:26:26 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D7081106566C for ; Mon, 26 May 2008 20:26:26 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from hosted.kievnet.com (hosted.kievnet.com [193.138.144.10]) by mx1.freebsd.org (Postfix) with ESMTP id 2F37C8FC0A for ; Mon, 26 May 2008 20:26:25 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from localhost ([127.0.0.1] helo=edge.pp.kiev.ua) by hosted.kievnet.com with esmtpa (Exim 4.62) (envelope-from ) id 1K0jGy-000Cx3-7V for freebsd-hackers@freebsd.org; Mon, 26 May 2008 23:26:24 +0300 Message-ID: <483B1CEB.90405@icyb.net.ua> Date: Mon, 26 May 2008 23:26:19 +0300 From: Andriy Gapon User-Agent: Thunderbird 2.0.0.12 (X11/20080320) MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Subject: make universe: only kernels, no worlds X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 20:26:26 -0000 Is there a built-in way to do an equivalent of building universe but only for kernels (and kernel tool-chains)? Or some straightforward to emulate that? Thanks! -- Andriy Gapon From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 21:02:37 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7EFAC1065671 for ; Mon, 26 May 2008 21:02:37 +0000 (UTC) (envelope-from mspitzer@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.168]) by mx1.freebsd.org (Postfix) with ESMTP id 189A78FC2B for ; Mon, 26 May 2008 21:02:36 +0000 (UTC) (envelope-from mspitzer@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so1755532wfg.7 for ; Mon, 26 May 2008 14:02:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=Xe5AY6kJdSlcHbDWf+jzWbvgLz1RF4qM/bzwrMSGHi8=; b=LdUr1x9qRVwx8zPOvCYuDddDONsA3zOY6syxp7e+cVQ1fQCV7UbiBoFOg53a7ZgUetbpkgtrWzFCFJ9PgE/ogJ+d4pLJSUdYl+LWYKhNXEeOzJ42esKc8jfSaNHj/Ghyj0/MmSUrskoiPg21TzpgeZfC+pMPA913L8MJt0ckU5Y= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=J4vAZ8AwKbYJyG+9zPSd1Wd5VGSzcE0yzDerhC/+CxH2AC5noyxCh2Q5zE6G0kFX2mUvQIscVXnx8O1SRd0I0/DlOFp2/qFPRPpIemaH2ZnAcBFrsaPPvByrNDbXlEqtgSmxoWJfOpZpEiwU0tE8+7g4DxEFmlwIMkU5jjcp2Z0= Received: by 10.143.155.7 with SMTP id h7mr165421wfo.282.1211835754896; Mon, 26 May 2008 14:02:34 -0700 (PDT) Received: by 10.143.123.5 with HTTP; Mon, 26 May 2008 14:02:34 -0700 (PDT) Message-ID: <8c50a3c30805261402y596a37a2m61a8993b37d13d7b@mail.gmail.com> Date: Mon, 26 May 2008 17:02:34 -0400 From: "Marc Spitzer" To: "Mathieu Prevot" In-Reply-To: <3e473cc60805261327g38349857ga87dcfa0b855c1f6@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <3e473cc60805260752o2f573cf2h12910a45cf6849e6@mail.gmail.com> <20080526151614.GA5582@dan.emsphone.com> <3e473cc60805260914r537f113eh8d840a94c0a5d958@mail.gmail.com> <8c50a3c30805261237y6573a2c9ra4af56477d93af78@mail.gmail.com> <3e473cc60805261327g38349857ga87dcfa0b855c1f6@mail.gmail.com> Cc: hackers@freebsd.org, Dan Nelson Subject: Re: network bitrate of a poll of processes X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 21:02:37 -0000 On Mon, May 26, 2008 at 4:27 PM, Mathieu Prevot wrote: > 2008/5/26 Marc Spitzer : >> On Mon, May 26, 2008 at 12:14 PM, Mathieu Prevot >> wrote: >>> 2008/5/26 Dan Nelson : >>>> In the last episode (May 26), Mathieu Prevot said: >>>>> Hi, >>>>> >>>>> I would like to know the bitrate of a pool of child processes that use >>>>> a network connection, how can I have something like netstat -w1 >>>>> provide but at the process level ? >>>> >>>> If you can segregate them to their own UID, you can use an ipfw "count >>>> ip from any to any uid 6666" rule to count the packets. Another option >>>> would be to jail them to a dedicated IP address and count traffic on >>>> that IP. >>> >>> Both are nice... thank you. And don't you have something more portable >>> ie. that could run on "any" posix os - like a sh script that use >>> standard tools - and that doesn't need root user intervention ? >>> >>> Mathieu >> >> I do not think so, firewall for example is controlled by root. And >> users do not generally have detailed access to other users >> information. You can look into the BASM framework to track what your >> apps are doing and if you know the behavior to expect you can use >> netflow/argus/tcpdump to track that and post process the logs in each >> case into something useful. >> >> What are you trying to do, details do help? >> >> marc > > I have a script that generates many child processes that download > videos (~10MB) in this case, or do heavy data processing/analysing. I > can tune the number of workers as I want, but It's a shared cluster so > I would like to > > 1) measure 2) optimize/control (by number of workers ? at the script > level ! so I can update thing very dynamically) > a) CPU load b) IO on drive(s) c) network load > > and I prefer solutions that don't need root access/intervention. I can > measure indirectly network load using `date +%s` and `du -b |sed > 's/\t.*//' ` regularly... but I may have to deal with several 10GB > later - and actually the number of files is more critical than their > size. > Maybe writing a (very) quick and dirty python app that listen/attach > to a group of processes (for the network case) ? > > Mathieu > for the CPU stuff take a look at ps: bob% ps aO%mem,%cpu,ppid PID %MEM %CPU PPID TT STAT TIME COMMAND 768 0.2 0.0 1 v0 Is+ 0:00.01 /usr/libexec/getty Pc ttyv0 769 0.2 0.0 1 v1 Is+ 0:00.01 /usr/libexec/getty Pc ttyv1 770 0.2 0.0 1 v2 Is+ 0:00.01 /usr/libexec/getty Pc ttyv2 771 0.2 0.0 1 v3 Is+ 0:00.01 /usr/libexec/getty Pc ttyv3 772 0.2 0.0 1 v4 Is+ 0:00.01 /usr/libexec/getty Pc ttyv4 773 0.2 0.0 1 v5 Is+ 0:00.01 /usr/libexec/getty Pc ttyv5 774 0.2 0.0 1 v6 Is+ 0:00.01 /usr/libexec/getty Pc ttyv6 775 0.2 0.0 1 v7 Is+ 0:00.01 /usr/libexec/getty Pc ttyv7 272 0.2 0.0 1 con- I 0:00.04 dhclient: le0 [priv] (dhclient) 951 0.6 0.0 949 p0 Rs 0:00.28 -zsh (zsh) 1056 0.2 0.0 951 p0 R+ 0:00.01 ps aO%mem,%cpu,ppid add what you need and you have your cpu and such stats, it might do your IO as well also look for thing in (s)bin that end in stat for things that might be a better fit. Network I do not know how to get you the level of access you want without root/trusted access at least on collection. You will not need it on processing. as far as managing thing after you have the information I have nothing for you there. good luck, marc -- Freedom is nothing but a chance to be better. Albert Camus From owner-freebsd-hackers@FreeBSD.ORG Mon May 26 22:45:21 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8D4E7106564A for ; Mon, 26 May 2008 22:45:21 +0000 (UTC) (envelope-from mathieu.prevot@gmail.com) Received: from fk-out-0910.google.com (fk-out-0910.google.com [209.85.128.187]) by mx1.freebsd.org (Postfix) with ESMTP id 11B8C8FC20 for ; Mon, 26 May 2008 22:45:20 +0000 (UTC) (envelope-from mathieu.prevot@gmail.com) Received: by fk-out-0910.google.com with SMTP id k31so2105552fkk.11 for ; Mon, 26 May 2008 15:45:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=nxooj2yjs0mnvCC6D9ZF+4N+D1x1SQMRQrm5UyKdSoE=; b=KkdORh61Pw0v0itdfEWnLR38qyqi7YUOYhzsp7i/WP33MskFJGMGsSgtEnan6W4jT9eXmzekZ4Fix4NPiMiyWjGcKntI1ldskN3IR00fAVYXMF3Fo1yJ3sTQADo+LOR0GnhfX7/lwETWgWbMej4+bQCNkP9aIQaqF8s3fJ9RgoM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=WTj7FKP9zBo0inStFEZNaxc9kz+1y0tKfB/BTVDssTazl7O2oHuANdJEbCRV8jRJvXMgGTcrMeGrbaF0HayLDO+ce16kqixdAhoeKkdsy1dPI+ywR1YNYHMfDrl913YK4Yypj8W9RxWRpsnSt7H/2TFl+9aoxX2NuSw77iJlzIw= Received: by 10.82.154.5 with SMTP id b5mr188405bue.45.1211833657400; Mon, 26 May 2008 13:27:37 -0700 (PDT) Received: by 10.82.170.10 with HTTP; Mon, 26 May 2008 13:27:37 -0700 (PDT) Message-ID: <3e473cc60805261327g38349857ga87dcfa0b855c1f6@mail.gmail.com> Date: Mon, 26 May 2008 22:27:37 +0200 From: "Mathieu Prevot" To: "Marc Spitzer" In-Reply-To: <8c50a3c30805261237y6573a2c9ra4af56477d93af78@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <3e473cc60805260752o2f573cf2h12910a45cf6849e6@mail.gmail.com> <20080526151614.GA5582@dan.emsphone.com> <3e473cc60805260914r537f113eh8d840a94c0a5d958@mail.gmail.com> <8c50a3c30805261237y6573a2c9ra4af56477d93af78@mail.gmail.com> Cc: hackers@freebsd.org, Dan Nelson Subject: Re: network bitrate of a poll of processes X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 May 2008 22:45:21 -0000 2008/5/26 Marc Spitzer : > On Mon, May 26, 2008 at 12:14 PM, Mathieu Prevot > wrote: >> 2008/5/26 Dan Nelson : >>> In the last episode (May 26), Mathieu Prevot said: >>>> Hi, >>>> >>>> I would like to know the bitrate of a pool of child processes that use >>>> a network connection, how can I have something like netstat -w1 >>>> provide but at the process level ? >>> >>> If you can segregate them to their own UID, you can use an ipfw "count >>> ip from any to any uid 6666" rule to count the packets. Another option >>> would be to jail them to a dedicated IP address and count traffic on >>> that IP. >> >> Both are nice... thank you. And don't you have something more portable >> ie. that could run on "any" posix os - like a sh script that use >> standard tools - and that doesn't need root user intervention ? >> >> Mathieu > > I do not think so, firewall for example is controlled by root. And > users do not generally have detailed access to other users > information. You can look into the BASM framework to track what your > apps are doing and if you know the behavior to expect you can use > netflow/argus/tcpdump to track that and post process the logs in each > case into something useful. > > What are you trying to do, details do help? > > marc I have a script that generates many child processes that download videos (~10MB) in this case, or do heavy data processing/analysing. I can tune the number of workers as I want, but It's a shared cluster so I would like to 1) measure 2) optimize/control (by number of workers ? at the script level ! so I can update thing very dynamically) a) CPU load b) IO on drive(s) c) network load and I prefer solutions that don't need root access/intervention. I can measure indirectly network load using `date +%s` and `du -b |sed 's/\t.*//' ` regularly... but I may have to deal with several 10GB later - and actually the number of files is more critical than their size. Maybe writing a (very) quick and dirty python app that listen/attach to a group of processes (for the network case) ? Mathieu From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 01:30:55 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B1A87106566B for ; Tue, 27 May 2008 01:30:55 +0000 (UTC) (envelope-from steve@Watt.COM) Received: from wattres.watt.com (wattres.watt.com [66.93.133.130]) by mx1.freebsd.org (Postfix) with ESMTP id 803D08FC0A for ; Tue, 27 May 2008 01:30:55 +0000 (UTC) (envelope-from steve@Watt.COM) Received: from wattres.watt.com (localhost.watt.com [127.0.0.1]) by wattres.watt.com (8.14.2/8.14.2) with ESMTP id m4R11huq075005; Mon, 26 May 2008 18:01:43 -0700 (PDT) (envelope-from steve@wattres.watt.com) Received: (from steve@localhost) by wattres.watt.com (8.14.2/8.14.2/Submit) id m4R11fEq075003; Mon, 26 May 2008 18:01:41 -0700 (PDT) (envelope-from steve) Message-Id: <200805270101.m4R11fEq075003@wattres.watt.com> X-Newsgroups: local.freebsd-hackers In-Reply-To: <7EB9398C5B46415B96D2C20A2E261E13@multiplay.co.uk> From: steve@Watt.COM (Steve Watt) References: <483B05DB.3000309@FreeBSD.org> <200805261936.m4QJaS7Q074045@apollo.backplane.com> Organization: Watt Consultants, San Jose, CA, USA Date: Mon, 26 May 2008 18:01:40 -0700 X-Mailer: Mail User's Shell (7.2.6 beta(5) 10/07/98) To: killing@multiplay.co.uk X-Archived: 1211850103.497617357@wattres.Watt.COM X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-3.0 (wattres.watt.com [127.0.0.1]); Mon, 26 May 2008 18:01:43 -0700 (PDT) Cc: hackers@freebsd.org Subject: Re: Using sendmsg for SCM_CREDS results in EINVAL on PF_INET socket X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 01:30:55 -0000 In <7EB9398C5B46415B96D2C20A2E261E13@multiplay.co.uk>, Steven Hartland wrote: [ Attributions fatally damaged, removing ] >> :> using the following code to send credentials to a remote host >> :> results in EINVAL from sendmsg. >> :> >> :> I suspect that SCM_CREDS is only valid for PF_LOCAL / PF_UNIX >> :> sockets and not PF_INET sockets and hence the code in dbus >> :> is actually invalid. >> :> >> :> Can anyone confirm this is the case or not? >> : >> :What would it even mean to send credentials to a remote host over an >> :AF_INET socket? >> >> The only way to do it is to do a connect-back to a secure port. In >> otherwords, to use the identd protocol. >> >> Control messages like SCM_CREDS (and descriptor passing for that matter) >> only work over local protocol sockets. > >Thank you for the confirmation guys. I'll look to create a patch >I can submit to the dbus project to disable the use of SCM_CREDS >when using PF_UNIX sockets. I think you got the sense backwards here; SCM_CREDS is OK when using PF_UNIX / PF_LOCAL. It's PF_INET that shouldn't be going there. Steve -- Steve Watt KD6GGD PP-ASEL-IA ICBM: 121W 56' 57.5" / 37N 20' 15.3" Internet: steve @ Watt.COM Whois: SW32-ARIN Free time? There's no such thing. It just comes in varying prices... From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 02:44:48 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 65CDB106567C for ; Tue, 27 May 2008 02:44:48 +0000 (UTC) (envelope-from keramida@ceid.upatras.gr) Received: from igloo.linux.gr (igloo.linux.gr [62.1.205.36]) by mx1.freebsd.org (Postfix) with ESMTP id B65188FC17 for ; Tue, 27 May 2008 02:44:47 +0000 (UTC) (envelope-from keramida@ceid.upatras.gr) Received: from kobe.laptop (adsl63-243.kln.forthnet.gr [77.49.190.243]) (authenticated bits=128) by igloo.linux.gr (8.14.3/8.14.3/Debian-1) with ESMTP id m4R2iXoq006595 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Tue, 27 May 2008 05:44:40 +0300 Received: from kobe.laptop (kobe.laptop [127.0.0.1]) by kobe.laptop (8.14.2/8.14.2) with ESMTP id m4R2iXLu029838; Tue, 27 May 2008 05:44:33 +0300 (EEST) (envelope-from keramida@ceid.upatras.gr) Received: (from keramida@localhost) by kobe.laptop (8.14.2/8.14.2/Submit) id m4R2iWRX029837; Tue, 27 May 2008 05:44:32 +0300 (EEST) (envelope-from keramida@ceid.upatras.gr) From: Giorgos Keramidas To: Andriy Gapon References: <483B1CEB.90405@icyb.net.ua> Date: Tue, 27 May 2008 05:44:32 +0300 In-Reply-To: <483B1CEB.90405@icyb.net.ua> (Andriy Gapon's message of "Mon, 26 May 2008 23:26:19 +0300") Message-ID: <87k5hg1n5b.fsf@kobe.laptop> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-MailScanner-ID: m4R2iXoq006595 X-Hellug-MailScanner: Found to be clean X-Hellug-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-3.818, required 5, autolearn=not spam, ALL_TRUSTED -1.80, AWL 0.58, BAYES_00 -2.60) X-Hellug-MailScanner-From: keramida@ceid.upatras.gr X-Spam-Status: No Cc: freebsd-hackers@freebsd.org Subject: Re: make universe: only kernels, no worlds X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 02:44:48 -0000 On Mon, 26 May 2008 23:26:19 +0300, Andriy Gapon wrote: > Is there a built-in way to do an equivalent of building universe but > only for kernels (and kernel tool-chains)? Or some straightforward to > emulate that? Yes, there is :) You can set MAKE_JUST_KERNELS: env MAKE_JUST_KERNELS='yes' make universe The tunable is a bit `hidden' in the src/Makefile code, near line 292: 292 universe_${target}: 293 .if !defined(MAKE_JUST_KERNELS) 294 @echo ">> ${target} started on `LC_ALL=C date`" 295 -cd ${.CURDIR} && ${MAKE} ${JFLAG} buildworld \ 296 TARGET=${target} \ 297 __MAKE_CONF=/dev/null \ 298 > _.${target}.buildworld 2>&1 299 @echo ">> ${target} buildworld completed on `LC_ALL=C date`" 300 .endif but it's there already. From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 04:39:18 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 068D41065676 for ; Tue, 27 May 2008 04:39:18 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (keira.kiwi-computer.com [63.224.10.3]) by mx1.freebsd.org (Postfix) with SMTP id A0CF48FC19 for ; Tue, 27 May 2008 04:39:17 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: (qmail 68745 invoked by uid 2001); 27 May 2008 04:12:36 -0000 Date: Mon, 26 May 2008 23:12:36 -0500 From: "Rick C. Petty" To: Jeremy Chadwick Message-ID: <20080527041236.GB68298@keira.kiwi-computer.com> References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080524201633.GA81364@eos.sc1.parodius.com> User-Agent: Mutt/1.4.2.3i Cc: freebsd-hackers@freebsd.org, m_evmenkin@yahoo.com, Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 04:39:18 -0000 On Sat, May 24, 2008 at 01:16:33PM -0700, Jeremy Chadwick wrote: > On Sat, May 24, 2008 at 01:38:08PM +1000, Fraser Tweedale wrote: > > Since upgrading to RELENG_7_0 I was experiencing momentary freezes (of > > about .5 seconds) whenever the capslock or numlock buttons were pressed. > > Let me guess -- you're using a USB keyboard. > > > The issue occurs both in console and in X, and for both ULE and 4BSD. The > > problem was reproducible with USB keyboards only (ukbd); atkbd seems fine. > > It also occurs when numlockx is used to set numlock on or off without > > keyboard interaction. > > I figured as much. I hadn't checked numlock/capslock myself, but vcons > switching also has that problem. Yes, it's semi-documented; see section > "USB" below: > > http://wiki.freebsd.org/JeremyChadwick/Commonly_reported_issues > > For what it's worth, the systems I've confirmed the problem on are Intel > and nForce 4. Meaning, the issue is not specific to a single chipset. I've seen this on certain chipsets (nForce4, Intel) and not on others (nForce5+). I originally reported this problem over two years ago: http://lists.freebsd.org/pipermail/freebsd-hackers/2006-March/015724.html This problem started when the kbdmux was added to the kernel and has not been fixed since (although the "delay" has been reduced from around two seconds to about 0.4 seconds). I verified the problem still persists with 7-stable as of last week. This "pause" actually blocks the entire kernel, not just things under GIANT. One test involved having a gmirror sync or fsck run while I switched virtal consoles and watched the drive activity LEDs turn off for the entire duration of the pause. > > Interestingly, if you add enough keyboards, the problem vanishes, which led > > me to kbdmux. Sure enough, removing device kbdmux from the kernel makes > > the problem go away (at the expensive of some functionality of course, but > > this is my current workaround). > > An interesting find! I'll add this to the details in the above wiki. > I've also CC'd kbdmux's maintainer. I've noticed that even plugging in a PS/2 keyboard fixes the problem. However unplugging the PS/2 keyboard restores the problematic behavior. I never found a solution to this problem except for buying different hardware or keeping a PS/2 keyboard plugged in. Being that the issue is on your wiki page, does that mean this problem will be fixed some day? -- Rick C. Petty From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 05:11:10 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0CA411065687 for ; Tue, 27 May 2008 05:11:10 +0000 (UTC) (envelope-from jdc@parodius.com) Received: from mx01.sc1.parodius.com (mx01.sc1.parodius.com [72.20.106.3]) by mx1.freebsd.org (Postfix) with ESMTP id EBA078FC20 for ; Tue, 27 May 2008 05:11:09 +0000 (UTC) (envelope-from jdc@parodius.com) Received: by mx01.sc1.parodius.com (Postfix, from userid 1000) id 9EE181CC033; Mon, 26 May 2008 22:11:09 -0700 (PDT) Date: Mon, 26 May 2008 22:11:09 -0700 From: Jeremy Chadwick To: "Rick C. Petty" Message-ID: <20080527051109.GA26502@eos.sc1.parodius.com> References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> <20080527041236.GB68298@keira.kiwi-computer.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080527041236.GB68298@keira.kiwi-computer.com> User-Agent: Mutt/1.5.17 (2007-11-01) Cc: freebsd-hackers@freebsd.org, m_evmenkin@yahoo.com, Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 05:11:10 -0000 On Mon, May 26, 2008 at 11:12:36PM -0500, Rick C. Petty wrote: > On Sat, May 24, 2008 at 01:16:33PM -0700, Jeremy Chadwick wrote: > > On Sat, May 24, 2008 at 01:38:08PM +1000, Fraser Tweedale wrote: > > > Since upgrading to RELENG_7_0 I was experiencing momentary freezes (of > > > about .5 seconds) whenever the capslock or numlock buttons were pressed. > > > > Let me guess -- you're using a USB keyboard. > > > > > The issue occurs both in console and in X, and for both ULE and 4BSD. The > > > problem was reproducible with USB keyboards only (ukbd); atkbd seems fine. > > > It also occurs when numlockx is used to set numlock on or off without > > > keyboard interaction. > > > > I figured as much. I hadn't checked numlock/capslock myself, but vcons > > switching also has that problem. Yes, it's semi-documented; see section > > "USB" below: > > > > http://wiki.freebsd.org/JeremyChadwick/Commonly_reported_issues > > > > For what it's worth, the systems I've confirmed the problem on are Intel > > and nForce 4. Meaning, the issue is not specific to a single chipset. > > I've seen this on certain chipsets (nForce4, Intel) and not on others > (nForce5+). I originally reported this problem over two years ago: > > http://lists.freebsd.org/pipermail/freebsd-hackers/2006-March/015724.html > > This problem started when the kbdmux was added to the kernel and has not > been fixed since (although the "delay" has been reduced from around two > seconds to about 0.4 seconds). I verified the problem still persists with > 7-stable as of last week. > > This "pause" actually blocks the entire kernel, not just things under > GIANT. One test involved having a gmirror sync or fsck run while I > switched virtal consoles and watched the drive activity LEDs turn off for > the entire duration of the pause. > > > > Interestingly, if you add enough keyboards, the problem vanishes, which led > > > me to kbdmux. Sure enough, removing device kbdmux from the kernel makes > > > the problem go away (at the expensive of some functionality of course, but > > > this is my current workaround). > > > > An interesting find! I'll add this to the details in the above wiki. > > I've also CC'd kbdmux's maintainer. > > I've noticed that even plugging in a PS/2 keyboard fixes the problem. > However unplugging the PS/2 keyboard restores the problematic behavior. > I never found a solution to this problem except for buying different > hardware or keeping a PS/2 keyboard plugged in. > > Being that the issue is on your wiki page, does that mean this problem will > be fixed some day? Hopefully. :-) I'd like to point fingers at kbdmux being the responsible piece, but the USB stack has a history of being flakey in many regards, hence my reluctance. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 05:48:43 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CDCC71065678 for ; Tue, 27 May 2008 05:48:43 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (keira.kiwi-computer.com [63.224.10.3]) by mx1.freebsd.org (Postfix) with SMTP id 5EE9F8FC18 for ; Tue, 27 May 2008 05:48:43 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: (qmail 69714 invoked by uid 2001); 27 May 2008 05:48:42 -0000 Date: Tue, 27 May 2008 00:48:42 -0500 From: "Rick C. Petty" To: Jeremy Chadwick Message-ID: <20080527054842.GA69670@keira.kiwi-computer.com> References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> <20080527041236.GB68298@keira.kiwi-computer.com> <20080527051109.GA26502@eos.sc1.parodius.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080527051109.GA26502@eos.sc1.parodius.com> User-Agent: Mutt/1.4.2.3i Cc: freebsd-hackers@freebsd.org, m_evmenkin@yahoo.com, Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 05:48:43 -0000 On Mon, May 26, 2008 at 10:11:09PM -0700, Jeremy Chadwick wrote: > > > > Being that the issue is on your wiki page, does that mean this problem will > > be fixed some day? > > Hopefully. :-) I'd like to point fingers at kbdmux being the > responsible piece, but the USB stack has a history of being flakey in > many regards, hence my reluctance. Agreed. I was never able to pinpoint it myself, but it certainly didn't show up before kbdmux. -- Rick C. Petty From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 08:21:28 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BDF4D106567C for ; Tue, 27 May 2008 08:21:28 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from hosted.kievnet.com (hosted.kievnet.com [193.138.144.10]) by mx1.freebsd.org (Postfix) with ESMTP id 761E48FC2E for ; Tue, 27 May 2008 08:21:28 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from localhost ([127.0.0.1] helo=edge.pp.kiev.ua) by hosted.kievnet.com with esmtpa (Exim 4.62) (envelope-from ) id 1K0uQw-0001bA-9V; Tue, 27 May 2008 11:21:26 +0300 Message-ID: <483BC480.2030302@icyb.net.ua> Date: Tue, 27 May 2008 11:21:20 +0300 From: Andriy Gapon User-Agent: Thunderbird 2.0.0.12 (X11/20080320) MIME-Version: 1.0 To: Giorgos Keramidas References: <483B1CEB.90405@icyb.net.ua> <87k5hg1n5b.fsf@kobe.laptop> In-Reply-To: <87k5hg1n5b.fsf@kobe.laptop> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: make universe: only kernels, no worlds X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 08:21:28 -0000 on 27/05/2008 05:44 Giorgos Keramidas said the following: > On Mon, 26 May 2008 23:26:19 +0300, Andriy Gapon wrote: >> Is there a built-in way to do an equivalent of building universe but >> only for kernels (and kernel tool-chains)? Or some straightforward to >> emulate that? > > Yes, there is :) > > You can set MAKE_JUST_KERNELS: Thank you! The name is very intuitive, I should have grep-ed for something like this :-) > env MAKE_JUST_KERNELS='yes' make universe > > The tunable is a bit `hidden' in the src/Makefile code, near line 292: > > 292 universe_${target}: > 293 .if !defined(MAKE_JUST_KERNELS) > 294 @echo ">> ${target} started on `LC_ALL=C date`" > 295 -cd ${.CURDIR} && ${MAKE} ${JFLAG} buildworld \ > 296 TARGET=${target} \ > 297 __MAKE_CONF=/dev/null \ > 298 > _.${target}.buildworld 2>&1 > 299 @echo ">> ${target} buildworld completed on `LC_ALL=C date`" > 300 .endif > > but it's there already. > -- Andriy Gapon From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 09:19:59 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 264E0106566B for ; Tue, 27 May 2008 09:19:59 +0000 (UTC) (envelope-from prvs=10337ef692=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id A9D8E8FC14 for ; Tue, 27 May 2008 09:19:58 +0000 (UTC) (envelope-from prvs=10337ef692=killing@multiplay.co.uk) DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=multiplay.co.uk; s=Multiplay; t=1211879102; x=1212483902; q=dns/txt; h=Received: Message-ID:From:To:Cc:References:Subject:Date:MIME-Version: Content-Type:Content-Transfer-Encoding; bh=H34nVLxFaDBZ0B6F6CaUq MF9H6e0ioVAnwzHXY+y/84=; b=FjQkMNLZv8zpfSN9KnwtABf7dfrK+5l2G1Eya jNE3rm+xuL+6QfxWuHyY6Nw3nU71JVkb7ktlfPG8jkFsjHe+o57dU1E8gUCBEpoj l/0ECq18bUZThIX34QEQKhQpukeaV3xXIDvKbuN/ENd/R/DSvZ7jJLINGFHCfZZq WIq/lY= X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-14.7 required=6.0 tests=BAYES_00, FORGED_MUA_OUTLOOK, USER_IN_WHITELIST,USER_IN_WHITELIST_TO autolearn=ham version=3.1.8 Received: from r2d2 by mail1.multiplay.co.uk (MDaemon PRO v9.6.5) with ESMTP id md50005672277.msg for ; Tue, 27 May 2008 10:05:00 +0100 X-Authenticated-Sender: Killing@multiplay.co.uk X-MDRemoteIP: 212.135.219.182 X-Return-Path: prvs=10337ef692=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: hackers@freebsd.org Message-ID: <39E6E2BA17E34472BC3E05749632E766@multiplay.co.uk> From: "Steven Hartland" To: "Steve Watt" References: <483B05DB.3000309@FreeBSD.org><200805261936.m4QJaS7Q074045@apollo.backplane.com> <200805270101.m4R11fEq075003@wattres.watt.com> Date: Tue, 27 May 2008 10:04:55 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="Windows-1252"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5512 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.5512 X-Spam-Processed: mail1.multiplay.co.uk, Tue, 27 May 2008 10:05:01 +0100 X-MDAV-Processed: mail1.multiplay.co.uk, Tue, 27 May 2008 10:05:02 +0100 Cc: hackers@freebsd.org Subject: Re: Using sendmsg for SCM_CREDS results in EINVAL on PF_INET socket X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 09:19:59 -0000 ----- Original Message ----- From: "Steve Watt" >>Thank you for the confirmation guys. I'll look to create a patch >>I can submit to the dbus project to disable the use of SCM_CREDS >>when using PF_UNIX sockets. > > I think you got the sense backwards here; SCM_CREDS is OK when using > PF_UNIX / PF_LOCAL. It's PF_INET that shouldn't be going there. Yer just posted while tired ;-) Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 18:00:13 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3CCD1106566C for ; Tue, 27 May 2008 18:00:13 +0000 (UTC) (envelope-from maksim.yevmenkin@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.228]) by mx1.freebsd.org (Postfix) with ESMTP id 0F4BC8FC22 for ; Tue, 27 May 2008 18:00:12 +0000 (UTC) (envelope-from maksim.yevmenkin@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so3017160rvf.43 for ; Tue, 27 May 2008 11:00:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=db1a8HZbRQNnbBR1q89wtuwv+UhvxoKaF8qt4tizUT4=; b=vozSVaDBCiR7J5KCfpvJhoLC4+mQPsUlIl01AiTIhfD66z2Gs66IXCO7GPbZ94qE63kSjrruGMF0u3/u1Q34QlOGpfI7WjpyFFJ381F1dAI8GIwPhOPjDUEcy8gm90tHYXAqp6aOuHc+G4fWn/o7ZR0vvRPn2YlbfFL8TsDOpn8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=pS/a5s6NheMdAkZVMnu7/TThY4WjkE5q5ZDaFK7qDaeAqRdr8oGnCDKxeN4ZWzOvw75cZeoP5nVp/JsPfGXRW0CZ2HAWwcPiB9VomRGGHoIBh7Nclt0l0L0RL0qArXA9RID3Lql5AXEWxAtJAl0H0LVwDhTF74fY8UuaBNFnbpQ= Received: by 10.141.15.19 with SMTP id s19mr665115rvi.39.1211909687819; Tue, 27 May 2008 10:34:47 -0700 (PDT) Received: by 10.141.178.21 with HTTP; Tue, 27 May 2008 10:34:47 -0700 (PDT) Message-ID: Date: Tue, 27 May 2008 10:34:47 -0700 From: "Maksim Yevmenkin" To: rick-freebsd@kiwi-computer.com In-Reply-To: <20080527054842.GA69670@keira.kiwi-computer.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> <20080527041236.GB68298@keira.kiwi-computer.com> <20080527051109.GA26502@eos.sc1.parodius.com> <20080527054842.GA69670@keira.kiwi-computer.com> Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , m_evmenkin@yahoo.com, Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 18:00:13 -0000 On 5/26/08, Rick C. Petty wrote: > On Mon, May 26, 2008 at 10:11:09PM -0700, Jeremy Chadwick wrote: > > > > > > Being that the issue is on your wiki page, does that mean this problem will > > > be fixed some day? > > > > Hopefully. :-) I'd like to point fingers at kbdmux being the > > responsible piece, but the USB stack has a history of being flakey in > > many regards, hence my reluctance. > > > Agreed. I was never able to pinpoint it myself, but it certainly didn't > show up before kbdmux. 1) what keyboards are used? usb only, ps2 only or mix? 2) what mice are used? usb only, ps2 only or mix? if ps2 devices (i.e. keyboard and mouse) are not used at all, does disabling atkbd(4) and/or psm(4) help? thanks, max From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 19:45:55 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 879B31065673 for ; Tue, 27 May 2008 19:45:55 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (keira.kiwi-computer.com [63.224.10.3]) by mx1.freebsd.org (Postfix) with SMTP id 30E9D8FC12 for ; Tue, 27 May 2008 19:45:55 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: (qmail 81161 invoked by uid 2001); 27 May 2008 19:45:54 -0000 Date: Tue, 27 May 2008 14:45:54 -0500 From: "Rick C. Petty" To: Maksim Yevmenkin Message-ID: <20080527194554.GA79741@keira.kiwi-computer.com> References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> <20080527041236.GB68298@keira.kiwi-computer.com> <20080527051109.GA26502@eos.sc1.parodius.com> <20080527054842.GA69670@keira.kiwi-computer.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , m_evmenkin@yahoo.com, Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 19:45:55 -0000 On Tue, May 27, 2008 at 10:34:47AM -0700, Maksim Yevmenkin wrote: > > > > Agreed. I was never able to pinpoint it myself, but it certainly didn't > > show up before kbdmux. > > 1) what keyboards are used? usb only, ps2 only or mix? > > 2) what mice are used? usb only, ps2 only or mix? > > if ps2 devices (i.e. keyboard and mouse) are not used at all, does > disabling atkbd(4) and/or psm(4) help? I think I stated this in my original thread but let me restate. I've only noticed the problem when both usbkbd and atkbd are both enabled (as in the GENERIC kernel) and a USB keyboard (only) is attached. Once I plug in the atkbd, the problem goes away. The problem also does not exist if just the atkbd is plugged in with no USB keyboard. I haven't noticed a problem with the mice, but I've not used a PS/2 mouse in almost a decade. I have noticed a problem which has hit me rarely on a 6.x system; perhaps because the problem is not easily reproducable have I never seen it in 7.x. Basically I've seen the kernel get "stuck" and the only way to unstick it was to move the USB mouse. Moving the mouse allowed the interrupt to trigger and things would happen elsewhere in the kernel, but as soon as I stopped moving the mouse everything else stopped (ata reads/writes, graphics updates, etc.). Unplugging the mouse was a bad idea because the plugin event never triggered. I've only witnessed this on post-kbdmux systems but since it wasn't reproducable in any reliable fashion, I couldn't pin the problem down. -- Rick C. Petty From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 20:32:14 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4518B106567C for ; Tue, 27 May 2008 20:32:14 +0000 (UTC) (envelope-from maksim.yevmenkin@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.155]) by mx1.freebsd.org (Postfix) with ESMTP id AAC7E8FC1F for ; Tue, 27 May 2008 20:32:12 +0000 (UTC) (envelope-from maksim.yevmenkin@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so1859416fgb.35 for ; Tue, 27 May 2008 13:32:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=yO0Xs6FSs+enNTtVzpzlAV6HUd7qM3YaBezzE+bZg1c=; b=vIza82BBqG2HK9/Ru7EkYSqDRzW6fOfw2DgLGACzMOghC56w3i2F2Aawtqb2o36yS46jyF61m9nOpESHWU6J32i2gBidqztMtB9lrWs/nqlI9oUUg8Dl2WbUiUSfGLwdADHjs+9uKr15nnKnd1PnVAtxBAnvgTcdaLJliUYDY4c= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=f27JTeeF3Ly/cit903zsEV/ujPQpYrcJv44ZyhSJ2k7LbMze38tvb/0l2buSvpY4XwXy5jFrBz8E+X8yjgZM6dmnYhK5/37+1EuloXDAXhAh4RDZv4RvrsL4yL3HM2TZPbKaHX3CGO5g3wUiRTFBC+VaN718pIUutVufmzrXY80= Received: by 10.86.89.4 with SMTP id m4mr7749597fgb.55.1211920330866; Tue, 27 May 2008 13:32:10 -0700 (PDT) Received: by 10.86.66.5 with HTTP; Tue, 27 May 2008 13:32:10 -0700 (PDT) Message-ID: Date: Tue, 27 May 2008 13:32:10 -0700 From: "Maksim Yevmenkin" To: rick-freebsd@kiwi-computer.com In-Reply-To: <20080527194554.GA79741@keira.kiwi-computer.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> <20080527041236.GB68298@keira.kiwi-computer.com> <20080527051109.GA26502@eos.sc1.parodius.com> <20080527054842.GA69670@keira.kiwi-computer.com> <20080527194554.GA79741@keira.kiwi-computer.com> Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , m_evmenkin@yahoo.com, Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 20:32:14 -0000 On 5/27/08, Rick C. Petty wrote: > On Tue, May 27, 2008 at 10:34:47AM -0700, Maksim Yevmenkin wrote: > > > > > > Agreed. I was never able to pinpoint it myself, but it certainly didn't > > > show up before kbdmux. > > > > 1) what keyboards are used? usb only, ps2 only or mix? > > > > 2) what mice are used? usb only, ps2 only or mix? > > > > if ps2 devices (i.e. keyboard and mouse) are not used at all, does > > disabling atkbd(4) and/or psm(4) help? > > > I think I stated this in my original thread but let me restate. I've only > noticed the problem when both usbkbd and atkbd are both enabled (as in the > GENERIC kernel) and a USB keyboard (only) is attached. Once I plug in the > atkbd, the problem goes away. The problem also does not exist if just the > atkbd is plugged in with no USB keyboard. right, which (to me) seems to indicate that something is going wrong when kbdmux is trying to work on two keyboards (i.e. ukbd and atkbd) and one of them (i.e. atkbd) is "not present". the problem, as i see it, is that atkbd keyboard is always present even if no physical ps2 keyboard is connected to the ps2 port. i understand that people are doing this in order to be able to "hot plug" ps2 keyboard (which is a bad idea as ps2 port was never designed to be "hot pluggable", imo). now, kbdmux simply switches all slave keyboards into raw mode and pretends to have one keyboard with lots of duplicated keys. it also tries to preserve consistent state on all slave keyboards. so, for example, when num/scroll/capslock etc. key is pressed, ioctl is called to light up corresponding led on the keyboard. this ioctl calls driver specific routine which will talk to the hardware. because kbdmux tries to keep consistent state, it will call this ioctl for every slave keyboard. i suspect that because physical ps2 keyboard is not actually present, the atkbd driver will have to timeout while talking to non-present hardware. obviously the things "work" without kbdmux because without kbdmux it is not possible to have a keyboard without physical keyboard present. well, technically it is possible with atkbd, but then one could not press any keys to trigger atkbd driver to talk back to the non-present hardware. i suppose it is possible to write a simple program that uses console ioctl to flash keyboard leds and try to run it on a machine without kbdmux and no physical keyboard attached to the ps2 port to see if this triggers the same problem. so, as a suggestion, please try to specify 0x1 flag to atkbd, i.e. from atkbd(4) Driver Flags The atkbd driver accepts the following driver flags. They can be set either in /boot/device.hints, or else from within the boot loader (see loader(8)). bit 0 (FAIL_IF_NO_KBD) By default the atkbd driver will install even if a keyboard is not actually connected to the system. This option prevents the driver from being installed in this situation. ... and see if this helps. you wont be able to "hot plug" ps2 keyboards, but i suspect you probably can live without it. > I haven't noticed a problem with the mice, but I've not used a PS/2 mouse > in almost a decade. I have noticed a problem which has hit me rarely on a > 6.x system; perhaps because the problem is not easily reproducable have I > never seen it in 7.x. Basically I've seen the kernel get "stuck" and the > only way to unstick it was to move the USB mouse. Moving the mouse allowed > the interrupt to trigger and things would happen elsewhere in the kernel, > but as soon as I stopped moving the mouse everything else stopped (ata > reads/writes, graphics updates, etc.). Unplugging the mouse was a bad idea > because the plugin event never triggered. I've only witnessed this on > post-kbdmux systems but since it wasn't reproducable in any reliable > fashion, I couldn't pin the problem down. well, i'm not sure it is the same problem, but if you have a way to reproduce it reliably and believe that it is a kbdmux related problem please let me know. thanks, max From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 21:01:59 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0EF9F1065674 for ; Tue, 27 May 2008 21:01:59 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (keira.kiwi-computer.com [63.224.10.3]) by mx1.freebsd.org (Postfix) with SMTP id A4F148FC1A for ; Tue, 27 May 2008 21:01:58 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: (qmail 82263 invoked by uid 2001); 27 May 2008 21:01:58 -0000 Date: Tue, 27 May 2008 16:01:58 -0500 From: "Rick C. Petty" To: Maksim Yevmenkin Message-ID: <20080527210158.GB81555@keira.kiwi-computer.com> References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> <20080527041236.GB68298@keira.kiwi-computer.com> <20080527051109.GA26502@eos.sc1.parodius.com> <20080527054842.GA69670@keira.kiwi-computer.com> <20080527194554.GA79741@keira.kiwi-computer.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , m_evmenkin@yahoo.com, Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 21:01:59 -0000 On Tue, May 27, 2008 at 01:32:10PM -0700, Maksim Yevmenkin wrote: > > right, which (to me) seems to indicate that something is going wrong > when kbdmux is trying to work on two keyboards (i.e. ukbd and atkbd) > and one of them (i.e. atkbd) is "not present". the problem, as i see > it, is that atkbd keyboard is always present even if no physical ps2 > keyboard is connected to the ps2 port. That's precisely how I see it. > i understand that people are > doing this in order to be able to "hot plug" ps2 keyboard (which is a > bad idea as ps2 port was never designed to be "hot pluggable", imo). Although not designed as hot pluggable, there's nothing in the technical specs which should prevent it. In fact, the specs imply that this is plausible. The only issue I know about is when older hardware didn't have TVS or line driver protection which could blow the serial driver chips (on either side) for example when both the keyboard and host try to drive the clock at the same time, but I doubt is a problem with modern hardware. Also, I believe the spec specifies the proper use of pullup resistors, so this shouldn't be a problem. A common complaint I've heard is that some (cheap) keyboards don't respond with a power-on self test completed (0xAA) when they are initially plugged in until they receive an initial command from the host. I've never seen such a keyboard; most keyboards send 0xAA immediately after power on, IIRC. > i suspect that because physical ps2 keyboard is not actually > present, the atkbd driver will have to timeout while talking to > non-present hardware. Sure, but this timeout shouldn't be ~0.4 seconds. I believe the spec says the maximum wait period to tell if the device is nonresponsive is around or less than 20ms. Certainly, blocking the entire kernel for the timeout is a bad thing, especially since the driver should make full use of the asynchronous onboard keyboard controller. > so, as a suggestion, please try to specify 0x1 flag to atkbd, i.e. from atkbd(4) > ... > > and see if this helps. you wont be able to "hot plug" ps2 keyboards, > but i suspect you probably can live without it. I'm almost certain this will help, but I believe this shouldn't be the answer to this problem. There's no reason atkbdc(4) should block the entire kernel for any appreciable amount of time. -- Rick C. Petty From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 21:01:07 2008 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6E4DE1065677 for ; Tue, 27 May 2008 21:01:07 +0000 (UTC) (envelope-from gabor@kovesdan.org) Received: from viefep28-int.chello.at (viefep28-int.chello.at [62.179.121.48]) by mx1.freebsd.org (Postfix) with ESMTP id B7FA78FC20 for ; Tue, 27 May 2008 21:01:06 +0000 (UTC) (envelope-from gabor@kovesdan.org) Received: from [86.101.217.227] by viefep20-int.chello.at (InterMail vM.7.08.02.02 201-2186-121-104-20070414) with ESMTP id <20080527204510.QGHX29278.viefep20-int.chello.at@[86.101.217.227]>; Tue, 27 May 2008 22:45:10 +0200 Message-ID: <483C72D4.7030806@kovesdan.org> Date: Tue, 27 May 2008 22:45:08 +0200 From: Gabor Kovesdan User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) MIME-Version: 1.0 To: hackers@FreeBSD.org, fjoe@FreeBSD.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Mailman-Approved-At: Tue, 27 May 2008 21:26:18 +0000 Cc: Subject: Progress of the BSD-licensed grep, sort and diff X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 21:01:07 -0000 Hello all, as you might have already known, I'm working on the BSD-licensed versions of these utilities, porting them from OpenBSD and complete the functionality. Still, I have a lot to do, but here's a little bit of status report: grep: - Implemented --label - Implemented --null - Implemented -D / --devices - Implemented -H / --with-filename - Implemented --version - Eliminate warnings - style(9) cleanup sort: - Added support for long command line options - Implemented -S / --buffer-size - Implemented --version - Eliminate warnings - style(9) cleanup diff: - Implemented --version - Eliminate warnings - style(9) cleanup Apart from the missing features, they should work fine, you can try it via the bsdgrep, bsdsort and bsddiff ports in the textproc category. These ports create bsd* and gnu* symlinks for the easier testing. If any of you could use these ports and report the possible problems, that would be cool. Cheers, Gábor Kövesdán From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 21:28:28 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9188F1065670 for ; Tue, 27 May 2008 21:28:28 +0000 (UTC) (envelope-from maksim.yevmenkin@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.156]) by mx1.freebsd.org (Postfix) with ESMTP id 197388FC22 for ; Tue, 27 May 2008 21:28:27 +0000 (UTC) (envelope-from maksim.yevmenkin@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so1871697fgb.35 for ; Tue, 27 May 2008 14:28:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=fWnWjXR0T7Zf/C9c7HAAYE7RbbTM35iBH4enJ3TCTxI=; b=xnAAEtrI027hwVeFGvXvaAi68jJ4wLkCoAJ9AjRN8+6Jo771JlBLQ3M65o+aaC/JoHg434vwPH1szwJlSD5lsSMdOnhSuN029x6piepcVKNRZdFmmoDqgC1XMDDWXCpAxQdaHmS0tWqjxsAssCwHXzqLm522RxOhCzOey/SGO9Y= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=OdnSnfuk87cqFqeo7nk3YTh4K0ZS2/LqgqiqiI8jxRgARrF9v6D3L6yPaFmrG8VBRxmC8SaHQlmOyiDrymjDLiOydfiMoUYbsHdeegIZrPPlALFs3lNrcdbRwuo7Y7zQb5TXgy+WfAkTtBXQ3LTXN2y1uXbPW+RFv74k9JSlqzk= Received: by 10.86.98.10 with SMTP id v10mr7605076fgb.46.1211923706051; Tue, 27 May 2008 14:28:26 -0700 (PDT) Received: by 10.86.66.5 with HTTP; Tue, 27 May 2008 14:28:26 -0700 (PDT) Message-ID: Date: Tue, 27 May 2008 14:28:26 -0700 From: "Maksim Yevmenkin" To: rick-freebsd@kiwi-computer.com In-Reply-To: <20080527210158.GB81555@keira.kiwi-computer.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> <20080527041236.GB68298@keira.kiwi-computer.com> <20080527051109.GA26502@eos.sc1.parodius.com> <20080527054842.GA69670@keira.kiwi-computer.com> <20080527194554.GA79741@keira.kiwi-computer.com> <20080527210158.GB81555@keira.kiwi-computer.com> Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 21:28:28 -0000 On 5/27/08, Rick C. Petty wrote: > On Tue, May 27, 2008 at 01:32:10PM -0700, Maksim Yevmenkin wrote: > > [...] > > i suspect that because physical ps2 keyboard is not actually > > present, the atkbd driver will have to timeout while talking to > > non-present hardware. > > Sure, but this timeout shouldn't be ~0.4 seconds. I believe the spec says > the maximum wait period to tell if the device is nonresponsive is around or > less than 20ms. Certainly, blocking the entire kernel for the timeout is a > bad thing, especially since the driver should make full use of the > asynchronous onboard keyboard controller. well, i just took a brief look at atkbd(4). specifically one function - wait_while_controller_busy(). this function polls status every KBDC_DELAYTIME (20) usec with retry count of 5000. so, just this function alone can give up to 100 msec delay. keep in mind that wait_while_controller_busy() is apparently called every time driver need to talk to the hardware. i can see how we could delay kernel for 400 msec or even more. > > so, as a suggestion, please try to specify 0x1 flag to atkbd, i.e. from atkbd(4) > > ... > > > > and see if this helps. you wont be able to "hot plug" ps2 keyboards, > > but i suspect you probably can live without it. > > I'm almost certain this will help, but I believe this shouldn't be the > answer to this problem. There's no reason atkbdc(4) should block the > entire kernel for any appreciable amount of time. agree. all i was trying to say is that kbdmux is only as good as underlying low level keyboard drivers. if a low level keyboard driver uses completely synchronous approach to poll the hardware, there is not much kbdmux can do about it. thanks, max From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 21:37:06 2008 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 906C110656A8; Tue, 27 May 2008 21:37:06 +0000 (UTC) (envelope-from gabor@FreeBSD.org) Received: from viefep32-int.chello.at (viefep32-int.chello.at [62.179.121.50]) by mx1.freebsd.org (Postfix) with ESMTP id AC7998FC17; Tue, 27 May 2008 21:37:05 +0000 (UTC) (envelope-from gabor@FreeBSD.org) Received: from [86.101.217.227] by viefep32-int.chello.at (InterMail vM.7.08.02.02 201-2186-121-104-20070414) with ESMTP id <20080527213703.SWEF24015.viefep32-int.chello.at@[86.101.217.227]>; Tue, 27 May 2008 23:37:03 +0200 Message-ID: <483C7F00.4060007@FreeBSD.org> Date: Tue, 27 May 2008 23:37:04 +0200 From: Gabor Kovesdan User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) MIME-Version: 1.0 To: hackers@FreeBSD.org, fjoe@FreeBSD.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: Subject: Progress of the BSD-licensed grep, sort and diff X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 21:37:06 -0000 Hello all, as you might have already known, I'm working on the BSD-licensed versions of these utilities, porting them from OpenBSD and complete the functionality. Still, I have a lot to do, but here's a little bit of status report: grep: - Implemented --label - Implemented --null - Implemented -D / --devices - Implemented -H / --with-filename - Implemented --version - Eliminate warnings - style(9) cleanup sort: - Added support for long command line options - Implemented -S / --buffer-size - Implemented --version - Eliminate warnings - style(9) cleanup diff: - Implemented --version - Eliminate warnings - style(9) cleanup Apart from the missing features, they should work fine, you can try it via the bsdgrep, bsdsort and bsddiff ports in the textproc category. These ports create bsd* and gnu* symlinks for the easier testing. If any of you could use these ports and report the possible problems, that would be cool. Cheers, Gábor Kövesdán From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 21:37:10 2008 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D8BCA1065680; Tue, 27 May 2008 21:37:10 +0000 (UTC) (envelope-from gabor@FreeBSD.org) Received: from viefep11-int.chello.at (viefep11-int.chello.at [62.179.121.31]) by mx1.freebsd.org (Postfix) with ESMTP id 013AC8FC15; Tue, 27 May 2008 21:37:09 +0000 (UTC) (envelope-from gabor@FreeBSD.org) Received: from [86.101.217.227] by viefep11-int.chello.at (InterMail vM.7.08.02.02 201-2186-121-104-20070414) with ESMTP id <20080527213708.CIUR7426.viefep11-int.chello.at@[86.101.217.227]>; Tue, 27 May 2008 23:37:08 +0200 Message-ID: <483C7F04.4030003@FreeBSD.org> Date: Tue, 27 May 2008 23:37:08 +0200 From: Gabor Kovesdan User-Agent: Thunderbird 2.0.0.14 (Windows/20080421) MIME-Version: 1.0 To: hackers@FreeBSD.org, fjoe@FreeBSD.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: Subject: Progress of the BSD-licensed grep, sort and diff X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 21:37:10 -0000 Hello all, as you might have already known, I'm working on the BSD-licensed versions of these utilities, porting them from OpenBSD and complete the functionality. Still, I have a lot to do, but here's a little bit of status report: grep: - Implemented --label - Implemented --null - Implemented -D / --devices - Implemented -H / --with-filename - Implemented --version - Eliminate warnings - style(9) cleanup sort: - Added support for long command line options - Implemented -S / --buffer-size - Implemented --version - Eliminate warnings - style(9) cleanup diff: - Implemented --version - Eliminate warnings - style(9) cleanup Apart from the missing features, they should work fine, you can try it via the bsdgrep, bsdsort and bsddiff ports in the textproc category. These ports create bsd* and gnu* symlinks for the easier testing. If any of you could use these ports and report the possible problems, that would be cool. Cheers, Gábor Kövesdán From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 22:42:58 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0A4D11065674 for ; Tue, 27 May 2008 22:42:58 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (keira.kiwi-computer.com [63.224.10.3]) by mx1.freebsd.org (Postfix) with SMTP id 8B7EC8FC15 for ; Tue, 27 May 2008 22:42:57 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: (qmail 83420 invoked by uid 2001); 27 May 2008 22:42:56 -0000 Date: Tue, 27 May 2008 17:42:56 -0500 From: "Rick C. Petty" To: Maksim Yevmenkin Message-ID: <20080527224256.GA83303@keira.kiwi-computer.com> References: <48378DA0.8040506@frase.id.au> <20080524201633.GA81364@eos.sc1.parodius.com> <20080527041236.GB68298@keira.kiwi-computer.com> <20080527051109.GA26502@eos.sc1.parodius.com> <20080527054842.GA69670@keira.kiwi-computer.com> <20080527194554.GA79741@keira.kiwi-computer.com> <20080527210158.GB81555@keira.kiwi-computer.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 22:42:58 -0000 On Tue, May 27, 2008 at 02:28:26PM -0700, Maksim Yevmenkin wrote: > > well, i just took a brief look at atkbd(4). specifically one function > - wait_while_controller_busy(). this function polls status every > KBDC_DELAYTIME (20) usec with retry count of 5000. so, just this > function alone can give up to 100 msec delay. keep in mind that > wait_while_controller_busy() is apparently called every time driver > need to talk to the hardware. i can see how we could delay kernel for > 400 msec or even more. I'm not sure why we retry 5000 times. 100ms seems like a long time to block the entire kernel. Is there any reason we can't spawn a kernel thread to deal with the waits? I recommend that we also reduce the timeouts to at most twice what the spec states. How come this doesn't happen when other keys are pressed? Just when the console is flipped. Perhaps because it tries to set the LEDs first? -- Rick C. Petty From owner-freebsd-hackers@FreeBSD.ORG Tue May 27 23:05:14 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 16644106566C for ; Tue, 27 May 2008 23:05:14 +0000 (UTC) (envelope-from maksim.yevmenkin@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.159]) by mx1.freebsd.org (Postfix) with ESMTP id 97F098FC18 for ; Tue, 27 May 2008 23:05:13 +0000 (UTC) (envelope-from maksim.yevmenkin@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so1890054fgb.35 for ; Tue, 27 May 2008 16:05:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=tR9FtILbEdFLjZpWqS9coCRIdPaHgB53wy80nPal7b8=; b=mvRC71Vz8vkxjv4xqvIICeeYmNIdyhmMa3a7hGaeY1GhYadVm6qLrJm77okUMtUecn3XSfoTGQ8D1gy76HP241GazHlpOlerptodnbObqI0eVOryTy8l/icrpsjjtXNWUF+OLWYDTZhDemN9bid6BbGopPedpuJ5khQNdeKBIo8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=sBFRq1ptdWQW55rOen1O4reEZ7F0HSrs2tfCQy3pBezlj+sP8G2DMcczk4SaAfUWwWgen1978ST0iwix5D5m9mWqi21KTAvEhclJnZ9spWNAMA1DT+dAGCeZIGb348Mqs6jyjeXRTfPtWid/KFpAonO/uklFUUloOhZk99LF/bQ= Received: by 10.86.59.2 with SMTP id h2mr3158996fga.57.1211929512251; Tue, 27 May 2008 16:05:12 -0700 (PDT) Received: by 10.86.66.5 with HTTP; Tue, 27 May 2008 16:05:12 -0700 (PDT) Message-ID: Date: Tue, 27 May 2008 16:05:12 -0700 From: "Maksim Yevmenkin" To: rick-freebsd@kiwi-computer.com In-Reply-To: <20080527224256.GA83303@keira.kiwi-computer.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <48378DA0.8040506@frase.id.au> <20080527041236.GB68298@keira.kiwi-computer.com> <20080527051109.GA26502@eos.sc1.parodius.com> <20080527054842.GA69670@keira.kiwi-computer.com> <20080527194554.GA79741@keira.kiwi-computer.com> <20080527210158.GB81555@keira.kiwi-computer.com> <20080527224256.GA83303@keira.kiwi-computer.com> Cc: freebsd-hackers@freebsd.org, Jeremy Chadwick , Fraser Tweedale Subject: Re: temporary freezes when pressing capslock / numlock X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 May 2008 23:05:14 -0000 On 5/27/08, Rick C. Petty wrote: > On Tue, May 27, 2008 at 02:28:26PM -0700, Maksim Yevmenkin wrote: > > > > well, i just took a brief look at atkbd(4). specifically one function > > - wait_while_controller_busy(). this function polls status every > > KBDC_DELAYTIME (20) usec with retry count of 5000. so, just this > > function alone can give up to 100 msec delay. keep in mind that > > wait_while_controller_busy() is apparently called every time driver > > need to talk to the hardware. i can see how we could delay kernel for > > 400 msec or even more. > > I'm not sure why we retry 5000 times. 100ms seems like a long time to > block the entire kernel. Is there any reason we can't spawn a kernel > thread to deal with the waits? I recommend that we also reduce the > timeouts to at most twice what the spec states. all great ideas. please send in the patches and i will be happy to review and commit them for you. > How come this doesn't happen when other keys are pressed? Just when the > console is flipped. Perhaps because it tries to set the LEDs first? like i said, i suspect delay happens only when driver needs to send command to the keyboard. that is what happens when you press num/scroll/capslock. thanks, max > > > -- Rick C. Petty > From owner-freebsd-hackers@FreeBSD.ORG Wed May 28 01:33:29 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 36EDE106567D; Wed, 28 May 2008 01:33:29 +0000 (UTC) (envelope-from brooks@lor.one-eyed-alien.net) Received: from lor.one-eyed-alien.net (cl-162.ewr-01.us.sixxs.net [IPv6:2001:4830:1200:a1::2]) by mx1.freebsd.org (Postfix) with ESMTP id 988728FC16; Wed, 28 May 2008 01:33:28 +0000 (UTC) (envelope-from brooks@lor.one-eyed-alien.net) Received: from lor.one-eyed-alien.net (localhost [127.0.0.1]) by lor.one-eyed-alien.net (8.14.2/8.14.2) with ESMTP id m4S1XXtA000937; Tue, 27 May 2008 20:33:33 -0500 (CDT) (envelope-from brooks@lor.one-eyed-alien.net) Received: (from brooks@localhost) by lor.one-eyed-alien.net (8.14.2/8.14.2/Submit) id m4S1XX0w000936; Tue, 27 May 2008 20:33:33 -0500 (CDT) (envelope-from brooks) Date: Tue, 27 May 2008 20:33:33 -0500 From: Brooks Davis To: Ed Schouten Message-ID: <20080528013333.GA821@lor.one-eyed-alien.net> References: <20080520170639.GE1181@hoeg.nl> <48330CDA.2080802@FreeBSD.org> <20080521172352.GJ1181@hoeg.nl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ibTvN161/egqYuK8" Content-Disposition: inline In-Reply-To: <20080521172352.GJ1181@hoeg.nl> User-Agent: Mutt/1.5.17 (2007-11-01) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-3.0 (lor.one-eyed-alien.net [127.0.0.1]); Tue, 27 May 2008 20:33:34 -0500 (CDT) Cc: FreeBSD Hackers Subject: Re: FreeBSD and LLVM X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 May 2008 01:33:29 -0000 --ibTvN161/egqYuK8 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, May 21, 2008 at 07:23:52PM +0200, Ed Schouten wrote: > Hello Stefan, >=20 > (CC'ing this back to the list) >=20 > * Stefan Esser wrote: > > this is great news! Can you provide your patches to upgrade the port > > to 2.3-pre? >=20 > I could, but I patched the ports rather poorly. The plists are > incorrect. I just incremented the version numbers, updated the distinfo > and made some changes to the llvm-gcc4 port to use the proper wrksrc. I've got WIP updates of both ports, but probably won't get them committed u= ntil next week. > > If 2.3-pre allows the kernel to boot and run, then many user-land > > programs should work as well. Testing a make world (and preparing > > the infrastructure to support llvm in addition to gcc and icc might > > be worthwhile ...). >=20 > We should really try that. Unfortunately I'm quite busy, hacking on the > TTY layer. ;-) >=20 > > You probably know about the clang project, which tries to completely > > replace the gcc parts needed for llvm-gcc ... >=20 > Yes. I haven't looked at it yet. It doesn't seem to be in Ports yet. Any > takers? ;-) Unless you make an evil port that does a checkout of last nights sources =66rom svn, there isn't much point today. Chris Latner said it would probably be ready to start publishing snapshots in 3-6 months (i.e. llvm 2.4 or 2.5). I'd like to whip one up, but haven't yet. -- Brooks --ibTvN161/egqYuK8 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (FreeBSD) iD8DBQFIPLZsXY6L6fI4GtQRAnbJAJ9YVSO/5n7/Pdxq3Vyw/2AOs5ZTywCdEYpJ PnT8jANViW7hOtyFwOLOShM= =iaaW -----END PGP SIGNATURE----- --ibTvN161/egqYuK8-- From owner-freebsd-hackers@FreeBSD.ORG Wed May 28 01:58:04 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CE23E1065676 for ; Wed, 28 May 2008 01:58:04 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from smtpoutm.mac.com (smtpoutm.mac.com [17.148.16.68]) by mx1.freebsd.org (Postfix) with ESMTP id 857998FC15 for ; Wed, 28 May 2008 01:58:04 +0000 (UTC) (envelope-from xcllnt@mac.com) Received: from asmtp012-bge351000 (asmtp012-bge351000 [10.150.69.75]) by smtpoutm.mac.com (Xserve/smtpout005/MantshX 4.0) with ESMTP id m4S1w465021652; Tue, 27 May 2008 18:58:04 -0700 (PDT) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Received: from [192.168.1.102] (209-128-86-226.bayarea.net [209.128.86.226]) by asmtp012.mac.com (Sun Java(tm) System Messaging Server 6.3-6.03 (built Mar 14 2008; 32bit)) with ESMTPSA id <0K1K002NO2SRY660@asmtp012.mac.com>; Tue, 27 May 2008 18:58:04 -0700 (PDT) Message-id: From: Marcel Moolenaar To: Brooks Davis In-reply-to: <20080528013333.GA821@lor.one-eyed-alien.net> Date: Tue, 27 May 2008 18:58:01 -0700 References: <20080520170639.GE1181@hoeg.nl> <48330CDA.2080802@FreeBSD.org> <20080521172352.GJ1181@hoeg.nl> <20080528013333.GA821@lor.one-eyed-alien.net> X-Mailer: Apple Mail (2.919.2) Cc: Ed Schouten , FreeBSD Hackers Subject: Re: FreeBSD and LLVM X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 May 2008 01:58:04 -0000 On May 27, 2008, at 6:33 PM, Brooks Davis wrote: >>> You probably know about the clang project, which tries to completely >>> replace the gcc parts needed for llvm-gcc ... >> >> Yes. I haven't looked at it yet. It doesn't seem to be in Ports >> yet. Any >> takers? ;-) > > Unless you make an evil port that does a checkout of last nights > sources > from svn, there isn't much point today. Chris Latner said it would > probably be ready to start publishing snapshots in 3-6 months (i.e. > llvm > 2.4 or 2.5). I'd like to whip one up, but haven't yet. BTW: I'm working on LLVM directly. I'm keeping track of FreeBSD support here: http://wiki.freebsd.org/LowLevelVirtualMachine What I'd like to have is some nightly automation that does the testing across all platforms. We could create nightly snapshots as part of the automation and create a port that installs the latest snapshot? -- Marcel Moolenaar xcllnt@mac.com From owner-freebsd-hackers@FreeBSD.ORG Wed May 28 13:05:14 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E5F221065687 for ; Wed, 28 May 2008 13:05:14 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 891328FC67 for ; Wed, 28 May 2008 13:05:14 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1K1KtW-0003Gz-Ou for freebsd-hackers@freebsd.org; Wed, 28 May 2008 12:36:42 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 28 May 2008 12:36:42 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 28 May 2008 12:36:42 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Ivan Voras Date: Wed, 28 May 2008 14:36:33 +0200 Lines: 36 Message-ID: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigC95AF5E91E39B4F62DCFA8C1" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.14 (X11/20080505) X-Enigmail-Version: 0.95.0 Sender: news Subject: Impact of having a large number of open file descriptors X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 May 2008 13:05:15 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigC95AF5E91E39B4F62DCFA8C1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi, Im thinking again of the old idea of implementing poor man's file replication system using kqueue to monitor changes on files. This would require opening every file that needs to be monitored and using EVFILT_VNODE to monitor them. I suppose this would work for a small-ish number of files like for a user's home directory but what about 100,000 files or millions of files? One other question: do kqueue events "coalesce" in the sense that if N operations happen (like write()s), there can be < N events passed to the kqueue (NOTE_WRITE)? While at it, will EVFILT_VNODE and NOTE_WRITE catch "additional" ways the file can be modified, meaning mmap()? --------------enigC95AF5E91E39B4F62DCFA8C1 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFIPVHRldnAQVacBcgRApuWAJ4trf/Hfti+FUCLRTFA6Gub8pBtbwCg6hsB hdEBNMuxNHiZw9Fi0By/HsA= =1uvQ -----END PGP SIGNATURE----- --------------enigC95AF5E91E39B4F62DCFA8C1-- From owner-freebsd-hackers@FreeBSD.ORG Wed May 28 14:46:52 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F088C1065677; Wed, 28 May 2008 14:46:52 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 610718FC0A; Wed, 28 May 2008 14:46:52 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.1/8.14.1) with ESMTP id m4SEkotO099134; Wed, 28 May 2008 16:46:50 +0200 (CEST) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.1/8.14.1/Submit) id m4SEkojn099133; Wed, 28 May 2008 16:46:50 +0200 (CEST) (envelope-from olli) Date: Wed, 28 May 2008 16:46:50 +0200 (CEST) Message-Id: <200805281446.m4SEkojn099133@lurza.secnetix.de> From: Oliver Fromme To: freebsd-hackers@FreeBSD.ORG, ivoras@FreeBSD.ORG In-Reply-To: X-Newsgroups: list.freebsd-hackers User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.2-STABLE-20070808 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Wed, 28 May 2008 16:46:51 +0200 (CEST) Cc: Subject: Re: Impact of having a large number of open file descriptors X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-hackers@FreeBSD.ORG, ivoras@FreeBSD.ORG List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 May 2008 14:46:53 -0000 Ivan Voras wrote: > Im thinking again of the old idea of implementing poor man's file > replication system using kqueue to monitor changes on files. It would be cool to have a kernel interface so you could attach to a mountpoint and receive a log of all activity on that file system. That's similar to what DragonFly's journaling feature does. Unfortunately the kqueue interface isn't capable of doing something like that ... So this is not an answer to your question, I'm afraid. > One other question: do kqueue events "coalesce" in the sense that if N > operations happen (like write()s), there can be < N events passed to the > kqueue (NOTE_WRITE)? The manpage says: "Multiple events which trigger the filter do not result in multiple kevents being placed on the kqueue; instead, the filter will aggregate the events into a single struct kevent." > While at it, will EVFILT_VNODE and NOTE_WRITE catch "additional" ways > the file can be modified, meaning mmap()? A quick grep for NOTE_WRITE on the sys tree indicates that it doesn't. I'm not 100% sure though. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "Documentation is like sex; when it's good, it's very, very good, and when it's bad, it's better than nothing." -- Dick Brandon From owner-freebsd-hackers@FreeBSD.ORG Wed May 28 16:26:06 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C0F1F1065670 for ; Wed, 28 May 2008 16:26:06 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.231]) by mx1.freebsd.org (Postfix) with ESMTP id A7C638FC0A for ; Wed, 28 May 2008 16:26:06 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so3603703rvf.43 for ; Wed, 28 May 2008 09:26:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; bh=J14qOlpucJM1rFahvP9Ho6oyZlkZxuLyE0FBD5zk6zM=; b=neTyCrUp1YhxGIB3s4ESeBut1fGamAZewUrfEcOyOojmalEAFx7WUF6ihUHlyIPs5ohS1ltnHBFRtTm2ek8FDfYCnbSw5tuVAQQTM4SZDv7V+GNod28/qqTl3d/ftJt5lH6MzopNuoyUS5zAxUASN3KWPJQ3skgQ2ogfd1lQDek= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=f+iGyFQSv6HBS0RG0e6xT+3vEANRX8lHuiQL7v8TdQz7tYOIRTX8/0uguF5I9LZTGcYjjBbxjZ/op2P+GE2IoGBYr9RQsd6Y+wwriAVftCt9or499boIOsZGsuODXy06bZjGn7bImg7zWkB1uLrHLYcGAjnFVIr7LFqucFBLpG8= Received: by 10.141.175.5 with SMTP id c5mr1350893rvp.54.1211990414987; Wed, 28 May 2008 09:00:14 -0700 (PDT) Received: by 10.140.252.21 with HTTP; Wed, 28 May 2008 09:00:14 -0700 (PDT) Message-ID: <9bbcef730805280900i1195b5f4rb879d22e9e0319d9@mail.gmail.com> Date: Wed, 28 May 2008 18:00:14 +0200 From: "Ivan Voras" Sender: ivoras@gmail.com To: freebsd-hackers@freebsd.org, ivoras@freebsd.org In-Reply-To: <200805281446.m4SEkojn099133@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <200805281446.m4SEkojn099133@lurza.secnetix.de> X-Google-Sender-Auth: 73992bc9bcef29b9 Cc: Subject: Re: Impact of having a large number of open file descriptors X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 May 2008 16:26:06 -0000 2008/5/28 Oliver Fromme : > Ivan Voras wrote: > > Im thinking again of the old idea of implementing poor man's file > > replication system using kqueue to monitor changes on files. > > It would be cool to have a kernel interface so you could > attach to a mountpoint and receive a log of all activity > on that file system. That's similar to what DragonFly's > journaling feature does. /me agrees. > Unfortunately the kqueue interface isn't capable of doing > something like that ... So this is not an answer to your > question, I'm afraid. > > > One other question: do kqueue events "coalesce" in the sense that if N > > operations happen (like write()s), there can be < N events passed to the > > kqueue (NOTE_WRITE)? > > The manpage says: "Multiple events which trigger the filter > do not result in multiple kevents being placed on the kqueue; > instead, the filter will aggregate the events into a single > struct kevent." That's mildly unfortunate but I think you're right - it agrees with the statement from the kqueue paper: "Events will normally considered to be "level-triggered", as opposed to "edge-triggered"." > > While at it, will EVFILT_VNODE and NOTE_WRITE catch "additional" ways > > the file can be modified, meaning mmap()? > > A quick grep for NOTE_WRITE on the sys tree indicates that > it doesn't. I'm not 100% sure though. Also bad for some users. From owner-freebsd-hackers@FreeBSD.ORG Wed May 28 22:11:08 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6FF7F106564A for ; Wed, 28 May 2008 22:11:08 +0000 (UTC) (envelope-from israsilva@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.175]) by mx1.freebsd.org (Postfix) with ESMTP id 542558FC17 for ; Wed, 28 May 2008 22:11:08 +0000 (UTC) (envelope-from israsilva@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so2628122wfg.7 for ; Wed, 28 May 2008 15:11:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type; bh=PpiZBGFCDFAbsESt0oLgUdZZdLOikfz5OXrAibJ1SzY=; b=b0kUxiVoq3+OgET2vZ68o5JCm3kDH+BJ28UiS83URv3sg6VP2mvoORcuDWNsaVAfQFOmxAubuJrFlXPrNrNnxhR/bfYTrbt33ziJrcUBp3c7n1Vd6zV+OWIWxLzSrO3whYlAhtZG5RigYW7CNl4ULkoEawEepC2t48+EABbrQUw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=p6zvikEi9bmH9wK4RxPEi8EY0kZxiU1zGEE15j4sCQPHIAeDUoa8B9mqSzol36udl7ahnBSBT/fr0FqONPXId7q3Hzemo3z9JvkYCYE/pDemNJdfqb4lcnk/F0ZtPksxy/PLibnY5WprACu+oJCC2G8VVjmb79IgHOI4XWl+w+0= Received: by 10.143.168.4 with SMTP id v4mr1245220wfo.308.1212012667034; Wed, 28 May 2008 15:11:07 -0700 (PDT) Received: by 10.142.49.8 with HTTP; Wed, 28 May 2008 15:11:06 -0700 (PDT) Message-ID: <5ce468b90805281511h2729be73l65dccdcfe13ad4db@mail.gmail.com> Date: Wed, 28 May 2008 19:11:06 -0300 From: "Israel Lehnen Silva" To: hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: FreeBSD + LDAP + SAMBA + WINDOWS X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 May 2008 22:11:08 -0000 Friends, I have the following scenario: Server FreeBSD 7.0 Stable authenticating in one basis LDAP through of the PAM (pam_ldap and nss_ldap) In same server, have running the SAMBA 3.0.28 authenticating too in basis LDAP and using the scripts smbldap-tools. Tool LDAPAdmin for administration of basis LDAP. THE PROBLEM: When chang the pass of user in basis LDAP trhough of LDAPAdmin, select th cryptograpy "MD5 Crypt" for the atribuct userPassword This way, I achieve log in the Windows and FreeBSD by terminal, ssh... but when chang pass of user by Windows, the cryptograpy of password in atribuct userPassword is chanded for SSHA and so not conect in FreeBSD, also just conect in windows. FreeBSD and SAMBA authenticating in LDAP, and changing the password by own user, not interfering in auth of ssh in FreeBSD... Someone implemented??? The configuration of Samba: # Samba config file created using SWAT # from 0.0.0.0 (0.0.0.0) # Date: 2008/05/05 16:13:37 [global] dos charset = CP850 unix charset = ISO8859-1 workgroup = NOVOARQ netbios name = NARQ server string = LDAP Teste # update encrypted = Yes # unix password sync = Yes passwd program = /usr/local/sbin/smbldap-passwd -u "%u" encrypt passwords = Yes # obey pam restrictions = Yes socket options = TCP_NODELAY IPTOS_LOWDELAY IPTOS_THROUGHPUT SO_KEEPALIVE SO_RCVBUF=8192 SO_SNDBUF=8192 log level = 1 log file = /var/log/samba/samba.log max log size = 0 time server = Yes machine password timeout = 0 logon script = %G.bat logon drive = H: logon home = \\NARQ\%U os level = 255 preferred master = Yes domain master = yes domain logons = yes local master = yes passdb backend = ldapsam:ldap://ldap.dominio.com.br ldap passwd sync = Yes ldap delete dn = Yes ldap ssl = no ldap admin dn = cn=admin,dc=unilasalle,dc=edu,dc=br ldap suffix = dc=unilasalle,dc=edu,dc=br ldap machine suffix = ou=computadores ldap user suffix = ou=usuarios ldap group suffix = ou=grupos ldap idmap suffix = sambaDomainName=NOVOARQ idmap backend = ldap:ldap://ldap.dominio.com.br idmap uid = 10000-65000 idmap gid = 10000-65000 enable privileges = yes add user script = /usr/local/sbin/smbldap-useradd -m "%u" # delete user script = /usr/local/sbin/smbldap-userdel "%u" add group script = /usr/local/sbin/smbldap-groupadd -p "%g" # delete group script = /usr/local/sbin/smbldap-groupdel "%g" add user to group script = /usr/local/sbin/smbldap-groupmod -m "%u" "%g" delete user from group script = /usr/local/sbin/smbldap-groupmod -x "%u" "%g" set primary group script = /usr/local/sbin/smbldap-usermod -g "%g" "%u" add machine script = /usr/local/sbin/smbldap-useradd -w "%u" utmp = Yes smb ports = 445 139 name resolve order = wins bcast hosts time server = Yes template shell = /bin/false winbind use default domain = no map acl inherit = Yes strict locking = Yes wins support = Yes interfaces = bce0 bind interfaces only = Yes dns proxy = No create mask = 0770 force create mode = 0770 directory mask = 0770 force directory mode = 0770 Best regards, Israel Lehnen Silva. From owner-freebsd-hackers@FreeBSD.ORG Thu May 29 04:15:26 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5124A106567A for ; Thu, 29 May 2008 04:15:26 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 5D0438FC0C for ; Thu, 29 May 2008 04:15:26 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from zion.baldwin.cx (server.baldwin.cx [208.65.91.234]) by elvis.mu.org (Postfix) with ESMTP id AA6E11A4D7C; Wed, 28 May 2008 21:15:25 -0700 (PDT) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Thu, 29 May 2008 00:04:41 -0400 User-Agent: KMail/1.9.7 References: <20080309152712.42752293@bhuda.mired.org> <18489.32903.477434.465037@gromit.timing.com> <20080525154537.GB1026@lizard.fafoe.narf.at> In-Reply-To: <20080525154537.GB1026@lizard.fafoe.narf.at> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200805290004.41653.jhb@freebsd.org> Cc: Stefan Farfeleder , hackers@freebsd.org, Mike Meyer , John E Hein Subject: Re: Why doesn't autoconf like our /bin/sh? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 May 2008 04:15:26 -0000 On Sunday 25 May 2008 11:45:37 am Stefan Farfeleder wrote: > On Sun, May 25, 2008 at 09:06:47AM -0600, John E Hein wrote: > > FWIW, it seems bash and sh report line number differently. > > > > # grep -n ^ ~/tmp/ln > > 1:#!/bin/sh > > 2:echo f line: $LINENO > > 3:f() > > 4:{ > > 5:echo f line: $LINENO > > 6:} > > 7: > > 8:f > > 9:echo main line: $LINENO > > 10:f > > > > > > # /bin/sh ~/tmp/ln > > f line: 2 > > f line: 3 > > main line: 9 > > f line: 3 > > > > > > # bash ~/tmp/ln > > f line: 2 > > f line: 5 > > main line: 9 > > f line: 5 > > Yes, I know. I think it is a bug in bash as SUSv3 states: > > "Set by the shell to a decimal number representing the current > sequential line number (numbered starting with 1) within a script or > function before it executes each command." Actually, the bash way seems more intuitive. And it does say "the current sequentional line number within a ... function before it executes each command" The "within a function" implies that this property goes inside of functions instead of forcing all commands in a function to use the starting line of the function which is what you are saying? -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Thu May 29 04:30:56 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DA0DC1065674 for ; Thu, 29 May 2008 04:30:56 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id EAAB18FC21 for ; Thu, 29 May 2008 04:30:56 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from zion.baldwin.cx (server.baldwin.cx [208.65.91.234]) by elvis.mu.org (Postfix) with ESMTP id AA6E11A4D7C; Wed, 28 May 2008 21:15:25 -0700 (PDT) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Thu, 29 May 2008 00:04:41 -0400 User-Agent: KMail/1.9.7 References: <20080309152712.42752293@bhuda.mired.org> <18489.32903.477434.465037@gromit.timing.com> <20080525154537.GB1026@lizard.fafoe.narf.at> In-Reply-To: <20080525154537.GB1026@lizard.fafoe.narf.at> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200805290004.41653.jhb@freebsd.org> Cc: Stefan Farfeleder , hackers@freebsd.org, Mike Meyer , John E Hein Subject: Re: Why doesn't autoconf like our /bin/sh? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 May 2008 04:30:56 -0000 On Sunday 25 May 2008 11:45:37 am Stefan Farfeleder wrote: > On Sun, May 25, 2008 at 09:06:47AM -0600, John E Hein wrote: > > FWIW, it seems bash and sh report line number differently. > > > > # grep -n ^ ~/tmp/ln > > 1:#!/bin/sh > > 2:echo f line: $LINENO > > 3:f() > > 4:{ > > 5:echo f line: $LINENO > > 6:} > > 7: > > 8:f > > 9:echo main line: $LINENO > > 10:f > > > > > > # /bin/sh ~/tmp/ln > > f line: 2 > > f line: 3 > > main line: 9 > > f line: 3 > > > > > > # bash ~/tmp/ln > > f line: 2 > > f line: 5 > > main line: 9 > > f line: 5 > > Yes, I know. I think it is a bug in bash as SUSv3 states: > > "Set by the shell to a decimal number representing the current > sequential line number (numbered starting with 1) within a script or > function before it executes each command." Actually, the bash way seems more intuitive. And it does say "the current sequentional line number within a ... function before it executes each command" The "within a function" implies that this property goes inside of functions instead of forcing all commands in a function to use the starting line of the function which is what you are saying? -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Thu May 29 16:48:34 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E8F94106566C for ; Thu, 29 May 2008 16:48:34 +0000 (UTC) (envelope-from ssouhlal@FreeBSD.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id BA94E8FC14 for ; Thu, 29 May 2008 16:48:34 +0000 (UTC) (envelope-from ssouhlal@FreeBSD.org) Received: from [192.168.0.100] (c-76-21-32-5.hsd1.ca.comcast.net [76.21.32.5]) by elvis.mu.org (Postfix) with ESMTP id AF5331A4D7E; Thu, 29 May 2008 09:48:34 -0700 (PDT) Mime-Version: 1.0 (Apple Message framework v753) In-Reply-To: <200805281446.m4SEkojn099133@lurza.secnetix.de> References: <200805281446.m4SEkojn099133@lurza.secnetix.de> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <64200F15-4444-44FE-B904-673543441F35@FreeBSD.org> Content-Transfer-Encoding: 7bit From: Suleiman Souhlal Date: Thu, 29 May 2008 09:48:26 -0700 To: freebsd-hackers@FreeBSD.ORG, ivoras@FreeBSD.ORG X-Mailer: Apple Mail (2.753) Cc: Subject: Re: Impact of having a large number of open file descriptors X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 May 2008 16:48:35 -0000 On May 28, 2008, at 7:46 AM, Oliver Fromme wrote: > Ivan Voras wrote: >> Im thinking again of the old idea of implementing poor man's file >> replication system using kqueue to monitor changes on files. > > It would be cool to have a kernel interface so you could > attach to a mountpoint and receive a log of all activity > on that file system. That's similar to what DragonFly's > journaling feature does. > > Unfortunately the kqueue interface isn't capable of doing > something like that ... So this is not an answer to your > question, I'm afraid. I have an old patch that makes kqueue monitor every file write on the system and return the inode number in the knote's data field: http:// people.freebsd.org/~ssouhlal/testing/kqueue-anyvnode-20050503.diff . I'd think it shouldn't be too hard to make it per-mountpoint.. >> While at it, will EVFILT_VNODE and NOTE_WRITE catch "additional" ways >> the file can be modified, meaning mmap()? I think it does, although it will get delayed until the mmapped pages get flushed to disk. -- Suleiman From owner-freebsd-hackers@FreeBSD.ORG Thu May 29 17:56:05 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 28BE11065688 for ; Thu, 29 May 2008 17:56:05 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from shell.rawbw.com (shell.rawbw.com [198.144.192.42]) by mx1.freebsd.org (Postfix) with ESMTP id F18168FC22 for ; Thu, 29 May 2008 17:56:04 +0000 (UTC) (envelope-from yuri@rawbw.com) Received: from eagle.syrec.org (ip224.carlyle.sfo.ygnition.net [24.219.144.224]) (authenticated bits=0) by shell.rawbw.com (8.13.6/8.13.6) with ESMTP id m4THdHKj027746 for ; Thu, 29 May 2008 10:39:18 -0700 (PDT) Message-ID: <483EEA59.7010104@rawbw.com> Date: Thu, 29 May 2008 10:39:37 -0700 From: Yuri User-Agent: Thunderbird 2.0.0.14 (X11/20080505) MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: airodump-ng loses all stations after 30 mins X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: yuri@rawbw.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 May 2008 17:56:05 -0000 Playing with wireless I tried to use airodump-ng to see what one can get out of it. Command /usr/local/sbin/airodump-ng -w xx ral0 works fine for ~30 minutes and then loses all stations. Restarting this command gets it to the state with no stations right away. But after I do 'ifconfig ral0 down ; ifconfig ral0 up' command works again. Until it loses stations in ~30 minutes again and everything repeats. It seems that ral0 gets into some internal state that prevents airodump-ng from picking up packets. And down/up clears it. But the output of 'ifconfig ral0' doesn't change after down/up: ral0: flags=2a9c3 metric 0 mtu 1500 ether 00:18:f8:2e:40:25 inet 192.168.168.133 netmask 0xffffff00 broadcast 192.168.168.255 media: IEEE 802.11 Wireless Ethernet autoselect (autoselect ) status: associated ssid "" channel 5 (2432 Mhz 11g) bssid 00:18:f8:2e:40:25 authmode OPEN privacy OFF txpower 50 scanvalid 60 bgscan bgscanintvl 300 bgscanidle 250 roam:rssi11g 7 roam:rate11g 5 protmode CTS My card is recognized as: ral0: mem 0xcffe8000-0xcffeffff irq 17 at device 10.0 on pci0 And I use 7.0-STABLE. This seems like a bug in the driver. But I am asking here hoping someone will have an answer off the top of their head. Yuri From owner-freebsd-hackers@FreeBSD.ORG Fri May 30 07:45:12 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E94DB1065674 for ; Fri, 30 May 2008 07:45:12 +0000 (UTC) (envelope-from dinesh@alphaque.com) Received: from mail.qubeconnect.com (mail.qubeconnect.com [202.190.74.25]) by mx1.freebsd.org (Postfix) with SMTP id 2C8E08FC2F for ; Fri, 30 May 2008 07:45:11 +0000 (UTC) (envelope-from dinesh@alphaque.com) Received: (qmail 33615 invoked by uid 0); 30 May 2008 15:18:46 +0800 Received: from mail.qubeconnect.com (HELO prophet.alphaque.com) (202.190.74.25) by mail.qubeconnect.com with SMTP; 30 May 2008 15:18:46 +0800 Received: from prophet.alphaque.com (localhost [127.0.0.1]) by prophet.alphaque.com (8.14.2/8.14.2) with ESMTP id m4U5wFNT033106; Fri, 30 May 2008 13:58:15 +0800 (MYT) (envelope-from dinesh@alphaque.com) Date: Fri, 30 May 2008 13:58:14 +0800 From: Dinesh Nair To: Jeremy Chadwick Message-ID: <20080530135814.390321ee@prophet.alphaque.com> In-Reply-To: <20080522133819.GA45578@eos.sc1.parodius.com> References: <48356E75.1050105@thearle.com.au> <20080522133819.GA45578@eos.sc1.parodius.com> Organization: Alphaque. Anytime. Anywhere. X-Mailer: Claws Mail 3.4.0 (GTK+ 2.12.9; i386-portbld-freebsd6.3) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@FreeBSD.org, Adrian Thearle Subject: Re: Maximum memory allocation per process X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 May 2008 07:45:13 -0000 On Thu, 22 May 2008 06:38:19 -0700, Jeremy Chadwick wrote: > You need to modify some kernel settings via /boot/loader.conf and > reboot. Here's what we use on our production RELENG_6 and RELENG_7 > boxes: > > # Increase maximum allocatable memory on a process to 2GB. > # (We don't choose 3GB (our max RAM) since that would > # exhaust all memory, and result in a kernel panic.) > # Set default memory size as 768MB. > # Maximum stack size is 256MB. > # > kern.maxdsiz="2048M" > kern.dfldsiz="768M" > kern.maxssiz="256MB" for those of us who're booting off a stripped down freebsd and are not using the 4th routines, are the above to be set before 'load /kernel' or after 'load /kernel' ? currently, loader.rc contains, --- cut here --- set console=comconsole set hw.ata.atapi_dma="0" set hw.ata.ata_dma="0" set hw.ata.wc="0" load /kernel load -t mfs_root /mfsroot boot --- cut here --- -- Regards, /\_/\ "All dogs go to heaven." dinesh@alphaque.com (0 0) http://www.openmalaysiablog.com/ +==========================----oOO--(_)--OOo----==========================+ | for a in past present future; do | | for b in clients employers associates relatives neighbours pets; do | | echo "The opinions here in no way reflect the opinions of my $a $b." | | done; done | +=========================================================================+ From owner-freebsd-hackers@FreeBSD.ORG Fri May 30 07:46:57 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 251E01065674 for ; Fri, 30 May 2008 07:46:57 +0000 (UTC) (envelope-from jdc@parodius.com) Received: from mx01.sc1.parodius.com (mx01.sc1.parodius.com [72.20.106.3]) by mx1.freebsd.org (Postfix) with ESMTP id 0683A8FC23 for ; Fri, 30 May 2008 07:46:56 +0000 (UTC) (envelope-from jdc@parodius.com) Received: by mx01.sc1.parodius.com (Postfix, from userid 1000) id BCC201CC031; Fri, 30 May 2008 00:46:56 -0700 (PDT) Date: Fri, 30 May 2008 00:46:56 -0700 From: Jeremy Chadwick To: Dinesh Nair Message-ID: <20080530074656.GA27066@eos.sc1.parodius.com> References: <48356E75.1050105@thearle.com.au> <20080522133819.GA45578@eos.sc1.parodius.com> <20080530135814.390321ee@prophet.alphaque.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080530135814.390321ee@prophet.alphaque.com> User-Agent: Mutt/1.5.17 (2007-11-01) Cc: freebsd-hackers@FreeBSD.org, Adrian Thearle Subject: Re: Maximum memory allocation per process X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 May 2008 07:46:57 -0000 On Fri, May 30, 2008 at 01:58:14PM +0800, Dinesh Nair wrote: > On Thu, 22 May 2008 06:38:19 -0700, Jeremy Chadwick wrote: > > You need to modify some kernel settings via /boot/loader.conf and > > reboot. Here's what we use on our production RELENG_6 and RELENG_7 > > boxes: > > > > # Increase maximum allocatable memory on a process to 2GB. > > # (We don't choose 3GB (our max RAM) since that would > > # exhaust all memory, and result in a kernel panic.) > > # Set default memory size as 768MB. > > # Maximum stack size is 256MB. > > # > > kern.maxdsiz="2048M" > > kern.dfldsiz="768M" > > kern.maxssiz="256MB" > > for those of us who're booting off a stripped down freebsd and are not > using the 4th routines, are the above to be set before 'load /kernel' or > after 'load /kernel' ? > > currently, loader.rc contains, > > --- cut here --- > set console=comconsole > set hw.ata.atapi_dma="0" > set hw.ata.ata_dma="0" > set hw.ata.wc="0" > load /kernel > load -t mfs_root /mfsroot > boot > --- cut here --- I believe these would either need to be set *before* loading the kernel, or, possibly it doesn't matter at all (they might be passed to the kernel itself during "boot"). -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Fri May 30 08:51:31 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 09BC9106566C for ; Fri, 30 May 2008 08:51:31 +0000 (UTC) (envelope-from vasanth.raonaik@gmail.com) Received: from an-out-0708.google.com (an-out-0708.google.com [209.85.132.248]) by mx1.freebsd.org (Postfix) with ESMTP id AD0228FC1B for ; Fri, 30 May 2008 08:51:30 +0000 (UTC) (envelope-from vasanth.raonaik@gmail.com) Received: by an-out-0708.google.com with SMTP id b33so80302ana.13 for ; Fri, 30 May 2008 01:51:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type; bh=SiN+O0BSoRoQnTqkYweDNdeUBKMAmoIor8inK/cYugQ=; b=ZSjnE7M6OaNv0hBC+Xt95BLraeO5XKe7KqO+SJDrYVyCLvbydaRjFM7Yzzk5fA0x1NHQSIg3QNtIUj8mqBir3EoF0NqfT6+yBILd/JgZbUrB2JFUaIuKAcPAFpk7ySVbvGWKjVeGW+9ws8XyvWe3t8FxagDPGw+XqZ3gB50ptQc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=cekRGprZwKf0EEULVnAosnqn0i6iIbj6Hsip7/HL/yf5UOkHjXIwjq+8uzM0BabdcYPh4046PykQM66HY2OjGp4rJpsPr80x2PDOarEQp7xtltm/Zv0VtbrOb7rLEf/OwLSA3eRuObmP/IsDrZwFMiJtu4dwMweNW8jt0lwTyZY= Received: by 10.100.214.3 with SMTP id m3mr1099120ang.134.1212135909082; Fri, 30 May 2008 01:25:09 -0700 (PDT) Received: by 10.100.249.11 with HTTP; Fri, 30 May 2008 01:25:09 -0700 (PDT) Message-ID: Date: Fri, 30 May 2008 13:55:09 +0530 From: "vasanth raonaik" To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Pahole on freebsd X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 May 2008 08:51:31 -0000 Hello Hackers, I have searched online to find the pahole utility for freebsd. Do we have a pahole utility for freebsd? If yes, can some one point me to the correct location from where i can download. Thanks, Vasanth From owner-freebsd-hackers@FreeBSD.ORG Fri May 30 14:37:11 2008 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 200FC106567C for ; Fri, 30 May 2008 14:37:11 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id A24808FC3C for ; Fri, 30 May 2008 14:37:10 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.1/8.14.1) with ESMTP id m4UEb30K010463; Fri, 30 May 2008 16:37:03 +0200 (CEST) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.1/8.14.1/Submit) id m4UEb0J8010462; Fri, 30 May 2008 16:37:00 +0200 (CEST) (envelope-from olli) Date: Fri, 30 May 2008 16:37:00 +0200 (CEST) Message-Id: <200805301437.m4UEb0J8010462@lurza.secnetix.de> From: Oliver Fromme To: freebsd-hackers@FreeBSD.ORG, dinesh@alphaque.com In-Reply-To: <20080530135814.390321ee@prophet.alphaque.com> X-Newsgroups: list.freebsd-hackers User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.2-STABLE-20070808 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Fri, 30 May 2008 16:37:04 +0200 (CEST) Cc: Subject: Re: Maximum memory allocation per process X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-hackers@FreeBSD.ORG, dinesh@alphaque.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 May 2008 14:37:11 -0000 Dinesh Nair wrote: > for those of us who're booting off a stripped down freebsd and are not > using the 4th routines, are the above to be set before 'load /kernel' or > after 'load /kernel' ? It doesn't matter. The tunables are passed to the kernel when it is booted. In fact, the standard beastie.4th stuff loads the kernel before displaying the menu, so the settings happen after the kernel is loaded. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "Being really good at C++ is like being really good at using rocks to sharpen sticks." -- Thant Tessman From owner-freebsd-hackers@FreeBSD.ORG Fri May 30 15:39:04 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EBDFF106566B for ; Fri, 30 May 2008 15:39:04 +0000 (UTC) (envelope-from florent.thoumie@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.29]) by mx1.freebsd.org (Postfix) with ESMTP id BA9048FC1E for ; Fri, 30 May 2008 15:39:04 +0000 (UTC) (envelope-from florent.thoumie@gmail.com) Received: by yw-out-2324.google.com with SMTP id 9so2348409ywe.13 for ; Fri, 30 May 2008 08:39:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition:x-google-sender-auth; bh=TN1JUeqyPVKmD7/vPk/J1wA73FQ8sjozouIrPwGQUmc=; b=G5RQgQKIaNP+1qLAktlsTJ/2rue+25RryNoJbS0nPnB9bT0sQc8uqyz572ah6+sIJYOz1d0qPa9YGAEmO+P2VSgUqk9fURsGxzk7eJNBBhWvVpnSNClAAD2VN9slz72hsiWdOWi6fxA10Qb3MTT7RQRtric8kuOtiKvsiBHiKAM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition:x-google-sender-auth; b=Q/BP56p7/nseqFs8HcN2/G+N1zcrH9KNp2+ytoGdu7EoJNxEoBOTPfpN814sx+oSJOTpWVaiuTUmz2pcPgFMTJESdMvjk4LfTVm56fQkSQarOa2shZ3bdFf6d/cW4JvV8bzipWe+F0I75YDWelu7GYqKe1BQRDxBlQ05oOAiixM= Received: by 10.114.159.6 with SMTP id h6mr6252572wae.65.1212160395756; Fri, 30 May 2008 08:13:15 -0700 (PDT) Received: by 10.114.57.4 with HTTP; Fri, 30 May 2008 08:13:15 -0700 (PDT) Message-ID: Date: Fri, 30 May 2008 16:13:15 +0100 From: "Florent Thoumie" Sender: florent.thoumie@gmail.com To: ports@freebsd.org, hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Google-Sender-Auth: 65ee063229fb840d X-Mailman-Approved-At: Fri, 30 May 2008 16:09:00 +0000 Cc: Subject: CFT: adding configuration file support to pkg_install X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 May 2008 15:39:05 -0000 This adds support for /etc/pkg.conf configuration file. Also, this adds support for naive multi-site package fetching. Any comment welcome (and appreciated). Patch is here: http://people.freebsd.org/~flz/local/ports/pkg-install-config.diff Tarball is here: http://people.freebsd.org/~flz/local/ports/pkg-install-0a553aac.tar.bz2 -- Florent Thoumie flz@FreeBSD.org FreeBSD Committer From owner-freebsd-hackers@FreeBSD.ORG Fri May 30 21:21:39 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C4B241065676 for ; Fri, 30 May 2008 21:21:39 +0000 (UTC) (envelope-from stef@memberwebs.com) Received: from mx.npubs.com (mail.npubs.com [209.66.100.224]) by mx1.freebsd.org (Postfix) with ESMTP id CC7598FC22 for ; Fri, 30 May 2008 21:21:39 +0000 (UTC) (envelope-from stef@memberwebs.com) Received: from mx.npubs.com (avhost [209.66.100.194]) by mx.npubs.com (Postfix) with ESMTP id 0297FF180A0 for ; Fri, 30 May 2008 21:03:48 +0000 (UTC) Received: from northstar-srv2 (unknown [172.27.2.11]) by mx.npubs.com (Postfix) with ESMTP id 5E1A6F1808E for ; Fri, 30 May 2008 21:03:47 +0000 (UTC) From: Stef Walter User-Agent: Thunderbird 2.0.0.14 (X11/20080505) MIME-Version: 1.0 To: freebsd-hackers@freebsd.org X-Enigmail-Version: 0.95.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Message-Id: <20080530210347.5E1A6F1808E@mx.npubs.com> X-Virus-Scanned: ClamAV using ClamSMTP Date: Fri, 30 May 2008 21:03:48 +0000 (UTC) X-Mailman-Approved-At: Fri, 30 May 2008 21:37:47 +0000 Subject: RAID status issues with Intel MatrixRAID ataraid X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 May 2008 21:21:39 -0000 This isn't a bug report, just a heads up to anyone using the same setup. This occurred in production, and I don't currently have a non-production hardware on which to investigate this bug and/or create a patch. In certain conditions, even though the Firmware RAID BIOS, says that a RAID is degraded, the FreeBSD driver thinks it's business as usual. In my case this resulted in file system corruption. Relevant output below. FreeBSD version: 6.3-RELEASE-p2 Cheers, Stef Walter BIOS OUTPUT: Copyright(C) 2003-06 Intel Corporation. All Rights Reserved. RAID Volumes: ID Name Level Strip Size Status Bootable 0 RAID Set 1 RAID1(Mirror) N/A 465.8GB Degraded Yes 1 RAID1(Mirror) N/A 465.8GB Normal Yes Physical Disks: Port Drive Model Serial # Size Type/Status(Vol ID) 0 WDC WD5000ABYS-0 WD-WCAPW5637184 465.8GB Member Disk(0) 1 ST3500320NS 5QM09E6F 465.8GB Error Occurred(0) 2 WDC WD5000ABYS-0 WD-WCAPW5548822 465.8GB Member Disk(1) 3 ST3500320NS 5QM0991D 465.8GB Member Disk(1) Press to enter Configuration Utility........... RELEVANT SNIPPET FROM DMESG: ar0: 476937MB status: READY ar0: disk0 READY (master) using ad4 at ata2-master ar0: disk1 READY (mirror) using ad6 at ata3-master From owner-freebsd-hackers@FreeBSD.ORG Fri May 30 23:02:58 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C39781065672 for ; Fri, 30 May 2008 23:02:58 +0000 (UTC) (envelope-from jdc@parodius.com) Received: from mx01.sc1.parodius.com (mx01.sc1.parodius.com [72.20.106.3]) by mx1.freebsd.org (Postfix) with ESMTP id CF0FC8FC12 for ; Fri, 30 May 2008 23:02:58 +0000 (UTC) (envelope-from jdc@parodius.com) Received: by mx01.sc1.parodius.com (Postfix, from userid 1000) id 9AAE71CC031; Fri, 30 May 2008 16:02:58 -0700 (PDT) Date: Fri, 30 May 2008 16:02:58 -0700 From: Jeremy Chadwick To: Stef Walter Message-ID: <20080530230258.GA61615@eos.sc1.parodius.com> References: <20080530210347.5E1A6F1808E@mx.npubs.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080530210347.5E1A6F1808E@mx.npubs.com> User-Agent: Mutt/1.5.17 (2007-11-01) Cc: freebsd-hackers@freebsd.org Subject: Re: RAID status issues with Intel MatrixRAID ataraid X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 May 2008 23:02:58 -0000 On Fri, May 30, 2008 at 09:03:48PM +0000, Stef Walter wrote: > This isn't a bug report, just a heads up to anyone using the same setup. > This occurred in production, and I don't currently have a non-production > hardware on which to investigate this bug and/or create a patch. > > In certain conditions, even though the Firmware RAID BIOS, says that a > RAID is degraded, the FreeBSD driver thinks it's business as usual. In > my case this resulted in file system corruption. Relevant output below. See the "ATA (SATA, PATA, ATAPI)" section, specifically the Intel MatrixRAID items: http://wiki.freebsd.org/JeremyChadwick/Commonly_reported_issues -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 01:49:27 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 897661065675 for ; Sat, 31 May 2008 01:49:27 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 2416C8FC15 for ; Sat, 31 May 2008 01:49:27 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.2/8.14.2) with ESMTP id m4V1nIoO030810; Fri, 30 May 2008 21:49:18 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Fri, 30 May 2008 21:43:11 -0400 User-Agent: KMail/1.9.7 References: <20080530210347.5E1A6F1808E@mx.npubs.com> In-Reply-To: <20080530210347.5E1A6F1808E@mx.npubs.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200805302143.11920.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Fri, 30 May 2008 21:49:20 -0400 (EDT) X-Virus-Scanned: ClamAV 0.91.2/7300/Fri May 30 19:42:28 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: Stef Walter Subject: Re: RAID status issues with Intel MatrixRAID ataraid X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 01:49:27 -0000 On Friday 30 May 2008 05:03:48 pm Stef Walter wrote: > This isn't a bug report, just a heads up to anyone using the same setup. > This occurred in production, and I don't currently have a non-production > hardware on which to investigate this bug and/or create a patch. > > In certain conditions, even though the Firmware RAID BIOS, says that a > RAID is degraded, the FreeBSD driver thinks it's business as usual. In > my case this resulted in file system corruption. Relevant output below. > > FreeBSD version: 6.3-RELEASE-p2 > > Cheers, > Stef Walter > > > > BIOS OUTPUT: > > Copyright(C) 2003-06 Intel Corporation. All Rights Reserved. > > RAID Volumes: > ID Name Level Strip Size Status Bootable > 0 RAID Set 1 RAID1(Mirror) N/A 465.8GB Degraded Yes > 1 RAID1(Mirror) N/A 465.8GB Normal Yes > > Physical Disks: > Port Drive Model Serial # Size Type/Status(Vol ID) > 0 WDC WD5000ABYS-0 WD-WCAPW5637184 465.8GB Member Disk(0) > 1 ST3500320NS 5QM09E6F 465.8GB Error Occurred(0) > 2 WDC WD5000ABYS-0 WD-WCAPW5548822 465.8GB Member Disk(1) > 3 ST3500320NS 5QM0991D 465.8GB Member Disk(1) > Press to enter Configuration Utility........... > > > > RELEVANT SNIPPET FROM DMESG: > > ar0: 476937MB status: READY > ar0: disk0 READY (master) using ad4 at ata2-master > ar0: disk1 READY (mirror) using ad6 at ata3-master Err, you have two RAID volumes, one degraded, and one ok. ar0 is apparently the one that is ok (drives 2 and 3). What is more odd is that it isn't seeing a RAID config at all for ad0 and ad2 (drives 0 and 1). -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 00:38:52 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EA21B106564A for ; Sat, 31 May 2008 00:38:52 +0000 (UTC) (envelope-from stef@memberwebs.com) Received: from mx.npubs.com (mail.writemehere.com [209.66.100.224]) by mx1.freebsd.org (Postfix) with ESMTP id E9A358FC30 for ; Sat, 31 May 2008 00:38:52 +0000 (UTC) (envelope-from stef@memberwebs.com) Received: from mx.npubs.com (avhost [209.66.100.194]) by mx.npubs.com (Postfix) with ESMTP id AD679F183D0; Sat, 31 May 2008 00:38:49 +0000 (UTC) Received: from northstar-srv2 (unknown [172.27.2.11]) by mx.npubs.com (Postfix) with ESMTP id D33C7F18286; Sat, 31 May 2008 00:38:48 +0000 (UTC) From: Stef Walter User-Agent: Thunderbird 2.0.0.14 (X11/20080505) MIME-Version: 1.0 To: Jeremy Chadwick References: <20080530210347.5E1A6F1808E@mx.npubs.com> <20080530230258.GA61615@eos.sc1.parodius.com> X-Enigmail-Version: 0.95.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-Id: <20080531003848.D33C7F18286@mx.npubs.com> X-Virus-Scanned: ClamAV using ClamSMTP Date: Sat, 31 May 2008 00:38:49 +0000 (UTC) X-Mailman-Approved-At: Sat, 31 May 2008 02:26:21 +0000 Cc: freebsd-hackers@freebsd.org Subject: Re: RAID status issues with Intel MatrixRAID ataraid X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 00:38:53 -0000 Jeremy Chadwick wrote: >> In certain conditions, even though the Firmware RAID BIOS, says that a >> RAID is degraded, the FreeBSD driver thinks it's business as usual. In >> my case this resulted in file system corruption. Relevant output below. > > See the "ATA (SATA, PATA, ATAPI)" section, specifically the Intel > MatrixRAID items: > > http://wiki.freebsd.org/JeremyChadwick/Commonly_reported_issues Yes, I reported several of those as well as provided patches for them. That was back when I had relevant hardware in my lab. Cheers, Stef Walter From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 06:19:07 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 886471065674 for ; Sat, 31 May 2008 06:19:07 +0000 (UTC) (envelope-from tzhuan@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.159]) by mx1.freebsd.org (Postfix) with ESMTP id 2ED068FC0A for ; Sat, 31 May 2008 06:19:06 +0000 (UTC) (envelope-from tzhuan@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so299568fgb.35 for ; Fri, 30 May 2008 23:19:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition:x-google-sender-auth; bh=rc8++1dTmO2yt2T1yVaZOZfXd1rYVALuIzxMg6HoNCA=; b=C7AIoAXk06lsx9OFHfLNWVhh6be+TMjYDxivEUk2QYI0fOTEp8whtfMS1PldpBZmH/iW6g292UiyCFoqEiGwQy/LVEO0QkMAuu0yscqls+fW3/R2+MtE/9iFNhzvDOolPHybH56T93EOidgcypd+vB7ynehgxJnl4RRgxOHGFdE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition:x-google-sender-auth; b=x2Ds4byKywOcVS4wg4C1YaQNh45IrP24knAUl3GDfdS2DsT+ST9/5Iq5MCwG1BbraVj33uRMDOD2Y/S8v46RmwtOVmgU/UuJ2PH/qB+AzbS9l6bJuLi68h4PDaUZGfY9TnH11wQfE8ybxaNoPaUuMxTX4XGVJ52Ss2g1MBHYpKQ= Received: by 10.86.77.5 with SMTP id z5mr9803050fga.35.1212213176388; Fri, 30 May 2008 22:52:56 -0700 (PDT) Received: by 10.86.92.1 with HTTP; Fri, 30 May 2008 22:52:56 -0700 (PDT) Message-ID: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> Date: Sat, 31 May 2008 13:52:56 +0800 From: "Tz-Huan Huang" Sender: tzhuan@gmail.com To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Google-Sender-Auth: 3b5931899e735fad Subject: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 06:19:07 -0000 Hi, Our nfs server is running 7-stable/amd64 with 8G ram, the size of zfs pool is 12T. We have set vm.kmem_size and vm.kmem_size_max to 1.5G, but the kernel still panics by "kmem_map too small" often. According to [1], the limitation is not only by the loader (is it fixed now?) but also by the default layout of KVM. [2] points a way to increase the KVM, but we get the similar linking error. Is there any standard way to modify the layout of KVM? For example, we may want to set KVM to 6G and leave the 2G for user space usage. Thanks, Tz-Huan [1] http://lists.freebsd.org/pipermail/freebsd-current/2007-October/077964.html [2] http://lists.freebsd.org/pipermail/freebsd-current/2008-March/084325.html From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 10:05:13 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 970C01065670 for ; Sat, 31 May 2008 10:05:13 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 1148B8FC21 for ; Sat, 31 May 2008 10:05:10 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1K2NxS-0002I0-BD for freebsd-hackers@freebsd.org; Sat, 31 May 2008 10:05:06 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sat, 31 May 2008 10:05:06 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sat, 31 May 2008 10:05:06 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Ivan Voras Date: Sat, 31 May 2008 12:04:52 +0200 Lines: 41 Message-ID: References: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig05359D5641FA785C27CA8C95" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.14 (X11/20080505) In-Reply-To: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 10:05:13 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig05359D5641FA785C27CA8C95 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Tz-Huan Huang wrote: > Is there any standard way to modify the layout of KVM? For example, we > may want to set KVM to 6G and leave the 2G for user space usage. > [2] http://lists.freebsd.org/pipermail/freebsd-current/2008-March/08432= 5.html Isn't this a limitation of gcc and the kernel/userland memory model inherited from Linux? ref: http://www.network-theory.co.uk/docs/gccintro/gccintro_65.html http://gcc.gnu.org/onlinedocs/gcc-3.4.4/gcc/i386-and-x86_002d64-Options.h= tml (see -mcmodel=3Dkernel) If it is, I don't think it will be "fixed" soon. --------------enig05359D5641FA785C27CA8C95 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFIQSLEldnAQVacBcgRAoiIAKCtphe/tn7nmwGabPTfVPmmQC9uqgCgogxi bNzfID+yyh1AlrFUG77pPgk= =gUB0 -----END PGP SIGNATURE----- --------------enig05359D5641FA785C27CA8C95-- From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 10:11:38 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3B6FD1065676 for ; Sat, 31 May 2008 10:11:38 +0000 (UTC) (envelope-from stefan@fafoe.narf.at) Received: from viefep32-int.chello.at (viefep32-int.chello.at [62.179.121.50]) by mx1.freebsd.org (Postfix) with ESMTP id 4A9EB8FC15 for ; Sat, 31 May 2008 10:11:36 +0000 (UTC) (envelope-from stefan@fafoe.narf.at) Received: from lizard.fafoe.narf.at ([213.47.85.26]) by viefep32-int.chello.at (InterMail vM.7.08.02.02 201-2186-121-104-20070414) with ESMTP id <20080531101135.JEDI25835.viefep32-int.chello.at@lizard.fafoe.narf.at>; Sat, 31 May 2008 12:11:35 +0200 Received: by lizard.fafoe.narf.at (Postfix, from userid 1001) id 2BB88BAEC; Sat, 31 May 2008 12:11:01 +0200 (CEST) Date: Sat, 31 May 2008 12:11:01 +0200 From: Stefan Farfeleder To: John Baldwin Message-ID: <20080531101101.GA1077@lizard.fafoe.narf.at> Mail-Followup-To: John Baldwin , freebsd-hackers@freebsd.org, hackers@freebsd.org, Mike Meyer , John E Hein References: <20080309152712.42752293@bhuda.mired.org> <18489.32903.477434.465037@gromit.timing.com> <20080525154537.GB1026@lizard.fafoe.narf.at> <200805290004.41653.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200805290004.41653.jhb@freebsd.org> User-Agent: Mutt/1.5.17 (2007-11-01) Cc: freebsd-hackers@freebsd.org, hackers@freebsd.org, Mike Meyer , John E Hein Subject: Re: Why doesn't autoconf like our /bin/sh? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 10:11:38 -0000 On Thu, May 29, 2008 at 12:04:41AM -0400, John Baldwin wrote: > On Sunday 25 May 2008 11:45:37 am Stefan Farfeleder wrote: > > On Sun, May 25, 2008 at 09:06:47AM -0600, John E Hein wrote: > > > FWIW, it seems bash and sh report line number differently. > > > > > > # grep -n ^ ~/tmp/ln > > > 1:#!/bin/sh > > > 2:echo f line: $LINENO > > > 3:f() > > > 4:{ > > > 5:echo f line: $LINENO > > > 6:} > > > 7: > > > 8:f > > > 9:echo main line: $LINENO > > > 10:f > > > > > > > > > # /bin/sh ~/tmp/ln > > > f line: 2 > > > f line: 3 > > > main line: 9 > > > f line: 3 > > > > > > > > > # bash ~/tmp/ln > > > f line: 2 > > > f line: 5 > > > main line: 9 > > > f line: 5 > > > > Yes, I know. I think it is a bug in bash as SUSv3 states: > > > > "Set by the shell to a decimal number representing the current > > sequential line number (numbered starting with 1) within a script or > > function before it executes each command." > > Actually, the bash way seems more intuitive. And it does say "the current > sequentional line number within a ... function before it executes each > command" > > The "within a function" implies that this property goes inside of functions > instead of forcing all commands in a function to use the starting line of the > function which is what you are saying? I've started a thread about that on standards@. From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 10:26:58 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ED35D106567B; Sat, 31 May 2008 10:26:58 +0000 (UTC) (envelope-from stefan@fafoe.narf.at) Received: from viefep34-int.chello.at (viefep18-int.chello.at [213.46.255.22]) by mx1.freebsd.org (Postfix) with ESMTP id 05AC68FC36; Sat, 31 May 2008 10:26:57 +0000 (UTC) (envelope-from stefan@fafoe.narf.at) Received: from lizard.fafoe.narf.at ([213.47.85.26]) by viefep32-int.chello.at (InterMail vM.7.08.02.02 201-2186-121-104-20070414) with ESMTP id <20080531101135.JEDI25835.viefep32-int.chello.at@lizard.fafoe.narf.at>; Sat, 31 May 2008 12:11:35 +0200 Received: by lizard.fafoe.narf.at (Postfix, from userid 1001) id 2BB88BAEC; Sat, 31 May 2008 12:11:01 +0200 (CEST) Date: Sat, 31 May 2008 12:11:01 +0200 From: Stefan Farfeleder To: John Baldwin Message-ID: <20080531101101.GA1077@lizard.fafoe.narf.at> Mail-Followup-To: John Baldwin , freebsd-hackers@freebsd.org, hackers@freebsd.org, Mike Meyer , John E Hein References: <20080309152712.42752293@bhuda.mired.org> <18489.32903.477434.465037@gromit.timing.com> <20080525154537.GB1026@lizard.fafoe.narf.at> <200805290004.41653.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200805290004.41653.jhb@freebsd.org> User-Agent: Mutt/1.5.17 (2007-11-01) Cc: freebsd-hackers@freebsd.org, hackers@freebsd.org, Mike Meyer , John E Hein Subject: Re: Why doesn't autoconf like our /bin/sh? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 10:26:59 -0000 On Thu, May 29, 2008 at 12:04:41AM -0400, John Baldwin wrote: > On Sunday 25 May 2008 11:45:37 am Stefan Farfeleder wrote: > > On Sun, May 25, 2008 at 09:06:47AM -0600, John E Hein wrote: > > > FWIW, it seems bash and sh report line number differently. > > > > > > # grep -n ^ ~/tmp/ln > > > 1:#!/bin/sh > > > 2:echo f line: $LINENO > > > 3:f() > > > 4:{ > > > 5:echo f line: $LINENO > > > 6:} > > > 7: > > > 8:f > > > 9:echo main line: $LINENO > > > 10:f > > > > > > > > > # /bin/sh ~/tmp/ln > > > f line: 2 > > > f line: 3 > > > main line: 9 > > > f line: 3 > > > > > > > > > # bash ~/tmp/ln > > > f line: 2 > > > f line: 5 > > > main line: 9 > > > f line: 5 > > > > Yes, I know. I think it is a bug in bash as SUSv3 states: > > > > "Set by the shell to a decimal number representing the current > > sequential line number (numbered starting with 1) within a script or > > function before it executes each command." > > Actually, the bash way seems more intuitive. And it does say "the current > sequentional line number within a ... function before it executes each > command" > > The "within a function" implies that this property goes inside of functions > instead of forcing all commands in a function to use the starting line of the > function which is what you are saying? I've started a thread about that on standards@. From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 14:36:52 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7DCF31065675; Sat, 31 May 2008 14:36:52 +0000 (UTC) (envelope-from lulf@stud.ntnu.no) Received: from bene1.itea.ntnu.no (bene1.itea.ntnu.no [IPv6:2001:700:300:3::56]) by mx1.freebsd.org (Postfix) with ESMTP id B8D438FC0C; Sat, 31 May 2008 14:36:51 +0000 (UTC) (envelope-from lulf@stud.ntnu.no) Received: from localhost (localhost [127.0.0.1]) by bene1.itea.ntnu.no (Postfix) with ESMTP id 33E8116C7B8; Sat, 31 May 2008 16:36:50 +0200 (CEST) Received: from nobby.studby.ntnu.no (unknown [IPv6:2001:700:300:3::184]) by bene1.itea.ntnu.no (Postfix) with ESMTP id C590416C7B2; Sat, 31 May 2008 16:36:49 +0200 (CEST) Date: Sat, 31 May 2008 16:36:55 +0200 From: Ulf Lilleengen To: freebsd-current@freebsd.org Message-ID: <20080531143655.GA14020@nobby.studby.ntnu.no> Mail-Followup-To: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.17 (2007-11-01) X-Virus-Scanned: Debian amavisd-new at bene1.itea.ntnu.no Cc: freebsd-hackers@freebsd.org Subject: CFT: CVSMode for csup with MD5 check X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 14:36:52 -0000 Hello, As a followup to my previous patch on csup, I've tried to do some fixes to RCS-files. However, instead of doing major workarounds in csup to handle files which does not behave correctly to RCS, I implemented MD5 check of RCS content. This means that the MD5 sum from cvsupd is checked against the actual RCS content (which is different from a normal MD5 check, because only the content is compared), and if it's not correct, a fixup of the file will be sent, thus making sure that the contents are correct. I hope some of you are able to test this. There are still a few issues with cvsmode: - Not correct entries in status file. - I get unnatural high memory usage. Patches here: http://people.freebsd.org/~lulf/patches/csup/csup_2008-05-31_CURRENT.diff and http://people.freebsd.org/~lulf/patches/csup/csup_2008-05-31_RELENG_7.diff -- Ulf Lilleengen From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 16:04:15 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7917F106567E for ; Sat, 31 May 2008 16:04:15 +0000 (UTC) (envelope-from imp@bsdimp.com) Received: from harmony.bsdimp.com (bsdimp.com [199.45.160.85]) by mx1.freebsd.org (Postfix) with ESMTP id 15E4D8FC0C for ; Sat, 31 May 2008 16:04:15 +0000 (UTC) (envelope-from imp@bsdimp.com) Received: from localhost (localhost [127.0.0.1]) by harmony.bsdimp.com (8.14.2/8.14.1) with ESMTP id m4VG2H5Q003579; Sat, 31 May 2008 10:02:18 -0600 (MDT) (envelope-from imp@bsdimp.com) Date: Sat, 31 May 2008 10:03:53 -0600 (MDT) Message-Id: <20080531.100353.451147141.imp@bsdimp.com> To: avg@icyb.net.ua From: "M. Warner Losh" In-Reply-To: <48285372.9060103@icyb.net.ua> References: <48285372.9060103@icyb.net.ua> X-Mailer: Mew version 5.2 on Emacs 21.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: openbsd solution to mounted umass removal X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 16:04:15 -0000 In message: <48285372.9060103@icyb.net.ua> Andriy Gapon writes: : : I've just came back from a good 2 week vacation and catching up on news. : In release notes for OpenBSD 4.3 I see the following: : http://openbsd.org/43.html : Filesystems on USB devices are automatically dismounted if the device is : disconnected. : : Does anybody have more [technical] details on this? effectively, that's what -current winds up doing... except for the actual umount() call... Warner From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 16:52:51 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 47BD1106566C for ; Sat, 31 May 2008 16:52:51 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 24FE68FC1A for ; Sat, 31 May 2008 16:52:51 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from zion.baldwin.cx (server.baldwin.cx [208.65.91.234]) by elvis.mu.org (Postfix) with ESMTP id CA2111A4D83; Sat, 31 May 2008 09:52:50 -0700 (PDT) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Sat, 31 May 2008 12:49:53 -0400 User-Agent: KMail/1.9.7 References: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> In-Reply-To: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200805311249.53986.jhb@freebsd.org> Cc: Tz-Huan Huang Subject: Re: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 16:52:51 -0000 On Saturday 31 May 2008 01:52:56 am Tz-Huan Huang wrote: > Hi, > > Our nfs server is running 7-stable/amd64 with 8G ram, the size of zfs > pool is 12T. We have set vm.kmem_size and vm.kmem_size_max to > 1.5G, but the kernel still panics by "kmem_map too small" often. > According to [1], the limitation is not only by the loader (is it fixed > now?) but also by the default layout of KVM. [2] points a way to increase > the KVM, but we get the similar linking error. > > Is there any standard way to modify the layout of KVM? For example, we > may want to set KVM to 6G and leave the 2G for user space usage. On i386 you only have 4GB of virtual address space period. For amd64 you can jack up KVM just fine AFAIK. The mcmodel=kernel stuff should only affect global variables (so .data and .bss) and not malloc'd stuff. Have you tried increasing the KVM size and seeing what happens? -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 17:58:10 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 28718106564A for ; Sat, 31 May 2008 17:58:10 +0000 (UTC) (envelope-from tzhuan@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.159]) by mx1.freebsd.org (Postfix) with ESMTP id 8CBFE8FC17 for ; Sat, 31 May 2008 17:58:09 +0000 (UTC) (envelope-from tzhuan@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so414049fgb.35 for ; Sat, 31 May 2008 10:58:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; bh=HnfFvco83XB3H9FKrfArIgrbDkIrdK/ws6OeQj+cZxM=; b=xYQe0vyV/6vYUugPkrSUjbE7a9SUaWSOp4/7U8MuP8pdnBmAUX79bWRkBO9qyZVGht5GiVxj4eZ1Zy9Ei3B5WqQKXaR+K5W+VQSxlcnqEV6m1P7xWxANE14JgSH0ySvZKOxTKC446tD7mP003csSZJNQ+yjxO4RsU0NoQ2DgPTk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=IlAQyij1DIcPNXfahioQBgwqtdAecn2bS3bHeTJBWLODvEDKJzcSkSagg4iCZ/9yM+QGE8ZS6izK0Z+FPRml2rm2yDuYV1PQEel65qa+1vlcuyhznTIsGtoj5aPAzHD1IaWNLYGaivU5ydaZA5zSxkW003lHwGF/nrJyO8nzGXQ= Received: by 10.86.76.20 with SMTP id y20mr685654fga.5.1212256686503; Sat, 31 May 2008 10:58:06 -0700 (PDT) Received: by 10.86.92.1 with HTTP; Sat, 31 May 2008 10:58:06 -0700 (PDT) Message-ID: <6a7033710805311058t41ef1ffah97648975f842846d@mail.gmail.com> Date: Sun, 1 Jun 2008 01:58:06 +0800 From: "Tz-Huan Huang" Sender: tzhuan@gmail.com To: "John Baldwin" In-Reply-To: <200805311249.53986.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> <200805311249.53986.jhb@freebsd.org> X-Google-Sender-Auth: 4a8bde6555d7297f Cc: freebsd-hackers@freebsd.org Subject: Re: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 17:58:10 -0000 On Sun, Jun 1, 2008 at 12:49 AM, John Baldwin wrote: > On Saturday 31 May 2008 01:52:56 am Tz-Huan Huang wrote: >> Hi, >> >> Our nfs server is running 7-stable/amd64 with 8G ram, the size of zfs >> pool is 12T. We have set vm.kmem_size and vm.kmem_size_max to >> 1.5G, but the kernel still panics by "kmem_map too small" often. >> According to [1], the limitation is not only by the loader (is it fixed >> now?) but also by the default layout of KVM. [2] points a way to increase >> the KVM, but we get the similar linking error. >> >> Is there any standard way to modify the layout of KVM? For example, we >> may want to set KVM to 6G and leave the 2G for user space usage. > > On i386 you only have 4GB of virtual address space period. For amd64 you can > jack up KVM just fine AFAIK. The mcmodel=kernel stuff should only affect > global variables (so .data and .bss) and not malloc'd stuff. Have you tried > increasing the KVM size and seeing what happens? Actaully I have no idea how to increase the KVM size ... Should I change some knobs on kernel conifg or some codes? When setting the vm.kmem_size to almost or more than 2G, the kernel panics immediately after booting. When I change the KPDPI like [1], I have linking error. Thanks, Tz-Huan [1] http://lists.freebsd.org/pipermail/freebsd-current/2008-March/084325.html From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 18:18:10 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 860191065672 for ; Sat, 31 May 2008 18:18:10 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.zoral.com.ua (skuns.zoral.com.ua [91.193.166.194]) by mx1.freebsd.org (Postfix) with ESMTP id BEE838FC19 for ; Sat, 31 May 2008 18:18:09 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id m4VHuAW4080416 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 31 May 2008 20:56:10 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.2/8.14.2) with ESMTP id m4VHu9YX059239; Sat, 31 May 2008 20:56:09 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.2/8.14.2/Submit) id m4VHu8hj059238; Sat, 31 May 2008 20:56:08 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 31 May 2008 20:56:08 +0300 From: Kostik Belousov To: John Baldwin Message-ID: <20080531175608.GH21317@deviant.kiev.zoral.com.ua> References: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> <200805311249.53986.jhb@freebsd.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="LNKrWK8T5LDJo+fl" Content-Disposition: inline In-Reply-To: <200805311249.53986.jhb@freebsd.org> User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: ClamAV version 0.91.2, clamav-milter version 0.91.2 on skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.4 X-Spam-Checker-Version: SpamAssassin 3.2.4 (2008-01-01) on skuns.kiev.zoral.com.ua Cc: freebsd-hackers@freebsd.org, Tz-Huan Huang Subject: Re: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 18:18:10 -0000 --LNKrWK8T5LDJo+fl Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, May 31, 2008 at 12:49:53PM -0400, John Baldwin wrote: > On Saturday 31 May 2008 01:52:56 am Tz-Huan Huang wrote: > > Hi, > > > > Our nfs server is running 7-stable/amd64 with 8G ram, the size of zfs > > pool is 12T. We have set vm.kmem_size and vm.kmem_size_max to > > 1.5G, but the kernel still panics by "kmem_map too small" often. > > According to [1], the limitation is not only by the loader (is it fixed > > now?) but also by the default layout of KVM. [2] points a way to increa= se > > the KVM, but we get the similar linking error. > > > > Is there any standard way to modify the layout of KVM? For example, we > > may want to set KVM to 6G and leave the 2G for user space usage. >=20 > On i386 you only have 4GB of virtual address space period. For amd64 you= can=20 > jack up KVM just fine AFAIK. The mcmodel=3Dkernel stuff should only affe= ct=20 > global variables (so .data and .bss) and not malloc'd stuff. Have you tr= ied=20 > increasing the KVM size and seeing what happens? I believe the module memory is malloc'ed, isn't it ? --LNKrWK8T5LDJo+fl Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkhBkTgACgkQC3+MBN1Mb4h+UgCdGaiEYnRREBtseg/QpffMsNcz Ef8An0DPVGCB8RaiF5KkWXfZymVIcVlw =7GoJ -----END PGP SIGNATURE----- --LNKrWK8T5LDJo+fl-- From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 18:28:18 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D792B106564A; Sat, 31 May 2008 18:28:18 +0000 (UTC) (envelope-from stef-list@memberwebs.com) Received: from mx.npubs.com (mx.npubs.com [209.66.100.224]) by mx1.freebsd.org (Postfix) with ESMTP id AB1938FC19; Sat, 31 May 2008 18:28:18 +0000 (UTC) (envelope-from stef-list@memberwebs.com) Received: from mx.npubs.com (avhost [209.66.100.194]) by mx.npubs.com (Postfix) with ESMTP id B7211F180B9; Sat, 31 May 2008 18:08:00 +0000 (UTC) Received: from northstar-srv2 (unknown [172.27.2.11]) by mx.npubs.com (Postfix) with ESMTP id EAEBAF180A0; Sat, 31 May 2008 18:07:59 +0000 (UTC) From: Stef Walter User-Agent: Thunderbird 2.0.0.14 (X11/20080505) MIME-Version: 1.0 To: John Baldwin References: <20080530210347.5E1A6F1808E@mx.npubs.com> <200805302143.11920.jhb@freebsd.org> Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 7bit Message-Id: <20080531180759.EAEBAF180A0@mx.npubs.com> X-Virus-Scanned: ClamAV using ClamSMTP Date: Sat, 31 May 2008 18:08:00 +0000 (UTC) Cc: freebsd-hackers@freebsd.org Subject: Re: RAID status issues with Intel MatrixRAID ataraid X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: stef@memberwebs.com List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 18:28:18 -0000 John Baldwin wrote: >> Physical Disks: >> Port Drive Model Serial # Size Type/Status(Vol ID) >> 0 WDC WD5000ABYS-0 WD-WCAPW5637184 465.8GB Member Disk(0) >> 1 ST3500320NS 5QM09E6F 465.8GB Error Occurred(0) >> 2 WDC WD5000ABYS-0 WD-WCAPW5548822 465.8GB Member Disk(1) >> 3 ST3500320NS 5QM0991D 465.8GB Member Disk(1) >> Press to enter Configuration Utility........... >> >> >> >> RELEVANT SNIPPET FROM DMESG: >> >> ar0: 476937MB status: READY >> ar0: disk0 READY (master) using ad4 at ata2-master >> ar0: disk1 READY (mirror) using ad6 at ata3-master > > Err, you have two RAID volumes, one degraded, and one ok. ar0 is apparently > the one that is ok (drives 2 and 3). What is more odd is that it isn't > seeing a RAID config at all for ad0 and ad2 (drives 0 and 1). Nope, ar1 (with ad8 and ad10) is the second RAID, both are marked as READY even though one is degraded in the BIOS. ar0: 476937MB status: READY ar0: disk0 READY (master) using ad4 at ata2-master ar0: disk1 READY (mirror) using ad6 at ata3-master ar1: 476937MB status: READY ar1: disk0 READY (master) using ad8 at ata4-master ar1: disk1 READY (mirror) using ad10 at ata5-master In any case, this is water under the bridge for me now. Cheers, Stef Walter From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 18:47:33 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 918E0106567B; Sat, 31 May 2008 18:47:33 +0000 (UTC) (envelope-from jdc@parodius.com) Received: from mx01.sc1.parodius.com (mx01.sc1.parodius.com [72.20.106.3]) by mx1.freebsd.org (Postfix) with ESMTP id 466308FC31; Sat, 31 May 2008 18:47:33 +0000 (UTC) (envelope-from jdc@parodius.com) Received: by mx01.sc1.parodius.com (Postfix, from userid 1000) id 465EC1CC031; Sat, 31 May 2008 11:47:33 -0700 (PDT) Date: Sat, 31 May 2008 11:47:33 -0700 From: Jeremy Chadwick To: John Baldwin Message-ID: <20080531184733.GA8470@eos.sc1.parodius.com> References: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> <200805311249.53986.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200805311249.53986.jhb@freebsd.org> User-Agent: Mutt/1.5.17 (2007-11-01) Cc: freebsd-hackers@freebsd.org, Tz-Huan Huang Subject: Re: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 18:47:33 -0000 On Sat, May 31, 2008 at 12:49:53PM -0400, John Baldwin wrote: > On Saturday 31 May 2008 01:52:56 am Tz-Huan Huang wrote: > > Hi, > > > > Our nfs server is running 7-stable/amd64 with 8G ram, the size of zfs > > pool is 12T. We have set vm.kmem_size and vm.kmem_size_max to > > 1.5G, but the kernel still panics by "kmem_map too small" often. > > According to [1], the limitation is not only by the loader (is it fixed > > now?) but also by the default layout of KVM. [2] points a way to increase > > the KVM, but we get the similar linking error. > > > > Is there any standard way to modify the layout of KVM? For example, we > > may want to set KVM to 6G and leave the 2G for user space usage. > > On i386 you only have 4GB of virtual address space period. For amd64 you can > jack up KVM just fine AFAIK. The mcmodel=kernel stuff should only affect > global variables (so .data and .bss) and not malloc'd stuff. Have you tried > increasing the KVM size and seeing what happens? On amd64 there's still a 2GB limit, re: vm.kmem_size. Increasing it to or past 2048M results in the message "kmem_suballoc(): bad status return of 3". http://lists.freebsd.org/pipermail/freebsd-stable/2008-May/042764.html -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 19:01:57 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 260291065675 for ; Sat, 31 May 2008 19:01:57 +0000 (UTC) (envelope-from tzhuan@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.155]) by mx1.freebsd.org (Postfix) with ESMTP id 771938FC0C for ; Sat, 31 May 2008 19:01:56 +0000 (UTC) (envelope-from tzhuan@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so423290fgb.35 for ; Sat, 31 May 2008 12:01:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; bh=cqdXPAWFMmeYnrCEl77fcX9dH7Du0bUAQXPaaHKh6b4=; b=j/VWPeapm9HSL6XwztbF0JIsWE0DKBRFH/g5OvP5fue7/jyjFmyE6euN7N34ggE7GRLz/BOVUDFdoJrvyKJNel22FN+8itUr2uTmQcfm9X8rh/d84feiBUvc1aVhjyxr67AHWQl32JFWpRtCrNA3suD8HoAz0yCqYIuY8Zrhw6o= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=ZoxMRRp+cWfkAa8d0osm8ZWHwPb7Y7/TeuWQ4PY7t5lcTgvEmC6AsT9CuGs0rGNumOS4/QNjLDsJO0MlCo298t+csKZi9RXrbiR8GCXYON+/6ddwTnN03Qp+tYcMx59XJLBpJF5iJ0OyIaYWsguZgqW3s9L76wp1kfxLaLWeOJE= Received: by 10.86.90.13 with SMTP id n13mr5998450fgb.3.1212260515277; Sat, 31 May 2008 12:01:55 -0700 (PDT) Received: by 10.86.92.1 with HTTP; Sat, 31 May 2008 12:01:55 -0700 (PDT) Message-ID: <6a7033710805311201t4085edcpc2f1ac9fa554c000@mail.gmail.com> Date: Sun, 1 Jun 2008 03:01:55 +0800 From: "Tz-Huan Huang" Sender: tzhuan@gmail.com To: Maslan In-Reply-To: <319cceca0805311154w5f705b2cp771392cd86ba888@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> <319cceca0805311154w5f705b2cp771392cd86ba888@mail.gmail.com> X-Google-Sender-Auth: fd026a976e1ba99c Cc: freebsd-hackers@freebsd.org Subject: Re: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 19:01:57 -0000 On Sun, Jun 1, 2008 at 2:54 AM, Maslan wrote: > Hi, > > is PAE enabled in your kernel config ? Our server runs on amd64. I might be wrong, but I think PAE is for i386 only, right? Thanks, Tz-Huan From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 19:18:15 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 240D7106568C for ; Sat, 31 May 2008 19:18:15 +0000 (UTC) (envelope-from maslanbsd@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.170]) by mx1.freebsd.org (Postfix) with ESMTP id D359E8FC1A for ; Sat, 31 May 2008 19:18:14 +0000 (UTC) (envelope-from maslanbsd@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so350089wfg.7 for ; Sat, 31 May 2008 12:18:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=MiC3YGceRQgpgCgFEY75X+XZZQ65L0O9vkLGJHxDj3w=; b=Q4l2BM63BX9iZOYR5MOQu1jHio28AlhUg5Sd2RiyCYs7K26Rn0LVmUpFCCWaT2Es44vCMxg3+9AWnsdpf0r1wlWUcK0MFRObRi+lATGfLZFd2TePjjX07dC2Y7gNOZObygo/5YMlKt08Oi2XiYI+RGyUu2Tz5G9Yi4DPgxZB4mE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=fuWg8m8NZr44D66MX0xDv7bP3mBCogzTgVOOad26Dw9GJBn+cYEC3bh1VZ0u70Y8WVUh7/hhhxR8FkVXL6+RI0Bu82BRuah0z7jpQ3MnfTi9tquU60v2y37HonoeXHejQxgdrziWz6OFeMas/lkUZw4uvPYr4Cimm9jZz+Nq1wo= Received: by 10.142.188.4 with SMTP id l4mr2771708wff.92.1212260046567; Sat, 31 May 2008 11:54:06 -0700 (PDT) Received: by 10.143.195.5 with HTTP; Sat, 31 May 2008 11:54:06 -0700 (PDT) Message-ID: <319cceca0805311154w5f705b2cp771392cd86ba888@mail.gmail.com> Date: Sat, 31 May 2008 18:54:06 +0000 From: Maslan To: "Tz-Huan Huang" In-Reply-To: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> Cc: freebsd-hackers@freebsd.org Subject: Re: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 19:18:15 -0000 Hi, is PAE enabled in your kernel config ? Thanks On Sat, May 31, 2008 at 5:52 AM, Tz-Huan Huang wrote: > Hi, > > Our nfs server is running 7-stable/amd64 with 8G ram, the size of zfs > pool is 12T. We have set vm.kmem_size and vm.kmem_size_max to > 1.5G, but the kernel still panics by "kmem_map too small" often. > According to [1], the limitation is not only by the loader (is it fixed now?) > but also by the default layout of KVM. [2] points a way to increase the > KVM, but we get the similar linking error. > > Is there any standard way to modify the layout of KVM? For example, we > may want to set KVM to 6G and leave the 2G for user space usage. > > Thanks, > Tz-Huan > > [1] http://lists.freebsd.org/pipermail/freebsd-current/2007-October/077964.html > [2] http://lists.freebsd.org/pipermail/freebsd-current/2008-March/084325.html > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > -- System Programmer -- I'm Searching For Perfection, So Even If U Need Portability U've To Use Assembly ;-) -- http://libosdk.berlios.de From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 20:03:52 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 67DC7106566C for ; Sat, 31 May 2008 20:03:52 +0000 (UTC) (envelope-from maslanbsd@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.172]) by mx1.freebsd.org (Postfix) with ESMTP id 2631D8FC1A for ; Sat, 31 May 2008 20:03:52 +0000 (UTC) (envelope-from maslanbsd@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so362670wfg.7 for ; Sat, 31 May 2008 13:03:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=UBkf/mtRn00bPfA6fnN2pEcYbSL1TsMZ79fANNC/DQM=; b=wypzn5myxVgKdxQRPGfdCxW77OT/uuHAEGdWbjw17PWqTo3cBd4rZJrX7NtR7U1KAd18b0QrsDXKn2t1mRE5QlQfTXjVp9PQ+qu7zz8ubk+WSHk2bVTjNCokY2QMTwWwqIAutIgnQZo+UOomi4z7rOjhvi7V1W1mZK6C0h2JZuk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=KgrUZIV5Zm/MvpuY0MzXqxgts3iY7P1XzlBQlAFKMb+5siwCuYyB/8GHbw+UqeGS8NP5br6381bf+YTlp/Cv7mze+xme4JsAqhDxhNSi46iGXTDlg2ExUTbJ2QuqLuIY2ohj2e745aEZsb1xhVyWjLxje3+u+pSiXJprAqMJJ2o= Received: by 10.142.89.13 with SMTP id m13mr2774608wfb.338.1212264231473; Sat, 31 May 2008 13:03:51 -0700 (PDT) Received: by 10.143.195.5 with HTTP; Sat, 31 May 2008 13:03:51 -0700 (PDT) Message-ID: <319cceca0805311303o61729e0dta615c442b6bd03ce@mail.gmail.com> Date: Sat, 31 May 2008 20:03:51 +0000 From: Maslan To: "Tz-Huan Huang" In-Reply-To: <6a7033710805311201t4085edcpc2f1ac9fa554c000@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <6a7033710805302252v43a7b240x66ca3f5e3dd5fda4@mail.gmail.com> <319cceca0805311154w5f705b2cp771392cd86ba888@mail.gmail.com> <6a7033710805311201t4085edcpc2f1ac9fa554c000@mail.gmail.com> Cc: freebsd-hackers@freebsd.org Subject: Re: Is there any way to increase the KVM? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 20:03:52 -0000 Your are right PAE is for i386, i mean try running i386 freebsd with PAE enabled rather than amd64. PAE will let you access 64GB which is far than you got. On Sat, May 31, 2008 at 7:01 PM, Tz-Huan Huang wrote: > On Sun, Jun 1, 2008 at 2:54 AM, Maslan wrote: >> Hi, >> >> is PAE enabled in your kernel config ? > > Our server runs on amd64. I might be wrong, but I think PAE is for i386 > only, right? > > Thanks, > Tz-Huan > -- System Programmer -- I'm Searching For Perfection, So Even If U Need Portability U've To Use Assembly ;-) -- http://libosdk.berlios.de From owner-freebsd-hackers@FreeBSD.ORG Sat May 31 21:15:50 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D67A01065675 for ; Sat, 31 May 2008 21:15:50 +0000 (UTC) (envelope-from pgollucci@p6m7g8.com) Received: from exhub015-1.exch015.msoutlookonline.net (exhub015-1.exch015.msoutlookonline.net [207.5.72.93]) by mx1.freebsd.org (Postfix) with ESMTP id BFC238FC1B for ; Sat, 31 May 2008 21:15:50 +0000 (UTC) (envelope-from pgollucci@p6m7g8.com) Received: from smgellar.p6m7g8.net (70.88.236.22) by smtpx15.msoutlookonline.net (207.5.72.103) with Microsoft SMTP Server (TLS) id 8.1.278.0; Sat, 31 May 2008 14:05:46 -0700 Message-ID: <4841BDA9.5090007@p6m7g8.com> Date: Sat, 31 May 2008 17:05:45 -0400 From: "Philip M. Gollucci" Organization: RideCharge Inc User-Agent: Thunderbird 2.0.0.14 (X11/20080506) MIME-Version: 1.0 To: Florent Thoumie References: In-Reply-To: Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit Cc: ports@freebsd.org, hackers@freebsd.org Subject: Re: CFT: adding configuration file support to pkg_install X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 May 2008 21:15:50 -0000 Florent Thoumie wrote: > This adds support for /etc/pkg.conf configuration file. > Also, this adds support for naive multi-site package fetching. > > Any comment welcome (and appreciated). > > Patch is here: http://people.freebsd.org/~flz/local/ports/pkg-install-config.diff > Tarball is here: > http://people.freebsd.org/~flz/local/ports/pkg-install-0a553aac.tar.bz2 Hi flz, I don't quite get what the end goal is. It looks like /etc/pkg.conf is duplicating a lot of things already in /usr/ports/Mk/bsd.port.mk. Would not it be better to just have the pkg_install tools read that file instead ? I probably missed all the back story here, so feel free to put me in my place. The multi-site package fetching is definitely something I'm interested it, but I also figured it would just iterate over the values in PACKAGESITE PACKAGESITE=ftp://foo/stdpath/base/Latest/ ftp://foo/stdpath/www/Latest where base would have things like sudo, bash, vim, etc... and could be used on multiple computers. www would have things like apache22 mod_X and would be used on 'www' class machines. -- ------------------------------------------------------------------------ Philip M. Gollucci (philip@ridecharge.com) o:703.549.2050x206 Senior System Admin - Riderway, Inc. http://riderway.com / http://ridecharge.com 1024D/DB9B8C1C B90B FBC3 A3A1 C71A 8E70 3F8C 75B8 8FFB DB9B 8C1C Work like you don't need the money, love like you'll never get hurt, and dance like nobody's watching.