From owner-freebsd-stable@FreeBSD.ORG Sat Oct 25 22:53:53 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EF1D81065676 for ; Sat, 25 Oct 2008 22:53:52 +0000 (UTC) (envelope-from marcus@freebsd.org) Received: from barracuda.ethostream.com (barracuda.ethostream.com [204.15.100.249]) by mx1.freebsd.org (Postfix) with ESMTP id AA9158FC18 for ; Sat, 25 Oct 2008 22:53:52 +0000 (UTC) (envelope-from marcus@freebsd.org) X-ASG-Debug-ID: 1224974232-56ae00190000-2ZKgNJ X-ASG-Debug-ID: 1224974232-56ae00190000-2ZKgNJ X-Barracuda-URL: http://204.15.100.249:8000/cgi-bin/mark.cgi Received: from relay.ethostream.com (www2.ethostream.com [204.15.100.237]) by barracuda.ethostream.com (Spam Firewall) with ESMTP id 02B6D649FCE; Sat, 25 Oct 2008 17:37:12 -0500 (CDT) Received: from relay.ethostream.com (www2.ethostream.com [204.15.100.237]) by barracuda.ethostream.com with ESMTP id jT7mv8Mfo79zV6hE; Sat, 25 Oct 2008 17:37:12 -0500 (CDT) Received: from ethoserver.ezone.net (unknown [66.172.159.54]) by relay.ethostream.com (Postfix) with ESMTPA id BCF0AFC002; Sat, 25 Oct 2008 17:37:09 -0500 (CDT) Received: from [10.0.0.134] (unknown [10.0.0.134]) by ethoserver.ezone.net (Postfix) with ESMTP id A324F350680; Sat, 25 Oct 2008 17:37:08 -0500 (CDT) Message-ID: <49039F94.2040707@freebsd.org> Date: Sat, 25 Oct 2008 18:37:08 -0400 From: Joe Marcus Clarke Organization: FreeBSD, Inc. User-Agent: Thunderbird 2.0.0.17 (Macintosh/20080914) MIME-Version: 1.0 To: Chris Peterson X-ASG-Orig-Subj: Re: kern.maxdsiz on amd63 with i386 binaries References: <9754CE37-FAAA-4E52-B41C-8DFFF7DC30C0@lamness.info> <49029AAD.1020700@freebsd.org> <135DB3FD-8241-495F-A977-849F8CB47638@lamness.info> In-Reply-To: <135DB3FD-8241-495F-A977-849F8CB47638@lamness.info> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Barracuda-Connect: www2.ethostream.com[204.15.100.237] X-Barracuda-Start-Time: 1224974233 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at ethostream.com X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using global scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=1.6 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.1.8732 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- X-Mailman-Approved-At: Sun, 26 Oct 2008 00:08:16 +0000 Cc: stable@freebsd.org Subject: Re: kern.maxdsiz on amd63 with i386 binaries X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Oct 2008 22:53:53 -0000 Chris Peterson wrote: > Thanks Joe, that did it. > > Out of curiosity, I don't see any of the compat tree in > /boot/defaults/loader.conf, is there any place this is documented > besides kernel sources? If not then I guess I should give something back > to the community and change that :) Not that I found. I typically find stuff like this by running sysctl -a and grepping for familiar patterns. Joe > > Regards, > Chris Peterson > > On Oct 24, 2008, at 9:03 PM, Joe Marcus Clarke wrote: > >> Chris Peterson wrote: >>> Hello, >>> >>> I've got a handful of i386 boxes, and a handful of amd64 boxes running a >>> 32-bit application, the reasons for this exact configuration mystify me >>> as well as the deployment predates my time in the environment. Now that >>> the dataset the application is loading is rapidly approaching 512MB >>> we're starting to tweak kern.maxdsiz and kern.dfldsiz to 1GB. >>> >>> The i386 boxes are doing great, but we hit an issue with the amd64 >>> machines in that 64bit apps seem to work fine, but the 32bit apps >>> running on the amd64 machines fail to be able to use more than the i386 >>> default of 512MB no matter what we set kern.maxdsiz to. I've also tried >>> compiling it into the kernel, which results in the same issue. >>> >>> I tried starting the app with "limits -d 1090519040", and it seems to >>> fail as well. Limits does show the proper value for datasize of >>> 1064960 kB. >>> >>> We're locked into 32-bit binaries for this app at the moment thanks to >>> some uh... interesting libraries it uses, so the usual option of >>> recompile isn't available. I'd like to avoid traveling from San Jose to >>> Seattle, then Virginia, then Munich to reinstall the amd64 machines with >>> i386 machines if at all possible. >>> >>> Uh... help? >> >> Have you tried setting compat.ia32.maxdsiz? I believe this will do what >> you want. >> >> Joe >> >> -- >> Joe Marcus Clarke >> FreeBSD GNOME Team :: gnome@FreeBSD.org >> FreeNode / #freebsd-gnome >> http://www.FreeBSD.org/gnome > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > -- Joe Marcus Clarke FreeBSD GNOME Team :: gnome@FreeBSD.org FreeNode / #freebsd-gnome http://www.FreeBSD.org/gnome From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 03:15:12 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C214F1065674 for ; Sun, 26 Oct 2008 03:15:12 +0000 (UTC) (envelope-from aragon@phat.za.net) Received: from mail.geek.sh (decoder.geek.sh [196.36.198.81]) by mx1.freebsd.org (Postfix) with ESMTP id 685E28FC1B for ; Sun, 26 Oct 2008 03:15:12 +0000 (UTC) (envelope-from aragon@phat.za.net) Received: by mail.geek.sh (Postfix, from userid 1000) id D5A0F24D22; Sun, 26 Oct 2008 05:15:10 +0200 (SAST) Date: Sun, 26 Oct 2008 05:15:10 +0200 From: Aragon Gouveia To: freebsd-stable@freebsd.org Message-ID: <20081026031510.GA48830@phat.za.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 4.10-RELEASE-p2 i386 Subject: compliments to the chef(s)! X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 03:15:12 -0000 Hi, I just updated a 7.0-RELEASE system to 7.1-PRERELEASE. Everything went smoothly. This is on an HP Pavilion dv2600 notebook. In particular I am beyond happy with the new linux emulation updates! I saw all the relevant patches have been committed to RELENG_7 now so I didn't have to do any manual patching. I take it this means 7.1-RELEASE will launch with them? In any case, for the first time in my history of using BSD as a workstation OS have I finally been able to have a fully working flash setup. BIG thanks to everyone that made it happen - this is going to make 7.1 rock. Regards, Aragon From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 10:13:08 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D9C38106566B for ; Sun, 26 Oct 2008 10:13:08 +0000 (UTC) (envelope-from yannick@diablotin.fr) Received: from postfix2-g20.free.fr (postfix2-g20.free.fr [212.27.60.43]) by mx1.freebsd.org (Postfix) with ESMTP id 60AC08FC24 for ; Sun, 26 Oct 2008 10:13:08 +0000 (UTC) (envelope-from yannick@diablotin.fr) Received: from smtp5-g19.free.fr (smtp5-g19.free.fr [212.27.42.35]) by postfix2-g20.free.fr (Postfix) with ESMTP id 9DD782C1C2B3 for ; Sun, 26 Oct 2008 08:55:09 +0100 (CET) Received: from smtp5-g19.free.fr (localhost.localdomain [127.0.0.1]) by smtp5-g19.free.fr (Postfix) with ESMTP id 164B83EA24D for ; Sun, 26 Oct 2008 10:55:23 +0100 (CET) Received: from [192.168.1.30] (mtg95-1-82-233-27-208.fbx.proxad.net [82.233.27.208]) by smtp5-g19.free.fr (Postfix) with ESMTP id D5E203EA246 for ; Sun, 26 Oct 2008 10:55:22 +0100 (CET) Mime-Version: 1.0 (Apple Message framework v753.1) To: freebsd-stable@freebsd.org Message-Id: From: Yannick Cadin Date: Sun, 26 Oct 2008 10:55:15 +0000 X-Mailer: Apple Mail (2.753.1) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: 2 (very old) bugs? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 10:13:08 -0000 Hi everybody, Is someone can confirm me that there are 2 bugs never fixed: - first in the stat command. Only with the -x option. If you execute stat -x on /tmp or /usr/bin/passwd parameters for example, the numeric representation of mode is wrong. The "special" bits are always 0. No suid-bit, no sticky bit! - Second. Because of a missing suid-bit on the newgrp command, this one is not really usable for users other than root. Best regards, Yannick Cadin From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 10:43:10 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E8B63106569A for ; Sun, 26 Oct 2008 10:43:10 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from mail-gw0.york.ac.uk (mail-gw0.york.ac.uk [144.32.128.245]) by mx1.freebsd.org (Postfix) with ESMTP id 804458FC1C for ; Sun, 26 Oct 2008 10:43:10 +0000 (UTC) (envelope-from gavin@FreeBSD.org) Received: from mail-gw6.york.ac.uk (mail-gw6.york.ac.uk [144.32.129.26]) by mail-gw0.york.ac.uk (8.13.6/8.13.6) with ESMTP id m9QAh5pC008480; Sun, 26 Oct 2008 10:43:05 GMT Received: from ury.york.ac.uk ([144.32.108.81]) by mail-gw6.york.ac.uk with esmtps (TLSv1:AES256-SHA:256) (Exim 4.68) (envelope-from ) id 1Ku35N-0005hj-H8; Sun, 26 Oct 2008 10:43:05 +0000 Received: from ury.york.ac.uk (localhost.york.ac.uk [127.0.0.1]) by ury.york.ac.uk (8.14.3/8.14.3) with ESMTP id m9QAh4J3093606; Sun, 26 Oct 2008 10:43:04 GMT (envelope-from gavin@FreeBSD.org) Received: from localhost (gavin@localhost) by ury.york.ac.uk (8.14.3/8.14.3/Submit) with ESMTP id m9QAh4kD093596; Sun, 26 Oct 2008 10:43:04 GMT (envelope-from gavin@FreeBSD.org) X-Authentication-Warning: ury.york.ac.uk: gavin owned process doing -bs Date: Sun, 26 Oct 2008 10:43:04 +0000 (GMT) From: Gavin Atkinson X-X-Sender: gavin@ury.york.ac.uk To: Yannick Cadin In-Reply-To: Message-ID: <20081026103133.B42478@ury.york.ac.uk> References: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-York-MailScanner: Found to be clean X-York-MailScanner-From: gavin@freebsd.org Cc: freebsd-stable@FreeBSD.org Subject: Re: 2 (very old) bugs? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 10:43:11 -0000 On Sun, 26 Oct 2008, Yannick Cadin wrote: > - first in the stat command. Only with the -x option. If you execute stat -x > on /tmp or /usr/bin/passwd parameters for example, the numeric representation > of mode is wrong. The "special" bits are always 0. No suid-bit, no sticky > bit! Although this does seem wrong to me, the code does it deliberately. I'm not sure why, it may be to be compatible with Linux (as the -x option is documented in the man page as giving "Linux format" output). > - Second. Because of a missing suid-bit on the newgrp command, this one is > not really usable for users other than root. This is deliberate, and is docimented in make.conf(5). Because almost nobody uses newgrp(1) and because it has the potential to be a security hole, it's not installed setuid by default. If you want it installing setuid, set ENABLE_SUID_NEWGRP in make.conf. Gavin From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 12:41:27 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8BB8A106567E; Sun, 26 Oct 2008 12:41:27 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [91.103.162.4]) by mx1.freebsd.org (Postfix) with ESMTP id 02C4B8FC23; Sun, 26 Oct 2008 12:41:26 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id C0F4F19E023; Sun, 26 Oct 2008 13:41:25 +0100 (CET) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 1077419E019; Sun, 26 Oct 2008 13:41:23 +0100 (CET) Message-ID: <49046596.3080605@quip.cz> Date: Sun, 26 Oct 2008 13:41:58 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: Jeremy Chadwick References: <20080927202250.GA60980@icarus.home.lan> <48E0DB7E.20804@quip.cz> <1222699642.24339.12.camel@buffy.york.ac.uk> <48E0F36C.1080400@quip.cz> <20080929153220.GA11459@icarus.home.lan> <48F7964C.4060309@quip.cz> <20081016202322.GA2429@icarus.home.lan> <48F87C0E.8060404@quip.cz> <20081017120858.GA20746@icarus.home.lan> <48F89C8D.5020301@quip.cz> <20081017150616.GA24321@icarus.home.lan> In-Reply-To: <20081017150616.GA24321@icarus.home.lan> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: Gavin Atkinson , freebsd-stable@FreeBSD.org Subject: Re: Recommendations for servers running SATA drives [hot-swap] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 12:41:27 -0000 Jeremy Chadwick wrote: > On Fri, Oct 17, 2008 at 04:09:17PM +0200, Miroslav Lachman wrote: > >>Jeremy Chadwick wrote: >> >>>On Fri, Oct 17, 2008 at 01:50:38PM +0200, Miroslav Lachman wrote: >>> >>>>Jeremy Chadwick wrote: >>>> >>>>>On Thu, Oct 16, 2008 at 09:30:20PM +0200, Miroslav Lachman wrote: >>>>> >>>>>>Today I was replacing disk in one Sun Fire X2100 M2 so I tried >>>>>>hot-swapping. It was as you said: atacontrol detach ata3, replace >>>>>>the HDD, atacontrol attach ata3 and new disk is in the system. I >>>>>>tried it 3 times to be sure that it was not coincidence - no >>>>>>panic was produced ;o) >>>>>>So in this case, hot-swapping on Sun Fire X2100 M2 with FreeBSD >>>>>>7.0 i386 works. >>>>> >>>>> >>>>>That's excellent news. So it seems possibly the problem I was seeing >>>>>was with "reinit" causing some sort of chaos. I'll have to check things >>>>>on my testbox here at home to see how I caused the panic last time. >>>>> >>>>>Thanks for providing feedback, as usual! :-) >>>> >>>>Unfortunately there is one problem - I see a lot of interrupts after >>>>disk swapping (about 193k of atapci1) >>>> >>>>Interrupts >>>>197k total >>>> ohci0 21 >>>> ehci0 22 >>>>193k atapci1 23 >>>>2001 cpu0: time >>>> 1 bge1 273 >>>>2001 cpu1: time >>> >>> >>>Okay, so it looks like the interrupt rate on atapci1 after swapping is >>>going crazy. What you're showing there looks like heavily modified >>>vmstat -i output. >> >>The shown is manually cropped from systat -vm, I'll try vmstat -i next >>time. ;) >> >> >>>>Full output of systat -vm 2 is attached. >>>> >>>>It is shown in top as 50% interrupt (CPU state) and load 1 until I >>>>rebooted the machine (I can provide MRTG graphs). The system was not >>>>in production load, but almost idle. (I will put it in production >>>>tomorrow). >>>>After reboot, everything is OK. >>> >>> >>>And this box is running the ATA patch Andrey provided, yes? >> >>It is clean install of FreeBSD 7.0-RELEASE-p5 amd64 without patches. >> >> >>>>Can somebody test hot-swapping with SATA drives and confirm this >>>>behavior? (I can't test it now, because machine is in datacenter) >>> >>> >>>I can test it on my P4SCE box. >>> >>>I'll check the interrupt rates after each step of the hot-swap to see >>>if/when the problem starts. >> >>I'll check the interrupts next time too and will post results to this >>thread. > > > As promised, here are notes from my testing: > > > First thing to note is that the BIOS on my P4SCE had the ICH5 SATA mode > set to "Auto", which was causing PATA emulation to happen on the SATA > controller, e.g. disk #0 == ata0-master, disk #1 == ata0-slave. > > I changed the BIOS option from Auto to "SATA Enhanced", and now the > disks show up on their own channels, e.g. disk #0 == ata2-master, disk > #1 == ata3-master. > > Here's the applicable data. Note that this kernel ***DOES*** include > Andrey's ATA patch: > > FreeBSD testbox.home.lan 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #0: Thu Oct 16 10:56:42 PDT 2008 root@testbox.home.lan:/usr/obj/usr/src/sys/TESTBOX i386 > > atapci1: port 0xc000-0xc007,0xc400-0xc403,0xc800-0xc807,0xcc00-0xcc03,0xd000-0xd00f irq 18 at device 31.2 on pci0 > atapci1: [ITHREAD] > ata2: on atapci1 > ata2: [ITHREAD] > ata3: on atapci1 > ata3: [ITHREAD] > > SATA controller is on IRQ 18. > > ad4: 114473MB at ata2-master SATA150 > ad6: 238474MB at ata3-master SATA150 > > ATA channel 2: > Master: ad4 Serial ATA v1.0 > Slave: no device present > ATA channel 3: > Master: ad6 Serial ATA II > Slave: no device present > > testbox# df -k > Filesystem 1024-blocks Used Avail Capacity Mounted on > /dev/ad4s1a 507630 230182 236838 49% / > devfs 1 1 0 100% /dev > /dev/ad4s1e 507630 12 467008 0% /tmp > /dev/ad4s1f 108498334 2944826 96873642 3% /usr > /dev/ad4s1d 2008622 32360 1815574 2% /var > /dev/ad6s1d 236511738 4 217590796 0% /hotswap > > testbox# vmstat -i > interrupt total rate > irq4: sio0 1398 34 > irq6: fdc0 10 0 > irq15: ata1 58 1 > irq18: atapci1 945 23 > irq23: em1 8 0 > cpu0: timer 80033 1952 > cpu1: timer 79808 1946 > Total 162260 3957 > > testbox# umount /hotswap > testbox# atacontrol detach ata3 > subdisk6: detached > ad6: detached > testbox# vmstat -i | grep atapci1 > irq18: atapci1 2671 11 > > At this point I wanted to see what happened if I just reattached without > any physical changes to the SATA bus. > > testbox# atacontrol attach ata3 > ata3: [ITHREAD] > ad6: 238474MB at ata3-master SATA150 > Master: ad6 Serial ATA II > Slave: no device present > > testbox# vmstat -i | grep atapci1 > irq18: atapci1 2764 9 > testbox# mount /dev/ad6s1d /hotswap > testbox# vmstat -i | grep atapci1 > irq18: atapci1 2779 8 > > Now we're going to try detaching *without* umounting the filesystem, > then reattaching to see what happens. Based on what I've seen and > others have reported in the past, this should panic the kernel. > Supposedly this problem is fixed on CURRENT. > > testbox# atacontrol detach ata3 > subdisk6: detached > ad6: detached > > testbox# atacontrol attach ata3 > ata3: [ITHREAD] > ad6: 238474MB at ata3-master SATA150 > Master: ad6 Serial ATA II > Slave: no device present > > testbox# df -k > Filesystem 1024-blocks Used Avail Capacity Mounted on > /dev/ad4s1a 507630 230182 236838 49% / > devfs 1 1 0 100% /dev > /dev/ad4s1e 507630 12 467008 0% /tmp > /dev/ad4s1f 108498334 2944826 96873642 3% /usr > /dev/ad4s1d 2008622 32360 1815574 2% /var > /dev/ad6s1d 236511738 4 217590796 0% /hotswap > > testbox# ls -l /hotswap > > > Fatal trap 12: page fault while in kernel mode > cpuid = 0; apic id = 00 > fault virtual address = 0xc0 > fault code = supervisor read, page not present > instruction pointer = 0x20:0xc0503ca7 > stack pointer = 0x28:0xe6310a5c > frame pointer = 0x28:0xe6310a5c > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, def32 1, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 795 (ls) > [thread pid 795 tid 100043 ] > Stopped at dev2udev+0x11: movl 0xc0(%eax),%eax > > db> bt > Tracing pid 795 tid 100043 td 0xc3dcc460 > dev2udev(3287166208,3861973668,3228755039,3861973872,3286025312,...) at dev2udev+17 > ufs_getattr(3861973664,3861973800,3227504003,3229700640,3861973664,...) at ufs_getattr+222 > VOP_GETATTR_APV(3229700640,3861973664,3229768320,3288955040,3861973684,...) at VOP_GETATTR_APV+68 > vn_stat(3288955040,3861973908,3286230784,0,3286025312,...) at vn_stat+73 > kern_lstat(3286025312,135344488,0,3861974040,3861974064,...) at kern_lstat+147 > lstat(3286025312,3861974268,8,3861974328,3861974316,...) at lstat+43 > syscall(3861974328) at syscall+814 > Xint0x80_syscall() at Xint0x80_syscall+32 > --- syscall (190, FreeBSD ELF32, lstat), eip = 1746463051, esp = 3217024524, ebp = 3217024664 --- > > Yup, there's the panic. :-) > > I rebooted the box from db, brought the system up in single-user, fsck'd > all the disks/filesystems (no anomalies were found), and rebooted the > box once more. > > Now we're going to do everything properly: unmount /hotswap, detach, > yank the disk and insert a new Maxtor hard disk, attach, and see what > happens. > > testbox# umount /hotswap > testbox# atacontrol detach ata3 > subdisk6: detached > ad6: detached > > testbox# vmstat -i | grep atapci1 > irq18: atapci1 1174 6 > > I've now removed the disk physically from the machine. Let's check > interrupts again. > > testbox# vmstat -i | grep atapci1 > irq18: atapci1 1185 4 > > Now the new Maxtor disk has been inserted. LEDs for the SATA hot-swap > backplane lit up for about 5-6 seconds, then went off. Let's check > interrupts at this point: > > testbox# vmstat -i | grep atapci1 > irq18: atapci1 1193 3 > > Now let's attach. Note that there is no filesystem on this disk (it's > completely blank), so there's nothing to mount. > > testbox# atacontrol attach ata3 > ata3: [ITHREAD] > ad6: 286188MB at ata3-master SATA150 > Master: ad6 Serial ATA v1.0 > Slave: no device present > > And now we check interrupts: > > testbox# vmstat -i | grep atapci1 > irq18: atapci1 1258 2 I played again with hot-swapping disks in Sun Fire X2100 M2 on FreeBSD 7.0-RELEASE-p5 i386 without ATA patches. Both disks (ad4 + ad6) are in gmirror. There were high interrupts load again! I tracked it to the point of pulling out the disk. Interrupt was OK after 'atacontrol detach', but rise up after disk was removed. When the disk is inserted back (same disk), interrupts are going to normal rate without need to reboot. I tried it three times and behavior was always the same. It can be related to the use of gmirror. Side note: If the disk was detached by 'atacontrol detach ata2' without removing from gmirror (without gmirror remove or gmirror deactivate) and then pulled out + inserted back, it was automagically attached without need of 'atacontrol attach ata2' and gmirror synchronization was autostarted. As I am planing my vacation, I will not have time to test newer versions of FreeBSD (or patches), I will test it later in December. Miroslav Lachman From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 12:53:39 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8CBCB1065679 for ; Sun, 26 Oct 2008 12:53:39 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA03.emeryville.ca.mail.comcast.net (qmta03.emeryville.ca.mail.comcast.net [76.96.30.32]) by mx1.freebsd.org (Postfix) with ESMTP id 6CE5A8FC1D for ; Sun, 26 Oct 2008 12:53:39 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA04.emeryville.ca.mail.comcast.net ([76.96.30.35]) by QMTA03.emeryville.ca.mail.comcast.net with comcast id XQox1a0070lTkoCA3Qtft2; Sun, 26 Oct 2008 12:53:39 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA04.emeryville.ca.mail.comcast.net with comcast id XQtb1a0092P6wsM8QQtbXE; Sun, 26 Oct 2008 12:53:36 +0000 X-Authority-Analysis: v=1.0 c=1 a=zWTp1yHTipkA:10 a=6gU17RteXIwA:10 a=QycZ5dHgAAAA:8 a=XloLxkO_RAHYdCOovHMA:9 a=-ZwvR-63o-kQUKhPxrsA:7 a=DUD0yBr8QtOQ6hXSSU1FbeH5NI8A:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 310ECC9419; Sun, 26 Oct 2008 05:53:35 -0700 (PDT) Date: Sun, 26 Oct 2008 05:53:35 -0700 From: Jeremy Chadwick To: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: <20081026125335.GA89389@icarus.home.lan> References: <1222699642.24339.12.camel@buffy.york.ac.uk> <48E0F36C.1080400@quip.cz> <20080929153220.GA11459@icarus.home.lan> <48F7964C.4060309@quip.cz> <20081016202322.GA2429@icarus.home.lan> <48F87C0E.8060404@quip.cz> <20081017120858.GA20746@icarus.home.lan> <48F89C8D.5020301@quip.cz> <20081017150616.GA24321@icarus.home.lan> <49046596.3080605@quip.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <49046596.3080605@quip.cz> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Gavin Atkinson , freebsd-stable@FreeBSD.org Subject: Re: Recommendations for servers running SATA drives [hot-swap] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 12:53:39 -0000 On Sun, Oct 26, 2008 at 01:41:58PM +0100, Miroslav Lachman wrote: > Jeremy Chadwick wrote: >> On Fri, Oct 17, 2008 at 04:09:17PM +0200, Miroslav Lachman wrote: >> >>> Jeremy Chadwick wrote: >>> >>>> On Fri, Oct 17, 2008 at 01:50:38PM +0200, Miroslav Lachman wrote: >>>> >>>>> Jeremy Chadwick wrote: >>>>> >>>>>> On Thu, Oct 16, 2008 at 09:30:20PM +0200, Miroslav Lachman wrote: >>>>>> >>>>>>> Today I was replacing disk in one Sun Fire X2100 M2 so I >>>>>>> tried hot-swapping. It was as you said: atacontrol detach >>>>>>> ata3, replace the HDD, atacontrol attach ata3 and new disk is >>>>>>> in the system. I tried it 3 times to be sure that it was not >>>>>>> coincidence - no panic was produced ;o) >>>>>>> So in this case, hot-swapping on Sun Fire X2100 M2 with >>>>>>> FreeBSD 7.0 i386 works. >>>>>> >>>>>> >>>>>> That's excellent news. So it seems possibly the problem I was seeing >>>>>> was with "reinit" causing some sort of chaos. I'll have to check things >>>>>> on my testbox here at home to see how I caused the panic last time. >>>>>> >>>>>> Thanks for providing feedback, as usual! :-) >>>>> >>>>> Unfortunately there is one problem - I see a lot of interrupts >>>>> after disk swapping (about 193k of atapci1) >>>>> >>>>> Interrupts >>>>> 197k total >>>>> ohci0 21 >>>>> ehci0 22 >>>>> 193k atapci1 23 >>>>> 2001 cpu0: time >>>>> 1 bge1 273 >>>>> 2001 cpu1: time >>>> >>>> >>>> Okay, so it looks like the interrupt rate on atapci1 after swapping is >>>> going crazy. What you're showing there looks like heavily modified >>>> vmstat -i output. >>> >>> The shown is manually cropped from systat -vm, I'll try vmstat -i >>> next time. ;) >>> >>> >>>>> Full output of systat -vm 2 is attached. >>>>> >>>>> It is shown in top as 50% interrupt (CPU state) and load 1 until >>>>> I rebooted the machine (I can provide MRTG graphs). The system >>>>> was not in production load, but almost idle. (I will put it in >>>>> production tomorrow). >>>>> After reboot, everything is OK. >>>> >>>> >>>> And this box is running the ATA patch Andrey provided, yes? >>> >>> It is clean install of FreeBSD 7.0-RELEASE-p5 amd64 without patches. >>> >>> >>>>> Can somebody test hot-swapping with SATA drives and confirm this >>>>> behavior? (I can't test it now, because machine is in >>>>> datacenter) >>>> >>>> >>>> I can test it on my P4SCE box. >>>> >>>> I'll check the interrupt rates after each step of the hot-swap to see >>>> if/when the problem starts. >>> >>> I'll check the interrupts next time too and will post results to this >>> thread. >> >> >> As promised, here are notes from my testing: >> >> >> First thing to note is that the BIOS on my P4SCE had the ICH5 SATA mode >> set to "Auto", which was causing PATA emulation to happen on the SATA >> controller, e.g. disk #0 == ata0-master, disk #1 == ata0-slave. >> >> I changed the BIOS option from Auto to "SATA Enhanced", and now the >> disks show up on their own channels, e.g. disk #0 == ata2-master, disk >> #1 == ata3-master. >> >> Here's the applicable data. Note that this kernel ***DOES*** include >> Andrey's ATA patch: >> >> FreeBSD testbox.home.lan 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #0: Thu Oct 16 10:56:42 PDT 2008 root@testbox.home.lan:/usr/obj/usr/src/sys/TESTBOX i386 >> >> atapci1: port 0xc000-0xc007,0xc400-0xc403,0xc800-0xc807,0xcc00-0xcc03,0xd000-0xd00f irq 18 at device 31.2 on pci0 >> atapci1: [ITHREAD] >> ata2: on atapci1 >> ata2: [ITHREAD] >> ata3: on atapci1 >> ata3: [ITHREAD] >> >> SATA controller is on IRQ 18. >> >> ad4: 114473MB at ata2-master SATA150 >> ad6: 238474MB at ata3-master SATA150 >> >> ATA channel 2: >> Master: ad4 Serial ATA v1.0 >> Slave: no device present >> ATA channel 3: >> Master: ad6 Serial ATA II >> Slave: no device present >> >> testbox# df -k >> Filesystem 1024-blocks Used Avail Capacity Mounted on >> /dev/ad4s1a 507630 230182 236838 49% / >> devfs 1 1 0 100% /dev >> /dev/ad4s1e 507630 12 467008 0% /tmp >> /dev/ad4s1f 108498334 2944826 96873642 3% /usr >> /dev/ad4s1d 2008622 32360 1815574 2% /var >> /dev/ad6s1d 236511738 4 217590796 0% /hotswap >> >> testbox# vmstat -i >> interrupt total rate >> irq4: sio0 1398 34 >> irq6: fdc0 10 0 >> irq15: ata1 58 1 >> irq18: atapci1 945 23 >> irq23: em1 8 0 >> cpu0: timer 80033 1952 >> cpu1: timer 79808 1946 >> Total 162260 3957 >> >> testbox# umount /hotswap >> testbox# atacontrol detach ata3 >> subdisk6: detached >> ad6: detached >> testbox# vmstat -i | grep atapci1 >> irq18: atapci1 2671 11 >> >> At this point I wanted to see what happened if I just reattached without >> any physical changes to the SATA bus. >> >> testbox# atacontrol attach ata3 >> ata3: [ITHREAD] >> ad6: 238474MB at ata3-master SATA150 >> Master: ad6 Serial ATA II >> Slave: no device present >> >> testbox# vmstat -i | grep atapci1 >> irq18: atapci1 2764 9 >> testbox# mount /dev/ad6s1d /hotswap >> testbox# vmstat -i | grep atapci1 >> irq18: atapci1 2779 8 >> >> Now we're going to try detaching *without* umounting the filesystem, >> then reattaching to see what happens. Based on what I've seen and >> others have reported in the past, this should panic the kernel. >> Supposedly this problem is fixed on CURRENT. >> >> testbox# atacontrol detach ata3 >> subdisk6: detached >> ad6: detached >> >> testbox# atacontrol attach ata3 >> ata3: [ITHREAD] >> ad6: 238474MB at ata3-master SATA150 >> Master: ad6 Serial ATA II >> Slave: no device present >> >> testbox# df -k >> Filesystem 1024-blocks Used Avail Capacity Mounted on >> /dev/ad4s1a 507630 230182 236838 49% / >> devfs 1 1 0 100% /dev >> /dev/ad4s1e 507630 12 467008 0% /tmp >> /dev/ad4s1f 108498334 2944826 96873642 3% /usr >> /dev/ad4s1d 2008622 32360 1815574 2% /var >> /dev/ad6s1d 236511738 4 217590796 0% /hotswap >> >> testbox# ls -l /hotswap >> >> >> Fatal trap 12: page fault while in kernel mode >> cpuid = 0; apic id = 00 >> fault virtual address = 0xc0 >> fault code = supervisor read, page not present >> instruction pointer = 0x20:0xc0503ca7 >> stack pointer = 0x28:0xe6310a5c >> frame pointer = 0x28:0xe6310a5c >> code segment = base 0x0, limit 0xfffff, type 0x1b >> = DPL 0, pres 1, def32 1, gran 1 >> processor eflags = interrupt enabled, resume, IOPL = 0 >> current process = 795 (ls) >> [thread pid 795 tid 100043 ] >> Stopped at dev2udev+0x11: movl 0xc0(%eax),%eax >> >> db> bt >> Tracing pid 795 tid 100043 td 0xc3dcc460 >> dev2udev(3287166208,3861973668,3228755039,3861973872,3286025312,...) at dev2udev+17 >> ufs_getattr(3861973664,3861973800,3227504003,3229700640,3861973664,...) at ufs_getattr+222 >> VOP_GETATTR_APV(3229700640,3861973664,3229768320,3288955040,3861973684,...) at VOP_GETATTR_APV+68 >> vn_stat(3288955040,3861973908,3286230784,0,3286025312,...) at vn_stat+73 >> kern_lstat(3286025312,135344488,0,3861974040,3861974064,...) at kern_lstat+147 >> lstat(3286025312,3861974268,8,3861974328,3861974316,...) at lstat+43 >> syscall(3861974328) at syscall+814 >> Xint0x80_syscall() at Xint0x80_syscall+32 >> --- syscall (190, FreeBSD ELF32, lstat), eip = 1746463051, esp = 3217024524, ebp = 3217024664 --- >> >> Yup, there's the panic. :-) >> >> I rebooted the box from db, brought the system up in single-user, fsck'd >> all the disks/filesystems (no anomalies were found), and rebooted the >> box once more. >> >> Now we're going to do everything properly: unmount /hotswap, detach, >> yank the disk and insert a new Maxtor hard disk, attach, and see what >> happens. >> >> testbox# umount /hotswap >> testbox# atacontrol detach ata3 >> subdisk6: detached >> ad6: detached >> >> testbox# vmstat -i | grep atapci1 >> irq18: atapci1 1174 6 >> >> I've now removed the disk physically from the machine. Let's check >> interrupts again. >> >> testbox# vmstat -i | grep atapci1 >> irq18: atapci1 1185 4 >> >> Now the new Maxtor disk has been inserted. LEDs for the SATA hot-swap >> backplane lit up for about 5-6 seconds, then went off. Let's check >> interrupts at this point: >> >> testbox# vmstat -i | grep atapci1 >> irq18: atapci1 1193 3 >> >> Now let's attach. Note that there is no filesystem on this disk (it's >> completely blank), so there's nothing to mount. >> >> testbox# atacontrol attach ata3 >> ata3: [ITHREAD] >> ad6: 286188MB at ata3-master SATA150 >> Master: ad6 Serial ATA v1.0 >> Slave: no device present >> >> And now we check interrupts: >> >> testbox# vmstat -i | grep atapci1 >> irq18: atapci1 1258 2 > > > I played again with hot-swapping disks in Sun Fire X2100 M2 on FreeBSD > 7.0-RELEASE-p5 i386 without ATA patches. > Both disks (ad4 + ad6) are in gmirror. There were high interrupts load > again! I tracked it to the point of pulling out the disk. > Interrupt was OK after 'atacontrol detach', but rise up after disk was > removed. When the disk is inserted back (same disk), interrupts are > going to normal rate without need to reboot. > I tried it three times and behavior was always the same. > It can be related to the use of gmirror. Interesting -- yeah, that's the one difference (besides hardware) between your tests and mine: you're using gmirror, I'm not. I'll take some time this weekend (or the upcoming weekend) to set up gmirror on the above test box, and see if I can reproduce what you're seeing. This will be my first experience with gmirror. > Side note: If the disk was detached by 'atacontrol detach ata2' without > removing from gmirror (without gmirror remove or gmirror deactivate) and > then pulled out + inserted back, it was automagically attached without > need of 'atacontrol attach ata2' and gmirror synchronization was > autostarted. This could mean that gmirror is constantly "polling" the underlying device layer for certain things, which might explain the high interrupt rate you're seeing. We should probably involve pjd@ in this discussion. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 14:18:37 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 495F0106566B for ; Sun, 26 Oct 2008 14:18:37 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: from wr-out-0506.google.com (wr-out-0506.google.com [64.233.184.235]) by mx1.freebsd.org (Postfix) with ESMTP id EA8D38FC1F for ; Sun, 26 Oct 2008 14:18:36 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: by wr-out-0506.google.com with SMTP id c8so259897wra.27 for ; Sun, 26 Oct 2008 07:18:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=DwBOT4irXlYv3l5hrjDn2TQ6i5yKhEwyGLGkI3VXUjQ=; b=vxhlFXHAv9YGeefe7rVQtII22iUP/rrjOLC1S+1HDrwMhycCfJ3seLoTMv7VOLikKd V3AJnx+2EVKNp0uFlvnrTxvMwa1c+9y78fuVVZe5yEDML/6vDbwws5Oa0GPqcFL6P76e OYuWv8Sf8eGEh3FXzl2+HZPj3oBzZ6x1w3nf0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=u0e/CzGtZRzIKJ+av02lrQT8Ve5GnUCq8uaRqT0tCu4b3g+RsrZhk1hU9lijNAa8Fj uhu1bcqb8M78GU3CKrhv5rbQKOhEz+GgyEQpN7R0iR/em6Mx11tWRyNisamW2VtlKH2y 0uhH3VWiwxU6RLxuN6Qiyc03LKz6TdWSNowoo= Received: by 10.65.234.18 with SMTP id l18mr5080202qbr.1.1225030715500; Sun, 26 Oct 2008 07:18:35 -0700 (PDT) Received: by 10.64.201.9 with HTTP; Sun, 26 Oct 2008 07:18:35 -0700 (PDT) Message-ID: Date: Sun, 26 Oct 2008 13:18:35 -0100 From: "Eduardo Meyer" To: freebsd-net@freebsd.org, freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Subject: NAT-PT on FreeBSD (or something else)? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 14:18:37 -0000 Hello, I want to start a migration education to IPv6, setting up my internal network to be 100% ipv6-only. I dont want it to be dual stacked, because I intend to force my team to perform only IPv6 related tools on the internal network. However, when performing internet activity like, reading e-mail or browsing the web, its impossible to avoid IPv4 today. I want them to be able to reach IPv4 network (internet) transparently. When DNS resolve to IPv4, they will ask the gateway (ipv6, dual stacked), who will put their v6 address in the v4 network. How can I accomplish that? Is NAT-PT the only way? If so, how can I get NAT-PT on FreeBSD? Your opinion: do you think this approach can be used for end users? I mean, someone with windows vista and teredo, is already getting IPv6 address since my FreeBSD is advertising it. However they are dual stacked. I want people to be v6-only and still can visit v4 networks transparently, without technical knowledge (say, my girlfriend who is not a geek). I guess this is a migration/education strategy, which I intend to deploy, but right now I am only studying. Will faith(4) do this for me? -- =========== Eduardo Meyer pessoal: dudu.meyer@gmail.com profissional: ddm.farmaciap@saude.gov.br From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 16:17:31 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C879F106569B; Sun, 26 Oct 2008 16:17:31 +0000 (UTC) (envelope-from oberman@es.net) Received: from postal1.es.net (postal2.es.net [198.128.3.206]) by mx1.freebsd.org (Postfix) with ESMTP id A78478FC18; Sun, 26 Oct 2008 16:17:31 +0000 (UTC) (envelope-from oberman@es.net) Received: from ptavv.es.net (ptavv.es.net [198.128.4.29]) by postal2.es.net (Postal Node 2) with ESMTP (SSL) id GAG73158; Sun, 26 Oct 2008 09:06:58 -0700 Received: from ptavv.es.net (localhost [127.0.0.1]) by ptavv.es.net (Tachyon Server) with ESMTP id 7ED2345048; Sun, 26 Oct 2008 09:06:58 -0700 (PDT) To: "Eduardo Meyer" In-Reply-To: Your message of "Sun, 26 Oct 2008 13:18:35 -0100." Mime-Version: 1.0 Content-Type: multipart/signed; boundary="==_Exmh_1225037218_63075P"; micalg=pgp-sha1; protocol="application/pgp-signature" Content-Transfer-Encoding: 7bit Date: Sun, 26 Oct 2008 09:06:58 -0700 From: "Kevin Oberman" Message-Id: <20081026160658.7ED2345048@ptavv.es.net> X-Sender-IP: 198.128.4.29 X-Sender-Domain: es.net X-Recipent: ; ; ; X-Sender: X-To_Name: Eduardo Meyer X-To_Domain: gmail.com X-To: "Eduardo Meyer" X-To_Email: dudu.meyer@gmail.com X-To_Alias: dudu.meyer Cc: freebsd-net@freebsd.org, freebsd-stable@freebsd.org Subject: Re: NAT-PT on FreeBSD (or something else)? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 16:17:31 -0000 --==_Exmh_1225037218_63075P Content-Type: text/plain; charset=us-ascii Content-Disposition: inline > Date: Sun, 26 Oct 2008 13:18:35 -0100 > From: "Eduardo Meyer" > Sender: owner-freebsd-net@freebsd.org > > Hello, > > I want to start a migration education to IPv6, setting up my internal > network to be 100% ipv6-only. I dont want it to be dual stacked, > because I intend to force my team to perform only IPv6 related tools > on the internal network. However, when performing internet activity > like, reading e-mail or browsing the web, its impossible to avoid IPv4 > today. > > I want them to be able to reach IPv4 network (internet) transparently. > When DNS resolve to IPv4, they will ask the gateway (ipv6, dual > stacked), who will put their v6 address in the v4 network. > > How can I accomplish that? Is NAT-PT the only way? If so, how can I > get NAT-PT on FreeBSD? > > Your opinion: do you think this approach can be used for end users? I > mean, someone with windows vista and teredo, is already getting IPv6 > address since my FreeBSD is advertising it. However they are dual > stacked. I want people to be v6-only and still can visit v4 networks > transparently, without technical knowledge (say, my girlfriend who is > not a geek). > > I guess this is a migration/education strategy, which I intend to > deploy, but right now I am only studying. > > Will faith(4) do this for me? I suspect that this is simply not quite possible today, although it's close. The BEHAVE IETF working group is the place to look for the latest information on this area. I have tried a couple of solutions. The one that worked best was IVI, developed in China. It generally worked well and was fairly fast. It's big problem is embedded IPv4 addresses in things like JavaScript. This is a workable problem, but it has not been worked to this point. -- R. Kevin Oberman, Network Engineer Energy Sciences Network (ESnet) Ernest O. Lawrence Berkeley National Laboratory (Berkeley Lab) E-mail: oberman@es.net Phone: +1 510 486-8634 Key fingerprint:059B 2DDF 031C 9BA3 14A4 EADA 927D EBB3 987B 3751 --==_Exmh_1225037218_63075P Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) Comment: Exmh version 2.5 06/03/2002 iD8DBQFJBJWikn3rs5h7N1ERAjPQAJ96WoYYLSQ7l7OKmX02Fzhqn4z2MACfeUh8 Ibhxt6IY+c1uMVuOP7YH1DA= =6OI/ -----END PGP SIGNATURE----- --==_Exmh_1225037218_63075P-- From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 16:56:19 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 041A0106567D for ; Sun, 26 Oct 2008 16:56:19 +0000 (UTC) (envelope-from clint@0lsen.net) Received: from belle.0lsen.net (belle.0lsen.net [75.150.32.89]) by mx1.freebsd.org (Postfix) with ESMTP id DFBA58FC08 for ; Sun, 26 Oct 2008 16:56:18 +0000 (UTC) (envelope-from clint@0lsen.net) Received: by belle.0lsen.net (Postfix, from userid 1001) id C066179348; Sun, 26 Oct 2008 09:56:02 -0700 (PDT) Date: Sun, 26 Oct 2008 09:56:02 -0700 From: Clint Olsen To: stable@freebsd.org Message-ID: <20081026165602.GA2264@0lsen.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i Organization: NULlsen Network X-Disclaimer: Mutt Bites! X-0lsen-net-MailScanner-Information: Please contact the ISP for more information X-MailScanner-ID: C066179348.105F7 X-0lsen-net-MailScanner: Found to be clean X-0lsen-net-MailScanner-From: clint@0lsen.net X-Spam-Status: No Cc: Subject: What could be causing unexpected reads to acd0? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 16:56:19 -0000 I'm seeing this sometimes before my machine dies: Oct 26 03:28:00 belle kernel: acd0: WARNING - READ_TOC taskqueue timeout - completing request directly Oct 26 03:28:00 belle kernel: acd0: WARNING - READ_TOC freeing taskqueue zombie request Oct 26 03:30:00 belle kernel: acd0: WARNING - READ_TOC taskqueue timeout - completing request directly Oct 26 03:30:00 belle kernel: acd0: WARNING - READ_TOC freeing taskqueue zombie request Oct 26 03:32:00 belle kernel: acd0: WARNING - READ_CAPACITY taskqueue timeout - completing request directly Oct 26 03:32:00 belle kernel: acd0: WARNING - READ_CAPACITY freeing taskqueue zombie request I run the gnome desktop environment. Could it be that? I do not have this mounted. The only thing that's running around this time is /sbin/dump. I'm never at the machine when this happens. FreeBSD belle.0lsen.net 6.3-STABLE FreeBSD 6.3-STABLE #0: Sun May 25 21:55:57 PDT 2008 root@belle.0lsen.net:/usr/obj/usr/src/sys/GENERIC i386 Thanks, -Clint -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 19:04:14 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CFF0B106566C for ; Sun, 26 Oct 2008 19:04:14 +0000 (UTC) (envelope-from barbara.xxx1975@libero.it) Received: from cp-out4.libero.it (cp-out4.libero.it [212.52.84.104]) by mx1.freebsd.org (Postfix) with ESMTP id 59DF48FC17 for ; Sun, 26 Oct 2008 19:04:14 +0000 (UTC) (envelope-from barbara.xxx1975@libero.it) Received: from libero.it (192.168.17.12) by cp-out4.libero.it (8.5.014) id 48EE1CA401E80F3E; Sun, 26 Oct 2008 20:04:11 +0100 Date: Sun, 26 Oct 2008 20:04:11 +0100 Message-Id: MIME-Version: 1.0 X-Sensitivity: 3 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable From: "barbara" To: "clint\.olsen" X-XaM3-API-Version: 4.3 (R1) (B3pl25) X-SenderIP: 82.51.158.7 Cc: freebsd-stable Subject: Re: What could be causing unexpected reads to acd0? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 19:04:14 -0000 Sorry, I've just joined the stable ml. Is the problem that is happening to you, something similar to what is des= cribed here (and linked threads)? http://www.freebsd.org/cgi/query-pr.cgi?pr=3D128076 From owner-freebsd-stable@FreeBSD.ORG Sun Oct 26 21:47:05 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3D176106566B; Sun, 26 Oct 2008 21:47:05 +0000 (UTC) (envelope-from randy@psg.com) Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:1::36]) by mx1.freebsd.org (Postfix) with ESMTP id 1FDBB8FC1C; Sun, 26 Oct 2008 21:47:05 +0000 (UTC) (envelope-from randy@psg.com) Received: from [213.42.94.180] (helo=rmac.psg.com) by ran.psg.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1KuDRu-000P1S-SL; Sun, 26 Oct 2008 21:47:03 +0000 Message-ID: <4904E553.60806@psg.com> Date: Mon, 27 Oct 2008 01:46:59 +0400 From: Randy Bush User-Agent: Thunderbird 2.0.0.17 (Macintosh/20080914) MIME-Version: 1.0 To: Eduardo Meyer References: In-Reply-To: X-Enigmail-Version: 0.95.7 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org, freebsd-stable@freebsd.org Subject: Re: NAT-PT on FreeBSD (or something else)? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Oct 2008 21:47:05 -0000 > I want to start a migration education to IPv6, setting up my internal > network to be 100% ipv6-only. I dont want it to be dual stacked, > because I intend to force my team to perform only IPv6 related tools > on the internal network. However, when performing internet activity > like, reading e-mail or browsing the web, its impossible to avoid IPv4 > today. sigh, for linux, http://code.google.com/p/stubl/ randy From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 01:11:26 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 984A31065671 for ; Mon, 27 Oct 2008 01:11:26 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: from mail-gx0-f15.google.com (mail-gx0-f15.google.com [209.85.217.15]) by mx1.freebsd.org (Postfix) with ESMTP id 3B5488FC1B for ; Mon, 27 Oct 2008 01:11:26 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: by gxk8 with SMTP id 8so1747012gxk.19 for ; Sun, 26 Oct 2008 18:11:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:from:to :content-type:mime-version:subject:date:cc:x-mailer; bh=HCkZnH0xrHpotbdHSXsKpcBsCH5f1XReivJbUdzudpo=; b=xFsGoTemufNZYRxyV5Haj+R5k6UNBmj1I3e/DILhDKHEMyTfGNN0cRoOvopbB+RxdL J1i3z4VmEclIrgymdTSxTeAECk66ttTEAO9gd2mShx0uoqK5CiVMYfh31V+wq+w7AKdK a5xW1tyLrEkA+yD9WCcH8YFFOduapLM8/eeNw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:from:to:content-type:mime-version:subject:date:cc :x-mailer; b=MZS9Eegb0KPByIvutS8PcVNphEILkFXGHIAzPuBmGWGh/eK0XXdhACUMkl2A5F2MGN R2zkHfMFBHNgtATXyIYZd4qN9sHJi8swarN9pi7wBZj3nGdjWg7j5ln6wv5NDyURaqsF 36C1gYFW3kxAwJz7HgCZxVp0/1FmRpHryOsBw= Received: by 10.65.72.7 with SMTP id z7mr5733001qbk.23.1225068445965; Sun, 26 Oct 2008 17:47:25 -0700 (PDT) Received: from 18-23-112.adsl.terra.cl (18-23-112.adsl.terra.cl [200.112.23.18]) by mx.google.com with ESMTPS id s27sm5727589qbs.12.2008.10.26.17.47.23 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sun, 26 Oct 2008 17:47:25 -0700 (PDT) Message-Id: From: Jose Amengual To: freebsd-stable@freebsd.org Mime-Version: 1.0 (Apple Message framework v929.2) Date: Sun, 26 Oct 2008 21:47:18 -0300 X-Mailer: Apple Mail (2.929.2) Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org Subject: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 01:11:26 -0000 Hi guys. I post a question few days ago. this is the link : http://groups.google.com/group/mailing.freebsd.current/browse_thread/thread/de0953974d6dd9f4/f35d27cbe374b799?show_docid=f35d27cbe374b799&fwc=1 I was reading this post : http://unix.derkeiler.com/Mailing-Lists/FreeBSD/current/2007-08/msg00174.html and this : http://unix.derkeiler.com/Mailing-Lists/FreeBSD/net/2008-04/msg00047.html The problem persist even in stable 7.0, 7.1-PRERELEASE and 7.0-P5 , the postfix jail is living all the email in defer queue saying "Connection Time Out" This server give service to 300 clients and the network load os high. is there any clue how to resolve this ? Thanks. From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 05:03:56 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3588A106566C for ; Mon, 27 Oct 2008 05:03:56 +0000 (UTC) (envelope-from andrew@areilly.bpa.nu) Received: from nskntmtas03p.mx.bigpond.com (nskntmtas03p.mx.bigpond.com [61.9.168.143]) by mx1.freebsd.org (Postfix) with ESMTP id B6E438FC08 for ; Mon, 27 Oct 2008 05:03:55 +0000 (UTC) (envelope-from andrew@areilly.bpa.nu) Received: from nskntotgx01p.mx.bigpond.com ([124.188.162.219]) by nskntmtas03p.mx.bigpond.com with ESMTP id <20081027050354.KIDI5533.nskntmtas03p.mx.bigpond.com@nskntotgx01p.mx.bigpond.com> for ; Mon, 27 Oct 2008 05:03:54 +0000 Received: from areilly.bpa.nu ([124.188.162.219]) by nskntotgx01p.mx.bigpond.com with ESMTP id <20081027050349.JBIE3509.nskntotgx01p.mx.bigpond.com@areilly.bpa.nu> for ; Mon, 27 Oct 2008 05:03:49 +0000 Received: (qmail 57446 invoked by uid 501); 27 Oct 2008 05:03:30 -0000 Date: Mon, 27 Oct 2008 16:03:30 +1100 From: Andrew Reilly To: Gavin Atkinson Message-ID: <20081027050330.GA55310@duncan.reilly.home> References: <20081026103133.B42478@ury.york.ac.uk> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081026103133.B42478@ury.york.ac.uk> User-Agent: Mutt/1.4.2.3i X-RPD-ScanID: Class unknown; VirusThreatLevel unknown, RefID str=0001.0A150204.49054BB5.0063:SCFSTAT2704298,ss=1,fgs=0 Cc: Yannick Cadin , freebsd-stable@FreeBSD.org Subject: Re: 2 (very old) bugs? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 05:03:56 -0000 On Sun, Oct 26, 2008 at 10:43:04AM +0000, Gavin Atkinson wrote: > On Sun, 26 Oct 2008, Yannick Cadin wrote: > > >- first in the stat command. Only with the -x option. If you execute stat > >-x on /tmp or /usr/bin/passwd parameters for example, the numeric > >representation of mode is wrong. The "special" bits are always 0. No > >suid-bit, no sticky bit! > > Although this does seem wrong to me, the code does it deliberately. I'm > not sure why, it may be to be compatible with Linux (as the -x option is > documented in the man page as giving "Linux format" output). I don't know the history, but must guess from what you've said that it was attempting to be compatible with an old linux stat, beause the one that I have installed in /usr/compat/linux/usr/bin/stat produces quite different output: duncan [209]$ /usr/compat/linux/usr/bin/stat /usr/bin/passwd File: `/usr/bin/passwd' Size: 7832 Blocks: 16 IO Block: 4096 regular file Device: 7ah/122d Inode: 33728080 Links: 2 Access: (4555/-r-sr-xr-x) Uid: ( 0/ root) Gid: ( 0/ wheel) Access: 2008-10-25 12:38:00.000000000 +1100 Modify: 2008-10-25 12:38:00.000000000 +1100 Change: 2008-10-25 12:38:00.000000000 +1100 duncan [210]$ stat -x /usr/bin/passwd File: "/usr/bin/passwd" Size: 7832 FileType: Regular File Mode: (0555/-r-sr-xr-x) Uid: ( 0/ root) Gid: ( 0/ wheel) Device: 0,122 Inode: 33728080 Links: 2 Access: Sat Oct 25 12:38:00 2008 Modify: Sat Oct 25 12:38:00 2008 Change: Sat Oct 25 12:38:00 2008 Since this clearly isn't close enough for the purposes of simple shell or sed scripts, I can understand why this bug has gone unfixed for so long... Cheers, Andrew From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 05:13:28 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EF9FC1065679 for ; Mon, 27 Oct 2008 05:13:28 +0000 (UTC) (envelope-from andrew@areilly.bpa.nu) Received: from nskntmtas02p.mx.bigpond.com (nskntmtas02p.mx.bigpond.com [61.9.168.140]) by mx1.freebsd.org (Postfix) with ESMTP id 7C1198FC08 for ; Mon, 27 Oct 2008 05:13:28 +0000 (UTC) (envelope-from andrew@areilly.bpa.nu) Received: from nskntotgx01p.mx.bigpond.com ([124.188.162.219]) by nskntmtas02p.mx.bigpond.com with ESMTP id <20081027051324.LOYD22947.nskntmtas02p.mx.bigpond.com@nskntotgx01p.mx.bigpond.com> for ; Mon, 27 Oct 2008 05:13:24 +0000 Received: from areilly.bpa.nu ([124.188.162.219]) by nskntotgx01p.mx.bigpond.com with ESMTP id <20081027051322.JWEY3509.nskntotgx01p.mx.bigpond.com@areilly.bpa.nu> for ; Mon, 27 Oct 2008 05:13:22 +0000 Received: (qmail 58584 invoked by uid 501); 27 Oct 2008 05:13:13 -0000 Date: Mon, 27 Oct 2008 16:13:13 +1100 From: Andrew Reilly To: Gavin Atkinson Message-ID: <20081027051313.GB55310@duncan.reilly.home> References: <20081026103133.B42478@ury.york.ac.uk> <20081027050330.GA55310@duncan.reilly.home> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081027050330.GA55310@duncan.reilly.home> User-Agent: Mutt/1.4.2.3i X-RPD-ScanID: Class unknown; VirusThreatLevel unknown, RefID str=0001.0A150202.49054DF2.0038:SCFSTAT2704298,ss=1,fgs=0 Cc: Yannick Cadin , freebsd-stable@FreeBSD.org Subject: Re: 2 (very old) bugs? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 05:13:29 -0000 On Mon, Oct 27, 2008 at 04:03:30PM +1100, Andrew Reilly wrote: > On Sun, Oct 26, 2008 at 10:43:04AM +0000, Gavin Atkinson wrote: > > On Sun, 26 Oct 2008, Yannick Cadin wrote: > > > > >- first in the stat command. Only with the -x option. If you execute stat > > >-x on /tmp or /usr/bin/passwd parameters for example, the numeric > > >representation of mode is wrong. The "special" bits are always 0. No > > >suid-bit, no sticky bit! > > > > Although this does seem wrong to me, the code does it deliberately. I'm > > not sure why, it may be to be compatible with Linux (as the -x option is > > documented in the man page as giving "Linux format" output). > > I don't know the history, but must guess from what you've > said that it was attempting to be compatible with an > old linux stat, beause the one that I have installed in > /usr/compat/linux/usr/bin/stat produces quite different output: Just in case I wasn't clear (and it seems to me that I wasn't): would a reasonable resolution to this bug report be the removal of the "-x" option from our stat? Cheers, Andrew From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 07:54:47 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4CD661065671 for ; Mon, 27 Oct 2008 07:54:47 +0000 (UTC) (envelope-from melyutin@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.168]) by mx1.freebsd.org (Postfix) with ESMTP id C69628FC22 for ; Mon, 27 Oct 2008 07:54:46 +0000 (UTC) (envelope-from melyutin@gmail.com) Received: by ug-out-1314.google.com with SMTP id 30so151719ugs.39 for ; Mon, 27 Oct 2008 00:54:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:subject:content-type :content-transfer-encoding; bh=zYRWASMBpXJ3X6GKzkImdHrbE1rfnQAOj+fgsGkisoo=; b=Pz7udQOinmPmodCPyRAPixtjIqZcz1+RxnGlfNycXINyBPH1zTujhoO5xZxklLStmd sp3VpgszsIpWDO2+6tJYJylDGCmWZcvWb9qUEsFVcEyE/UMUwHKbDQUTth81T5/JfZHl +Si1o+pGFZhf82DPDbnIT1gMUKJzQUWXLsLXM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; b=XSabv7eCJiDOA2dRycFMZgmrsxjf9yCic1IJp9xHlZmTVcmt3oL3AqLoS3Siixj7Fw PfjDsh10Q3okYws/lzDqyumQxKRKsRI1eRS5f2mBVU+JmCozMGQBcjJV2ChlhhAlXSL7 oboeMy/E9KMCnk06vUv2H5dIWmiecuS8++9KI= Received: by 10.67.123.8 with SMTP id a8mr1857114ugn.42.1225092722165; Mon, 27 Oct 2008 00:32:02 -0700 (PDT) Received: from ?192.168.140.53? ([79.135.230.161]) by mx.google.com with ESMTPS id g30sm4518273ugd.32.2008.10.27.00.32.00 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 27 Oct 2008 00:32:01 -0700 (PDT) Message-ID: <49056DE9.7010308@gmail.com> Date: Mon, 27 Oct 2008 10:29:45 +0300 From: Elyutin Matvei User-Agent: Thunderbird 2.0.0.16 (X11/20080820) MIME-Version: 1.0 To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Subject: 7.1-BETA2 panic on mpt degrade X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 07:54:47 -0000 I use the controller LSI 1068E (mpt). When disk array (mirror) is degrading i get kernel panic. With the recovery disk array, I also get a kernel panic FreeBSD qweqwe 7.1-BETA2 FreeBSD 7.1-BETA2 #0: Sun Oct 12 20:59:28 UTC 2008 root@driscoll.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 Fatal trap 12: page fault while in kernel mode cpuid = 7; apic id = 07 fault virtual address = 0x28 fault code = supervisor read data, page not present instruction pointer = 0x8:0xffffffff8018254d stack pointer = 0x10:0xffffffffac2c0a30 frame pointer = 0x10:0xffffff00036a3400 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 23 (swi2: cambio) trap number = 12 panic: page fault cpuid = 7 Uptime: 2m27s Physical memory: 8174 MB Dumping 342 MB: 327 311 295 279 263 247 231 215 199 183 167 151 135 119 103 87 71 55 39 23 7 #0 doadump () at pcpu.h:195 195 pcpu.h: No such file or directory. in pcpu.h (kgdb) backtrace #0 doadump () at pcpu.h:195 #1 0x0000000000000004 in ?? () #2 0xffffffff804b4299 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:418 #3 0xffffffff804b46a2 in panic (fmt=0x104
) at /usr/src/sys/kern/kern_shutdown.c:574 #4 0xffffffff80789123 in trap_fatal (frame=0xffffff0001255370, eva=Variable "eva" is not available. ) at /usr/src/sys/amd64/amd64/trap.c:764 #5 0xffffffff807894f5 in trap_pfault (frame=0xffffffffac2c0980, usermode=0) at /usr/src/sys/amd64/amd64/trap.c:680 #6 0xffffffff80789e38 in trap (frame=0xffffffffac2c0980) at /usr/src/sys/amd64/amd64/trap.c:449 #7 0xffffffff8076f63e in calltrap () at /usr/src/sys/amd64/amd64/exception.S:209 #8 0xffffffff8018254d in xpt_done (done_ccb=0xffffff00036a3400) at /usr/src/sys/cam/cam_xpt.c:4833 #9 0xffffffff80186692 in xpt_scan_bus (periph=Variable "periph" is not available. ) at /usr/src/sys/cam/cam_xpt.c:5395 #10 0xffffffff80184768 in camisr_runqueue (V_queue=Variable "V_queue" is not available. ) at /usr/src/sys/cam/cam_xpt.c:7316 #11 0xffffffff80184af9 in camisr (dummy=Variable "dummy" is not available. ) at /usr/src/sys/cam/cam_xpt.c:7216 #12 0xffffffff804957f0 in ithread_loop (arg=0xffffff00011daba0) at /usr/src/sys/kern/kern_intr.c:1088 #13 0xffffffff80492693 in fork_exit (callout=0xffffffff80495680 , arg=0xffffff00011daba0, frame=0xffffffffac2c0c80) at /usr/src/sys/kern/kern_fork.c:804 #14 0xffffffff8076fa0e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:455 #15 0x0000000000000000 in ?? () #16 0x0000000000000000 in ?? () #17 0x0000000000000001 in ?? () #18 0x0000000000000000 in ?? () #19 0x0000000000000000 in ?? () #20 0x0000000000000000 in ?? () #21 0x0000000000000000 in ?? () #22 0x0000000000000000 in ?? () #23 0x0000000000000000 in ?? () #24 0x0000000000000000 in ?? () #25 0x0000000000000000 in ?? () #26 0x0000000000000000 in ?? () #27 0x0000000000000000 in ?? () #28 0x0000000000000000 in ?? () #29 0x0000000000000000 in ?? () #30 0x0000000000000000 in ?? () #31 0x0000000000000000 in ?? () #32 0x0000000000000000 in ?? () #33 0x0000000000000000 in ?? () #34 0x0000000000000000 in ?? () #35 0x0000000000000000 in ?? () #36 0x0000000000000000 in ?? () #37 0x0000000000000000 in ?? () #38 0x0000000000000000 in ?? () #39 0x0000000000d41000 in ?? () #40 0xffffffff80abb540 in tdq_cpu () #41 0xffffffff80ac2940 in tdq_groups () #42 0xffffffff80ac25c0 in tdq_cpu () #43 0xffffff0001255370 in ?? () #44 0xffffffff80ab5dc0 in tdg_maxid () #45 0xffffffffac2c05f8 in ?? () #46 0xffffff0001255370 in ?? () #47 0xffffffff804d4e58 in sched_switch (td=0xffffffff80495680, newtd=0x0, flags=Variable "flags" is not available. ) at /usr/src/sys/kern/sched_ule.c:1938 #48 0x0000000000000000 in ?? () #49 0x0000000000000000 in ?? () #50 0x0000000000000000 in ?? () ---Type to continue, or q to quit--- #51 0x0000000000000000 in ?? () #52 0x0000000000000000 in ?? () #53 0x0000000000000000 in ?? () #54 0x0000000000000000 in ?? () #55 0x0000000000000000 in ?? () #56 0x0000000000000000 in ?? () #57 0x0000000000000000 in ?? () #58 0x0000000000000000 in ?? () #59 0x0000000000000000 in ?? () #60 0x0000000000000000 in ?? () #61 0x0000000000000000 in ?? () #62 0x0000000000000000 in ?? () #63 0x0000000000000000 in ?? () #64 0x0000000000000000 in ?? () #65 0x0000000000000000 in ?? () #66 0x0000000000000000 in ?? () #67 0x0000000000000000 in ?? () #68 0x0000000000000000 in ?? () #69 0x0000000000000000 in ?? () #70 0x0000000000000000 in ?? () #71 0x0000000000000000 in ?? () #72 0x0000000000000000 in ?? () #73 0x0000000000000000 in ?? () #74 0x0000000000000000 in ?? () #75 0x0000000000000000 in ?? () #76 0x0000000000000000 in ?? () #77 0x0000000000000000 in ?? () #78 0x0000000000000000 in ?? () #79 0x0000000000000000 in ?? () #80 0x0000000000000000 in ?? () #81 0x0000000000000000 in ?? () #82 0x0000000000000000 in ?? () #83 0x0000000000000000 in ?? () #84 0x0000000000000000 in ?? () #85 0x0000000000000000 in ?? () #86 0x0000000000000000 in ?? () #87 0x0000000000000000 in ?? () #88 0x0000000000000000 in ?? () #89 0x0000000000000000 in ?? () #90 0x0000000000000000 in ?? () #91 0x0000000000000000 in ?? () #92 0x0000000000000000 in ?? () #93 0x0000000000000000 in ?? () #94 0x0000000000000000 in ?? () #95 0x0000000000000000 in ?? () #96 0x0000000000000000 in ?? () #97 0x0000000000000000 in ?? () #98 0x0000000000000000 in ?? () #99 0x0000000000000000 in ?? () #100 0x0000000000000000 in ?? () #101 0x0000000000000000 in ?? () #102 0x0000000000000000 in ?? () ---Type to continue, or q to quit--- #103 0x0000000000000000 in ?? () #104 0x0000000000000000 in ?? () #105 0x0000000000000000 in ?? () #106 0x0000000000000000 in ?? () #107 0x0000000000000000 in ?? () #108 0x0000000000000000 in ?? () #109 0x0000000000000000 in ?? () #110 0x0000000000000000 in ?? () #111 0x0000000000000000 in ?? () #112 0x0000000000000000 in ?? () #113 0x0000000000000000 in ?? () #114 0x0000000000000000 in ?? () #115 0x0000000000000000 in ?? () Cannot access memory at address 0xffffffffac2c1000 From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 10:17:40 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CD2D61065699 for ; Mon, 27 Oct 2008 10:17:40 +0000 (UTC) (envelope-from v.haisman@sh.cvut.cz) Received: from service1.sh.cvut.cz (service1.sh.cvut.cz [147.32.127.214]) by mx1.freebsd.org (Postfix) with ESMTP id 8868B8FC14 for ; Mon, 27 Oct 2008 10:17:40 +0000 (UTC) (envelope-from v.haisman@sh.cvut.cz) Received: from localhost (localhost [127.0.0.1]) by service1.sh.cvut.cz (Postfix) with ESMTP id 306F1123C77; Mon, 27 Oct 2008 11:17:08 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at service1.sh.cvut.cz X-Spam-Score: -86.452 X-Spam-Level: X-Spam-Status: No, score=-86.452 tagged_above=-255 required=5 tests=[ALL_TRUSTED=-1.44, AWL=13.987, CRM114_HAM_00=, DNS_FROM_SECURITYSAGE=2.001, SMTPAUTH_SHDOMAIN=-100] Received: from service1.sh.cvut.cz ([127.0.0.1]) by localhost (service1.sh.cvut.cz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id f0QXE5VHI3Ra; Mon, 27 Oct 2008 11:17:00 +0100 (CET) Received: from 35.201.broadband4.iol.cz (35.201.broadband4.iol.cz [85.71.201.35]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: v.haisman@sh.cvut.cz) by service1.sh.cvut.cz (Postfix) with ESMTP id 0DD60123C6D; Mon, 27 Oct 2008 11:17:00 +0100 (CET) Message-ID: <4905951B.2050602@sh.cvut.cz> Date: Mon, 27 Oct 2008 11:16:59 +0100 From: Vaclav Haisman User-Agent: Thunderbird 2.0.0.17 (X11/20081017) MIME-Version: 1.0 To: freebsd-stable@freebsd.org X-Enigmail-Version: 0.95.7 OpenPGP: id=63B6B297 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Subject: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 10:17:40 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hi, I have recently bought a new disk (Seagate 500G, ST3500320NS). I have enabled SMART checking using the smartmontools as usual for the disk (/dev/ad6 -a -S on -s (S/../.././03|L/../../7/03) -m root). The problem is that each time the test runs I get messages like the following in /var/log/messages: Oct 26 04:54:15 35 kernel: ad6: TIMEOUT - WRITE_DMA48 retrying (1 retry left) LBA=836986454 Oct 26 04:54:25 35 kernel: ad6: TIMEOUT - WRITE_DMA48 retrying (0 retries left) LBA=836986454 Oct 26 04:54:25 35 kernel: ad6: FAILURE - WRITE_DMA48 timed out LBA=836986454 Oct 26 04:54:25 35 kernel: g_vfs_done():ad6s2d[WRITE(offset=13150142464, length=16384)]error = 5 And the SMART test results log on the disk contains line like this: # 1 Short offline Interrupted (host reset) 00% 297 - This is on 7.1-PRERELEASE #0: Wed Oct 15 18:56:54 UTC 2008, with GENERIC kernel. Now, does the timeout cause loss of any data? Is there anything besides disabling the testing that I can do about it? - -- VH -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iFYEAREIAAYFAkkFlRsACgkQhQBMvHf/WHn6fQDbBv7gpSV3x2GwDsM5VeVI+iax oCp7aGDcgFwD9ADaAzA219KdJfu2aCgZfqXOthqvJhah6u06VObcIw== =jm7d -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 11:58:09 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4F0FC1065670; Mon, 27 Oct 2008 11:58:09 +0000 (UTC) (envelope-from spamd@stu.cn.ua) Received: from stu.cn.ua (stalker.stu.cn.ua [195.69.76.130]) by mx1.freebsd.org (Postfix) with ESMTP id C8C178FC1C; Mon, 27 Oct 2008 11:58:07 +0000 (UTC) (envelope-from spamd@stu.cn.ua) Received: from stu.cn.ua (localhost [127.0.0.1]) by stu.cn.ua (Postfix) with ESMTP id 2D8FE247CDF; Mon, 27 Oct 2008 03:25:54 +0200 (EET) Received: by stu.cn.ua (Postfix, from userid 58) id 1385E2474CF; Mon, 27 Oct 2008 03:25:54 +0200 (EET) X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on stalker.stu.cn.ua X-Spam-Level: X-Spam-Status: No, score=-105.0 required=4.5 tests=BAYES_00, RCVD_IN_DNSWL_MED, RCVD_IN_NJABL_PROXY, SPF_PASS, USER_IN_WHITELIST autolearn=ham version=3.2.5 Received: from mx2.freebsd.org (mx2.freebsd.org [69.147.83.53]) by stu.cn.ua (Postfix) with ESMTP id DC575244C42 for ; Mon, 27 Oct 2008 03:25:50 +0200 (EET) Received: from hub.freebsd.org (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id 1B1251544DE; Mon, 27 Oct 2008 01:25:15 +0000 (UTC) (envelope-from owner-freebsd-current@freebsd.org) Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 6FFA31065748; Mon, 27 Oct 2008 01:25:12 +0000 (UTC) (envelope-from owner-freebsd-current@freebsd.org) Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4B5F7106566B for ; Mon, 27 Oct 2008 00:47:28 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: from mail-gx0-f15.google.com (mail-gx0-f15.google.com [209.85.217.15]) by mx1.freebsd.org (Postfix) with ESMTP id DB8FF8FC08 for ; Mon, 27 Oct 2008 00:47:27 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: by gxk8 with SMTP id 8so1733396gxk.19 for ; Sun, 26 Oct 2008 17:47:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:from:to :content-type:mime-version:subject:date:cc:x-mailer; bh=HCkZnH0xrHpotbdHSXsKpcBsCH5f1XReivJbUdzudpo=; b=xFsGoTemufNZYRxyV5Haj+R5k6UNBmj1I3e/DILhDKHEMyTfGNN0cRoOvopbB+RxdL J1i3z4VmEclIrgymdTSxTeAECk66ttTEAO9gd2mShx0uoqK5CiVMYfh31V+wq+w7AKdK a5xW1tyLrEkA+yD9WCcH8YFFOduapLM8/eeNw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:from:to:content-type:mime-version:subject:date:cc :x-mailer; b=MZS9Eegb0KPByIvutS8PcVNphEILkFXGHIAzPuBmGWGh/eK0XXdhACUMkl2A5F2MGN R2zkHfMFBHNgtATXyIYZd4qN9sHJi8swarN9pi7wBZj3nGdjWg7j5ln6wv5NDyURaqsF 36C1gYFW3kxAwJz7HgCZxVp0/1FmRpHryOsBw= Received: by 10.65.72.7 with SMTP id z7mr5733001qbk.23.1225068445965; Sun, 26 Oct 2008 17:47:25 -0700 (PDT) Received: from 18-23-112.adsl.terra.cl (18-23-112.adsl.terra.cl [200.112.23.18]) by mx.google.com with ESMTPS id s27sm5727589qbs.12.2008.10.26.17.47.23 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sun, 26 Oct 2008 17:47:25 -0700 (PDT) Message-Id: From: Jose Amengual To: freebsd-stable@freebsd.org Mime-Version: 1.0 (Apple Message framework v929.2) Date: Sun, 26 Oct 2008 21:47:18 -0300 X-Mailer: Apple Mail (2.929.2) X-Mailman-Approved-At: Mon, 27 Oct 2008 01:25:07 +0000 Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Sender: owner-freebsd-current@freebsd.org Errors-To: owner-freebsd-current@freebsd.org X-Virus-Scanned: ClamAV using ClamSMTP on stalker.stu.cn.ua Cc: freebsd-current@freebsd.org Subject: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 11:58:09 -0000 Hi guys. I post a question few days ago. this is the link : http://groups.google.com/group/mailing.freebsd.current/browse_thread/thread/de0953974d6dd9f4/f35d27cbe374b799?show_docid=f35d27cbe374b799&fwc=1 I was reading this post : http://unix.derkeiler.com/Mailing-Lists/FreeBSD/current/2007-08/msg00174.html and this : http://unix.derkeiler.com/Mailing-Lists/FreeBSD/net/2008-04/msg00047.html The problem persist even in stable 7.0, 7.1-PRERELEASE and 7.0-P5 , the postfix jail is living all the email in defer queue saying "Connection Time Out" This server give service to 300 clients and the network load os high. is there any clue how to resolve this ? Thanks. _______________________________________________ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 12:29:12 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F13BC106567C for ; Mon, 27 Oct 2008 12:29:12 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.cksoft.de (mail.cksoft.de [62.111.66.27]) by mx1.freebsd.org (Postfix) with ESMTP id AADEB8FC08 for ; Mon, 27 Oct 2008 12:29:12 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from localhost (amavis.str.cksoft.de [192.168.74.71]) by mail.cksoft.de (Postfix) with ESMTP id 7F6B141C70C; Mon, 27 Oct 2008 13:10:05 +0100 (CET) X-Virus-Scanned: amavisd-new at cksoft.de Received: from mail.cksoft.de ([62.111.66.27]) by localhost (amavis.str.cksoft.de [192.168.74.71]) (amavisd-new, port 10024) with ESMTP id Us70FAGpfZ9A; Mon, 27 Oct 2008 13:10:05 +0100 (CET) Received: by mail.cksoft.de (Postfix, from userid 66) id 2F3B541C707; Mon, 27 Oct 2008 13:10:05 +0100 (CET) Received: from maildrop.int.zabbadoz.net (maildrop.int.zabbadoz.net [10.111.66.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.int.zabbadoz.net (Postfix) with ESMTP id 6633E44487F; Mon, 27 Oct 2008 12:09:53 +0000 (UTC) Date: Mon, 27 Oct 2008 12:09:52 +0000 (UTC) From: "Bjoern A. Zeeb" X-X-Sender: bz@maildrop.int.zabbadoz.net To: Jose Amengual In-Reply-To: Message-ID: <20081027120802.G2978@maildrop.int.zabbadoz.net> References: X-OpenPGP-Key: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 12:29:13 -0000 On Sun, 26 Oct 2008, Jose Amengual wrote: Hi, > The problem persist even in stable 7.0, 7.1-PRERELEASE and 7.0-P5 , the > postfix jail is living all the email in defer queue saying "Connection Time > Out" > > This server give service to 300 clients and the network load os high. > > is there any clue how to resolve this ? sorry if I am not reading back various links which include mails I had sent which are entirely unrelated. So you are seeing TCP problems. And you are running with a firewall enabled? Have you tried tcpdumping and seeing what exactly goes wrong? do you have any offload stuff enabled (as the subject suggests)? If so what happens if you disable this? /bz -- Bjoern A. Zeeb Stop bit received. Insert coin for new game. From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 12:30:56 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B7680106566B; Mon, 27 Oct 2008 12:30:56 +0000 (UTC) (envelope-from spamd@stu.cn.ua) Received: from stu.cn.ua (stalker.stu.cn.ua [195.69.76.130]) by mx1.freebsd.org (Postfix) with ESMTP id 091C08FC1A; Mon, 27 Oct 2008 12:30:55 +0000 (UTC) (envelope-from spamd@stu.cn.ua) Received: from stu.cn.ua (localhost [127.0.0.1]) by stu.cn.ua (Postfix) with ESMTP id 3131A244ED7; Mon, 27 Oct 2008 14:30:53 +0200 (EET) Received: by stu.cn.ua (Postfix, from userid 58) id 1246B244F49; Mon, 27 Oct 2008 14:30:53 +0200 (EET) X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on stalker.stu.cn.ua X-Spam-Level: X-Spam-Status: No, score=-106.6 required=4.5 tests=BAYES_00, RCVD_IN_DNSWL_MED, SPF_PASS,USER_IN_WHITELIST autolearn=ham version=3.2.5 Received: from mx2.freebsd.org (mx2.freebsd.org [69.147.83.53]) by stu.cn.ua (Postfix) with ESMTP id C4D36244DE4 for ; Mon, 27 Oct 2008 14:10:39 +0200 (EET) Received: from hub.freebsd.org (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id CCD6E1622B5; Mon, 27 Oct 2008 12:10:22 +0000 (UTC) (envelope-from owner-freebsd-current@freebsd.org) Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 520A91065751; Mon, 27 Oct 2008 12:10:20 +0000 (UTC) (envelope-from owner-freebsd-current@freebsd.org) Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2D264106566C for ; Mon, 27 Oct 2008 12:10:08 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.cksoft.de (mail.cksoft.de [62.111.66.27]) by mx1.freebsd.org (Postfix) with ESMTP id D90338FC1A for ; Mon, 27 Oct 2008 12:10:07 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from localhost (amavis.str.cksoft.de [192.168.74.71]) by mail.cksoft.de (Postfix) with ESMTP id 7F6B141C70C; Mon, 27 Oct 2008 13:10:05 +0100 (CET) X-Virus-Scanned: amavisd-new at cksoft.de Received: from mail.cksoft.de ([62.111.66.27]) by localhost (amavis.str.cksoft.de [192.168.74.71]) (amavisd-new, port 10024) with ESMTP id Us70FAGpfZ9A; Mon, 27 Oct 2008 13:10:05 +0100 (CET) Received: by mail.cksoft.de (Postfix, from userid 66) id 2F3B541C707; Mon, 27 Oct 2008 13:10:05 +0100 (CET) Received: from maildrop.int.zabbadoz.net (maildrop.int.zabbadoz.net [10.111.66.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.int.zabbadoz.net (Postfix) with ESMTP id 6633E44487F; Mon, 27 Oct 2008 12:09:53 +0000 (UTC) Date: Mon, 27 Oct 2008 12:09:52 +0000 (UTC) From: "Bjoern A. Zeeb" X-X-Sender: bz@maildrop.int.zabbadoz.net To: Jose Amengual In-Reply-To: Message-ID: <20081027120802.G2978@maildrop.int.zabbadoz.net> References: X-OpenPGP-Key: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Sender: owner-freebsd-current@freebsd.org Errors-To: owner-freebsd-current@freebsd.org X-Virus-Scanned: ClamAV using ClamSMTP on stalker.stu.cn.ua Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 12:30:56 -0000 On Sun, 26 Oct 2008, Jose Amengual wrote: Hi, > The problem persist even in stable 7.0, 7.1-PRERELEASE and 7.0-P5 , the > postfix jail is living all the email in defer queue saying "Connection Time > Out" > > This server give service to 300 clients and the network load os high. > > is there any clue how to resolve this ? sorry if I am not reading back various links which include mails I had sent which are entirely unrelated. So you are seeing TCP problems. And you are running with a firewall enabled? Have you tried tcpdumping and seeing what exactly goes wrong? do you have any offload stuff enabled (as the subject suggests)? If so what happens if you disable this? /bz -- Bjoern A. Zeeb Stop bit received. Insert coin for new game. _______________________________________________ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 12:51:57 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 43AE1106567C for ; Mon, 27 Oct 2008 12:51:57 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: from gv-out-0910.google.com (gv-out-0910.google.com [216.239.58.184]) by mx1.freebsd.org (Postfix) with ESMTP id BF3EF8FC0C for ; Mon, 27 Oct 2008 12:51:56 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: by gv-out-0910.google.com with SMTP id n8so193226gve.39 for ; Mon, 27 Oct 2008 05:51:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=u4J/5RksQaiff8uZ89y0E+J1lTy09UceWIkUOd0bsUU=; b=eJ38PN6JwppYTC/8OoD8Bqca98wDQNgJEgpfg7HXsl9nVbqmSfmflB8yS/Kx3cY/oG YoctQIYmz/5jERzVtoEf4qXzDneBnlETEQQyYexFbyAbYNN0htvxUHB3Gb6fRfMcSP2a qejzrtA3EzavkJgGH+AY/Q7ZESwGNbY7yn9G4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=Z03oX7NAJ9lgOmiaGellmDf1RUHODHkLaPt/+oj/yoPoqK6McYdGqubQzz6AWzmbn1 d/x6utzKP047ojM73shA1pVEMQns8Rsx9mg1Ukugv3E5evj10pMg/s5FUb1iH3aP1h30 veGRDgQfiRar+mndKttz5qZeWl+pXtYSZFcVQ= Received: by 10.103.247.14 with SMTP id z14mr2723065mur.2.1225111914748; Mon, 27 Oct 2008 05:51:54 -0700 (PDT) Received: by 10.103.192.6 with HTTP; Mon, 27 Oct 2008 05:51:54 -0700 (PDT) Message-ID: Date: Mon, 27 Oct 2008 09:51:54 -0300 From: "Jose Amengual" To: "Bjoern A. Zeeb" In-Reply-To: <20081027120802.G2978@maildrop.int.zabbadoz.net> MIME-Version: 1.0 References: <20081027120802.G2978@maildrop.int.zabbadoz.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 12:51:57 -0000 Hi Bjoern. I have PF has a firewall with 4 jails and nat. I have the same configuration in a 6.4 with no issues. I can send you my pf.conf if you want and any dump file, just let me know with options do you need with tcpdump. I didn't have any offload stuff enabled I just install freebsd default, update to stable and start working, I didn't change any sysctl variable. The only estrange behavior that you can see that when a email is going to the deferred spool you will see a TCP kernel message just before that. Please let me know what you need to help me. Thanks. On Mon, Oct 27, 2008 at 9:09 AM, Bjoern A. Zeeb < bzeeb-lists@lists.zabbadoz.net> wrote: > On Sun, 26 Oct 2008, Jose Amengual wrote: > > Hi, > > The problem persist even in stable 7.0, 7.1-PRERELEASE and 7.0-P5 , the >> postfix jail is living all the email in defer queue saying "Connection Time >> Out" >> >> This server give service to 300 clients and the network load os high. >> >> is there any clue how to resolve this ? >> > > sorry if I am not reading back various links which include mails I had > sent which are entirely unrelated. > > So you are seeing TCP problems. And you are running with a firewall > enabled? > > Have you tried tcpdumping and seeing what exactly goes wrong? > > do you have any offload stuff enabled (as the subject suggests)? If so > what happens if you disable this? > > /bz > > -- > Bjoern A. Zeeb Stop bit received. Insert coin for new game. > From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 15:58:54 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DFAE81065672 for ; Mon, 27 Oct 2008 15:58:54 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 5AAB78FC13 for ; Mon, 27 Oct 2008 15:58:54 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9RFwpGD019594; Mon, 27 Oct 2008 16:58:52 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9RFwpnv019593; Mon, 27 Oct 2008 16:58:51 +0100 (CET) (envelope-from olli) Date: Mon, 27 Oct 2008 16:58:51 +0100 (CET) Message-Id: <200810271558.m9RFwpnv019593@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG, gamato@users.sf.net In-Reply-To: X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Mon, 27 Oct 2008 16:58:52 +0100 (CET) Cc: Subject: Re: easy way to upgrade from 6.3 to 7.1 (including port packages) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-stable@FreeBSD.ORG, gamato@users.sf.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 15:58:55 -0000 martinko wrote: > Oliver Fromme wrote: > > martinko wrote: > > > 1) I wonder if I could use mergemaster to compare 2 directories and > > > merge differencies as neccessary. To explain: I have all config files I > > > touch saved with full path somewhere in /root. And therefore I'd like > > > mergemaster or some other tool to compare all files in my backup > > > directory with newly installed (config) files. > > > > You can use mergemaster against any directory, not just > > /etc. This is especially useful when perforing a binary > > update, a cross update or similar things. > > > > No, you cannot. Yes, You can. I've done it several times. And I'm sure I'm not hallucinating. :-) > I have all config files I edited saved with full path under my backup > directory and I would like to use mergemaster or something similar to > compare and merge my changes (perhaps from other machine). But if you > try to use mergemaster (you need to specify both -m and -D) You only need -m if you have installed the source somewhere else than /usr/src. > it would try > to run make (1) which fails since there is no Makefile in my backup dir. :-( You have to it runs make(1) in /usr/src/etc (unless you override the path with -m) which contains a Makefile. If it doesn't, you haven't installed the system sources correctly. >From your description it sounds as if you used -m to point to your modified etc files. That's wrong. Please follow the instructions that I explained in my previous mail message. It works. As I said, I've done it plenty of times. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "The scanf() function is a large and complex beast that often does something almost but not quite entirely unlike what you desired." -- Chris Torek From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 16:02:58 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0BDBF106566B for ; Mon, 27 Oct 2008 16:02:58 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 49ED28FC0C for ; Mon, 27 Oct 2008 16:02:57 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.3/8.14.3) with ESMTP id m9RG2Y1b012952; Mon, 27 Oct 2008 12:02:50 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Jo Rhett Date: Mon, 27 Oct 2008 11:51:47 -0400 User-Agent: KMail/1.9.7 References: <84E1EC10-5323-4A8C-AD60-31142621DB32@netconsonance.com> In-Reply-To: <84E1EC10-5323-4A8C-AD60-31142621DB32@netconsonance.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810271151.47366.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Mon, 27 Oct 2008 12:02:50 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8508/Mon Oct 27 09:02:44 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-stable Stable Subject: Re: 6.4 RC1 locks up solid on first reboot X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 16:02:58 -0000 On Friday 24 October 2008 02:48:13 pm Jo Rhett wrote: > So I booted up by CD and used Fixit mode to switch the system to boot > via serial (keyboard detached), but this gathered me even less. > > /boot.config: -Dh > Consoles: internal video/keyboard serial port > BIOS drive A: is disk0 > BIOS drive C: is disk1 > BIOS drive D: is disk2 > BIOS 639kB/4062144kB available memory > > FreeBSD/i386 bootstrap loader, Revision 1.1 > (root@dessler.cse.b > > Plugging back in the monitor after lockup showed only a single char > more: > (root@dessler.cse.bu This confirms it is hanging in one of the two BIOS routines to output a character. One thing you can do would be to boot up and do the following: dd if=/dev/mem bs=0x400 count=1 of=idt.out dd if=/dev/mem bs=64k iseek=15 count=1 of=bios.out Then place those files some place I can fetch them. You might also play with any BIOS settings you have for serial console redirection to see if they make a difference. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 16:03:04 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4E1971065675 for ; Mon, 27 Oct 2008 16:03:04 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 877908FC0C for ; Mon, 27 Oct 2008 16:03:03 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.3/8.14.3) with ESMTP id m9RG2Y1c012952; Mon, 27 Oct 2008 12:02:56 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Jo Rhett Date: Mon, 27 Oct 2008 11:52:44 -0400 User-Agent: KMail/1.9.7 References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810271152.46716.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Mon, 27 Oct 2008 12:02:56 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8508/Mon Oct 27 09:02:44 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=AWL,BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-stable Stable Subject: Re: 6.4 RC1 locks up solid on first reboot X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 16:03:04 -0000 On Friday 24 October 2008 03:05:32 pm Jo Rhett wrote: > John, is this perhaps the problem seen with 7.0, discussed here? > http://unix.derkeiler.com/Mailing-Lists/FreeBSD/stable/2008-05/msg00437.html It is related, but that fix is already in 6.4. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 16:03:12 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 64C18106569F; Mon, 27 Oct 2008 16:03:12 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 7A1678FC20; Mon, 27 Oct 2008 16:03:11 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.3/8.14.3) with ESMTP id m9RG2Y1d012952; Mon, 27 Oct 2008 12:03:02 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Jeremy Chadwick Date: Mon, 27 Oct 2008 11:57:05 -0400 User-Agent: KMail/1.9.7 References: <20081025014218.GA47549@phat.za.net> <20081025080945.GA55413@icarus.home.lan> In-Reply-To: <20081025080945.GA55413@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810271157.06096.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Mon, 27 Oct 2008 12:03:04 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8508/Mon Oct 27 09:02:44 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: Jo Rhett , Aragon Gouveia , freebsd-stable Stable Subject: Re: 6.4 RC1 locks up solid on first reboot X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 16:03:12 -0000 On Saturday 25 October 2008 04:09:45 am Jeremy Chadwick wrote: > Just for posterity: the USB Legacy Support BIOS option does not affect > natively-connected PS/2 keyboards; you can leave the option enabled even > in the scenario where you have a USB keyboard *and* a PS/2 keyboard > plugged in; one will not "trump" the other. Instead, you should have > two keyboards which function in OSes/environments which lack a USB > stack. (That is, until something resets/reassigns the BIOS-controlled > interrupt, which will then break USB->PS/2 emulation; the native PS/2 > keyboard should not be affected by this) This last statement is not quite true (at least not always true). For many systems, the way the PS/2 emulation works is that accesses to the backing I/O ports (0x60 and 0x64) case a trap into SMM and the SMI handler in the BIOS then talks to the USB controller and keyboard and updates the register values to simulate the I/O port accesses. This is disabled by having the USB host controller driver frob flags in controller registers to disable the SMI traps. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 16:08:32 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ADD4B1065672 for ; Mon, 27 Oct 2008 16:08:32 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA08.westchester.pa.mail.comcast.net (qmta08.westchester.pa.mail.comcast.net [76.96.62.80]) by mx1.freebsd.org (Postfix) with ESMTP id 19DD68FC1E for ; Mon, 27 Oct 2008 16:08:31 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA14.westchester.pa.mail.comcast.net ([76.96.62.60]) by QMTA08.westchester.pa.mail.comcast.net with comcast id XqNR1a00L1HzFnQ58s8Cdn; Mon, 27 Oct 2008 16:08:12 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA14.westchester.pa.mail.comcast.net with comcast id Xs8U1a00Y2P6wsM3as8UtL; Mon, 27 Oct 2008 16:08:29 +0000 X-Authority-Analysis: v=1.0 c=1 a=KeEtZEhZrkgA:10 a=ieuqav0nqiAA:10 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=fEAqBA1rE-sgMAfmhTcA:9 a=CTT0H_cuS7nIOsb--lUA:7 a=V27EtbvlOLZXyGoM-Xcq8oTUGxwA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 140E6C9419; Mon, 27 Oct 2008 09:08:28 -0700 (PDT) Date: Mon, 27 Oct 2008 09:08:28 -0700 From: Jeremy Chadwick To: Vaclav Haisman Message-ID: <20081027160828.GA24496@icarus.home.lan> References: <4905951B.2050602@sh.cvut.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4905951B.2050602@sh.cvut.cz> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-stable@freebsd.org Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 16:08:32 -0000 On Mon, Oct 27, 2008 at 11:16:59AM +0100, Vaclav Haisman wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > Hi, > I have recently bought a new disk (Seagate 500G, ST3500320NS). I have > enabled SMART checking using the smartmontools as usual for the disk > (/dev/ad6 -a -S on -s (S/../.././03|L/../../7/03) -m root). The problem > is that each time the test runs I get messages like the following in > /var/log/messages: > > Oct 26 04:54:15 35 kernel: ad6: TIMEOUT - WRITE_DMA48 retrying (1 retry > left) LBA=836986454 > Oct 26 04:54:25 35 kernel: ad6: TIMEOUT - WRITE_DMA48 retrying (0 > retries left) LBA=836986454 > Oct 26 04:54:25 35 kernel: ad6: FAILURE - WRITE_DMA48 timed out > LBA=836986454 > Oct 26 04:54:25 35 kernel: g_vfs_done():ad6s2d[WRITE(offset=13150142464, > length=16384)]error = 5 > > And the SMART test results log on the disk contains line like this: > > # 1 Short offline Interrupted (host reset) 00% 297 > - First and foremost, your above smartd.conf -s flags are conflicting. Your long offline test will never get run on Sunday; the short will run first, and the long won't ever start (because the short is already running). I would recommend telling the short test to run only between days 0-6, leaving Sunday solely for the long test. (I noticed this because the above "Interrupted" test indicates a short test was interrupted and not a long). Second, your short offline test runs at 0300, but the errors you're seeing are at 0454 in the morning. A short offline test does not take 2 hours to run -- they take between 2-10 minutes -- unless the system is also in the middle of doing a lot of I/O, in which case the short test will be suspended. There are cronjobs (specifically periodic jobs) that run starting at 0301 in the morning ("periodic daily"), and many of those are I/O bound. This could possibly extend the length of the short test until 0454. Weekly periodic jobs run at 0415 in the morning, on Sundays. These also perform a lot of disk I/O, so it's possible that on Sunday specifically the short SMART test gets pushed back quite some time. Third, the DMA timeouts you're seeing are possibly caused by the drive taking too long when internally suspending the SMART test. In most cases, it's safe for SMART tests (short and long) to be run while the machine is operational, and disk I/O requests are being performed. When an I/O request comes and the disk is in the middle of performing a SMART test, the drive has to stop the SMART test (e.g. "suspend" it), complete the I/O request, then resume the SMART test. The FreeBSD ATA layer has a 5 second timeout on I/O requests; if it doesn't receive an acknowledgement back from the controller (disk) within 5 seconds, it'll report a timeout on whatever operation it was performing. I'm thinking the disk gets stuck in a "do the offline test, no wait stop there's an I/O request, okay its done continue the test, no way stop there's another I/O" loop. Another possibility is that your drive really *does* have a bad block at LBA 836986454, and that one of those cron/periodic jobs is what's noticing it, and that upon noticing a bad block, the drive more or less aborts the SMART test to perform internal remapping of the block. To confirm this, you would need to boot the SeaTools utilities from DOS or from a CD (see Seagate's site) and run a full sector scan (NOT the "quick" test). This takes a few hours. Assuming it comes back clean, then my above claim of the offline test taking too long to suspend is probably the case. Possibly this is a firmware bug in the drive -- you might consider mailing Seagate about this problem, although I'm doubting their Tier 1 support will understand what the issue is. Is the block number always the same? Do you only see this error on Sundays? These are two questions which might help narrow things down. > This is on 7.1-PRERELEASE #0: Wed Oct 15 18:56:54 UTC 2008, with GENERIC > kernel. > > Now, does the timeout cause loss of any data? Is there anything besides > disabling the testing that I can do about it? Do you understand what short and long offline tests actually do and what they're used for? :-) If so, you'd know that running them periodically is more or less silly (IMHO). If you're trying to accomplish a cheap version of disk scrubbing, e.g. scanning the entire disk for bad blocks and report them or have them automatically remapped by the drive, consider using sysutils/diskcheckd, which was made for this purpose. However, be aware of a problem I've run into with it (still needs someone clueful to figure out why this happens): http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/115853 I do not advocate the use of periodic offline tests on disks, especially at such aggressive intervals (daily). In fact, I don't even know why Bruce added that option to smartd. There are only a few attributes in SMART which get updated on offline tests, so I cease to see the point. You shouldn't be doing what you're doing, IMHO. If you want to do these tests once every 2 weeks or once a month, that'd be a better idea. Stick with the short test, and do it during a time when disk I/O is very low (try something like 7am on a Saturday). Don't go with 2am if your system/environment honours Daylight Saving Time, because that could cause the test to run twice. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 16:09:49 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 158761065685 for ; Mon, 27 Oct 2008 16:09:49 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 6E7058FC14 for ; Mon, 27 Oct 2008 16:09:48 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9RG9kRv020295; Mon, 27 Oct 2008 17:09:47 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9RG9kLB020294; Mon, 27 Oct 2008 17:09:46 +0100 (CET) (envelope-from olli) Date: Mon, 27 Oct 2008 17:09:46 +0100 (CET) Message-Id: <200810271609.m9RG9kLB020294@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG, dudu.meyer@gmail.com In-Reply-To: X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Mon, 27 Oct 2008 17:09:47 +0100 (CET) Cc: Subject: Re: ifconfig won't allow me to change ether address and inet address in ?the same command X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-stable@FreeBSD.ORG, dudu.meyer@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 16:09:49 -0000 Eduardo Meyer wrote: > # ifconfig rl0 ether 00:02:4f:0a:ce:f3 inet 192.168.2.12 netmask 255.255.255.0 > ifconfig: can't set link-level netmask or broadcast > > # ifconfig rl0 inet 192.168.2.12 netmask 255.255.255.0 ether 00:02:4f:0a:ce:f3 > ifconfig: ether: bad value > > # ifconfig rl0 inet 192.168.2.12 netmask 255.255.255.0 > # ifconfig rl0 ether 00:02:4f:0a:ce:f3 > > I ask you some help, how can I accomplish both tasks with rc_ng? In /etc/rc.conf > > ifconfig_rl0="inet 192.168.2.12 netmask 255.255.255.0 ether 00:02:4f:0a:ce:f3" > > Won't allow me to do what I want. Any suggestions? I would like like > to edit /etc/rc.local and any other kind of "workaround". Can rc.conf > issue ifconfig twice for the same nic? > > Or can ifconfig accomplish this task by someway else other than > issuing the command twice? Others have already suggested several workarounds. Another possibility is to set only the IP via rc.conf: ifconfig_rl0="inet 192.168.2.12 netmask 255.255.255.0" And set the MAC address with an interface start script which should be named /etc/start_if.rl0 in your case and contain this line: ifconfig rl0 ether 00:02:4f:0a:ce:f3 Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "What is this talk of 'release'? We do not make software 'releases'. Our software 'escapes', leaving a bloody trail of designers and quality assurance people in its wake." From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 16:18:11 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3D41A106567B for ; Mon, 27 Oct 2008 16:18:11 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA01.westchester.pa.mail.comcast.net (qmta01.westchester.pa.mail.comcast.net [76.96.62.16]) by mx1.freebsd.org (Postfix) with ESMTP id 8D12D8FC4C for ; Mon, 27 Oct 2008 16:18:08 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA12.westchester.pa.mail.comcast.net ([76.96.62.44]) by QMTA01.westchester.pa.mail.comcast.net with comcast id XqPF1a00X0xGWP851sJ8Al; Mon, 27 Oct 2008 16:18:08 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA12.westchester.pa.mail.comcast.net with comcast id XsJ61a00K2P6wsM3YsJ7yT; Mon, 27 Oct 2008 16:18:08 +0000 X-Authority-Analysis: v=1.0 c=1 a=j1jtvhf0zA8A:10 a=T4SDRHG4orYA:10 a=QycZ5dHgAAAA:8 a=gtLclbzq4LdMaKvm740A:9 a=y5jnm3NcaIDNIJa3F4EA:7 a=ULynrNWdqBSmK_4fLfAHhR5Q4PcA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 88098C941E; Mon, 27 Oct 2008 09:18:06 -0700 (PDT) Date: Mon, 27 Oct 2008 09:18:06 -0700 From: Jeremy Chadwick To: John Baldwin Message-ID: <20081027161806.GA25404@icarus.home.lan> References: <20081025014218.GA47549@phat.za.net> <20081025080945.GA55413@icarus.home.lan> <200810271157.06096.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200810271157.06096.jhb@freebsd.org> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Jo Rhett , Aragon Gouveia , freebsd-stable Stable Subject: Re: 6.4 RC1 locks up solid on first reboot X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 16:18:11 -0000 On Mon, Oct 27, 2008 at 11:57:05AM -0400, John Baldwin wrote: > On Saturday 25 October 2008 04:09:45 am Jeremy Chadwick wrote: > > Just for posterity: the USB Legacy Support BIOS option does not affect > > natively-connected PS/2 keyboards; you can leave the option enabled even > > in the scenario where you have a USB keyboard *and* a PS/2 keyboard > > plugged in; one will not "trump" the other. Instead, you should have > > two keyboards which function in OSes/environments which lack a USB > > stack. (That is, until something resets/reassigns the BIOS-controlled > > interrupt, which will then break USB->PS/2 emulation; the native PS/2 > > keyboard should not be affected by this) > > This last statement is not quite true (at least not always true). For many > systems, the way the PS/2 emulation works is that accesses to the backing I/O > ports (0x60 and 0x64) case a trap into SMM and the SMI handler in the BIOS > then talks to the USB controller and keyboard and updates the register values > to simulate the I/O port accesses. This is disabled by having the USB host > controller driver frob flags in controller registers to disable the SMI > traps. Thanks for cluing me in, John. I'm used to legacy device emulation being done purely from an interrupt handler point of view (BIOS mapping code to a specific interrupt), and wasn't even aware of SMM/SMI. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 17:22:44 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3091E106566B for ; Mon, 27 Oct 2008 17:22:44 +0000 (UTC) (envelope-from v.haisman@sh.cvut.cz) Received: from service1.sh.cvut.cz (service1.sh.cvut.cz [147.32.127.214]) by mx1.freebsd.org (Postfix) with ESMTP id A12E08FC0C for ; Mon, 27 Oct 2008 17:22:43 +0000 (UTC) (envelope-from v.haisman@sh.cvut.cz) Received: from localhost (localhost [127.0.0.1]) by service1.sh.cvut.cz (Postfix) with ESMTP id 7D8C5123C13; Mon, 27 Oct 2008 18:22:12 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at service1.sh.cvut.cz X-Spam-Score: -86.599 X-Spam-Level: X-Spam-Status: No, score=-86.599 tagged_above=-255 required=5 tests=[ALL_TRUSTED=-1.44, AWL=13.651, CRM114_HAM_00=, DNS_FROM_SECURITYSAGE=2.001, MISSING_HEADERS=0.189, SMTPAUTH_SHDOMAIN=-100] Received: from service1.sh.cvut.cz ([127.0.0.1]) by localhost (service1.sh.cvut.cz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id J+wIN2MSwmR0; Mon, 27 Oct 2008 18:22:03 +0100 (CET) Received: from 35.201.broadband4.iol.cz (35.201.broadband4.iol.cz [85.71.201.35]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: v.haisman@sh.cvut.cz) by service1.sh.cvut.cz (Postfix) with ESMTP id 80169123C0D; Mon, 27 Oct 2008 18:22:03 +0100 (CET) Message-ID: <4905F8BB.3080302@sh.cvut.cz> Date: Mon, 27 Oct 2008 18:22:03 +0100 From: Vaclav Haisman User-Agent: Thunderbird 2.0.0.17 (X11/20081017) MIME-Version: 1.0 CC: freebsd-stable@freebsd.org References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> In-Reply-To: <20081027160828.GA24496@icarus.home.lan> X-Enigmail-Version: 0.95.7 OpenPGP: id=63B6B297 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 17:22:44 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Jeremy Chadwick wrote: > On Mon, Oct 27, 2008 at 11:16:59AM +0100, Vaclav Haisman wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA256 >> >> Hi, >> I have recently bought a new disk (Seagate 500G, ST3500320NS). I have >> enabled SMART checking using the smartmontools as usual for the disk >> (/dev/ad6 -a -S on -s (S/../.././03|L/../../7/03) -m root). The problem >> is that each time the test runs I get messages like the following in >> /var/log/messages: >> >> Oct 26 04:54:15 35 kernel: ad6: TIMEOUT - WRITE_DMA48 retrying (1 retry >> left) LBA=836986454 >> Oct 26 04:54:25 35 kernel: ad6: TIMEOUT - WRITE_DMA48 retrying (0 >> retries left) LBA=836986454 >> Oct 26 04:54:25 35 kernel: ad6: FAILURE - WRITE_DMA48 timed out >> LBA=836986454 >> Oct 26 04:54:25 35 kernel: g_vfs_done():ad6s2d[WRITE(offset=13150142464, >> length=16384)]error = 5 >> >> And the SMART test results log on the disk contains line like this: >> >> # 1 Short offline Interrupted (host reset) 00% 297 >> - > > First and foremost, your above smartd.conf -s flags are conflicting. > Your long offline test will never get run on Sunday; the short will run > first, and the long won't ever start (because the short is already > running). I would recommend telling the short test to run only between > days 0-6, leaving Sunday solely for the long test. (I noticed this > because the above "Interrupted" test indicates a short test was > interrupted and not a long). Thanks, I have not noticed the overlap at all. > > Second, your short offline test runs at 0300, but the errors you're > seeing are at 0454 in the morning. A short offline test does not > take 2 hours to run -- they take between 2-10 minutes -- unless the > system is also in the middle of doing a lot of I/O, in which case the > short test will be suspended. > > There are cronjobs (specifically periodic jobs) that run starting at > 0301 in the morning ("periodic daily"), and many of those are I/O bound. > This could possibly extend the length of the short test until 0454. > > Weekly periodic jobs run at 0415 in the morning, on Sundays. These also > perform a lot of disk I/O, so it's possible that on Sunday specifically > the short SMART test gets pushed back quite some time. > > Third, the DMA timeouts you're seeing are possibly caused by the drive > taking too long when internally suspending the SMART test. > > In most cases, it's safe for SMART tests (short and long) to be run > while the machine is operational, and disk I/O requests are being > performed. When an I/O request comes and the disk is in the middle of > performing a SMART test, the drive has to stop the SMART test (e.g. > "suspend" it), complete the I/O request, then resume the SMART test. > > The FreeBSD ATA layer has a 5 second timeout on I/O requests; if it > doesn't receive an acknowledgement back from the controller (disk) > within 5 seconds, it'll report a timeout on whatever operation it was > performing. I'm thinking the disk gets stuck in a "do the offline > test, no wait stop there's an I/O request, okay its done continue the > test, no way stop there's another I/O" loop. Can I make the timeout higher? For the sake of elimination. > > Another possibility is that your drive really *does* have a bad block at > LBA 836986454, and that one of those cron/periodic jobs is what's > noticing it, and that upon noticing a bad block, the drive more or less > aborts the SMART test to perform internal remapping of the block. > > To confirm this, you would need to boot the SeaTools utilities from DOS > or from a CD (see Seagate's site) and run a full sector scan (NOT the > "quick" test). This takes a few hours. Assuming it comes back clean, > then my above claim of the offline test taking too long to suspend is > probably the case. > > Possibly this is a firmware bug in the drive -- you might consider > mailing Seagate about this problem, although I'm doubting their Tier 1 > support will understand what the issue is. > > Is the block number always the same? Do you only see this error on > Sundays? These are two questions which might help narrow things down. Nope, the LBA is always different and I see it in the logs once every day. > >> This is on 7.1-PRERELEASE #0: Wed Oct 15 18:56:54 UTC 2008, with GENERIC >> kernel. >> >> Now, does the timeout cause loss of any data? Is there anything besides >> disabling the testing that I can do about it? > > Do you understand what short and long offline tests actually do and what > they're used for? :-) If so, you'd know that running them periodically > is more or less silly (IMHO). I do not, not completely :) I think I have just copied the settings from somewhere and only just tweaked it a bit whenever I have added a disk. > > If you're trying to accomplish a cheap version of disk scrubbing, e.g. > scanning the entire disk for bad blocks and report them or have them > automatically remapped by the drive, consider using sysutils/diskcheckd, > which was made for this purpose. However, be aware of a problem I've > run into with it (still needs someone clueful to figure out why this > happens): > http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/115853 > > I do not advocate the use of periodic offline tests on disks, especially > at such aggressive intervals (daily). In fact, I don't even know why > Bruce added that option to smartd. There are only a few attributes in > SMART which get updated on offline tests, so I cease to see the point. > > You shouldn't be doing what you're doing, IMHO. If you want to do > these tests once every 2 weeks or once a month, that'd be a better idea. > Stick with the short test, and do it during a time when disk I/O is > very low (try something like 7am on a Saturday). Don't go with 2am > if your system/environment honours Daylight Saving Time, because that > could cause the test to run twice. Ok, I am taking the advice and I have set longer intervals of checking. Thanks for such extensive answer. - -- VH -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iFYEAREIAAYFAkkF+LoACgkQhQBMvHf/WHmX3ADfTosXsJI0wAKl1MT7PCvBpmOm WnK9GavuuFsptwDgnjD0+tLGkZ2EEXjiXnvN/6wkz+wMWPCXYcHpGQ== =oDRL -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 17:51:40 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3896C10656C5; Mon, 27 Oct 2008 17:51:40 +0000 (UTC) (envelope-from kirk@strauser.com) Received: from kanga.honeypot.net (kanga.honeypot.net [IPv6:2001:470:a80a:1:21f:d0ff:fe22:b8a8]) by mx1.freebsd.org (Postfix) with ESMTP id EE7778FC23; Mon, 27 Oct 2008 17:51:39 +0000 (UTC) (envelope-from kirk@strauser.com) Received: from localhost (localhost [127.0.0.1]) by kanga.honeypot.net (Postfix) with ESMTP id 687EF944FC3; Mon, 27 Oct 2008 12:51:39 -0500 (CDT) X-Virus-Scanned: amavisd-new at honeypot.net Received: from kanga.honeypot.net ([127.0.0.1]) by localhost (kanga.honeypot.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Vmatr6hmKopJ; Mon, 27 Oct 2008 12:51:37 -0500 (CDT) Received: from athena.daycos.com (athena.daycos.com [IPv6:2001:470:c054:1:221:9bff:fe00:de3f]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by kanga.honeypot.net (Postfix) with ESMTPSA id 5D737944FCC; Mon, 27 Oct 2008 12:51:35 -0500 (CDT) From: Kirk Strauser To: freebsd-stable@freebsd.org, d@delphij.net Date: Mon, 27 Oct 2008 12:51:28 -0500 User-Agent: KMail/1.10.1 (FreeBSD/7.1-PRERELEASE; KDE/4.1.1; amd64; ; ) References: <520894aa0809301434h68b94628x54ec08fd48785feb@mail.gmail.com> <200810011134.49795.jhb@freebsd.org> <48EBDE69.1030609@delphij.net> In-Reply-To: <48EBDE69.1030609@delphij.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810271251.28411.kirk@strauser.com> Cc: Fernan Aguero , John Baldwin Subject: Re: [FreeBSD] Fix for ServerWorks HT1000 in upcoming 7.1? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 17:51:40 -0000 On Tuesday 07 October 2008 17:10:49 Xin LI wrote: > Did anyone who can trigger the data corruption has tried John's patch > and let us know if it worked? > > Cheers, I can confirm that it works on my PowerEdge SC1435. With both controllers running in SATA150 mode, I have an uptime of 101 days with moderately heavy load. -- Kirk Strauser From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 17:53:44 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 940F31065716 for ; Mon, 27 Oct 2008 17:53:44 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA04.westchester.pa.mail.comcast.net (qmta04.westchester.pa.mail.comcast.net [76.96.62.40]) by mx1.freebsd.org (Postfix) with ESMTP id 96BB88FC2C for ; Mon, 27 Oct 2008 17:53:40 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA08.westchester.pa.mail.comcast.net ([76.96.62.12]) by QMTA04.westchester.pa.mail.comcast.net with comcast id Xtoy1a0020Fqzac54ttfU0; Mon, 27 Oct 2008 17:53:39 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA08.westchester.pa.mail.comcast.net with comcast id Xtte1a0032P6wsM3UtteUD; Mon, 27 Oct 2008 17:53:39 +0000 X-Authority-Analysis: v=1.0 c=1 a=KeEtZEhZrkgA:10 a=ieuqav0nqiAA:10 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=PknYFqdLV36Eq15mbBQA:9 a=pb1hVOCmK-J8QI8qWiIA:7 a=mybmvhvxaGj3WbjjLMHoeHtfMT4A:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id E2408C9419; Mon, 27 Oct 2008 10:53:37 -0700 (PDT) Date: Mon, 27 Oct 2008 10:53:37 -0700 From: Jeremy Chadwick To: Vaclav Haisman Message-ID: <20081027175337.GA27175@icarus.home.lan> References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4905F8BB.3080302@sh.cvut.cz> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-stable@freebsd.org Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 17:53:45 -0000 On Mon, Oct 27, 2008 at 06:22:03PM +0100, Vaclav Haisman wrote: > Jeremy Chadwick wrote: > > On Mon, Oct 27, 2008 at 11:16:59AM +0100, Vaclav Haisman wrote: > > Second, your short offline test runs at 0300, but the errors you're > > seeing are at 0454 in the morning. A short offline test does not > > take 2 hours to run -- they take between 2-10 minutes -- unless the > > system is also in the middle of doing a lot of I/O, in which case the > > short test will be suspended. > > > > There are cronjobs (specifically periodic jobs) that run starting at > > 0301 in the morning ("periodic daily"), and many of those are I/O bound. > > This could possibly extend the length of the short test until 0454. > > > > Weekly periodic jobs run at 0415 in the morning, on Sundays. These also > > perform a lot of disk I/O, so it's possible that on Sunday specifically > > the short SMART test gets pushed back quite some time. > > > > Third, the DMA timeouts you're seeing are possibly caused by the drive > > taking too long when internally suspending the SMART test. > > > > In most cases, it's safe for SMART tests (short and long) to be run > > while the machine is operational, and disk I/O requests are being > > performed. When an I/O request comes and the disk is in the middle of > > performing a SMART test, the drive has to stop the SMART test (e.g. > > "suspend" it), complete the I/O request, then resume the SMART test. > > > > The FreeBSD ATA layer has a 5 second timeout on I/O requests; if it > > doesn't receive an acknowledgement back from the controller (disk) > > within 5 seconds, it'll report a timeout on whatever operation it was > > performing. I'm thinking the disk gets stuck in a "do the offline > > test, no wait stop there's an I/O request, okay its done continue the > > test, no way stop there's another I/O" loop. > Can I make the timeout higher? For the sake of elimination. You will have to make modifications to the ata(4) driver code, and rebuild+reinstall your kernel. There is a patch from the FreeNAS folks which turns the command timeout value into a sysctl for tuning, but that patch has not been brought into FreeBSD (any version) at this time. You can find it referenced below (see one of the "Workarounds" sections). You will probably have to apply the patch "by hand" rather than blindly using patch < patchfile, because the ATA code has changed since the patch was created. http://wiki.freebsd.org/JeremyChadwick/ATA_issues_and_troubleshooting > > Another possibility is that your drive really *does* have a bad block at > > LBA 836986454, and that one of those cron/periodic jobs is what's > > noticing it, and that upon noticing a bad block, the drive more or less > > aborts the SMART test to perform internal remapping of the block. > > > > To confirm this, you would need to boot the SeaTools utilities from DOS > > or from a CD (see Seagate's site) and run a full sector scan (NOT the > > "quick" test). This takes a few hours. Assuming it comes back clean, > > then my above claim of the offline test taking too long to suspend is > > probably the case. > > > > Possibly this is a firmware bug in the drive -- you might consider > > mailing Seagate about this problem, although I'm doubting their Tier 1 > > support will understand what the issue is. > > > > Is the block number always the same? Do you only see this error on > > Sundays? These are two questions which might help narrow things down. > Nope, the LBA is always different and I see it in the logs once every day. Okay, so that greatly diminishes the possibility of it being a bad block. I'd still advocate running SeaTools on the disk to ensure everything is 100% okay (re: "sake of elimination"); chances are it will pass with flying colours. > >> This is on 7.1-PRERELEASE #0: Wed Oct 15 18:56:54 UTC 2008, with GENERIC > >> kernel. > >> > >> Now, does the timeout cause loss of any data? Is there anything besides > >> disabling the testing that I can do about it? > > > > Do you understand what short and long offline tests actually do and what > > they're used for? :-) If so, you'd know that running them periodically > > is more or less silly (IMHO). > I do not, not completely :) I think I have just copied the settings from > somewhere and only just tweaked it a bit whenever I have added a disk. Let me know if you figure out who or what online resource solicited adding daily short/long tests, as I'd like to talk to them about their decision. I have a feeling whoever thought it up felt that the tests were performing entire sector scans of the entire disk, which is simply not the case. > > If you're trying to accomplish a cheap version of disk scrubbing, e.g. > > scanning the entire disk for bad blocks and report them or have them > > automatically remapped by the drive, consider using sysutils/diskcheckd, > > which was made for this purpose. However, be aware of a problem I've > > run into with it (still needs someone clueful to figure out why this > > happens): > > http://www.freebsd.org/cgi/query-pr.cgi?pr=ports/115853 > > > > I do not advocate the use of periodic offline tests on disks, especially > > at such aggressive intervals (daily). In fact, I don't even know why > > Bruce added that option to smartd. There are only a few attributes in > > SMART which get updated on offline tests, so I cease to see the point. > > > > You shouldn't be doing what you're doing, IMHO. If you want to do > > these tests once every 2 weeks or once a month, that'd be a better idea. > > Stick with the short test, and do it during a time when disk I/O is > > very low (try something like 7am on a Saturday). Don't go with 2am > > if your system/environment honours Daylight Saving Time, because that > > could cause the test to run twice. > Ok, I am taking the advice and I have set longer intervals of checking. > > Thanks for such extensive answer. You're welcome! Let's see if we can figure out what the root cause of this is; so far, my money is on the SMART tests taking too long to suspend/resume when an I/O operation interrupts them. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 18:26:15 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6740E1065673 for ; Mon, 27 Oct 2008 18:26:15 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id E28788FC0A for ; Mon, 27 Oct 2008 18:26:14 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KuWn7-0002BW-2B for freebsd-stable@freebsd.org; Mon, 27 Oct 2008 18:26:13 +0000 Received: from 200.41.broadband11.iol.cz ([90.178.41.200]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 27 Oct 2008 18:26:13 +0000 Received: from gamato by 200.41.broadband11.iol.cz with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 27 Oct 2008 18:26:13 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: martinko Date: Mon, 27 Oct 2008 19:26:03 +0100 Lines: 57 Message-ID: References: <200810271558.m9RFwpnv019593@lurza.secnetix.de> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 200.41.broadband11.iol.cz User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.17) Gecko/20081009 SeaMonkey/1.1.12 In-Reply-To: <200810271558.m9RFwpnv019593@lurza.secnetix.de> Sender: news Subject: Re: easy way to upgrade from 6.3 to 7.1 (including port packages) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 18:26:15 -0000 Oliver Fromme wrote: > martinko wrote: > > Oliver Fromme wrote: > > > martinko wrote: > > > > 1) I wonder if I could use mergemaster to compare 2 directories and > > > > merge differencies as neccessary. To explain: I have all config files I > > > > touch saved with full path somewhere in /root. And therefore I'd like > > > > mergemaster or some other tool to compare all files in my backup > > > > directory with newly installed (config) files. > > > > > > You can use mergemaster against any directory, not just > > > /etc. This is especially useful when perforing a binary > > > update, a cross update or similar things. > > > > > > > No, you cannot. > > Yes, You can. I've done it several times. And I'm sure > I'm not hallucinating. :-) > > > I have all config files I edited saved with full path under my backup > > directory and I would like to use mergemaster or something similar to > > compare and merge my changes (perhaps from other machine). But if you > > try to use mergemaster (you need to specify both -m and -D) > > You only need -m if you have installed the source somewhere > else than /usr/src. > > > it would try > > to run make (1) which fails since there is no Makefile in my backup dir. :-( > > You have to it runs make(1) in /usr/src/etc (unless you > override the path with -m) which contains a Makefile. > If it doesn't, you haven't installed the system sources > correctly. > >>From your description it sounds as if you used -m to > point to your modified etc files. That's wrong. Please > follow the instructions that I explained in my previous > mail message. It works. As I said, I've done it plenty > of times. > > Best regards > Oliver > OK, it's obvious now that I didn't make myself clear enough. Sorry. :-) I'd like a more general purpose utility, be it mergemaster or sth else. I like the way mergemaster works but I'd like to use it not only for /etc (after make) -- I'd like to point it to my backup directory which doesn't contain all of /etc and compare the files it finds with those in /etc. Or point it to arbitrary 2 directories and compare their files. Cheers, Martin From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 18:52:21 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 419111065671 for ; Mon, 27 Oct 2008 18:52:21 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id EB5BC8FC1E for ; Mon, 27 Oct 2008 18:52:20 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KuXCG-0003ZH-UP for freebsd-stable@freebsd.org; Mon, 27 Oct 2008 18:52:13 +0000 Received: from 200.41.broadband11.iol.cz ([90.178.41.200]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 27 Oct 2008 18:52:12 +0000 Received: from gamato by 200.41.broadband11.iol.cz with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 27 Oct 2008 18:52:12 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: martinko Date: Mon, 27 Oct 2008 19:52:01 +0100 Lines: 32 Message-ID: References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 200.41.broadband11.iol.cz User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.17) Gecko/20081009 SeaMonkey/1.1.12 In-Reply-To: <20081027175337.GA27175@icarus.home.lan> Sender: news Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 18:52:21 -0000 Jeremy Chadwick wrote: >>>> >>>> Now, does the timeout cause loss of any data? Is there anything besides >>>> disabling the testing that I can do about it? >>> Do you understand what short and long offline tests actually do and what >>> they're used for? :-) If so, you'd know that running them periodically >>> is more or less silly (IMHO). >> I do not, not completely :) I think I have just copied the settings from >> somewhere and only just tweaked it a bit whenever I have added a disk. > > Let me know if you figure out who or what online resource solicited > adding daily short/long tests, as I'd like to talk to them about their > decision. I have a feeling whoever thought it up felt that the tests > were performing entire sector scans of the entire disk, which is simply > not the case. > Hallo, Reading this thread I checked my config to find this: ;-) #/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ 2006-11-03 mato /dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ 2006-11-03 mato I believe I came up with the settings after reading manual page / documentation of the tool. Regards, Martin From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 19:10:33 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 35D5C106567A for ; Mon, 27 Oct 2008 19:10:33 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA08.westchester.pa.mail.comcast.net (qmta08.westchester.pa.mail.comcast.net [76.96.62.80]) by mx1.freebsd.org (Postfix) with ESMTP id C8EF38FC14 for ; Mon, 27 Oct 2008 19:10:32 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA03.westchester.pa.mail.comcast.net ([76.96.62.27]) by QMTA08.westchester.pa.mail.comcast.net with comcast id Xurb1a0160bG4ec58vABRM; Mon, 27 Oct 2008 19:10:13 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA03.westchester.pa.mail.comcast.net with comcast id XvAU1a00L2P6wsM3PvAVRn; Mon, 27 Oct 2008 19:10:29 +0000 X-Authority-Analysis: v=1.0 c=1 a=KeEtZEhZrkgA:10 a=ieuqav0nqiAA:10 a=QycZ5dHgAAAA:8 a=kcbmCjinaA4WLZLc50YA:9 a=sNbbPtsaESYYmWGSmi_yK2Ce7K8A:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 781BFC9419; Mon, 27 Oct 2008 12:10:28 -0700 (PDT) Date: Mon, 27 Oct 2008 12:10:28 -0700 From: Jeremy Chadwick To: martinko Message-ID: <20081027191028.GA28688@icarus.home.lan> References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-stable@freebsd.org Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 19:10:33 -0000 On Mon, Oct 27, 2008 at 07:52:01PM +0100, martinko wrote: > Jeremy Chadwick wrote: >>>>> >>>>> Now, does the timeout cause loss of any data? Is there anything besides >>>>> disabling the testing that I can do about it? >>>> Do you understand what short and long offline tests actually do and what >>>> they're used for? :-) If so, you'd know that running them periodically >>>> is more or less silly (IMHO). >>> I do not, not completely :) I think I have just copied the settings from >>> somewhere and only just tweaked it a bit whenever I have added a disk. >> >> Let me know if you figure out who or what online resource solicited >> adding daily short/long tests, as I'd like to talk to them about their >> decision. I have a feeling whoever thought it up felt that the tests >> were performing entire sector scans of the entire disk, which is simply >> not the case. >> > > Hallo, > > Reading this thread I checked my config to find this: ;-) > > #/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) -m > root # ++ 2006-11-03 mato > /dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ > 2006-11-03 mato > > I believe I came up with the settings after reading manual page / > documentation of the tool. Can you explain why you're doing this? So far no one's provided a reason *why* they're doing short and long offline scans on a daily basis. I'm under the impression the conclusion was reached like this: "man smartd.conf ... oh, -s, a neat thing, let's enable it". There are negative repercussions to doing tests of this nature at such regular intervals. Once-a-week is borderline acceptable; once a month would be quite reasonable. I'd love to know what kind of affect daily tests have on MTBF; I can imagine it's reached much sooner with this. The main point of smartd is to monitor SMART attribute changes. If you're concerned about the health of your hard disk, you should be looking at your logs and not relying on things like automatic short/long tests. Most SMART attributes are updated immediately and not during an offline test, and all of those attribute changes will be logged. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 19:38:51 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 974DC1065675; Mon, 27 Oct 2008 19:38:51 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [91.103.162.4]) by mx1.freebsd.org (Postfix) with ESMTP id 125F08FC1B; Mon, 27 Oct 2008 19:38:51 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id AD18C19E027; Mon, 27 Oct 2008 20:38:49 +0100 (CET) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id D801619E023; Mon, 27 Oct 2008 20:38:45 +0100 (CET) Message-ID: <490618E7.8000905@quip.cz> Date: Mon, 27 Oct 2008 20:39:19 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: Jeremy Chadwick References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> In-Reply-To: <20081027175337.GA27175@icarus.home.lan> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: Vaclav Haisman , freebsd-stable@freebsd.org Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 19:38:51 -0000 Jeremy Chadwick wrote: > On Mon, Oct 27, 2008 at 06:22:03PM +0100, Vaclav Haisman wrote: > >>Jeremy Chadwick wrote: >> >>>On Mon, Oct 27, 2008 at 11:16:59AM +0100, Vaclav Haisman wrote: >>>Second, your short offline test runs at 0300, but the errors you're >>>seeing are at 0454 in the morning. A short offline test does not >>>take 2 hours to run -- they take between 2-10 minutes -- unless the >>>system is also in the middle of doing a lot of I/O, in which case the >>>short test will be suspended. >>> >>>There are cronjobs (specifically periodic jobs) that run starting at >>>0301 in the morning ("periodic daily"), and many of those are I/O bound. >>>This could possibly extend the length of the short test until 0454. >>> >>>Weekly periodic jobs run at 0415 in the morning, on Sundays. These also >>>perform a lot of disk I/O, so it's possible that on Sunday specifically >>>the short SMART test gets pushed back quite some time. >>> >>>Third, the DMA timeouts you're seeing are possibly caused by the drive >>>taking too long when internally suspending the SMART test. >>> >>>In most cases, it's safe for SMART tests (short and long) to be run >>>while the machine is operational, and disk I/O requests are being >>>performed. When an I/O request comes and the disk is in the middle of >>>performing a SMART test, the drive has to stop the SMART test (e.g. >>>"suspend" it), complete the I/O request, then resume the SMART test. >>> >>>The FreeBSD ATA layer has a 5 second timeout on I/O requests; if it >>>doesn't receive an acknowledgement back from the controller (disk) >>>within 5 seconds, it'll report a timeout on whatever operation it was >>>performing. I'm thinking the disk gets stuck in a "do the offline >>>test, no wait stop there's an I/O request, okay its done continue the >>>test, no way stop there's another I/O" loop. >> >>Can I make the timeout higher? For the sake of elimination. > > > You will have to make modifications to the ata(4) driver code, and > rebuild+reinstall your kernel. > > There is a patch from the FreeNAS folks which turns the command timeout > value into a sysctl for tuning, but that patch has not been brought into > FreeBSD (any version) at this time. You can find it referenced below > (see one of the "Workarounds" sections). You will probably have to > apply the patch "by hand" rather than blindly using patch < patchfile, > because the ATA code has changed since the patch was created. > > http://wiki.freebsd.org/JeremyChadwick/ATA_issues_and_troubleshooting > > >>>Another possibility is that your drive really *does* have a bad block at >>>LBA 836986454, and that one of those cron/periodic jobs is what's >>>noticing it, and that upon noticing a bad block, the drive more or less >>>aborts the SMART test to perform internal remapping of the block. >>> >>>To confirm this, you would need to boot the SeaTools utilities from DOS >>>or from a CD (see Seagate's site) and run a full sector scan (NOT the >>>"quick" test). This takes a few hours. Assuming it comes back clean, >>>then my above claim of the offline test taking too long to suspend is >>>probably the case. >>> >>>Possibly this is a firmware bug in the drive -- you might consider >>>mailing Seagate about this problem, although I'm doubting their Tier 1 >>>support will understand what the issue is. >>> >>>Is the block number always the same? Do you only see this error on >>>Sundays? These are two questions which might help narrow things down. >> >>Nope, the LBA is always different and I see it in the logs once every day. > > > Okay, so that greatly diminishes the possibility of it being a bad > block. I'd still advocate running SeaTools on the disk to ensure > everything is 100% okay (re: "sake of elimination"); chances are it will > pass with flying colours. > > >>>>This is on 7.1-PRERELEASE #0: Wed Oct 15 18:56:54 UTC 2008, with GENERIC >>>>kernel. >>>> >>>>Now, does the timeout cause loss of any data? Is there anything besides >>>>disabling the testing that I can do about it? >>> >>>Do you understand what short and long offline tests actually do and what >>>they're used for? :-) If so, you'd know that running them periodically >>>is more or less silly (IMHO). >> >>I do not, not completely :) I think I have just copied the settings from >>somewhere and only just tweaked it a bit whenever I have added a disk. > > > Let me know if you figure out who or what online resource solicited > adding daily short/long tests, as I'd like to talk to them about their > decision. I have a feeling whoever thought it up felt that the tests > were performing entire sector scans of the entire disk, which is simply > not the case. It seems like a little modified example from smartd.conf.sample # First (primary) ATA/IDE hard disk. Monitor all attributes, enable # automatic online data collection, automatic Attribute autosave, and # start a short self-test every day between 2-3am, and a long self test # Saturdays between 3-4am. #/dev/hda -a -o on -S on -s (S/../.././02|L/../../6/03) I am using similar config without problem: /dev/ad4 -a -o on -S on -m root -M test -M diminishing -s (S/../.././01|L/../../(3|6)/05) -t -I 194 /dev/ad6 -a -o on -S on -m root -M test -M diminishing -s (S/../.././01|L/../../(3|6)/04) -t -I 194 Miroslav Lachman From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 19:44:25 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E4E3B1065670 for ; Mon, 27 Oct 2008 19:44:25 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 5C8C88FC1E for ; Mon, 27 Oct 2008 19:44:25 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9RJiMre031778; Mon, 27 Oct 2008 20:44:23 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9RJiMmo031777; Mon, 27 Oct 2008 20:44:22 +0100 (CET) (envelope-from olli) Date: Mon, 27 Oct 2008 20:44:22 +0100 (CET) Message-Id: <200810271944.m9RJiMmo031777@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG In-Reply-To: X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Mon, 27 Oct 2008 20:44:24 +0100 (CET) Cc: Subject: Re: easy way to upgrade from 6.3 to 7.1 (including port packages) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-stable@FreeBSD.ORG, gamato@users.sf.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 19:44:26 -0000 martinko wrote: > Oliver Fromme wrote: > I'd like a more general purpose utility, be it mergemaster or sth else. > I like the way mergemaster works but I'd like to use it not only for > /etc (after make) -- I'd like to point it to my backup directory which > doesn't contain all of /etc and compare the files it finds with those in > /etc. That can be done like this, assuming /root/etcbak is your backup directory, and also assuming that /usr/src is of the same date as /etc (if not, use cvsup or csup to bring it to the same date). # mkdir -p /tmp/newroot # find /etc /root/etcbak | cpio -dump /tmp/newroot # cd /root/etcbak # mergemaster -D /tmp/newroot The result of the merge will be in /tmp/newroot/etc. > Or point it to arbitrary 2 directories and compare their files. You can compare arbitrary directories with diff -r. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "Perl will consistently give you what you want, unless what you want is consistency." -- Larry Wall From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 19:50:53 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9ED1A1065673 for ; Mon, 27 Oct 2008 19:50:53 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 255D78FC1B for ; Mon, 27 Oct 2008 19:50:52 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KuY71-0005uE-PH for freebsd-stable@freebsd.org; Mon, 27 Oct 2008 19:50:51 +0000 Received: from 200.41.broadband11.iol.cz ([90.178.41.200]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 27 Oct 2008 19:50:51 +0000 Received: from gamato by 200.41.broadband11.iol.cz with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 27 Oct 2008 19:50:51 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: martinko Date: Mon, 27 Oct 2008 20:50:44 +0100 Lines: 55 Message-ID: References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> <20081027191028.GA28688@icarus.home.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 200.41.broadband11.iol.cz User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.17) Gecko/20081009 SeaMonkey/1.1.12 In-Reply-To: <20081027191028.GA28688@icarus.home.lan> Sender: news Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 19:50:53 -0000 Jeremy Chadwick wrote: > On Mon, Oct 27, 2008 at 07:52:01PM +0100, martinko wrote: >> Jeremy Chadwick wrote: >>>>>> Now, does the timeout cause loss of any data? Is there anything besides >>>>>> disabling the testing that I can do about it? >>>>> Do you understand what short and long offline tests actually do and what >>>>> they're used for? :-) If so, you'd know that running them periodically >>>>> is more or less silly (IMHO). >>>> I do not, not completely :) I think I have just copied the settings from >>>> somewhere and only just tweaked it a bit whenever I have added a disk. >>> Let me know if you figure out who or what online resource solicited >>> adding daily short/long tests, as I'd like to talk to them about their >>> decision. I have a feeling whoever thought it up felt that the tests >>> were performing entire sector scans of the entire disk, which is simply >>> not the case. >>> >> Hallo, >> >> Reading this thread I checked my config to find this: ;-) >> >> #/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) -m >> root # ++ 2006-11-03 mato >> /dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ >> 2006-11-03 mato >> >> I believe I came up with the settings after reading manual page / >> documentation of the tool. > > Can you explain why you're doing this? So far no one's provided a > reason *why* they're doing short and long offline scans on a daily > basis. I'm under the impression the conclusion was reached like this: > "man smartd.conf ... oh, -s, a neat thing, let's enable it". > > There are negative repercussions to doing tests of this nature at such > regular intervals. Once-a-week is borderline acceptable; once a month > would be quite reasonable. I'd love to know what kind of affect daily > tests have on MTBF; I can imagine it's reached much sooner with this. > > The main point of smartd is to monitor SMART attribute changes. If > you're concerned about the health of your hard disk, you should be > looking at your logs and not relying on things like automatic short/long > tests. Most SMART attributes are updated immediately and not during an > offline test, and all of those attribute changes will be logged. > You asked Miroslav about source of his configuration. And as it is very similar to mine I think we both have it from smartd documentation. Where else to look for information? It's a usual source. So if you think it's wrong please contact the authors, we're obviously just users. Thanks. M. PS: Btw, long offline scan is scheduled on weekly basis, not daily. If it's good or not I do not know. From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 19:55:04 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 783061065672 for ; Mon, 27 Oct 2008 19:55:04 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 1A3B58FC17 for ; Mon, 27 Oct 2008 19:55:04 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from root by ciao.gmane.org with local (Exim 4.43) id 1KuYB4-00064t-NF for freebsd-stable@freebsd.org; Mon, 27 Oct 2008 19:55:02 +0000 Received: from 200.41.broadband11.iol.cz ([90.178.41.200]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 27 Oct 2008 19:55:02 +0000 Received: from gamato by 200.41.broadband11.iol.cz with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 27 Oct 2008 19:55:02 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: martinko Date: Mon, 27 Oct 2008 20:53:24 +0100 Lines: 64 Message-ID: References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> <20081027191028.GA28688@icarus.home.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 200.41.broadband11.iol.cz User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.17) Gecko/20081009 SeaMonkey/1.1.12 In-Reply-To: Sender: news Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 19:55:04 -0000 martinko wrote: > Jeremy Chadwick wrote: >> On Mon, Oct 27, 2008 at 07:52:01PM +0100, martinko wrote: >>> Jeremy Chadwick wrote: >>>>>>> Now, does the timeout cause loss of any data? Is there anything >>>>>>> besides >>>>>>> disabling the testing that I can do about it? >>>>>> Do you understand what short and long offline tests actually do >>>>>> and what >>>>>> they're used for? :-) If so, you'd know that running them >>>>>> periodically >>>>>> is more or less silly (IMHO). >>>>> I do not, not completely :) I think I have just copied the settings >>>>> from >>>>> somewhere and only just tweaked it a bit whenever I have added a disk. >>>> Let me know if you figure out who or what online resource solicited >>>> adding daily short/long tests, as I'd like to talk to them about their >>>> decision. I have a feeling whoever thought it up felt that the tests >>>> were performing entire sector scans of the entire disk, which is simply >>>> not the case. >>>> >>> Hallo, >>> >>> Reading this thread I checked my config to find this: ;-) >>> >>> #/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) >>> -m root # ++ 2006-11-03 mato >>> /dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ >>> 2006-11-03 mato >>> >>> I believe I came up with the settings after reading manual page / >>> documentation of the tool. >> >> Can you explain why you're doing this? So far no one's provided a >> reason *why* they're doing short and long offline scans on a daily >> basis. I'm under the impression the conclusion was reached like this: >> "man smartd.conf ... oh, -s, a neat thing, let's enable it". >> >> There are negative repercussions to doing tests of this nature at such >> regular intervals. Once-a-week is borderline acceptable; once a month >> would be quite reasonable. I'd love to know what kind of affect daily >> tests have on MTBF; I can imagine it's reached much sooner with this. >> >> The main point of smartd is to monitor SMART attribute changes. If >> you're concerned about the health of your hard disk, you should be >> looking at your logs and not relying on things like automatic short/long >> tests. Most SMART attributes are updated immediately and not during an >> offline test, and all of those attribute changes will be logged. >> > > You asked Miroslav about source of his configuration. And as it is very ^^^^^^^^ I meant Vaclav, of course, Miroslav's email just arrived. :) > similar to mine I think we both have it from smartd documentation. Where > else to look for information? It's a usual source. So if you think > it's wrong please contact the authors, we're obviously just users. > Thanks. > > M. > > PS: Btw, long offline scan is scheduled on weekly basis, not daily. If > it's good or not I do not know. > From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 19:59:58 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E56C51065670 for ; Mon, 27 Oct 2008 19:59:57 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA08.westchester.pa.mail.comcast.net (qmta08.westchester.pa.mail.comcast.net [76.96.62.80]) by mx1.freebsd.org (Postfix) with ESMTP id A2C2B8FC1B for ; Mon, 27 Oct 2008 19:59:54 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA13.westchester.pa.mail.comcast.net ([76.96.62.52]) by QMTA08.westchester.pa.mail.comcast.net with comcast id XolC1a01817dt5G58vzbfc; Mon, 27 Oct 2008 19:59:35 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA13.westchester.pa.mail.comcast.net with comcast id Xvzp1a00X2P6wsM3Zvzq66; Mon, 27 Oct 2008 19:59:51 +0000 X-Authority-Analysis: v=1.0 c=1 a=KeEtZEhZrkgA:10 a=ieuqav0nqiAA:10 a=QycZ5dHgAAAA:8 a=OUC38-waEQlcmPEpmqoA:9 a=eggzLWZxbyKMnXP2evGBIzAO8A0A:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id B32CDC9419; Mon, 27 Oct 2008 12:59:49 -0700 (PDT) Date: Mon, 27 Oct 2008 12:59:49 -0700 From: Jeremy Chadwick To: martinko Message-ID: <20081027195949.GA29641@icarus.home.lan> References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> <20081027191028.GA28688@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-stable@freebsd.org Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 19:59:58 -0000 On Mon, Oct 27, 2008 at 08:50:44PM +0100, martinko wrote: > Jeremy Chadwick wrote: >> On Mon, Oct 27, 2008 at 07:52:01PM +0100, martinko wrote: >>> Jeremy Chadwick wrote: >>>>>>> Now, does the timeout cause loss of any data? Is there anything besides >>>>>>> disabling the testing that I can do about it? >>>>>> Do you understand what short and long offline tests actually do and what >>>>>> they're used for? :-) If so, you'd know that running them periodically >>>>>> is more or less silly (IMHO). >>>>> I do not, not completely :) I think I have just copied the settings from >>>>> somewhere and only just tweaked it a bit whenever I have added a disk. >>>> Let me know if you figure out who or what online resource solicited >>>> adding daily short/long tests, as I'd like to talk to them about their >>>> decision. I have a feeling whoever thought it up felt that the tests >>>> were performing entire sector scans of the entire disk, which is simply >>>> not the case. >>>> >>> Hallo, >>> >>> Reading this thread I checked my config to find this: ;-) >>> >>> #/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) >>> -m root # ++ 2006-11-03 mato >>> /dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ >>> 2006-11-03 mato >>> >>> I believe I came up with the settings after reading manual page / >>> documentation of the tool. >> >> Can you explain why you're doing this? So far no one's provided a >> reason *why* they're doing short and long offline scans on a daily >> basis. I'm under the impression the conclusion was reached like this: >> "man smartd.conf ... oh, -s, a neat thing, let's enable it". >> >> There are negative repercussions to doing tests of this nature at such >> regular intervals. Once-a-week is borderline acceptable; once a month >> would be quite reasonable. I'd love to know what kind of affect daily >> tests have on MTBF; I can imagine it's reached much sooner with this. >> >> The main point of smartd is to monitor SMART attribute changes. If >> you're concerned about the health of your hard disk, you should be >> looking at your logs and not relying on things like automatic short/long >> tests. Most SMART attributes are updated immediately and not during an >> offline test, and all of those attribute changes will be logged. >> > > You asked Miroslav about source of his configuration. And as it is very > similar to mine I think we both have it from smartd documentation. Where > else to look for information? It's a usual source. So if you think it's > wrong please contact the authors, we're obviously just users. > Thanks. I'm not asking *where* you got the information from (we know where you and others got it from: the documentation). I'm asking you *why* you enabled what you did, because this is not something smartd.conf enables by default (the example is commented out). If you *really* want me to talk to Bruce about this, I can/will, but I'm left with the impression that the example in smartd.conf is there to show people the syntactical usage of -o, and not to advocate its usage. > PS: Btw, long offline scan is scheduled on weekly basis, not daily. If > it's good or not I do not know. The OP's long scan is also scheduled on a weekly basis (every Sunday), but his short scan trumps it. Folks, the point I'm trying to make here is that daily -- and even weekly -- SMART offline tests are unnecessary. If you're that concerned about your disk health, you should be looking at your syslog logs for attribute changes that indicate drive issues. Performing SMART offline tests at regular intervals like this does very little other than increase wear/tear on drive components (not necessarily the physical platters/heads; there are many pieces to a hard disk. :-) ) -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 20:14:11 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B9979106566B for ; Mon, 27 Oct 2008 20:14:11 +0000 (UTC) (envelope-from torfinn.ingolfsen@broadpark.no) Received: from osl1smout1.broadpark.no (osl1smout1.broadpark.no [80.202.4.58]) by mx1.freebsd.org (Postfix) with ESMTP id 76ADA8FC08 for ; Mon, 27 Oct 2008 20:14:11 +0000 (UTC) (envelope-from torfinn.ingolfsen@broadpark.no) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII Received: from osl1sminn1.broadpark.no ([80.202.4.59]) by osl1smout1.broadpark.no (Sun Java(tm) System Messaging Server 6.3-3.01 (built Jul 12 2007; 32bit)) with ESMTP id <0K9E00FZMYVFPT30@osl1smout1.broadpark.no> for freebsd-stable@freebsd.org; Mon, 27 Oct 2008 21:14:03 +0100 (CET) Received: from kg-work2.kg4.no ([80.202.72.201]) by osl1sminn1.broadpark.no (Sun Java(tm) System Messaging Server 6.3-3.01 (built Jul 12 2007; 32bit)) with SMTP id <0K9E0090JYVFYX21@osl1sminn1.broadpark.no> for freebsd-stable@freebsd.org; Mon, 27 Oct 2008 21:14:03 +0100 (CET) Date: Mon, 27 Oct 2008 21:14:03 +0100 From: Torfinn Ingolfsen To: freebsd-stable@freebsd.org Message-id: <20081027211403.a65c9d38.torfinn.ingolfsen@broadpark.no> In-reply-to: References: <200810271558.m9RFwpnv019593@lurza.secnetix.de> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; i386-portbld-freebsd7.0) X-Face: "t9w2,-X@O^I`jVW\sonI3.,36KBLZE*AL[y9lL[PyFD*r_S:dIL9c[8Y>V42R0"!"yb_zN,f#%.[PYYNq; m"_0v; ~rUM2Yy!zmkh)3&U|u!=T(zyv,MHJv"nDH>OJ`t(@mil461d_B'Uo|'nMwlKe0Mv=kvV?Nh@>Hb<3s_z2jYgZhPb@?Wi^x1a~Hplz1.zH Subject: Re: easy way to upgrade from 6.3 to 7.1 (including port packages) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 20:14:11 -0000 On Mon, 27 Oct 2008 19:26:03 +0100 martinko wrote: > I'd like a more general purpose utility, be it mergemaster or sth > else. I like the way mergemaster works but I'd like to use it not > only for /etc (after make) -- I'd like to point it to my backup > directory which doesn't contain all of /etc and compare the files it > finds with those in /etc. Or point it to arbitrary 2 directories and > compare their files. This is getting a bit OT, but kind of like dirdiff[1]? References: 1) http://www.freshports.org/sysutils/dirdiff/ -- Regards, Torfinn Ingolfsen From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 20:44:49 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 818BB1065673; Mon, 27 Oct 2008 20:44:49 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [91.103.162.4]) by mx1.freebsd.org (Postfix) with ESMTP id F3EFF8FC12; Mon, 27 Oct 2008 20:44:48 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id B699919E027; Mon, 27 Oct 2008 21:44:47 +0100 (CET) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 2311F19E023; Mon, 27 Oct 2008 21:44:44 +0100 (CET) Message-ID: <4906285D.40304@quip.cz> Date: Mon, 27 Oct 2008 21:45:17 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: Jeremy Chadwick References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> <20081027191028.GA28688@icarus.home.lan> <20081027195949.GA29641@icarus.home.lan> In-Reply-To: <20081027195949.GA29641@icarus.home.lan> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org, martinko Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 20:44:49 -0000 Jeremy Chadwick wrote: > On Mon, Oct 27, 2008 at 08:50:44PM +0100, martinko wrote: > >>Jeremy Chadwick wrote: >> >>>On Mon, Oct 27, 2008 at 07:52:01PM +0100, martinko wrote: >>> >>>>Jeremy Chadwick wrote: >>>> >>>>>>>>Now, does the timeout cause loss of any data? Is there anything besides >>>>>>>>disabling the testing that I can do about it? >>>>>>> >>>>>>>Do you understand what short and long offline tests actually do and what >>>>>>>they're used for? :-) If so, you'd know that running them periodically >>>>>>>is more or less silly (IMHO). >>>>>> >>>>>>I do not, not completely :) I think I have just copied the settings from >>>>>>somewhere and only just tweaked it a bit whenever I have added a disk. >>>>> >>>>>Let me know if you figure out who or what online resource solicited >>>>>adding daily short/long tests, as I'd like to talk to them about their >>>>>decision. I have a feeling whoever thought it up felt that the tests >>>>>were performing entire sector scans of the entire disk, which is simply >>>>>not the case. >>>>> >>>> >>>>Hallo, >>>> >>>>Reading this thread I checked my config to find this: ;-) >>>> >>>>#/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) >>>>-m root # ++ 2006-11-03 mato >>>>/dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ >>>>2006-11-03 mato >>>> >>>>I believe I came up with the settings after reading manual page / >>>>documentation of the tool. >>> >>>Can you explain why you're doing this? So far no one's provided a >>>reason *why* they're doing short and long offline scans on a daily >>>basis. I'm under the impression the conclusion was reached like this: >>>"man smartd.conf ... oh, -s, a neat thing, let's enable it". >>> >>>There are negative repercussions to doing tests of this nature at such >>>regular intervals. Once-a-week is borderline acceptable; once a month >>>would be quite reasonable. I'd love to know what kind of affect daily >>>tests have on MTBF; I can imagine it's reached much sooner with this. >>> >>>The main point of smartd is to monitor SMART attribute changes. If >>>you're concerned about the health of your hard disk, you should be >>>looking at your logs and not relying on things like automatic short/long >>>tests. Most SMART attributes are updated immediately and not during an >>>offline test, and all of those attribute changes will be logged. >>> >> >>You asked Miroslav about source of his configuration. And as it is very >>similar to mine I think we both have it from smartd documentation. Where >>else to look for information? It's a usual source. So if you think it's >>wrong please contact the authors, we're obviously just users. >>Thanks. > > > I'm not asking *where* you got the information from (we know where you > and others got it from: the documentation). I'm asking you *why* you > enabled what you did, because this is not something smartd.conf enables > by default (the example is commented out). > > If you *really* want me to talk to Bruce about this, I can/will, but I'm > left with the impression that the example in smartd.conf is there to > show people the syntactical usage of -o, and not to advocate its usage. > > >>PS: Btw, long offline scan is scheduled on weekly basis, not daily. If >>it's good or not I do not know. > > > The OP's long scan is also scheduled on a weekly basis (every Sunday), > but his short scan trumps it. > > Folks, the point I'm trying to make here is that daily -- and even > weekly -- SMART offline tests are unnecessary. If you're that concerned > about your disk health, you should be looking at your syslog logs for > attribute changes that indicate drive issues. Performing SMART offline > tests at regular intervals like this does very little other than > increase wear/tear on drive components (not necessarily the physical > platters/heads; there are many pieces to a hard disk. :-) ) It is more than three years ago when I started to use smartd and I did not change my configs from that time, just copy it to all the new servers, so I can't tell why I had feeling that daily short and weekly long test is "the right way". Do you have some link to brief overview, where we can read something about "the best practices" with smartd? Or may I just change the config to do short test once a week and long test once a month? Miroslav Lachman PS: all examples in smartd.conf.sample are commented out (DEVICESCAN is the default), but almost all of the examples have weekly long test, this may lead to our conclusion "weekly long test is good" From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 21:23:13 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3FC901065681 for ; Mon, 27 Oct 2008 21:23:13 +0000 (UTC) (envelope-from gaijin.k@gmail.com) Received: from qw-out-2122.google.com (qw-out-2122.google.com [74.125.92.27]) by mx1.freebsd.org (Postfix) with ESMTP id E86AB8FC12 for ; Mon, 27 Oct 2008 21:23:12 +0000 (UTC) (envelope-from gaijin.k@gmail.com) Received: by qw-out-2122.google.com with SMTP id 9so1053378qwb.7 for ; Mon, 27 Oct 2008 14:23:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:from:to:cc :in-reply-to:references:content-type:date:message-id:mime-version :x-mailer:content-transfer-encoding; bh=Tyis/dM8zJ6wqGfN9MQNyXFgNk+rZ+ZXuC+l6oW04kk=; b=GSPmbjUwRGTxVGlFCyu0pyvwh2/wCwoUaa+8VNh/sCaAmScvwD6gDygFHySEap+pUt SOaZFmPov95H8Erk8DFqWcQTCxli8m7eWkNfedzdcQrgTnaM5hUc11xBvINOAwtoMwVm YuMLevHYCZ+ur/UQIcZVQaTkjfCyrKbExlS14= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:cc:in-reply-to:references:content-type:date :message-id:mime-version:x-mailer:content-transfer-encoding; b=NK45c6bRrSiuY86oo1x5MYuqBxleA4FB+kTVS1qfiXYpgo94tHlkKPNHvOtsLW6fGD PiIIZtFVJhTv96EUfZXSU3KGEQIZi5zBJyD9gzns45lg7wRBmay9erHCB5o90uIJSbqT f1cDEiwEAragC7x9p2p3LHNfGslVQwZI0aa9s= Received: by 10.215.38.2 with SMTP id q2mr122954qaj.104.1225142592153; Mon, 27 Oct 2008 14:23:12 -0700 (PDT) Received: from ?10.0.3.231? ([70.111.10.128]) by mx.google.com with ESMTPS id 4sm1077842yxj.7.2008.10.27.14.23.10 (version=SSLv3 cipher=RC4-MD5); Mon, 27 Oct 2008 14:23:11 -0700 (PDT) From: "Alexandre \"Sunny\" Kovalenko" To: Jeremy Chadwick In-Reply-To: <20081027175337.GA27175@icarus.home.lan> References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> Content-Type: text/plain; charset=utf-8 Date: Mon, 27 Oct 2008 17:22:50 -0400 Message-Id: <1225142570.1052.3.camel@RabbitsDen> Mime-Version: 1.0 X-Mailer: Evolution 2.22.3.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 8bit Cc: Vaclav Haisman , freebsd-stable@freebsd.org Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 21:23:13 -0000 On Mon, 2008-10-27 at 10:53 -0700, Jeremy Chadwick wrote: > On Mon, Oct 27, 2008 at 06:22:03PM +0100, Vaclav Haisman wrote: > > Jeremy Chadwick wrote: > > > Do you understand what short and long offline tests actually do and what > > > they're used for? :-) If so, you'd know that running them periodically > > > is more or less silly (IMHO). > > I do not, not completely :) I think I have just copied the settings from > > somewhere and only just tweaked it a bit whenever I have added a disk. > > Let me know if you figure out who or what online resource solicited > adding daily short/long tests, as I'd like to talk to them about their > decision. I have a feeling whoever thought it up felt that the tests > were performing entire sector scans of the entire disk, which is simply > not the case. While I am not the OP, one such place would be example configuration file in 'man smartd.conf'. HTH, -- Alexandre "Sunny" Kovalenko (ОлекÑандр Коваленко) From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 21:30:50 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 20A82106567B for ; Mon, 27 Oct 2008 21:30:50 +0000 (UTC) (envelope-from gaijin.k@gmail.com) Received: from qw-out-2122.google.com (qw-out-2122.google.com [74.125.92.26]) by mx1.freebsd.org (Postfix) with ESMTP id BE9628FC1B for ; Mon, 27 Oct 2008 21:30:49 +0000 (UTC) (envelope-from gaijin.k@gmail.com) Received: by qw-out-2122.google.com with SMTP id 9so1055316qwb.7 for ; Mon, 27 Oct 2008 14:30:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:from:to:cc :in-reply-to:references:content-type:date:message-id:mime-version :x-mailer:content-transfer-encoding; bh=GYESwi5IJU/2YYrbxzkfp7Zltduvx/lC5/RnC3c2T50=; b=Dii9v4kUeuKZL1DyMj/kuvAICnY6iJ4GfQ8q19jZbK63qP0bmiMKBv5vDnoopwYkvA 9AlWX6xJsURmRDMWOzudLjYP2MZYJQdAnpZIjd2e4ZLtRYH+UBSeAJssAWQQyjBquzUu dPoUDan/pJ4/slm7kS9WQ8kotvb+nMsmeK0fY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:cc:in-reply-to:references:content-type:date :message-id:mime-version:x-mailer:content-transfer-encoding; b=NScGNHTknc+kvih4R2LEuQYIEoIJs1uzPEVkrYzksBT2WRVtwpNGJB7YtYK7+Ob+ks 2VBtbn6KrxzxyTgC1CPu9/Ke3DcuyaEdCx+fzl+k/cjRlC0nCPfk0rRNmx7due9y2ftv r5phE+zRBQeP+MAYkEMZcY4J8o+EWBRLhmA6M= Received: by 10.215.38.2 with SMTP id q2mr165930qaj.274.1225143048080; Mon, 27 Oct 2008 14:30:48 -0700 (PDT) Received: from ?10.0.3.231? (pool-70-111-10-128.nwrk.east.verizon.net [70.111.10.128]) by mx.google.com with ESMTPS id 8sm391405ywg.6.2008.10.27.14.30.46 (version=SSLv3 cipher=RC4-MD5); Mon, 27 Oct 2008 14:30:47 -0700 (PDT) From: "Alexandre \"Sunny\" Kovalenko" To: Miroslav Lachman <000.fbsd@quip.cz> In-Reply-To: <4906285D.40304@quip.cz> References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> <20081027191028.GA28688@icarus.home.lan> <20081027195949.GA29641@icarus.home.lan> <4906285D.40304@quip.cz> Content-Type: text/plain; charset=utf-8 Date: Mon, 27 Oct 2008 17:30:26 -0400 Message-Id: <1225143026.1052.9.camel@RabbitsDen> Mime-Version: 1.0 X-Mailer: Evolution 2.22.3.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 8bit Cc: Jeremy Chadwick , freebsd-stable@freebsd.org, martinko Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 21:30:50 -0000 On Mon, 2008-10-27 at 21:45 +0100, Miroslav Lachman wrote: > Jeremy Chadwick wrote: > > > On Mon, Oct 27, 2008 at 08:50:44PM +0100, martinko wrote: > > > >>Jeremy Chadwick wrote: > >> > >>>On Mon, Oct 27, 2008 at 07:52:01PM +0100, martinko wrote: > >>> > >>>>Jeremy Chadwick wrote: > >>>> > >>>>>>>>Now, does the timeout cause loss of any data? Is there anything besides > >>>>>>>>disabling the testing that I can do about it? > >>>>>>> > >>>>>>>Do you understand what short and long offline tests actually do and what > >>>>>>>they're used for? :-) If so, you'd know that running them periodically > >>>>>>>is more or less silly (IMHO). > >>>>>> > >>>>>>I do not, not completely :) I think I have just copied the settings from > >>>>>>somewhere and only just tweaked it a bit whenever I have added a disk. > >>>>> > >>>>>Let me know if you figure out who or what online resource solicited > >>>>>adding daily short/long tests, as I'd like to talk to them about their > >>>>>decision. I have a feeling whoever thought it up felt that the tests > >>>>>were performing entire sector scans of the entire disk, which is simply > >>>>>not the case. > >>>>> > >>>> > >>>>Hallo, > >>>> > >>>>Reading this thread I checked my config to find this: ;-) > >>>> > >>>>#/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) > >>>>-m root # ++ 2006-11-03 mato > >>>>/dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ > >>>>2006-11-03 mato > >>>> > >>>>I believe I came up with the settings after reading manual page / > >>>>documentation of the tool. > >>> > >>>Can you explain why you're doing this? So far no one's provided a > >>>reason *why* they're doing short and long offline scans on a daily > >>>basis. I'm under the impression the conclusion was reached like this: > >>>"man smartd.conf ... oh, -s, a neat thing, let's enable it". > >>> > >>>There are negative repercussions to doing tests of this nature at such > >>>regular intervals. Once-a-week is borderline acceptable; once a month > >>>would be quite reasonable. I'd love to know what kind of affect daily > >>>tests have on MTBF; I can imagine it's reached much sooner with this. > >>> > >>>The main point of smartd is to monitor SMART attribute changes. If > >>>you're concerned about the health of your hard disk, you should be > >>>looking at your logs and not relying on things like automatic short/long > >>>tests. Most SMART attributes are updated immediately and not during an > >>>offline test, and all of those attribute changes will be logged. > >>> > >> > >>You asked Miroslav about source of his configuration. And as it is very > >>similar to mine I think we both have it from smartd documentation. Where > >>else to look for information? It's a usual source. So if you think it's > >>wrong please contact the authors, we're obviously just users. > >>Thanks. > > > > > > I'm not asking *where* you got the information from (we know where you > > and others got it from: the documentation). I'm asking you *why* you > > enabled what you did, because this is not something smartd.conf enables > > by default (the example is commented out). > > > > If you *really* want me to talk to Bruce about this, I can/will, but I'm > > left with the impression that the example in smartd.conf is there to > > show people the syntactical usage of -o, and not to advocate its usage. > > > > > >>PS: Btw, long offline scan is scheduled on weekly basis, not daily. If > >>it's good or not I do not know. > > > > > > The OP's long scan is also scheduled on a weekly basis (every Sunday), > > but his short scan trumps it. > > > > Folks, the point I'm trying to make here is that daily -- and even > > weekly -- SMART offline tests are unnecessary. If you're that concerned > > about your disk health, you should be looking at your syslog logs for > > attribute changes that indicate drive issues. Performing SMART offline > > tests at regular intervals like this does very little other than > > increase wear/tear on drive components (not necessarily the physical > > platters/heads; there are many pieces to a hard disk. :-) ) > > It is more than three years ago when I started to use smartd and I did > not change my configs from that time, just copy it to all the new > servers, so I can't tell why I had feeling that daily short and weekly > long test is "the right way". > Do you have some link to brief overview, where we can read something > about "the best practices" with smartd? Or may I just change the config > to do short test once a week and long test once a month? > > Miroslav Lachman > > PS: all examples in smartd.conf.sample are commented out (DEVICESCAN is > the default), but almost all of the examples have weekly long test, this > may lead to our conclusion "weekly long test is good" They are *not* commented out in the example configuration found while reading the man page. All of the examples in the man page use daily short and weekly long offline tests. Since it would have been as illustrative to depict monthly short and annual long tests, most of the readers assumed that it is The Good Thing. If it indeed is not, someone should kindly ask man page author to use different frequencies or, at least vary them from example to example, so they are less suggestive. -- Alexandre "Sunny" Kovalenko (ОлекÑандр Коваленко) From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 22:03:26 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EF047106567B for ; Mon, 27 Oct 2008 22:03:25 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA01.emeryville.ca.mail.comcast.net (qmta01.emeryville.ca.mail.comcast.net [76.96.30.16]) by mx1.freebsd.org (Postfix) with ESMTP id C8E3E8FC0C for ; Mon, 27 Oct 2008 22:03:25 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA14.emeryville.ca.mail.comcast.net ([76.96.30.60]) by QMTA01.emeryville.ca.mail.comcast.net with comcast id XrMw1a0011HpZEsA1y3PTq; Mon, 27 Oct 2008 22:03:23 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA14.emeryville.ca.mail.comcast.net with comcast id Xy3M1a00h2P6wsM8ay3Nas; Mon, 27 Oct 2008 22:03:22 +0000 X-Authority-Analysis: v=1.0 c=1 a=KeEtZEhZrkgA:10 a=ieuqav0nqiAA:10 a=QycZ5dHgAAAA:8 a=_TXvcwFi-0E1dRgPgDgA:9 a=JAHsaD8fJQVkSzAB0QIA:7 a=blXtmiCz3l0Lf-mhtmDg_pWaG2oA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 9C264C9419; Mon, 27 Oct 2008 15:03:21 -0700 (PDT) Date: Mon, 27 Oct 2008 15:03:21 -0700 From: Jeremy Chadwick To: Alexandre Sunny Kovalenko Message-ID: <20081027220321.GA31809@icarus.home.lan> References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> <20081027191028.GA28688@icarus.home.lan> <20081027195949.GA29641@icarus.home.lan> <4906285D.40304@quip.cz> <1225143026.1052.9.camel@RabbitsDen> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1225143026.1052.9.camel@RabbitsDen> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-stable@freebsd.org, Miroslav Lachman <000.fbsd@quip.cz>, martinko Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 22:03:26 -0000 On Mon, Oct 27, 2008 at 05:30:26PM -0400, Alexandre Sunny Kovalenko wrote: > On Mon, 2008-10-27 at 21:45 +0100, Miroslav Lachman wrote: > > Jeremy Chadwick wrote: > > > > > On Mon, Oct 27, 2008 at 08:50:44PM +0100, martinko wrote: > > > > > >>Jeremy Chadwick wrote: > > >> > > >>>On Mon, Oct 27, 2008 at 07:52:01PM +0100, martinko wrote: > > >>> > > >>>>Jeremy Chadwick wrote: > > >>>> > > >>>>>>>>Now, does the timeout cause loss of any data? Is there anything besides > > >>>>>>>>disabling the testing that I can do about it? > > >>>>>>> > > >>>>>>>Do you understand what short and long offline tests actually do and what > > >>>>>>>they're used for? :-) If so, you'd know that running them periodically > > >>>>>>>is more or less silly (IMHO). > > >>>>>> > > >>>>>>I do not, not completely :) I think I have just copied the settings from > > >>>>>>somewhere and only just tweaked it a bit whenever I have added a disk. > > >>>>> > > >>>>>Let me know if you figure out who or what online resource solicited > > >>>>>adding daily short/long tests, as I'd like to talk to them about their > > >>>>>decision. I have a feeling whoever thought it up felt that the tests > > >>>>>were performing entire sector scans of the entire disk, which is simply > > >>>>>not the case. > > >>>>> > > >>>> > > >>>>Hallo, > > >>>> > > >>>>Reading this thread I checked my config to find this: ;-) > > >>>> > > >>>>#/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) > > >>>>-m root # ++ 2006-11-03 mato > > >>>>/dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ > > >>>>2006-11-03 mato > > >>>> > > >>>>I believe I came up with the settings after reading manual page / > > >>>>documentation of the tool. > > >>> > > >>>Can you explain why you're doing this? So far no one's provided a > > >>>reason *why* they're doing short and long offline scans on a daily > > >>>basis. I'm under the impression the conclusion was reached like this: > > >>>"man smartd.conf ... oh, -s, a neat thing, let's enable it". > > >>> > > >>>There are negative repercussions to doing tests of this nature at such > > >>>regular intervals. Once-a-week is borderline acceptable; once a month > > >>>would be quite reasonable. I'd love to know what kind of affect daily > > >>>tests have on MTBF; I can imagine it's reached much sooner with this. > > >>> > > >>>The main point of smartd is to monitor SMART attribute changes. If > > >>>you're concerned about the health of your hard disk, you should be > > >>>looking at your logs and not relying on things like automatic short/long > > >>>tests. Most SMART attributes are updated immediately and not during an > > >>>offline test, and all of those attribute changes will be logged. > > >>> > > >> > > >>You asked Miroslav about source of his configuration. And as it is very > > >>similar to mine I think we both have it from smartd documentation. Where > > >>else to look for information? It's a usual source. So if you think it's > > >>wrong please contact the authors, we're obviously just users. > > >>Thanks. > > > > > > > > > I'm not asking *where* you got the information from (we know where you > > > and others got it from: the documentation). I'm asking you *why* you > > > enabled what you did, because this is not something smartd.conf enables > > > by default (the example is commented out). > > > > > > If you *really* want me to talk to Bruce about this, I can/will, but I'm > > > left with the impression that the example in smartd.conf is there to > > > show people the syntactical usage of -o, and not to advocate its usage. > > > > > > > > >>PS: Btw, long offline scan is scheduled on weekly basis, not daily. If > > >>it's good or not I do not know. > > > > > > > > > The OP's long scan is also scheduled on a weekly basis (every Sunday), > > > but his short scan trumps it. > > > > > > Folks, the point I'm trying to make here is that daily -- and even > > > weekly -- SMART offline tests are unnecessary. If you're that concerned > > > about your disk health, you should be looking at your syslog logs for > > > attribute changes that indicate drive issues. Performing SMART offline > > > tests at regular intervals like this does very little other than > > > increase wear/tear on drive components (not necessarily the physical > > > platters/heads; there are many pieces to a hard disk. :-) ) > > > > It is more than three years ago when I started to use smartd and I did > > not change my configs from that time, just copy it to all the new > > servers, so I can't tell why I had feeling that daily short and weekly > > long test is "the right way". > > Do you have some link to brief overview, where we can read something > > about "the best practices" with smartd? Or may I just change the config > > to do short test once a week and long test once a month? > > > > Miroslav Lachman > > > > PS: all examples in smartd.conf.sample are commented out (DEVICESCAN is > > the default), but almost all of the examples have weekly long test, this > > may lead to our conclusion "weekly long test is good" > They are *not* commented out in the example configuration found while > reading the man page. All of the examples in the man page use daily > short and weekly long offline tests. Since it would have been as > illustrative to depict monthly short and annual long tests, most of the > readers assumed that it is The Good Thing. If it indeed is not, someone > should kindly ask man page author to use different frequencies or, at > least vary them from example to example, so they are less suggestive. Are people forgetting that this is a 3rd-party piece of software that's in the ports tree? Why is everyone demonising what's in the man page, the example/sample configuration, etc. etc. when nobody controls this but the author of the software? I realise the port maintainer has some degree of responsibility, but port maintainers -- as a default -- have to make the assumption that the default/sample configuration files that come with the software are sufficient. I had no idea users were blindly uncommenting examples in smartd.conf.sample without reading what the features do. Then again, I guess many users/admins have no idea what sort of impact offline tests could have on a system. Short/long tests should not have any effect on a running/used disk -- and most do not see any effect -- but under high I/O I would assume there is a chance the suspend/resume aspect of SMART tests could take longer than 5 seconds. Though I am disappointed in the fact that people often schedule "maintenance things" all at the same time (between 0200 and 0500) but never think about the implications of them all running in parallel. I'll get in contact with Bruce Allen (author of smartmontools) and discuss all of this with him. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Mon Oct 27 22:24:10 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 12DCF106567F for ; Mon, 27 Oct 2008 22:24:10 +0000 (UTC) (envelope-from andrew@modulus.org) Received: from email.octopus.com.au (host-122-100-2-232.octopus.com.au [122.100.2.232]) by mx1.freebsd.org (Postfix) with ESMTP id C36B18FC1B for ; Mon, 27 Oct 2008 22:24:09 +0000 (UTC) (envelope-from andrew@modulus.org) Received: by email.octopus.com.au (Postfix, from userid 1002) id 08A39173F2; Tue, 28 Oct 2008 09:24:07 +1100 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on email.octopus.com.au X-Spam-Level: X-Spam-Status: No, score=-1.3 required=10.0 tests=ALL_TRUSTED, DNS_FROM_SECURITYSAGE autolearn=no version=3.2.3 Received: from [115.129.9.68] (unknown [115.129.9.68]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: admin@email.octopus.com.au) by email.octopus.com.au (Postfix) with ESMTP id ACA601737B for ; Tue, 28 Oct 2008 09:24:01 +1100 (EST) Message-ID: <49063F79.9050402@modulus.org> Date: Tue, 28 Oct 2008 09:23:53 +1100 From: Andrew Snow User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> <20081027191028.GA28688@icarus.home.lan> <20081027195949.GA29641@icarus.home.lan> <4906285D.40304@quip.cz> <1225143026.1052.9.camel@RabbitsDen> <20081027220321.GA31809@icarus.home.lan> In-Reply-To: <20081027220321.GA31809@icarus.home.lan> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2008 22:24:10 -0000 IMO, A much better option to run on a weekly basis is to use a RAID controller with "verify" feature (eg. 3ware) or use ZFS "scrub" mode. From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 02:47:19 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 61DE1106566C for ; Tue, 28 Oct 2008 02:47:19 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.30]) by mx1.freebsd.org (Postfix) with ESMTP id 113268FC12 for ; Tue, 28 Oct 2008 02:47:18 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: by yw-out-2324.google.com with SMTP id 9so588966ywe.13 for ; Mon, 27 Oct 2008 19:47:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:mime-version:subject:date:references :x-mailer; bh=pZMtCRZPAUTYnam1dntQubur+oCQH8meFO+arRSfyoA=; b=Qcgqgg/yAbK0LGT7x6Nztby8w/vkH52MJkXhKQVr3qas0FPnGT51FBS0QvxdrKAcsg 71ZehAmpqJDXV6XLNBI4sfwDhFXGmu4X5g1sGjH01nc1kJaxQ//kQmpCqmHvgYfkVSSK zoNrIAVUnpgrdROFl330cdyOsVxMiStZBQhv8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type:mime-version:subject :date:references:x-mailer; b=eOGL11DW5xQ0hCto4EM+hmYRapThLFOhGMR7eHZ6B/gQ3AUZgafXcfOxevO+Oo0OhU WAye8Z3uz5mba0M0O48HSP0z2YeMTAuNpHt6fyys4CCla+urpTYwrMW2GMfKo7vGxsrP +Iy+SAY/itP1288vavv0Vp/mfJcG9/mP+9N2w= Received: by 10.65.100.17 with SMTP id c17mr7316538qbm.48.1225162037286; Mon, 27 Oct 2008 19:47:17 -0700 (PDT) Received: from 133-34-50.adsl.terra.cl (133-34-50.adsl.terra.cl [200.50.34.133]) by mx.google.com with ESMTPS id 28sm1531969qbw.11.2008.10.27.19.47.14 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 27 Oct 2008 19:47:16 -0700 (PDT) Message-Id: From: Jose Amengual To: Bjoern A. Zeeb In-Reply-To: <20081027120802.G2978@maildrop.int.zabbadoz.net> Mime-Version: 1.0 (Apple Message framework v929.2) Date: Mon, 27 Oct 2008 23:47:12 -0300 References: <20081027120802.G2978@maildrop.int.zabbadoz.net> X-Mailer: Apple Mail (2.929.2) Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: SOLUTION!!!! Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 02:47:19 -0000 Hi Guys. I will describe de steps that I did to solve this problem that I still don't understand. Like my first post, I installed FreeBSD with the install cd 7.0- STABLE-200807-i386-disc1.iso , then I update using cvsup and the stable supfile and I got the 7.1-PREREALEASE ( I don't know why I got 7.1 has a stable using the stablesupfile using RELENG_7 ). After make world and stuff, I installed ezjail and I start creating my jails, then I configure my pf script and I give my jails and user nat and etc. Then I start installing packages to my jails and I start seeing the TCP kernel messages that at the first time I ignored. After I had all the jails working , I realize that my postfix jail was leaving almost all the emails in the defer queue with reasons like "Connection time out", then I realize that the tcp_do_segment messages were talking about port 25 connections and not only ftp connections, and that was exactly one message per mail in the queue. After reading some post I decide to Update my machine again to RELENG_7_0 and I got 7.0-p5 and the problem persist, after that I start changing sysctl variables like sack etc. Today I reinstall the same machine with the 7.0-RELEASE-i386-disc1.iso and update to 7.0-p5 and using ezjail I start creating the jails and I realize that I was getting the same TCP messages per ftp connections but seems to be working ok. After some research and reading I decide to REMOVE the SCTP option from the kernel and recompile. After that I didn't receive any message and today the server is up and running with 300 users behind and tons of email with NONE in the defer queue. The configurations of the jails were copy and paste to the new installation of the server, the only thing that I change was the install CD. Is that possible ?, could be the reason ? SCTP is generating this problem ? Thanks to all. On 27-Oct-08, at 9:09 AM, Bjoern A. Zeeb wrote: > On Sun, 26 Oct 2008, Jose Amengual wrote: > > Hi, > >> The problem persist even in stable 7.0, 7.1-PRERELEASE and 7.0-P5 , >> the postfix jail is living all the email in defer queue saying >> "Connection Time Out" >> >> This server give service to 300 clients and the network load os high. >> >> is there any clue how to resolve this ? > > sorry if I am not reading back various links which include mails I had > sent which are entirely unrelated. > > So you are seeing TCP problems. And you are running with a firewall > enabled? > > Have you tried tcpdumping and seeing what exactly goes wrong? > > do you have any offload stuff enabled (as the subject suggests)? If so > what happens if you disable this? > > /bz > > -- > Bjoern A. Zeeb Stop bit received. Insert coin for new > game. > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org > " From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 02:53:19 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6004C10656A1 for ; Tue, 28 Oct 2008 02:53:19 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA01.emeryville.ca.mail.comcast.net (qmta01.emeryville.ca.mail.comcast.net [76.96.30.16]) by mx1.freebsd.org (Postfix) with ESMTP id F21738FC16 for ; Tue, 28 Oct 2008 02:53:18 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA08.emeryville.ca.mail.comcast.net ([76.96.30.12]) by QMTA01.emeryville.ca.mail.comcast.net with comcast id Xyuz1a0070FhH24A12tJmG; Tue, 28 Oct 2008 02:53:18 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA08.emeryville.ca.mail.comcast.net with comcast id Y2tH1a0042P6wsM8U2tHq6; Tue, 28 Oct 2008 02:53:18 +0000 X-Authority-Analysis: v=1.0 c=1 a=LQwoggFKHvUA:10 a=kkzYbUAfm-cA:10 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=jC--hM5gn0AE43neS4oA:9 a=E4gqarx8Ui6uxUgKxDGs0Z9UqqcA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 32945C9419; Mon, 27 Oct 2008 19:53:17 -0700 (PDT) Date: Mon, 27 Oct 2008 19:53:17 -0700 From: Jeremy Chadwick To: Jose Amengual Message-ID: <20081028025317.GA37415@icarus.home.lan> References: <20081027120802.G2978@maildrop.int.zabbadoz.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: "Bjoern A. Zeeb" , freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: SOLUTION!!!! Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 02:53:19 -0000 On Mon, Oct 27, 2008 at 11:47:12PM -0300, Jose Amengual wrote: > Like my first post, I installed FreeBSD with the install cd 7.0- > STABLE-200807-i386-disc1.iso , then I update using cvsup and the stable > supfile and I got the 7.1-PREREALEASE ( I don't know why I got 7.1 has a > stable using the stablesupfile using RELENG_7 ). This has been discussed on this list twice in the past week. http://lists.freebsd.org/pipermail/freebsd-questions/2008-October/thread.html#184992 http://lists.freebsd.org/pipermail/freebsd-questions/2008-October/thread.html#185008 -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 02:54:55 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 68DDE106569B for ; Tue, 28 Oct 2008 02:54:55 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA06.emeryville.ca.mail.comcast.net (qmta06.emeryville.ca.mail.comcast.net [76.96.30.56]) by mx1.freebsd.org (Postfix) with ESMTP id 4A4168FC1A for ; Tue, 28 Oct 2008 02:54:55 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA08.emeryville.ca.mail.comcast.net ([76.96.30.12]) by QMTA06.emeryville.ca.mail.comcast.net with comcast id Y2531a01Q0FhH24A62uvWc; Tue, 28 Oct 2008 02:54:55 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA08.emeryville.ca.mail.comcast.net with comcast id Y2uu1a0092P6wsM8U2uuJK; Tue, 28 Oct 2008 02:54:54 +0000 X-Authority-Analysis: v=1.0 c=1 a=LQwoggFKHvUA:10 a=kkzYbUAfm-cA:10 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=MGgHbMBflC0DpuJ_RVoA:9 a=TK_yCqcTFvU91EVqy54A:7 a=AmILsQHdK65QyGT_EsHkTRIMAFMA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 48B89C9419; Mon, 27 Oct 2008 19:54:54 -0700 (PDT) Date: Mon, 27 Oct 2008 19:54:54 -0700 From: Jeremy Chadwick To: Jose Amengual Message-ID: <20081028025454.GA37503@icarus.home.lan> References: <20081027120802.G2978@maildrop.int.zabbadoz.net> <20081028025317.GA37415@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081028025317.GA37415@icarus.home.lan> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: "Bjoern A. Zeeb" , freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: SOLUTION!!!! Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 02:54:55 -0000 On Mon, Oct 27, 2008 at 07:53:17PM -0700, Jeremy Chadwick wrote: > On Mon, Oct 27, 2008 at 11:47:12PM -0300, Jose Amengual wrote: > > Like my first post, I installed FreeBSD with the install cd 7.0- > > STABLE-200807-i386-disc1.iso , then I update using cvsup and the stable > > supfile and I got the 7.1-PREREALEASE ( I don't know why I got 7.1 has a > > stable using the stablesupfile using RELENG_7 ). > > This has been discussed on this list twice in the past week. > > http://lists.freebsd.org/pipermail/freebsd-questions/2008-October/thread.html#184992 > http://lists.freebsd.org/pipermail/freebsd-questions/2008-October/thread.html#185008 Well that's what I get for being subscribed to ~14 different FreeBSD lists -- very difficult keeping track of all of them. Anyway, it was discussed on -questions, not -stable, my apologies. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 06:59:02 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 15C90106566C for ; Tue, 28 Oct 2008 06:59:02 +0000 (UTC) (envelope-from spork@bway.net) Received: from xena.bway.net (xena.bway.net [216.220.96.26]) by mx1.freebsd.org (Postfix) with ESMTP id AC8D58FC1B for ; Tue, 28 Oct 2008 06:59:01 +0000 (UTC) (envelope-from spork@bway.net) Received: (qmail 39282 invoked by uid 0); 28 Oct 2008 06:32:18 -0000 Received: from unknown (HELO toasty.nat.fasttrackmonkey.com) (spork@96.57.102.250) by smtp.bway.net with (DHE-RSA-AES256-SHA encrypted) SMTP; 28 Oct 2008 06:32:18 -0000 Date: Tue, 28 Oct 2008 02:32:18 -0400 (EDT) From: Charles Sprickman X-X-Sender: spork@toasty.nat.fasttrackmonkey.com To: stable@freebsd.org Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Subject: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 06:59:02 -0000 Hello all, I've been searching around and have come up with no current discussions on this issue. I'll keep it brief: In 7.0 or 7.1 is there any provision to have multiple IP addresses in a jail? I'm stumped on this, as I just started a new hosting project that needs a few jails. At least one of those requires multiple IPs, which is something I never really even realized was not supported. What puzzles me more is that before I decided to host this stuff myself, I was shopping for FreeBSD VPS providers, and I noticed that Verio is actually offering what looks like jails as VPSs, and they are offering multiple IPs. Is this something they hacked up and did not contribute back? Is there any firewall hackery to be had that can at least let me do IP based virtual hosts for web hosting? Thanks, Charles From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 07:24:15 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 194E01065672 for ; Tue, 28 Oct 2008 07:24:15 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.cksoft.de (mail.cksoft.de [62.111.66.27]) by mx1.freebsd.org (Postfix) with ESMTP id C8B8F8FC19 for ; Tue, 28 Oct 2008 07:24:14 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from localhost (amavis.str.cksoft.de [192.168.74.71]) by mail.cksoft.de (Postfix) with ESMTP id 363E341C677; Tue, 28 Oct 2008 08:05:05 +0100 (CET) X-Virus-Scanned: amavisd-new at cksoft.de Received: from mail.cksoft.de ([62.111.66.27]) by localhost (amavis.str.cksoft.de [192.168.74.71]) (amavisd-new, port 10024) with ESMTP id v9+qwKMe1J0G; Tue, 28 Oct 2008 08:05:04 +0100 (CET) Received: by mail.cksoft.de (Postfix, from userid 66) id DED6941C670; Tue, 28 Oct 2008 08:05:04 +0100 (CET) Received: from maildrop.int.zabbadoz.net (maildrop.int.zabbadoz.net [10.111.66.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.int.zabbadoz.net (Postfix) with ESMTP id 1038844487F; Tue, 28 Oct 2008 07:01:43 +0000 (UTC) Date: Tue, 28 Oct 2008 07:01:43 +0000 (UTC) From: "Bjoern A. Zeeb" X-X-Sender: bz@maildrop.int.zabbadoz.net To: Charles Sprickman In-Reply-To: Message-ID: <20081028070106.Y2978@maildrop.int.zabbadoz.net> References: X-OpenPGP-Key: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 07:24:15 -0000 On Tue, 28 Oct 2008, Charles Sprickman wrote: > Hello all, > > I've been searching around and have come up with no current discussions on > this issue. I'll keep it brief: > > In 7.0 or 7.1 is there any provision to have multiple IP addresses in a jail? Subscribe to the freebsd-jail mailinglist and check the archives. You'll find patches there. /bz -- Bjoern A. Zeeb Stop bit received. Insert coin for new game. From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 07:49:02 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 34AC31065679 for ; Tue, 28 Oct 2008 07:49:02 +0000 (UTC) (envelope-from luigi@onelab2.iet.unipi.it) Received: from onelab2.iet.unipi.it (onelab2.iet.unipi.it [131.114.9.129]) by mx1.freebsd.org (Postfix) with ESMTP id EE8878FC16 for ; Tue, 28 Oct 2008 07:49:01 +0000 (UTC) (envelope-from luigi@onelab2.iet.unipi.it) Received: by onelab2.iet.unipi.it (Postfix, from userid 275) id A2293730AC; Tue, 28 Oct 2008 08:53:20 +0100 (CET) Date: Tue, 28 Oct 2008 08:53:20 +0100 From: Luigi Rizzo To: stable@freebsd.org Message-ID: <20081028075320.GA25535@onelab2.iet.unipi.it> References: <20081021103129.GC93431@onelab2.iet.unipi.it> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081021103129.GC93431@onelab2.iet.unipi.it> User-Agent: Mutt/1.4.2.3i Cc: Subject: nspluginwrapper / acrobat problem (was Re: huge cpu and memory usage by ld.so ?) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 07:49:02 -0000 On Tue, Oct 21, 2008 at 12:31:29PM +0200, Luigi Rizzo wrote: > On RELENG_7 (various versions between june and a few days ago) i > noticed that sometimes ld.so starts using huge amounts of memory > and CPU, both in terms of SIZE and RES. > > I saw it first on 3 different machines doing a portupgrade -a > while X was active, but perhaps it is Xorg-related because even > stopping portupgrade the phenomenon continues, and the Xorg process > also comes next in terms of CPU usage (not memory though, it stays > down to reasonable levels). > > This is the 'top' output during a portupgrade -a > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 17385 luigi 1 107 0 2027M 220M RUN 1 19:20 51.37% ld-2.3.6.so > > and it really goes up with time, at perhaps 50-100Mbytes per minute. > > 2 of the machines use the nvidia-driver, one is a Dell X1 laptop > with an i915 board. > Exiting from X seems to terminate the stray ld.so. > > I am not sure how reproducible the thing is, or whether it is > a known issue (perhaps portupgrade is replacing some Xorg component > while the Xorg process is using it ?) For the archives- i tracked the problem to be related to the use of acrobat8 (the viewer) within firefox3 using nspluginwrapper. What happens is that when you load a pdf document, nsplugin wrapper runs nppdf.so > nspluginwrapper -l /home/luigi/.mozilla/plugins/npwrapper.nppdf.so Original plugin: /usr/local/Adobe/Reader8/ENU/Adobe/Reader8/Browser/intellinux/nppdf.so which in turn, presumably, calls /compat/linux/lib/ld-2.3.6.so to load the required libraries. What i see is that the ld-2.3.6.so binary stays alive throughout the lifetime of the pdf document, and when i close the tab with the pdf viewer, quite often ld-2.3.6.so does not disappear but starts eating memory at 1-2MB per second. I can kill ld-2.3.6.so manually, though i am just a bit unclear on how exactly i could force the loader to go away when nppdf.so is unloaded. cheers luigi > cheers > luigi From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 08:54:10 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2CE1C106566B for ; Tue, 28 Oct 2008 08:54:10 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 9D9248FC0A for ; Tue, 28 Oct 2008 08:54:09 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9S8rxQj061074; Tue, 28 Oct 2008 09:53:59 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9S8rxsP061073; Tue, 28 Oct 2008 09:53:59 +0100 (CET) (envelope-from olli) Date: Tue, 28 Oct 2008 09:53:59 +0100 (CET) Message-Id: <200810280853.m9S8rxsP061073@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG, spork@bway.net In-Reply-To: X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Tue, 28 Oct 2008 09:54:00 +0100 (CET) Cc: Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-stable@FreeBSD.ORG, spork@bway.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 08:54:10 -0000 Charles Sprickman wrote: > [...] > Is there any firewall hackery to be had that can at least let me do IP > based virtual hosts for web hosting? A common solution is to put the jail on a localhost IP (e.g. 127.0.0.2, whatever). The apache inside is bound to several arbitrary port numbers. For example, the first virtual host listens on port 800, the next one on port 801, then 802, and so on. Everything on the same jail IP. Then use packet filter and NAT rules to forward incoming connections from the real IP addresses to the respective port on your jail IP: 11.22.33.44 : 80 <--> 127.0.0.2 : 800 11.22.33.45 : 80 <--> 127.0.0.2 : 801 11.22.33.46 : 80 <--> 127.0.0.2 : 802 11.22.33.47 : 80 <--> 127.0.0.2 : 803 ... You should be able to do that with any of the included "firewall" packages (IPFW, IPF, PF). Personally I prefer IPFW, which is used like this: ipfw nat 1 config redirect_port tcp 127.0.0.2:800 11.22.33.44:80 ipfw nat 1 tcp from any to 11.22.33.44 80 ipfw nat 1 tcp from 127.0.0.2 800 to any ipfw nat 2 config redirect_port tcp 127.0.0.2:801 11.22.33.45:80 ipfw nat 2 tcp from any to 11.22.33.45 80 ipfw nat 2 tcp from 127.0.0.2 801 to any .. and so on. Of course you can add additional NAT rules for port 443 (https). Works perfectly fine for me. (You need to enable IPFIREWALL_NAT and LIBALIAS in your kernel, or load libalias.ko and ipfw_nat.ko with kldload.) Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "[...] one observation we can make here is that Python makes an excellent pseudocoding language, with the wonderful attribute that it can actually be executed." -- Bruce Eckel From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 11:40:40 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5A3C61065671; Tue, 28 Oct 2008 11:40:40 +0000 (UTC) (envelope-from joao@matik.com.br) Received: from msrv.matik.com.br (msrv.matik.com.br [200.153.48.3]) by mx1.freebsd.org (Postfix) with ESMTP id CEACD8FC13; Tue, 28 Oct 2008 11:40:39 +0000 (UTC) (envelope-from joao@matik.com.br) Received: from [10.10.2.2] (sip-rp1 [189.19.2.198]) by msrv.matik.com.br (8.14.2/8.14.2) with ESMTP id m9SBeSZo069842; Tue, 28 Oct 2008 09:40:29 -0200 (BRST) (envelope-from joao@matik.com.br) From: JoaoBR Organization: Infomatik To: freebsd-stable@freebsd.org Date: Tue, 28 Oct 2008 09:38:41 -0200 User-Agent: KMail/1.9.7 References: <4905951B.2050602@sh.cvut.cz> <1225143026.1052.9.camel@RabbitsDen> <20081027220321.GA31809@icarus.home.lan> In-Reply-To: <20081027220321.GA31809@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200810280938.42162.joao@matik.com.br> X-Spam-Status: No, score=0.8 required=5.0 tests=ALL_TRUSTED,AWL autolearn=failed version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on msrv.matik.com.br X-Virus-Scanned: ClamAV 0.93.3/8524/Tue Oct 28 08:56:37 2008 on msrv.matik.com.br X-Virus-Status: Clean Cc: Jeremy Chadwick , Alexandre Sunny Kovalenko , Miroslav Lachman <000.fbsd@quip.cz>, martinko Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 11:40:40 -0000 On Monday 27 October 2008 20:03:21 Jeremy Chadwick wrote: > I had no idea users were blindly uncommenting examples in well seems you're new in support business then :) the issue might be the reason why weapons are not delivered with roles in t= he=20 chambers ... so developers probably should take care of what kind of exampl= e=20 they include=20 > smartd.conf.sample without reading what the features do. =A0Then again, I > guess many users/admins have no idea what sort of impact offline tests > could have on a system. =A0Short/long tests should not have any effect on > a running/used disk -- and most do not see any effect -- but under high > I/O I would assume there is a chance the suspend/resume aspect of SMART > tests could take longer than 5 seconds. =A0Though I am disappointed in > the fact that people often schedule "maintenance things" all at the same > time (between 0200 and 0500) but never think about the implications of > them all running in parallel. well good idea to start a faq with general orientations :) =2D-=20 Jo=E3o A mensagem foi scaneada pelo sistema de e-mail e pode ser considerada segura. Service fornecido pelo Datacenter Matik https://datacenter.matik.com.br From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 12:31:54 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8559A1065673 for ; Tue, 28 Oct 2008 12:31:54 +0000 (UTC) (envelope-from sjt.kar@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.183]) by mx1.freebsd.org (Postfix) with ESMTP id 57BC58FC1A for ; Tue, 28 Oct 2008 12:31:54 +0000 (UTC) (envelope-from sjt.kar@gmail.com) Received: by wa-out-1112.google.com with SMTP id n4so1444395wag.27 for ; Tue, 28 Oct 2008 05:31:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=DC6wF/oMEDBU1kqjsTN/2dalgWJWxMwSt26G66MurLM=; b=IuUmfXld0SbqNRszfnNuH1D3cQ2pHFI9tUaZcIUSzhIJj1CtTjyN2wGQN3wKvDnWM5 cs3OM9hATzpm9BDIGip9f8d5WTAtynygvYAMLIe1sdZNWV4Lvil1YZP47i8TGVH3gP5g pD6tTF+Ncw3BdIgWib2KMS37zgtP3j4jSViyc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=oKHaOVS/SUJ7ZfOYsXM7jNcDeKBync9VgPfZzqOxBZXV909HI+L3bCMr9d/9btf5Rj h2Y2kXaxE21NQK7tieqdmba28h4+CqAZ9mBKNrV6Musyih3X6KXeJsJVsgN6GtpnluZj evYESig0ANYmK2VsFZyazQ+1oxEc6wQBU3UZs= Received: by 10.115.74.1 with SMTP id b1mr6066843wal.169.1225195421006; Tue, 28 Oct 2008 05:03:41 -0700 (PDT) Received: by 10.115.54.14 with HTTP; Tue, 28 Oct 2008 05:03:40 -0700 (PDT) Message-ID: <921ca19c0810280503o79b0e1cei4b8e92293847bec1@mail.gmail.com> Date: Tue, 28 Oct 2008 17:33:40 +0530 From: "Sujit Karataparambil" To: "Jose Amengual" , freebsd-current@freebsd.org, freebsd-stable@freebsd.org In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081027120802.G2978@maildrop.int.zabbadoz.net> Cc: Subject: Re: SOLUTION!!!! Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 12:31:54 -0000 Sorry Just donot understand what you are saying. On 10/28/08, Jose Amengual wrote: > Hi Guys. > > I will describe de steps that I did to solve this problem that I still don't > understand. > > Like my first post, I installed FreeBSD with the install cd > 7.0-STABLE-200807-i386-disc1.iso , then I update using > cvsup and the stable supfile and I got the 7.1-PREREALEASE ( I don't know > why I got 7.1 has a stable using the stablesupfile using RELENG_7 ). > > After make world and stuff, I installed ezjail and I start creating my > jails, then I configure my pf script and I give my jails and user nat and > etc. > Then I start installing packages to my jails and I start seeing the TCP > kernel messages that at the first time I ignored. > > After I had all the jails working , I realize that my postfix jail was > leaving almost all the emails in the defer queue with reasons like > "Connection time out", then I realize that the tcp_do_segment messages were > talking about port 25 connections and not only ftp connections, and that was > exactly one message per mail in the queue. > > After reading some post I decide to Update my machine again to RELENG_7_0 > and I got 7.0-p5 and the problem persist, after that I start changing sysctl > variables like sack etc. > > Today I reinstall the same machine with the 7.0-RELEASE-i386-disc1.iso and > update to 7.0-p5 and using ezjail I start creating the jails and I realize > that I was getting the same TCP messages per ftp connections but seems to be > working ok. After some research and reading I decide to REMOVE the SCTP > option from the kernel and recompile. > > After that I didn't receive any message and today the server is up and > running with 300 users behind and tons of email with NONE in the defer > queue. > > The configurations of the jails were copy and paste to the new installation > of the server, the only thing that I change was the install CD. > > Is that possible ?, could be the reason ? > SCTP is generating this problem ? > > > > Thanks to all. > > > On 27-Oct-08, at 9:09 AM, Bjoern A. Zeeb wrote: > > > On Sun, 26 Oct 2008, Jose Amengual wrote: > > > > Hi, > > > > > > > The problem persist even in stable 7.0, 7.1-PRERELEASE and 7.0-P5 , the > postfix jail is living all the email in defer queue saying "Connection Time > Out" > > > > > > This server give service to 300 clients and the network load os high. > > > > > > is there any clue how to resolve this ? > > > > > > > sorry if I am not reading back various links which include mails I had > > sent which are entirely unrelated. > > > > So you are seeing TCP problems. And you are running with a firewall > > enabled? > > > > Have you tried tcpdumping and seeing what exactly goes wrong? > > > > do you have any offload stuff enabled (as the subject suggests)? If so > > what happens if you disable this? > > > > /bz > > > > -- > > Bjoern A. Zeeb Stop bit received. Insert coin for new game. > > _______________________________________________ > > freebsd-current@freebsd.org mailing list > > > http://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to > "freebsd-current-unsubscribe@freebsd.org" > > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to > "freebsd-stable-unsubscribe@freebsd.org" > -- --linux(2.4/2.6),bsd(4.5.x+),solaris(2.5+) From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 13:10:21 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 943A01065676; Tue, 28 Oct 2008 13:10:21 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from falcon.cybervisiontech.com (falcon.cybervisiontech.com [217.20.163.9]) by mx1.freebsd.org (Postfix) with ESMTP id 100228FC1F; Tue, 28 Oct 2008 13:10:20 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from localhost (localhost [127.0.0.1]) by falcon.cybervisiontech.com (Postfix) with ESMTP id 3FFFB744175; Tue, 28 Oct 2008 15:10:16 +0200 (EET) X-Virus-Scanned: Debian amavisd-new at falcon.cybervisiontech.com Received: from falcon.cybervisiontech.com ([127.0.0.1]) by localhost (falcon.cybervisiontech.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id M5oeeeuBFuEo; Tue, 28 Oct 2008 15:10:16 +0200 (EET) Received: from [10.2.1.87] (gateway.cybervisiontech.com.ua [91.198.50.114]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by falcon.cybervisiontech.com (Postfix) with ESMTP id 816EA744005; Tue, 28 Oct 2008 15:10:15 +0200 (EET) Message-ID: <49070F36.8090606@icyb.net.ua> Date: Tue, 28 Oct 2008 15:10:14 +0200 From: Andriy Gapon User-Agent: Thunderbird 2.0.0.17 (X11/20080929) MIME-Version: 1.0 To: Jeremy Chadwick References: <4905951B.2050602@sh.cvut.cz> <20081027160828.GA24496@icarus.home.lan> <4905F8BB.3080302@sh.cvut.cz> <20081027175337.GA27175@icarus.home.lan> <20081027191028.GA28688@icarus.home.lan> <20081027195949.GA29641@icarus.home.lan> In-Reply-To: <20081027195949.GA29641@icarus.home.lan> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org, martinko Subject: Re: Short SMART check causes disk op timeouts X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 13:10:21 -0000 on 27/10/2008 21:59 Jeremy Chadwick said the following: > On Mon, Oct 27, 2008 at 08:50:44PM +0100, martinko wrote: >> Jeremy Chadwick wrote: >>> On Mon, Oct 27, 2008 at 07:52:01PM +0100, martinko wrote: >>>> Jeremy Chadwick wrote: >>>>>>>> Now, does the timeout cause loss of any data? Is there anything besides >>>>>>>> disabling the testing that I can do about it? >>>>>>> Do you understand what short and long offline tests actually do and what >>>>>>> they're used for? :-) If so, you'd know that running them periodically >>>>>>> is more or less silly (IMHO). >>>>>> I do not, not completely :) I think I have just copied the settings from >>>>>> somewhere and only just tweaked it a bit whenever I have added a disk. >>>>> Let me know if you figure out who or what online resource solicited >>>>> adding daily short/long tests, as I'd like to talk to them about their >>>>> decision. I have a feeling whoever thought it up felt that the tests >>>>> were performing entire sector scans of the entire disk, which is simply >>>>> not the case. >>>>> >>>> Hallo, >>>> >>>> Reading this thread I checked my config to find this: ;-) >>>> >>>> #/dev/ad0 -a -n standby,q -o on -S on -s (S/../.././02|L/../../7/03) >>>> -m root # ++ 2006-11-03 mato >>>> /dev/ad0 -a -o on -S on -s (S/../.././02|L/../../7/03) -m root # ++ >>>> 2006-11-03 mato >>>> >>>> I believe I came up with the settings after reading manual page / >>>> documentation of the tool. >>> Can you explain why you're doing this? So far no one's provided a >>> reason *why* they're doing short and long offline scans on a daily >>> basis. I'm under the impression the conclusion was reached like this: >>> "man smartd.conf ... oh, -s, a neat thing, let's enable it". >>> >>> There are negative repercussions to doing tests of this nature at such >>> regular intervals. Once-a-week is borderline acceptable; once a month >>> would be quite reasonable. I'd love to know what kind of affect daily >>> tests have on MTBF; I can imagine it's reached much sooner with this. >>> >>> The main point of smartd is to monitor SMART attribute changes. If >>> you're concerned about the health of your hard disk, you should be >>> looking at your logs and not relying on things like automatic short/long >>> tests. Most SMART attributes are updated immediately and not during an >>> offline test, and all of those attribute changes will be logged. >>> >> You asked Miroslav about source of his configuration. And as it is very >> similar to mine I think we both have it from smartd documentation. Where >> else to look for information? It's a usual source. So if you think it's >> wrong please contact the authors, we're obviously just users. >> Thanks. > > I'm not asking *where* you got the information from (we know where you > and others got it from: the documentation). I'm asking you *why* you > enabled what you did, because this is not something smartd.conf enables > by default (the example is commented out). > > If you *really* want me to talk to Bruce about this, I can/will, but I'm > left with the impression that the example in smartd.conf is there to > show people the syntactical usage of -o, and not to advocate its usage. > >> PS: Btw, long offline scan is scheduled on weekly basis, not daily. If >> it's good or not I do not know. > > The OP's long scan is also scheduled on a weekly basis (every Sunday), > but his short scan trumps it. > > Folks, the point I'm trying to make here is that daily -- and even > weekly -- SMART offline tests are unnecessary. If you're that concerned > about your disk health, you should be looking at your syslog logs for > attribute changes that indicate drive issues. Performing SMART offline > tests at regular intervals like this does very little other than > increase wear/tear on drive components (not necessarily the physical > platters/heads; there are many pieces to a hard disk. :-) ) BTW, I am not entirely sure what Bruce you mentioned above - probably I missed something, but I found this post: http://article.gmane.org/gmane.linux.utilities.smartmontools/1443 This was a long time ago, and it really warns about the same balance that you do, but it can hint at "source of authority" for all the configs around. -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 13:11:12 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5D507106566B for ; Tue, 28 Oct 2008 13:11:12 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: from qw-out-2122.google.com (qw-out-2122.google.com [74.125.92.24]) by mx1.freebsd.org (Postfix) with ESMTP id B07008FC27 for ; Tue, 28 Oct 2008 13:11:11 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: by qw-out-2122.google.com with SMTP id 9so1201987qwb.7 for ; Tue, 28 Oct 2008 06:11:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-mailer; bh=HC4v/HFzO3omoylHDtt8nrmzZp0ph8ySp30HvCxE/aA=; b=JnPRD5ZO7VF/gsMcXkv7LGLJBKSd03W9d8e5WRgjISO0LmdnViV+WTC7EAwi253XBY NO06pn1U7aoaADKaMIo3PK49n6MVdyKJRyGt41iBmNWTVvDyZoHE3y9Su+xBvNE5ee0P AD6RbR0URlUKmq37Q+HAfsxolnAAILMDHvTZQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-mailer; b=QYnhotr0QZSciWKOxCiIWR2Nvr3ppk1VBmTmBi7K/lQdgVoUa1AD0gObbFYu5AkG+E IfGdB+yj4dJyweArXg14peN4NYc0zbx1XgyBqCWIwKI75h+FNAmZPq7/vDffWmpp4c17 o+HMbLblelkjCyqPqIdB3909rU71SG0E86wxM= Received: by 10.214.81.2 with SMTP id e2mr750848qab.110.1225199470876; Tue, 28 Oct 2008 06:11:10 -0700 (PDT) Received: from ?192.168.42.174? ([190.8.72.74]) by mx.google.com with ESMTPS id 34sm3089761yxl.8.2008.10.28.06.11.08 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 28 Oct 2008 06:11:09 -0700 (PDT) Message-Id: From: Jose Amengual To: Sujit Karataparambil In-Reply-To: <921ca19c0810280503o79b0e1cei4b8e92293847bec1@mail.gmail.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Tue, 28 Oct 2008 10:10:54 -0300 References: <20081027120802.G2978@maildrop.int.zabbadoz.net> <921ca19c0810280503o79b0e1cei4b8e92293847bec1@mail.gmail.com> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: SOLUTION!!!! Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 13:11:12 -0000 Sorry for my ESL :). On 28-Oct-08, at 9:03 AM, Sujit Karataparambil wrote: > Sorry Just donot understand what you are saying. > > On 10/28/08, Jose Amengual wrote: >> Hi Guys. >> >> I will describe de steps that I did to solve this problem that I >> still don't >> understand. >> >> Like my first post, I installed FreeBSD with the install cd >> 7.0-STABLE-200807-i386-disc1.iso , then I update using >> cvsup and the stable supfile and I got the 7.1-PREREALEASE ( I >> don't know >> why I got 7.1 has a stable using the stablesupfile using RELENG_7 ). >> >> After make world and stuff, I installed ezjail and I start creating >> my >> jails, then I configure my pf script and I give my jails and user >> nat and >> etc. >> Then I start installing packages to my jails and I start seeing the >> TCP >> kernel messages that at the first time I ignored. >> >> After I had all the jails working , I realize that my postfix jail >> was >> leaving almost all the emails in the defer queue with reasons like >> "Connection time out", then I realize that the tcp_do_segment >> messages were >> talking about port 25 connections and not only ftp connections, and >> that was >> exactly one message per mail in the queue. >> >> After reading some post I decide to Update my machine again to >> RELENG_7_0 >> and I got 7.0-p5 and the problem persist, after that I start >> changing sysctl >> variables like sack etc. >> >> Today I reinstall the same machine with the 7.0-RELEASE-i386- >> disc1.iso and >> update to 7.0-p5 and using ezjail I start creating the jails and I >> realize >> that I was getting the same TCP messages per ftp connections but >> seems to be >> working ok. After some research and reading I decide to REMOVE the >> SCTP >> option from the kernel and recompile. >> >> After that I didn't receive any message and today the server is up >> and >> running with 300 users behind and tons of email with NONE in the >> defer >> queue. >> >> The configurations of the jails were copy and paste to the new >> installation >> of the server, the only thing that I change was the install CD. >> >> Is that possible ?, could be the reason ? >> SCTP is generating this problem ? >> >> >> >> Thanks to all. >> >> >> On 27-Oct-08, at 9:09 AM, Bjoern A. Zeeb wrote: >> >>> On Sun, 26 Oct 2008, Jose Amengual wrote: >>> >>> Hi, >>> >>> >>>> The problem persist even in stable 7.0, 7.1-PRERELEASE and 7.0- >>>> P5 , the >> postfix jail is living all the email in defer queue saying >> "Connection Time >> Out" >>>> >>>> This server give service to 300 clients and the network load os >>>> high. >>>> >>>> is there any clue how to resolve this ? >>>> >>> >>> sorry if I am not reading back various links which include mails I >>> had >>> sent which are entirely unrelated. >>> >>> So you are seeing TCP problems. And you are running with a firewall >>> enabled? >>> >>> Have you tried tcpdumping and seeing what exactly goes wrong? >>> >>> do you have any offload stuff enabled (as the subject suggests)? >>> If so >>> what happens if you disable this? >>> >>> /bz >>> >>> -- >>> Bjoern A. Zeeb Stop bit received. Insert coin for new >>> game. >>> _______________________________________________ >>> freebsd-current@freebsd.org mailing list >>> >> http://lists.freebsd.org/mailman/listinfo/freebsd-current >>> To unsubscribe, send any mail to >> "freebsd-current-unsubscribe@freebsd.org" >>> >> >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to >> "freebsd-stable-unsubscribe@freebsd.org" >> > > > -- > --linux(2.4/2.6),bsd(4.5.x+),solaris(2.5+) From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 13:14:04 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 15A541065675 for ; Tue, 28 Oct 2008 13:14:04 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: from qw-out-2122.google.com (qw-out-2122.google.com [74.125.92.24]) by mx1.freebsd.org (Postfix) with ESMTP id BB6588FC0A for ; Tue, 28 Oct 2008 13:14:03 +0000 (UTC) (envelope-from jose.amengual@gmail.com) Received: by qw-out-2122.google.com with SMTP id 9so1202840qwb.7 for ; Tue, 28 Oct 2008 06:14:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-mailer; bh=0T7b+uxVi7XohY8sey/ywMJ+4cEcyY9VX+xAaoOUJsM=; b=LKtdTTndaeEdF7ZEEPDbnPyG5AHZK6KnDRYdXWYjMsgAlddZlCq4yaMb4hIZYKQWBY 7a3D2srfXzG7u+bptf8UhijNNnLi5M7mXzn4xrx+P7PIkg9b65TbjV/cSVlRJaeiwy/r 3YgyVglD487nr1yNLodx0qON8u0FClY7bxKrg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-mailer; b=UrmsYkWtM1UivAaDpReAkp/RfArv54QgPjA13+tz6mBKIYOFi1XkuqqfKxMgE1nY+M +ZT5byl8KWyTOXgzJJ9ImtxLlK3tCqutWb+eHGfqeY5IBIcRqP/M6CPiwZR79/s81qHv pG1vJP+5Jz+W2eFPzJa4SooG40YWfTT0K/9uE= Received: by 10.215.13.13 with SMTP id q13mr763328qai.189.1225199643116; Tue, 28 Oct 2008 06:14:03 -0700 (PDT) Received: from ?192.168.42.174? ([190.8.72.74]) by mx.google.com with ESMTPS id 34sm3091740yxm.0.2008.10.28.06.14.00 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 28 Oct 2008 06:14:02 -0700 (PDT) Message-Id: From: Jose Amengual To: Jeremy Chadwick In-Reply-To: <20081028025454.GA37503@icarus.home.lan> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Tue, 28 Oct 2008 10:13:52 -0300 References: <20081027120802.G2978@maildrop.int.zabbadoz.net> <20081028025317.GA37415@icarus.home.lan> <20081028025454.GA37503@icarus.home.lan> X-Mailer: Apple Mail (2.929.2) Cc: "Bjoern A. Zeeb" , freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: Re: SOLUTION!!!! Re: tcp_do_segment....again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 13:14:04 -0000 Thanks for the answer. But as you can see in my post one of the steps was to downgrade to 7.0- p5 and the problem was still there. That's why I'm so confuse. On 27-Oct-08, at 11:54 PM, Jeremy Chadwick wrote: > On Mon, Oct 27, 2008 at 07:53:17PM -0700, Jeremy Chadwick wrote: >> On Mon, Oct 27, 2008 at 11:47:12PM -0300, Jose Amengual wrote: >>> Like my first post, I installed FreeBSD with the install cd 7.0- >>> STABLE-200807-i386-disc1.iso , then I update using cvsup and the >>> stable >>> supfile and I got the 7.1-PREREALEASE ( I don't know why I got 7.1 >>> has a >>> stable using the stablesupfile using RELENG_7 ). >> >> This has been discussed on this list twice in the past week. >> >> http://lists.freebsd.org/pipermail/freebsd-questions/2008-October/thread.html#184992 >> http://lists.freebsd.org/pipermail/freebsd-questions/2008-October/thread.html#185008 > > Well that's what I get for being subscribed to ~14 different FreeBSD > lists -- very difficult keeping track of all of them. Anyway, it > was discussed on -questions, not -stable, my apologies. > > -- > | Jeremy Chadwick jdc at parodius.com | > | Parodius Networking http://www.parodius.com/ | > | UNIX Systems Administrator Mountain View, CA, USA | > | Making life hard for others since 1977. PGP: 4BD6C0CB | > > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org > " From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 16:56:11 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5276E10656A4 for ; Tue, 28 Oct 2008 16:56:11 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.30]) by mx1.freebsd.org (Postfix) with ESMTP id 0D07C8FC16 for ; Tue, 28 Oct 2008 16:56:10 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by yw-out-2324.google.com with SMTP id 9so643545ywe.13 for ; Tue, 28 Oct 2008 09:56:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to :to:subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=u1uaUXPW7i3AmGJHOfote2POx1tu8u5BbRsGEgKUpWk=; b=BsQb+k7k/P43Y2DQUBsyucdIq8mWk0iBj+pZ7YpWVXtbX3uJFh+CGr7AyzRbFNRYcK niIMxLQNikxXUa81Rh3vDfHCu2EAmzCsWnPA/ApVQWFwVqp4+FokgES5Z3Pw99PLQLyd F3U00Sik6Yz7MZlSYTCKqn9kWt2L81nlR1VBY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:reply-to:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=e75JCpVWMGB8e3NPpDLmk/lMVDBgxiFCC6YbJXL5T7bzO9dOxvCYInEIuuY+cmtVMN foRwkm6lQazOhZmFGnUeSwP0fgFJ/D73K3uPZ92b0P+8o1zQlK2eVYVMCCmh4TG5jMpD TkdxqmrKG1KuinwAItI0d7bfZFonqQ8ryV4W0= Received: by 10.151.12.4 with SMTP id p4mr8884868ybi.85.1225212970038; Tue, 28 Oct 2008 09:56:10 -0700 (PDT) Received: by 10.151.11.21 with HTTP; Tue, 28 Oct 2008 09:56:10 -0700 (PDT) Message-ID: <8cb6106e0810280956lf864bdbqe46120e2d6816125@mail.gmail.com> Date: Tue, 28 Oct 2008 12:56:10 -0400 From: "Josh Carroll" To: "FreeBSD Stable" MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: src/lib/libc/stdlib/grantpt.c commit broke sshd X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 16:56:11 -0000 I just built world from RELENG_7 sources csup'd this morning, and it appears the change to src/lib/libc/stdlib/grantpt.c has broken sshd. I see the following when I attempt to login: Oct 28 12:32:34 pflog sshd[78236]: fatal: openpty returns device for which ttyname fails. Oct 28 12:32:34 pflog sshd[78236]: error: chown 0 0 failed: No such file or directory Oct 28 12:32:34 pflog sshd[78236]: error: chmod 0666 failed: No such file or directory If I back out the changes committed on 10/26 to grantpt.c, rebuild libc and restart sshd, I can login again properly. Here are the pty/tty related options in my kernel config: device pty # Pseudo-ttys (telnet etc) Note that I do not have: options COMPAT_43TTY Is COMPAT_43TTY necessary after this commit? Thanks, Josh From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 17:19:21 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C5E1F1065685 for ; Tue, 28 Oct 2008 17:19:21 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from wx-out-0506.google.com (wx-out-0506.google.com [66.249.82.237]) by mx1.freebsd.org (Postfix) with ESMTP id 7F0008FC0A for ; Tue, 28 Oct 2008 17:19:21 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by wx-out-0506.google.com with SMTP id s17so875818wxc.7 for ; Tue, 28 Oct 2008 10:19:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to :to:subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=cOl+va84ntlT9s92rFakidbsl7hSHtSDZDfzR44gFB4=; b=onX9B3cHyh415q1OnfdMES95dmpe+Dx/Pw9Lvyaptaje1Aa6C/DmPpduvoZ7Y664Lz MKH8bFzQTGF4NCOQ7LmNy/ZRDBwTxKMztR/MPhBecEm27oyfp0ydgd/efsOM9vWgcjix zRiRd+0Xdq3jYf+pmwxs6/W4dynNtFRviXfq0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:reply-to:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=G38jqrGOCeFKU/RA0ExFnyHcTy3BFMrX5pKQ/NoaatpzGyjauEoKy9PiyN+msS3WtI Pv8BBhAr182bvWa/xlwgL+JoYuX+5Nc9wd/TifyoUfGPozLQsH9MqYFcdXd5wunTFCbB LutaPKORmev0FZdxzkqOjKo4MJDU/VxB/i6Sw= Received: by 10.150.204.12 with SMTP id b12mr10035562ybg.245.1225214360425; Tue, 28 Oct 2008 10:19:20 -0700 (PDT) Received: by 10.151.11.21 with HTTP; Tue, 28 Oct 2008 10:19:20 -0700 (PDT) Message-ID: <8cb6106e0810281019n6b57ca02l676b327d9e9171dd@mail.gmail.com> Date: Tue, 28 Oct 2008 13:19:20 -0400 From: "Josh Carroll" To: "FreeBSD Stable" In-Reply-To: <8cb6106e0810280956lf864bdbqe46120e2d6816125@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0810280956lf864bdbqe46120e2d6816125@mail.gmail.com> Subject: [SOLVED] Re: src/lib/libc/stdlib/grantpt.c commit broke sshd X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 17:19:21 -0000 On Tue, Oct 28, 2008 at 12:56 PM, Josh Carroll wrote: > I just built world from RELENG_7 sources csup'd this morning, and it > appears the change to src/lib/libc/stdlib/grantpt.c has broken sshd. > > I see the following when I attempt to login: > > Oct 28 12:32:34 pflog sshd[78236]: fatal: openpty returns device for > which ttyname fails. > Oct 28 12:32:34 pflog sshd[78236]: error: chown 0 0 failed: No such > file or directory > Oct 28 12:32:34 pflog sshd[78236]: error: chmod 0666 failed: No such > file or directory Looks like libutil did not get built for some reason. Rebuilding libutil fixed the problem. Sorry for the noise! Josh From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 17:21:17 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A869D1065681 for ; Tue, 28 Oct 2008 17:21:17 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: from palm.hoeg.nl (unknown [IPv6:2001:7b8:613:100::211]) by mx1.freebsd.org (Postfix) with ESMTP id 493DA8FC23 for ; Tue, 28 Oct 2008 17:21:17 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: by palm.hoeg.nl (Postfix, from userid 1000) id CC71D1CC51; Tue, 28 Oct 2008 18:23:29 +0100 (CET) Date: Tue, 28 Oct 2008 18:23:29 +0100 From: Ed Schouten To: josh.carroll@gmail.com Message-ID: <20081028172329.GB1165@hoeg.nl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="f2QGlHpHGjS2mn6Y" Content-Disposition: inline User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-stable@freebsd.org Subject: Re: src/lib/libc/stdlib/grantpt.c commit broke sshd X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 17:21:17 -0000 --f2QGlHpHGjS2mn6Y Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello Josh, The commits I made two days ago were a little tricky. I made some modifications to libc and libutil at the same time. Unfortunately, due to a small case of API misuse in libutil, I couldn't keep older versions of libutil compatible with the new version of libc. Below is a small table with libutil vs libc versions: | libutil <=3D 26/10 | libutil > 26/10 | --------------+------------------+------------------+ libc <=3D 26/10 | Works | Works | libc > 26/10 | Doesn't work | Works | --------------+------------------+------------------+ I suspect you are running a new libc, but forgot to update libutil to the latest version as well. Keep in mind that such a setup is not really supported. Ah, right after I finished typing this message, Wesley Shields mentioned an older version of libutil was indeed your problem. Well, to others out there experiencing the same problem: make sure you update libutil as well. Thanks! --=20 Ed Schouten WWW: http://80386.nl/ --f2QGlHpHGjS2mn6Y Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkkHSpEACgkQ52SDGA2eCwXC1wCfYSNovbTUkjw4ta6Bi7tS0fbW iYAAmwULB0XGzmo2kAGpmD8BDkJqvL2V =9lxk -----END PGP SIGNATURE----- --f2QGlHpHGjS2mn6Y-- From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 17:27:09 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8D9A1106566C for ; Tue, 28 Oct 2008 17:27:09 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from mail-gx0-f15.google.com (mail-gx0-f15.google.com [209.85.217.15]) by mx1.freebsd.org (Postfix) with ESMTP id 463078FC1A for ; Tue, 28 Oct 2008 17:27:09 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by gxk8 with SMTP id 8so4130514gxk.19 for ; Tue, 28 Oct 2008 10:27:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to :to:subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=O8ZfgbGibEuNNLclZ0I0X2XEecYIpHVkASekMxzVwyM=; b=KpEMJ23Zp+DRz4X9TOsWG4o6U/buCAT//lhMmcrz9YzAUEJCfAMqhrHe7R/XJ/NBl+ onzfnz6Sji/IaEgeKpFq09hO0vQwoo8YSaeM1uP7zNPEkWA7tqzlYUMIm55jTfuxFwbB qNXFy11w5F4FIMs0CLX/nljs/WnQQoVFzserQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:reply-to:to:subject:cc:in-reply-to :mime-version:content-type:content-transfer-encoding :content-disposition:references; b=EYSKqe0xZO/bPtYiEIRfsEv5O+GewiJrcN0Gg7eRzYCGkOvhJKFyCfZQnyqfP4d4ht z40+1YCJ4dx5tKz7GsupQQj2uD+nJy8E6oXnJe+F6KGcE7wpswqP8VDkwr76YXO312xi XbkefxRo7wwP+bCu1bJDXz0X8OLMKk34HXXhY= Received: by 10.150.228.12 with SMTP id a12mr1630320ybh.61.1225214828532; Tue, 28 Oct 2008 10:27:08 -0700 (PDT) Received: by 10.151.11.21 with HTTP; Tue, 28 Oct 2008 10:27:08 -0700 (PDT) Message-ID: <8cb6106e0810281027p591b2707y36c9775dd2adfba0@mail.gmail.com> Date: Tue, 28 Oct 2008 13:27:08 -0400 From: "Josh Carroll" To: "Ed Schouten" In-Reply-To: <20081028172329.GB1165@hoeg.nl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081028172329.GB1165@hoeg.nl> Cc: freebsd-stable@freebsd.org Subject: Re: src/lib/libc/stdlib/grantpt.c commit broke sshd X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 17:27:09 -0000 > I suspect you are running a new libc, but forgot to update libutil to > the latest version as well. Keep in mind that such a setup is not really > supported. Yes, exactly my problem. The mystery on my end is now how I managed to build libc but not libutil. :) > Ah, right after I finished typing this message, Wesley Shields mentioned > an older version of libutil was indeed your problem. Well, to others out > there experiencing the same problem: make sure you update libutil as > well. Thanks! Yes, Wesley suggested I check whether libutil had been updated, and that did the trick. Thanks Ed/Wesley! Josh From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 17:29:37 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C64B5106566C for ; Tue, 28 Oct 2008 17:29:37 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: from palm.hoeg.nl (unknown [IPv6:2001:7b8:613:100::211]) by mx1.freebsd.org (Postfix) with ESMTP id 8BBE98FC17 for ; Tue, 28 Oct 2008 17:29:37 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: by palm.hoeg.nl (Postfix, from userid 1000) id 02E981CC51; Tue, 28 Oct 2008 18:31:49 +0100 (CET) Date: Tue, 28 Oct 2008 18:31:49 +0100 From: Ed Schouten To: josh.carroll@gmail.com Message-ID: <20081028173149.GC1165@hoeg.nl> References: <20081028172329.GB1165@hoeg.nl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="32u276st3Jlj2kUU" Content-Disposition: inline In-Reply-To: <20081028172329.GB1165@hoeg.nl> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-stable@freebsd.org Subject: Re: src/lib/libc/stdlib/grantpt.c commit broke sshd X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 17:29:37 -0000 --32u276st3Jlj2kUU Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi Josh, I forgot to reply to your second question: there is no real need to enable COMPAT_43TTY. It is possible that applications use this (by including ), but if you make sure your ports are up to date, they should not. is not present on FreeBSD -CURRENT, so I (and others) already made sure almost all ports compile without being present. So if you know what you're doing, you can just omit COMPAT_43TTY. If you are not, please leave it there. COMPAT_43TTY doesn't really add a lot of baggage, it only adds some additional ioctl()'s to TTY devices. --=20 Ed Schouten WWW: http://80386.nl/ --32u276st3Jlj2kUU Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkkHTIUACgkQ52SDGA2eCwXkqACfdJ0bA93/1L1CVygrFafgjrvP LuAAn1SepTf9NWwDVR4dBJLg0+xQ8rYA =WAF/ -----END PGP SIGNATURE----- --32u276st3Jlj2kUU-- From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 17:38:29 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DAA65106567E for ; Tue, 28 Oct 2008 17:38:29 +0000 (UTC) (envelope-from lopez.on.the.lists@yellowspace.net) Received: from mail.yellowspace.net (mail.yellowspace.net [80.190.200.164]) by mx1.freebsd.org (Postfix) with ESMTP id 724678FC17 for ; Tue, 28 Oct 2008 17:38:29 +0000 (UTC) (envelope-from lopez.on.the.lists@yellowspace.net) Received: from five.intranet ([62.216.211.194]) (AUTH: LOGIN lopez.on.the.lists@yellowspace.net) by mail.yellowspace.net with esmtp; Tue, 28 Oct 2008 18:28:19 +0100 id 00386DC1.0000000049074BB3.00011756 Message-Id: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> From: Lorenzo Perone To: Charles Sprickman In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Tue, 28 Oct 2008 18:28:18 +0100 References: X-Mailer: Apple Mail (2.929.2) Cc: stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 17:38:29 -0000 Hi, there's a patch by Bjoern A.Zeeb, available at http://people.freebsd.org/~bz/bz_jail7-20080920-01-at150161.diff which succeeds and works well with 7.1-PRERELEASE currently. I had similar issues to solve and patched several hosts with it, so far with success. Bjoern has made an excellent work in patching all relevant parts, so you'll be able to use the stock rc.d/jail script as well as having an updated manpage and a jls -v which shows all the IPs while preserving compatibility with scripts making assumptions on the usual jls output. Please see the freebsd-jail mailing list archives of the last weeks and months for more info. I hope very much that these patches will be included officially in RELENG_7 soon. Regards, Lorenzo On 28.10.2008, at 07:32, Charles Sprickman wrote: > Hello all, > > I've been searching around and have come up with no current > discussions on this issue. I'll keep it brief: > > In 7.0 or 7.1 is there any provision to have multiple IP addresses > in a jail? > > I'm stumped on this, as I just started a new hosting project that > needs a few jails. At least one of those requires multiple IPs, > which is something I never really even realized was not supported. > What puzzles me more is that before I decided to host this stuff > myself, I was shopping for FreeBSD VPS providers, and I noticed that > Verio is actually offering what looks like jails as VPSs, and they > are offering multiple IPs. Is this something they hacked up and did > not contribute back? > > Is there any firewall hackery to be had that can at least let me do > IP based virtual hosts for web hosting? > > Thanks, > > Charles > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org > " From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 18:07:36 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E7A3E1065679 for ; Tue, 28 Oct 2008 18:07:36 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from sarah.protected-networks.net (sarah.protected-networks.net [IPv6:2001:470:1f07:4e1::1]) by mx1.freebsd.org (Postfix) with ESMTP id AA5F48FC19 for ; Tue, 28 Oct 2008 18:07:36 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from [127.0.0.1] (localhost [IPv6:::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) (Authenticated sender: imb) by sarah.protected-networks.net (Postfix) with ESMTPSA id D799360D3; Tue, 28 Oct 2008 14:07:34 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=protected-networks.net; s=200705; t=1225217255; bh=63x8U+i1VfY6jn m6GGojfZNjdF/SwuF8WyB3GOLusLg=; h=Message-ID:Date:From:MIME-Version: To:CC:Subject:References:In-Reply-To:Content-Type: Content-Transfer-Encoding; b=py8L3Ugd0lkIXQljpv3xdN1DK5c/RHVyR/Vuj C91zYTcPSm2CuwzRy3zYfZm7r4iZ+upccnPU5BShGsd6F7o1UIdVgyQrZyqG9i/ry6q j8pQGZGJhFwdNvntgcYmG7FC DomainKey-Signature: a=rsa-sha1; s=200509; d=protected-networks.net; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:cc:subject: references:in-reply-to:content-type:content-transfer-encoding; b=UAd3HBVJGweHWcQ0oFO/CLAFvnJ7OjVw3HxJKUDhRl0JDjqQZgwjC9a+OsiNRS5EU AqTKVeICaObsQyLV66hpz5A7i2TKuLrtgI2qkOA73yBi27LxCQmS5nrkQ3+ycNT Message-ID: <490754D5.8050202@protected-networks.net> Date: Tue, 28 Oct 2008 14:07:17 -0400 From: Michael Butler User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: Lorenzo Perone References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> In-Reply-To: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 18:07:37 -0000 Lorenzo Perone wrote: > Hi, there's a patch by Bjoern A.Zeeb, available at > http://people.freebsd.org/~bz/bz_jail7-20080920-01-at150161.diff > > which succeeds and works well with 7.1-PRERELEASE currently. > I had similar issues to solve and patched several hosts > with it, so far with success. > > Bjoern has made an excellent work in patching all > relevant parts, so you'll be able to use the stock > rc.d/jail script as well as having an updated manpage > and a jls -v which shows all the IPs while preserving > compatibility with scripts making assumptions on > the usual jls output. > > Please see the freebsd-jail mailing list archives of > the last weeks and months for more info. > > I hope very much that these patches will be included > officially in RELENG_7 soon. This seems to imply that, at last, IPv6 addresses can be used in jails - is that true? Michael From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 18:18:28 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 64F89106567A for ; Tue, 28 Oct 2008 18:18:28 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.cksoft.de (mail.cksoft.de [62.111.66.27]) by mx1.freebsd.org (Postfix) with ESMTP id 1C74B8FC0A for ; Tue, 28 Oct 2008 18:18:28 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from localhost (amavis.str.cksoft.de [192.168.74.71]) by mail.cksoft.de (Postfix) with ESMTP id 28EA341C64A; Tue, 28 Oct 2008 19:18:26 +0100 (CET) X-Virus-Scanned: amavisd-new at cksoft.de Received: from mail.cksoft.de ([62.111.66.27]) by localhost (amavis.str.cksoft.de [192.168.74.71]) (amavisd-new, port 10024) with ESMTP id 569FeKiDyse8; Tue, 28 Oct 2008 19:18:25 +0100 (CET) Received: by mail.cksoft.de (Postfix, from userid 66) id B599D41C65F; Tue, 28 Oct 2008 19:18:25 +0100 (CET) Received: from maildrop.int.zabbadoz.net (maildrop.int.zabbadoz.net [10.111.66.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.int.zabbadoz.net (Postfix) with ESMTP id 93D1F44487F; Tue, 28 Oct 2008 18:18:16 +0000 (UTC) Date: Tue, 28 Oct 2008 18:18:15 +0000 (UTC) From: "Bjoern A. Zeeb" X-X-Sender: bz@maildrop.int.zabbadoz.net To: Michael Butler In-Reply-To: <490754D5.8050202@protected-networks.net> Message-ID: <20081028181744.Q2978@maildrop.int.zabbadoz.net> References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <490754D5.8050202@protected-networks.net> X-OpenPGP-Key: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Lorenzo Perone , stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-jail@freebsd.org List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 18:18:28 -0000 On Tue, 28 Oct 2008, Michael Butler wrote: > Lorenzo Perone wrote: >> Hi, there's a patch by Bjoern A.Zeeb, available at >> http://people.freebsd.org/~bz/bz_jail7-20080920-01-at150161.diff >> >> which succeeds and works well with 7.1-PRERELEASE currently. >> I had similar issues to solve and patched several hosts >> with it, so far with success. >> >> Bjoern has made an excellent work in patching all >> relevant parts, so you'll be able to use the stock >> rc.d/jail script as well as having an updated manpage >> and a jls -v which shows all the IPs while preserving >> compatibility with scripts making assumptions on >> the usual jls output. >> >> Please see the freebsd-jail mailing list archives of >> the last weeks and months for more info. >> >> I hope very much that these patches will be included >> officially in RELENG_7 soon. > This seems to imply that, at last, IPv6 addresses can be used in jails - > is that true? yes -- Bjoern A. Zeeb Stop bit received. Insert coin for new game. From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 18:20:20 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 85F311065676; Tue, 28 Oct 2008 18:20:20 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from sarah.protected-networks.net (sarah.protected-networks.net [IPv6:2001:470:1f07:4e1::1]) by mx1.freebsd.org (Postfix) with ESMTP id 4592D8FC23; Tue, 28 Oct 2008 18:20:20 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from [127.0.0.1] (localhost [IPv6:::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) (Authenticated sender: imb) by sarah.protected-networks.net (Postfix) with ESMTPSA id A692960D3; Tue, 28 Oct 2008 14:20:18 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=protected-networks.net; s=200705; t=1225218018; bh=kmFl0CoJWfm/6d bHu7Lptswz/TOZ0fHt2FlOHQV7040=; h=Message-ID:Date:From:MIME-Version: To:CC:Subject:References:In-Reply-To:Content-Type: Content-Transfer-Encoding; b=gAtNH9sw9gdOEH5HfQhMLsWG8OjV2qjMGGSHC NRxovOqYuXw4UCnER4C2kWtpUCs47VYtJe4Qsgcu/ioAxlIWsD6uUK2Yz5P8qNx5IOy ig+pPOXZvUD3mNYDYeYuWEXm DomainKey-Signature: a=rsa-sha1; s=200509; d=protected-networks.net; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:cc:subject: references:in-reply-to:content-type:content-transfer-encoding; b=EKL+NsiXDtGohjN8TeJ+4CgPFBx+14Jxscu19eDUnzPhWpKlF8DW76GLgFfuQhXAw eJy3N9qVUOBqhNub+xiTZ1wrjndc2hz6ObY3uIIw/RXP3D/F/enNyvAPWrGe+jh Message-ID: <490757D1.6080709@protected-networks.net> Date: Tue, 28 Oct 2008 14:20:01 -0400 From: Michael Butler User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: freebsd-jail@freebsd.org References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <490754D5.8050202@protected-networks.net> <20081028181744.Q2978@maildrop.int.zabbadoz.net> In-Reply-To: <20081028181744.Q2978@maildrop.int.zabbadoz.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Lorenzo Perone , stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 18:20:20 -0000 Bjoern A. Zeeb wrote: >> This seems to imply that, at last, IPv6 addresses can be used in jails - >> is that true? > yes Woohoo! THANKS! :-) Michael From owner-freebsd-stable@FreeBSD.ORG Tue Oct 28 21:51:30 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C00B61065678 for ; Tue, 28 Oct 2008 21:51:30 +0000 (UTC) (envelope-from chris@smartt.com) Received: from nov.smartt.com (nov.smartt.com [69.31.173.253]) by mx1.freebsd.org (Postfix) with ESMTP id 8AACE8FC13 for ; Tue, 28 Oct 2008 21:51:30 +0000 (UTC) (envelope-from chris@smartt.com) Received: from [69.31.174.220] ([69.31.174.220]) (authenticated bits=0) by nov.smartt.com (8.13.8/8.13.5) with ESMTP id m9SLQDJ0011216; Tue, 28 Oct 2008 14:26:13 -0700 Message-ID: <49078377.2090807@smartt.com> Date: Tue, 28 Oct 2008 14:26:15 -0700 From: Chris St Denis User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: Lorenzo Perone References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> In-Reply-To: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-3.1 required=5.0 tests=AWL,BAYES_00,SPF_PASS autolearn=ham version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on nov.smartt.com Cc: Charles Sprickman , stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Oct 2008 21:51:30 -0000 Lorenzo Perone wrote: > > > Hi, there's a patch by Bjoern A.Zeeb, available at > http://people.freebsd.org/~bz/bz_jail7-20080920-01-at150161.diff > > which succeeds and works well with 7.1-PRERELEASE currently. > I had similar issues to solve and patched several hosts > with it, so far with success. > > Bjoern has made an excellent work in patching all > relevant parts, so you'll be able to use the stock > rc.d/jail script as well as having an updated manpage > and a jls -v which shows all the IPs while preserving > compatibility with scripts making assumptions on > the usual jls output. > > Please see the freebsd-jail mailing list archives of > the last weeks and months for more info. > > I hope very much that these patches will be included > officially in RELENG_7 soon. > > Regards, > > Lorenzo > > > > > On 28.10.2008, at 07:32, Charles Sprickman wrote: > >> Hello all, >> >> I've been searching around and have come up with no current >> discussions on this issue. I'll keep it brief: >> >> In 7.0 or 7.1 is there any provision to have multiple IP addresses in >> a jail? >> >> I'm stumped on this, as I just started a new hosting project that >> needs a few jails. At least one of those requires multiple IPs, >> which is something I never really even realized was not supported. >> What puzzles me more is that before I decided to host this stuff >> myself, I was shopping for FreeBSD VPS providers, and I noticed that >> Verio is actually offering what looks like jails as VPSs, and they >> are offering multiple IPs. Is this something they hacked up and did >> not contribute back? >> >> Is there any firewall hackery to be had that can at least let me do >> IP based virtual hosts for web hosting? >> >> Thanks, >> >> Charles >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to >> "freebsd-stable-unsubscribe@freebsd.org" > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" Serious question here (not trolling). These patches have been around for years, why have they never been committed to trunk/stable? From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 00:14:34 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 92B1F106568C for ; Wed, 29 Oct 2008 00:14:34 +0000 (UTC) (envelope-from freebsd@hub.org) Received: from hub.org (hub.org [200.46.204.220]) by mx1.freebsd.org (Postfix) with ESMTP id 6335F8FC13 for ; Wed, 29 Oct 2008 00:14:34 +0000 (UTC) (envelope-from freebsd@hub.org) Received: from localhost (unknown [200.46.204.183]) by hub.org (Postfix) with ESMTP id 5925511A2C85; Tue, 28 Oct 2008 20:56:59 -0300 (ADT) Received: from hub.org ([200.46.204.220]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 24549-03; Tue, 28 Oct 2008 20:56:58 -0300 (ADT) Received: from [192.168.1.2] (blk-224-204-104.eastlink.ca [24.224.204.104]) by hub.org (Postfix) with ESMTPA id 4445011A2878; Tue, 28 Oct 2008 20:56:58 -0300 (ADT) Date: Tue, 28 Oct 2008 20:56:55 -0300 From: "Marc G. Fournier" To: freebsd-net@freebsd.org, freebsd-stable@freebsd.org Message-ID: X-Mailer: Mulberry/4.0.8 (Linux/x86) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Subject: Problem with Bridging ... and bge devices under FreeBSD 7.x? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 00:14:34 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I'm trying to run a QEMU VM on top of a FreeBSD 7.x server ... I've tried the exact same setup on my desktop, using 192.168.1.x and an fxp device, and it all works perfectly, but as soon as I do this on another machine on a public IP, I'm not getting any routing, I can't even ping it from the same machine ... My first thought was that there was an issue with IP aliases already on the bge device, but tried doing the following: ifconfig bridge0 destroy ifconfig tap0 destroy ifconfig fxp0 -alias 192.168.1.101 ifconfig fxp0 alias 192.168.1.101 netmask 255.255.255.255 ifconfig bridge0 create ifconfig tap0 create ifconfig bridge0 addm fxp0 addm tap0 up on my desktop here and then starting up the qemu image, and all worked as expected, so having an alias on the interface, before or after, doesn't make a difference ... at least with the fxp device ... Using VNC to connect to the VM, I can look at the interface, and it says it is connected ... and the IP/Gateway are all set right for the network I'm on, netmask is set to 255.255.255.0, same as on the 'private network' ... Please note that when I say "it works" on my private network / desktop, I'm using it to connect to my work computer, across the Internet, via Windows RDP, and it works flawlessly ... Looking at /var/log/messages, you can see the bridge being setup: Oct 27 18:53:21 io kernel: bridge0: Ethernet address: ce:44:c7:1b:47:40 as well as the tap device: Oct 27 18:53:25 io kernel: tap0: Ethernet address: 00:bd:96:ae:67:00 Oct 27 18:53:41 io kernel: tap0: promiscuous mode enabled and the ethernet going promiscuous: Oct 26 20:53:56 ganymede kernel: fxp0: promiscuous mode enabled So, all I have left is that everything is being setup okay, but there is something I'm missing here ... something with bridge<->bge, maybe? I've even tries to compare the output of 'ifconfig -a' as far as the bridge0 and tap0 devices are concerned, and other then the mac address, they look identical also ... So, pointers to what I may be missing here? a sysctl value that I need to set for this interface? Thanks ... - -- Marc G. Fournier Hub.Org Hosting Solutions S.A. (http://www.hub.org) Email . scrappy@hub.org MSN . scrappy@hub.org Yahoo . yscrappy Skype: hub.org ICQ . 7615664 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkkHpscACgkQ4QvfyHIvDvPnFgCgk+6Pg+QeYO0BD9KMIkyZK2g7 JWgAn3VHq+F1OzD9M8VuYLEZDQLfFsNU =+3J/ -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 02:35:32 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CA1101065680 for ; Wed, 29 Oct 2008 02:35:32 +0000 (UTC) (envelope-from mike@jellydonut.org) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.156]) by mx1.freebsd.org (Postfix) with ESMTP id 42C368FC13 for ; Wed, 29 Oct 2008 02:35:31 +0000 (UTC) (envelope-from mike@jellydonut.org) Received: by fg-out-1718.google.com with SMTP id l26so2423134fgb.35 for ; Tue, 28 Oct 2008 19:35:30 -0700 (PDT) Received: by 10.181.228.15 with SMTP id f15mr36226bkr.152.1225246098726; Tue, 28 Oct 2008 19:08:18 -0700 (PDT) Received: by 10.181.17.8 with HTTP; Tue, 28 Oct 2008 19:08:18 -0700 (PDT) Message-ID: <1de79840810281908i616a8086r474d4329de184f37@mail.gmail.com> Date: Tue, 28 Oct 2008 22:08:18 -0400 From: "Michael Proto" To: "Marc G. Fournier" In-Reply-To: MIME-Version: 1.0 References: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Problem with Bridging ... and bge devices under FreeBSD 7.x? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 02:35:33 -0000 On Tue, Oct 28, 2008 at 7:56 PM, Marc G. Fournier wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > I'm trying to run a QEMU VM on top of a FreeBSD 7.x server ... I've tried > the > exact same setup on my desktop, using 192.168.1.x and an fxp device, and it > all > works perfectly, but as soon as I do this on another machine on a public > IP, > I'm not getting any routing, I can't even ping it from the same machine ... > > My first thought was that there was an issue with IP aliases already on > the > bge device, but tried doing the following: > > ifconfig bridge0 destroy > ifconfig tap0 destroy > ifconfig fxp0 -alias 192.168.1.101 > ifconfig fxp0 alias 192.168.1.101 netmask 255.255.255.255 > ifconfig bridge0 create > ifconfig tap0 create > ifconfig bridge0 addm fxp0 addm tap0 up > > on my desktop here and then starting up the qemu image, and all worked as > expected, so having an alias on the interface, before or after, doesn't > make a > difference ... at least with the fxp device ... > > Using VNC to connect to the VM, I can look at the interface, and it says it > is > connected ... and the IP/Gateway are all set right for the network I'm on, > netmask is set to 255.255.255.0, same as on the 'private network' ... > > Please note that when I say "it works" on my private network / desktop, I'm > using it to connect to my work computer, across the Internet, via Windows > RDP, > and it works flawlessly ... > > Looking at /var/log/messages, you can see the bridge being setup: > > > Oct 27 18:53:21 io kernel: bridge0: Ethernet address: ce:44:c7:1b:47:40 > > as well as the tap device: > > Oct 27 18:53:25 io kernel: tap0: Ethernet address: 00:bd:96:ae:67:00 > Oct 27 18:53:41 io kernel: tap0: promiscuous mode enabled > > and the ethernet going promiscuous: > > Oct 26 20:53:56 ganymede kernel: fxp0: promiscuous mode enabled > > So, all I have left is that everything is being setup okay, but there is > something I'm missing here ... something with bridge<->bge, maybe? I've > even > tries to compare the output of 'ifconfig -a' as far as the bridge0 and tap0 > devices are concerned, and other then the mac address, they look identical > also > ... > > So, pointers to what I may be missing here? a sysctl value that I need to > set > for this interface? > > I'm having a little trouble understanding the setup you have. In your test case, is the IP of your VM 192.168.1.101? If so, then I don't think you want that IP aliased on the physical interface of your bridge. The VM NIC will answer for packets destined on your local segment, which the bridge would forward to the physical interface. If you assign the VM's IP to that physical interface, then your host would think that traffic is destined for itself and not pass it to the bridge. If I'm misunderstanding and the 192.168.1.101 alias (or whatever the equiv in your production setup) isn't being used by your VM then I would start looking at the ARP traffic crossing both the tap0, lo0, and physical interfaces. What does an 'ifconfig -a' look like on both systems? netstat -rn? Any packet filtering? -Proto From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 03:35:45 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D9D5D1065672; Wed, 29 Oct 2008 03:35:45 +0000 (UTC) (envelope-from freebsd@hub.org) Received: from hub.org (hub.org [200.46.204.220]) by mx1.freebsd.org (Postfix) with ESMTP id 9E3518FC0A; Wed, 29 Oct 2008 03:35:45 +0000 (UTC) (envelope-from freebsd@hub.org) Received: from localhost (unknown [200.46.204.183]) by hub.org (Postfix) with ESMTP id 57C8E11A2C85; Wed, 29 Oct 2008 00:35:42 -0300 (ADT) Received: from hub.org ([200.46.204.220]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 70756-02; Wed, 29 Oct 2008 00:35:38 -0300 (ADT) Received: from [192.168.1.2] (blk-224-204-104.eastlink.ca [24.224.204.104]) by hub.org (Postfix) with ESMTPA id 63F5711A2872; Wed, 29 Oct 2008 00:35:36 -0300 (ADT) Date: Wed, 29 Oct 2008 00:35:35 -0300 From: "Marc G. Fournier" To: Michael Proto , "Marc G. Fournier" Message-ID: X-Mailer: Mulberry/4.0.8 (Linux/x86) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: freebsd-net@freebsd.org, freebsd-stable@freebsd.org Subject: Re: Problem with Bridging ... and bge devices under FreeBSD 7.x? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 03:35:46 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 - --On Tuesday, October 28, 2008 22:08:18 -0400 Michael Proto wrote: > > > > On Tue, Oct 28, 2008 at 7:56 PM, Marc G. Fournier wrote: > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > I'm trying to run a QEMU VM on top of a FreeBSD 7.x server ... I've tried the > exact same setup on my desktop, using 192.168.1.x and an fxp device, and it > all > works perfectly, but as soon as I do this on another machine on a public IP, > I'm not getting any routing, I can't even ping it from the same machine ... > > My first thought was that there was an issue with IP aliases already on the > bge device, but tried doing the following: > > ifconfig bridge0 destroy > ifconfig tap0 destroy > ifconfig fxp0 -alias 192.168.1.101 > ifconfig fxp0 alias 192.168.1.101 netmask 255.255.255.255 > ifconfig bridge0 create > ifconfig tap0 create > ifconfig bridge0 addm fxp0 addm tap0 up > > on my desktop here and then starting up the qemu image, and all worked as > expected, so having an alias on the interface, before or after, doesn't make a > difference ... at least with the fxp device ... > > Using VNC to connect to the VM, I can look at the interface, and it says it is > connected ... and the IP/Gateway are all set right for the network I'm on, > netmask is set to 255.255.255.0, same as on the 'private network' ... > > Please note that when I say "it works" on my private network / desktop, I'm > using it to connect to my work computer, across the Internet, via Windows RDP, > and it works flawlessly ... > > Looking at /var/log/messages, you can see the bridge being setup: > > > Oct 27 18:53:21 io kernel: bridge0: Ethernet address: ce:44:c7:1b:47:40 > > as well as the tap device: > > Oct 27 18:53:25 io kernel: tap0: Ethernet address: 00:bd:96:ae:67:00 > Oct 27 18:53:41 io kernel: tap0: promiscuous mode enabled > > and the ethernet going promiscuous: > > Oct 26 20:53:56 ganymede kernel: fxp0: promiscuous mode enabled > > So, all I have left is that everything is being setup okay, but there is > something I'm missing here ... something with bridge<->bge, maybe? I've even > tries to compare the output of 'ifconfig -a' as far as the bridge0 and tap0 > devices are concerned, and other then the mac address, they look identical > also > ... > > So, pointers to what I may be missing here? a sysctl value that I need to set > for this interface? > > > > > I'm having a little trouble understanding the setup you have. In your test > case, is the IP of your VM 192.168.1.101? If so, then I don't think you want > that IP aliased on the physical interface of your bridge. The VM NIC will > answer for packets destined on your local segment, which the bridge would > forward to the physical interface. If you assign the VM's IP to that physical > interface, then your host would think that traffic is destined for itself and > not pass it to the bridge. > > If I'm misunderstanding and the 192.168.1.101 alias (or whatever the equiv in > your production setup) isn't being used by your VM then I would start looking > at the ARP traffic crossing both the tap0, lo0, and physical interfaces. > > What does an 'ifconfig -a' look like on both systems? netstat -rn? Any packet > filtering? I always fear I'm going to send more info then I should, and generate chaos and confusion :) On my test box, the VM is set to 192.168.1.100 ... the alias I added to fxp0 was to simulate what I have on the "public server", where there is a bge0 device with n aliases attached to it ... in no case is the IP assigned to the VM actually aliased onto any interface on the network itself Now, to try and answer your other questions ... netstat -nr on the 192 server shows the IP to be at: > netstat -nr | grep 168.1.100 192.168.1.100 52:54:00:12:34:56 UHLW 1 1 fxp0 1128 which is very odd, as that MAC address is not found via ifconfig -a: > ifconfig -a | grep 52 > while arp -a also shows the 52:54 MAC, although MACs for the ifconfig -a are, in fact: > ifconfig -a | grep ether ether 00:02:b3:ee:da:3e ether 5e:d1:e6:8b:55:50 ether 00:bd:25:18:6d:00 On the server, I'm getting nothing in arp or netstat for the IP in question: io# arp -a | grep 204.213 io# netstat -nr | grep 204.213 io# I've even tried doing a ping *from* the VM (logged in with VNC) to see if it will broadcast itself out, and nothing ... I'm starting QEMU on both servers with the same options as well: qemu -m 512M -net nic -net tap winxp.img just to confirm that I'm not doing anything different for attaching to the network ... So, right now, all I can see as being "different" is bge vs fxp interfaces ... both machines are running 7.x ... - -- Marc G. Fournier Hub.Org Hosting Solutions S.A. (http://www.hub.org) Email . scrappy@hub.org MSN . scrappy@hub.org Yahoo . yscrappy Skype: hub.org ICQ . 7615664 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkkH2gcACgkQ4QvfyHIvDvNHUgCgtQORpycxkREQuiogWWOwydWG WfUAoOlRghz5Iy7XYWwwpOI5JgMjmBfi =3Q5f -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 04:32:33 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 460B21065675 for ; Wed, 29 Oct 2008 04:32:33 +0000 (UTC) (envelope-from bakul@bitblocks.com) Received: from mail.bitblocks.com (bitblocks.com [64.142.15.60]) by mx1.freebsd.org (Postfix) with ESMTP id 211AC8FC1C for ; Wed, 29 Oct 2008 04:32:33 +0000 (UTC) (envelope-from bakul@bitblocks.com) Received: from bitblocks.com (localhost.bitblocks.com [127.0.0.1]) by mail.bitblocks.com (Postfix) with ESMTP id DC80C5B46; Tue, 28 Oct 2008 21:14:28 -0700 (PDT) To: "Marc G. Fournier" In-reply-to: Your message of "Wed, 29 Oct 2008 00:35:35 -0300." References: Comments: In-reply-to "Marc G. Fournier" message dated "Wed, 29 Oct 2008 00:35:35 -0300." Date: Tue, 28 Oct 2008 21:14:28 -0700 From: Bakul Shah Message-Id: <20081029041428.DC80C5B46@mail.bitblocks.com> Cc: Michael Proto , freebsd-stable@freebsd.org, freebsd-net@freebsd.org Subject: Re: Problem with Bridging ... and bge devices under FreeBSD 7.x? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 04:32:33 -0000 On Wed, 29 Oct 2008 00:35:35 -0300 "Marc G. Fournier" wrote: > netstat -nr on the 192 server shows the IP to be at: > > > netstat -nr | grep 168.1.100 > 192.168.1.100 52:54:00:12:34:56 UHLW 1 1 fxp0 1128 > > which is very odd, as that MAC address is not found via ifconfig -a: > > > ifconfig -a | grep 52 > > > > while arp -a also shows the 52:54 MAC, although MACs for the ifconfig -a are, > > in fact: > > > ifconfig -a | grep ether > ether 00:02:b3:ee:da:3e > ether 5e:d1:e6:8b:55:50 > ether 00:bd:25:18:6d:00 The setup you get with a tap device talking to qemu is this: [host]-tap0----qemu---ed0-[VM] Each end has its own mac address. The VM's NIC (ed0 or rl0 or whatever) gets addresses like 52:54:00:12:34:56. The host will have an arp entry for it once the VM sends an arp packet. But tap0 will have an address assigned by the tap driver, something like 00:bd:xx:xx:xx. If you have two VMs running at the same time on two different machines and they both have identical MAC addresses, that could be part of your problem. But your network topolgy is still not clear. What would help is something like this: You have: machine A (runs VM A1). machine B (runs VM B1). machine C (runs windows). Can you ping from A to C? Can you ping from B to C? Can you ping from A to A1? Can you ping from B to B1? Can you ping from A1 to C? Can you ping from B1 to C? Can you ping from C to A1? Can you ping from C to B1? All of the above should work. Next you can try tcpdump on tap devices to see what is going on. If you are still stumped provide ifconfig -a output on A, B, C, A1 and B1. On windows machine you can do ipconfig/all to get at this information (IIRC). From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 04:38:53 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E5C6C1065690; Wed, 29 Oct 2008 04:38:53 +0000 (UTC) (envelope-from freebsd@hub.org) Received: from hub.org (hub.org [200.46.204.220]) by mx1.freebsd.org (Postfix) with ESMTP id 806DA8FC0C; Wed, 29 Oct 2008 04:38:53 +0000 (UTC) (envelope-from freebsd@hub.org) Received: from localhost (unknown [200.46.204.183]) by hub.org (Postfix) with ESMTP id 7C06311A2CB9; Wed, 29 Oct 2008 01:38:51 -0300 (ADT) Received: from hub.org ([200.46.204.220]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 84723-01; Wed, 29 Oct 2008 01:38:43 -0300 (ADT) Received: from [192.168.1.2] (blk-224-204-104.eastlink.ca [24.224.204.104]) by hub.org (Postfix) with ESMTPA id CDB4911A2878; Wed, 29 Oct 2008 01:38:41 -0300 (ADT) Date: Wed, 29 Oct 2008 01:38:38 -0300 From: "Marc G. Fournier" To: Bakul Shah , "Marc G. Fournier" Message-ID: <7762927ECAFF08B969F9E5A0@ganymede.hub.org> In-Reply-To: <20081029041428.DC80C5B46@mail.bitblocks.com> References: <20081029041428.DC80C5B46@mail.bitblocks.com> X-Mailer: Mulberry/4.0.8 (Linux/x86) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Michael Proto , freebsd-stable@freebsd.org, freebsd-net@freebsd.org Subject: Re: Problem with Bridging ... and bge devices under FreeBSD 7.x? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 04:38:54 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I only have one VM running on one server ... - --On Tuesday, October 28, 2008 21:14:28 -0700 Bakul Shah wrote: > On Wed, 29 Oct 2008 00:35:35 -0300 "Marc G. Fournier" > wrote: >> netstat -nr on the 192 server shows the IP to be at: >> >> > netstat -nr | grep 168.1.100 >> 192.168.1.100 52:54:00:12:34:56 UHLW 1 1 fxp0 1128 >> >> which is very odd, as that MAC address is not found via ifconfig -a: >> >> > ifconfig -a | grep 52 >> > >> >> while arp -a also shows the 52:54 MAC, although MACs for the ifconfig -a are, >> >> in fact: >> >> > ifconfig -a | grep ether >> ether 00:02:b3:ee:da:3e >> ether 5e:d1:e6:8b:55:50 >> ether 00:bd:25:18:6d:00 > > The setup you get with a tap device talking to qemu is this: > > [host]-tap0----qemu---ed0-[VM] > > Each end has its own mac address. The VM's NIC (ed0 or rl0 > or whatever) gets addresses like 52:54:00:12:34:56. The host > will have an arp entry for it once the VM sends an arp > packet. But tap0 will have an address assigned by the tap > driver, something like 00:bd:xx:xx:xx. > > If you have two VMs running at the same time on two different > machines and they both have identical MAC addresses, that > could be part of your problem. > > But your network topolgy is still not clear. What would help > is something like this: > > You have: > machine A (runs VM A1). > machine B (runs VM B1). > machine C (runs windows). > > Can you ping from A to C? > Can you ping from B to C? > Can you ping from A to A1? > Can you ping from B to B1? > Can you ping from A1 to C? > Can you ping from B1 to C? > Can you ping from C to A1? > Can you ping from C to B1? > > All of the above should work. Next you can try tcpdump on > tap devices to see what is going on. If you are still > stumped provide ifconfig -a output on A, B, C, A1 and B1. On > windows machine you can do ipconfig/all to get at this > information (IIRC). - -- Marc G. Fournier Hub.Org Hosting Solutions S.A. (http://www.hub.org) Email . scrappy@hub.org MSN . scrappy@hub.org Yahoo . yscrappy Skype: hub.org ICQ . 7615664 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkkH6M4ACgkQ4QvfyHIvDvPciwCgi3LwM74g8DPrRC4XlkNQgFD4 eRgAnj6/CUVTkrzwr8GnzawWKlbfCWBc =KgEt -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 07:45:08 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 27BBB1065676; Wed, 29 Oct 2008 07:45:08 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.cksoft.de (mail.cksoft.de [62.111.66.27]) by mx1.freebsd.org (Postfix) with ESMTP id CC6298FC16; Wed, 29 Oct 2008 07:45:07 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from localhost (amavis.str.cksoft.de [192.168.74.71]) by mail.cksoft.de (Postfix) with ESMTP id 2DABE41C63C; Wed, 29 Oct 2008 08:45:06 +0100 (CET) X-Virus-Scanned: amavisd-new at cksoft.de Received: from mail.cksoft.de ([62.111.66.27]) by localhost (amavis.str.cksoft.de [192.168.74.71]) (amavisd-new, port 10024) with ESMTP id 8OXdOnRFXvR1; Wed, 29 Oct 2008 08:45:05 +0100 (CET) Received: by mail.cksoft.de (Postfix, from userid 66) id BFF9741C615; Wed, 29 Oct 2008 08:45:05 +0100 (CET) Received: from maildrop.int.zabbadoz.net (maildrop.int.zabbadoz.net [10.111.66.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.int.zabbadoz.net (Postfix) with ESMTP id 6931644487F; Wed, 29 Oct 2008 07:42:23 +0000 (UTC) Date: Wed, 29 Oct 2008 07:42:22 +0000 (UTC) From: "Bjoern A. Zeeb" X-X-Sender: bz@maildrop.int.zabbadoz.net To: Chris St Denis In-Reply-To: <49078377.2090807@smartt.com> Message-ID: <20081029072821.S2978@maildrop.int.zabbadoz.net> References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <49078377.2090807@smartt.com> X-OpenPGP-Key: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: stable@freebsd.org, freebsd-jail@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-jail@freebsd.org List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 07:45:08 -0000 On Tue, 28 Oct 2008, Chris St Denis wrote: Hi, [ jail patches ] > Serious question here (not trolling). > > These patches have been around for years, why have they never been committed > to trunk/stable? Well, the multi-ipv4 patch has been for a while - what we are talking about at the moment is more. If you look at older status reports they said soemthing like "there is the need for this at the moment but it's not considered to be the right thing". There are multiple reasons for that, that I can think of: 1) some larger parts (of the network stack|kernel) get plastered with all kinds of if (this) if (that) checks complicating code, making it unreadbale, having to be maintained, not ignored for security, ... It's important to really catch all the places, .. which it seems we had been doing well though not 100% well as I just found out currerntly preparing more if (this) if (that) checks for something not really important but still being a problem - since the first day it turns out. 2) there is questionable logic in them and while we had been living with it up to now, it came up during review process for the commit to HEAD (so it could be merged to stable) and it turns out that properly solving it isn't a easy or simple task and multiple people have been pondering over this for days now. Even after removing some optional code paths for simplicity things are still not always definite in what would happen. 3) Nonetheless they are very helpful and very usable (else I wouldn't have worked on it). The plan as the status report will say is to get this in, merge it to stable/7 before 7.2 and keep it in 8. 8 will also have vimages and ideally I'd like to see this entire jail IP hacks be gone for 9, when vimage will provide the infrastructure, etc. This means that 8 would be the transition period. But that's just me and my ideas - we'll see how it'll go. /bz -- Bjoern A. Zeeb Stop bit received. Insert coin for new game. From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 09:38:59 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9CFCD106567B for ; Wed, 29 Oct 2008 09:38:59 +0000 (UTC) (envelope-from dominique.goncalves@gmail.com) Received: from qw-out-2122.google.com (qw-out-2122.google.com [74.125.92.24]) by mx1.freebsd.org (Postfix) with ESMTP id 585558FC0A for ; Wed, 29 Oct 2008 09:38:59 +0000 (UTC) (envelope-from dominique.goncalves@gmail.com) Received: by qw-out-2122.google.com with SMTP id 9so1461881qwb.7 for ; Wed, 29 Oct 2008 02:38:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=Lc7WgssRVqlzEFMfadwoIa91quni5EwjdpZcjIGjZMM=; b=TeDjwrIeOLa2nIPqLvKfVnM+WyuX7friu406IwfgPRGtHP0mDEOVcUBTJXcGezHGcO VS7ZK1tZCrwXkf2VQKNay/HVcG3OFaI9H1UxMIsFxBSAeLSWjti5v7w0GYYMUhZQ8c6i lLcyv4G7zHieIhkiybfrAK3kc/ivS9JUmzM3g= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=fnL4iKQvzdD/YC2pzkE1PnGkG/c5UOf8g63bGoy/OF77zMb/ufqYjsIQzRieoB4mQL hMxM3O8Zi2mMFBrukUd1p14EgXLx3jcS8cpe9mm7KDr/DI6nluP+5giswwnHf8i1YGw8 E6R6VsujVXj7/UuJ7fwPt3bKXyNMaLN9dF6G4= Received: by 10.214.59.17 with SMTP id h17mr1864981qaa.321.1225271872858; Wed, 29 Oct 2008 02:17:52 -0700 (PDT) Received: by 10.214.242.8 with HTTP; Wed, 29 Oct 2008 02:17:52 -0700 (PDT) Message-ID: <7daacbbe0810290217l60236d8ci1b2c4011720a0cc8@mail.gmail.com> Date: Wed, 29 Oct 2008 10:17:52 +0100 From: "Dominique Goncalves" To: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: Perl application hang in umtxn state X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 09:38:59 -0000 Hi, I run FreeBSD 7.1-PRERELEASE and with a Perl GTK2 application, Perl hang in umtxn state: PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAND 76288 dom 1 53 0 67860K 46080K umtxn 0:02 0.00% perl5.8.8 And the only way to stop the application is kill -9 I tried to use ktrace/kdump and ktrace.out show "_umtx_op" $ kdump -f ktrace.out [...] 13199 perl5.8.8 RET lstat 0 13199 perl5.8.8 CALL gettimeofday(0xbfbfb144,0) 13199 perl5.8.8 RET gettimeofday 0 13199 perl5.8.8 CALL _umtx_op(0xbfbfd18c,0x3,0x1,0,0) 13199 perl5.8.8 RET _umtx_op 0 13199 perl5.8.8 CALL sigprocmask(SIG_BLOCK,0xbfbfd120,0x8121490) 13199 perl5.8.8 RET sigprocmask 0 13199 perl5.8.8 CALL _umtx_op(0x287fb8a0,0x5,0,0,0) 13199 perl5.8.8 RET _umtx_op RESTART 13199 perl5.8.8 PSIG SIGKILL SIG_DFL How to debug this hang? (btw I'm not a developer) $ uname -a FreeBSD freebsd7 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #15 r184123: Tue Oct 21 16:24:59 CEST 2008 root@freebsd7:/usr/obj/usr/src/sys/GENERIC i386 Thanks for your help, Regards. -- There's this old saying: "Give a man a fish, feed him for a day. Teach a man to fish, feed him for life." From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 09:43:53 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8FFCB106564A for ; Wed, 29 Oct 2008 09:43:53 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id 6983A8FC13 for ; Wed, 29 Oct 2008 09:43:53 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [65.122.17.41]) by cyrus.watson.org (Postfix) with ESMTP id E15F546B09; Wed, 29 Oct 2008 05:43:52 -0400 (EDT) Date: Wed, 29 Oct 2008 09:43:52 +0000 (GMT) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Chris St Denis In-Reply-To: <49078377.2090807@smartt.com> Message-ID: References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <49078377.2090807@smartt.com> User-Agent: Alpine 1.10 (BSF 962 2008-03-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Lorenzo Perone , Charles Sprickman , stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 09:43:53 -0000 On Tue, 28 Oct 2008, Chris St Denis wrote: > Serious question here (not trolling). > > These patches have been around for years, why have they never been committed > to trunk/stable? Network stacks are incredibly complicated pieces of software, and some of the short-cuts jail took to accomplish its goals without implementing true virtualization break down when generalized. The patches to date have made the code more complicated and added more edge cases, and we'd like to avoid adding more edge cases to the stack if we can avoid it, as every edge case offers the opportunity for bugs and maintenance issues. The current patches Bjoern is preparing address most of these concerns, and they've been undergoing review and testing for a few months now. I'd like to think they will be in 8.x relatively shortly (next week or two), and in 7.x before 7.2. Robert N M Watson Computer Laboratory University of Cambridge From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 16:24:07 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B78DC1065674 for ; Wed, 29 Oct 2008 16:24:07 +0000 (UTC) (envelope-from m4gicite@gmail.com) Received: from gv-out-0910.google.com (gv-out-0910.google.com [216.239.58.184]) by mx1.freebsd.org (Postfix) with ESMTP id C71618FC0C for ; Wed, 29 Oct 2008 16:24:06 +0000 (UTC) (envelope-from m4gicite@gmail.com) Received: by gv-out-0910.google.com with SMTP id n8so45596gve.39 for ; Wed, 29 Oct 2008 09:24:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=EB59Ayx+Y5ZC4eTWD1bJASwrI+fUo3b62ULsWCo14Hc=; b=kJ1Ct2gUPFWxTSELiobIHsLuBy3Rvw774/3nPC8YlxAOCCHjunirTKTOQr7AqHpWEB /7yAd41Y7mAq0JFLwAySZr8nwpHikUu11djPlfC+IpOHHXvLh2cQDbYLrydQKvKQhIeL Llr7VapyKoGz2W4E4twgTiZV/gU9Ri9ibWC9k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=SOpZQGYXMJq5uBCWzYS2cdK8bdjeah0bTMihnTwPX1JpXWCeHzaBYxwbkcNkeSGa71 gJjETVTgxpBTHD5yWX4xcKMhUPrM1CjB/C1rTsYAfFbAhWKmdei3571+uhiMSeFSSD/P 7cUY0a1sim8AFEt838ao5GCDDlYAFDcr0+qo8= Received: by 10.86.59.2 with SMTP id h2mr5790118fga.30.1225296030680; Wed, 29 Oct 2008 09:00:30 -0700 (PDT) Received: by 10.86.82.4 with HTTP; Wed, 29 Oct 2008 09:00:30 -0700 (PDT) Message-ID: Date: Wed, 29 Oct 2008 16:00:30 +0000 From: Ryan To: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: Install issues with 7.x X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 16:24:07 -0000 Hello, I purchased a new Clevo M860TU on the account that it ran linux very well and was hoping it would fair the same on FreeBSD. Not so much, little help? I posted this in mobile originally but though stable would be a better choice. Don't know if it is more appropriate here or ACPI. I'm giving you as much information as I know how to get. as I cannot get sysinstall to load I am having to type all these dmesg. The boot process is hanging. This is all with 7.x, I can give 6.x if needed. Hardware: Intel P9500 4gb DDR3-1066 Nvidia 9800M GT Atheros AR5006e FreeBSD 7.1-BETA2 These snippets of dmesg happen around the end where it hangs. 1. Default ... cpu0: on acpi0 ACPI Error (dsopcode-0350): No pointer back to NS node in buffer obj 0xc6a02d40 [20070320] ACPI Exception (dswexec-0556): AE_AML_INTERNAL, While resolving operands for [OpcodeName unavailable] [20070320] ACPI Error (psparse-0626): Method parse/execution failed [\_PR_.CPU0._OSC] (Node 0xc68556e0), AE_AML_INTERNAL est0: on cpu0 p4tcc0: on cpu0 cpu1: on acpi0 ACPI Error (dsopcode-0350): No pointer back to NS node in buffer obj 0xc6a0e300 [20070320] ACPI Exception (dswexec-0556): AE_AML_INTERNAL, While resolving operands for [OpcodeName unavailable] [20070320] ACPI Error (psparse-0626): Method parse/execution failed [\_PR_.CPU1._OSC] (Node 0xc685560), AE_AML_INTERNAL est1: on cpu1 p4tcc1: on cpu1 ... cpu0: Cx states changed cpu1: Cx states changed unknown: timeout waiting for read DRQ unknown: timeout waiting for read DRQ acd0: DVDR at ata3-master UDMA33 GEOM_LABEL: Label for provider acd0 is iso9660/FreeBSD_Install run_interrupt_driven_hooks: still waiting after 60 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 120 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 180 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 240 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 300 seconds for xpt_config Then just stalls 2. No ACPI ... unknown: timeout waiting for read DRQ unknown: timeout waiting for read DRQ acd0: DVDR at ata3-master UDMA33 GEOM_LABEL: Label for provider acd0 is iso9660/FreeBSD_Install run_interrupt_driven_hooks: still waiting after 60 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 120 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 180 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 240 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 300 seconds for xpt_config Then just stalls 3. Safe Mode I can only tell you a little because console is spammed. It is the same as no ACPI, but with an interrupt storm. ... unknown: timeout waiting for read DRQ unknown: timeout waiting for read DRQ acd0: DVDR at ata3-master UDMA33 GEOM_LABEL: Label for provider acd0 is iso9660/FreeBSD_Install run_interrupt_driven_hooks: still waiting after 60 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 120 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 180 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 240 seconds for xpt_config run_interrupt_driven_hooks: still waiting after 300 seconds for xpt_config When it gets to the unknowns, this is spammed. interrupt storm detected on "irq10:"; throttling interrupt source Other than the interrupt storm spam, it is halted like the others. 4. Single User Mode Same as 1, Default 5. Verbose All I can tell you is what is spammed at the end. acpi: bad write to port 0x080 (32), val hex Where hex is ever increasing and loops when it hits 0xff01. I can also see run_interrupt_driven_hooks message in all the spam. Using some googling if you add the sysctl before boot debug.acpi.block_bad_io=1 it might be of some help. This just leads to a never ending loop of acpi errors - the scroll very fast and difficult to record might I add! ... acpi: bad write to port 0x080 (32), val hex ACPI Exception (evregion-0529): AE_BAD_PARAMETER, Returned by handler for [SystemIO] [20070320] ACPI Error (psparse-0626): Method parse/execution failed [\P8XH] (Node 0xc6850a60), AE_BAD_PARAMETER ACPI Error (psparse-0626): Method parse/execution failed [\_GPE._L01] [20070320] ACPI Exception (evgpe-0687): AE_BAD_PARAMETER, while evauating GPE method [_L01] [20070320] --repeat-- ... FreeBSD 7.0-REL 7.0 is a little different than 7.1. Messages are somewhat the same but they happen near the beginning of dmesg instead of around the end. The run_interrupt_driven_hooks issue is nonexistant as well, but it still hangs. I'm guessing that's a debug tool more than an error. 1. Default ... cpu0: on acpi0 ACPI Error (dsopcode-0350): No pointer back to NS node in buffer obj 0xc6862580 [20070320] ACPI Exception (dswexec-0556): AE_AML_INTERNAL, While resolving operands for [OpcodeName unavailable] [20070320] ACPI Error (psparse-0626): Method parse/execution failed [\_PR_.CPU0._OSC] (Node 0xc682d580), AE_AML_INTERNAL est0: on cpu0 p4tcc0: on cpu0 cpu1: on acpi0 ACPI Error (dsopcode-0350): No pointer back to NS node in buffer obj 0xc6861100 [20070320] ACPI Exception (dswexec-0556): AE_AML_INTERNAL, While resolving operands for [OpcodeName unavailable] [20070320] ACPI Error (psparse-0626): Method parse/execution failed [\_PR_.CPU1._OSC] (Node 0xc682d4a0), AE_AML_INTERNAL est1: on cpu1 p4tcc1: on cpu1 ... cpu0: Cx states changed cpu1: Cx states changed unknown: timeout waiting for read DRQ unknown: timeout waiting for read DRQ acd0: DVDR at ata3-master UDMA33 GEOM_LABEL: Label for provider acd0 is iso9660/FreeBSD_Install Hangs. 2. No ACPI .. unknown: timeout waiting for read DRQ unknown: timeout waiting for read DRQ .. Hangs. 3. Safe Mode Same interrupt storm as 7.1-BETA2. ... interrupt storm detected on "irq10:"; throttling interrupt source --repeat-- 4. Single User Mode Same as 1. Default. 5. Verbose Hang like normal, cannot see the ACPI errors since they fly off the scroll lock buffer. ... cpu0: Cx states changed cpu1: Cx states changed ... unknown: timeout waiting for read DRQ unknown: timeout waiting for read DRQ ... Thanks again. From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 16:34:03 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 48534106567A for ; Wed, 29 Oct 2008 16:34:03 +0000 (UTC) (envelope-from lehmann@ans-netz.de) Received: from avocado.salatschuessel.net (avocado.salatschuessel.net [78.111.72.186]) by mx1.freebsd.org (Postfix) with SMTP id B09E08FC13 for ; Wed, 29 Oct 2008 16:34:02 +0000 (UTC) (envelope-from lehmann@ans-netz.de) Received: (qmail 76006 invoked by uid 89); 29 Oct 2008 16:07:20 -0000 Received: from unknown (HELO kartoffel.salatschuessel.net) (78.111.72.187) by avocado.salatschuessel.net with SMTP; 29 Oct 2008 16:07:20 -0000 Date: Wed, 29 Oct 2008 17:07:28 +0100 From: Oliver Lehmann To: stable@freebsd.org Message-Id: <20081029170728.be7cc7ab.lehmann@ans-netz.de> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; amd64-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: smp@freebsd.org Subject: 3Ware 9000 series hangs under load X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 16:34:03 -0000 Hi, I've problems with my 3ware controller. Havingg heavy I/O load (e.g. running 40 port builds the day over with tinderbox which involves un-taring a whole FreeBSD tree 40 times), my system hangs with the well known swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2, size: 4096 swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2, size: 4096 error. I'v opened a ticket at 3ware and after half a month of dummy-testings (are your drives fine, can you run a stress test), it looks like i was redirected to someone from the 2nd lvl support and he told me: There are 2 things that you can try, 1, disable apic in your bootloader.conf file, or RMA the controller. The error that you have is generally caused by an interrupt problem, defective backplane, bad drive or bad controller. and after I told him that I intend to use the 2 CPUs I have and not falling back to one CPU for ever he responded: Yes I do understand about disabling APIC, but the feature is sometimes not stable in all dual proc systems. There are many variables, the CPU's have to be matched down to the Lot #, the motherboard must have a good design and the kernel supporting APIC must be stable. But, it is a good test to see if it is software or hardware. So what I did now, was compiling a kernel w/o apic/smp and I'm running this configuration now for 3 days stressing the system w/o running into the swap_pager problem. Can it be still a controller problem or is it more likley a problem of FreeBSDs smp/apic implementation or the board I'm using (Intel L440GX). I'm asking because I'm not sure which problem it is now and before telling it 3ware and having them responding "ok it is a FreeBSD problem" or "ok it is a board problem" I'd like to know what can be the case here. (please keep me CCed, I'm not subscribed to smp@) Further information (and the history) on this topic can be found here (and following): http://lists.freebsd.org/pipermail/freebsd-stable/2008-September/045500.html -- Oliver Lehmann http://www.pofo.de/ http://wishlist.ans-netz.de/ From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 16:48:50 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D9ED41065678 for ; Wed, 29 Oct 2008 16:48:50 +0000 (UTC) (envelope-from spork@bway.net) Received: from xena.bway.net (xena.bway.net [216.220.96.26]) by mx1.freebsd.org (Postfix) with ESMTP id 6FF798FC25 for ; Wed, 29 Oct 2008 16:48:50 +0000 (UTC) (envelope-from spork@bway.net) Received: (qmail 96931 invoked by uid 0); 29 Oct 2008 16:48:49 -0000 Received: from unknown (HELO toasty.nat.fasttrackmonkey.com) (spork@96.57.102.250) by smtp.bway.net with (DHE-RSA-AES256-SHA encrypted) SMTP; 29 Oct 2008 16:48:49 -0000 Date: Wed, 29 Oct 2008 12:48:48 -0400 (EDT) From: Charles Sprickman X-X-Sender: spork@toasty.nat.fasttrackmonkey.com To: Robert Watson In-Reply-To: Message-ID: References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <49078377.2090807@smartt.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Lorenzo Perone , stable@freebsd.org, Chris St Denis Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 16:48:50 -0000 On Wed, 29 Oct 2008, Robert Watson wrote: > On Tue, 28 Oct 2008, Chris St Denis wrote: > >> Serious question here (not trolling). >> >> These patches have been around for years, why have they never been >> committed to trunk/stable? > ... > The current patches Bjoern is preparing address most of these concerns, > and they've been undergoing review and testing for a few months now. > I'd like to think they will be in 8.x relatively shortly (next week or > two), and in 7.x before 7.2. That is great news! I have always avoided running patches like this on anything that I expect to be maintaining over a long period of time, since you can't know for sure whether new patches will be developed going forward. Having this very useful feature become part of the base really helps me and anyone else doing VPS-type stuff. I did find the vimage work eventually, but it's more than I need and I was not too certain about how stable it is at this point. Thanks, Charles > Robert N M Watson > Computer Laboratory > University of Cambridge > From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 17:04:58 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8942B1065670; Wed, 29 Oct 2008 17:04:58 +0000 (UTC) (envelope-from fernan@iib.unsam.edu.ar) Received: from unsam.edu.ar (mx.unsam.edu.ar [200.45.170.30]) by mx1.freebsd.org (Postfix) with ESMTP id C487A8FC22; Wed, 29 Oct 2008 17:04:54 +0000 (UTC) (envelope-from fernan@iib.unsam.edu.ar) Received: from gama.iib.unsam.edu.ar by unsam.edu.ar (MDaemon.PRO.v8.1.1.R) with ESMTP id md50011231947.msg; Wed, 29 Oct 2008 15:04:41 -0200 Received: from gama.iib.unsam.edu.ar (localhost [127.0.0.1]) by gama.iib.unsam.edu.ar (8.14.2/8.14.2) with ESMTP id m9TH5OkG049342; Wed, 29 Oct 2008 14:05:24 -0300 (ART) (envelope-from fernan@iib.unsam.edu.ar) Received: (from fernan@localhost) by gama.iib.unsam.edu.ar (8.14.2/8.14.2/Submit) id m9TH5Mpu049341; Wed, 29 Oct 2008 14:05:22 -0300 (ART) (envelope-from fernan@iib.unsam.edu.ar) X-Authentication-Warning: gama.iib.unsam.edu.ar: fernan set sender to fernan@iib.unsam.edu.ar using -f Date: Wed, 29 Oct 2008 14:05:22 -0300 From: Fernan Aguero To: Kirk Strauser Message-ID: <20081029170522.GH47829@iib.unsam.edu.ar> References: <520894aa0809301434h68b94628x54ec08fd48785feb@mail.gmail.com> <200810011134.49795.jhb@freebsd.org> <48EBDE69.1030609@delphij.net> <200810271251.28411.kirk@strauser.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200810271251.28411.kirk@strauser.com> User-Agent: Mutt/1.5.18 (2008-05-17) X-Spam-Processed: unsam-mail.unsam.edu.ar, Wed, 29 Oct 2008 15:04:41 -0200 (not processed: spam filter disabled) X-Return-Path: fernan@iib.unsam.edu.ar X-MDAV-Processed: unsam-mail.unsam.edu.ar, Wed, 29 Oct 2008 15:04:44 -0200 Cc: d@delphij.net, freebsd-stable@freebsd.org, re@freebsd.org, John Baldwin Subject: Re: [FreeBSD] Fix for ServerWorks HT1000 in upcoming 7.1? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 17:04:58 -0000 > On Tuesday 07 October 2008 17:10:49 Xin LI wrote: > > Did anyone who can trigger the data corruption has tried John's patch > > and let us know if it worked? > > > > Cheers, > > I can confirm that it works on my PowerEdge SC1435. With both controllers > running in SATA150 mode, I have an uptime of 101 days with moderately heavy > load. > -- > Kirk Strauser Same here. The ata_ht1000.patch referenced in this thread works, in my case at least with 1 controller running in SATA150 mode (I have only 1 disk). However, the recent 7.1-BETA2 does not work for me, contrary to reports saying that this BETA contains the patch. Looking at the sources, it seems evident that the patch applied is not identical to the ata_ht1000.patch in this thread. This patch: http://people.freebsd.org/~jhb/patches/ata_ht1000.patch is the only requirement to turn a broken 7.1-BETA1 into a working 7.1 for a Dell PowerEdge SC1435. The recent 7.1-BETA2, does not work! Fernan dmesg (7.1-BETA2): Copyright (c) 1992-2008 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.1-BETA2 #0: Sun Oct 12 20:59:28 UTC 2008 root@driscoll.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Dual-Core AMD Opteron(tm) Processor 2210 (1795.51-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x40f13 Stepping = 3 Features=0x178bfbff Features2=0x2001 AMD Features=0xea500800 AMD Features2=0x1f Cores per package: 2 usable memory = 8575381504 (8178 MB) avail memory = 8295841792 (7911 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 ioapic0: Changing APIC ID to 4 ioapic1: Changing APIC ID to 5 ioapic2: Changing APIC ID to 6 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-15 on motherboard ioapic1 irqs 32-47 on motherboard ioapic2 irqs 64-79 on motherboard kbd1 at kbdmux0 ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci3: on pcib1 pcib2: at device 13.0 on pci3 pci4: on pcib2 atapci0: port 0xecb0-0xecb7,0xeca0-0xeca3,0xecb8-0xecbf,0xeca4-0xeca7,0xece0-0xecef mem 0xefdfe000-0xefdfffff irq 6 at device 14.0 on pci3 atapci0: [ITHREAD] ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] atapci1: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x8c0-0x8cf at device 2.1 on pci0 ata0: on atapci1 ata0: [ITHREAD] ata1: on atapci1 ata1: [ITHREAD] isab0: at device 2.2 on pci0 isa0: on isab0 ohci0: port 0xd000-0xd0ff mem 0xefbed000-0xefbedfff irq 11 at device 3.0 on pci0 ohci0: [GIANT-LOCKED] ohci0: [ITHREAD] usb0: OHCI version 1.0, legacy support usb0: SMM does not respond, resetting usb0: on ohci0 usb0: USB revision 1.0 uhub0: <(0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0 uhub0: 2 ports with 2 removable, self powered ohci1: port 0xd400-0xd4ff mem 0xefbee000-0xefbeefff irq 11 at device 3.1 on pci0 ohci1: [GIANT-LOCKED] ohci1: [ITHREAD] usb1: OHCI version 1.0, legacy support usb1: on ohci1 usb1: USB revision 1.0 uhub1: <(0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1 uhub1: 2 ports with 2 removable, self powered ehci0: port 0xd800-0xd8ff mem 0xefbef000-0xefbeffff irq 11 at device 3.2 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb2: EHCI version 1.0 usb2: companion controllers, 2 ports each: usb0 usb1 usb2: on ehci0 usb2: USB revision 2.0 uhub2: <(0x1166) EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb2 uhub2: 4 ports with 4 removable, self powered uhub3: on uhub2 uhub3: multiple transaction translators uhub3: 2 ports with 2 removable, self powered ums0: on uhub3 ums0: 3 buttons and Z dir. ukbd0: on uhub3 kbd2 at ukbd0 uhid0: on uhub3 vgapci0: port 0xdc00-0xdcff mem 0xe0000000-0xe7ffffff,0xefbf0000-0xefbfffff irq 44 at device 4.0 on pci0 pcib3: irq 32 at device 7.0 on pci0 pci5: on pcib3 pcib4: irq 33 at device 8.0 on pci0 pci1: on pcib4 bge0: mem 0xefef0000-0xefefffff irq 33 at device 0.0 on pci1 miibus0: on bge0 brgphy0: PHY 1 on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bge0: Ethernet address: 00:1a:a0:1e:3c:3b bge0: [ITHREAD] pcib5: irq 37 at device 9.0 on pci0 pci2: on pcib5 bge1: mem 0xefff0000-0xefffffff irq 37 at device 0.0 on pci2 miibus1: on bge1 brgphy1: PHY 1 on miibus1 brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bge1: Ethernet address: 00:1a:a0:1e:3c:3c bge1: [ITHREAD] pcib6: irq 35 at device 10.0 on pci0 pci6: on pcib6 pcib7: irq 36 at device 11.0 on pci0 pci7: on pcib7 sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio0: [FILTER] sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A sio1: [FILTER] cpu0: on acpi0 powernow0: on cpu0 device_attach: powernow0 attach returned 6 cpu1: on acpi0 powernow1: on cpu1 device_attach: powernow1 attach returned 6 cpu2: on acpi0 powernow2: on cpu2 device_attach: powernow2 attach returned 6 cpu3: on acpi0 powernow3: on cpu3 device_attach: powernow3 attach returned 6 orm0: at iomem 0xc0000-0xc8fff,0xc9000-0xc9fff,0xca000-0xcb7ff,0xec000-0xeffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] ppc0: cannot reserve I/O port range sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec acd0: CDRW at ata0-master UDMA33 ad4: DMA limited to UDMA33, device found non-ATA66 cable ad4: 152587MB at ata2-master UDMA33 SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! Trying to mount root from ufs:/dev/ad4s1a bge0: link state changed to UP From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 17:27:51 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A6603106564A for ; Wed, 29 Oct 2008 17:27:51 +0000 (UTC) (envelope-from chris@smartt.com) Received: from nov.smartt.com (nov.smartt.com [69.31.173.253]) by mx1.freebsd.org (Postfix) with ESMTP id 87A118FC17 for ; Wed, 29 Oct 2008 17:27:51 +0000 (UTC) (envelope-from chris@smartt.com) Received: from [69.31.174.220] ([69.31.174.220]) (authenticated bits=0) by nov.smartt.com (8.13.8/8.13.5) with ESMTP id m9THRkm9032512; Wed, 29 Oct 2008 10:27:48 -0700 Message-ID: <49089D14.7040603@smartt.com> Date: Wed, 29 Oct 2008 10:27:48 -0700 From: Chris St Denis User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: freebsd-jail@freebsd.org References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <49078377.2090807@smartt.com> <20081029072821.S2978@maildrop.int.zabbadoz.net> In-Reply-To: <20081029072821.S2978@maildrop.int.zabbadoz.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-3.1 required=5.0 tests=AWL,BAYES_00,SPF_PASS autolearn=ham version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on nov.smartt.com Cc: stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 17:27:51 -0000 Bjoern A. Zeeb wrote: > On Tue, 28 Oct 2008, Chris St Denis wrote: > > Hi, > > [ jail patches ] > >> Serious question here (not trolling). >> >> These patches have been around for years, why have they never been >> committed to trunk/stable? > > Well, the multi-ipv4 patch has been for a while - what we are talking > about at the moment is more. > > If you look at older status reports they said soemthing like "there is > the need for this at the moment but it's not considered to be the > right thing". > > There are multiple reasons for that, that I can think of: > > 1) some larger parts (of the network stack|kernel) get plastered with > all kinds of if (this) if (that) checks complicating code, making > it unreadbale, having to be maintained, not ignored for security, ... > It's important to really catch all the places, .. which it seems we > had been doing well though not 100% well as I just found out > currerntly preparing more if (this) if (that) checks for something > not really important but still being a problem - since the first > day it turns out. > > 2) there is questionable logic in them and while we had been living > with it up to now, it came up during review process for the commit > to HEAD (so it could be merged to stable) and it turns out that > properly solving it isn't a easy or simple task and multiple people > have been pondering over this for days now. Even after removing > some optional code paths for simplicity things are still not always > definite in what would happen. > > 3) > > > Nonetheless they are very helpful and very usable (else I wouldn't > have worked on it). > > The plan as the status report will say is to get this in, merge it to > stable/7 before 7.2 and keep it in 8. > > 8 will also have vimages and ideally I'd like to see this entire jail > IP hacks be gone for 9, when vimage will provide the infrastructure, > etc. This means that 8 would be the transition period. But that's > just me and my ideas - we'll see how it'll go. > > > /bz > Thanks for the info from all who responded. I hadn't heard of vimage before, but after doing some searching on it it sounds like it will be very good improvement to jails. If we can get resource limits on jails too in a near future release, Jails will become a competitive solution for VPS systems. From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 18:42:57 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6609E1065678 for ; Wed, 29 Oct 2008 18:42:57 +0000 (UTC) (envelope-from msnkipa@mail.ru) Received: from mx44.mail.ru (mx44.mail.ru [195.239.211.10]) by mx1.freebsd.org (Postfix) with ESMTP id 22B898FC12 for ; Wed, 29 Oct 2008 18:42:57 +0000 (UTC) (envelope-from msnkipa@mail.ru) Received: from f177.mail.ru (f177.mail.ru [194.67.57.145]) by mx44.mail.ru (mPOP.Fallback_MX) with ESMTP id AE5793801B4BA for ; Wed, 29 Oct 2008 19:26:52 +0300 (MSK) Received: from mail by f177.mail.ru with local id 1KvDsg-0005JZ-00 for freebsd-stable@freebsd.org; Wed, 29 Oct 2008 19:26:50 +0300 Received: from [89.113.74.101] by win.mail.ru with HTTP; Wed, 29 Oct 2008 19:26:50 +0300 From: =?koi8-r?Q?=ED=C9=C8=C1=C9=CC_=EB=C9=D0=C1?= To: freebsd-stable@freebsd.org Mime-Version: 1.0 X-Mailer: mPOP Web-Mail 2.19 X-Originating-IP: 192.168.7.150 via proxy [89.113.74.101] Date: Wed, 29 Oct 2008 19:26:50 +0300 Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: 8bit Message-Id: X-Spam: Not detected X-Mras: OK Subject: Where is new session creation in init-getty-login X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: =?koi8-r?Q?=ED=C9=C8=C1=C9=CC_=EB=C9=D0=C1?= List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 18:42:57 -0000 I can`t find the place in the source where new session creates when I login via local terminal. There is no call to setsid() after init forks in start_getty(session_t *sp) and no calls to that function in getty and login. But when I login to the local terminal, exit and login again I will have different session ID`s (pid numbers of session leader process). So I wan`t to know where login process become a session leader? Mihail. From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 21:00:20 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B2BD11065675 for ; Wed, 29 Oct 2008 21:00:20 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from mail.terabit.net.ua (mail.terabit.net.ua [195.137.202.147]) by mx1.freebsd.org (Postfix) with ESMTP id 5E0918FC16 for ; Wed, 29 Oct 2008 21:00:20 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from skuns.zoral.com.ua ([91.193.166.194] helo=mail.zoral.com.ua) by mail.terabit.net.ua with esmtps (TLSv1:AES256-SHA:256) (Exim 4.63 (FreeBSD)) (envelope-from ) id 1KvI9K-0000WU-IL; Wed, 29 Oct 2008 23:00:18 +0200 Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by mail.zoral.com.ua (8.14.2/8.14.2) with ESMTP id m9TL0F1u007681 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 29 Oct 2008 23:00:16 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.3/8.14.3) with ESMTP id m9TL0F6o027001; Wed, 29 Oct 2008 23:00:15 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.3/8.14.3/Submit) id m9TL0Fge027000; Wed, 29 Oct 2008 23:00:15 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Wed, 29 Oct 2008 23:00:15 +0200 From: Kostik Belousov To: =?koi8-r?B?7cnIwcnMIOvJ0ME=?= Message-ID: <20081029210015.GH18100@deviant.kiev.zoral.com.ua> References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="lf0NQ8GVTdtriwpn" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: ClamAV version 0.93.3, clamav-milter version 0.93.3 on skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on skuns.kiev.zoral.com.ua X-Virus-Scanned: mail.terabit.net.ua 1KvI9K-0000WU-IL 74c9e6afc2e8fe12d0f97b3522936343 X-Terabit: YES Cc: freebsd-stable@freebsd.org Subject: Re: Where is new session creation in init-getty-login X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 21:00:20 -0000 --lf0NQ8GVTdtriwpn Content-Type: text/plain; charset=koi8-r Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Oct 29, 2008 at 07:26:50PM +0300, =ED=C9=C8=C1=C9=CC =EB=C9=D0=C1 w= rote: >=20 > I can`t find the place in the source where new session creates when > I login via local terminal. There is no call to setsid() after init > forks in start_getty(session_t *sp) and no calls to that function in > getty and login. But when I login to the local terminal, exit and > login again I will have different session ID`s (pid numbers of session > leader process). So I wan`t to know where login process become a > session leader? Watch for the login_tty(3) calls both in init and in getty. This function from libutil sets up the session and controlling terminal. It is called from init for single-user shell and rc script. getty calls it for line logons. --lf0NQ8GVTdtriwpn Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkkIzt4ACgkQC3+MBN1Mb4hv7wCfbsrdZ4y7wZpf0w1nUnYG/Rlj jUEAn3F9I1+MDMnqHAe9EAvcN4A7t/bR =nrkc -----END PGP SIGNATURE----- --lf0NQ8GVTdtriwpn-- From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 21:11:36 2008 Return-Path: Delivered-To: stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3039B1065680; Wed, 29 Oct 2008 21:11:36 +0000 (UTC) (envelope-from webmaster@kibab.com) Received: from smtp.ht-systems.ru (mr0.ht-systems.ru [78.110.50.55]) by mx1.freebsd.org (Postfix) with ESMTP id DB1E78FC1A; Wed, 29 Oct 2008 21:11:35 +0000 (UTC) (envelope-from webmaster@kibab.com) Received: from [85.140.150.107] (helo=kibab-nb) by smtp.ht-systems.ru with esmtpa (Exim 4.62) (envelope-from ) id 1KvIKD-0002sn-EZ; Thu, 30 Oct 2008 00:11:33 +0300 Date: Thu, 30 Oct 2008 00:11:23 +0300 From: Ilya Bakulin To: pyunyh@gmail.com Message-Id: <20081030001123.cb1ebd9c.webmaster@kibab.com> In-Reply-To: <20081021043152.GE43039@cdnetworks.co.kr> References: <755632516.20081018001504@rulez.sk> <20081018020248.GB31303@cdnetworks.co.kr> <20081020012504.95adc0ca.nork@FreeBSD.org> <20081020071155.GH38923@cdnetworks.co.kr> <20081020132827.edbb2c53.webmaster@kibab.com> <20081021043152.GE43039@cdnetworks.co.kr> Organization: HT-Systems X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; i386-portbld-freebsd7.1) Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA1"; boundary="Signature=_Thu__30_Oct_2008_00_11_23_+0300_87umKu7zmlzp3Ltb" Cc: Daniel Gerzo , Norikatsu Shigemura , stable@FreeBSD.org, yongari@FreeBSD.org Subject: Re: re0 problem X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 21:11:36 -0000 --Signature=_Thu__30_Oct_2008_00_11_23_+0300_87umKu7zmlzp3Ltb Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, 21 Oct 2008 13:31:52 +0900 Pyun YongHyeon wrote: > On Mon, Oct 20, 2008 at 01:28:27PM +0400, Ilya Bakulin wrote: > > On my laptop (Dell Vostro 1310) I get _periodically_ (not always!) the= same error: > > re0: PHY write failed > > re0: PHY write failed > > re0: MII without any phy! > > device_attach: re0 attach returned 6 =20 > This is known issue which happens on RTL8168C/CP and RTL8102E/EL > PCIe controllers. Would you try the patch at the following URL? >=20 > http://www.freebsd.org/~yongari/re/re.ephy.patch.20081021 >=20 > Even if the patch work for you, you should try serveral times to > make sure it really fix the issue.(e.g. completely shutdown your > box, unplug power cord and wait several mininutes and reboot.) =20 > --=20 > Regards, > Pyun YongHyeon I've applied this patch nine days ago and added "if_re_load=3Dyes" in /boot= /loader.conf (Earlier I used to kldload it only if I needed to). Since that= time I've never seen errors. Thank you!!! --=20 Ilya Bakulin --Signature=_Thu__30_Oct_2008_00_11_23_+0300_87umKu7zmlzp3Ltb Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkkI0YMACgkQo9vlj1oadwgvIQCgwNEPS5xnRuBVU1ivsfv2EpQT GwwAnRRZBqi5g3rTvlWmQCvSPmj35UDT =J+hN -----END PGP SIGNATURE----- --Signature=_Thu__30_Oct_2008_00_11_23_+0300_87umKu7zmlzp3Ltb-- From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 22:02:47 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8656D106568D for ; Wed, 29 Oct 2008 22:02:47 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: from an-out-0708.google.com (an-out-0708.google.com [209.85.132.241]) by mx1.freebsd.org (Postfix) with ESMTP id DDEA28FC3B for ; Wed, 29 Oct 2008 22:02:45 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: by an-out-0708.google.com with SMTP id b33so33552ana.13 for ; Wed, 29 Oct 2008 15:02:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=TIz8ap7AYJhnpo20dAr/boqDzC2QNkegbs7j8/bMYZI=; b=HmEepCGacvGkowM5jvCH/zDteVTCByzeuII8tCtv8FNjE2Dli0YzIAgaveEKK9yYKG ITLBU2Hw7eKPQXDh+5F0mSF1UCvbsttAr9vjbbsm6difSJsYjGrvcuP6Wjl9xDYwKNfD h/xQ/GlRN6LSgWFoHwC7Xxcs0cy4EhXRD4KDc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=K/K6hHeLk5n9TVjFK6f+ty7k1+veyv1cPNeOil/Ef3/F86D2U6CwSMO83pWYmN8DKD CJJeuGxULRJijOps4c8hqJ+SW+nVO+6u+qaD6Vi18JLllCzkOhx9FV7GBc5PpO5TJ6zv tpU2OK7H+xlpKzCK3Afh9Rf4bpdiP808phakc= Received: by 10.64.185.18 with SMTP id i18mr9813211qbf.65.1225317763100; Wed, 29 Oct 2008 15:02:43 -0700 (PDT) Received: by 10.64.201.9 with HTTP; Wed, 29 Oct 2008 15:02:43 -0700 (PDT) Message-ID: Date: Wed, 29 Oct 2008 20:02:43 -0200 From: "Eduardo Meyer" To: stable@freebsd.org, questions@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Subject: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 22:02:57 -0000 Hello, I need to write a cgi script which will print the output from ps(1) in a table (html), so the average-operator can click on a KILL link and the cgi will send the selected signal. I need to add one ps information per column in a table (html), however, I found ps(1) output to be too hard to parse. There is no separator. I believed \t was the separator but its not. The ps(1) command I need to use is: ps -ax -o pid -o user -o emul -o lstart -o lockname -o stat -o command Since many of those args use [:space:] in the output, I can not use [:space:] as a separator. Sadly, `-o fiend='value'` will only format the HEADER output, not the values. Ive got no clue what to do, can someone enlight me? Thank you all in advance. -- =========== Eduardo Meyer pessoal: dudu.meyer@gmail.com profissional: ddm.farmaciap@saude.gov.br From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 22:15:41 2008 Return-Path: Delivered-To: stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 99793106564A; Wed, 29 Oct 2008 22:15:41 +0000 (UTC) (envelope-from jamie@gritton.org) Received: from gritton.org (gritton.org [161.58.222.4]) by mx1.freebsd.org (Postfix) with ESMTP id 61CE58FC08; Wed, 29 Oct 2008 22:15:41 +0000 (UTC) (envelope-from jamie@gritton.org) Received: from guppy.corp.verio.net (fw.oremut02.us.wh.verio.net [198.65.168.24]) (authenticated bits=0) by gritton.org (8.13.6.20060614/8.13.6) with ESMTP id m9TLmg35096991; Wed, 29 Oct 2008 15:48:43 -0600 (MDT) Message-ID: <4908DA35.7070905@gritton.org> Date: Wed, 29 Oct 2008 15:48:37 -0600 From: James Gritton User-Agent: Thunderbird 2.0.0.9 (X11/20080228) MIME-Version: 1.0 To: "Bjoern A. Zeeb" References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <49078377.2090807@smartt.com> <20081029072821.S2978@maildrop.int.zabbadoz.net> In-Reply-To: <20081029072821.S2978@maildrop.int.zabbadoz.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV version 0.93, clamav-milter version 0.93 on gritton.org X-Virus-Status: Clean Cc: stable@FreeBSD.org, freebsd-jail@FreeBSD.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 22:15:41 -0000 Bjoern A. Zeeb wrote: > The plan as the status report will say is to get this in, merge it to > stable/7 before 7.2 and keep it in 8. > > 8 will also have vimages and ideally I'd like to see this entire jail > IP hacks be gone for 9, when vimage will provide the infrastructure, > etc. This means that 8 would be the transition period. But that's > just me and my ideas - we'll see how it'll go. I'm not convinced vimage is the only kind of network virtualization we want to give the option of. The IP addresses assigned to jails seems a lighter weight alternative, and allows some things that vimage doesn't do easily, such as system processes that listen on the virtual addresses for some services, leaving the jail to handle others. - Jamie From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 23:15:41 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C4EE7106564A; Wed, 29 Oct 2008 23:15:41 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.delphij.net (delphij-pt.tunnel.tserv2.fmt.ipv6.he.net [IPv6:2001:470:1f03:2c9::2]) by mx1.freebsd.org (Postfix) with ESMTP id 6BA748FC17; Wed, 29 Oct 2008 23:15:41 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.geekcn.org (tarsier.geekcn.org [211.166.10.233]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by tarsier.delphij.net (Postfix) with ESMTPS id C856728449; Thu, 30 Oct 2008 07:15:39 +0800 (CST) Received: from localhost (tarsier.geekcn.org [211.166.10.233]) by tarsier.geekcn.org (Postfix) with ESMTP id 5B292EB939C; Thu, 30 Oct 2008 07:15:39 +0800 (CST) X-Virus-Scanned: amavisd-new at geekcn.org Received: from tarsier.geekcn.org ([211.166.10.233]) by localhost (mail.geekcn.org [211.166.10.233]) (amavisd-new, port 10024) with ESMTP id xxSxTN4uI7da; Thu, 30 Oct 2008 07:15:34 +0800 (CST) Received: from charlie.delphij.net (adsl-76-237-33-62.dsl.pltn13.sbcglobal.net [76.237.33.62]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tarsier.geekcn.org (Postfix) with ESMTPSA id 14B49EB9391; Thu, 30 Oct 2008 07:15:32 +0800 (CST) DomainKey-Signature: a=rsa-sha1; s=default; d=delphij.net; c=nofws; q=dns; h=message-id:date:from:reply-to:organization:user-agent: mime-version:to:cc:subject:references:in-reply-to: x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=Pc2c17jY1f432z0mRFuiAGLCwa3PhFZzkK31mTojB6dx4FauiJ2OF/C0tEbfbt0GE vA8o20m9r7d8ard6SMXFA== Message-ID: <4908EE91.1080706@delphij.net> Date: Wed, 29 Oct 2008 16:15:29 -0700 From: Xin LI Organization: The FreeBSD Project User-Agent: Thunderbird 2.0.0.17 (X11/20080928) MIME-Version: 1.0 To: Eduardo Meyer References: In-Reply-To: X-Enigmail-Version: 0.95.7 OpenPGP: id=18EDEBA0; url=http://www.delphij.net/delphij.asc Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org, questions@freebsd.org Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: d@delphij.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 23:15:41 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Eduardo Meyer wrote: > Hello, > > I need to write a cgi script which will print the output from ps(1) in > a table (html), so the average-operator can click on a KILL link and > the cgi will send the selected signal. > > I need to add one ps information per column in a table (html), > however, I found ps(1) output to be too hard to parse. There is no > separator. I believed \t was the separator but its not. > > The ps(1) command I need to use is: > > ps -ax -o pid -o user -o emul -o lstart -o lockname -o stat -o command > > Since many of those args use [:space:] in the output, I can not use > [:space:] as a separator. > Sadly, `-o fiend='value'` will only format the HEADER output, not the values. > > Ive got no clue what to do, can someone enlight me? Perhaps use cut(1) with -c or something similar in other scripting language? It looks like that the output is aligned. Cheers, - -- Xin LI http://www.delphij.net/ FreeBSD - The Power to Serve! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkkI7pEACgkQi+vbBBjt66Bi3wCgmk9chU/FIZjuBpm/57Yl7jBY D6kAoI6ZmQRdxDm7mzjale84p4uXmlmz =4FMM -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 23:19:33 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C7E091065672 for ; Wed, 29 Oct 2008 23:19:33 +0000 (UTC) (envelope-from clint@0lsen.net) Received: from belle.0lsen.net (belle.0lsen.net [75.150.32.89]) by mx1.freebsd.org (Postfix) with ESMTP id B2FA68FC14 for ; Wed, 29 Oct 2008 23:19:33 +0000 (UTC) (envelope-from clint@0lsen.net) Received: by belle.0lsen.net (Postfix, from userid 1001) id DFF8F78FB9; Wed, 29 Oct 2008 16:19:26 -0700 (PDT) Date: Wed, 29 Oct 2008 16:19:26 -0700 From: Clint Olsen To: stable@freebsd.org Message-ID: <20081029231926.GA35188@0lsen.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i Organization: NULlsen Network X-Disclaimer: Mutt Bites! X-0lsen-net-MailScanner-Information: Please contact the ISP for more information X-MailScanner-ID: DFF8F78FB9.8B6F5 X-0lsen-net-MailScanner: Found to be clean X-0lsen-net-MailScanner-From: clint@0lsen.net X-Spam-Status: No Cc: Subject: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 23:19:33 -0000 I've seen some stuff online that made it look like using hard-link trees and then doing some rsync worked, but some of this appears to be obsoleted by new rsync features. If anyone has a pointer, that would be much appreciated. Thanks, -Clint -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. From owner-freebsd-stable@FreeBSD.ORG Wed Oct 29 23:51:00 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 128861065670 for ; Wed, 29 Oct 2008 23:51:00 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA03.emeryville.ca.mail.comcast.net (qmta03.emeryville.ca.mail.comcast.net [76.96.30.32]) by mx1.freebsd.org (Postfix) with ESMTP id 44A568FC1F for ; Wed, 29 Oct 2008 23:50:58 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA04.emeryville.ca.mail.comcast.net ([76.96.30.35]) by QMTA03.emeryville.ca.mail.comcast.net with comcast id YcHG1a0010lTkoCA3nqy76; Wed, 29 Oct 2008 23:50:58 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA04.emeryville.ca.mail.comcast.net with comcast id Ynqx1a00L2P6wsM8QnqxN0; Wed, 29 Oct 2008 23:50:58 +0000 X-Authority-Analysis: v=1.0 c=1 a=O4elbw95V2UA:10 a=fsHTwVbq3VgA:10 a=QycZ5dHgAAAA:8 a=56y6IifgGXVeQTtvsKUA:9 a=GzBAohgEGxlDpvoiDD43Ka7e_PYA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 64CDBC9419; Wed, 29 Oct 2008 16:50:57 -0700 (PDT) Date: Wed, 29 Oct 2008 16:50:57 -0700 From: Jeremy Chadwick To: Clint Olsen Message-ID: <20081029235057.GA89812@icarus.home.lan> References: <20081029231926.GA35188@0lsen.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081029231926.GA35188@0lsen.net> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: stable@freebsd.org Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Oct 2008 23:51:00 -0000 On Wed, Oct 29, 2008 at 04:19:26PM -0700, Clint Olsen wrote: > I've seen some stuff online that made it look like using hard-link trees > and then doing some rsync worked, but some of this appears to be obsoleted > by new rsync features. If anyone has a pointer, that would be much > appreciated. We use sysutils/rsnapshot to take care of all of this in a very clean manner. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 00:08:33 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C4379106564A for ; Thu, 30 Oct 2008 00:08:33 +0000 (UTC) (envelope-from rhavenn@rhavenn.net) Received: from smtp203.sat.emailsrvr.com (smtp203.sat.emailsrvr.com [66.216.121.203]) by mx1.freebsd.org (Postfix) with ESMTP id 9FCE48FC13 for ; Thu, 30 Oct 2008 00:08:33 +0000 (UTC) (envelope-from rhavenn@rhavenn.net) Received: from relay20.relay.sat.mlsrvr.com (localhost [127.0.0.1]) by relay20.relay.sat.mlsrvr.com (SMTP Server) with ESMTP id CFB0D1B4012; Wed, 29 Oct 2008 19:32:19 -0400 (EDT) Received: by relay20.relay.sat.mlsrvr.com (Authenticated sender: rhavenn-AT-rhavenn.net) with ESMTP id 9F6E81B4003; Wed, 29 Oct 2008 19:32:19 -0400 (EDT) From: Henrik Hudson To: freebsd-stable@freebsd.org Date: Wed, 29 Oct 2008 15:32:16 -0800 User-Agent: KMail/1.10.1 (FreeBSD/7.1-PRERELEASE; KDE/4.1.1; i386; ; ) References: <20081029231926.GA35188@0lsen.net> In-Reply-To: <20081029231926.GA35188@0lsen.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810291532.16532.rhavenn@rhavenn.net> Cc: Clint Olsen Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rhavenn@rhavenn.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 00:08:33 -0000 On Wednesday 29 October 2008, Clint Olsen sent a missive stating: > I've seen some stuff online that made it look like using hard-link trees > and then doing some rsync worked, but some of this appears to be obsoleted > by new rsync features. If anyone has a pointer, that would be much > appreciated. Check out rdiff-backup it's a python script using the rsync libs. Henrik -- Henrik Hudson rhavenn@rhavenn.net ------------------------------ "There are 10 kinds of people in the world: Those who understand binary and those who don't..." From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 00:11:04 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CDA481065675 for ; Thu, 30 Oct 2008 00:11:04 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [91.103.162.4]) by mx1.freebsd.org (Postfix) with ESMTP id 8CD1D8FC19 for ; Thu, 30 Oct 2008 00:11:04 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 62D3019E02E; Thu, 30 Oct 2008 00:53:46 +0100 (CET) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 3EDC719E02D; Thu, 30 Oct 2008 00:53:44 +0100 (CET) Message-ID: <4908F7AB.4000205@quip.cz> Date: Thu, 30 Oct 2008 00:54:19 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: Clint Olsen References: <20081029231926.GA35188@0lsen.net> In-Reply-To: <20081029231926.GA35188@0lsen.net> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 00:11:04 -0000 Clint Olsen wrote: > I've seen some stuff online that made it look like using hard-link trees > and then doing some rsync worked, but some of this appears to be obsoleted > by new rsync features. If anyone has a pointer, that would be much > appreciated. I think freebsd-stable@ is not the right place to ask... This is part of my script I am using for "snapshotted" backups: src_host="10.20.30.40" # ip, ip:port, host, host.example.com:873 src_user="rsync_user" src_module="module_name" pass_file="/path/to/.rsync.passwd" # file with password for rsync_user dest="/where/to/store/backups" rsync_log="/var/log/rsync_backup.log" today=`date "+%Y-%m-%d"` yesterday=`date -v -1d "+%Y-%m-%d"` dest_curr="${dest}/${today}" # current backup dir by date [today] dest_last="${dest}/${yesterday}" # last backup dir from previous day rsync -a -H --log-file=${rsync_log} --numeric-ids --password-file=${pass_file} --link-dest=${dest_last} rsync://${src_user}@${src_host}/${src_module} ${dest_curr} This script is runned daily from backup server (where backups are stored). Rsync daemon is configured and running on backed up machine. Miroslav Lachman From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 00:53:07 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 83A0F106567F for ; Thu, 30 Oct 2008 00:53:07 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from mx01.qsc.de (mx01.qsc.de [213.148.129.14]) by mx1.freebsd.org (Postfix) with ESMTP id 426A88FC0A for ; Thu, 30 Oct 2008 00:53:07 +0000 (UTC) (envelope-from freebsd@edvax.de) Received: from r55.edvax.de (port-92-195-52-25.dynamic.qsc.de [92.195.52.25]) by mx01.qsc.de (Postfix) with ESMTP id 9B7D150D49; Thu, 30 Oct 2008 01:37:22 +0100 (CET) Received: from r55.edvax.de (localhost [127.0.0.1]) by r55.edvax.de (8.14.2/8.14.2) with SMTP id m9U0bLRe003520; Thu, 30 Oct 2008 01:37:21 +0100 (CET) (envelope-from freebsd@edvax.de) Date: Thu, 30 Oct 2008 01:37:20 +0100 From: Polytropon To: "Eduardo Meyer" Message-Id: <20081030013720.1ea2c825.freebsd@edvax.de> In-Reply-To: References: Organization: EDVAX X-Mailer: Sylpheed 2.4.7 (GTK+ 2.12.1; i386-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org, questions@freebsd.org Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Polytropon List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 00:53:07 -0000 On Wed, 29 Oct 2008 20:02:43 -0200, "Eduardo Meyer" wrote: > I need to write a cgi script which will print the output from ps(1) in > a table (html), so the average-operator can click on a KILL link and > the cgi will send the selected signal. If you can use awk, it's quite simple: ps | awk -F " " 'NR > 1 {printf("%s%s%s%s%s\n", $1, $2, $3, $4, $5);}' The only problem I see is that $5, the COMMAND field, is truncated after the first space character, so command line arguments will be missing. -- Polytropon >From Magdeburg, Germany Happy FreeBSD user since 4.0 Andra moi ennepe, Mousa, ... From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 01:14:23 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 49F8F1065680 for ; Thu, 30 Oct 2008 01:14:23 +0000 (UTC) (envelope-from pmurray@nevada.net.nz) Received: from bellagio.open2view.net (bellagio.open2view.net [210.48.79.75]) by mx1.freebsd.org (Postfix) with ESMTP id 0D83C8FC1C for ; Thu, 30 Oct 2008 01:14:22 +0000 (UTC) (envelope-from pmurray@nevada.net.nz) Received: from treasure-2.office.open2view.com (ip-58-28-153-152.static-xdsl.xnet.co.nz [58.28.153.152]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by bellagio.open2view.net (Postfix) with ESMTP id 368F9582E9B; Thu, 30 Oct 2008 13:59:04 +1300 (NZDT) Message-Id: <13394481-8FDC-4934-BB12-FA5BCB2D35CD@nevada.net.nz> From: Philip Murray To: Oliver Lehmann In-Reply-To: <20081029170728.be7cc7ab.lehmann@ans-netz.de> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 30 Oct 2008 13:59:03 +1300 References: <20081029170728.be7cc7ab.lehmann@ans-netz.de> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-stable@freebsd.org Subject: Re: 3Ware 9000 series hangs under load X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 01:14:23 -0000 On 30/10/2008, at 5:07 AM, Oliver Lehmann wrote: > Hi, > > I've problems with my 3ware controller. Havingg heavy I/O load (e.g. > running 40 port builds the day over with tinderbox which involves > un-taring a whole FreeBSD tree 40 times), my system hangs with the > well > known > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2, size: 4096 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2, size: 4096 I used to get this (FreeBSD 6.1 days) all the time, the controller would just lock up almost on a daily basis (and have to wait for the fsck 4 out of 24 hours in the day). Anyway, I stopped running 3dmd (or 3dm2 I think it's called now) to monitor it, and the crashes went away. It's had hundreds of days uptime since. I've never been game enough to try newer versions of 3dm, but a cronjob of tw_cli allows me to monitor it now without the lockups. Might not be your problem, but it's worth a shot if all else fails. From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 01:39:03 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EED7E106568C for ; Thu, 30 Oct 2008 01:39:03 +0000 (UTC) (envelope-from lstewart@freebsd.org) Received: from lauren.room52.net (lauren.room52.net [210.50.193.198]) by mx1.freebsd.org (Postfix) with ESMTP id 7E3128FC1C for ; Thu, 30 Oct 2008 01:39:03 +0000 (UTC) (envelope-from lstewart@freebsd.org) Received: from lstewart.caia.swin.edu.au (lstewart.caia.swin.edu.au [136.186.229.95]) (authenticated bits=0) by lauren.room52.net (8.14.3/8.14.3) with ESMTP id m9U12fpF035000 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 30 Oct 2008 12:02:42 +1100 (EST) (envelope-from lstewart@freebsd.org) Message-ID: <490907AC.5070303@freebsd.org> Date: Thu, 30 Oct 2008 12:02:36 +1100 From: Lawrence Stewart User-Agent: Thunderbird 2.0.0.16 (X11/20080806) MIME-Version: 1.0 To: Clint Olsen References: <20081029231926.GA35188@0lsen.net> In-Reply-To: <20081029231926.GA35188@0lsen.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-2.0 required=5.0 tests=AWL,BAYES_00,SPF_SOFTFAIL autolearn=disabled version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on lauren.room52.net Cc: stable@freebsd.org Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 01:39:04 -0000 Clint Olsen wrote: > I've seen some stuff online that made it look like using hard-link trees > and then doing some rsync worked, but some of this appears to be obsoleted > by new rsync features. If anyone has a pointer, that would be much > appreciated. Not exactly sure what you mean by "new rsync features", but I wrote the following script a while back with a similar purpose in mind and have recently updated it: https://lauren.room52.net/svn/lstewart/misc/scripts/rolling_backups/trunk/ Username/password: guest/guest It still needs a little bit of polishing, particularly the stats reporting feature, but works as is. The configure script is currently redundant and you can simply rename "backup.sh.in" to "backup.sh" and make it executable. The usage statement and comments at the top of the script describe how to use it. I use it to do all my home and non realtime-critical backups, but YMMV. Cheers, Lawrence From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 01:51:55 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8C2481065670 for ; Thu, 30 Oct 2008 01:51:55 +0000 (UTC) (envelope-from andrew@modulus.org) Received: from email.octopus.com.au (host-122-100-2-232.octopus.com.au [122.100.2.232]) by mx1.freebsd.org (Postfix) with ESMTP id 487D08FC13 for ; Thu, 30 Oct 2008 01:51:54 +0000 (UTC) (envelope-from andrew@modulus.org) Received: by email.octopus.com.au (Postfix, from userid 1002) id 6AA0217E4E; Thu, 30 Oct 2008 12:51:52 +1100 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on email.octopus.com.au X-Spam-Level: X-Spam-Status: No, score=-1.3 required=10.0 tests=ALL_TRUSTED, DNS_FROM_SECURITYSAGE autolearn=no version=3.2.3 Received: from [10.1.50.60] (ppp121-44-74-189.lns10.syd6.internode.on.net [121.44.74.189]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: admin@email.octopus.com.au) by email.octopus.com.au (Postfix) with ESMTP id 1938A17942; Thu, 30 Oct 2008 12:51:48 +1100 (EST) Message-ID: <490912CC.6000406@modulus.org> Date: Thu, 30 Oct 2008 12:50:04 +1100 From: Andrew Snow User-Agent: Thunderbird 2.0.0.14 (X11/20080523) MIME-Version: 1.0 To: freebsd-stable@freebsd.org, clint.olsen@gmail.com References: <20081029231926.GA35188@0lsen.net> <490907AC.5070303@freebsd.org> In-Reply-To: <490907AC.5070303@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 01:51:55 -0000 I've written a backup system using rsync's ability to generate "diff" files using batch file mode. It works like this: 1. We take a backup of the live system and store that 2. We generate a diff batch file against an older copy 3. We update the older copy to be identical to the current copy In this way, each day we generate a batch file that lets us step back one day. The diffs themselves, compressed with gzip, and extremely space efficient. We can step back potentially hundreds of days, though it seems to throw errors sometimes when backing up Windows boxes, which I haven't tracked down yet. But to be honest, soon you can save yourself a lot of hassle by simply using ZFS and taking snapshots. It'll be faster, and with compression very space efficient. - Andrew From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 05:12:23 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AE21B1065679 for ; Thu, 30 Oct 2008 05:12:23 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from ti-out-0910.google.com (ti-out-0910.google.com [209.85.142.186]) by mx1.freebsd.org (Postfix) with ESMTP id 1892A8FC17 for ; Thu, 30 Oct 2008 05:12:22 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: by ti-out-0910.google.com with SMTP id d27so169893tid.3 for ; Wed, 29 Oct 2008 22:12:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:received:received:date:from :to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=NNTIVve8i6ZGY0ZMgS5XeZDqN165De2z+lfOuXvssKI=; b=XiJEy5zvu8wdJy+ZcrYgXhr8wzrdtA4QeBL6tKG+YHt+tJRa7vt8PARTTjIKuevAik RVJLi8JEijKkfJOVCGUo7irGznkHRoKjhdzkPZyVON6N7P2jABjxAHPezLCgsAfgEzWe 8EkEfBxc24M0DuKb0xkczWnAzE8duXaM6NiL4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=xN41Zv7R3JmIz04wmwHkUhdkUWqHLBt/uq+4Z/DLMPBiUUGZOKXCr337DkTcOQ1K13 OkW/ljyp6jS/Cc3GNb7NoiYBT7nLxCWI0/yf9fy7yLTr9wIjfu7ppOnr936doTE89du7 lrYIo9IoH2zUyhs8ElrkiOh91V7DUAe1mkJvI= Received: by 10.110.20.15 with SMTP id 15mr6689953tit.28.1225343541946; Wed, 29 Oct 2008 22:12:21 -0700 (PDT) Received: from michelle.cdnetworks.co.kr ([211.53.35.84]) by mx.google.com with ESMTPS id a14sm2081375tia.12.2008.10.29.22.12.18 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 29 Oct 2008 22:12:19 -0700 (PDT) Received: from michelle.cdnetworks.co.kr (localhost.cdnetworks.co.kr [127.0.0.1]) by michelle.cdnetworks.co.kr (8.13.5/8.13.5) with ESMTP id m9U5AJie079690 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 30 Oct 2008 14:10:19 +0900 (KST) (envelope-from pyunyh@gmail.com) Received: (from yongari@localhost) by michelle.cdnetworks.co.kr (8.13.5/8.13.5/Submit) id m9U5AHmj079689; Thu, 30 Oct 2008 14:10:17 +0900 (KST) (envelope-from pyunyh@gmail.com) Date: Thu, 30 Oct 2008 14:10:17 +0900 From: Pyun YongHyeon To: Ilya Bakulin Message-ID: <20081030051017.GB78796@cdnetworks.co.kr> References: <755632516.20081018001504@rulez.sk> <20081018020248.GB31303@cdnetworks.co.kr> <20081020012504.95adc0ca.nork@FreeBSD.org> <20081020071155.GH38923@cdnetworks.co.kr> <20081020132827.edbb2c53.webmaster@kibab.com> <20081021043152.GE43039@cdnetworks.co.kr> <20081030001123.cb1ebd9c.webmaster@kibab.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081030001123.cb1ebd9c.webmaster@kibab.com> User-Agent: Mutt/1.4.2.1i Cc: Daniel Gerzo , Norikatsu Shigemura , stable@FreeBSD.org, yongari@FreeBSD.org Subject: Re: re0 problem X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 05:12:23 -0000 On Thu, Oct 30, 2008 at 12:11:23AM +0300, Ilya Bakulin wrote: > On Tue, 21 Oct 2008 13:31:52 +0900 > Pyun YongHyeon wrote: > > > On Mon, Oct 20, 2008 at 01:28:27PM +0400, Ilya Bakulin wrote: > > > On my laptop (Dell Vostro 1310) I get _periodically_ (not always!) the same error: > > > > re0: PHY write failed > > > re0: PHY write failed > > > re0: MII without any phy! > > > device_attach: re0 attach returned 6 > > > > This is known issue which happens on RTL8168C/CP and RTL8102E/EL > > PCIe controllers. Would you try the patch at the following URL? > > > > http://www.freebsd.org/~yongari/re/re.ephy.patch.20081021 > > > > Even if the patch work for you, you should try serveral times to > > make sure it really fix the issue.(e.g. completely shutdown your > > box, unplug power cord and wait several mininutes and reboot.) > > > -- > > Regards, > > Pyun YongHyeon > > I've applied this patch nine days ago and added "if_re_load=yes" in /boot/loader.conf (Earlier I used to kldload it only if I needed to). Since that time I've never seen errors. Thank you!!! > Please make sure you've (cold/warm) rebooted several times with this patch. Just applying the patch and using it without reboots doesn't necessary mean a working fix. Since it's hard to reproduce the issue even on a system with problematic controllers I'd like to have confidence in the patch. -- Regards, Pyun YongHyeon From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 05:19:51 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 17A0B1065673 for ; Thu, 30 Oct 2008 05:19:51 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.237]) by mx1.freebsd.org (Postfix) with ESMTP id D7A198FC08 for ; Thu, 30 Oct 2008 05:19:50 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so374262rvf.43 for ; Wed, 29 Oct 2008 22:19:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=uU4OPK4LLCDm4PJzr797gSKc8ceUMyUXhUJqeMuliME=; b=ohYz/XZNpL3RKg8XDIVjsMj9XiM1lZ0SBNbedWp1TgPe/bfj9s2lSSvzYrDQXYqRIX hqgVTTR214mjIgOciuw32xZ16OM0TaFhOIrvojoDuCCZQswKL5SIb9IqWLocIqC9+/3V 50Fyz7UtVBr5fwy+6ElxC3JfuHi3IjSkrMawU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=ugJATifNnz3YY9qLbGrIjXV5UK51TADaUCPHY8OBRjkdhitIygii4Vgb5c3tom2Z1M vPvnCRj5h8z4vgjWqFOj4d4kBcGBru2EBKXqeGaKuJDvfcTgVIWqyrPsX5YDhlJHhoQZ NxGT2VriLYVBaRk3NdZ9Gbj2zMQ+4UdTXQevU= Received: by 10.141.18.10 with SMTP id v10mr1371735rvi.3.1225342732887; Wed, 29 Oct 2008 21:58:52 -0700 (PDT) Received: by 10.140.200.11 with HTTP; Wed, 29 Oct 2008 21:58:52 -0700 (PDT) Message-ID: Date: Thu, 30 Oct 2008 04:58:52 +0000 From: "Freddie Cash" To: freebsd-stable@freebsd.org In-Reply-To: <490912CC.6000406@modulus.org> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081029231926.GA35188@0lsen.net> <490907AC.5070303@freebsd.org> <490912CC.6000406@modulus.org> Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 05:19:51 -0000 On Thu, Oct 30, 2008 at 1:50 AM, Andrew Snow wrote: > In this way, each day we generate a batch file that lets us step back one > day. The diffs themselves, compressed with gzip, and extremely space > efficient. We can step back potentially hundreds of days, though it seems > to throw errors sometimes when backing up Windows boxes, which I haven't > tracked down yet. > > But to be honest, soon you can save yourself a lot of hassle by simply using > ZFS and taking snapshots. It'll be faster, and with compression very space > efficient. That's exactly what we do, use ZFS and RSync. We have a ZFS /storage/backup filesystem, with directories for each remote site, and sub-directories for each server to be backed up. Each night we snapshot the directory, then run rsync to backup each server. Snapshots are named with the current date. For 80 FreeBSD and Linux servers, we average 10 GB of changed data a night. No muss, no fuss. We've used it to restore entire servers (boot off Knoppix/Frenzy CD, format partitions, rsync back), individual files (no mounting required, just cd into the .zfs/snapshot/snapshotname directory and scp the file), and even once to restore the permissions on a pair of servers where a clueless admin "chmod -R user /home" and "chmod -R 777 /home". Our backup script is pretty much just a double-for loop that scans a set of site-name directories for server config files, and runs rsync in parallel (1 per remote site). We we looking into using variations on rsnapshot, custom squashfs/hardlink stuff, and other solutions, but once we started using ZFS, we stopped looking down those roads. We were able to do in 3 days of testing and scripting what we hadn't been able to do in almost a month of research and testing. -- Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 05:26:40 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C5E50106564A for ; Thu, 30 Oct 2008 05:26:40 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.225]) by mx1.freebsd.org (Postfix) with ESMTP id 91C6F8FC0C for ; Thu, 30 Oct 2008 05:26:40 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so376804rvf.43 for ; Wed, 29 Oct 2008 22:26:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=uU4OPK4LLCDm4PJzr797gSKc8ceUMyUXhUJqeMuliME=; b=Go4AN4n8UArojf4DQYXXViGovpHGQxW4BWIKhQkcPYDmII7mUfNSyH9VY9a/j5bGxb qcHiuarlSC95bIkIEucK5EFD7s/7SZ4F48BhdQkJ+1ELj2c36fMDPFOtWpiJj8KI48Kp L17GpKAhS/Oaom1Er2xVyXdEn0InHv6AnBZNg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=X6/SvT/Q8js81cvmQshtph5O/XBzr1X2K4foqrUM/BPzPe9M7ITm0xc86ZebkDAl8q KSOrnNxLDmysfvNEkvT/haGIZhIwU2WM74vS2segaBP4BBVuM3HGK57eusKOwSzIYMVt ELucKByQTx2qFxqIiFs74PabIePV0Q2P0Nu3g= Received: by 10.115.73.20 with SMTP id a20mr7965451wal.142.1225342835267; Wed, 29 Oct 2008 22:00:35 -0700 (PDT) Received: by 10.114.121.12 with HTTP; Wed, 29 Oct 2008 22:00:33 -0700 (PDT) Message-ID: Date: Thu, 30 Oct 2008 05:00:33 +0000 From: "Freddie Cash" To: freebsd-stable@freebsd.org In-Reply-To: <490912CC.6000406@modulus.org> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081029231926.GA35188@0lsen.net> <490907AC.5070303@freebsd.org> <490912CC.6000406@modulus.org> Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 05:26:40 -0000 On Thu, Oct 30, 2008 at 1:50 AM, Andrew Snow wrote: > In this way, each day we generate a batch file that lets us step back one > day. The diffs themselves, compressed with gzip, and extremely space > efficient. We can step back potentially hundreds of days, though it seems > to throw errors sometimes when backing up Windows boxes, which I haven't > tracked down yet. > > But to be honest, soon you can save yourself a lot of hassle by simply using > ZFS and taking snapshots. It'll be faster, and with compression very space > efficient. That's exactly what we do, use ZFS and RSync. We have a ZFS /storage/backup filesystem, with directories for each remote site, and sub-directories for each server to be backed up. Each night we snapshot the directory, then run rsync to backup each server. Snapshots are named with the current date. For 80 FreeBSD and Linux servers, we average 10 GB of changed data a night. No muss, no fuss. We've used it to restore entire servers (boot off Knoppix/Frenzy CD, format partitions, rsync back), individual files (no mounting required, just cd into the .zfs/snapshot/snapshotname directory and scp the file), and even once to restore the permissions on a pair of servers where a clueless admin "chmod -R user /home" and "chmod -R 777 /home". Our backup script is pretty much just a double-for loop that scans a set of site-name directories for server config files, and runs rsync in parallel (1 per remote site). We we looking into using variations on rsnapshot, custom squashfs/hardlink stuff, and other solutions, but once we started using ZFS, we stopped looking down those roads. We were able to do in 3 days of testing and scripting what we hadn't been able to do in almost a month of research and testing. -- Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 08:51:06 2008 Return-Path: Delivered-To: stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 655701065670 for ; Thu, 30 Oct 2008 08:51:06 +0000 (UTC) (envelope-from nick@van-laarhoven.org) Received: from hpsmtp-eml19.kpnxchange.com (hpsmtp-eml19.KPNXCHANGE.COM [213.75.38.84]) by mx1.freebsd.org (Postfix) with ESMTP id E9FDA8FC0A for ; Thu, 30 Oct 2008 08:51:05 +0000 (UTC) (envelope-from nick@van-laarhoven.org) Received: from cpsmtpi-eml05.kpnxchange.com ([213.75.38.135]) by hpsmtp-eml19.kpnxchange.com with Microsoft SMTPSVC(6.0.3790.3959); Thu, 30 Oct 2008 09:39:02 +0100 Received: from uitsmijter.van-laarhoven.org ([81.207.207.222]) by cpsmtpi-eml05.kpnxchange.com with Microsoft SMTPSVC(6.0.3790.3959); Thu, 30 Oct 2008 09:39:02 +0100 Received: (qmail 68917 invoked by uid 98); 30 Oct 2008 08:39:01 -0000 Received: from 10.66.0.135 (nick@10.66.0.135) by uitsmijter.van-laarhoven.org (envelope-from , uid 82) with qmail-scanner-2.01 (clamdscan: 0.92/5270. f-prot: 4.6.7/3.16.15. spamassassin: 3.2.3. Clear:RC:1(10.66.0.135):. Processed in 0.782965 secs); 30 Oct 2008 08:39:01 -0000 Received: from unknown (HELO van-laarhoven.org) (nick@10.66.0.135) by uitsmijter.van-laarhoven.org with SMTP; 30 Oct 2008 08:39:00 -0000 Received: (nullmailer pid 2064 invoked by uid 1001); Thu, 30 Oct 2008 08:38:59 -0000 From: Nick Hibma To: svn-src-all@freebsd.org Date: Thu, 30 Oct 2008 09:38:57 +0100 User-Agent: KMail/1.9.7 References: <200810300832.m9U8WInO045752@svn.freebsd.org> In-Reply-To: <200810300832.m9U8WInO045752@svn.freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810300938.58420.nick@van-laarhoven.org> X-OriginalArrivalTime: 30 Oct 2008 08:39:02.0446 (UTC) FILETIME=[F5F924E0:01C93A6A] Cc: FreeBSD STABLE Mailing List , chat@freebsd.org Subject: Re: svn commit: r184466 - head/sys/dev/usb X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 08:51:06 -0000 Folks, Just to preempt people suggesting that I committed into the wrong tree: I didn't. FBSD 6 is still locked down. To keep things simple I keep one version of the driver in CURRENT which works on FBSD CURRENT, 7, and 6. See http://people.freebsd.org/~n_hibma/u3g.html for more info on how to use the driver in various versions of the OS. And the cross post is intentional as well as I've had many positive responses from people that became aware of the driver. Nick > Author: n_hibma > Date: Thu Oct 30 08:32:18 2008 > New Revision: 184466 > URL: http://svn.freebsd.org/changeset/base/184466 > > Log: > We need to print out the device info ourselves on FBSD 6. > > Submitted by: Thomas Nystrom > > Modified: > head/sys/dev/usb/u3g.c > > Modified: head/sys/dev/usb/u3g.c > ========================================================================= >===== --- head/sys/dev/usb/u3g.c Thu Oct 30 08:17:27 2008 (r184465) > +++ head/sys/dev/usb/u3g.c Thu Oct 30 08:32:18 2008 (r184466) > @@ -227,6 +227,13 @@ u3g_attach(device_t self) > usb_config_descriptor_t *cd; > char devnamefmt[32]; > > +#if __FreeBSD_version < 700000 > + char *devinfo = malloc(1024, M_USBDEV, M_WAITOK); > + usbd_devinfo(dev, 0, devinfo); > + device_printf(self, "%s\n", devinfo); > + free(devinfo, M_USBDEV); > +#endif > + > /* get the config descriptor */ > cd = usbd_get_config_descriptor(dev); > if (cd == NULL) { > _______________________________________________ > svn-src-all@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/svn-src-all > To unsubscribe, send any mail to "svn-src-all-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 08:52:46 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E48B2106568C for ; Thu, 30 Oct 2008 08:52:45 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.173]) by mx1.freebsd.org (Postfix) with ESMTP id 6E5638FC18 for ; Thu, 30 Oct 2008 08:52:45 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: by ug-out-1314.google.com with SMTP id 30so804260ugs.39 for ; Thu, 30 Oct 2008 01:52:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-mailer; bh=rtix3TCZH3KNeC/yp/gmd9WkAmzw0C0v4aLQ4dScihg=; b=oUksSH0E9jTLvhW6cy40wA2Q7p5xEnVAXgCfZuKa49fTeWq1EGhc51lwXjJk5K1LVa ZQaqOFcBQHWINhHQQPKJwrOAhKcrdVxQVlGXMShYEzGAP5r+Df4oqgI6qAkTucpefmm/ pNYTjZD/hgAFiHUGXmlgQ67hoJza2MtfOVbd4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-mailer; b=IPdXyL1xQJL3FVAXHpgcMYBgG5aRCtlQhMevu0USttJ8vpU7SaPZ1EH6+6T2YGSVji CivZhCalOdhnQWJW91i/XhKZ7JKxKJ/5Vq1AQhehxMC49lqP1YgxQEdm82DWuMtC4WFy mIcMFtNvfktOEWaFk8/GosNKJBbwRyXWNPwBA= Received: by 10.103.93.18 with SMTP id v18mr2810262mul.89.1225355162458; Thu, 30 Oct 2008 01:26:02 -0700 (PDT) Received: from ndenev.cmotd.com (blah.sun-fish.com [217.18.249.150]) by mx.google.com with ESMTPS id u9sm4067573muf.9.2008.10.30.01.25.59 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 30 Oct 2008 01:26:00 -0700 (PDT) Message-Id: <95550BEC-DB92-4C68-8409-3DFF7C0B86C0@gmail.com> From: Nikolay Denev To: Freddie Cash In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 30 Oct 2008 10:25:56 +0200 References: <20081029231926.GA35188@0lsen.net> <490907AC.5070303@freebsd.org> <490912CC.6000406@modulus.org> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-stable@freebsd.org Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 08:52:46 -0000 On 30 Oct, 2008, at 07:00 , Freddie Cash wrote: > On Thu, Oct 30, 2008 at 1:50 AM, Andrew Snow > wrote: >> In this way, each day we generate a batch file that lets us step >> back one >> day. The diffs themselves, compressed with gzip, and extremely space >> efficient. We can step back potentially hundreds of days, though >> it seems >> to throw errors sometimes when backing up Windows boxes, which I >> haven't >> tracked down yet. >> >> But to be honest, soon you can save yourself a lot of hassle by >> simply using >> ZFS and taking snapshots. It'll be faster, and with compression >> very space >> efficient. > > That's exactly what we do, use ZFS and RSync. We have a ZFS > /storage/backup filesystem, with directories for each remote site, and > sub-directories for each server to be backed up. > > Each night we snapshot the directory, then run rsync to backup each > server. Snapshots are named with the current date. For 80 FreeBSD > and Linux servers, we average 10 GB of changed data a night. > > No muss, no fuss. We've used it to restore entire servers (boot off > Knoppix/Frenzy CD, format partitions, rsync back), individual files > (no mounting required, just cd into the .zfs/snapshot/snapshotname > directory and scp the file), and even once to restore the permissions > on a pair of servers where a clueless admin "chmod -R user /home" and > "chmod -R 777 /home". > > Our backup script is pretty much just a double-for loop that scans a > set of site-name directories for server config files, and runs rsync > in parallel (1 per remote site). > > We we looking into using variations on rsnapshot, custom > squashfs/hardlink stuff, and other solutions, but once we started > using ZFS, we stopped looking down those roads. We were able to do in > 3 days of testing and scripting what we hadn't been able to do in > almost a month of research and testing. > > -- > Freddie Cash > fjwcash@gmail.com > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org > " Hi, Do you experience problems with the snapshots? Last time I tried something similiar for backups the bachine began to spit errors after a few days of snapshots. http://lists.freebsd.org/pipermail/freebsd-fs/2008-February/004413.html -- Regards, Nikolay Denev From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 09:04:30 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1923C106564A for ; Thu, 30 Oct 2008 09:04:30 +0000 (UTC) (envelope-from andrew@modulus.org) Received: from email.octopus.com.au (host-122-100-2-232.octopus.com.au [122.100.2.232]) by mx1.freebsd.org (Postfix) with ESMTP id CB89D8FC1A for ; Thu, 30 Oct 2008 09:04:29 +0000 (UTC) (envelope-from andrew@modulus.org) Received: by email.octopus.com.au (Postfix, from userid 1002) id 3075B17DDF; Thu, 30 Oct 2008 20:04:26 +1100 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on email.octopus.com.au X-Spam-Level: X-Spam-Status: No, score=-1.3 required=10.0 tests=ALL_TRUSTED, DNS_FROM_SECURITYSAGE autolearn=no version=3.2.3 Received: from [10.20.30.101] (60.218.233.220.exetel.com.au [220.233.218.60]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: admin@email.octopus.com.au) by email.octopus.com.au (Postfix) with ESMTP id 389D51737B; Thu, 30 Oct 2008 20:04:22 +1100 (EST) Message-ID: <49097892.5070200@modulus.org> Date: Thu, 30 Oct 2008 20:04:18 +1100 From: Andrew Snow User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: Nikolay Denev References: <20081029231926.GA35188@0lsen.net> <490907AC.5070303@freebsd.org> <490912CC.6000406@modulus.org> <95550BEC-DB92-4C68-8409-3DFF7C0B86C0@gmail.com> In-Reply-To: <95550BEC-DB92-4C68-8409-3DFF7C0B86C0@gmail.com> Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 09:04:30 -0000 Nikolay Denev wrote: > Do you experience problems with the snapshots? > Last time I tried something similiar for backups the bachine > began to spit errors after a few days of snapshots. > > http://lists.freebsd.org/pipermail/freebsd-fs/2008-February/004413.html Haven't seen that one specifically, but I experienced several big problems with ZFS on 7.x, and when I upgraded to 8-current (~July) with pjd's extra patches, it solved everything. Best thing now is to sit tight and wait for the patches to make it back into the source tree. - Andrew From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 09:33:00 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2467B106568F for ; Thu, 30 Oct 2008 09:32:59 +0000 (UTC) (envelope-from v.haisman@sh.cvut.cz) Received: from service2.sh.cvut.cz (service2.sh.cvut.cz [147.32.127.218]) by mx1.freebsd.org (Postfix) with ESMTP id A630D8FC22 for ; Thu, 30 Oct 2008 09:32:58 +0000 (UTC) (envelope-from v.haisman@sh.cvut.cz) Received: from localhost (localhost [127.0.0.1]) by service2.sh.cvut.cz (Postfix) with ESMTP id 43593137724; Thu, 30 Oct 2008 10:32:27 +0100 (CET) Received: from service2.sh.cvut.cz ([127.0.0.1]) by localhost (service2.sh.cvut.cz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 01598-07; Thu, 30 Oct 2008 10:32:20 +0100 (CET) Received: from [192.168.111.233] (eccam.com [82.113.60.26]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by service2.sh.cvut.cz (Postfix) with ESMTP id E25B413771D; Thu, 30 Oct 2008 10:32:19 +0100 (CET) Message-ID: <49097F1F.7060109@sh.cvut.cz> Date: Thu, 30 Oct 2008 10:32:15 +0100 From: =?ISO-8859-1?Q?V=E1clav_Haisman?= User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: Dominique Goncalves References: <7daacbbe0810290217l60236d8ci1b2c4011720a0cc8@mail.gmail.com> In-Reply-To: <7daacbbe0810290217l60236d8ci1b2c4011720a0cc8@mail.gmail.com> X-Enigmail-Version: 0.95.7 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at service2.sh.cvut.cz X-Spam-Status: No, hits=-1.0 tagged_above=-255.0 required=5.0 tests=AWL, CRM114_HAM_10, JR_RCVD_TOO_FEW_HOPS X-Spam-Level: Cc: freebsd-stable@freebsd.org Subject: Re: Perl application hang in umtxn state X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 09:33:00 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Dominique Goncalves wrote: > Hi, > > I run FreeBSD 7.1-PRERELEASE and with a Perl GTK2 application, Perl > hang in umtxn state: > > PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAND > 76288 dom 1 53 0 67860K 46080K umtxn 0:02 0.00% perl5.8.8 > > And the only way to stop the application is kill -9 > > I tried to use ktrace/kdump and ktrace.out show "_umtx_op" > > $ kdump -f ktrace.out > [...] > 13199 perl5.8.8 RET lstat 0 > 13199 perl5.8.8 CALL gettimeofday(0xbfbfb144,0) > 13199 perl5.8.8 RET gettimeofday 0 > 13199 perl5.8.8 CALL _umtx_op(0xbfbfd18c,0x3,0x1,0,0) > 13199 perl5.8.8 RET _umtx_op 0 > 13199 perl5.8.8 CALL sigprocmask(SIG_BLOCK,0xbfbfd120,0x8121490) > 13199 perl5.8.8 RET sigprocmask 0 > 13199 perl5.8.8 CALL _umtx_op(0x287fb8a0,0x5,0,0,0) > 13199 perl5.8.8 RET _umtx_op RESTART > 13199 perl5.8.8 PSIG SIGKILL SIG_DFL > > > How to debug this hang? (btw I'm not a developer) You can try rebuilding perl with debugging information. I am not sure this is the best way but I have used this in my /etc/make.conf: # Disable binaries stripping. STRIP= # Add debugging info to binaries. CFLAGS?= CFLAGS+= -g3 -ggdb CXXFLAGS?= CXXFLAGS+= -g3 -ggdb When you have that, try running your test case again. When it blocks again, attach GDB to the hung process: gdb -p PID `which perl`. And then obtain the call stack: (gdb) bt. I suspect there will be some pthreads call on top of the stack. I am not FreeBSD developer but this seems really similar to situations reported in thread "umtxn and Apache 2.2" and mine "Process in "uwait" state". > > $ uname -a > FreeBSD freebsd7 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #15 r184123: > Tue Oct 21 16:24:59 CEST 2008 > root@freebsd7:/usr/obj/usr/src/sys/GENERIC i386 > > Thanks for your help, > Regards. > - -- VH -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iFYEAREIAAYFAkkJfx8ACgkQhQBMvHf/WHnzuwDffY0A82o1mpzdVBixQ6bjeqon pLikFIEvlXke3ADeIGmhTjnC5TPnJE01XiiZyPuOcrrgYpXhFzTdPw== =KOCn -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 13:27:15 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 75DE2106564A; Thu, 30 Oct 2008 13:27:15 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 0AB6B8FC17; Thu, 30 Oct 2008 13:27:14 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [IPv6:::1]) (authenticated bits=0) by server.baldwin.cx (8.14.3/8.14.3) with ESMTP id m9UDR7J0048145; Thu, 30 Oct 2008 09:27:07 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: freebsd-smp@freebsd.org Date: Thu, 30 Oct 2008 09:27:02 -0400 User-Agent: KMail/1.9.7 References: <20081029170728.be7cc7ab.lehmann@ans-netz.de> In-Reply-To: <20081029170728.be7cc7ab.lehmann@ans-netz.de> MIME-Version: 1.0 Content-Disposition: inline Message-Id: <200810300927.03620.jhb@freebsd.org> Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [IPv6:::1]); Thu, 30 Oct 2008 09:27:07 -0400 (EDT) X-Virus-Scanned: ClamAV 0.93.1/8541/Wed Oct 29 22:54:28 2008 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=4.2 tests=BAYES_00,NO_RELAYS autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: freebsd-stable@freebsd.org, Oliver Lehmann Subject: Re: 3Ware 9000 series hangs under load X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 13:27:15 -0000 On Wednesday 29 October 2008 12:07:28 pm Oliver Lehmann wrote: > Hi, > > I've problems with my 3ware controller. Havingg heavy I/O load (e.g. > running 40 port builds the day over with tinderbox which involves > un-taring a whole FreeBSD tree 40 times), my system hangs with the well > known > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2, size: 4096 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2, size: 4096 > > error. I'v opened a ticket at 3ware and after half a month of > dummy-testings (are your drives fine, can you run a stress test), it > looks like i was redirected to someone from the 2nd lvl support and he > told me: > > There are 2 things that you can try, > 1, disable apic in your bootloader.conf file, or RMA the controller. > > The error that you have is generally caused by an interrupt problem, > defective backplane, bad drive or bad controller. > > and after I told him that I intend to use the 2 CPUs I have and not > falling back to one CPU for ever he responded: > > Yes I do understand about disabling APIC, but the feature is sometimes > not stable in all dual proc systems. There are many variables, the > CPU's have to be matched down to the Lot #, the motherboard must have a > good design and the kernel supporting APIC must be stable. But, it is a > good test to see if it is software or hardware. > > So what I did now, was compiling a kernel w/o apic/smp and I'm running > this configuration now for 3 days stressing the system w/o running into > the swap_pager problem. Can it be still a controller problem or is it > more likley a problem of FreeBSDs smp/apic implementation or the board > I'm using (Intel L440GX). > > I'm asking because I'm not sure which problem it is now and before > telling it 3ware and having them responding "ok it is a FreeBSD problem" > or "ok it is a board problem" I'd like to know what can be the case here. > > (please keep me CCed, I'm not subscribed to smp@) > > Further information (and the history) on this topic can be found here > (and following): > > http://lists.freebsd.org/pipermail/freebsd-stable/2008-September/045500.html FYI, you can disable APIC support w/o recompiling your kernel. Just set 'hint.apic.0.disabled=1' in the loader. If the problem is that the card stops triggering interrupts after being up for a while, then it is likely not a FreeBSD bug. If FreeBSD doesn't get the interrupt routing and setup correct then the card will not work at all starting at boot. You can also try just disabling SMP while leaving APIC enabled by setting 'kern.smp.disabled=1' from the loader. If that fixes the issue, then it may be that the 3ware driver simply has a race condition that is more easily triggered on SMP boxes. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 14:19:00 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 901081065670 for ; Thu, 30 Oct 2008 14:19:00 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 07F648FC1F for ; Thu, 30 Oct 2008 14:18:59 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9UEIwl2086322; Thu, 30 Oct 2008 15:18:58 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9UEIvSj086321; Thu, 30 Oct 2008 15:18:57 +0100 (CET) (envelope-from olli) Date: Thu, 30 Oct 2008 15:18:57 +0100 (CET) Message-Id: <200810301418.m9UEIvSj086321@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG, dudu.meyer@gmail.com In-Reply-To: X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Thu, 30 Oct 2008 15:18:58 +0100 (CET) Cc: Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-stable@FreeBSD.ORG, dudu.meyer@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 14:19:00 -0000 Eduardo Meyer wrote: > I need to write a cgi script which will print the output from ps(1) in > a table (html), so the average-operator can click on a KILL link and > the cgi will send the selected signal. > > I need to add one ps information per column in a table (html), > however, I found ps(1) output to be too hard to parse. There is no > separator. I believed \t was the separator but its not. > > The ps(1) command I need to use is: > > ps -ax -o pid -o user -o emul -o lstart -o lockname -o stat -o command You should use -axww so the command is not truncated. > Since many of those args use [:space:] in the output, I can not use > [:space:] as a separator. Yup, that's a problem. That's why a simple awk line won't do it. You should use fixed character positions instead of field separaters for splitting fields. I think you can look at the headers (first line) to determine the field widths. All fields are left-aligned except for the PID. So your script should simply look at the first line and store the starting position of every word in an array. Using those values you can split all the data lines according to the character positions. I could provide a 3-liner in Python, but I assume you're not writing that script in Python. :-) Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd C++: "an octopus made by nailing extra legs onto a dog" -- Steve Taylor, 1998 From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 14:59:44 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E52E21065696 for ; Thu, 30 Oct 2008 14:59:44 +0000 (UTC) (envelope-from jerrymc@gizmo.acns.msu.edu) Received: from gizmo.acns.msu.edu (gizmo.acns.msu.edu [35.8.1.43]) by mx1.freebsd.org (Postfix) with ESMTP id A8C618FC1C for ; Thu, 30 Oct 2008 14:59:44 +0000 (UTC) (envelope-from jerrymc@gizmo.acns.msu.edu) Received: from gizmo.acns.msu.edu (localhost [127.0.0.1]) by gizmo.acns.msu.edu (8.13.6/8.13.6) with ESMTP id m9UEf0g8012284; Thu, 30 Oct 2008 10:41:00 -0400 (EDT) (envelope-from jerrymc@gizmo.acns.msu.edu) Received: (from jerrymc@localhost) by gizmo.acns.msu.edu (8.13.6/8.13.6/Submit) id m9UEf0v8012283; Thu, 30 Oct 2008 10:41:00 -0400 (EDT) (envelope-from jerrymc) Date: Thu, 30 Oct 2008 10:41:00 -0400 From: Jerry McAllister To: d@delphij.net Message-ID: <20081030144100.GA12264@gizmo.acns.msu.edu> References: <4908EE91.1080706@delphij.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4908EE91.1080706@delphij.net> User-Agent: Mutt/1.4.2.2i Cc: stable@freebsd.org, Eduardo Meyer , questions@freebsd.org Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 14:59:45 -0000 On Wed, Oct 29, 2008 at 04:15:29PM -0700, Xin LI wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Eduardo Meyer wrote: > > Hello, > > > > I need to write a cgi script which will print the output from ps(1) in > > a table (html), so the average-operator can click on a KILL link and > > the cgi will send the selected signal. > > > > I need to add one ps information per column in a table (html), > > however, I found ps(1) output to be too hard to parse. There is no > > separator. I believed \t was the separator but its not. > > > > The ps(1) command I need to use is: > > > > ps -ax -o pid -o user -o emul -o lstart -o lockname -o stat -o command > > > > Since many of those args use [:space:] in the output, I can not use > > [:space:] as a separator. > > Sadly, `-o fiend='value'` will only format the HEADER output, not the values. > > > > Ive got no clue what to do, can someone enlight me? Well, first pick a language. This would be easy in PHP or Perl or other similar scripting interpreter languages. If you pick one and then study it a little - write a few simple practice scripts, you will probably quickly see how to do it. ////jerry > > Perhaps use cut(1) with -c or something similar in other scripting > language? It looks like that the output is aligned. > > Cheers, > - -- > Xin LI http://www.delphij.net/ > FreeBSD - The Power to Serve! > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v2.0.9 (FreeBSD) > > iEYEARECAAYFAkkI7pEACgkQi+vbBBjt66Bi3wCgmk9chU/FIZjuBpm/57Yl7jBY > D6kAoI6ZmQRdxDm7mzjale84p4uXmlmz > =4FMM > -----END PGP SIGNATURE----- > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 15:04:39 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 235E91065672 for ; Thu, 30 Oct 2008 15:04:39 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.freebsd.org (Postfix) with ESMTP id ED1218FC20 for ; Thu, 30 Oct 2008 15:04:38 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id BDA8F1A000B31 for ; Thu, 30 Oct 2008 08:04:37 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at smtp.sd73.bc.ca Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id LKgclM7PmJCU for ; Thu, 30 Oct 2008 08:04:31 -0700 (PDT) Received: from coal (s10.sbo [192.168.0.10]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 5687C1A000B18 for ; Thu, 30 Oct 2008 08:04:31 -0700 (PDT) From: Freddie Cash To: freebsd-stable@freebsd.org Date: Thu, 30 Oct 2008 08:04:31 -0700 User-Agent: KMail/1.9.9 References: <20081029231926.GA35188@0lsen.net> <95550BEC-DB92-4C68-8409-3DFF7C0B86C0@gmail.com> In-Reply-To: <95550BEC-DB92-4C68-8409-3DFF7C0B86C0@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810300804.31186.fjwcash@gmail.com> Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 15:04:39 -0000 On October 30, 2008 01:25 am Nikolay Denev wrote: > On 30 Oct, 2008, at 07:00 , Freddie Cash wrote: > > On Thu, Oct 30, 2008 at 1:50 AM, Andrew Snow > > > > wrote: > >> In this way, each day we generate a batch file that lets us step > >> back one > >> day. The diffs themselves, compressed with gzip, and extremely > >> space efficient. We can step back potentially hundreds of days, > >> though it seems > >> to throw errors sometimes when backing up Windows boxes, which I > >> haven't > >> tracked down yet. > >> > >> But to be honest, soon you can save yourself a lot of hassle by > >> simply using > >> ZFS and taking snapshots. It'll be faster, and with compression > >> very space > >> efficient. > > > > That's exactly what we do, use ZFS and RSync. We have a ZFS > > /storage/backup filesystem, with directories for each remote site, > > and sub-directories for each server to be backed up. > > > > Each night we snapshot the directory, then run rsync to backup each > > server. Snapshots are named with the current date. For 80 FreeBSD > > and Linux servers, we average 10 GB of changed data a night. > > > > No muss, no fuss. We've used it to restore entire servers (boot off > > Knoppix/Frenzy CD, format partitions, rsync back), individual files > > (no mounting required, just cd into the .zfs/snapshot/snapshotname > > directory and scp the file), and even once to restore the permissions > > on a pair of servers where a clueless admin "chmod -R user /home" and > > "chmod -R 777 /home". > > > > Our backup script is pretty much just a double-for loop that scans a > > set of site-name directories for server config files, and runs rsync > > in parallel (1 per remote site). > > > > We we looking into using variations on rsnapshot, custom > > squashfs/hardlink stuff, and other solutions, but once we started > > using ZFS, we stopped looking down those roads. We were able to do > > in 3 days of testing and scripting what we hadn't been able to do in > > almost a month of research and testing. > Do you experience problems with the snapshots? > Last time I tried something similiar for backups the bachine > began to spit errors after a few days of snapshots. > > http://lists.freebsd.org/pipermail/freebsd-fs/2008-February/004413.html We have 72 daily snapshots so far. Have had up to 30 of them mounted read-only while looking for the right version of a file to restore. These are ZFS snapshots, very different from UFS snapshots. -- Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 15:18:07 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4AE991065686 for ; Thu, 30 Oct 2008 15:18:07 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from gv-out-0910.google.com (gv-out-0910.google.com [216.239.58.186]) by mx1.freebsd.org (Postfix) with ESMTP id C063B8FC14 for ; Thu, 30 Oct 2008 15:18:06 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: by gv-out-0910.google.com with SMTP id n8so136813gve.39 for ; Thu, 30 Oct 2008 08:18:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-pgp-agent:x-mailer; bh=4cGxjupXdSgrH/oIJlSDwbhJvrYjjm9YJTJD3WeTakg=; b=qomhAzcvjLYIjHmUYkZxAt6blS8rFzQR6XS9lO9QYGa6FVg/RnPi5UQi2OnoZXTek4 /7lFC3R1vZageMwNMxa3F9MBN0W1ZotOhLkYeAOt9MctyYbu3dsdhcttk0crwoA3GHx1 0yRZhf/S8vIgl9b2jGbMlukgfbLHOZv+i3WdU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-pgp-agent:x-mailer; b=LE6a1as1s/THMSDjJtUQCzYJpuwEAxSnAP1G1ViL0Qx+m/sl4B/6b25Jtjkenh+brF qvIenWcKVqB0r+9hfqSXMXOuQw9TRtNvamzaF1oCUinQBUXRLDKMImpfDjbFkhAroCax wstxIGTZrCqmTW7bBapbFLLC84GpBUJMOk5gY= Received: by 10.103.11.5 with SMTP id o5mr4925133mui.74.1225379884999; Thu, 30 Oct 2008 08:18:04 -0700 (PDT) Received: from ndenev.cmotd.com (blah.sun-fish.com [217.18.249.150]) by mx.google.com with ESMTPS id w5sm5877386mue.10.2008.10.30.08.18.02 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 30 Oct 2008 08:18:03 -0700 (PDT) Message-Id: <444B4891-057B-4E09-99A1-A50A1187109E@gmail.com> From: Nikolay Denev To: Freddie Cash In-Reply-To: <200810300804.31186.fjwcash@gmail.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 30 Oct 2008 17:18:00 +0200 References: <20081029231926.GA35188@0lsen.net> <95550BEC-DB92-4C68-8409-3DFF7C0B86C0@gmail.com> <200810300804.31186.fjwcash@gmail.com> X-Pgp-Agent: GPGMail d53 (v53, Leopard) X-Mailer: Apple Mail (2.929.2) Cc: freebsd-stable@freebsd.org Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 15:18:07 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 30 Oct, 2008, at 17:04 , Freddie Cash wrote: > On October 30, 2008 01:25 am Nikolay Denev wrote: >> On 30 Oct, 2008, at 07:00 , Freddie Cash wrote: >>> On Thu, Oct 30, 2008 at 1:50 AM, Andrew Snow >>> >>> wrote: >>>> In this way, each day we generate a batch file that lets us step >>>> back one >>>> day. The diffs themselves, compressed with gzip, and extremely >>>> space efficient. We can step back potentially hundreds of days, >>>> though it seems >>>> to throw errors sometimes when backing up Windows boxes, which I >>>> haven't >>>> tracked down yet. >>>> >>>> But to be honest, soon you can save yourself a lot of hassle by >>>> simply using >>>> ZFS and taking snapshots. It'll be faster, and with compression >>>> very space >>>> efficient. >>> >>> That's exactly what we do, use ZFS and RSync. We have a ZFS >>> /storage/backup filesystem, with directories for each remote site, >>> and sub-directories for each server to be backed up. >>> >>> Each night we snapshot the directory, then run rsync to backup each >>> server. Snapshots are named with the current date. For 80 FreeBSD >>> and Linux servers, we average 10 GB of changed data a night. >>> >>> No muss, no fuss. We've used it to restore entire servers (boot off >>> Knoppix/Frenzy CD, format partitions, rsync back), individual files >>> (no mounting required, just cd into the .zfs/snapshot/snapshotname >>> directory and scp the file), and even once to restore the >>> permissions >>> on a pair of servers where a clueless admin "chmod -R user /home" >>> and >>> "chmod -R 777 /home". >>> >>> Our backup script is pretty much just a double-for loop that scans a >>> set of site-name directories for server config files, and runs rsync >>> in parallel (1 per remote site). >>> >>> We we looking into using variations on rsnapshot, custom >>> squashfs/hardlink stuff, and other solutions, but once we started >>> using ZFS, we stopped looking down those roads. We were able to do >>> in 3 days of testing and scripting what we hadn't been able to do in >>> almost a month of research and testing. > >> Do you experience problems with the snapshots? >> Last time I tried something similiar for backups the bachine >> began to spit errors after a few days of snapshots. >> >> http://lists.freebsd.org/pipermail/freebsd-fs/2008-February/004413.html > > We have 72 daily snapshots so far. Have had up to 30 of them mounted > read-only while looking for the right version of a file to restore. > > These are ZFS snapshots, very different from UFS snapshots. > > -- > Freddie Cash > fjwcash@gmail.com Yes, Mine were zfs snapshots too, and I've never managed to create more than a few days worth of snapshots before the machine start to print "bad file descriptor" errors while trying to access the snapshot directory. But I guess (hope) this problem does not exist anymore when you are able to do 72 snapshots. - -- Regards, Nikolay Denev -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (Darwin) iEYEARECAAYFAkkJ0CgACgkQHNAJ/fLbfrn9pACfSVFPyiHDosaK6FdOdfgo8onL Ia4An1qUoSnOq/yjIGC5fMngT+PPkEKk =bWqT -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 15:59:12 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 353C4106567F for ; Thu, 30 Oct 2008 15:59:12 +0000 (UTC) (envelope-from lehmann@ans-netz.de) Received: from avocado.salatschuessel.net (avocado.salatschuessel.net [78.111.72.186]) by mx1.freebsd.org (Postfix) with SMTP id 7DD4B8FC0C for ; Thu, 30 Oct 2008 15:59:11 +0000 (UTC) (envelope-from lehmann@ans-netz.de) Received: (qmail 96373 invoked by uid 89); 30 Oct 2008 15:59:09 -0000 Received: from unknown (HELO kartoffel.salatschuessel.net) (78.111.72.187) by avocado.salatschuessel.net with SMTP; 30 Oct 2008 15:59:09 -0000 Date: Thu, 30 Oct 2008 16:59:28 +0100 From: Oliver Lehmann To: Philip Murray Message-Id: <20081030165928.f87e7f74.lehmann@ans-netz.de> In-Reply-To: <13394481-8FDC-4934-BB12-FA5BCB2D35CD@nevada.net.nz> References: <20081029170728.be7cc7ab.lehmann@ans-netz.de> <13394481-8FDC-4934-BB12-FA5BCB2D35CD@nevada.net.nz> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; amd64-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: 3Ware 9000 series hangs under load X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 15:59:12 -0000 Hi Philip, Philip Murray wrote: > Might not be your problem, but it's worth a shot if all else fails. I've tried this, and the system still hangs up :( I'll move on with SMP/single CPU tests.... -- Oliver Lehmann http://www.pofo.de/ http://wishlist.ans-netz.de/ From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 16:04:15 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 385451065670 for ; Thu, 30 Oct 2008 16:04:15 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.freebsd.org (Postfix) with ESMTP id 0DB508FC1C for ; Thu, 30 Oct 2008 16:04:14 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id 6F3E51A000B34 for ; Thu, 30 Oct 2008 09:04:14 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at smtp.sd73.bc.ca Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 2IKHYLfGGEmi for ; Thu, 30 Oct 2008 09:04:08 -0700 (PDT) Received: from coal (s10.sbo [192.168.0.10]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 176641A000B18 for ; Thu, 30 Oct 2008 09:04:08 -0700 (PDT) From: Freddie Cash To: freebsd-stable@freebsd.org Date: Thu, 30 Oct 2008 09:04:07 -0700 User-Agent: KMail/1.9.9 References: <20081029231926.GA35188@0lsen.net> <200810300804.31186.fjwcash@gmail.com> <444B4891-057B-4E09-99A1-A50A1187109E@gmail.com> In-Reply-To: <444B4891-057B-4E09-99A1-A50A1187109E@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810300904.07958.fjwcash@gmail.com> Subject: Re: Anyone used rsync scriptology for incremental backup? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 16:04:15 -0000 On October 30, 2008 08:18 am Nikolay Denev wrote: > On 30 Oct, 2008, at 17:04 , Freddie Cash wrote: > > On October 30, 2008 01:25 am Nikolay Denev wrote: > >> On 30 Oct, 2008, at 07:00 , Freddie Cash wrote: > >>> On Thu, Oct 30, 2008 at 1:50 AM, Andrew Snow > >>> > >>> wrote: > >>>> In this way, each day we generate a batch file that lets us step > >>>> back one > >>>> day. The diffs themselves, compressed with gzip, and extremely > >>>> space efficient. We can step back potentially hundreds of days, > >>>> though it seems > >>>> to throw errors sometimes when backing up Windows boxes, which I > >>>> haven't > >>>> tracked down yet. > >>>> > >>>> But to be honest, soon you can save yourself a lot of hassle by > >>>> simply using > >>>> ZFS and taking snapshots. It'll be faster, and with compression > >>>> very space > >>>> efficient. > >>> > >>> That's exactly what we do, use ZFS and RSync. We have a ZFS > >>> /storage/backup filesystem, with directories for each remote site, > >>> and sub-directories for each server to be backed up. > >>> > >>> Each night we snapshot the directory, then run rsync to backup each > >>> server. Snapshots are named with the current date. For 80 FreeBSD > >>> and Linux servers, we average 10 GB of changed data a night. > >>> > >>> No muss, no fuss. We've used it to restore entire servers (boot > >>> off Knoppix/Frenzy CD, format partitions, rsync back), individual > >>> files (no mounting required, just cd into the > >>> .zfs/snapshot/snapshotname directory and scp the file), and even > >>> once to restore the > >>> permissions > >>> on a pair of servers where a clueless admin "chmod -R user /home" > >>> and > >>> "chmod -R 777 /home". > >>> > >>> Our backup script is pretty much just a double-for loop that scans > >>> a set of site-name directories for server config files, and runs > >>> rsync in parallel (1 per remote site). > >>> > >>> We we looking into using variations on rsnapshot, custom > >>> squashfs/hardlink stuff, and other solutions, but once we started > >>> using ZFS, we stopped looking down those roads. We were able to do > >>> in 3 days of testing and scripting what we hadn't been able to do > >>> in almost a month of research and testing. > >> > >> Do you experience problems with the snapshots? > >> Last time I tried something similiar for backups the bachine > >> began to spit errors after a few days of snapshots. > >> > >> http://lists.freebsd.org/pipermail/freebsd-fs/2008-February/004413.h > >>tml > > > > We have 72 daily snapshots so far. Have had up to 30 of them mounted > > read-only while looking for the right version of a file to restore. > > > > These are ZFS snapshots, very different from UFS snapshots. > > > > -- > > Freddie Cash > > fjwcash@gmail.com > > Yes, > > Mine were zfs snapshots too, and I've never managed to create more > than a > few days worth of snapshots before the machine start to print "bad > file descriptor" errors > while trying to access the snapshot directory. > But I guess (hope) this problem does not exist anymore when you are > able to do 72 snapshots. Well, hopefully we're not just lucky. :) We're running 64-bit FreeBSD 7-STABLE from August (after the first round of ZFS patches hit the -STABLE tree). Took about 3 weeks-ish to get the kernel and ARC tuning set right. Since then, it's been smooth sailing. For posterity sake: uname -a: FreeBSD megadrive.sd73.bc.ca 7.0-STABLE FreeBSD 7.0-STABLE #0: Tue Aug 19 10:39:29 PDT 2008 root@megadrive.sd73.bc.ca:/usr/obj/usr/src/sys/ZFSHOST amd64 /boot/loader.conf: zfs_load="YES" hw.ata.ata_dma=0 kern.hz="100" vfs.zfs.arc_min="512M" vfs.zfs.arc_max="768M" vfs.zfs.prefetch_disable="1" vfs.zfs.zil_disable="0" vm.kmem_size="1596M" vm.kmem_size_max="1596M" The ata_dma=0 is needed as / is a gmirror of two 2 GB CompactFlash cards attached to IDE adapters, and they don't support DMA. And the zpool is a raidz2 of 12x400 GB SATA drives connected to a 3Ware 9550SXU-16ML, and 12x500 GB SATA drives connected to a 3Ware 9650SE-12ML, all configured as SingleDisk arrays (so 24 daXX devices). There's just over 9 TB of usable space in the zpool. zfs list -t filesystem: NAME USED AVAIL REFER MOUNTPOINT storage 3.32T 4.43T 117K /storage storage/Backup186 697M 4.43T 697M /storage/Backup186 storage/backup 3.25T 4.43T 2.21T /storage/backup storage/home 19.9G 4.43T 19.9G /home storage/tmp 27.2M 4.43T 27.2M /tmp storage/usr 2.71G 4.45T 223M /usr storage/usr/local 128M 4.45T 128M /usr/local storage/usr/obj 1.63G 4.45T 1.63G /usr/obj storage/usr/ports 540M 4.45T 449M /usr/ports storage/usr/ports/distfiles 91.2M 4.45T 91.2M /usr/ports/distfiles storage/usr/src 210M 4.45T 210M /usr/src storage/var 1.75G 4.45T 1.75G /var zfs list -t snapshot | wc -l 74 -- Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 16:14:20 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7BEC91065672; Thu, 30 Oct 2008 16:14:20 +0000 (UTC) (envelope-from aragon@phat.za.net) Received: from mail.geek.sh (decoder.geek.sh [196.36.198.81]) by mx1.freebsd.org (Postfix) with ESMTP id 1AD7D8FC2A; Thu, 30 Oct 2008 16:14:20 +0000 (UTC) (envelope-from aragon@phat.za.net) Received: by mail.geek.sh (Postfix, from userid 1000) id 642A224D22; Thu, 30 Oct 2008 17:45:12 +0200 (SAST) Date: Thu, 30 Oct 2008 17:45:12 +0200 From: Aragon Gouveia To: Eduardo Meyer Message-ID: <20081030154512.GB80375@phat.za.net> Mail-Followup-To: Eduardo Meyer , stable@freebsd.org, questions@freebsd.org References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 4.10-RELEASE-p2 i386 Cc: stable@freebsd.org, questions@freebsd.org Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 16:14:20 -0000 | By Eduardo Meyer | [ 2008-10-30 00:04 +0200 ] > Hello, > > I need to write a cgi script which will print the output from ps(1) in > a table (html), so the average-operator can click on a KILL link and > the cgi will send the selected signal. > > I need to add one ps information per column in a table (html), > however, I found ps(1) output to be too hard to parse. There is no > separator. I believed \t was the separator but its not. Another option might be to mount /proc and use that instead. See procfs(5). Regards, Aragon From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 16:21:14 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 66AD31065678 for ; Thu, 30 Oct 2008 16:21:14 +0000 (UTC) (envelope-from lehmann@ans-netz.de) Received: from avocado.salatschuessel.net (avocado.salatschuessel.net [78.111.72.186]) by mx1.freebsd.org (Postfix) with SMTP id AFAA78FC1A for ; Thu, 30 Oct 2008 16:21:13 +0000 (UTC) (envelope-from lehmann@ans-netz.de) Received: (qmail 97195 invoked by uid 89); 30 Oct 2008 16:21:11 -0000 Received: from unknown (HELO kartoffel.salatschuessel.net) (78.111.72.187) by avocado.salatschuessel.net with SMTP; 30 Oct 2008 16:21:11 -0000 Date: Thu, 30 Oct 2008 17:21:30 +0100 From: Oliver Lehmann To: Scott Long Message-Id: <20081030172130.c163755e.lehmann@ans-netz.de> In-Reply-To: <4909DA89.9060804@samsco.org> References: <20081029170728.be7cc7ab.lehmann@ans-netz.de> <4909DA89.9060804@samsco.org> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; amd64-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org, smp@freebsd.org Subject: Re: 3Ware 9000 series hangs under load X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 16:21:14 -0000 Scott Long wrote: > or put a spare ATA > drive in the chassis and set it up as a dump partition, then get a > crashdump of the system when it gets into this state. The system is not panicing itself so I've tried debugging some time ago with KDB by panicing it by hand after it got stuck again. Here is what I did back then (but I guess this isn't telling much) http://lists.freebsd.org/pipermail/freebsd-stable/2008-October/045578.html -- Oliver Lehmann http://www.pofo.de/ http://wishlist.ans-netz.de/ From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 16:34:19 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DCE39106564A; Thu, 30 Oct 2008 16:34:18 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id 5B9AE8FC1A; Thu, 30 Oct 2008 16:34:18 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.local ([192.168.254.200]) (authenticated bits=0) by pooker.samsco.org (8.14.2/8.14.2) with ESMTP id m9UG2H5E082696; Thu, 30 Oct 2008 10:02:17 -0600 (MDT) (envelope-from scottl@samsco.org) Message-ID: <4909DA89.9060804@samsco.org> Date: Thu, 30 Oct 2008 10:02:17 -0600 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.13) Gecko/20080313 SeaMonkey/1.1.9 MIME-Version: 1.0 To: Oliver Lehmann References: <20081029170728.be7cc7ab.lehmann@ans-netz.de> In-Reply-To: <20081029170728.be7cc7ab.lehmann@ans-netz.de> X-Enigmail-Version: 0.95.6 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-4.4 required=3.8 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on pooker.samsco.org Cc: stable@freebsd.org, smp@freebsd.org Subject: Re: 3Ware 9000 series hangs under load X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 16:34:19 -0000 Oliver Lehmann wrote: > Hi, > > I've problems with my 3ware controller. Havingg heavy I/O load (e.g. > running 40 port builds the day over with tinderbox which involves > un-taring a whole FreeBSD tree 40 times), my system hangs with the well > known > > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2, size: 4096 > swap_pager: indefinite wait buffer: bufobj: 0, blkno: 2, size: 4096 > > error. I'v opened a ticket at 3ware and after half a month of > dummy-testings (are your drives fine, can you run a stress test), it > looks like i was redirected to someone from the 2nd lvl support and he > told me: > > There are 2 things that you can try, > 1, disable apic in your bootloader.conf file, or RMA the controller. > > The error that you have is generally caused by an interrupt problem, > defective backplane, bad drive or bad controller. > > and after I told him that I intend to use the 2 CPUs I have and not > falling back to one CPU for ever he responded: > > Yes I do understand about disabling APIC, but the feature is sometimes > not stable in all dual proc systems. There are many variables, the > CPU's have to be matched down to the Lot #, the motherboard must have a > good design and the kernel supporting APIC must be stable. But, it is a > good test to see if it is software or hardware. > > So what I did now, was compiling a kernel w/o apic/smp and I'm running > this configuration now for 3 days stressing the system w/o running into > the swap_pager problem. Can it be still a controller problem or is it > more likley a problem of FreeBSDs smp/apic implementation or the board > I'm using (Intel L440GX). > > I'm asking because I'm not sure which problem it is now and before > telling it 3ware and having them responding "ok it is a FreeBSD problem" > or "ok it is a board problem" I'd like to know what can be the case here. > > (please keep me CCed, I'm not subscribed to smp@) > > Further information (and the history) on this topic can be found here > (and following): > > http://lists.freebsd.org/pipermail/freebsd-stable/2008-September/045500.html > > The probability that it's a problem in the generic interrupt/APIC code in FreeBSD is low. That code has matured quite well over the last 5 years, and it is very solid for just about every other hardware configuration out there. I'd suspect the following things in the following order: 1. Driver bug. Driver might be loosing an interrupt, or might be deadlocking due to coding/design problems. 2. Defective controller 3. Buggy firmware on the controller. FreeBSD does tend to push I/O controllers a lot harder than other OS's, resulting in strange bugs sometimes being found. 4. Defective motherboard. The fact that it's running fine with SMP/APIC disabled could easily mean that it's not taking as high of a load, and is thus avoiding problems. It could also mean that latent bugs in the driver are not being exposed. I don't have a lot of time to spend debugging this, but I'd suggest that you either take up AMCC's offer to RMA the board, or put a spare ATA drive in the chassis and set it up as a dump partition, then get a crashdump of the system when it gets into this state. Scott From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 16:46:15 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EF2421065670; Thu, 30 Oct 2008 16:46:15 +0000 (UTC) (envelope-from mh@kernel32.de) Received: from crivens.kernel32.de (crivens.asm68k.org [81.169.171.191]) by mx1.freebsd.org (Postfix) with ESMTP id AFEAB8FC12; Thu, 30 Oct 2008 16:46:15 +0000 (UTC) (envelope-from mh@kernel32.de) Received: from www.terrorteam.de (localhost [127.0.0.1]) by crivens.kernel32.de (Postfix) with ESMTP id 562BDB02E0; Thu, 30 Oct 2008 17:28:46 +0100 (CET) MIME-Version: 1.0 Date: Thu, 30 Oct 2008 17:28:46 +0100 From: Marian Hettwer To: Aragon Gouveia In-Reply-To: <20081030154512.GB80375@phat.za.net> References: <20081030154512.GB80375@phat.za.net> Message-ID: <7b873e39ac6eb91f7d2d3a1088207498@localhost> X-Sender: mh@kernel32.de User-Agent: RoundCube Webmail/0.1-rc2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit Cc: stable@freebsd.org, Eduardo Meyer , questions@freebsd.org Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 16:46:16 -0000 Hi, On Thu, 30 Oct 2008 17:45:12 +0200, Aragon Gouveia wrote: > | By Eduardo Meyer > | [ 2008-10-30 00:04 +0200 ] >> Hello, >> >> I need to write a cgi script which will print the output from ps(1) in >> a table (html), so the average-operator can click on a KILL link and >> the cgi will send the selected signal. >> >> I need to add one ps information per column in a table (html), >> however, I found ps(1) output to be too hard to parse. There is no >> separator. I believed \t was the separator but its not. > > Another option might be to mount /proc and use that instead. See > procfs(5). > I wouldn't do that. IIRC procfs(5) is deprecated in FreeBSD. But I could be wrong... regards, Marian From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 19:02:09 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 57F93106564A; Thu, 30 Oct 2008 19:02:09 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from sarah.protected-networks.net (sarah.protected-networks.net [IPv6:2001:470:1f07:4e1::1]) by mx1.freebsd.org (Postfix) with ESMTP id 066A08FC1B; Thu, 30 Oct 2008 19:02:09 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from [127.0.0.1] (localhost [IPv6:::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) (Authenticated sender: imb) by sarah.protected-networks.net (Postfix) with ESMTPSA id E5FF86187; Thu, 30 Oct 2008 15:02:06 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=protected-networks.net; s=200705; t=1225393327; bh=+360mITcs/HdRd osi/IRtXd9F1kkWpnVzh9Yt8Djs7Q=; h=Message-ID:Date:From:MIME-Version: To:CC:Subject:References:In-Reply-To:Content-Type: Content-Transfer-Encoding; b=CgKAJCLhxQvW6qGCBCG6STJdZJThHxj/RrNfB XXIwlW2rPVfsje8ADRvKK+rZ7JXRhvGg60h/zFPbfGqsWatds1sXi+dvJOWHr6mNAEh 3JbydT48Oa8uiGSCWSjcs2HZ DomainKey-Signature: a=rsa-sha1; s=200509; d=protected-networks.net; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:cc:subject: references:in-reply-to:content-type:content-transfer-encoding; b=mfvl2NhPlycbJaD9ANCoTnzC0W6H3cMQIZwBzOQx5G32SAhwCxhtKqJcsGa8slmgv Gdv+7wnjoweXep3TwSRTvjVQHc9y30ctUP0KIMwiP7FRO48WxLpuo2Uj1IV2JqZ Message-ID: <490A048E.8000907@protected-networks.net> Date: Thu, 30 Oct 2008 15:01:34 -0400 From: Michael Butler User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: freebsd-jail@freebsd.org References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <490754D5.8050202@protected-networks.net> <20081028181744.Q2978@maildrop.int.zabbadoz.net> In-Reply-To: <20081028181744.Q2978@maildrop.int.zabbadoz.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 19:02:09 -0000 >>> Hi, there's a patch by Bjoern A.Zeeb, available at >>> http://people.freebsd.org/~bz/bz_jail7-20080920-01-at150161.diff >>> >>> which succeeds and works well with 7.1-PRERELEASE currently. >>> I had similar issues to solve and patched several hosts >>> with it, so far with success. Sadly, SVN rev 184481 (of today) breaks these patches :-( Is there an updated patch-set available or planned? Michael From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 19:21:17 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4CE9B106567F; Thu, 30 Oct 2008 19:21:17 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id BC6178FC1E; Thu, 30 Oct 2008 19:21:16 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9UJLEOx098456; Thu, 30 Oct 2008 20:21:15 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9UJLEZC098455; Thu, 30 Oct 2008 20:21:14 +0100 (CET) (envelope-from olli) Date: Thu, 30 Oct 2008 20:21:14 +0100 (CET) Message-Id: <200810301921.m9UJLEZC098455@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG, freebsd-net@FreeBSD.ORG X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Thu, 30 Oct 2008 20:21:15 +0100 (CET) Cc: Subject: LevelOne WPC-0301 11g Wireless CardBus X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 19:21:17 -0000 Hello, I bought a LevelOne WPC-0301 11g Wireless CardBus Adapter today. According to the box it is "v6". The ral(4) man- page mentions only v2, but that one is ancient and can't be bought anymore. So, enabling the debug sysctl gives this in dmesg: cardbus0: Expecting link target, got 0x0 cardbus0: at device 0.0 (no driver attached) cardbus0: CIS pointer is 0x102 cardbus0: CIS in BAR 0x14 cardbus0: Expecting link target, got 0x0 cardbus0: Warning: Bogus CIS ignored cardbus0: at device 0.0 (no driver attached) I tried the card in a different notebook, same thing. Anything I can do, except drop the new card in the dustbin? :-( Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd We're sysadmins. To us, data is a protocol-overhead. From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 19:26:01 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 97E5D1065697 for ; Thu, 30 Oct 2008 19:26:01 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from sarah.protected-networks.net (sarah.protected-networks.net [IPv6:2001:470:1f07:4e1::1]) by mx1.freebsd.org (Postfix) with ESMTP id 5ED0F8FC18 for ; Thu, 30 Oct 2008 19:26:01 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from [127.0.0.1] (localhost [IPv6:::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) (Authenticated sender: imb) by sarah.protected-networks.net (Postfix) with ESMTPSA id 2F8AF6187 for ; Thu, 30 Oct 2008 15:26:00 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=protected-networks.net; s=200705; t=1225394760; bh=Fy9znbrybTKunN DDDk9HdQQRLUPPfci8tTfLN6c0dSY=; h=Message-ID:Date:From:MIME-Version: To:Subject:Content-Type:Content-Transfer-Encoding; b=aYQ5xof/mWHBH Ql69ynDKyTbVlmArLUA2GeLWtKT0GLo+0oUF/p9dDW16ts9JP/MwMILdqXc3E43TA+O sPiQJZ8ii6ZEOrHTtzqzAczhEzEiM3elD+9SZVdHiAIoK0zl DomainKey-Signature: a=rsa-sha1; s=200509; d=protected-networks.net; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:subject: content-type:content-transfer-encoding; b=GEqQAleFPzBccvG3aP/KXARRzPYTKM1TQUt1Abb3wOvv9jj0dMVRT6OL/G1pEe7oU 6SGzE8iUO+Gz4Xm3sF3dRT5R3tAd7WO/K3Mrif2bxy2fdodWp0iu0W7tom5sfyu Message-ID: <490A0A35.8040109@protected-networks.net> Date: Thu, 30 Oct 2008 15:25:41 -0400 From: Michael Butler User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: FreeBSD stable Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Subject: ICH7M limited to SATA-150? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 19:26:01 -0000 Recently, I upgraded the disk in my Toshiba A105 with a 7200rpm SATA-II device but it seems to still talking at SATA-I speed :-( atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x18b0-0x18bf at device 31.2 on pci0 [ .. snip .. ] ad0: 305245MB at ata0-master SATA150 acd0: DVDR at ata1-master UDMA33 There don't appear to be any obvious 'compatibility jumpers' on the drive, so I'm wondering what gives? Is it possible this is hard-coded into the BIOS? Michael From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 20:01:31 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 90DA1106567B for ; Thu, 30 Oct 2008 20:01:31 +0000 (UTC) (envelope-from sebosik@demax.sk) Received: from mail.demax.sk (mail.demax.sk [213.215.102.234]) by mx1.freebsd.org (Postfix) with ESMTP id 4C6538FC08 for ; Thu, 30 Oct 2008 20:01:31 +0000 (UTC) (envelope-from sebosik@demax.sk) Received: from mail.demax.sk (localhost [127.0.0.1]) by nod32.demax.sk (Postfix) with ESMTP id 43EED42AC9; Thu, 30 Oct 2008 20:40:55 +0100 (CET) X-Virus-Scanner: This message was checked by NOD32 Antivirus system NOD32 for Linux Mail Server. For more information on NOD32 Antivirus System, please, visit our website: http://www.nod32.com/. Received: from [192.168.0.2] (2D204.demax.sk [195.62.17.204]) by mail.demax.sk (Postfix) with ESMTP id 032D442AC8; Thu, 30 Oct 2008 20:40:54 +0100 (CET) Message-ID: <490A0DC6.5000609@demax.sk> Date: Thu, 30 Oct 2008 20:40:54 +0100 From: Jan Sebosik User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: Michael Butler References: <490A0A35.8040109@protected-networks.net> In-Reply-To: <490A0A35.8040109@protected-networks.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD stable Subject: Re: ICH7M limited to SATA-150? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 20:01:31 -0000 Michael Butler napsal(a): > Recently, I upgraded the disk in my Toshiba A105 with a 7200rpm SATA-II > device but it seems to still talking at SATA-I speed :-( > > atapci0: port > 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x18b0-0x18bf at device 31.2 on pci0 > > [ .. snip .. ] > > ad0: 305245MB at ata0-master SATA150 > acd0: DVDR at ata1-master UDMA33 > > There don't appear to be any obvious 'compatibility jumpers' on the > drive, so I'm wondering what gives? > > Is it possible this is hard-coded into the BIOS? > > Michael > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > Hi Michael you should read following thread: http://forum.notebookreview.com/showthread.php?t=304404 I think that SATA-300 isn`t required if you have classical HDD (not SSD). -- Jan Sebosik, Slovakia sebosik@demax.sk Volne pracovne miesto, kliknite na nasledujuci link, dozviete sa viac..... https://web.demax.sk/kategoria?pracovna-ponuka From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 20:02:09 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E957E106564A for ; Thu, 30 Oct 2008 20:02:09 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.29]) by mx1.freebsd.org (Postfix) with ESMTP id 9C26B8FC1B for ; Thu, 30 Oct 2008 20:02:09 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: by yw-out-2324.google.com with SMTP id 9so328484ywe.13 for ; Thu, 30 Oct 2008 13:02:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=ehcXYkrLpUajGr2BlkFWc7OFDOVetWl+Lx1ssZpx8hI=; b=gOBnyikmPOP/2zHzy+0ck8VIIccgOKMi0RxaxcS63/ndHklopRZ3oiCQ2F3JHSDIVG TNGuwMvUElYd3Y2/O3gjugHMwZRlqDk2rUWwWVrhXf07I7JL8XzpuhP1qE/KKKE+MXox sJ2f77fV/gKX5aLz7rgWBDPys8BcLd4iQ1Ffo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=LZHjSbP9hbBTnI+KYiEV2B3plJKoxUkfN9Lb/pstdNrr+lngNiwLVavr6pw9Bt3ETf gB8Z0oQgnt9fhITA00r8w3DpSlHBeNvhtNiqNMxnptjfcUBj8pDkSzaD7Z0Zpq3r+P98 sq25Bf2O3U+auiu9YZnt+KeXLdOizZND6kta0= Received: by 10.142.139.14 with SMTP id m14mr4894745wfd.291.1225396928311; Thu, 30 Oct 2008 13:02:08 -0700 (PDT) Received: by 10.142.158.11 with HTTP; Thu, 30 Oct 2008 13:02:08 -0700 (PDT) Message-ID: Date: Thu, 30 Oct 2008 18:02:08 -0200 From: "Eduardo Meyer" To: freebsd-stable@freebsd.org, dudu.meyer@gmail.com In-Reply-To: <200810301418.m9UEIvSj086321@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <200810301418.m9UEIvSj086321@lurza.secnetix.de> Cc: Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 20:02:10 -0000 On Thu, Oct 30, 2008 at 12:18 PM, Oliver Fromme wrote: > Eduardo Meyer wrote: > > I need to write a cgi script which will print the output from ps(1) in > > a table (html), so the average-operator can click on a KILL link and Thank you all. I didnt mention the language, yes, I wanted it with shell script. Sadly, no idea was completly enough, for the default ps output it simple has no pattern. No multiple-pattern would do the job safely. With kernel stuff like idle, output happens to be completly nonsense. Counting positions in a array is the way to go, but not with the default output. Things just happen to get completly trashed with long values, like idle CPU time. What I did was formating every output header like that ps -o start="<<<..............................................>>>" -o lstart="<<<..............................................>>>" -o args="<<<..............................................>>>" etc So I could find the begining and the ending column. "-o command" or "-o args" have always to be the last option, if I dont want 'em to get truncated. So sad. Now my next problem, do the sabe with sockstat.... %sockstat | head -4 USER COMMAND PID FD PROTO LOCAL ADDRESS FOREIGN ADDRESS freebsdsupportsshd 57255 3 tcp4 172.16.0.225:22 172.16.0.69:63583 freebsdsupportsshd 57255 4 stream -> ?? root sshd 57253 3 tcp4 172.16.0.225:22 172.16.0.69:63583 So I have the USER and COMMAND column "merged" in a single string, because username is large. Again, space can not be used as a separator, but hopefully only the patterns with "->" will have space if not a column separator, easier to parse. But sockstat have no formatting option to be issued like -o from ps(1). Measing in the very first sockstat output, I dont know what to do... :( -- =========== Eduardo Meyer pessoal: dudu.meyer@gmail.com profissional: ddm.farmaciap@saude.gov.br From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 20:03:52 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 05C8E106564A for ; Thu, 30 Oct 2008 20:03:52 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.28]) by mx1.freebsd.org (Postfix) with ESMTP id AC4AF8FC1F for ; Thu, 30 Oct 2008 20:03:51 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: by yw-out-2324.google.com with SMTP id 9so329090ywe.13 for ; Thu, 30 Oct 2008 13:03:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=ehcXYkrLpUajGr2BlkFWc7OFDOVetWl+Lx1ssZpx8hI=; b=B4+5bS7n2RlhEmh8qJx+zKmxgdnRbMgrN5pBShoJDHXv+eL8p5N2DMXrnrqL2m2yG6 qqOiKA9dGk4Grx+tC0JK3VdANZ0aXsVnPuZHTMPq8IMA7+7LvT5Jp9fZE3MMhJVXt5L4 QTCurJOlF5MvTZb6f8q/+VD/n9C8Rm2Zhk2qI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=R8aw85X3Zvw6qodCMQo9/9Ag35DhKbaN++czd16KlTjRgbaY0zsFBwqL5uWX58NDrM TMHz46Lh5cAHKe7hIaZvuGu3dzYSv3s3Hp0peR4pOBLJY5ziU3UcqsNdrjI3O+wk2VYP kG/0QuhTcu64PVhfe4GtpzhQW6xaoU5O2TLFE= Received: by 10.64.183.6 with SMTP id g6mr11670558qbf.37.1225397029752; Thu, 30 Oct 2008 13:03:49 -0700 (PDT) Received: by 10.64.201.9 with HTTP; Thu, 30 Oct 2008 13:03:49 -0700 (PDT) Message-ID: Date: Thu, 30 Oct 2008 18:03:49 -0200 From: "Eduardo Meyer" To: freebsd-stable@freebsd.org, dudu.meyer@gmail.com In-Reply-To: <200810301418.m9UEIvSj086321@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <200810301418.m9UEIvSj086321@lurza.secnetix.de> Cc: Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 20:03:52 -0000 On Thu, Oct 30, 2008 at 12:18 PM, Oliver Fromme wrote: > Eduardo Meyer wrote: > > I need to write a cgi script which will print the output from ps(1) in > > a table (html), so the average-operator can click on a KILL link and Thank you all. I didnt mention the language, yes, I wanted it with shell script. Sadly, no idea was completly enough, for the default ps output it simple has no pattern. No multiple-pattern would do the job safely. With kernel stuff like idle, output happens to be completly nonsense. Counting positions in a array is the way to go, but not with the default output. Things just happen to get completly trashed with long values, like idle CPU time. What I did was formating every output header like that ps -o start="<<<..............................................>>>" -o lstart="<<<..............................................>>>" -o args="<<<..............................................>>>" etc So I could find the begining and the ending column. "-o command" or "-o args" have always to be the last option, if I dont want 'em to get truncated. So sad. Now my next problem, do the sabe with sockstat.... %sockstat | head -4 USER COMMAND PID FD PROTO LOCAL ADDRESS FOREIGN ADDRESS freebsdsupportsshd 57255 3 tcp4 172.16.0.225:22 172.16.0.69:63583 freebsdsupportsshd 57255 4 stream -> ?? root sshd 57253 3 tcp4 172.16.0.225:22 172.16.0.69:63583 So I have the USER and COMMAND column "merged" in a single string, because username is large. Again, space can not be used as a separator, but hopefully only the patterns with "->" will have space if not a column separator, easier to parse. But sockstat have no formatting option to be issued like -o from ps(1). Measing in the very first sockstat output, I dont know what to do... :( -- =========== Eduardo Meyer pessoal: dudu.meyer@gmail.com profissional: ddm.farmaciap@saude.gov.br From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 20:05:23 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2DAF71065675 for ; Thu, 30 Oct 2008 20:05:23 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [91.103.162.4]) by mx1.freebsd.org (Postfix) with ESMTP id E10628FC19 for ; Thu, 30 Oct 2008 20:05:22 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id BC8FF19E027; Thu, 30 Oct 2008 21:05:21 +0100 (CET) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 7F4C219E023; Thu, 30 Oct 2008 21:05:19 +0100 (CET) Message-ID: <490A13A3.806@quip.cz> Date: Thu, 30 Oct 2008 21:05:55 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: Michael Butler References: <490A0A35.8040109@protected-networks.net> In-Reply-To: <490A0A35.8040109@protected-networks.net> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD stable Subject: Re: ICH7M limited to SATA-150? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 20:05:23 -0000 Michael Butler wrote: > Recently, I upgraded the disk in my Toshiba A105 with a 7200rpm SATA-II > device but it seems to still talking at SATA-I speed :-( > > atapci0: port > 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x18b0-0x18bf at device 31.2 on pci0 > > [ .. snip .. ] > > ad0: 305245MB at ata0-master SATA150 > acd0: DVDR at ata1-master UDMA33 > > There don't appear to be any obvious 'compatibility jumpers' on the > drive, so I'm wondering what gives? > > Is it possible this is hard-coded into the BIOS? It is possible to switch it in HDD firmware, but it depends on HDD manufacturer. I don't know Fujitsu drives. Try to search the Fujitsu website for some HDD utility to change SATA / SATA II. Miroslav Lachman From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 20:48:02 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F2F521065675 for ; Thu, 30 Oct 2008 20:48:02 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.delphij.net (delphij-pt.tunnel.tserv2.fmt.ipv6.he.net [IPv6:2001:470:1f03:2c9::2]) by mx1.freebsd.org (Postfix) with ESMTP id 999D48FC17 for ; Thu, 30 Oct 2008 20:48:02 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.geekcn.org (tarsier.geekcn.org [211.166.10.233]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by tarsier.delphij.net (Postfix) with ESMTPS id 8EFDA28454 for ; Fri, 31 Oct 2008 04:48:01 +0800 (CST) Received: from localhost (tarsier.geekcn.org [211.166.10.233]) by tarsier.geekcn.org (Postfix) with ESMTP id 30F74EB9C3D; Fri, 31 Oct 2008 04:48:01 +0800 (CST) X-Virus-Scanned: amavisd-new at geekcn.org Received: from tarsier.geekcn.org ([211.166.10.233]) by localhost (mail.geekcn.org [211.166.10.233]) (amavisd-new, port 10024) with ESMTP id ldrxOWhiaLKc; Fri, 31 Oct 2008 04:47:56 +0800 (CST) Received: from charlie.delphij.net (adsl-76-237-33-62.dsl.pltn13.sbcglobal.net [76.237.33.62]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tarsier.geekcn.org (Postfix) with ESMTPSA id 016EDEB9C19; Fri, 31 Oct 2008 04:47:52 +0800 (CST) DomainKey-Signature: a=rsa-sha1; s=default; d=delphij.net; c=nofws; q=dns; h=message-id:date:from:reply-to:organization:user-agent: mime-version:to:cc:subject:references:in-reply-to: x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=nr2/eqHVyAcopX+KPgMzyLog4agEIc1oaVIijKgcQwWdXetMJGtBiKC+sF/1h17py ZJlE+JYXKxsLyI43x+fbg== Message-ID: <490A1D74.10008@delphij.net> Date: Thu, 30 Oct 2008 13:47:48 -0700 From: Xin LI Organization: The FreeBSD Project User-Agent: Thunderbird 2.0.0.17 (X11/20080928) MIME-Version: 1.0 To: Michael Butler References: <490A0A35.8040109@protected-networks.net> In-Reply-To: <490A0A35.8040109@protected-networks.net> X-Enigmail-Version: 0.95.7 OpenPGP: id=18EDEBA0; url=http://www.delphij.net/delphij.asc Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: FreeBSD stable Subject: Re: ICH7M limited to SATA-150? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: d@delphij.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 20:48:03 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Michael Butler wrote: > Recently, I upgraded the disk in my Toshiba A105 with a 7200rpm SATA-II > device but it seems to still talking at SATA-I speed :-( > > atapci0: port > 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x18b0-0x18bf at device 31.2 on pci0 > > [ .. snip .. ] > > ad0: 305245MB at ata0-master SATA150 > acd0: DVDR at ata1-master UDMA33 > > There don't appear to be any obvious 'compatibility jumpers' on the > drive, so I'm wondering what gives? > > Is it possible this is hard-coded into the BIOS? Personally I don't really think ICH7M is capable to do SATA-300. Intel datasheet 307013, page 191 says: Supported Supported 3 Gb/s Transfer Rate (Desktop Only) (Desktop Only) My understanding is that ICH7- *M* does not support SATA-300 at all. Cheers, - -- Xin LI http://www.delphij.net/ FreeBSD - The Power to Serve! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkkKHXMACgkQi+vbBBjt66DVTwCggPQ47SCFTdOGM7cwbvRYTdUF DloAnij/DRaJl8BPAi+sb/Q886Ub4G9j =kxTZ -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 21:07:51 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 08E29106564A for ; Thu, 30 Oct 2008 21:07:51 +0000 (UTC) (envelope-from me@janh.de) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.186]) by mx1.freebsd.org (Postfix) with ESMTP id 923A28FC1F for ; Thu, 30 Oct 2008 21:07:50 +0000 (UTC) (envelope-from me@janh.de) Received: from janh.freebsd (f054105056.adsl.alicedsl.de [78.54.105.56]) by mrelayeu.kundenserver.de (node=mrelayeu3) with ESMTP (Nemesis) id 0MKxQS-1KveXX2tx2-0007tw; Thu, 30 Oct 2008 21:54:47 +0100 Message-ID: <490A1F15.5060008@janh.de> Date: Thu, 30 Oct 2008 21:54:45 +0100 From: Jan Henrik Sylvester User-Agent: Thunderbird 2.0.0.17 (X11/20080927) MIME-Version: 1.0 To: Oliver Fromme Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Provags-ID: V01U2FsdGVkX1+D1ci7ZpKuN9YhwqxLf/c/l72v6g63hNPGhNn AIzCgyD68tCtCEn313CxPHhxGFwan8oOA6ZGnd6/hbDsYK2dDv 4y6YPGZcQGxgipQszI0fA== Cc: stable-list freebsd Subject: Re: LevelOne WPC-0301 11g Wireless CardBus X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 21:07:51 -0000 Oliver wrote: > I bought a LevelOne WPC-0301 11g Wireless CardBus Adapter > today. According to the box it is "v6". The ral(4) man- > page mentions only v2, but that one is ancient and can't > be bought anymore. I do not know about the WPC-0301, but I since I bought a wrong WNC-0301 (PCI version), I did some research looking at the IDs and additionally Windows drivers: v.1 is Marvel, v.2 is the old Ralink, v.3 is the never Ralink, and v.5 (and v.6?) is RealTek. (v.4 does not have a Windows driver at the LevelOne homepage.) BTW: I did summit this info to http://linux-wless.passys.nl/ -- it is a pretty good overview, especially if you want to check which vendors switch chipset manufacturers from one revision to the next. My guess would be that you are out of luck, if it is not detected at 7-STABLE. Look at the sys files in the Windows driver, if there is one. Of course, you can try ndis, but I would not go for it. If you shop for a card, most of the 108Mbps are Atheros, which works better than Ralink in my experience. Since you are from Germany, too: geizhals.at lists TP-Link TL-WN610G for less than 15 Euros, which has an Atheros chipset according to the site I mentioned above. If you are looking on Ebay, I can really recommend Philips SNN6500, which does a/b/g and the proprietary Atheros stuff (TURBOP, BURST). Cheers, Jan Henrik From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 21:14:11 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 150F7106564A for ; Thu, 30 Oct 2008 21:14:11 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 80CE28FC21 for ; Thu, 30 Oct 2008 21:14:10 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9ULE8n6002690; Thu, 30 Oct 2008 22:14:08 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9ULE8jV002689; Thu, 30 Oct 2008 22:14:08 +0100 (CET) (envelope-from olli) Date: Thu, 30 Oct 2008 22:14:08 +0100 (CET) Message-Id: <200810302114.m9ULE8jV002689@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG, dudu.meyer@gmail.com In-Reply-To: X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Thu, 30 Oct 2008 22:14:09 +0100 (CET) Cc: Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-stable@FreeBSD.ORG, dudu.meyer@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 21:14:11 -0000 Eduardo Meyer wrote: > Oliver Fromme wrote: > > Eduardo Meyer wrote: > > > I need to write a cgi script which will print the output from ps(1) in > > > a table (html), so the average-operator can click on a KILL link and > > Thank you all. I didnt mention the language, yes, I wanted it with > shell script. Sadly, no idea was completly enough, for the default ps > output it simple has no pattern. No multiple-pattern would do the job > safely. Did you actually read my suggestion? I explained that you cannot cut by pattern, but that you need to cut on field widths according to the header line. Here's a solution that implements that, using awk to do the parsing: #!/bin/sh - ps -axww -o pid -o user -o emul -o lstart -o lockname -o stat -o command | awk '{ if (NR == 1) { # Parse header line. # Build arrays fstart[] and fwidth[]. numfields = split(" " $0, field, / [^ ]/) - 1 fwidth[1] = length(field[1] field[2]) + 2 fstart[1] = 1 for (i = 2; i <= numfields; i++) { fwidth[i] = length(field[i + 1]) + 2 fstart[i] = fstart[i - 1] + fwidth[i - 1] } fwidth[numfields] = 100 } else { # Parse data line. print "" for (i = 1; i <= numfields; i++) { content = substr($0, fstart[i], fwidth[i]) print " " content "" } print "" } }' Of course that's just an example. You still have to produce "" and other surrounding HTML, of course. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "File names are infinite in length, where infinity is set to 255 characters." -- Peter Collinson, "The Unix File System" From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 21:40:43 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3CB021065673 for ; Thu, 30 Oct 2008 21:40:43 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: from yx-out-2324.google.com (yx-out-2324.google.com [74.125.44.29]) by mx1.freebsd.org (Postfix) with ESMTP id E4D4C8FC0C for ; Thu, 30 Oct 2008 21:40:42 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: by yx-out-2324.google.com with SMTP id 8so358418yxb.13 for ; Thu, 30 Oct 2008 14:40:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=aujhKY4CnbBSM7aeWGHLp2G2gzOGwVu82uHdkf+Xq/g=; b=VnZP1AGeIOZQZtRUGG7KacoYAotJ0S1F0zbRjZDPOdNT96nuimqqwniYIV3MeTwLhL +cyRvTXxgotJEL+/tfcQ/fNbzNPeYGCFFjXRsVycti+XWTssll34RCHoaWpRXqFzY0ua mu8xd9GJ4NlZJpV7wCd95gvzFFKMbYgNjd+aA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=Hwmhj6RQacyzLEIe0N21Fye4zDUiHFRzoH77qM8JY+BwjONzD2uREbYuEX6O7NozPu 34sv1mf/yTtumrG6yUkOZ7f+3xK+2v+4jSWfktvaIk6ZA69twB3D0/b8ggAEMsYym24a QOEokiHuKvuDcN70rqbo67cgsiWRZeJJTduyQ= Received: by 10.65.215.14 with SMTP id s14mr3326245qbq.47.1225402841066; Thu, 30 Oct 2008 14:40:41 -0700 (PDT) Received: by 10.64.201.9 with HTTP; Thu, 30 Oct 2008 14:40:40 -0700 (PDT) Message-ID: Date: Thu, 30 Oct 2008 19:40:40 -0200 From: "Eduardo Meyer" To: freebsd-stable@freebsd.org, dudu.meyer@gmail.com In-Reply-To: <200810302114.m9ULE8jV002689@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <200810302114.m9ULE8jV002689@lurza.secnetix.de> Cc: Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 21:40:43 -0000 On Thu, Oct 30, 2008 at 7:14 PM, Oliver Fromme wrote: > Eduardo Meyer wrote: > > Oliver Fromme wrote: > > > Eduardo Meyer wrote: > > > > I need to write a cgi script which will print the output from ps(1) in > > > > a table (html), so the average-operator can click on a KILL link and > > > > Thank you all. I didnt mention the language, yes, I wanted it with > > shell script. Sadly, no idea was completly enough, for the default ps > > output it simple has no pattern. No multiple-pattern would do the job > > safely. > > Did you actually read my suggestion? I explained that you > cannot cut by pattern, but that you need to cut on field > widths according to the header line. Yes, sure I did. This is why I replied agreeing with you. However, it was not enough, I had to format the header so I was sure the pattern would not fail. > > Here's a solution that implements that, using awk to do > the parsing: > > #!/bin/sh - > > ps -axww -o pid -o user -o emul -o lstart -o lockname -o stat -o command | > awk '{ > if (NR == 1) { > # Parse header line. > # Build arrays fstart[] and fwidth[]. > numfields = split(" " $0, field, / [^ ]/) - 1 > fwidth[1] = length(field[1] field[2]) + 2 > fstart[1] = 1 > for (i = 2; i <= numfields; i++) { > fwidth[i] = length(field[i + 1]) + 2 > fstart[i] = fstart[i - 1] + fwidth[i - 1] > } > fwidth[numfields] = 100 > } > else { > # Parse data line. > print "" > for (i = 1; i <= numfields; i++) { > content = substr($0, fstart[i], fwidth[i]) > print " " > } > print "" > } > }' > > Of course that's just an example. You still have to > produce "
" content "
" and other surrounding HTML, of course. > > Best regards > Oliver Thank you :) I will use it as a template. -- =========== Eduardo Meyer pessoal: dudu.meyer@gmail.com profissional: ddm.farmaciap@saude.gov.br From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 22:05:36 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DECC11065674 for ; Thu, 30 Oct 2008 22:05:36 +0000 (UTC) (envelope-from lopez.on.the.lists@yellowspace.net) Received: from mail.yellowspace.net (mail.yellowspace.net [80.190.200.164]) by mx1.freebsd.org (Postfix) with ESMTP id 554748FC22 for ; Thu, 30 Oct 2008 22:05:36 +0000 (UTC) (envelope-from lopez.on.the.lists@yellowspace.net) Received: from [192.168.178.21] ([85.181.142.163]) (AUTH: CRAM-MD5 lopez.on.the.lists@yellowspace.net, TLS: TLSv1/SSLv3, 128bits, AES128-SHA) by mail.yellowspace.net with esmtp; Thu, 30 Oct 2008 22:55:29 +0100 id 00200168.00000000490A2D52.00000B22 Message-Id: <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> From: Lorenzo Perone To: Freddie Cash In-Reply-To: <200810220838.45900.fjwcash@gmail.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 30 Oct 2008 22:55:21 +0100 References: <200810220838.45900.fjwcash@gmail.com> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-stable@freebsd.org Subject: Re: ZFS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 22:05:37 -0000 On 22.10.2008, at 17:38, Freddie Cash wrote: > Personally, we use it in production for a remote backup box using > ZFS and > Rsync (64-bit FreeBSD 7-Stable from August, 2x dual-core Opteron > 2200s, 8 > GB DDR2 RAM, 24x 500 GB SATA disks attached to two 3Ware 9650/9550 > controllers as single-disks). Works beautifully, backing up 80 > FreeBSD > and Debian Linux servers every night, creating snapshots with each > run. > Restoring files from an arbitrary day is as simple as navigating to > the > needed .zfs/snapshot/// and scping the file to > wherever. > And full system restores are as simple as "boot livecd, partition/ > format > disks, run rsync". So your system doesn't suffer panics and/or deadlocks, or you just cope with them as "collateral damage" (which, admitted, is less of a problem with a logging fs)? If that's the case, would you share the details about what you're using on that machine (RELENG_7?, 7_0? HEAD?) and which patches /knobs You used? I have a similar setup on a host which backs up way fewer machines and locks up every... 3-9 weeks or so. That host only has about 2GB ram though. Thanx and regards, Lorenzo From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 22:34:55 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 13CD5106564A for ; Thu, 30 Oct 2008 22:34:55 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.freebsd.org (Postfix) with ESMTP id B94608FC17 for ; Thu, 30 Oct 2008 22:34:54 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id 18D2E1A000B30 for ; Thu, 30 Oct 2008 15:34:54 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at smtp.sd73.bc.ca Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 0chJP+hLgqvq for ; Thu, 30 Oct 2008 15:34:47 -0700 (PDT) Received: from coal (s10.sbo [192.168.0.10]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 59E7D1A000B31 for ; Thu, 30 Oct 2008 15:34:47 -0700 (PDT) From: Freddie Cash To: freebsd-stable@freebsd.org Date: Thu, 30 Oct 2008 15:34:47 -0700 User-Agent: KMail/1.9.9 References: <200810220838.45900.fjwcash@gmail.com> <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> In-Reply-To: <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810301534.47326.fjwcash@gmail.com> Subject: Re: ZFS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 22:34:55 -0000 On October 30, 2008 02:55 pm Lorenzo Perone wrote: > On 22.10.2008, at 17:38, Freddie Cash wrote: > > Personally, we use it in production for a remote backup box using > > ZFS and Rsync (64-bit FreeBSD 7-Stable from August, 2x dual-core > > Opteron 2200s, 8 GB DDR2 RAM, 24x 500 GB SATA disks attached to two > > 3Ware 9650/9550 controllers as single-disks). Works beautifully, > > backing up 80 FreeBSD and Debian Linux servers every night, creating > > snapshots with each run. > > Restoring files from an arbitrary day is as simple as navigating to > > the needed .zfs/snapshot/// and scping the file to > > wherever. > > And full system restores are as simple as "boot livecd, partition/ > > format disks, run rsync". > So your system doesn't suffer panics and/or deadlocks, or you just > cope with them as "collateral damage" (which, admitted, is less of > a problem with a logging fs)? Back in August, when we first started the implementation, we deadlocked it once or twice a week. By the time it went live in September, we deadlocked it several times a week, but that turned out to be due to the CPU/RAM in the production machine not being able to keep up with even 20 rsync runs (2x Opeteron 200, 8 GB DDR1-SDRAM). We moved the harddrives over to another system with the Opteron 2200s (similar to the testing machine) and DDR2-SDRAM and have only deadlocked it 2x in 6 weeks. Through all that, we noticed a pattern: if we had more than 4 rsyncs running that were doing straight copies (ie added new servers to the backup, and this was their first run), then the server would deadlock. Had to be power-cycled. But if the rsyncs are doing mostly incremental updates (file compares, updating changed files, writing new files), then we can run with all 80 without issues. So, we've taken to only adding 1 new server at a time to the backup process, and waiting for it to fully sync to the backup server before adding the next one. (We stop the rsync run at 6:50am, so some servers can take up to three days for the initial sync to complete, as the remote end only has 768 Kbps ADSL upload speeds.) It's only been up for a week now since the last deadlock, but now that we've discovered the issue (too many writes from too many rsyncs simultaneously), we think it will be a lot longer until the next one. :) We're anxiously awaiting the release of 8.0, with the much expanded kmem_max, so we can put 16 GB of RAM in here, give 4 GB to the ARC, and give the rest to rsync, which should speed things up and stabilise it more. > If that's the case, would you share the details about what you're using > on that machine (RELENG_7?, 7_0? HEAD?) and which patches > /knobs You used? I have a similar setup on a host which > backs up way fewer machines and locks up every... 3-9 weeks or so. > That host only has about 2GB ram though. All the gory details follow. It's fairly long. There are no custom or extra patches installed. Hardware: Tyan h2000M motherboard (S3992) 2x Opteron 2200 CPUs (dual-core) @ 2 GHz 4x 2 GB DDR2-667 ECC SDRAM 3Ware 9550SXU-ML16 PCI-X RAID controller 3Ware 9650SE-ML12 PCIe RAID controller 12x 400 GB Seagate SATA harddrives 12x 500 GB WD SATA harddrives 2x 2 GB CompactFlash cards in CF-to-IDE adapters Chenbro 5U case with 4-way redundand PSUs and 24x hot-swappable bays All 24 harddrives are configured as "SingleDisk" arrays, which makes them appear as individual, normal drives to the OS, but allows the RAID controller to use the disk write cache and the card write cache. ad0 and ad1 are the CF cards, and are part of a gmirror (gm0) da0 through da23 are part of a raidz2 pool called "storage" / is on gm0 The following are ZFS filesystems: /usr /usr/src compressed (ljz) /usr/obj /usr/ports compressed (ljz) /usr/ports/distfiles /usr/local /home /tmp /var /storage /storage/backup compressed (gzip) swap is an 8 GB zvol ZFS recordsize is set to 64K on storage, and inherited by the rest. uname -a: FreeBSD megadrive.sd73.bc.ca 7.0-STABLE FreeBSD 7.0-STABLE #0: Tue Aug 19 10:39:29 PDT 2008 root@megadrive.sd73.bc.ca:/usr/obj/usr/src/sys/ZFSHOST amd64 /boot/loader.conf: # Loader options autoboot_delay="10" beastie_disable="NO" loader_logo="beastie" module_path="/boot/kernel" # Kernel modules to load at boot zfs_load="YES" # Kernel tunables to set at boot (mostly for ZFS tuning) # Disable DMA for the CF disks # Set kmem to 1.5 GB (the current max on amd64) # Set ZFS Adaptive Read Cache (arc) to about half of kmem (leaving half for the OS) hw.ata.ata_dma=0 kern.hz="100" vfs.zfs.arc_min="512M" vfs.zfs.arc_max="768M" vfs.zfs.prefetch_disable="1" vfs.zfs.zil_disable="0" vm.kmem_size="1596M" vm.kmem_size_max="1596M" # Devices to disable at boot (mainly ISA/non-PnP devices) hint.fd.1.disabled="1" hint.sio.0.disabled="1" hint.sio.1.disabled="1" hint.sio.2.disabled="1" hint.sio.3.disabled="1" hint.ppc.0.disabled="1" Kernel config is GENERIC minus a bunch of unneeded drivers, using SCHED_ULE. /etc/sysctl.conf: # General network settings net.isr.direct=1 # Whether to enable Direct Dispatch for netisr # IP options net.inet.ip.forwarding=0 # Whether to enable packet forwarding net.inet.ip.process_options=0 # Disable processing of IP options net.inet.ip.random_id=1 # Randomise the IP header ID number net.inet.ip.redirect=0 # Whether to allow redirect packets #net.inet.ip.stealth=0 # Whether to appear in traceroute output # ICMP options net.inet.icmp.icmplim=200 # Limit ICMP packets to this many/s net.inet.icmp.drop_redirect=1 # Drop ICMP redirect packets net.inet.icmp.log_redirect=0 # Don't log ICMP redirect packets # TCP options net.inet.tcp.blackhole=1 # Drop packets destined to unused ports net.inet.tcp.inflight.enable=1 # Use automatic TCP window-scaling net.inet.tcp.log_in_vain=0 # Don't log the blackholed packets net.inet.tcp.path_mtu_discovery=1 # Use ICMP type 3 to find the MTU to use net.inet.tcp.recvspace=131072 # Size in bytes of the receive buffer net.inet.tcp.sack.enable=1 # Enable Selective ACKs net.inet.tcp.sendspace=131072 # Size in bytes of the send buffer net.inet.tcp.syncookies=1 # Enable SYN cookie protection # UDP options net.inet.udp.blackhole=1 # Drop packets destined to unused ports net.inet.udp.checksum=1 # Enable UDP checksums net.inet.udp.log_in_vain=0 # Don't log the blackholed packets net.inet.udp.recvspace=65536 # Size in bytes of the receive buffer # Debug options debug.minidump=1 # Enable the small kernel core dump debug.mpsafevfs=1 # Enable threaded VFS subsystem # Kernel options kern.coredump=0 # Disable kernel core dumps kern.ipc.somaxconn=512 # Expand the IP listen queue kern.maxvnodes=250000 # Bump up the max number of vnodes # PCI bus options hw.pci.enable_msix=1 # Enable Message Signalled Interrupts Extended hw.pci.enable_msi=1 # Enable Message Signalled Interrupts hw.pci.enable_io_modes=1 # Enable alternate I/O access modes # Other options vfs.usermount=1 # Enable non-root users to mount filesystems -- Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 22:45:22 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 185BA1065673 for ; Thu, 30 Oct 2008 22:45:22 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA01.emeryville.ca.mail.comcast.net (qmta01.emeryville.ca.mail.comcast.net [76.96.30.16]) by mx1.freebsd.org (Postfix) with ESMTP id F17FC8FC14 for ; Thu, 30 Oct 2008 22:45:21 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA05.emeryville.ca.mail.comcast.net ([76.96.30.43]) by QMTA01.emeryville.ca.mail.comcast.net with comcast id Z7u11a0030vp7WLA1AlMTw; Thu, 30 Oct 2008 22:45:21 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA05.emeryville.ca.mail.comcast.net with comcast id ZAlL1a0022P6wsM8RAlLxa; Thu, 30 Oct 2008 22:45:20 +0000 X-Authority-Analysis: v=1.0 c=1 a=QycZ5dHgAAAA:8 a=xygHCC4G5pvWBM54_z0A:9 a=g_Nw4SE5s3b2XdhCdFesf7y3KTQA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 0127EC9419; Thu, 30 Oct 2008 15:45:19 -0700 (PDT) Date: Thu, 30 Oct 2008 15:45:19 -0700 From: Jeremy Chadwick To: d@delphij.net Message-ID: <20081030224519.GA15921@icarus.home.lan> References: <490A0A35.8040109@protected-networks.net> <490A1D74.10008@delphij.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <490A1D74.10008@delphij.net> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: FreeBSD stable Subject: Re: ICH7M limited to SATA-150? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 22:45:22 -0000 On Thu, Oct 30, 2008 at 01:47:48PM -0700, Xin LI wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi, > > Michael Butler wrote: > > Recently, I upgraded the disk in my Toshiba A105 with a 7200rpm SATA-II > > device but it seems to still talking at SATA-I speed :-( > > > > atapci0: port > > 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x18b0-0x18bf at device 31.2 on pci0 > > > > [ .. snip .. ] > > > > ad0: 305245MB at ata0-master SATA150 > > acd0: DVDR at ata1-master UDMA33 > > > > There don't appear to be any obvious 'compatibility jumpers' on the > > drive, so I'm wondering what gives? > > > > Is it possible this is hard-coded into the BIOS? > > Personally I don't really think ICH7M is capable to do SATA-300. Intel > datasheet 307013, page 191 says: > > Supported Supported > 3 Gb/s Transfer Rate > (Desktop Only) (Desktop Only) > > My understanding is that ICH7- *M* does not support SATA-300 at all. Xin Li is correct -- the mobile version doesn't do SATA300. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 23:00:43 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E43FE1065670; Thu, 30 Oct 2008 23:00:43 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from sarah.protected-networks.net (sarah.protected-networks.net [IPv6:2001:470:1f07:4e1::1]) by mx1.freebsd.org (Postfix) with ESMTP id 925D78FC0C; Thu, 30 Oct 2008 23:00:43 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from toshi.auburn.protected-networks.net (toshi.auburn.protected-networks.net [IPv6:2001:470:1f07:4e1::4]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "Iain Michael Butler", Issuer "Protected Networks Certificate Authority" (verified OK)) (Authenticated sender: imb) by sarah.protected-networks.net (Postfix) with ESMTPSA id 1DDCB6187; Thu, 30 Oct 2008 19:00:42 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=protected-networks.net; s=200705; t=1225407642; bh=/eefmuNcvZQgdI Ld2YvorRDGvVczzWpD5GJZr/i0DNo=; h=Message-ID:Date:From:MIME-Version: To:CC:Subject:References:In-Reply-To:Content-Type: Content-Transfer-Encoding; b=eHhZ9V88jYm4nPWi0XLldBnNkiglJV9G/5G3i zbAsipdZLW1UKXjfZTzMuosrF/MglDwbNnH7NyNAf60OJvVW2/ipm/6EN/DJdG2woed sfMrfThoFCoG7cmvR7qYKqpp DomainKey-Signature: a=rsa-sha1; s=200509; d=protected-networks.net; c=nofws; q=dns; h=message-id:date:from:user-agent:mime-version:to:cc:subject: references:in-reply-to:x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=gsMt/NoHCE2M3y38mBW9uQrX2u/2WAmCCzCKZG0YVDq0HzsoodPo2zzCcdQK+5Uf1 SXG+HLsbi+aDYFJregfzTZlYoN97obIKF1gxsya2ABIixxnZvwfqB8mOwJQ6kU1 Message-ID: <490A3C95.1050405@protected-networks.net> Date: Thu, 30 Oct 2008 19:00:37 -0400 From: Michael Butler User-Agent: Thunderbird 2.0.0.17 (X11/20081021) MIME-Version: 1.0 To: Jeremy Chadwick References: <490A0A35.8040109@protected-networks.net> <490A1D74.10008@delphij.net> <20081030224519.GA15921@icarus.home.lan> In-Reply-To: <20081030224519.GA15921@icarus.home.lan> X-Enigmail-Version: 0.95.7 OpenPGP: id=0442D492 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: FreeBSD stable , =?ISO-8859-1?Q?Schmidt?= , =?ISO-8859-1?Q?S=F8ren_?= Subject: Re: ICH7M limited to SATA-150? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 23:00:44 -0000 Jeremy Chadwick wrote: > On Thu, Oct 30, 2008 at 01:47:48PM -0700, Xin LI wrote: >> Personally I don't really think ICH7M is capable to do SATA-300. Intel >> datasheet 307013, page 191 says: >> >> Supported Supported >> 3 Gb/s Transfer Rate >> (Desktop Only) (Desktop Only) >> >> My understanding is that ICH7- *M* does not support SATA-300 at all. > > Xin Li is correct -- the mobile version doesn't do SATA300. Then there is a correction required to /sys/dev/ata/ata_chipset.c - mine identifies itself as: atapci0@pci0:0:31:2: class=0x010180 card=0xff101179 chip=0x27c48086 rev=0x02 hdr=0x00 vendor = 'Intel Corporation' device = '82801GBM/GHM (ICH7-M Family) Serial ATA Storage Controller' class = mass storage subclass = ATA .. where 0x27c4 is "legacy" mode and 0x27c5 is AHCI mode, Michael From owner-freebsd-stable@FreeBSD.ORG Thu Oct 30 23:08:05 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 347EE1065680; Thu, 30 Oct 2008 23:08:05 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.delphij.net (delphij-pt.tunnel.tserv2.fmt.ipv6.he.net [IPv6:2001:470:1f03:2c9::2]) by mx1.freebsd.org (Postfix) with ESMTP id C8EAD8FC17; Thu, 30 Oct 2008 23:08:04 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.geekcn.org (tarsier.geekcn.org [211.166.10.233]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by tarsier.delphij.net (Postfix) with ESMTPS id AFF1D28454; Fri, 31 Oct 2008 07:08:03 +0800 (CST) Received: from localhost (tarsier.geekcn.org [211.166.10.233]) by tarsier.geekcn.org (Postfix) with ESMTP id 48F18EB9D35; Fri, 31 Oct 2008 07:08:03 +0800 (CST) X-Virus-Scanned: amavisd-new at geekcn.org X-Amavis-Alert: BAD HEADER SECTION, Non-encoded 8-bit data (char C3 hex): CC: ...hmidt , "S\303\270ren "@FreeBSD.ORG Received: from tarsier.geekcn.org ([211.166.10.233]) by localhost (mail.geekcn.org [211.166.10.233]) (amavisd-new, port 10024) with ESMTP id iK8ZDBhDdbir; Fri, 31 Oct 2008 07:07:58 +0800 (CST) Received: from charlie.delphij.net (adsl-76-237-33-62.dsl.pltn13.sbcglobal.net [76.237.33.62]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tarsier.geekcn.org (Postfix) with ESMTPSA id 75B0EEB96DB; Fri, 31 Oct 2008 07:07:54 +0800 (CST) DomainKey-Signature: a=rsa-sha1; s=default; d=delphij.net; c=nofws; q=dns; h=message-id:date:from:reply-to:organization:user-agent: mime-version:to:cc:subject:references:in-reply-to: x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=UIIJtcBmtsu4daYF+N7YV/MvrB3RPs3M63lWNQSIBTwKXwVWU+neMo/UynQTaJguz kopoTm9IMQzQzz8iaGGSQ== Message-ID: <490A3E46.1060404@delphij.net> Date: Thu, 30 Oct 2008 16:07:50 -0700 From: Xin LI Organization: The FreeBSD Project User-Agent: Thunderbird 2.0.0.17 (X11/20080928) MIME-Version: 1.0 To: Michael Butler References: <490A0A35.8040109@protected-networks.net> <490A1D74.10008@delphij.net> <20081030224519.GA15921@icarus.home.lan> <490A3C95.1050405@protected-networks.net> In-Reply-To: <490A3C95.1050405@protected-networks.net> X-Enigmail-Version: 0.95.7 OpenPGP: id=18EDEBA0; url=http://www.delphij.net/delphij.asc Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Jeremy Chadwick , FreeBSD stable , "Søren "@FreeBSD.ORG, Schmidt Subject: Re: ICH7M limited to SATA-150? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: d@delphij.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Oct 2008 23:08:05 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Michael Butler wrote: > Jeremy Chadwick wrote: > >> On Thu, Oct 30, 2008 at 01:47:48PM -0700, Xin LI wrote: >>> Personally I don't really think ICH7M is capable to do SATA-300. Intel >>> datasheet 307013, page 191 says: >>> >>> Supported Supported >>> 3 Gb/s Transfer Rate >>> (Desktop Only) (Desktop Only) >>> >>> My understanding is that ICH7- *M* does not support SATA-300 at all. >> Xin Li is correct -- the mobile version doesn't do SATA300. > > Then there is a correction required to /sys/dev/ata/ata_chipset.c - mine > identifies itself as: > > atapci0@pci0:0:31:2: class=0x010180 card=0xff101179 chip=0x27c48086 > rev=0x02 hdr=0x00 > vendor = 'Intel Corporation' > device = '82801GBM/GHM (ICH7-M Family) Serial ATA Storage > Controller' > class = mass storage > subclass = ATA > > .. where 0x27c4 is "legacy" mode and 0x27c5 is AHCI mode, Yes. I have actually already submitted a patch to sos@ for review. Please note that 27c4, 27c5 and *27c6* should all be changed, according to the datasheet. Thanks for bringing this to our attention. Cheers, - -- Xin LI http://www.delphij.net/ FreeBSD - The Power to Serve! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkkKPkYACgkQi+vbBBjt66CjmwCfYtNzKlcZVEBsbHWTipVLB2rr pwQAoI/JEx27m7Kis4Z/9MeGQOKkRgg0 =10Uz -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 00:43:41 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7755D1065677 for ; Fri, 31 Oct 2008 00:43:41 +0000 (UTC) (envelope-from eksffa@freebsdbrasil.com.br) Received: from capeta.freebsdbrasil.com.br (capeta.freebsdbrasil.com.br [201.48.151.3]) by mx1.freebsd.org (Postfix) with SMTP id A3A4E8FC1B for ; Fri, 31 Oct 2008 00:43:40 +0000 (UTC) (envelope-from eksffa@freebsdbrasil.com.br) Received: (qmail 99997 invoked from network); 30 Oct 2008 22:16:59 -0200 Received: by simscan 1.1.0 ppid: 99987, pid: 99989, t: 0.9512s scanners: clamav: 0.91.1/m: spam: 3.1.1 X-Spam-Checker-Version: SpamAssassin: -last, FreeBSD Brasil LTDA rulesets: Yes X-Spam-Status: No, hits=-1.9 required=3.7 Received: from unknown (HELO claire.bh.freebsdbrasil.com.br) (201.48.151.226) by capeta.freebsdbrasil.com.br with SMTP; 30 Oct 2008 22:16:58 -0200 Message-ID: <490A4E6F.1040506@freebsdbrasil.com.br> Date: Thu, 30 Oct 2008 22:16:47 -0200 From: Patrick Tracanelli Organization: FreeBSD Brasil LTDA User-Agent: Thunderbird 2.0.0.0 (X11/20070612) MIME-Version: 1.0 To: Eduardo Meyer References: <200810301418.m9UEIvSj086321@lurza.secnetix.de> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 00:43:41 -0000 Eduardo Meyer escreveu: [...] > Now my next problem, do the sabe with sockstat.... > > %sockstat | head -4 > USER COMMAND PID FD PROTO LOCAL ADDRESS FOREIGN ADDRESS > freebsdsupportsshd 57255 3 tcp4 172.16.0.225:22 172.16.0.69:63583 > freebsdsupportsshd 57255 4 stream -> ?? > root sshd 57253 3 tcp4 172.16.0.225:22 172.16.0.69:63583 > > So I have the USER and COMMAND column "merged" in a single string, > because username is large. Again, space can not be used as a > separator, but hopefully only the patterns with "->" will have space > if not a column separator, easier to parse. > > But sockstat have no formatting option to be issued like -o from > ps(1). Measing in the very first sockstat output, I dont know what to > do... :( You wont be able to parse it. I believe sockstat was written when username was limited to 8 chars. Therefore, it will count until the 9th position to print another space. I dont know if patching is an option for you, but you can truncate the username printing up to 8 chars. This is the huge patch which will make your output look better and get fully parseable: --- sockstat.c.orig 2007-06-16 17:24:55.000000000 -0300 +++ sockstat.c 2008-10-30 21:57:05.000000000 -0200 @@ -586,7 +586,7 @@ if ((pwd = getpwuid(xf->xf_uid)) == NULL) pos += xprintf("%lu", (u_long)xf->xf_uid); else - pos += xprintf("%s", pwd->pw_name); + pos += xprintf("%.8s", pwd->pw_name); while (pos < 9) pos += xprintf(" "); pos += xprintf("%.10s", getprocname(xf->xf_pid)); -- Patrick Tracanelli FreeBSD Brasil LTDA. Tel.: (31) 3516-0800 316601@sip.freebsdbrasil.com.br http://www.freebsdbrasil.com.br "Long live Hanin Elias, Kim Deal!" From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 00:45:07 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 12B4F106567D; Fri, 31 Oct 2008 00:45:07 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.cksoft.de (mail.cksoft.de [62.111.66.27]) by mx1.freebsd.org (Postfix) with ESMTP id BA76B8FC12; Fri, 31 Oct 2008 00:45:06 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from localhost (amavis.str.cksoft.de [192.168.74.71]) by mail.cksoft.de (Postfix) with ESMTP id F15F441C751; Fri, 31 Oct 2008 01:45:05 +0100 (CET) X-Virus-Scanned: amavisd-new at cksoft.de Received: from mail.cksoft.de ([62.111.66.27]) by localhost (amavis.str.cksoft.de [192.168.74.71]) (amavisd-new, port 10024) with ESMTP id 0NZitcXrokpJ; Fri, 31 Oct 2008 01:45:05 +0100 (CET) Received: by mail.cksoft.de (Postfix, from userid 66) id 8312A41C74D; Fri, 31 Oct 2008 01:45:05 +0100 (CET) Received: from maildrop.int.zabbadoz.net (maildrop.int.zabbadoz.net [10.111.66.10]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.int.zabbadoz.net (Postfix) with ESMTP id ECD0844487F; Fri, 31 Oct 2008 00:41:14 +0000 (UTC) Date: Fri, 31 Oct 2008 00:41:14 +0000 (UTC) From: "Bjoern A. Zeeb" X-X-Sender: bz@maildrop.int.zabbadoz.net To: Michael Butler In-Reply-To: <490A048E.8000907@protected-networks.net> Message-ID: <20081031003552.A4973@maildrop.int.zabbadoz.net> References: <487086DA-4514-44E7-AB9F-F1D98C652980@yellowspace.net> <490754D5.8050202@protected-networks.net> <20081028181744.Q2978@maildrop.int.zabbadoz.net> <490A048E.8000907@protected-networks.net> X-OpenPGP-Key: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: stable@freebsd.org, freebsd-jail@freebsd.org Subject: Re: 7.x and multiple IPs in jails X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-jail@freebsd.org List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 00:45:07 -0000 On Thu, 30 Oct 2008, Michael Butler wrote: Hi, >>>> Hi, there's a patch by Bjoern A.Zeeb, available at >>>> http://people.freebsd.org/~bz/bz_jail7-20080920-01-at150161.diff >>>> >>>> which succeeds and works well with 7.1-PRERELEASE currently. >>>> I had similar issues to solve and patched several hosts >>>> with it, so far with success. > > Sadly, SVN rev 184481 (of today) breaks these patches :-( > > Is there an updated patch-set available or planned? I wonder if that was one of my MFCs - I guess so. One of the reasons I am doing those MFCs is to keep the diff between HEAD and 7 down to a minimum so that I have to ship less patches integrated into the jail patch for 7. So yes the plan is to finish the MFCs and generate a new patch for 7 the next days (most likely beginning of next week). Regards, Bjoern -- Bjoern A. Zeeb Stop bit received. Insert coin for new game. From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 02:29:43 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5358C106567D for ; Fri, 31 Oct 2008 02:29:43 +0000 (UTC) (envelope-from louisk@cryptomonkeys.com) Received: from abeyance.cryptomonkeys.com (abeyance.cryptomonkeys.com [67.42.3.2]) by mx1.freebsd.org (Postfix) with ESMTP id C9B9B8FC08 for ; Fri, 31 Oct 2008 02:29:41 +0000 (UTC) (envelope-from louisk@cryptomonkeys.com) Received: from lk-mbp.local (c-76-21-17-250.hsd1.ca.comcast.net [76.21.17.250]) (authenticated bits=0) by abeyance.cryptomonkeys.com (8.13.8+Sun/8.13.8) with ESMTP id m9V2FDuA015057 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Thu, 30 Oct 2008 18:16:48 -0800 (PST) Received: from [127.0.0.1] by lk-mbp.local (PGP Universal service); Thu, 30 Oct 2008 19:16:48 -0700 X-PGP-Universal: processed; by lk-mbp.local on Thu, 30 Oct 2008 19:16:48 -0700 Message-Id: <1EA86BC6-349F-48DB-A77C-A4D8E00C55B5@cryptomonkeys.com> From: Louis Kowolowski To: Lorenzo Perone In-Reply-To: <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 30 Oct 2008 19:15:13 -0700 References: <200810220838.45900.fjwcash@gmail.com> <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> X-Mailer: Apple Mail (2.929.2) Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: ZFS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 02:29:43 -0000 On Oct 30, 2008, at 2:55 PM, Lorenzo Perone wrote: > On 22.10.2008, at 17:38, Freddie Cash wrote: >> Personally, we use it in production for a remote backup box using >> ZFS and >> Rsync (64-bit FreeBSD 7-Stable from August, 2x dual-core Opteron >> 2200s, 8 >> GB DDR2 RAM, 24x 500 GB SATA disks attached to two 3Ware 9650/9550 >> controllers as single-disks). Works beautifully, backing up 80 >> FreeBSD >> and Debian Linux servers every night, creating snapshots with each >> run. >> Restoring files from an arbitrary day is as simple as navigating to >> the >> needed .zfs/snapshot/// and scping the file to >> wherever. >> And full system restores are as simple as "boot livecd, partition/ >> format >> disks, run rsync". > > > So your system doesn't suffer panics and/or deadlocks, or you just > cope with them as "collateral damage" (which, admitted, is less of > a problem with a logging fs)? > > If that's the case, would you share the details about what you're > using > on that machine (RELENG_7?, 7_0? HEAD?) and which patches > /knobs You used? I have a similar setup on a host which > backs up way fewer machines and locks up every... 3-9 weeks or so. > That host only has about 2GB ram though. > I have a system which is sort of similar in production at work. I have the following tunables (for ZFS) set: zfs_load="YES" vm.kmem_size_max="1024M" vm.kmem_size="1024M" vfs.zfs.arc_min="16M" vfs.zfs.arc_max="384M" [lkowolowski@release lkowolowski 76 ]$ uname -a FreeBSD release.pgp.com 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #0: Wed Sep 3 12:18:57 PDT 2008 root@release.pgp.com:/usr/obj/usr/src/sys/ GENERIC amd64 [lkowolowski@release lkowolowski 77 ]$ This box has 2G of RAM, and 8.5T in ZFS spread across 8 RAID1 mirrors in an EonStore Fiber array (direct attach). It's been rock solid and stores all of our build collateral. -- Louis Kowolowski louisk@cryptomonkeys.com Cryptomonkeys: http://www.cryptomonkeys.com/~louisk Making life more interesting for people since 1977 From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 07:54:59 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 87C30106568B for ; Fri, 31 Oct 2008 07:54:59 +0000 (UTC) (envelope-from dominique.goncalves@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.173]) by mx1.freebsd.org (Postfix) with ESMTP id 5C2BC8FC17 for ; Fri, 31 Oct 2008 07:54:59 +0000 (UTC) (envelope-from dominique.goncalves@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so1058675wfg.7 for ; Fri, 31 Oct 2008 00:54:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=95TsQmVM9dCjULKl2UGRicgNstuuyxFyp605XLdrH5I=; b=PL81LTldAeg+PWJRRDNs78k2l1SUl/PpDpWUB1x4dxPnOEgAT9htCpJVu2dkALIPyC NmLyWP6qFzO/+AitBQH4DQ9m4pOapGEEoS7XMir4w1PCWusaeDJdbeQs63eeS2J+3fQk DCitOZhPdISGIrHKjrkwFeGj5xf+gTMGgxeWA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=ULfIJK6JuHyTK8mEueYV055gfXBWFM0cHgsAE62l2zJmaz7Gwm8v7ubyRh++Jk6CSC GDDzZthKdfexp/431bznV+X6Yeq01HKNXhJLe3SVuAnxt5MW27aqsDREmZMMe+rOT0iB V4/c2qZCcNMEBZO7s1LCSsw/d4dOSV3m7wzSA= Received: by 10.143.2.19 with SMTP id e19mr5235206wfi.90.1225439698933; Fri, 31 Oct 2008 00:54:58 -0700 (PDT) Received: by 10.142.246.14 with HTTP; Fri, 31 Oct 2008 00:54:58 -0700 (PDT) Message-ID: <7daacbbe0810310054p73bec34eu9497f4d036b5d648@mail.gmail.com> Date: Fri, 31 Oct 2008 08:54:58 +0100 From: "Dominique Goncalves" To: "=?ISO-8859-1?Q?V=E1clav_Haisman?=" In-Reply-To: <49097F1F.7060109@sh.cvut.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <7daacbbe0810290217l60236d8ci1b2c4011720a0cc8@mail.gmail.com> <49097F1F.7060109@sh.cvut.cz> Cc: freebsd-stable@freebsd.org Subject: Re: Perl application hang in umtxn state X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 07:54:59 -0000 Hi On Thu, Oct 30, 2008 at 10:32 AM, V=E1clav Haisman w= rote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > Dominique Goncalves wrote: >> Hi, >> >> I run FreeBSD 7.1-PRERELEASE and with a Perl GTK2 application, Perl >> hang in umtxn state: >> >> PID USERNAME THR PRI NICE SIZE RES STATE TIME WCPU COMMAN= D >> 76288 dom 1 53 0 67860K 46080K umtxn 0:02 0.00% perl5.= 8.8 >> >> And the only way to stop the application is kill -9 >> >> I tried to use ktrace/kdump and ktrace.out show "_umtx_op" >> >> $ kdump -f ktrace.out >> [...] >> 13199 perl5.8.8 RET lstat 0 >> 13199 perl5.8.8 CALL gettimeofday(0xbfbfb144,0) >> 13199 perl5.8.8 RET gettimeofday 0 >> 13199 perl5.8.8 CALL _umtx_op(0xbfbfd18c,0x3,0x1,0,0) >> 13199 perl5.8.8 RET _umtx_op 0 >> 13199 perl5.8.8 CALL sigprocmask(SIG_BLOCK,0xbfbfd120,0x8121490) >> 13199 perl5.8.8 RET sigprocmask 0 >> 13199 perl5.8.8 CALL _umtx_op(0x287fb8a0,0x5,0,0,0) >> 13199 perl5.8.8 RET _umtx_op RESTART >> 13199 perl5.8.8 PSIG SIGKILL SIG_DFL >> >> >> How to debug this hang? (btw I'm not a developer) > You can try rebuilding perl with debugging information. I am not sure > this is the best way but I have used this in my /etc/make.conf: > > # Disable binaries stripping. > STRIP=3D > # Add debugging info to binaries. > CFLAGS?=3D > CFLAGS+=3D -g3 -ggdb > CXXFLAGS?=3D > CXXFLAGS+=3D -g3 -ggdb Ok, I've recompiled Perl and others applications with these options. > When you have that, try running your test case again. When it blocks > again, attach GDB to the hung process: gdb -p PID `which perl`. And then > obtain the call stack: (gdb) bt. # gdb -p 2528 `which perl` GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you ar= e welcome to change it and/or distribute copies of it under certain condition= s. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd"...(no debugging symbols found)... Attaching to program: /usr/bin/perl, process 2528 Reading symbols from /usr/local/lib/perl5/5.8.8/mach/CORE/libperl.so...done= . Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/CORE/libperl.so Reading symbols from /lib/libm.so.5...done. Loaded symbols for /lib/libm.so.5 Reading symbols from /lib/libcrypt.so.4...done. Loaded symbols for /lib/libcrypt.so.4 Reading symbols from /lib/libutil.so.7...done. Loaded symbols for /lib/libutil.so.7 Reading symbols from /lib/libc.so.7...done. Loaded symbols for /lib/libc.so.7 Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Cwd/Cwd.so...done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Cwd/Cwd.s= o Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/POSIX/POSIX.so...= done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/POSIX/POSIX.so Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Glib/Glib.so...done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Glib/Glib= .so Reading symbols from /usr/local/lib/libgobject-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgobject-2.0.so.0 Reading symbols from /usr/local/lib/libglib-2.0.so.0...done. Loaded symbols for /usr/local/lib/libglib-2.0.so.0 Reading symbols from /usr/local/lib/libintl.so.8...done. Loaded symbols for /usr/local/lib/libintl.so.8 Reading symbols from /usr/local/lib/libiconv.so.3...done. Loaded symbols for /usr/local/lib/libiconv.so.3 Reading symbols from /usr/local/lib/libpcre.so.0...done. Loaded symbols for /usr/local/lib/libpcre.so.0 Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Cairo/Cairo.so...done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Cairo/Cai= ro.so Reading symbols from /usr/local/lib/libcairo.so.2...done. Loaded symbols for /usr/local/lib/libcairo.so.2 Reading symbols from /usr/local/lib/libfreetype.so.9...done. Loaded symbols for /usr/local/lib/libfreetype.so.9 Reading symbols from /lib/libz.so.4...done. Loaded symbols for /lib/libz.so.4 Reading symbols from /usr/local/lib/libfontconfig.so.1...done. Loaded symbols for /usr/local/lib/libfontconfig.so.1 Reading symbols from /usr/local/lib/libpixman-1.so.9...done. Loaded symbols for /usr/local/lib/libpixman-1.so.9 Reading symbols from /usr/local/lib/libpng.so.5...done. Loaded symbols for /usr/local/lib/libpng.so.5 Reading symbols from /usr/local/lib/libxcb-render-util.so.0...done. Loaded symbols for /usr/local/lib/libxcb-render-util.so.0 Reading symbols from /usr/local/lib/libxcb-render.so.0...done. Loaded symbols for /usr/local/lib/libxcb-render.so.0 Reading symbols from /usr/local/lib/libxcb.so.1...done. Loaded symbols for /usr/local/lib/libxcb.so.1 Reading symbols from /usr/local/lib/libXrender.so.1...done. Loaded symbols for /usr/local/lib/libXrender.so.1 Reading symbols from /usr/local/lib/libX11.so.6...done. Loaded symbols for /usr/local/lib/libX11.so.6 Reading symbols from /lib/libthr.so.3...done. [New Thread 0x8125400 (LWP 100093)] Loaded symbols for /lib/libthr.so.3 Reading symbols from /usr/local/lib/libexpat.so.6...done. Loaded symbols for /usr/local/lib/libexpat.so.6 Reading symbols from /usr/local/lib/libXau.so.6...done. Loaded symbols for /usr/local/lib/libXau.so.6 Reading symbols from /usr/local/lib/libXdmcp.so.6...done. Loaded symbols for /usr/local/lib/libXdmcp.so.6 Reading symbols from /usr/lib/librpcsvc.so.4...done. Loaded symbols for /usr/lib/librpcsvc.so.4 Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Gtk2/Gtk2.so...done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Gtk2/Gtk2= .so Reading symbols from /usr/local/lib/libgtk-x11-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgtk-x11-2.0.so.0 Reading symbols from /usr/local/lib/libgdk-x11-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgdk-x11-2.0.so.0 Reading symbols from /usr/local/lib/libatk-1.0.so.0...done. Loaded symbols for /usr/local/lib/libatk-1.0.so.0 Reading symbols from /usr/local/lib/libgdk_pixbuf-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgdk_pixbuf-2.0.so.0 Reading symbols from /usr/local/lib/libpangocairo-1.0.so.0...done. Loaded symbols for /usr/local/lib/libpangocairo-1.0.so.0 Reading symbols from /usr/local/lib/libgio-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgio-2.0.so.0 Reading symbols from /usr/local/lib/libXext.so.6...done. Loaded symbols for /usr/local/lib/libXext.so.6 Reading symbols from /usr/local/lib/libXinerama.so.1...done. Loaded symbols for /usr/local/lib/libXinerama.so.1 Reading symbols from /usr/local/lib/libXi.so.6...done. Loaded symbols for /usr/local/lib/libXi.so.6 Reading symbols from /usr/local/lib/libXrandr.so.2...done. Loaded symbols for /usr/local/lib/libXrandr.so.2 Reading symbols from /usr/local/lib/libXcursor.so.1...done. Loaded symbols for /usr/local/lib/libXcursor.so.1 Reading symbols from /usr/local/lib/libXcomposite.so.1...done. Loaded symbols for /usr/local/lib/libXcomposite.so.1 Reading symbols from /usr/local/lib/libXdamage.so.1...done. Loaded symbols for /usr/local/lib/libXdamage.so.1 Reading symbols from /usr/local/lib/libpangoft2-1.0.so.0...done. Loaded symbols for /usr/local/lib/libpangoft2-1.0.so.0 Reading symbols from /usr/local/lib/libXfixes.so.3...done. Loaded symbols for /usr/local/lib/libXfixes.so.3 Reading symbols from /usr/local/lib/libpango-1.0.so.0...done. Loaded symbols for /usr/local/lib/libpango-1.0.so.0 Reading symbols from /usr/local/lib/libgmodule-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgmodule-2.0.so.0 Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/IO/IO.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/IO/IO.so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/Fcntl/Fcntl.so...= done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/Fcntl/Fcntl.so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/File/Glob/Glob.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/File/Glob/Glob.so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/Storable/Storable.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/Storable/Storable.s= o Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/List/Util/Util.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/List/Util/Util.so Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/DateTime/DateTime.so...done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/DateTime/DateTime.so Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Params/Validate/Validate.so.= ..done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Params/Validate/Validate.so Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/List/MoreUtils/MoreUtils.so.= ..done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/List/MoreUtils/MoreUtils.so Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Gtk2/Spell/Spell.so...done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Gtk2/Spell/Spell.so Reading symbols from /usr/local/lib/libgtkspell.so.0...done. Loaded symbols for /usr/local/lib/libgtkspell.so.0 Reading symbols from /usr/local/lib/libenchant.so.1...done. Loaded symbols for /usr/local/lib/libenchant.so.1 Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Gnome2/VFS/VFS.so...done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Gnome2/VFS/VFS.so Reading symbols from /usr/local/lib/libgnomevfs-2.so.0...done. Loaded symbols for /usr/local/lib/libgnomevfs-2.so.0 Reading symbols from /usr/local/lib/libgconf-2.so.4...done. Loaded symbols for /usr/local/lib/libgconf-2.so.4 Reading symbols from /usr/local/lib/libgthread-2.0.so.0...done. Loaded symbols for /usr/local/lib/libgthread-2.0.so.0 Reading symbols from /usr/local/lib/libxml2.so.5...done. Loaded symbols for /usr/local/lib/libxml2.so.5 Reading symbols from /usr/local/lib/libdbus-glib-1.so.2...done. Loaded symbols for /usr/local/lib/libdbus-glib-1.so.2 Reading symbols from /usr/local/lib/libdbus-1.so.3...done. Loaded symbols for /usr/local/lib/libdbus-1.so.3 Reading symbols from /usr/lib/libssl.so.5...done. Loaded symbols for /usr/lib/libssl.so.5 Reading symbols from /lib/libcrypto.so.5...done. Loaded symbols for /lib/libcrypto.so.5 Reading symbols from /usr/local/lib/libavahi-glib.so.1...done. Loaded symbols for /usr/local/lib/libavahi-glib.so.1 Reading symbols from /usr/local/lib/libavahi-common.so.3...done. Loaded symbols for /usr/local/lib/libavahi-common.so.3 Reading symbols from /usr/local/lib/libavahi-client.so.3...done. Loaded symbols for /usr/local/lib/libavahi-client.so.3 Reading symbols from /usr/local/lib/libORBit-2.so.0...done. Loaded symbols for /usr/local/lib/libORBit-2.so.0 Reading symbols from /lib/libssp.so.0...done. Loaded symbols for /lib/libssp.so.0 Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/HTML/Parser/Parser.so...done= . Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/HTML/Parser/Parser.so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/Encode/Encode.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/Encode/Encode.so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/Socket/Socket.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/Socket/Socket.so Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/XML/Parser/Expat/Expat.so...= done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/XML/Parser/Expat/Expat.so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/Unicode/Normalize/Normalize.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/Unicode/Normalize/Normalize.so Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Compress/Raw/Zlib/Zlib.so...= done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Compress/Raw/Zlib/Zlib.so Reading symbols from /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Compress/Raw/Bzip2/Bzip2.so.= ..done. Loaded symbols for /usr/local/lib/perl5/site_perl/5.8.8/mach/auto/Compress/Raw/Bzip2/Bzip2.so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/MIME/Base64/Base64.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/MIME/Base64/Base64.= so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/Digest/MD5/MD5.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/Digest/MD5/MD5.so Reading symbols from /usr/local/lib/perl5/5.8.8/mach/auto/Filter/Util/Call/Call.so...done. Loaded symbols for /usr/local/lib/perl5/5.8.8/mach/auto/Filter/Util/Call/Ca= ll.so Reading symbols from /usr/local/lib/gtk-2.0/2.10.0/loaders/libpixbufloader-png.so...done. Loaded symbols for /usr/local/lib/gtk-2.0/2.10.0/loaders/libpixbufloader-pn= g.so Reading symbols from /usr/local/lib/pango/1.6.0/modules/pango-basic-fc.so...done. Loaded symbols for /usr/local/lib/pango/1.6.0/modules/pango-basic-fc.so Reading symbols from /usr/local/lib/enchant/libenchant_aspell.so...done. Loaded symbols for /usr/local/lib/enchant/libenchant_aspell.so Reading symbols from /usr/local/lib/libaspell.so.16...done. Loaded symbols for /usr/local/lib/libaspell.so.16 Reading symbols from /usr/lib/libstdc++.so.6...done. Loaded symbols for /usr/lib/libstdc++.so.6 Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Reading symbols from /usr/local/lib/enchant/libenchant_ispell.so...done. Loaded symbols for /usr/local/lib/enchant/libenchant_ispell.so Reading symbols from /usr/local/lib/enchant/libenchant_myspell.so...done. Loaded symbols for /usr/local/lib/enchant/libenchant_myspell.so Reading symbols from /usr/local/lib/enchant/libenchant_zemberek.so...done. Loaded symbols for /usr/local/lib/enchant/libenchant_zemberek.so Reading symbols from /usr/local/lib/gio/modules/libgiofam.so...done. Loaded symbols for /usr/local/lib/gio/modules/libgiofam.so Reading symbols from /usr/local/lib/libfam.so.0...done. Loaded symbols for /usr/local/lib/libfam.so.0 Reading symbols from /libexec/ld-elf.so.1...done. Loaded symbols for /libexec/ld-elf.so.1 [Switching to Thread 0x8125400 (LWP 100093)] 0x282269a9 in _umtx_op () from /lib/libc.so.7 (gdb) bt #0 0x282269a9 in _umtx_op () from /lib/libc.so.7 #1 0x28818e5d in __error () from /lib/libthr.so.3 #2 0x2881b8a0 in _thread_state_running () from /lib/libthr.so.3 #3 0x00000005 in ?? () #4 0x00000000 in ?? () #5 0x00000000 in ?? () #6 0x00000000 in ?? () #7 0x2881a96c in ?? () from /lib/libthr.so.3 #8 0xbfbfcde8 in ?? () #9 0x288150cb in pthread_mutex_destroy () from /lib/libthr.so.3 Previous frame identical to this frame (corrupt stack?) > I suspect there will be some pthreads call on top of the stack. I am not > FreeBSD developer but this seems really similar to situations reported > in thread "umtxn and Apache 2.2" and mine "Process in "uwait" state". > >> >> $ uname -a >> FreeBSD freebsd7 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #15 r184123: >> Tue Oct 21 16:24:59 CEST 2008 >> root@freebsd7:/usr/obj/usr/src/sys/GENERIC i386 >> >> Thanks for your help, >> Regards. >> > > - -- > VH > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.9 (MingW32) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org > > iFYEAREIAAYFAkkJfx8ACgkQhQBMvHf/WHnzuwDffY0A82o1mpzdVBixQ6bjeqon > pLikFIEvlXke3ADeIGmhTjnC5TPnJE01XiiZyPuOcrrgYpXhFzTdPw=3D=3D > =3DKOCn > -----END PGP SIGNATURE----- > Regards. --=20 There's this old saying: "Give a man a fish, feed him for a day. Teach a man to fish, feed him for life." From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 10:03:34 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 37E111065732 for ; Fri, 31 Oct 2008 10:03:34 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 6F7F48FC1D for ; Fri, 31 Oct 2008 10:03:33 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9VA3VnJ029989; Fri, 31 Oct 2008 11:03:31 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9VA3U9Z029988; Fri, 31 Oct 2008 11:03:30 +0100 (CET) (envelope-from olli) Date: Fri, 31 Oct 2008 11:03:30 +0100 (CET) Message-Id: <200810311003.m9VA3U9Z029988@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG, dudu.meyer@gmail.com In-Reply-To: X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Fri, 31 Oct 2008 11:03:32 +0100 (CET) Cc: Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-stable@FreeBSD.ORG, dudu.meyer@gmail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 10:03:34 -0000 Eduardo Meyer wrote: > Now my next problem, do the sabe with sockstat.... I think in earlier days sockstat was just a script that merged the output from netstat and fstat (or maybe some third tool, too, I don't remember). So, you might try to use netstat and fstat instead. Of course it depends on what information you exactly need from the sockstat output (if not all of it). Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "If you aim the gun at your foot and pull the trigger, it's UNIX's job to ensure reliable delivery of the bullet to where you aimed the gun (in this case, Mr. Foot)." -- Terry Lambert, FreeBSD-hackers mailing list. From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 11:02:12 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AC336106567C; Fri, 31 Oct 2008 11:02:12 +0000 (UTC) (envelope-from gerrit@pmp.uni-hannover.de) Received: from mrelay1.uni-hannover.de (mrelay1.uni-hannover.de [130.75.2.106]) by mx1.freebsd.org (Postfix) with ESMTP id 1A3A38FC1B; Fri, 31 Oct 2008 11:02:11 +0000 (UTC) (envelope-from gerrit@pmp.uni-hannover.de) Received: from www.pmp.uni-hannover.de (www.pmp.uni-hannover.de [130.75.117.2]) by mrelay1.uni-hannover.de (8.14.2/8.14.2) with ESMTP id m9VB1uuU006058; Fri, 31 Oct 2008 12:01:58 +0100 Received: from pmp.uni-hannover.de (arc.pmp.uni-hannover.de [130.75.117.1]) by www.pmp.uni-hannover.de (Postfix) with SMTP id 6279A4F; Fri, 31 Oct 2008 12:01:56 +0100 (CET) Date: Fri, 31 Oct 2008 12:01:56 +0100 From: Gerrit =?ISO-8859-1?Q?K=FChn?= To: John Baldwin Message-Id: <20081031120156.94a0d490.gerrit@pmp.uni-hannover.de> In-Reply-To: <200810141312.05094.jhb@freebsd.org> References: <20080807132947.061d24eb.gerrit@pmp.uni-hannover.de> <200810131027.40630.jhb@freebsd.org> <20081014115333.3d3e41ab.gerrit@pmp.uni-hannover.de> <200810141312.05094.jhb@freebsd.org> Organization: Albert-Einstein-Institut (MPI =?ISO-8859-1?Q?f=FCr?= Gravitationsphysik & IGP =?ISO-8859-1?Q?Universit=E4t?= Hannover) X-Mailer: Sylpheed 2.4.8 (GTK+ 2.12.11; i386-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-PMX-Version: 5.4.1.325704, Antispam-Engine: 2.6.0.325393, Antispam-Data: 2008.10.31.104929 Cc: freebsd-stable@freebsd.org, Jeremy Chadwick , d@delphij.net, jeff@freebsd.org Subject: Re: Regression 7.0R -> 7-stable? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 11:02:12 -0000 On Tue, 14 Oct 2008 13:12:04 -0400 John Baldwin wrote about Re: Regression 7.0R -> 7-stable?: Hi, I'm back. Sorry for taking so long with the answer, but I had some holidays and needed to catch up with lots of other things first. JB> Are you sure you aren't using dual consoles somehow with serial being JB> primary? If you break into the loader, what does 'show console' show? Just "vidconsole". JB> > As I am seeing this only with the ULE-scheduler: Is the scheduler JB> > already in action at this point, and may the hang depend on what it JB> > is deciding to do? JB> Hmmm, I'm really not sure. I wonder if you are having some sort of JB> interrupt storm. What if you disable SMP via 'kern.smp.disabled=1' in JB> the loader, does that help at all? Yes, boots up fine with that setting (but naturally running on only one core). cu Gerrit From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 12:37:37 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BF4EE1065695; Fri, 31 Oct 2008 12:37:37 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [91.103.162.4]) by mx1.freebsd.org (Postfix) with ESMTP id 3ADB98FC20; Fri, 31 Oct 2008 12:37:37 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 7525E19E027; Fri, 31 Oct 2008 13:37:35 +0100 (CET) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id C430819E023; Fri, 31 Oct 2008 13:37:31 +0100 (CET) Message-ID: <490AFC2F.7090908@quip.cz> Date: Fri, 31 Oct 2008 13:38:07 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: Jeremy Chadwick References: <48F526BB.6010604@quip.cz> <20081015041749.GA67219@icarus.home.lan> In-Reply-To: <20081015041749.GA67219@icarus.home.lan> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: atacontrol: ioctl(IOCATADEVICES): Device not configured X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 12:37:37 -0000 Jeremy Chadwick wrote: > On Wed, Oct 15, 2008 at 01:09:47AM +0200, Miroslav Lachman wrote: > >>FreeBSD 7.1-BETA amd64 GENERIC on HP ProLiant ML110 G5 >> >>When I tried to run 'atacontrol list' I got an error: >>atacontrol: ioctl(IOCATADEVICES): Device not configured > > > There was a bug in atacontrol which was causing this for most > people, although there's the possibility that this is a new bug. > > See revision 1.43.2.3 below: > > http://www.freebsd.org/cgi/cvsweb.cgi/src/sbin/atacontrol/atacontrol.c > > Can you verify what version of src/sbin/atacontrol/atacontrol.c your > world was built off of? I'm thinking because it was so new (barely > 2 weeks) that it didn't get pulled in during the BETA build, but it > definitely should have gotten pulled in for BETA2. > > ftp://ftp4.freebsd.org/pub/FreeBSD/releases/amd64/ISO-IMAGES/7.1/ Just to close this issue - you are right, today upgrade to BETA2 fixed the atacontrol problem. (I did not have sources installed, it was minimal instalation on USB flashdisk, hence I can't compare revision numbers. The system was successfuly upgraded by 'freebsd-update -r 7.1-BETA2 upgrade') Thanks again for you time and suggestions. >>It is after I switched HDD mode in BIOS to "Serial ATA" (it was "Auto" >>before) >> >>Does it means that atacontrol list is not available for Serial ATA >>native mode? (I don't think so, because I am using atacontrol on another >>machines where disk are at AHCI mode AFAIK - Sun Fire X2100 M2 for >>example) >> >> >>## pciconf -lv >>atapci0@pci0:0:31:2: class=0x01018f card=0x31f4103c chip=0x29208086 >>rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> device = '82801IB/IR/IH (ICH9 Family) 4 port Serial ATA Storage >>Controller 1' >> class = mass storage >> subclass = ATA >>none0@pci0:0:31:3: class=0x0c0500 card=0x31f4103c chip=0x29308086 >>rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> device = '82801IB/IR/IH (ICH9 Family) SMBus Controller' >> class = serial bus >> subclass = SMBus >>atapci1@pci0:0:31:5: class=0x010185 card=0x31f4103c chip=0x29268086 >>rev=0x02 hdr=0x00 >> vendor = 'Intel Corporation' >> device = '82801IB/IR/IH (ICH9 Family) 2 port Serial ATA Storage >>Controller 2' >> class = mass storage >> subclass = ATA >> >>bge0@pci0:14:0:0: class=0x020000 card=0x7051103c chip=0x165a14e4 >>rev=0x00 hdr=0x00 >> vendor = 'Broadcom Corporation' >> device = 'NetXtreme BCM5722 Gigabit Ethernet PCIe' >> class = network >> subclass = ethernet >> >>## BIOS HDD mode: Serial ATA >>## /var/run/dmesg.boog >>atapci0: port >>0x1c50-0x1c57,0x1c44-0x1c47,0x1c48-0x1c4f,0x1c40-0x1c43,0x1c10-0x1c1f,0x1c00-0x1c0f >>irq 17 at device 31.2 on pci0 >>atapci0: [ITHREAD] >>ata2: on atapci0 >>ata2: [ITHREAD] >>ata3: on atapci0 >>ata3: [ITHREAD] >>pci0: at device 31.3 (no driver attached) >>atapci1: port >>0x1c68-0x1c6f,0x1c5c-0x1c5f,0x1c60-0x1c67,0x1c58-0x1c5b,0x1c30-0x1c3f,0x1c20-0x1c2f >>irq 18 at device 31.5 on pci0 >>atapci1: [ITHREAD] >>ata4: on atapci1 >>ata4: [ITHREAD] >>ata5: on atapci1 >>ata5: [ITHREAD] >>[...] >>ad4: 953869MB at ata2-master SATA300 >>ad5: 953869MB at ata2-slave SATA300 >>ad6: 953869MB at ata3-master SATA300 >>ad7: 953869MB at ata3-slave SATA300 >>da0 at umass-sim0 bus 0 target 0 lun 0 >>da0: Removable Direct Access SCSI-0 device >>da0: 40.000MB/s transfers >>da0: 7936MB (16252928 512 byte sectors: 255H 63S/T 1011C) >>acd0: DVDR at ata4-master SATA150 >> >> >>## BIOS HDD mode: Auto >>atapci0: port >>0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1c10-0x1c1f,0x1c00-0x1c0f at >>device 31.2 on pci0 >>ata0: on atapci0 >>ata0: [ITHREAD] >>ata1: on atapci0 >>ata1: [ITHREAD] >>pci0: at device 31.3 (no driver attached) >>atapci1: port >>0x1c68-0x1c6f,0x1c5c-0x1c5f,0x1c60-0x1c67,0x1c58-0x1c5b,0x1c30-0x1c3f,0x1c20-0x1c2f >>irq 18 at device 31.5 on pci0 >>atapci1: [ITHREAD] >>ata2: on atapci1 >>ata2: [ITHREAD] >>ata3: on atapci1 >>ata3: [ITHREAD] >>[...] >>ad0: 953869MB at ata0-master SATA300 >>ad1: 953869MB at ata0-slave SATA300 >>ad2: 953869MB at ata1-master SATA300 >>ad3: 953869MB at ata1-slave SATA300 >>da0 at umass-sim0 bus 0 target 0 lun 0 >>da0: Removable Direct Access SCSI-0 device >>da0: 40.000MB/s transfers >>da0: 7936MB (16252928 512 byte sectors: 255H 63S/T 1011C) >>acd0: DVDR at ata2-master SATA150 >> >> >>The motherboard has 6x SATA ports, 2 are marked "for optical/removable >>drives" and 4 are for HDDs. >>System is booted from USB flash disk. >>It is first time I see SATA devices attached as Master & Slave on same >>ATA channel, previously (on different machines) it was always as Master >>on separated channels. This configuration is worse if I want to utilize >>all drives at the same time (in RAIDZ). One drive can achieve 110MB/s >>read, both drives can achieve only 80MB/s each. ;( >> >>Next strange thing is difference in Interrupts in systat output. With >>mode "Auto', each ATA channel is listed on separated IRQ, with mode >>"Serial ATA" channels are not listed but it seems that both are on the >>same interrupt as bge0. Am I right? So it seems better to not use >>"Serial ATA" mode settings. >> >>## part of systat during read test by 'dd if=/dev/adN of=/dev/null' >>## BIOS HDD mode: Serial ATA >>Interrupts >>8737 total >> uhci0 uhci >>4734 bge0 uhci1 >> uhci2 ehci >>2001 cpu0: time >>2002 cpu1: time >> >>## BIOS HDD mode: Auto >>Interrupts >>9262 total >>2660 ata0 irq14 >>2603 ata1 irq15 >> uhci0 uhci >> 1 bge0 uhci1 >> uhci2 ehci >>1999 cpu0: time >>1999 cpu1: time >> >> >>Let me know if (and what) more details are needed. >> >>Miroslav Lachman From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 12:40:09 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 085C610656B2 for ; Fri, 31 Oct 2008 12:40:09 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.173]) by mx1.freebsd.org (Postfix) with ESMTP id CD1A58FC08 for ; Fri, 31 Oct 2008 12:40:08 +0000 (UTC) (envelope-from dudu.meyer@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so1184185wfg.7 for ; Fri, 31 Oct 2008 05:40:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=sTpTrPaQfsVVihJHOnuzJSKUhv4TfipXrJpsvTEfXhg=; b=E4QoP6Mgg2z5sCI3LRH1Bw6sM+1mCe8Dcbv3anHX0nwXY9lwJbDvabNgmrt5iKZLoU ItNbWwJmF+RB9vjvTiWdmsSR/dn5ZKH5pBFxEG4ztf+kVB3/aAenCEU02y95eh3Tf8i8 94uNjtj7+LMr6s4Et4RvgASwKx7FN2lv7cjDA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=ElxA8IdJqQClDuAy1BTlTDPH9R8w8tovNvPZ/st7ft7auRX11EwokQ267O0wU9tP/b G6DfNdNlc+KSpNIWd36ZrsEiqDpZt/4WuAgTdjhElC6I5NpStQ6+nOiaxEVnip8IhgVl gYX4MrZP8KfTufjBfZD1FTnF/xcrcyonQtf2A= Received: by 10.142.48.3 with SMTP id v3mr5366974wfv.124.1225456808321; Fri, 31 Oct 2008 05:40:08 -0700 (PDT) Received: by 10.142.158.11 with HTTP; Fri, 31 Oct 2008 05:40:08 -0700 (PDT) Message-ID: Date: Fri, 31 Oct 2008 10:40:08 -0200 From: "Eduardo Meyer" To: freebsd-stable@freebsd.org, dudu.meyer@gmail.com In-Reply-To: <200810311003.m9VA3U9Z029988@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <200810311003.m9VA3U9Z029988@lurza.secnetix.de> Cc: Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 12:40:09 -0000 On Fri, Oct 31, 2008 at 8:03 AM, Oliver Fromme wro= te: > Eduardo Meyer wrote: > > Now my next problem, do the sabe with sockstat.... > > I think in earlier days sockstat was just a script that > merged the output from netstat and fstat (or maybe some > third tool, too, I don't remember). So, you might try > to use netstat and fstat instead. Of course it depends > on what information you exactly need from the sockstat > output (if not all of it). > > Best regards > Oliver Right, I can potentially find the sabe information with netstat. I will check if it can be safely parsed. Thank you. > > > -- > Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. > Handelsregister: Registergericht Muenchen, HRA 74606, Gesch=E4ftsfuehrun= g: > secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht M=FC= n- > chen, HRB 125758, Gesch=E4ftsf=FChrer: Maik Bachmann, Olaf Erb, Ralf Geb= hart > > FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd > > "If you aim the gun at your foot and pull the trigger, it's > UNIX's job to ensure reliable delivery of the bullet to > where you aimed the gun (in this case, Mr. Foot)." > -- Terry Lambert, FreeBSD-hackers mailing list. > --=20 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Eduardo Meyer pessoal: dudu.meyer@gmail.com profissional: ddm.farmaciap@saude.gov.br From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 12:40:16 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5FD7910656B2; Fri, 31 Oct 2008 12:40:16 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: from ey-out-2122.google.com (ey-out-2122.google.com [74.125.78.26]) by mx1.freebsd.org (Postfix) with ESMTP id B00BE8FC0C; Fri, 31 Oct 2008 12:40:15 +0000 (UTC) (envelope-from soren.schmidt@gmail.com) Received: by ey-out-2122.google.com with SMTP id 6so414260eyi.7 for ; Fri, 31 Oct 2008 05:40:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:from:to :content-type:content-transfer-encoding:x-mailer:mime-version :subject:date:cc; bh=kEvPZxd+k+7zg3osWPUbIdOvnlcxY9AlySnJKRvbYd0=; b=Tw6DsY/y2eQebXYwGxAAxtT6BNfljrFFuLZyIEbSrbcyZzEzD5BZaAZTjbmcA73jZA lxHjSTBaGuPdlH1M2RkErdt+K4GJa8C+AD7QwOONGewgPiNsRcmnBZt4jxhxRXTG/+VW 5gisXukr03OnM2vknGTTJFTE2KjPKkRC4kPn8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:from:to:content-type:content-transfer-encoding:x-mailer :mime-version:subject:date:cc; b=Kpeax5UMN7frSKOlpo8kdKt6lJI/34g5XtOw27w4NZSvDU4vd8WpWre/x1sC6Hy1dk 9lf+h30PWcrH5tDyyj5RCQBj/yRRj8jftIkCqDN3c1cAd3sDDUK14jQ2SbDVQO2Aazy2 p/eSuFHz4JTu7Jxs6634mdkgMYtRLCrUkKFbY= Received: by 10.210.87.14 with SMTP id k14mr13283872ebb.159.1225456814439; Fri, 31 Oct 2008 05:40:14 -0700 (PDT) Received: from ?192.168.0.250? (adsl.deepcore.dk [87.63.29.106]) by mx.google.com with ESMTPS id 34sm15522117nfu.24.2008.10.31.05.40.12 (version=TLSv1/SSLv3 cipher=RC4-MD5); Fri, 31 Oct 2008 05:40:13 -0700 (PDT) Message-Id: <01D6B57B-E04C-4526-BB62-A04E2017A9AB@gmail.com> From: =?utf-8?Q?S=C3=B8ren_Schmidt?= To: Michael Butler Content-Type: text/plain; charset=utf-8; format=flowed; delsp=yes Content-Transfer-Encoding: quoted-printable X-Mailer: iPhone Mail (5F136) Mime-Version: 1.0 (iPhone Mail 5F136) Date: Fri, 31 Oct 2008 13:40:06 +0100 Cc: Jeremy Chadwick , FreeBSD stable , =?utf-8?Q?S=C3=B8ren_Schmidt?= Subject: Re: ICH7M limited to SATA-150? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 12:40:16 -0000 I'll look into it -S=C3=B8ren -- On 31/10/2008, at 00.00, Michael Butler =20 wrote: > Jeremy Chadwick wrote: > >> On Thu, Oct 30, 2008 at 01:47:48PM -0700, Xin LI wrote: >>> Personally I don't really think ICH7M is capable to do SATA-300. =20= >>> Intel >>> datasheet 307013, page 191 says: >>> >>> Supported Supported >>> 3 Gb/s Transfer Rate >>> (Desktop Only) (Desktop Only) >>> >>> My understanding is that ICH7- *M* does not support SATA-300 at all. >> >> Xin Li is correct -- the mobile version doesn't do SATA300. > > Then there is a correction required to /sys/dev/ata/ata_chipset.c - =20= > mine > identifies itself as: > > atapci0@pci0:0:31:2: class=3D0x010180 card=3D0xff101179 = chip=3D0x27c48086 > rev=3D0x02 hdr=3D0x00 > vendor =3D 'Intel Corporation' > device =3D '82801GBM/GHM (ICH7-M Family) Serial ATA Storage > Controller' > class =3D mass storage > subclass =3D ATA > > .. where 0x27c4 is "legacy" mode and 0x27c5 is AHCI mode, > > Michael > From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 12:45:56 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 09C391065678 for ; Fri, 31 Oct 2008 12:45:56 +0000 (UTC) (envelope-from lopez.on.the.lists@yellowspace.net) Received: from mail.yellowspace.net (mail.yellowspace.net [80.190.200.164]) by mx1.freebsd.org (Postfix) with ESMTP id A4A5A8FC08 for ; Fri, 31 Oct 2008 12:45:55 +0000 (UTC) (envelope-from lopez.on.the.lists@yellowspace.net) Received: from [192.168.178.21] ([85.181.132.237]) (AUTH: CRAM-MD5 lopez.on.the.lists@yellowspace.net, TLS: TLSv1/SSLv3, 128bits, AES128-SHA) by mail.yellowspace.net with esmtp; Fri, 31 Oct 2008 13:45:53 +0100 id 0020009B.00000000490AFE01.00016BDD Message-Id: <45AA3BD6-4892-44E6-B64E-AD93F2C11AB0@yellowspace.net> From: Lorenzo Perone To: Louis Kowolowski In-Reply-To: <1EA86BC6-349F-48DB-A77C-A4D8E00C55B5@cryptomonkeys.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Fri, 31 Oct 2008 13:45:52 +0100 References: <200810220838.45900.fjwcash@gmail.com> <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> <1EA86BC6-349F-48DB-A77C-A4D8E00C55B5@cryptomonkeys.com> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-stable@freebsd.org Subject: Re: ZFS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 12:45:56 -0000 Thanx a lot for sharing :) OK guys that sort of gives some courage to dare a next experiment. I've got one host which has one AMP application and a mailserver running, which I'd like to set up with live zfs goodness (I know that customer would kiss me for having a snapshot history of the mail accounts...), and your posts give me the spark to try this one out. It's nothing high-volume, so summing up Freddies and Your post makes me hope this one won't deadlock too soon. anyway It's a DELL PE 1950 wirth enough ram and, most of all, a DRAC so I can powercycle that one remotely if it does the dance :-> Hope to have good news to report after a few weeks of zfs-entertainment... Thanx a lot and regards... Lorenzo On 31.10.2008, at 03:15, Louis Kowolowski wrote: > On Oct 30, 2008, at 2:55 PM, Lorenzo Perone wrote: >> On 22.10.2008, at 17:38, Freddie Cash wrote: >>> Personally, we use it in production for a remote backup box using >>> ZFS and >>> Rsync (64-bit FreeBSD 7-Stable from August, 2x dual-core Opteron >>> 2200s, 8 >>> GB DDR2 RAM, 24x 500 GB SATA disks attached to two 3Ware 9650/9550 >>> controllers as single-disks). Works beautifully, backing up 80 >>> FreeBSD >>> and Debian Linux servers every night, creating snapshots with each >>> run. >>> Restoring files from an arbitrary day is as simple as navigating >>> to the >>> needed .zfs/snapshot/// and scping the file to >>> wherever. >>> And full system restores are as simple as "boot livecd, partition/ >>> format >>> disks, run rsync". >> >> >> So your system doesn't suffer panics and/or deadlocks, or you just >> cope with them as "collateral damage" (which, admitted, is less of >> a problem with a logging fs)? >> >> If that's the case, would you share the details about what you're >> using >> on that machine (RELENG_7?, 7_0? HEAD?) and which patches >> /knobs You used? I have a similar setup on a host which >> backs up way fewer machines and locks up every... 3-9 weeks or so. >> That host only has about 2GB ram though. >> > I have a system which is sort of similar in production at work. > I have the following tunables (for ZFS) set: > zfs_load="YES" > vm.kmem_size_max="1024M" > vm.kmem_size="1024M" > vfs.zfs.arc_min="16M" > vfs.zfs.arc_max="384M" > > [lkowolowski@release lkowolowski 76 ]$ uname -a > FreeBSD release.pgp.com 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #0: > Wed Sep 3 12:18:57 PDT 2008 root@release.pgp.com:/usr/obj/usr/ > src/sys/GENERIC amd64 > [lkowolowski@release lkowolowski 77 ]$ > > This box has 2G of RAM, and 8.5T in ZFS spread across 8 RAID1 > mirrors in an EonStore Fiber array (direct attach). > > It's been rock solid and stores all of our build collateral. > > -- > Louis Kowolowski louisk@cryptomonkeys.com > Cryptomonkeys: http://www.cryptomonkeys.com/~louisk > > Making life more interesting for people since 1977 > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org > " From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 13:59:01 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2A67D1065673 for ; Fri, 31 Oct 2008 13:59:01 +0000 (UTC) (envelope-from arnaud.houdelette@tzim.net) Received: from golanth.tzim.net (unknown [IPv6:2001:41d0:1:d91f:21c:c0ff:fe4b:cf32]) by mx1.freebsd.org (Postfix) with ESMTP id B62108FC3A for ; Fri, 31 Oct 2008 13:58:58 +0000 (UTC) (envelope-from arnaud.houdelette@tzim.net) Received: from localhost ([127.0.0.1]) by golanth.tzim.net with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1KvuWd-00065k-BE; Fri, 31 Oct 2008 14:58:55 +0100 Message-ID: <490B0F1D.2050606@tzim.net> Date: Fri, 31 Oct 2008 14:58:53 +0100 From: Arnaud Houdelette User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: Louis Kowolowski References: <200810220838.45900.fjwcash@gmail.com> <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> <1EA86BC6-349F-48DB-A77C-A4D8E00C55B5@cryptomonkeys.com> In-Reply-To: <1EA86BC6-349F-48DB-A77C-A4D8E00C55B5@cryptomonkeys.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Authenticated-User: tzim@tzim.net X-Authenticator: plain Cc: Lorenzo Perone , freebsd-stable@freebsd.org Subject: Re: Re: ZFS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 13:59:01 -0000 Louis Kowolowski a écrit : >
On Oct > 30, 2008, at 2:55 PM, Lorenzo Perone wrote: >> On 22.10.2008, at 17:38, Freddie Cash wrote: >>> Personally, we use it in production for a remote backup box using >>> ZFS and >>> Rsync (64-bit FreeBSD 7-Stable from August, 2x dual-core Opteron >>> 2200s, 8 >>> GB DDR2 RAM, 24x 500 GB SATA disks attached to two 3Ware 9650/9550 >>> controllers as single-disks). Works beautifully, backing up 80 FreeBSD >>> and Debian Linux servers every night, creating snapshots with each run. >>> Restoring files from an arbitrary day is as simple as navigating to the >>> needed .zfs/snapshot/// and scping the file to >>> wherever. >>> And full system restores are as simple as "boot livecd, >>> partition/format >>> disks, run rsync". >> >> >> So your system doesn't suffer panics and/or deadlocks, or you just >> cope with them as "collateral damage" (which, admitted, is less of >> a problem with a logging fs)? >> >> If that's the case, would you share the details about what you're using >> on that machine (RELENG_7?, 7_0? HEAD?) and which patches >> /knobs You used? I have a similar setup on a host which >> backs up way fewer machines and locks up every... 3-9 weeks or so. >> That host only has about 2GB ram though. >> > I have a system which is sort of similar in production at work. > I have the following tunables (for ZFS) set: > zfs_load="YES" > vm.kmem_size_max="1024M" > vm.kmem_size="1024M" > vfs.zfs.arc_min="16M" > vfs.zfs.arc_max="384M" > > [lkowolowski@release lkowolowski 76 ]$ uname -a > FreeBSD release.pgp.com 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #0: Wed > Sep 3 12:18:57 PDT 2008 > root@release.pgp.com:/usr/obj/usr/src/sys/GENERIC amd64 > [lkowolowski@release lkowolowski 77 ]$ > > This box has 2G of RAM, and 8.5T in ZFS spread across 8 RAID1 mirrors > in an EonStore Fiber array (direct attach). > > It's been rock solid and stores all of our build collateral. > > -- > Louis Kowolowski louisk@cryptomonkeys.com > Cryptomonkeys: http://www.cryptomonkeys.com/~louisk > > Making life more interesting for people since 1977 > I use ZFS since 7.0-RELEASE. I'm currently using latest stable. Ok the load is not as a production one, as the box is used as a home server (NAS), but the hardware is limited too (only 512MB of RAM, mono-core A64 3200+, motherborad integrated sata controler). I tried to stress the filesystem a bit with multiple simultaneous rsyncs. No glitches. The only failures was when swap was on a zvol instead of the system drive. Even with more ram, it regularely ended in panics or deadlocks (most of the time, deadlocks) under "high" load. Not sure of anything here, but you might want to try with non-zfs swap - on another drive(s) or dedicated slices ? Arnaud Houdelette From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 15:48:28 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B3618106567C for ; Fri, 31 Oct 2008 15:48:28 +0000 (UTC) (envelope-from lopez.on.the.lists@yellowspace.net) Received: from mail.yellowspace.net (mail.yellowspace.net [80.190.200.164]) by mx1.freebsd.org (Postfix) with ESMTP id 461AA8FC08 for ; Fri, 31 Oct 2008 15:48:28 +0000 (UTC) (envelope-from lopez.on.the.lists@yellowspace.net) Received: from five.intranet ([62.216.211.194]) (AUTH: LOGIN lopez.on.the.lists@yellowspace.net) by mail.yellowspace.net with esmtp; Fri, 31 Oct 2008 16:48:26 +0100 id 0020018F.00000000490B28CA.000043E1 Message-Id: From: Lorenzo Perone To: Arnaud Houdelette In-Reply-To: <490B0F1D.2050606@tzim.net> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Fri, 31 Oct 2008 16:48:25 +0100 References: <200810220838.45900.fjwcash@gmail.com> <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> <1EA86BC6-349F-48DB-A77C-A4D8E00C55B5@cryptomonkeys.com> <490B0F1D.2050606@tzim.net> X-Mailer: Apple Mail (2.929.2) Cc: Louis Kowolowski , freebsd-stable@freebsd.org Subject: Re: ZFS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 15:48:28 -0000 > I use ZFS since 7.0-RELEASE. I'm currently using latest stable. > Ok the load is not as a production one, as the box is used as a home > server (NAS), but the hardware is limited too (only 512MB of RAM, > mono-core A64 3200+, motherborad integrated sata controler). > I tried to stress the filesystem a bit with multiple simultaneous > rsyncs. No glitches. The only failures was when swap was on a zvol > instead of the system drive. Even with more ram, it regularely ended > in panics or deadlocks (most of the time, deadlocks) under "high" > load. > > Not sure of anything here, but you might want to try with non-zfs > swap - on another drive(s) or dedicated slices ? Yep, I think I'm going to use a separate slice for the pool, mounting into the respective jails only the needed filesystems: mypool/mail into /jails/mail/maildataroot mypool/db into /jails/web/mysql-bup-slave (or sort of) and then use frequent snapshots for mypool/mail (even hourly or so), and for the database, a few times per day mysql-backup-slave.sh stop, zfs snapshot mypool/db, mysql-backup-slave.sh start.. the mysql slave snapshotting is really a goodness which I've used on a SunOS with zfs and really rocks. So I never shutdown the master, the slave goes down only a few seconds, and the database filesystem is consistent and synced. In the current case, I think it is not only a feature but also a must: _If_ the host deadlocks and mysql fails to sync, at least I have a working snapshot of the data. I wouldn't put the master itself on zfs for now, but if all goes well for a while, why not. BTW: while sync does not work anymore in a deadlock situation, I've seen that fsync mostly still does. So something like find /var/db/mysql -type f -exec fsync {} \; can save your files if the db is running on UFS.. Thanx & Regards! Lorenzo From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 17:33:15 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9A5FE106567A for ; Fri, 31 Oct 2008 17:33:15 +0000 (UTC) (envelope-from shoesoft@gmx.net) Received: from mail.gmx.net (mail.gmx.net [213.165.64.20]) by mx1.freebsd.org (Postfix) with SMTP id DC4A08FC22 for ; Fri, 31 Oct 2008 17:33:14 +0000 (UTC) (envelope-from shoesoft@gmx.net) Received: (qmail invoked by alias); 31 Oct 2008 17:33:12 -0000 Received: from 85-127-86-101.dynamic.xdsl-line.inode.at (EHLO taxman.pepperland) [85.127.86.101] by mail.gmx.net (mp032) with SMTP; 31 Oct 2008 18:33:12 +0100 X-Authenticated: #16703784 X-Provags-ID: V01U2FsdGVkX1/t4zEcF/vtd9K3e0HW508ezcoiUzEL2Dkatno7PO h2p2ssmAZ/lVsF From: Stefan Ehmann To: freebsd-stable@freebsd.org Date: Fri, 31 Oct 2008 18:33:09 +0100 User-Agent: KMail/1.10.1 (FreeBSD/7.1-PRERELEASE; KDE/4.1.2; i386; ; ) MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200810311833.09951.shoesoft@gmx.net> X-Y-GMX-Trusted: 0 X-FuHaFi: 0.61 Subject: CPU utilization calculation broken with SCHED_ULE and dummynet X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 17:33:15 -0000 Already posted this earlier this month and filed as kern/128177. Short summary: top/ps displays 0% instead of 100% CPU usage for CPU-intensive processes. single-threaded process on single-CPU i386 machine. I think this also negatively effects scheduling decisions but haven't found a good way to test this. I did some more investigations today: The problem only occurs when the dummynet module is loaded. If I unload the module everything seems fine. It's enough if the module is loaded, no rules involving dummynet are needed. If I revert 1.214.2.7 (SVN rev 183294) the problem is gone. Already noted earlier: I don't see the problem in CURRENT on the same machine. This might be due to different configurations though. If I run the process with idletime priority, I don't see the problem either. SCHED_4BSD is not affected. Hope these findings help fixing the problem. Thanks, Stefan From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 17:57:30 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 811AC1065687 for ; Fri, 31 Oct 2008 17:57:30 +0000 (UTC) (envelope-from fbsdq@peterk.org) Received: from poshta.pknet.net (poshta.pknet.net [216.241.167.213]) by mx1.freebsd.org (Postfix) with SMTP id 251D68FC12 for ; Fri, 31 Oct 2008 17:57:30 +0000 (UTC) (envelope-from fbsdq@peterk.org) Received: (qmail 14675 invoked from network); 31 Oct 2008 17:30:48 -0000 Received: from poshta.pknet.net (HELO mail.pknet.net) (216.241.167.213) by poshta.pknet.net with SMTP; 31 Oct 2008 17:30:48 -0000 Received: from 216.241.167.212 (SquirrelMail authenticated user fbsdq@peterk.org) by webmail.pknet.net with HTTP; Fri, 31 Oct 2008 11:30:48 -0600 (MDT) Message-ID: <64567.216.241.167.212.1225474248.squirrel@webmail.pknet.net> Date: Fri, 31 Oct 2008 11:30:48 -0600 (MDT) From: "Peter" To: "Eduardo Meyer" User-Agent: SquirrelMail/1.4.11 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal Cc: freebsd-stable@freebsd.org Subject: Re: Script-friendly (parseble) ps(1) output? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 17:57:30 -0000 >Hello, > >I need to write a cgi script which will print the output from ps(1) in >a table (html), so the average-operator can click on a KILL link and >the cgi will send the selected signal. > >I need to add one ps information per column in a table (html), >however, I found ps(1) output to be too hard to parse. There is no >separator. I believed \t was the separator but its not. > >The ps(1) command I need to use is: > >ps -ax -o pid -o user -o emul -o lstart -o lockname -o stat -o command > >Since many of those args use [:space:] in the output, I can not use >[:space:] as a separator. >Sadly, `-o fiend='value'` will only format the HEADER output, not the >values. >Ive got no clue what to do, can someone enlight me? >Thank you all in advance. -- >=========== >Eduardo Meyer >pessoal: dudu.meyer@gmail.com >profissional: ddm.farmaciap@saude.gov.br Here is something simple, and you can wrap the HTML around it...; poshta:$ps axuww | while read USER PID CPU MEM VSZ RSS TT STAT STARTED TIME COMMAND; do echo $PID $CPU $USER $COMMAND;done |head -3 PID %CPU USER COMMAND 11 89.6 root [idle] 5127 2.9 qscand spamd child (perl5.8.8) the read ignores all white space...the last variable in that 'while read' will hold everything beyond it... ie; poshta:$ps axuww| while read USER PID CPU MEM VSZ RSS TT STAT STARTED TIME; do echo $PID $CPU $USER $TIME;done |head -3 PID %CPU USER TIME COMMAND 11 77.9 root 138080:11.91 [idle] 13607 5.0 qscand 0:09.12 spamd child (perl5.8.8) etc.etc... ]Peter[ From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 22:03:21 2008 Return-Path: Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4AC34106564A for ; Fri, 31 Oct 2008 22:03:21 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (unknown [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id B86008FC14 for ; Fri, 31 Oct 2008 22:03:20 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id m9VM3IXn060908; Fri, 31 Oct 2008 23:03:19 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id m9VM3Iff060907; Fri, 31 Oct 2008 23:03:18 +0100 (CET) (envelope-from olli) Date: Fri, 31 Oct 2008 23:03:18 +0100 (CET) Message-Id: <200810312203.m9VM3Iff060907@lurza.secnetix.de> From: Oliver Fromme To: freebsd-stable@FreeBSD.ORG, me@janh.de In-Reply-To: <490A1F15.5060008@janh.de> X-Newsgroups: list.freebsd-stable User-Agent: tin/1.8.3-20070201 ("Scotasay") (UNIX) (FreeBSD/6.4-PRERELEASE-20080904 (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Fri, 31 Oct 2008 23:03:19 +0100 (CET) Cc: Subject: Re: LevelOne WPC-0301 11g Wireless CardBus X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 22:03:21 -0000 Jan Henrik Sylvester wrote: > Oliver wrote: > > I bought a LevelOne WPC-0301 11g Wireless CardBus Adapter > > today. According to the box it is "v6". The ral(4) man- > > page mentions only v2, but that one is ancient and can't > > be bought anymore. > > I do not know about the WPC-0301, but I since I bought a wrong WNC-0301 > (PCI version), I did some research looking at the IDs and additionally > Windows drivers: v.1 is Marvel, v.2 is the old Ralink, v.3 is the never > Ralink, and v.5 (and v.6?) is RealTek. (v.4 does not have a Windows > driver at the LevelOne homepage.) > > BTW: I did summit this info to http://linux-wless.passys.nl/ -- it is a > pretty good overview, especially if you want to check which vendors > switch chipset manufacturers from one revision to the next. > > My guess would be that you are out of luck, if it is not detected at > 7-STABLE. Look at the sys files in the Windows driver, if there is one. > Of course, you can try ndis, but I would not go for it. > > If you shop for a card, most of the 108Mbps are Atheros, which works > better than Ralink in my experience. Since you are from Germany, too: > geizhals.at lists TP-Link TL-WN610G for less than 15 Euros, which has an > Atheros chipset according to the site I mentioned above. If you are > looking on Ebay, I can really recommend Philips SNN6500, which does > a/b/g and the proprietary Atheros stuff (TURBOP, BURST). Thank you for the comments and the URL! Fortunately, the guy at the shop (*) took the card back without asking any questions and replaced it with an Atheros-based 108Mbps card (LeveOne WPC-0300). This card seems to work. I haven't tried to connect to an actual AP yet (will do that on my next trip), but at least the card is detected when plugged in and attaches as ath0, and "list scan" returns some output (probably the APs from neighbors). However, a simple "ifconfig ath0 scan" never terninates. I have to press ^C. Is this normal? Also, my X session froze after the card was plugged in for about 20 minutes (but it was not in use, i.e. not connected to an AP). Removing the card solved it. I hope this was just an accidental hiccup. Best regards Oliver (*) For anybody near Munich, I can recommend the shop "NB Computer" (Schillerstr. near Hbf). Friendly people and good prices. (I'm not in any way associated with them nor benefit from recommending them. Just a happy customer.) -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "FreeBSD is Yoda, Linux is Luke Skywalker" -- Daniel C. Sobral From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 22:41:36 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DF2C310656A6 for ; Fri, 31 Oct 2008 22:41:36 +0000 (UTC) (envelope-from onemda@gmail.com) Received: from rn-out-0910.google.com (rn-out-0910.google.com [64.233.170.184]) by mx1.freebsd.org (Postfix) with ESMTP id 90C738FC16 for ; Fri, 31 Oct 2008 22:41:36 +0000 (UTC) (envelope-from onemda@gmail.com) Received: by rn-out-0910.google.com with SMTP id j71so1174207rne.12 for ; Fri, 31 Oct 2008 15:41:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=hIJD5jo9xJIlxds0yQG4tuOkA1TpnNpVUO5JKZOep+8=; b=vWpPPr9nguWkPPbBiIMbhYizXmwrOtZyv9rzFXMLBls5djv0s1VJNuIgxDfNY43bfA k91k52OPwc3tLiZoJM7B321b8seqeM/33bxm5sID+AnF9iTQYIylkj0XBEQukUYMlK5T oAGOHgDFMXC8wL80pQFSG7EvwvuPUUoWL3iUo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=nL9f4CS7zTMnQ2CB2L6MlxNney0VMCY2e+a4Zcvcoc5i0hVnveoxCtdHWiuHI1V4zX RplsUcDZcGK1MouX9K9iG7aglP0Wez7uHPJAikJAc92839bIif6Riz1yS2NPFu5Ihcrt xgmLygXRAvdSfxoknD8ynGGIaG1iVDkesL0ZE= Received: by 10.231.10.140 with SMTP id p12mr2919791ibp.35.1225492894449; Fri, 31 Oct 2008 15:41:34 -0700 (PDT) Received: by 10.231.11.72 with HTTP; Fri, 31 Oct 2008 15:41:34 -0700 (PDT) Message-ID: <3a142e750810311541k3fb41e51h207e06f328a1f578@mail.gmail.com> Date: Fri, 31 Oct 2008 23:41:34 +0100 From: "Paul B. Mahol" To: "Oliver Fromme" In-Reply-To: <200810312203.m9VM3Iff060907@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <490A1F15.5060008@janh.de> <200810312203.m9VM3Iff060907@lurza.secnetix.de> Cc: me@janh.de, freebsd-stable@freebsd.org Subject: Re: LevelOne WPC-0301 11g Wireless CardBus X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 22:41:37 -0000 On 10/31/08, Oliver Fromme wrote: > However, a simple "ifconfig ath0 scan" never terninates. > I have to press ^C. Is this normal? FYI, if you set card to manual roaming, that simple command will work. In other scenarios "ifconfig ath0 list scan" works. From owner-freebsd-stable@FreeBSD.ORG Sat Nov 1 06:42:35 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 84946106564A; Sat, 1 Nov 2008 06:42:35 +0000 (UTC) (envelope-from aragon@phat.za.net) Received: from mail.geek.sh (decoder.geek.sh [196.36.198.81]) by mx1.freebsd.org (Postfix) with ESMTP id 213DA8FC08; Sat, 1 Nov 2008 06:42:34 +0000 (UTC) (envelope-from aragon@phat.za.net) Received: by mail.geek.sh (Postfix, from userid 1000) id B678324D22; Sat, 1 Nov 2008 08:42:32 +0200 (SAST) Date: Sat, 1 Nov 2008 08:42:32 +0200 From: Aragon Gouveia To: Jeremy Chadwick Message-ID: <20081101064232.GA36710@phat.za.net> References: <200810230627.46478.freebsd-stable@dino.sk> <209111CB-326D-4758-80B2-2505CAE9BCDF@netconsonance.com> <20081025003750.GA42077@phat.za.net> <20081025012148.GA48297@icarus.home.lan> <20081025014218.GA47549@phat.za.net> <20081025080945.GA55413@icarus.home.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081025080945.GA55413@icarus.home.lan> User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 4.10-RELEASE-p2 i386 Cc: freebsd-stable Stable Subject: Re: 6.4 RC1 locks up solid on first reboot X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Nov 2008 06:42:35 -0000 Hi, | By Jeremy Chadwick | [ 2008-10-25 10:09 +0200 ] > Anything is possible. Can you please rebuild your system, and the > bootstraps (and don't forget to install them; bsdlabel -B ), > without messing with optimisation flags? I just upgraded to 7.1 today. No luck, even with loader compiled without optimisations, it is still unstable on my system for some reason. No biggie for me, but possibly worthy of investigation if others have similar problems. (my hardware is quite new still) I'm more than open to help troubleshoot this further if you (or anyone) has any ideas on what to try next. Regards, Aragon From owner-freebsd-stable@FreeBSD.ORG Sat Nov 1 07:39:40 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DB17A1065677; Sat, 1 Nov 2008 07:39:40 +0000 (UTC) (envelope-from aragon@phat.za.net) Received: from mail.geek.sh (decoder.geek.sh [196.36.198.81]) by mx1.freebsd.org (Postfix) with ESMTP id 6F8078FC2D; Sat, 1 Nov 2008 07:39:40 +0000 (UTC) (envelope-from aragon@phat.za.net) Received: by mail.geek.sh (Postfix, from userid 1000) id 3383A24D22; Sat, 1 Nov 2008 09:39:39 +0200 (SAST) Date: Sat, 1 Nov 2008 09:39:39 +0200 From: Aragon Gouveia To: Jeremy Chadwick Message-ID: <20081101073939.GA41841@phat.za.net> References: <200810230627.46478.freebsd-stable@dino.sk> <209111CB-326D-4758-80B2-2505CAE9BCDF@netconsonance.com> <20081025003750.GA42077@phat.za.net> <20081025012148.GA48297@icarus.home.lan> <20081025014218.GA47549@phat.za.net> <20081025080945.GA55413@icarus.home.lan> <20081101064232.GA36710@phat.za.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081101064232.GA36710@phat.za.net> User-Agent: Mutt/1.4i X-Operating-System: FreeBSD 4.10-RELEASE-p2 i386 Cc: freebsd-stable Stable Subject: Re: 6.4 RC1 locks up solid on first reboot X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Nov 2008 07:39:41 -0000 | By Aragon Gouveia | [ 2008-11-01 08:43 +0200 ] > > Anything is possible. Can you please rebuild your system, and the > > bootstraps (and don't forget to install them; bsdlabel -B ), > > without messing with optimisation flags? > > I just upgraded to 7.1 today. No luck, even with loader compiled without > optimisations, it is still unstable on my system for some reason. No > biggie for me, but possibly worthy of investigation if others have similar > problems. (my hardware is quite new still) > > I'm more than open to help troubleshoot this further if you (or anyone) has > any ideas on what to try next. Quick (progressive) update! I thought I'd see how loader behaves on my various boot CDs. My 7.0-RELEASE discs both work fine - loader doesn't freeze. My 7.1-BETA2 disc's loader behaves the same as the loader I compile. I've copied the loader binary from one of the 7.0-RELEASE discs onto my system and it works great just like that, and no more freezing. Perhaps a change that happened in RELENG_7 after 7.0-RELEASE is causing this? I've been experiencing it since my RELENG_7 checkout in May this year. Regards, Aragon From owner-freebsd-stable@FreeBSD.ORG Sat Nov 1 19:06:08 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D8D7F106567A for ; Sat, 1 Nov 2008 19:06:08 +0000 (UTC) (envelope-from torfinn.ingolfsen@broadpark.no) Received: from osl1smout1.broadpark.no (osl1smout1.broadpark.no [80.202.4.58]) by mx1.freebsd.org (Postfix) with ESMTP id 936848FC26 for ; Sat, 1 Nov 2008 19:06:08 +0000 (UTC) (envelope-from torfinn.ingolfsen@broadpark.no) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII Received: from osl1sminn1.broadpark.no ([80.202.4.59]) by osl1smout1.broadpark.no (Sun Java(tm) System Messaging Server 6.3-3.01 (built Jul 12 2007; 32bit)) with ESMTP id <0K9O002IT5265I40@osl1smout1.broadpark.no> for freebsd-stable@freebsd.org; Sat, 01 Nov 2008 20:06:06 +0100 (CET) Received: from kg-work2.kg4.no ([80.202.173.243]) by osl1sminn1.broadpark.no (Sun Java(tm) System Messaging Server 6.3-3.01 (built Jul 12 2007; 32bit)) with SMTP id <0K9O00HLO526IVC1@osl1sminn1.broadpark.no> for freebsd-stable@freebsd.org; Sat, 01 Nov 2008 20:06:06 +0100 (CET) Date: Sat, 01 Nov 2008 20:06:06 +0100 From: Torfinn Ingolfsen To: freebsd-stable@freebsd.org Message-id: <20081101200606.e50b5dbc.torfinn.ingolfsen@broadpark.no> In-reply-to: <20081003083443.GD71518@cdnetworks.co.kr> References: <20080921215704.eca7300b.torfinn.ingolfsen@broadpark.no> <20080922021022.GC26294@cdnetworks.co.kr> <20081002222542.849d5481.torfinn.ingolfsen@broadpark.no> <20081003083443.GD71518@cdnetworks.co.kr> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; i386-portbld-freebsd7.0) X-Face: "t9w2,-X@O^I`jVW\sonI3.,36KBLZE*AL[y9lL[PyFD*r_S:dIL9c[8Y>V42R0"!"yb_zN,f#%.[PYYNq; m"_0v; ~rUM2Yy!zmkh)3&U|u!=T(zyv,MHJv"nDH>OJ`t(@mil461d_B'Uo|'nMwlKe0Mv=kvV?Nh@>Hb<3s_z2jYgZhPb@?Wi^x1a~Hplz1.zH Cc: pyunyh@gmail.com Subject: Re: FreeBSD 6.5-prerelease and if_re - patches needed? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Nov 2008 19:06:08 -0000 On Fri, 03 Oct 2008 17:34:43 +0900 Pyun YongHyeon wrote: > Maybe you can use if_re.c/if_rlreg.h in RELENG_7 with minor > modification. I have tried that now. Unfortunately, the differences were too many - I never managed to get it to compile. Has anyone else created pathes for if_re for RELENG_6? -- Regards, Torfinn Ingolfsen