From owner-freebsd-hackers@FreeBSD.ORG Sun Aug 30 15:40:19 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E24A410656CF for ; Sun, 30 Aug 2009 15:40:18 +0000 (UTC) (envelope-from junichi@junichi.org) Received: from niseko.junichi.org (niseko.v6.junichi.org [IPv6:2001:268:313::53:2]) by mx1.freebsd.org (Postfix) with ESMTP id 2DD7D8FC1D for ; Sun, 30 Aug 2009 15:40:17 +0000 (UTC) Received: from norn.pn.junichi.org (norn.junichi.org [IPv6:2001:268:313:1000:220:edff:fe61:47d]) by niseko.junichi.org (8.14.3/8.14.3/niseko) with ESMTP id n7UFeFp2065299 for ; Mon, 31 Aug 2009 00:40:15 +0900 (JST) (envelope-from junichi@junichi.org) Received: from localhost (localhost.pn.junichi.org [127.0.0.1]) by norn.pn.junichi.org (8.14.1/8.13.8) with ESMTP id n7UFeFVp001953 for ; Mon, 31 Aug 2009 00:40:15 +0900 (JST) (envelope-from junichi@junichi.org) Date: Mon, 31 Aug 2009 00:40:15 +0900 (JST) Message-Id: <20090831.004015.74756379.junichi@junichi.org> To: freebsd-hackers@freebsd.org From: Junichi Satoh X-Mailer: Mew version 5.2 on Emacs 21.3 / Mule 5.0 (SAKAKI) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: Frequency and core voltage adjustment for AMD CPUs. X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Aug 2009 15:40:19 -0000 Hello, I did functionality expansion of cpufreq driver for AMD CPUs, "powernow.c" and "hwpstate.c". It can change frequency and core voltage from default in each P-states by definition of device.hints. Patch file against cpufreq driver: http://configure.sh/FreeBSD/cpufreq.html http://configure.sh/FreeBSD/cpufreq-j.html (Japanese) At least, it works well with my FreeBSD box, HP ProLiant ML115 G5. But, I don't know whether it works with other hardwares. Can anyone test this patch? Any comments and suggestions are welcome. - How to change frequency or core voltage. Define difference value from default in /boot/device.hints as follows. hint.{drivername}.0.adjfreq=XXX CPU frequency(MHz) of difference from default in all P-states. hint.{drivername}.0.adjfreqN=XXX CPU frequency(MHz) of difference from default in P-state N. hint.{drivername}.0.adjvcore=XXX CPU core voltage(mV) of difference from default in all P-states. hint.{drivername}.0.adjvcoreN=XXX CPU core voltage(mV) of difference from default in P-state N. *{drivername} is "powernow" or "hwpstate". Frequency and core voltage can be defined by an arbitrary value, but it is adjusted automatically by the nearest value that CPU allows. For example, the driver sets +100MHz if you define "adjfreq=110" when frequency step that specified by CPU is 100MHz. - Example 1 OS : FreeBSD 8.0-BETA2 H/W: HP ProLiant ML115 G5 CPU: Athlon 1640B (2.7GHz) /boot/device.hints: ======================================================================== hint.powernow.0.adjvcore="-200" -> Core voltage is set to -200mV from default in all P-states. hint.powernow.0.adjfreq="-100" -> Frequency is set to -100MHz from default in all P-states. hint.powernow.0.adjfreq0="0 -> Frequency is set to default in P-state0. ======================================================================== dmesg: ======================================================================== Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-BETA2 #56: Sun Aug 23 10:34:37 JST 2009 junichi@shiga.pn.junichi.org:/usr/src/sys/amd64/compile/SHIGA WARNING: WITNESS option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Athlon(tm) Processor 1640B (2700.02-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x70ff2 Stepping = 2 Features=0x78bfbff Features2=0x2001 AMD Features=0xea500800 AMD Features2=0x11d real memory = 2147483648 (2048 MB) avail memory = 4105457664 (3915 MB) ACPI APIC Table: ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of fec00000, 1000 (3) failed acpi0: reservation of fee00000, 1000 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x2008-0x200b on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 25000000 Hz quality 900 .... cpu0: on acpi0 powernow0: on cpu0 powernow0: P-state0: 2700MHz->2700MHz, 1350mV->1150mV powernow0: P-state1: 2600MHz->2500MHz, 1325mV->1125mV powernow0: P-state2: 2400MHz->2300MHz, 1275mV->1075mV powernow0: P-state3: 2200MHz->2100MHz, 1225mV->1025mV powernow0: P-state4: 2000MHz->1900MHz, 1175mV->975mV powernow0: P-state5: 1800MHz->1700MHz, 1125mV->925mV powernow0: P-state6: 1000MHz->900MHz, 1100mV->900mV ... ======================================================================== Result of "sysctl dev.cpu.0.freq_levels": ======================================================================== dev.cpu.0.freq_levels: 2700/50000 2500/46381 2300/39643 2100/33545 1900/28057 1700/23148 900/12249 ======================================================================== - Example 2 OS: FreeBSD 8.0-BETA3 H/W: HP ProLiant ML115 G5 CPU: Phenom 9850 Black Edition (2.5GHz) /boot/device.hints: ======================================================================== hint.hwpstate.0.adjfreq0="200" -> Frequency is set to +200MHz(over clock) from default in P-state0. hint.hwpstate.0.adjfreq1="-350" -> Frequency is set to -350MHz from default in P-state1. hint.hwpstate.0.adjvcore1="-175" -> Core voltage is set to -175mV from default in P-state1. ======================================================================== dmesg: ======================================================================== Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-BETA3 #0: Mon Aug 24 23:29:36 JST 2009 junichi@shiga.pn.junichi.org:/usr/src/sys/amd64/compile/SHIGA WARNING: WITNESS option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Phenom(tm) 9850 Quad-Core Processor (2500.02-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 5100273664 (4864 MB) avail memory = 4105482240 (3915 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of fec00000, 1000 (3) failed acpi0: reservation of fee00000, 1000 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x2008-0x200b on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 25000000 Hz quality 900 ... cpu0: on acpi0 hwpstate0: P-state0: 2500MHz->2700MHz, 1300mV->1300mV hwpstate0: P-state1: 1250MHz->900MHz, 1050mV->875mV hwpstate0: on cpu0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 ... ======================================================================== Result of "sysctl dev.cpu.0.freq_levels": ======================================================================== dev.cpu.0.freq_levels: 2700/30940 900/1848 ======================================================================== --- Junichi Satoh From owner-freebsd-hackers@FreeBSD.ORG Mon Aug 31 10:18:58 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0DA46106566C for ; Mon, 31 Aug 2009 10:18:58 +0000 (UTC) (envelope-from brampton@gmail.com) Received: from ey-out-2122.google.com (ey-out-2122.google.com [74.125.78.24]) by mx1.freebsd.org (Postfix) with ESMTP id 9AFEC8FC35 for ; Mon, 31 Aug 2009 10:18:57 +0000 (UTC) Received: by ey-out-2122.google.com with SMTP id 4so995773eyf.9 for ; Mon, 31 Aug 2009 03:18:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:date :x-google-sender-auth:message-id:subject:from:to:content-type; bh=ihdEnbiM2Gr+pbtDb0OPjBHjNVcude2iM167o1PpaUQ=; b=qiQc3/iUAiWTR6g65C+ypf7rSUGbzUziT+sc7oMtU9ZFwZlhxoryHr8Wr/AKJT4SlY E974KXBldr0pGjNuCNCnSOggLZm4Hg5UcE1DBVARFsAFm0BT0tXnO3vSJphI++BH1SVA SBKy8305k/wsKzKqt4rPojcaXIr/gIm+0IWec= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:date:x-google-sender-auth:message-id:subject :from:to:content-type; b=JmSFdN4o3/q3cC15Tkgpq8prV1EvRCFHfFaUl2BDTciCpPcpyaBIVsHkfkkD8AIpLU YIV+pYVi2Mb6gXBotD4Zv5Z2mFLbiai/b+kOiruoL5jKn/KvzXQudOALAZGkVFa+ElYS NLUh/qa6o9M936+kj32LxKy2WgL6pfCP5Nm78= MIME-Version: 1.0 Sender: brampton@gmail.com Received: by 10.216.11.207 with SMTP id 57mr1105535wex.154.1251713936588; Mon, 31 Aug 2009 03:18:56 -0700 (PDT) Date: Mon, 31 Aug 2009 11:18:56 +0100 X-Google-Sender-Auth: 4c08602bf3e30d9b Message-ID: From: Andrew Brampton To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=UTF-8 Subject: netstat -i Ierrs column, Is it total, or per second? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2009 10:18:58 -0000 Hi FreeBSD-Hackers, netstat -i will print out statistics for each interface, including input/output packets, input/output bytes, and input/output errors. Now packets and bytes columns seem to be absolute counts, whereas the errors column seems to be a count over the last second. For example, when I am filling a link (and then stop), I get output like so: Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll ix0 9000 00:1b:21:20:f9:07 12687951213 432913 1 0 0 ix0 9000 00:1b:21:20:f9:07 12691545431 435439 1 0 0 ix0 9000 00:1b:21:20:f9:07 12692054413 434735 1 0 0 ix0 9000 00:1b:21:20:f9:07 12696499228 300785 1 0 0 ix0 9000 00:1b:21:20:f9:07 12696499228 0 1 0 0 As you can see the "Ipkts" value continues to rise, but the "Ierrs" goes up and down, eventually falling to zero. So my question is, should this "Ierrs" count be per second?, if so how can I change this behaviour. I looked at the source code for the driver (ixgbe) and the OS, looking for every reference to ifp->if_ierrors, but I didn't find anything that reset this value over time. I also tried a similar experiment with the e1000 driver but I couldn't get that interface to list any errors. I'm running these tests on FreeBSD 8.0-Beta3, but I observed the same behaviour on FreeBSD 7.2. Thanks Andrew From owner-freebsd-hackers@FreeBSD.ORG Mon Aug 31 10:40:57 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6144B1065670 for ; Mon, 31 Aug 2009 10:40:57 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id 3997C8FC17 for ; Mon, 31 Aug 2009 10:40:57 +0000 (UTC) Received: from fledge.watson.org (fledge.watson.org [65.122.17.41]) by cyrus.watson.org (Postfix) with ESMTPS id D812746B06; Mon, 31 Aug 2009 06:40:56 -0400 (EDT) Date: Mon, 31 Aug 2009 11:40:56 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: =?ISO-8859-15?Q?Dag-Erling_Sm=F8rgrav?= In-Reply-To: <868wh663vi.fsf@ds4.des.no> Message-ID: References: <9527461a0908260656w570f6cdha72e92b267e5354f@mail.gmail.com> <868wh663vi.fsf@ds4.des.no> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="621616949-282914110-1251715256=:68412" Cc: bert wiley , freebsd-hackers@freebsd.org Subject: Re: Need some help understanding a jail system call. X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2009 10:40:57 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --621616949-282914110-1251715256=:68412 Content-Type: TEXT/PLAIN; charset=utf-8; format=flowed Content-Transfer-Encoding: 8BIT On Wed, 26 Aug 2009, Dag-Erling Smørgrav wrote: >> Here is the link i used to find this code >> http://www.watson.org/~robert/freebsd/jailng/ > > You realize that this is eight years old, right? And that the jail > infrastructure has been extensively modified since then, and is currently > being rewritten again? As DES points out, that jail work has been superceded by other, more interesting, work in the base tree. My suggestion would be to read the jail(2) man page, both the current 7.x version, and the forthcoming 8.x version which has been substantially enhanced, and disregard the jailng page. I should more clearly mark it as being of historic interest only. Robert N M Watson Computer Laboratory University of Cambridge --621616949-282914110-1251715256=:68412-- From owner-freebsd-hackers@FreeBSD.ORG Mon Aug 31 11:18:27 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 420A91065694 for ; Mon, 31 Aug 2009 11:18:27 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from lo.gmane.org (lo.gmane.org [80.91.229.12]) by mx1.freebsd.org (Postfix) with ESMTP id 018F08FC24 for ; Mon, 31 Aug 2009 11:18:26 +0000 (UTC) Received: from list by lo.gmane.org with local (Exim 4.50) id 1Mi4tz-00026p-Un for freebsd-hackers@freebsd.org; Mon, 31 Aug 2009 13:18:23 +0200 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 31 Aug 2009 13:18:23 +0200 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 31 Aug 2009 13:18:23 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Ivan Voras Date: Mon, 31 Aug 2009 13:18:02 +0200 Lines: 6 Message-ID: Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.22 (X11/20090817) Sender: news Subject: UFS block writing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2009 11:18:27 -0000 Does UFS do full-block writes? Always or only in specific circumstances? For example, if a UFS file system is created with the 16/2 block/fragment size, and a small random write (e.g. 512 bytes) comes in the middle of a larger file, will UFS read in the whole 16k block, modify it and write it out? What about fragments? From owner-freebsd-hackers@FreeBSD.ORG Mon Aug 31 12:23:57 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8335E1065670; Mon, 31 Aug 2009 12:23:57 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id 54DA68FC28; Mon, 31 Aug 2009 12:23:57 +0000 (UTC) Received: from bigwig.baldwin.cx (66.111.2.69.static.nyinternet.net [66.111.2.69]) by cyrus.watson.org (Postfix) with ESMTPSA id AB0ED46B2D; Mon, 31 Aug 2009 08:23:56 -0400 (EDT) Received: from jhbbsd.hudson-trading.com (unknown [209.249.190.8]) by bigwig.baldwin.cx (Postfix) with ESMTPA id CB80F8A02E; Mon, 31 Aug 2009 08:23:55 -0400 (EDT) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Mon, 31 Aug 2009 08:04:27 -0400 User-Agent: KMail/1.9.7 References: In-Reply-To: MIME-Version: 1.0 Content-Disposition: inline Message-Id: <200908310804.27417.jhb@freebsd.org> Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0.1 (bigwig.baldwin.cx); Mon, 31 Aug 2009 08:23:55 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.95.1 at bigwig.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-1.3 required=4.2 tests=AWL,BAYES_00,RDNS_NONE autolearn=no version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on bigwig.baldwin.cx Cc: jfv@FreeBSD.org, Andrew Brampton Subject: Re: netstat -i Ierrs column, Is it total, or per second? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2009 12:23:57 -0000 On Monday 31 August 2009 6:18:56 am Andrew Brampton wrote: > Hi FreeBSD-Hackers, > > netstat -i will print out statistics for each interface, including > input/output packets, input/output bytes, and input/output errors. Now > packets and bytes columns seem to be absolute counts, whereas the > errors column seems to be a count over the last second. For example, > when I am filling a link (and then stop), I get output like so: > > Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll > ix0 9000 00:1b:21:20:f9:07 12687951213 432913 > 1 0 0 > > ix0 9000 00:1b:21:20:f9:07 12691545431 435439 > 1 0 0 > > ix0 9000 00:1b:21:20:f9:07 12692054413 434735 > 1 0 0 > > ix0 9000 00:1b:21:20:f9:07 12696499228 300785 > 1 0 0 > > ix0 9000 00:1b:21:20:f9:07 12696499228 0 1 > 0 0 > > As you can see the "Ipkts" value continues to rise, but the "Ierrs" > goes up and down, eventually falling to zero. So my question is, > should this "Ierrs" count be per second?, if so how can I change this > behaviour. I looked at the source code for the driver (ixgbe) and the > OS, looking for every reference to ifp->if_ierrors, but I didn't find > anything that reset this value over time. I also tried a similar > experiment with the e1000 driver but I couldn't get that interface to > list any errors. > > I'm running these tests on FreeBSD 8.0-Beta3, but I observed the same > behaviour on FreeBSD 7.2. It should be total and it sounds like a bug in the device driver. It looks like ixgbe_update_stats_counters() overwrites the accumulated value of if_ierrors: /* Rx Errors */ ifp->if_ierrors = total_missed_rx + adapter->stats.crcerrs + adapter->stats.rlec; It also increments if_ierrors in ixgbe_rxeof(). The driver should only do one or the other, but probably not both. -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Mon Aug 31 19:15:56 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5D1781065676 for ; Mon, 31 Aug 2009 19:15:56 +0000 (UTC) (envelope-from brampton@gmail.com) Received: from mail-bw0-f206.google.com (mail-bw0-f206.google.com [209.85.218.206]) by mx1.freebsd.org (Postfix) with ESMTP id A773A8FC12 for ; Mon, 31 Aug 2009 19:15:55 +0000 (UTC) Received: by bwz2 with SMTP id 2so2825776bwz.43 for ; Mon, 31 Aug 2009 12:15:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:received:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type; bh=M2rxl5pNgHSu5E/yLjFBXZ+wAg5g5sZfnMFgHGsGXdw=; b=qSrNuCA245Pcbj2QN+jv3JlPDQHzIIRHmJ1YNVhIOE6YYXGl6ET7JobhbIGsHA9sFJ 0X1p0wpR5olYkvnulvM4bnbm5d9qRzzebMPh4Z+qzuyYaUax94jVFWvElz+ShNUFvOhp k/KLYxTwBlBifoe0dwz5Y9TcvWHg7B6a+LSrQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; b=eYmfyjFCVispsBl6C05anMrdxOY2H+BFVzKSZua806y9gnSmOYUR1bztYIvIoipqYU 3xsm4Vs5zv/COgyRaggVuMqBNj551nFeXXOQMqyg7IVuvm+ZR8eYZ7EgCL+gQiDPmLRh EboChNr4Acrs+IKVhcdXSdr59HJ83YOdTTwzE= MIME-Version: 1.0 Sender: brampton@gmail.com Received: by 10.223.53.149 with SMTP id m21mr1876824fag.101.1251746153730; Mon, 31 Aug 2009 12:15:53 -0700 (PDT) In-Reply-To: <200908310804.27417.jhb@freebsd.org> References: <200908310804.27417.jhb@freebsd.org> Date: Mon, 31 Aug 2009 20:15:53 +0100 X-Google-Sender-Auth: 2b152fec2dab2833 Message-ID: From: Andrew Brampton To: John Baldwin Content-Type: multipart/mixed; boundary=001517473652d794ef047274dcf6 Cc: jfv@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: netstat -i Ierrs column, Is it total, or per second? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2009 19:15:56 -0000 --001517473652d794ef047274dcf6 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable 2009/8/31 John Baldwin : > It should be total and it sounds like a bug in the device driver. =C2=A0I= t looks > like ixgbe_update_stats_counters() overwrites the accumulated value of > if_ierrors: > > =C2=A0 =C2=A0 =C2=A0 =C2=A0/* Rx Errors */ > =C2=A0 =C2=A0 =C2=A0 =C2=A0ifp->if_ierrors =3D total_missed_rx + adapter-= >stats.crcerrs + > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0adapter->stats.rle= c; > > It also increments if_ierrors in ixgbe_rxeof(). =C2=A0The driver should o= nly do one > or the other, but probably not both. > > -- > John Baldwin > Thanks for your reply. I had wondered that, but looking at e1000/if_em.c it does a similar thing. However, a quick look at non-intel drivers and it seems others don't. So perhaps this is a problem across the intel drivers? So anyway I spent my afternoon reading the ixgbe spec sheet and creating the attached patch, which hopefully fixes this problem. I will forward this patch to freebsd intel.com unless someone can point me toward the maintainers email address, or should I just create a PR? thanks Andrew --001517473652d794ef047274dcf6 Content-Type: text/plain; charset=US-ASCII; name="freebsd-ixgbe.ierrors.patch.txt" Content-Disposition: attachment; filename="freebsd-ixgbe.ierrors.patch.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_fz1lbj720 ZGlmZiAtdSBpeGdiZS5vbGQvaXhnYmUuYyBpeGdiZS9peGdiZS5jCi0tLSBpeGdiZS5vbGQvaXhn YmUuYwkyMDA5LTA4LTMxIDE4OjE1OjA1LjAwMDAwMDAwMCArMDEwMAorKysgaXhnYmUvaXhnYmUu YwkyMDA5LTA4LTMxIDE5OjUyOjE0LjAwMDAwMDAwMCArMDEwMApAQCAtMzk3OCw3ICszOTc4LDYg QEAKIAogCQkJaWYgKGVvcCkgewogCQkJCXJ4ci0+Zm1wLT5tX3BrdGhkci5yY3ZpZiA9IGlmcDsK LQkJCQlpZnAtPmlmX2lwYWNrZXRzKys7CiAJCQkJcnhyLT5yeF9wYWNrZXRzKys7CiAJCQkJLyog Y2FwdHVyZSBkYXRhIGZvciBBSU0gKi8KIAkJCQlyeHItPmJ5dGVzICs9IHJ4ci0+Zm1wLT5tX3Br dGhkci5sZW47CkBAIC00MDAwLDggKzM5OTksOSBAQAogCQkJCXJ4ci0+bG1wID0gTlVMTDsKIAkJ CX0KIAkJfSBlbHNlIHsKLQkJCWlmcC0+aWZfaWVycm9ycysrOwogZGlzY2FyZDoKKwkJCWFkYXB0 ZXItPmRyb3BwZWRfcGt0cysrOworCiAJCQkvKiBSZXVzZSBsb2FkZWQgRE1BIG1hcCBhbmQganVz dCB1cGRhdGUgbWJ1ZiBjaGFpbiAqLwogCQkJaWYgKGhsZW4pIHsKIAkJCQltaCA9IHJ4ci0+cnhf YnVmZmVyc1tpXS5tX2hlYWQ7CkBAIC00NDU5LDEyICs0NDU5LDE1IEBACiAJdTMyICBtaXNzZWRf cnggPSAwLCBicHJjLCBseG9uLCBseG9mZiwgdG90YWw7CiAKIAlhZGFwdGVyLT5zdGF0cy5jcmNl cnJzICs9IElYR0JFX1JFQURfUkVHKGh3LCBJWEdCRV9DUkNFUlJTKTsKKwlhZGFwdGVyLT5zdGF0 cy5pbGxlcnJjICs9IElYR0JFX1JFQURfUkVHKGh3LCBJWEdCRV9JTExFUlJDKTsKKwlhZGFwdGVy LT5zdGF0cy5lcnJiYyAgICs9IElYR0JFX1JFQURfUkVHKGh3LCBJWEdCRV9FUlJCQyk7CiAKIAlm b3IgKGludCBpID0gMDsgaSA8IDg7IGkrKykgewogCQlpbnQgbXA7CiAJCW1wID0gSVhHQkVfUkVB RF9SRUcoaHcsIElYR0JFX01QQyhpKSk7CiAJCW1pc3NlZF9yeCArPSBtcDsKICAgICAgICAgCWFk YXB0ZXItPnN0YXRzLm1wY1tpXSArPSBtcDsKKyAgICAgICAgCWFkYXB0ZXItPnN0YXRzLm1wY3Rv dGFsICs9IG1wOwogCQlhZGFwdGVyLT5zdGF0cy5ybmJjW2ldICs9IElYR0JFX1JFQURfUkVHKGh3 LCBJWEdCRV9STkJDKGkpKTsKIAl9CiAKQEAgLTQ1MzIsOCArNDUzNSwxMSBAQAogCWlmcC0+aWZf Y29sbGlzaW9ucyA9IDA7CiAKIAkvKiBSeCBFcnJvcnMgKi8KLQlpZnAtPmlmX2llcnJvcnMgPSBt aXNzZWRfcnggKyBhZGFwdGVyLT5zdGF0cy5jcmNlcnJzICsKLQkJYWRhcHRlci0+c3RhdHMucmxl YzsKKwlpZnAtPmlmX2llcnJvcnMgPSBhZGFwdGVyLT5zdGF0cy5tcGN0b3RhbCArCisJICAgICAg ICAgICAgICAgICAgYWRhcHRlci0+c3RhdHMuY3JjZXJycyArCisJICAgICAgICAgICAgICAgICAg YWRhcHRlci0+c3RhdHMuaWxsZXJyYyArCisJICAgICAgICAgICAgICAgICAgYWRhcHRlci0+c3Rh dHMuZXJyYmMgKworCSAgICAgICAgICAgICAgICAgIGFkYXB0ZXItPnN0YXRzLnJsZWM7CiB9Cgo= --001517473652d794ef047274dcf6-- From owner-freebsd-hackers@FreeBSD.ORG Mon Aug 31 21:49:47 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7C868106568B; Mon, 31 Aug 2009 21:49:47 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id 4BEFC8FC16; Mon, 31 Aug 2009 21:49:47 +0000 (UTC) Received: from bigwig.baldwin.cx (66.111.2.69.static.nyinternet.net [66.111.2.69]) by cyrus.watson.org (Postfix) with ESMTPSA id EFE2746B2C; Mon, 31 Aug 2009 17:49:46 -0400 (EDT) Received: from jhbbsd.hudson-trading.com (unknown [209.249.190.8]) by bigwig.baldwin.cx (Postfix) with ESMTPA id 00A158A03E; Mon, 31 Aug 2009 17:49:45 -0400 (EDT) From: John Baldwin To: Andrew Brampton Date: Mon, 31 Aug 2009 16:42:50 -0400 User-Agent: KMail/1.9.7 References: <200908310804.27417.jhb@freebsd.org> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200908311642.50866.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0.1 (bigwig.baldwin.cx); Mon, 31 Aug 2009 17:49:46 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.95.1 at bigwig.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-1.4 required=4.2 tests=AWL,BAYES_00,RDNS_NONE autolearn=no version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on bigwig.baldwin.cx Cc: jfv@freebsd.org, freebsd-hackers@freebsd.org Subject: Re: netstat -i Ierrs column, Is it total, or per second? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Aug 2009 21:49:47 -0000 On Monday 31 August 2009 3:15:53 pm Andrew Brampton wrote: > 2009/8/31 John Baldwin : > > It should be total and it sounds like a bug in the device driver. =A0It= =20 looks > > like ixgbe_update_stats_counters() overwrites the accumulated value of > > if_ierrors: > > > > =A0 =A0 =A0 =A0/* Rx Errors */ > > =A0 =A0 =A0 =A0ifp->if_ierrors =3D total_missed_rx + adapter->stats.crc= errs + > > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0adapter->stats.rlec; > > > > It also increments if_ierrors in ixgbe_rxeof(). =A0The driver should on= ly do=20 one > > or the other, but probably not both. > > > > -- > > John Baldwin > > >=20 > Thanks for your reply. I had wondered that, but looking at > e1000/if_em.c it does a similar thing. However, a quick look at > non-intel drivers and it seems others don't. So perhaps this is a > problem across the intel drivers? >=20 > So anyway I spent my afternoon reading the ixgbe spec sheet and > creating the attached patch, which hopefully fixes this problem. I > will forward this patch to freebsd intel.com unless someone can > point me toward the maintainers email address, or should I just create > a PR? I cc'd him on my earlier reply (jfv@) so he should have seen your patch=20 already. =2D-=20 John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 1 18:02:50 2009 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 443BC106568B for ; Tue, 1 Sep 2009 18:02:50 +0000 (UTC) (envelope-from news@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [194.45.71.2]) by mx1.freebsd.org (Postfix) with ESMTP id A89B98FC1E for ; Tue, 1 Sep 2009 18:02:49 +0000 (UTC) Received: from uucp.dinoex.sub.de (uucp@uucp.dinoex.sub.de [194.45.71.2] (may be forged)) by uucp.dinoex.sub.de (8.14.3/8.14.2) with ESMTP id n81I2RZx094488 for ; Tue, 1 Sep 2009 20:02:27 +0200 (CEST) (envelope-from news@citylink.dinoex.sub.org) X-MDaemon-Deliver-To: Received: from citylink.dinoex.sub.org (uucp@localhost) by uucp.dinoex.sub.de (8.14.3/8.14.2/Submit) with UUCP id n81I2RKS094487 for freebsd-hackers@FreeBSD.ORG; Tue, 1 Sep 2009 20:02:27 +0200 (CEST) (envelope-from news@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.14.3/8.14.3) with ESMTP id n81Ht9Q8097532 for ; Tue, 1 Sep 2009 19:55:09 +0200 (CEST) (envelope-from news@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.14.3/8.14.3) with ESMTP id n81Hs2b5097281 for ; Tue, 1 Sep 2009 19:54:02 +0200 (CEST) (envelope-from news@gate.oper.dinoex.org) Received: (from news@localhost) by gate.oper.dinoex.org (8.14.3/8.14.3/Submit) id n81Hs2Ki097273 for freebsd-hackers@FreeBSD.ORG; Tue, 1 Sep 2009 19:54:02 +0200 (CEST) (envelope-from news) From: peter@citylink.dinoex.sub.org (Peter Much) Message-ID: Date: Tue, 1 Sep 2009 17:45:44 GMT Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=ISO-8859-1 Mime-Version: 1.0 Organization: some more stinking socks X-Newsreader: trn 4.0-test76 (Apr 2, 2001) Sender: li-fbsd@citylink.dinoex.sub.org To: freebsd-hackers@FreeBSD.ORG X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 194.45.71.2; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (uucp.dinoex.sub.de [194.45.71.2]); Tue, 01 Sep 2009 20:02:28 +0200 (CEST) Cc: Subject: crashdump "watchdog timeout" - Howto get useful information? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Sep 2009 18:02:50 -0000 Dear all, could anybody share some insight (or pointers to docs) on how to approach an analysis of a "watchdog timeout" crashdump? I hopefully have the necessities in place (that is, I can load the dump into ddd and actually see things). But I have no real idea about where to start looking for interesting things - some structure from where to unroll what the system was doing (or not doing). The "developers handbook" mainly explains about figuring the cause of the crash - but in my case this is obvious, it is the watchdog I have configured. Since this is a reproducible issue, ideas on things that could be configured beforehand could also be useful. rgds, PMc From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 2 12:44:44 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C2C561065670 for ; Wed, 2 Sep 2009 12:44:44 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id 94F678FC20 for ; Wed, 2 Sep 2009 12:44:44 +0000 (UTC) Received: from bigwig.baldwin.cx (66.111.2.69.static.nyinternet.net [66.111.2.69]) by cyrus.watson.org (Postfix) with ESMTPSA id 4476246B2D; Wed, 2 Sep 2009 08:44:44 -0400 (EDT) Received: from jhbbsd.hudson-trading.com (unknown [209.249.190.8]) by bigwig.baldwin.cx (Postfix) with ESMTPA id 9AF138A041; Wed, 2 Sep 2009 08:44:43 -0400 (EDT) From: John Baldwin To: freebsd-hackers@freebsd.org Date: Wed, 2 Sep 2009 08:35:47 -0400 User-Agent: KMail/1.9.7 References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200909020835.47358.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0.1 (bigwig.baldwin.cx); Wed, 02 Sep 2009 08:44:43 -0400 (EDT) X-Virus-Scanned: clamav-milter 0.95.1 at bigwig.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-1.5 required=4.2 tests=AWL,BAYES_00,RDNS_NONE autolearn=no version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on bigwig.baldwin.cx Cc: Peter Much Subject: Re: crashdump "watchdog timeout" - Howto get useful information? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Sep 2009 12:44:44 -0000 On Tuesday 01 September 2009 1:45:44 pm Peter Much wrote: > > Dear all, > > could anybody share some insight (or pointers to docs) on how to > approach an analysis of a "watchdog timeout" crashdump? > > I hopefully have the necessities in place (that is, I can load > the dump into ddd and actually see things). > > But I have no real idea about where to start looking for interesting > things - some structure from where to unroll what the system was > doing (or not doing). > The "developers handbook" mainly explains about figuring the cause > of the crash - but in my case this is obvious, it is the watchdog I > have configured. > > Since this is a reproducible issue, ideas on things that could be > configured beforehand could also be useful. I would examine the state of the processes in the system first. If all the CPUs are idle but some threads are blocked on locks you might have a deadlock, etc. You can use the gdb scripts at http://www.FreeBSD.org/~jhb/gdb/ in kgdb to figure some of that stuff out (source gdb6 from within gdb. I usually start with 'ps'). -- John Baldwin From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 2 20:33:04 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D776F106568F for ; Wed, 2 Sep 2009 20:33:04 +0000 (UTC) (envelope-from Robert.Eckardt@Robert-Eckardt.de) Received: from mo-p00-ob.rzone.de (mo-p00-ob.rzone.de [81.169.146.161]) by mx1.freebsd.org (Postfix) with ESMTP id 64BF98FC1F for ; Wed, 2 Sep 2009 20:33:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; t=1251923582; l=2060; s=domk; d=robert-eckardt.de; h=Content-Type:MIME-Version:Date:Subject:To:From:X-RZG-CLASS-ID: X-RZG-AUTH; bh=h9CLOjz/mS1VyteriZ/TxXFM5Rs=; b=sB/ES1S1QCMNulykrlg61o7Y3AVWgrYkMwNe56BzlslCBgJMCmRxF+u1+cdixC0av84 2F0iSk8RgjiGoeTzeym/HqO3Wq5xxwJw06C1q0jHs+aHpO4bexntnZwhC6X1Mzwdu7Y1t FA4ZYZ2XFPTe3B0w7BQy1fSZuYI5h9p0Sss= X-RZG-AUTH: :PmMGcFK8ft/ijOzYQwKyRQtU5O3aHqLcetKYQCNo0Y/QGlinQo1iUUAGQjwVEjDNt1fe8clWPQ== X-RZG-CLASS-ID: mo00 Received: from postit (p4FDD6D97.dip.t-dialin.net [79.221.109.151]) by post.strato.de (klopstock mo7) (RZmta 21.0) with ESMTP id 606c64l82JJj1C for ; Wed, 2 Sep 2009 22:22:02 +0200 (MEST) Received: from www.home.roberte.eu (localhost.home.roberte.eu [127.0.0.1]) by postit (8.13.8/8.13.8) with ESMTP id n82KM21o095300 for ; Wed, 2 Sep 2009 22:22:02 +0200 (CEST) (envelope-from Robert.Eckardt@Robert-Eckardt.de) From: "Robert Eckardt" To: hackers@freebsd.org Date: Wed, 2 Sep 2009 22:22:02 +0200 Message-Id: <20090902193059.M336@Robert-Eckardt.de> X-Mailer: OpenWebMail 2.52 20060502 X-OriginatingIP: 192.168.183.52 (roberte) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 X-Mailman-Approved-At: Wed, 02 Sep 2009 20:35:17 +0000 Cc: Subject: ZFS continuously growing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Sep 2009 20:33:04 -0000 Hi folks, after upgrading my backup server to 8.0-BETA2, I noticed that the available space shrinks from backup to backup (a tree each day with differential rsync) although with each new tree the oldest tree gets removed. Since I removed some subdirectories on my active server the number of used inodes now is reduced by approx. 90000 on each run. At the same time used space grows by between 650MB and 6.7GB and free space gets reduced by 4.4 to 9GB (see table below). The output of "df" and "zfs list" is consistent. Although I understand that the backed-up file by rsync can be much larger than the data transferred I get worried that without changing much the available space shrinks continuously. (Remember, the number of backup trees stays constant since the oldest gets removed and 6GB/d results in more that 1TB over half a year.) Do I have to be worried? Is there a memory leak in the current ZFS implementation? Why is used space growing slower than free space is shrinking? Is there some garbage collection needed in ZFS? Besides, although the backup server has 3 GB RAM I had to tune arc_max to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. (I.e., the defaults algorithm was not sufficient.) Regards, Robert day rsynced Used free inodes oldest dir newest dir d-used d-free d-inode 27 57018987 2792986368 1914681984 43854571 20090224-0917 20090827-0916 28 67181251 2794269440 1910242176 43765134 20090225-0917 20090828-0916 1.283.072 -4.439.808 -89.437 30 52078382 2800983296 1897022720 43586320 20090227-0917 20090830-0916 6.713.856 -13.219.456 -178.814 31 2647268060 2803757056 1891064192 43496712 20090228-0917 20090831-0916 2.773.760 -5.958.528 -89.608 1 92096258 2804415616 1881965184 43406059 20090301-0917 20090901-0916 658.560 -9.099.008 -90.653 2 121590303 2807900288 1875341440 43316517 20090302-0917 20090902-0916 3.484.672 -6.623.744 -89.542 -- Dr. Robert Eckardt --- Robert.Eckardt@Robert-Eckardt.de From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 2 21:01:47 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4B5431065693 for ; Wed, 2 Sep 2009 21:01:47 +0000 (UTC) (envelope-from rol@robert-eckardt.de) Received: from mo-p00-ob.rzone.de (mo-p00-ob.rzone.de [81.169.146.161]) by mx1.freebsd.org (Postfix) with ESMTP id CACEC8FC15 for ; Wed, 2 Sep 2009 21:01:46 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; t=1251925305; l=2060; s=domk; d=robert-eckardt.de; h=Content-Type:MIME-Version:References:In-Reply-To:Date:Subject:To: From:X-RZG-CLASS-ID:X-RZG-AUTH; bh=h9CLOjz/mS1VyteriZ/TxXFM5Rs=; b=KHB6FPexuNfchqcxlNsgwCDwkJCv44oi/RTXvG2WnbNS2jykXWjqWebPANnzBxDsUAU tpKw0FRnwPX5VOl67wq37KxO1QqLYObQ6h4f+/vsTKuDNK+BaCwdHtYhuX4iZ11tonsrD 1Pwls9DZ9QEFhes63i6R7ODqsAa5POjJYH8= X-RZG-AUTH: :PmMGcFK8ft/ijOzYQwKyRQtU5O3aHqLcetKYQCNo0Y/QGlinQo1iUUAGQjwVEjDNt1fe8clWPQ== X-RZG-CLASS-ID: mo00 Received: from postit (p4FDD6D97.dip.t-dialin.net [79.221.109.151]) by post.strato.de (klopstock mo62) (RZmta 21.0) with ESMTP id v069c4l82K7Fey for ; Wed, 2 Sep 2009 22:49:57 +0200 (MEST) Received: from www.home.roberte.eu (localhost.home.roberte.eu [127.0.0.1]) by postit (8.13.8/8.13.8) with ESMTP id n82Knun2097109 for ; Wed, 2 Sep 2009 22:49:56 +0200 (CEST) (envelope-from rol@robert-eckardt.de) From: "Robert Eckardt" To: hackers@freebsd.org Date: Wed, 2 Sep 2009 22:49:56 +0200 Message-Id: <20090902204845.M67171@Robert-Eckardt.de> In-Reply-To: <20090902193059.M336@Robert-Eckardt.de> References: <20090902193059.M336@Robert-Eckardt.de> X-Mailer: OpenWebMail 2.52 20060502 X-OriginatingIP: 192.168.183.52 (roberte) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Cc: Subject: ZFS continuously growing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Sep 2009 21:01:47 -0000 Hi folks, after upgrading my backup server to 8.0-BETA2, I noticed that the available space shrinks from backup to backup (a tree each day with differential rsync) although with each new tree the oldest tree gets removed. Since I removed some subdirectories on my active server the number of used inodes now is reduced by approx. 90000 on each run. At the same time used space grows by between 650MB and 6.7GB and free space gets reduced by 4.4 to 9GB (see table below). The output of "df" and "zfs list" is consistent. Although I understand that the backed-up file by rsync can be much larger than the data transferred I get worried that without changing much the available space shrinks continuously. (Remember, the number of backup trees stays constant since the oldest gets removed and 6GB/d results in more that 1TB over half a year.) Do I have to be worried? Is there a memory leak in the current ZFS implementation? Why is used space growing slower than free space is shrinking? Is there some garbage collection needed in ZFS? Besides, although the backup server has 3 GB RAM I had to tune arc_max to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. (I.e., the defaults algorithm was not sufficient.) Regards, Robert day rsynced Used free inodes oldest dir newest dir d-used d-free d-inode 27 57018987 2792986368 1914681984 43854571 20090224-0917 20090827-0916 28 67181251 2794269440 1910242176 43765134 20090225-0917 20090828-0916 1.283.072 -4.439.808 -89.437 30 52078382 2800983296 1897022720 43586320 20090227-0917 20090830-0916 6.713.856 -13.219.456 -178.814 31 2647268060 2803757056 1891064192 43496712 20090228-0917 20090831-0916 2.773.760 -5.958.528 -89.608 1 92096258 2804415616 1881965184 43406059 20090301-0917 20090901-0916 658.560 -9.099.008 -90.653 2 121590303 2807900288 1875341440 43316517 20090302-0917 20090902-0916 3.484.672 -6.623.744 -89.542 -- Dr. Robert Eckardt --- Robert.Eckardt@Robert-Eckardt.de From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 2 21:13:10 2009 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 01AE91065676 for ; Wed, 2 Sep 2009 21:13:10 +0000 (UTC) (envelope-from news@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.sub.de [194.45.71.2]) by mx1.freebsd.org (Postfix) with ESMTP id 74BA08FC0C for ; Wed, 2 Sep 2009 21:13:09 +0000 (UTC) Received: from uucp.dinoex.sub.de (uucp@uucp.dinoex.sub.de [194.45.71.2] (may be forged)) by uucp.dinoex.sub.de (8.14.3/8.14.2) with ESMTP id n82LCoPg038017 for ; Wed, 2 Sep 2009 23:12:51 +0200 (CEST) (envelope-from news@citylink.dinoex.sub.org) X-MDaemon-Deliver-To: Received: from citylink.dinoex.sub.org (uucp@localhost) by uucp.dinoex.sub.de (8.14.3/8.14.2/Submit) with UUCP id n82LCoDU038016 for freebsd-hackers@FreeBSD.ORG; Wed, 2 Sep 2009 23:12:50 +0200 (CEST) (envelope-from news@citylink.dinoex.sub.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.14.3/8.14.3) with ESMTP id n82KYDIn002085 for ; Wed, 2 Sep 2009 22:34:13 +0200 (CEST) (envelope-from news@gate.oper.dinoex.org) Received: from gate.oper.dinoex.org (gate-e [192.168.98.2]) by gate.oper.dinoex.org (8.14.3/8.14.3) with ESMTP id n82KY4rj001996 for ; Wed, 2 Sep 2009 22:34:05 +0200 (CEST) (envelope-from news@gate.oper.dinoex.org) Received: (from news@localhost) by gate.oper.dinoex.org (8.14.3/8.14.3/Submit) id n82KY4qS001993 for freebsd-hackers@FreeBSD.ORG; Wed, 2 Sep 2009 22:34:04 +0200 (CEST) (envelope-from news) From: peter@citylink.dinoex.sub.org (Peter Much) Message-ID: Date: Wed, 2 Sep 2009 20:22:10 GMT Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=ISO-8859-1 References: <200909020835.47358.jhb@freebsd.org> Mime-Version: 1.0 Organization: some more stinking socks X-Newsreader: trn 4.0-test76 (Apr 2, 2001) Sender: li-fbsd@citylink.dinoex.sub.org To: freebsd-hackers@FreeBSD.ORG X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 194.45.71.2; Sender-helo: uucp.dinoex.sub.de; ) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (uucp.dinoex.sub.de [194.45.71.2]); Wed, 02 Sep 2009 23:12:51 +0200 (CEST) Cc: Subject: Re: crashdump "watchdog timeout" - Howto get useful information? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Sep 2009 21:13:10 -0000 In article <200909020835.47358.jhb@freebsd.org>, John Baldwin wrote: |You can use the gdb scripts at http://www.FreeBSD.org/~jhb/gdb/ in kgdb to |figure some of that stuff out (source gdb6 from within gdb. I usually start |with 'ps'). WHOOAAAH, THAT ROCKS!!!! Thats a lot more than I had hoped for! muchas, muchas gracias!!! PMc From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 07:42:22 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C0C581065670 for ; Thu, 3 Sep 2009 07:42:22 +0000 (UTC) (envelope-from ady@ady.ro) Received: from ey-out-2122.google.com (ey-out-2122.google.com [74.125.78.26]) by mx1.freebsd.org (Postfix) with ESMTP id 3038B8FC08 for ; Thu, 3 Sep 2009 07:42:21 +0000 (UTC) Received: by ey-out-2122.google.com with SMTP id 4so960795eyf.3 for ; Thu, 03 Sep 2009 00:42:21 -0700 (PDT) MIME-Version: 1.0 Sender: ady@ady.ro Received: by 10.211.168.3 with SMTP id v3mr9077445ebo.97.1251961761924; Thu, 03 Sep 2009 00:09:21 -0700 (PDT) In-Reply-To: <20090902193059.M336@Robert-Eckardt.de> References: <20090902193059.M336@Robert-Eckardt.de> Date: Thu, 3 Sep 2009 09:09:19 +0200 X-Google-Sender-Auth: b547805cf4ef5777 Message-ID: <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> From: Adrian Penisoara To: Robert Eckardt Content-Type: text/plain; charset=ISO-8859-1 Cc: hackers@freebsd.org Subject: Re: ZFS continuously growing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 07:42:22 -0000 Hi, On Wed, Sep 2, 2009 at 10:22 PM, Robert Eckardt wrote: > > Hi folks, > > after upgrading my backup server to 8.0-BETA2, I noticed that the > available space shrinks from backup to backup (a tree each day with > differential rsync) although with each new tree the oldest tree gets > removed. > > Since I removed some subdirectories on my active server the number > of used inodes now is reduced by approx. 90000 on each run. > At the same time used space grows by between 650MB and 6.7GB and > free space gets reduced by 4.4 to 9GB (see table below). The output > of "df" and "zfs list" is consistent. > > Although I understand that the backed-up file by rsync can be much > larger than the data transferred I get worried that without changing > much the available space shrinks continuously. (Remember, the number > of backup trees stays constant since the oldest gets removed and > 6GB/d results in more that 1TB over half a year.) > > Do I have to be worried? > Is there a memory leak in the current ZFS implementation? > Why is used space growing slower than free space is shrinking? > Is there some garbage collection needed in ZFS? > > Besides, although the backup server has 3 GB RAM I had to tune arc_max > to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the > 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. > (I.e., the defaults algorithm was not sufficient.) Do I take you are using ZFS snapshots in between rsync'ing (send/recv requires snapshots) ? Could you please post the "zfs list" output after subsequent runs to clarify ? Regards, Adrian EnterpriseBSD From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 08:07:02 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 17C14106566B for ; Thu, 3 Sep 2009 08:07:02 +0000 (UTC) (envelope-from rol@robert-eckardt.de) Received: from mo-p00-ob.rzone.de (mo-p00-ob.rzone.de [81.169.146.162]) by mx1.freebsd.org (Postfix) with ESMTP id 902078FC0A for ; Thu, 3 Sep 2009 08:07:01 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; t=1251965220; l=2720; s=domk; d=robert-eckardt.de; h=Content-Type:MIME-Version:References:In-Reply-To:Date:Subject:Cc:To: From:X-RZG-CLASS-ID:X-RZG-AUTH; bh=MZZFl3SONyfuS+dIp76TrrUPl8A=; b=fHlaZ7gTLsj6swHwtNcd02G6BBggDGuLSv/n5NSQtHicOEcyZFUdnD7hDRkzpW0QFNo Fx8QJFyDYuFvkLjTKRUuqaAlpk7oLFo+JPkq0SAXggGo/lEY4BoscFC8uQ5yWuQFyxVMK z4/v/Lw87P1aqUfvQ9uKjgXOXZRwBn1uxHw= X-RZG-AUTH: :PmMGcFK8ft/ijOzYQwKyRQtU5O3aHqLcetKYQCNo0Y/QGlinQo1iUUAGQjwVEjDNt1je+c46 X-RZG-CLASS-ID: mo00 Received: from postit (p4FDD6A5C.dip.t-dialin.net [79.221.106.92]) by post.strato.de (fruni mo10) (RZmta 21.0) with ESMTP id 904aecl837QG9B ; Thu, 3 Sep 2009 10:06:57 +0200 (MEST) Received: from www.home.roberte.eu (localhost.home.roberte.eu [127.0.0.1]) by postit (8.13.8/8.13.8) with ESMTP id n8386vdq035835; Thu, 3 Sep 2009 10:06:57 +0200 (CEST) (envelope-from rol@robert-eckardt.de) From: "Robert Eckardt" To: Adrian Penisoara Date: Thu, 3 Sep 2009 10:06:57 +0200 Message-Id: <20090903080558.M13772@Robert-Eckardt.de> In-Reply-To: <20090903071913.M84990@Robert-Eckardt.de> References: <20090902193059.M336@Robert-Eckardt.de> <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> <20090903071913.M84990@Robert-Eckardt.de> X-Mailer: OpenWebMail 2.52 20060502 X-OriginatingIP: 217.110.226.122 (roberte) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Cc: hackers@freebsd.org Subject: Fw: Re: ZFS continuously growing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 08:07:02 -0000 On Thu, 3 Sep 2009 09:09:19 +0200, Adrian Penisoara wrote > Hi, > > On Wed, Sep 2, 2009 at 10:22 PM, Robert Eckardt > wrote: > > Do I have to be worried? > > Is there a memory leak in the current ZFS implementation? > > Why is used space growing slower than free space is shrinking? > > Is there some garbage collection needed in ZFS? > > > > Besides, although the backup server has 3 GB RAM I had to tune arc_max > > to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the > > 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. > > (I.e., the defaults algorithm was not sufficient.) > > Do I take you are using ZFS snapshots in between rsync'ing > (send/recv requires snapshots) ? Could you please post the "zfs > list" output after subsequent runs to clarify ? > > Regards, > Adrian > EnterpriseBSD Hi Adrian, no I'm not using snapshots. Just seperate directories, where identical files are hardlinked by rsync to the version one day older. The send|recv was neccessary when I increased the raidz of the backup-fs. (Copying everthing to two 1.5TB HDDs and after adding disks back again. I used s.th. like "zfs send bigpool/big@backup | zfs recv big/big".) Here the zfs list of the last five days: Thu Sep 3 09:36:12 CEST 2009 (Today add. 2GB of data were transfered.) big 1861882752 0 1861882752 0% 5 14545959 0% /big big/big 4676727168 2814844416 1861882752 60% 43137409 14545959 75% /big/big NAME USED AVAIL REFER MOUNTPOINT big 2.72T 1.73T 31.5K /big big/big 2.72T 1.73T 2.62T /big/big Wed Sep 2 09:36:24 CEST 2009 big 1869058944 128 1869058816 0% 5 14602022 0% /big big/big 4679698688 2810639872 1869058816 60% 43226966 14602022 75% /big/big NAME USED AVAIL REFER MOUNTPOINT big 2.72T 1.74T 31.5K /big big/big 2.72T 1.74T 2.62T /big/big Tue Sep 1 09:36:33 CEST 2009 big 1875352064 0 1875352064 0% 5 14651188 0% /big big/big 4683241856 2807889792 1875352064 60% 43316454 14651188 75% /big/big NAME USED AVAIL REFER MOUNTPOINT big 2.71T 1.75T 31.5K /big big/big 2.71T 1.75T 2.62T /big/big Mon Aug 31 09:45:26 CEST 2009 big 1881967616 128 1881967488 0% 5 14702871 0% /big big/big 4686380928 2804413440 1881967488 60% 43406044 14702871 75% /big/big NAME USED AVAIL REFER MOUNTPOINT big 2.71T 1.75T 31.5K /big big/big 2.71T 1.75T 2.61T /big/big Sun Aug 30 09:39:31 CEST 2009 big 1891064192 0 1891064192 0% 5 14773939 0% /big big/big 4694821376 2803757184 1891064192 60% 43496712 14773939 75% /big/big NAME USED AVAIL REFER MOUNTPOINT big 2.70T 1.76T 31.5K /big big/big 2.70T 1.76T 2.61T /big/big Regards, Robert -- Dr. Robert Eckardt --- Robert.Eckardt@Robert-Eckardt.de From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 09:48:52 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B4A831065672 for ; Thu, 3 Sep 2009 09:48:52 +0000 (UTC) (envelope-from rol@robert-eckardt.de) Received: from mo-p00-ob.rzone.de (mo-p00-ob.rzone.de [81.169.146.162]) by mx1.freebsd.org (Postfix) with ESMTP id 379798FC17 for ; Thu, 3 Sep 2009 09:48:51 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; t=1251971330; l=1098; s=domk; d=robert-eckardt.de; h=Content-Type:MIME-Version:References:In-Reply-To:Date:Subject:Cc:To: From:X-RZG-CLASS-ID:X-RZG-AUTH; bh=97E0SqIdsWtekQ+cbq1bLEGYVVo=; b=cLqfrXnwwCpgLiNYvi87IXDjNvFidf9W5acoEoAJGdxzSzk6eozEiP0qhdnVyY6ax4a CNXPAUxGL6HCIg3J0nHmFJ38vFvss0mr+MpuvRiEHyN78jXlQbmR63Fj7E3JuceghOgZx YPfrE1AVqyOlXZTNjN8gzRlfhFW3ogZ+CjE= X-RZG-AUTH: :PmMGcFK8ft/ijOzYQwKyRQtU5O3aHqLcetKYQCNo0Y/QGlinQo1iUUAGQjwVEjDNt1je+c46 X-RZG-CLASS-ID: mo00 Received: from postit (p4FDD6A5C.dip.t-dialin.net [79.221.106.92]) by post.strato.de (mrclete mo10) (RZmta 21.0) with ESMTP id 907033l839ibY4 ; Thu, 3 Sep 2009 11:48:48 +0200 (MEST) Received: from www.home.roberte.eu (localhost.home.roberte.eu [127.0.0.1]) by postit (8.13.8/8.13.8) with ESMTP id n839mlaK039463; Thu, 3 Sep 2009 11:48:47 +0200 (CEST) (envelope-from rol@robert-eckardt.de) From: "Robert Eckardt" To: krad Date: Thu, 3 Sep 2009 11:48:47 +0200 Message-Id: <20090903094501.M34547@robert-eckardt.de> In-Reply-To: References: <20090902193059.M336@Robert-Eckardt.de> <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> <20090903071913.M84990@Robert-Eckardt.de> <20090903080558.M13772@Robert-Eckardt.de> X-Mailer: OpenWebMail 2.52 20060502 X-OriginatingIP: 217.110.226.122 (roberte) MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Cc: hackers@freebsd.org, Adrian Penisoara Subject: Re: Fw: Re: ZFS continuously growing [SOLVED] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 09:48:52 -0000 On Thu, 3 Sep 2009 10:01:28 +0100, krad wrote > 2009/9/3 Robert Eckardt > On Thu, 3 Sep 2009 09:09:19 +0200, Adrian Penisoara wrote > > > Hi, > > > > On Wed, Sep 2, 2009 at 10:22 PM, Robert Eckardt > > wrote: > > > > Do I have to be worried? > > > Is there a memory leak in the current ZFS implementation? > > > Why is used space growing slower than free space is shrinking? > > > Is there some garbage collection needed in ZFS? > > > > > > Besides, although the backup server has 3 GB RAM I had to tune arc_max > > > to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the > > > 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. > > > (I.e., the defaults algorithm was not sufficient.) > > > do a " zfs list -t all" > > you will see all snapshots and zvols then as well Uups, sorry for asking. Everything o.k. after "zfs destroy big/big@backup" :-( I hope the info on arc_max will stay useful. Regards, Robert -- Dr. Robert Eckardt    ---     Robert.Eckardt@Robert-Eckardt.de From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 10:41:56 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9A29A106566C for ; Thu, 3 Sep 2009 10:41:56 +0000 (UTC) (envelope-from ady@ady.ro) Received: from mail-ew0-f208.google.com (mail-ew0-f208.google.com [209.85.219.208]) by mx1.freebsd.org (Postfix) with ESMTP id 389078FC12 for ; Thu, 3 Sep 2009 10:41:55 +0000 (UTC) Received: by ewy4 with SMTP id 4so1682276ewy.36 for ; Thu, 03 Sep 2009 03:41:55 -0700 (PDT) MIME-Version: 1.0 Sender: ady@ady.ro Received: by 10.210.38.5 with SMTP id l5mr9329631ebl.64.1251974514624; Thu, 03 Sep 2009 03:41:54 -0700 (PDT) In-Reply-To: References: <20090902193059.M336@Robert-Eckardt.de> <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> <20090903071913.M84990@Robert-Eckardt.de> <20090903080558.M13772@Robert-Eckardt.de> <20090903094501.M34547@robert-eckardt.de> From: Adrian Penisoara Date: Thu, 3 Sep 2009 12:41:34 +0200 X-Google-Sender-Auth: 072eba136daee26f Message-ID: <78cb3d3f0909030341m27bdab76o7564dddecca3c85@mail.gmail.com> To: krad Content-Type: text/plain; charset=ISO-8859-1 Cc: hackers@freebsd.org Subject: Re: Fw: Re: ZFS continuously growing [SOLVED] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 10:41:56 -0000 Hi, On Thu, Sep 3, 2009 at 12:05 PM, krad wrote: [...] > > There was a change between zfs v7 and v13. IN 7 when you did a zfs list it > would show snapshots, after 13 it didnt unless you supplied the switch. It > still catches me out as we have a right mix of zfs version at work, so dont > feel to bad 8) Nasty surprise, doesn't that break POLA ? :) I assume that was Sun's change, not something specific to FreeBSD... Regards, Adrian EnterpriseBSD. From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 09:33:38 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D20AF106566C for ; Thu, 3 Sep 2009 09:33:38 +0000 (UTC) (envelope-from kraduk@googlemail.com) Received: from mail-fx0-f210.google.com (mail-fx0-f210.google.com [209.85.220.210]) by mx1.freebsd.org (Postfix) with ESMTP id 43D1F8FC08 for ; Thu, 3 Sep 2009 09:33:37 +0000 (UTC) Received: by fxm6 with SMTP id 6so1383029fxm.43 for ; Thu, 03 Sep 2009 02:33:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=Ytoyzuo74KlcQeVQPhqnnYVZBdB5z4CJH5OrB8sgpSQ=; b=q45DO6FN65hmPn0f0905Z5thfe8jalblFqXa2oErJpSrtMarElipJD7P/L24VutBlp VXZjW9vOONbEuPgerCAQmrOMCi1Ykh5eAQqAYsUuITXyl6sHY3enSXeFFfdpHr70Mv/r JzsG+cQv8WIpdW5C9tBcBovHmE2t/CUZnXy60= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=w72SCPP7NhjQ0oYyvZ2YRA7ozq79gob62TSqbSlrU04DYWXBgIeIbbuO4rTJYa4N9l +Gl2ppskK2ZE6tI2Rk64lR+f/4zDFSroJx/KdM8HdGeMFuVLHrnGGnM9+nBciu7KISvB 8ZSLS6SHAZ4Cy8Bkh5mjB2D3wvRokRvw9ihIc= MIME-Version: 1.0 Received: by 10.103.184.18 with SMTP id l18mr4050644mup.51.1251968488986; Thu, 03 Sep 2009 02:01:28 -0700 (PDT) In-Reply-To: <20090903080558.M13772@Robert-Eckardt.de> References: <20090902193059.M336@Robert-Eckardt.de> <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> <20090903071913.M84990@Robert-Eckardt.de> <20090903080558.M13772@Robert-Eckardt.de> Date: Thu, 3 Sep 2009 10:01:28 +0100 Message-ID: From: krad To: Robert Eckardt X-Mailman-Approved-At: Thu, 03 Sep 2009 11:24:42 +0000 Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: hackers@freebsd.org, Adrian Penisoara Subject: Re: Fw: Re: ZFS continuously growing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 09:33:38 -0000 2009/9/3 Robert Eckardt > On Thu, 3 Sep 2009 09:09:19 +0200, Adrian Penisoara wrote > > Hi, > > > > On Wed, Sep 2, 2009 at 10:22 PM, Robert Eckardt > > wrote: > > > Do I have to be worried? > > > Is there a memory leak in the current ZFS implementation? > > > Why is used space growing slower than free space is shrinking? > > > Is there some garbage collection needed in ZFS? > > > > > > Besides, although the backup server has 3 GB RAM I had to tune arc_max > > > to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the > > > 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. > > > (I.e., the defaults algorithm was not sufficient.) > > > > Do I take you are using ZFS snapshots in between rsync'ing > > (send/recv requires snapshots) ? Could you please post the "zfs > > list" output after subsequent runs to clarify ? > > > > Regards, > > Adrian > > EnterpriseBSD > > Hi Adrian, > > no I'm not using snapshots. Just seperate directories, where identical > files are hardlinked by rsync to the version one day older. > The send|recv was neccessary when I increased the raidz of the backup-fs. > (Copying everthing to two 1.5TB HDDs and after adding disks back again. > I used s.th. like "zfs send bigpool/big@backup | zfs recv big/big".) > > Here the zfs list of the last five days: > Thu Sep 3 09:36:12 CEST 2009 (Today add. 2GB of data were transfered.) > big 1861882752 0 1861882752 0% 5 14545959 > 0% /big > big/big 4676727168 2814844416 1861882752 60% 43137409 14545959 > 75% /big/big > NAME USED AVAIL REFER MOUNTPOINT > big 2.72T 1.73T 31.5K /big > big/big 2.72T 1.73T 2.62T /big/big > > Wed Sep 2 09:36:24 CEST 2009 > big 1869058944 128 1869058816 0% 5 14602022 > 0% /big > big/big 4679698688 2810639872 1869058816 60% 43226966 14602022 > 75% /big/big > NAME USED AVAIL REFER MOUNTPOINT > big 2.72T 1.74T 31.5K /big > big/big 2.72T 1.74T 2.62T /big/big > > Tue Sep 1 09:36:33 CEST 2009 > big 1875352064 0 1875352064 0% 5 14651188 > 0% /big > big/big 4683241856 2807889792 1875352064 60% 43316454 14651188 > 75% /big/big > NAME USED AVAIL REFER MOUNTPOINT > big 2.71T 1.75T 31.5K /big > big/big 2.71T 1.75T 2.62T /big/big > > Mon Aug 31 09:45:26 CEST 2009 > big 1881967616 128 1881967488 0% 5 14702871 > 0% /big > big/big 4686380928 2804413440 1881967488 60% 43406044 14702871 > 75% /big/big > NAME USED AVAIL REFER MOUNTPOINT > big 2.71T 1.75T 31.5K /big > big/big 2.71T 1.75T 2.61T /big/big > > Sun Aug 30 09:39:31 CEST 2009 > big 1891064192 0 1891064192 0% 5 14773939 > 0% /big > big/big 4694821376 2803757184 1891064192 60% 43496712 14773939 > 75% /big/big > NAME USED AVAIL REFER MOUNTPOINT > big 2.70T 1.76T 31.5K /big > big/big 2.70T 1.76T 2.61T /big/big > > Regards, > Robert > > -- > Dr. Robert Eckardt --- Robert.Eckardt@Robert-Eckardt.de > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > do a " zfs list -t all" you will see all snapshots and zvols then as well From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 09:34:54 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BD799106568B for ; Thu, 3 Sep 2009 09:34:54 +0000 (UTC) (envelope-from kraduk@googlemail.com) Received: from mail-bw0-f206.google.com (mail-bw0-f206.google.com [209.85.218.206]) by mx1.freebsd.org (Postfix) with ESMTP id 10DFA8FC23 for ; Thu, 3 Sep 2009 09:34:53 +0000 (UTC) Received: by bwz2 with SMTP id 2so1320174bwz.43 for ; Thu, 03 Sep 2009 02:34:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=uVIxYSvYT6oXFgS/3tfsY3GTzyI87uVt2PTFTskxkfk=; b=tTdikVX72//mzgCcsHIlgLmPjMybzu1MBnv/1LY64ZHw+fQ3KDfq1js1MKWgb8PCev YFIHrrptILcMYfQ7VFNOgib6z9RtiXj91wjzyCQEKbOnHYlGdKxXsh7269WCUorqQBxY cRgYIQu7UKNsBEINIUwTaroDB9fy+ud5vHV90= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=Gfap3XvhvzDbWjfvv295bmHK5REL41oWBPgosenRU+s9pkxpqNFRpeK2v0jstyWYcE YuTCauSjLxJBpwHdh0cWp3db+vXBQbavfSZ2qx7rt9YWrqWXbm93yteVfEffxkQHMSLY QhXF9xp7TrPRF+iBqkx6Oo91FyvCNR+5Fp/R0= MIME-Version: 1.0 Received: by 10.103.81.38 with SMTP id i38mr4032681mul.92.1251968688146; Thu, 03 Sep 2009 02:04:48 -0700 (PDT) In-Reply-To: References: <20090902193059.M336@Robert-Eckardt.de> <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> <20090903071913.M84990@Robert-Eckardt.de> <20090903080558.M13772@Robert-Eckardt.de> Date: Thu, 3 Sep 2009 10:04:48 +0100 Message-ID: From: krad To: Robert Eckardt X-Mailman-Approved-At: Thu, 03 Sep 2009 11:25:03 +0000 Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: hackers@freebsd.org, Adrian Penisoara Subject: Re: Fw: Re: ZFS continuously growing X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 09:34:54 -0000 2009/9/3 krad > > > 2009/9/3 Robert Eckardt > > On Thu, 3 Sep 2009 09:09:19 +0200, Adrian Penisoara wrote >> > Hi, >> > >> > On Wed, Sep 2, 2009 at 10:22 PM, Robert Eckardt >> > wrote: >> > > Do I have to be worried? >> > > Is there a memory leak in the current ZFS implementation? >> > > Why is used space growing slower than free space is shrinking? >> > > Is there some garbage collection needed in ZFS? >> > > >> > > Besides, although the backup server has 3 GB RAM I had to tune arc_max >> > > to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the >> > > 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. >> > > (I.e., the defaults algorithm was not sufficient.) >> > >> > Do I take you are using ZFS snapshots in between rsync'ing >> > (send/recv requires snapshots) ? Could you please post the "zfs >> > list" output after subsequent runs to clarify ? >> > >> > Regards, >> > Adrian >> > EnterpriseBSD >> >> Hi Adrian, >> >> no I'm not using snapshots. Just seperate directories, where identical >> files are hardlinked by rsync to the version one day older. >> The send|recv was neccessary when I increased the raidz of the backup-fs. >> (Copying everthing to two 1.5TB HDDs and after adding disks back again. >> I used s.th. like "zfs send bigpool/big@backup | zfs recv big/big".) >> >> Here the zfs list of the last five days: >> Thu Sep 3 09:36:12 CEST 2009 (Today add. 2GB of data were transfered.) >> big 1861882752 0 1861882752 0% 5 14545959 >> 0% /big >> big/big 4676727168 2814844416 1861882752 60% 43137409 14545959 >> 75% /big/big >> NAME USED AVAIL REFER MOUNTPOINT >> big 2.72T 1.73T 31.5K /big >> big/big 2.72T 1.73T 2.62T /big/big >> >> Wed Sep 2 09:36:24 CEST 2009 >> big 1869058944 128 1869058816 0% 5 14602022 >> 0% /big >> big/big 4679698688 2810639872 1869058816 60% 43226966 14602022 >> 75% /big/big >> NAME USED AVAIL REFER MOUNTPOINT >> big 2.72T 1.74T 31.5K /big >> big/big 2.72T 1.74T 2.62T /big/big >> >> Tue Sep 1 09:36:33 CEST 2009 >> big 1875352064 0 1875352064 0% 5 14651188 >> 0% /big >> big/big 4683241856 2807889792 1875352064 60% 43316454 14651188 >> 75% /big/big >> NAME USED AVAIL REFER MOUNTPOINT >> big 2.71T 1.75T 31.5K /big >> big/big 2.71T 1.75T 2.62T /big/big >> >> Mon Aug 31 09:45:26 CEST 2009 >> big 1881967616 128 1881967488 0% 5 14702871 >> 0% /big >> big/big 4686380928 2804413440 1881967488 60% 43406044 14702871 >> 75% /big/big >> NAME USED AVAIL REFER MOUNTPOINT >> big 2.71T 1.75T 31.5K /big >> big/big 2.71T 1.75T 2.61T /big/big >> >> Sun Aug 30 09:39:31 CEST 2009 >> big 1891064192 0 1891064192 0% 5 14773939 >> 0% /big >> big/big 4694821376 2803757184 1891064192 60% 43496712 14773939 >> 75% /big/big >> NAME USED AVAIL REFER MOUNTPOINT >> big 2.70T 1.76T 31.5K /big >> big/big 2.70T 1.76T 2.61T /big/big >> >> Regards, >> Robert >> >> -- >> Dr. Robert Eckardt --- Robert.Eckardt@Robert-Eckardt.de >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org >> " >> > > do a " zfs list -t all" > > you will see all snapshots and zvols then as well > > also might be worth doing a "zfs get all| grep copies" just to make sure you haven't got multiple copies assigned to any fs It sounds like for some reason the free blocks are getting put back into the free block table/map Also try scrubbing the zpool for good measure. Its worth croning it once a week From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 10:05:43 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 331FE106566B for ; Thu, 3 Sep 2009 10:05:43 +0000 (UTC) (envelope-from kraduk@googlemail.com) Received: from mail-bw0-f206.google.com (mail-bw0-f206.google.com [209.85.218.206]) by mx1.freebsd.org (Postfix) with ESMTP id A7E018FC1D for ; Thu, 3 Sep 2009 10:05:42 +0000 (UTC) Received: by bwz2 with SMTP id 2so1336208bwz.43 for ; Thu, 03 Sep 2009 03:05:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=ohY6Jvy0HOJheIsyJ9i19Lbuz1Lw42AHGDranq1WunE=; b=Yb8z5D+uaKGTK0QdPv2sZfoeA7qA6hbb53zE2OHk3LZYmZ0RaVHsFsveM3wLj7TsCo h5aGap8kQOzWmHwYaPZcUlMqt99G4BPKS2On9GW8HSygiU2uqPegJqGT7e/WJQ7sPhm+ WxjhVyUCY+KC7ItOq9Gt3NByraUzxx8g9x5N0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=bxpn3L9xFZi4PF1cqCc/GQj/2Hz0xuWVEsPkqfPBc+/r1YpSn7tPmbbgMCtHd/xxOp sY38CH6phcuFVH1aDDPJ9QMvOnSEcPVVgIjBHCJs5ScgiUJhRZsPpUTm2mcajqrZzDrU iVFu0CYUJ1zPWudOUlNpqNmlVizNQMQByQCic= MIME-Version: 1.0 Received: by 10.103.86.13 with SMTP id o13mr4097894mul.6.1251972341356; Thu, 03 Sep 2009 03:05:41 -0700 (PDT) In-Reply-To: <20090903094501.M34547@robert-eckardt.de> References: <20090902193059.M336@Robert-Eckardt.de> <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> <20090903071913.M84990@Robert-Eckardt.de> <20090903080558.M13772@Robert-Eckardt.de> <20090903094501.M34547@robert-eckardt.de> Date: Thu, 3 Sep 2009 11:05:41 +0100 Message-ID: From: krad To: Robert Eckardt X-Mailman-Approved-At: Thu, 03 Sep 2009 11:25:16 +0000 Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: hackers@freebsd.org, Adrian Penisoara Subject: Re: Fw: Re: ZFS continuously growing [SOLVED] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 10:05:43 -0000 2009/9/3 Robert Eckardt > On Thu, 3 Sep 2009 10:01:28 +0100, krad wrote > > 2009/9/3 Robert Eckardt > > On Thu, 3 Sep 2009 09:09:19 +0200, Adrian Penisoara wrote > > > > > Hi, > > > > > > On Wed, Sep 2, 2009 at 10:22 PM, Robert Eckardt > > > wrote: > > > > > > Do I have to be worried? > > > > Is there a memory leak in the current ZFS implementation? > > > > Why is used space growing slower than free space is shrinking? > > > > Is there some garbage collection needed in ZFS? > > > > > > > > Besides, although the backup server has 3 GB RAM I had to tune > arc_max > > > > to 150MB to copy the backed-up data from an 2.8TB ZFS (v6) to the > > > > 4.5 TB ZFS (v13) by "zfs send|zfs recv" without kmalloc panic. > > > > (I.e., the defaults algorithm was not sufficient.) > > > > > > do a " zfs list -t all" > > > > you will see all snapshots and zvols then as well > > Uups, sorry for asking. > Everything o.k. after "zfs destroy big/big@backup" :-( > > I hope the info on arc_max will stay useful. > > Regards, > Robert > > -- > Dr. Robert Eckardt --- Robert.Eckardt@Robert-Eckardt.de > > There was a change between zfs v7 and v13. IN 7 when you did a zfs list it would show snapshots, after 13 it didnt unless you supplied the switch. It still catches me out as we have a right mix of zfs version at work, so dont feel to bad 8) From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 11:52:33 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0AD221065670 for ; Thu, 3 Sep 2009 11:52:33 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward2.yandex.ru (forward2.yandex.ru [77.88.46.7]) by mx1.freebsd.org (Postfix) with ESMTP id B09B88FC18 for ; Thu, 3 Sep 2009 11:52:32 +0000 (UTC) Received: from smtp3.yandex.ru (smtp3.yandex.ru [77.88.46.103]) by forward2.yandex.ru (Yandex) with ESMTP id 0957D3968896; Thu, 3 Sep 2009 15:41:17 +0400 (MSD) Received: from [127.0.0.1] (ns.kirov.so-cdu.ru [77.72.136.145]) by smtp3.yandex.ru (Yandex) with ESMTPSA id A6ACA8B8079; Thu, 3 Sep 2009 15:41:16 +0400 (MSD) Message-ID: <4A9FAB5A.6020302@yandex.ru> Date: Thu, 03 Sep 2009 15:41:14 +0400 From: "Andrey V. Elsukov" User-Agent: Mozilla Thunderbird 1.5 (FreeBSD/20051231) MIME-Version: 1.0 To: krad References: <20090902193059.M336@Robert-Eckardt.de> <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> <20090903071913.M84990@Robert-Eckardt.de> <20090903080558.M13772@Robert-Eckardt.de> <20090903094501.M34547@robert-eckardt.de> In-Reply-To: Content-Type: text/plain; charset=KOI8-R; format=flowed Content-Transfer-Encoding: 7bit X-Yandex-TimeMark: 1251978076 X-Yandex-Spam: 1 X-Yandex-Front: smtp3.yandex.ru Cc: hackers@freebsd.org, Adrian Penisoara Subject: Re: Fw: Re: ZFS continuously growing [SOLVED] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 11:52:33 -0000 krad wrote: > There was a change between zfs v7 and v13. IN 7 when you did a zfs list it > would show snapshots, after 13 it didnt unless you supplied the switch. It > still catches me out as we have a right mix of zfs version at work, so dont > feel to bad 8) Try: # zpool set listsnapshots=on -- WBR, Andrey V. Elsukov From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 14:07:30 2009 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3336A106566C for ; Thu, 3 Sep 2009 14:07:30 +0000 (UTC) (envelope-from ticso@cicely7.cicely.de) Received: from raven.bwct.de (raven.bwct.de [85.159.14.73]) by mx1.freebsd.org (Postfix) with ESMTP id AA2CD8FC15 for ; Thu, 3 Sep 2009 14:07:29 +0000 (UTC) Received: from cicely5.cicely.de ([10.1.1.7]) by raven.bwct.de (8.13.4/8.13.4) with ESMTP id n83DWAr4089504 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Thu, 3 Sep 2009 15:32:10 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (cicely7.cicely.de [10.1.1.9]) by cicely5.cicely.de (8.14.2/8.14.2) with ESMTP id n83DW7eu086084 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 3 Sep 2009 15:32:07 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (localhost [127.0.0.1]) by cicely7.cicely.de (8.14.2/8.14.2) with ESMTP id n83DW7ae070251; Thu, 3 Sep 2009 15:32:07 +0200 (CEST) (envelope-from ticso@cicely7.cicely.de) Received: (from ticso@localhost) by cicely7.cicely.de (8.14.2/8.14.2/Submit) id n83DW7t6070250; Thu, 3 Sep 2009 15:32:07 +0200 (CEST) (envelope-from ticso) Date: Thu, 3 Sep 2009 15:32:07 +0200 From: Bernd Walter To: "Andrey V. Elsukov" Message-ID: <20090903133207.GC60240@cicely7.cicely.de> References: <20090902193059.M336@Robert-Eckardt.de> <78cb3d3f0909030009y505a30by769052258576bfeb@mail.gmail.com> <20090903071913.M84990@Robert-Eckardt.de> <20090903080558.M13772@Robert-Eckardt.de> <20090903094501.M34547@robert-eckardt.de> <4A9FAB5A.6020302@yandex.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4A9FAB5A.6020302@yandex.ru> X-Operating-System: FreeBSD cicely7.cicely.de 7.0-STABLE i386 User-Agent: Mutt/1.5.11 X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED=-1.8, AWL=0.001, BAYES_00=-2.599 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on spamd.cicely.de Cc: Adrian Penisoara , hackers@freebsd.org, krad Subject: Re: Fw: Re: ZFS continuously growing [SOLVED] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 14:07:30 -0000 On Thu, Sep 03, 2009 at 03:41:14PM +0400, Andrey V. Elsukov wrote: > krad wrote: > >There was a change between zfs v7 and v13. IN 7 when you did a zfs list it > >would show snapshots, after 13 it didnt unless you supplied the switch. It > >still catches me out as we have a right mix of zfs version at work, so dont > >feel to bad 8) > > Try: > # zpool set listsnapshots=on Ah - I already did an zlist alias... This however is better for my routined fingers. -- B.Walter http://www.bwct.de Modbus/TCP Ethernet I/O Baugruppen, ARM basierte FreeBSD Rechner uvm. From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 15:50:06 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C17A4106566C; Thu, 3 Sep 2009 15:50:06 +0000 (UTC) (envelope-from faust64@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.158]) by mx1.freebsd.org (Postfix) with ESMTP id F0F7C8FC0C; Thu, 3 Sep 2009 15:50:05 +0000 (UTC) Received: by fg-out-1718.google.com with SMTP id 16so738123fgg.13 for ; Thu, 03 Sep 2009 08:50:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :from:date:message-id:subject:to:content-type; bh=HK6eTgIdnbebMlIhf027ur9TaSEJ5wWMDhM4Hi/rtPo=; b=n/pawIFx3ZZwatK/1hTgUKkD1O+RC+RUFLhILXu5sqMJzsaflfYVWTqzS23a+cZJe8 zMPrKuUbwmph6A/kLBroPKTOq6YTrpEb2KW641BmNP4s7AKZGtFNNXrAdbi0gUL91MsS SaprWbMzai2gBpks7uU2YSkgDM+5TIo+dUJE4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; b=A6QnsYMj7uX9bKkteuz6q46AWyAQLjv89H030dnd/VZp4M0CtGKIHXHcptkNegSpQJ nzBB5syfuvogmbvzOS28boZjciJF4sTw8XSWyacy5scSE7tem7QzYPfODa+FKmnSZTqr 3iKtWKSovS5oS6d6RdzPRf8XD0ZwxbhAeVRyE= MIME-Version: 1.0 Received: by 10.86.13.37 with SMTP id 37mr4061525fgm.58.1251993005102; Thu, 03 Sep 2009 08:50:05 -0700 (PDT) In-Reply-To: References: From: =?ISO-8859-1?Q?Samuel_Mart=EDn_Moro?= Date: Thu, 3 Sep 2009 17:49:45 +0200 Message-ID: To: freebsd-questions@freebsd.org, freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: Re: Making bootable USB keys X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 15:50:06 -0000 hello. again. btw: my .img file is 0-filled in its 512 first bytes... i downloaded the 8-0-BETA3-???.img, it starts with EB3C. and I think each .img file start like that, right ? thanks Samuel Mart=EDn Moro CamTrace {EPITECH.} tek4 On Thu, Sep 3, 2009 at 5:35 PM, Samuel Mart=EDn Moro wro= te: > > Hello > > I'm having some troubles, trying to create bootable USB keys. > I found (freebsd-hackers ML archives) a script, supposed to create the > bootable image from my iso file. > But, it still don't boot... (I may do it wrong) > > In details: > -We distribute a FreeBSD (4.7, 5.4, 6.2 and 7.2) "custom" server. > -We burn our install CD (and, in a few, our USB sticks) on a Ferdora 9 > (sorry...) > -USB sticks must contain a FAT32 partition (we'ld like to provide doc for > windows users) > > Well, my english isn't so great... so I'll post my code (more > understandable) > > --maker.sh-- > #!/bin/sh > ISO_DIR=3D/r00t > ISO_PFIX=3Dr00t > VERSION=3D5.9.3.0 > ISO_FILE=3D$ISO_DIR/$ISO_PFIX-$VERSION.img > DEVICE=3D > TMPDOC=3D/mnt/tmpdoc > DOCDIR=3D/root/samuel/docdir > ERR=3D > SFX=3D > MBR=3D/root/samuel/mbr > BT1=3D/root/samuel/boot1 > BT2=3D/root/samuel/boot2 > > if [ -e "$1" ]; then > DEVICE=3D$1 > elif [ "$1" -a -e "/dev/$1" ]; then > DEVICE=3D/dev/$1 > elif [ "$1" ]; then > echo "$0: incorrect device specified" >&2 > exit > else > echo "$0: must specify device" >&2 > exit > fi > for i in `mount | cut -d ' ' -f 1` > do > if [ "`echo $i | grep $DEVICE`" ]; then > echo "$0: $i already mounted" >&2 > echo " umount it manually or choose an other drive" >&2 > exit > fi > done > > if [ -e "$TMPDOC" -a -d "$TMPDOC" ]; then > echo "$0: removing $TMPDOC directory" >&2 > rm -rf $TMPDOC > elif [ -e "$TMPDOC" ]; then > mv $TMPDOC $TMPDOC.old > echo "$0: moved $TMPDOC to $TMPDOC.old" >&2 > fi > mkdir $TMPDOC > > if [ "$2" ]; then > echo $2 | grep "\.img$" >/dev/null || SFX=3D".img" > fi > > if [ -e "$2$SFX" ]; then > ISO_FILE=3D$2$SFX > elif [ "$2" -a -e "$ISO_DIR/$2$SFX" ]; then > ISO_FILE=3D$ISO_DIR/$2 > elif [ "$2" -a -e "$ISO_DIR/$ISO_PFIX-$2$SFX" ]; then > ISO_FILE=3D"$ISO_DIR/$ISO_PFX-$2$SFX" > else > echo "$0: will use default file \`$ISO_FILE'" >&2 > echo " as system image source" >&2 > fi > if [ -e "$ISO_FILE" ]; then > MSize=3D`ls -l $ISO_FILE | awk '{print $5}'` > else > echo "$0: $ISO_FILE doesn't exist!" >&2 > rm -rf $TMPDOC > exit > fi > if [ -z "$MSize" -o "$MSize" -lt 1 ]; then > echo "$0: bad image size (size=3D$MSize)" >&2 > rm -rf $TMPDOC > exit > fi > > while : > do > echo " [ Working on $DEVICE ]" > > echo -n " determining device geometry " > infos=3D`fdisk -l $DEVICE 2>/dev/null | grep "[0-9]* heads"` > ident=3D`fdisk -l $DEVICE 2>/dev/null | awk '/Disk identifier/{print > $3}'` > csz=3D`fdisk -l $DEVICE 2>/dev/null | awk '/Units =3D cylinders /{pri= nt > $7}'` > eval `echo $infos | awk '{print "hpc=3D" $1 " sec=3D" $3 " cyl=3D" $5= }'` > if [ -z "$hpc" -o -z "$sec" -o -z "$cyl" -o -z "$csz" ]; then > echo " [ FAIL ]" > echo "$0: can't get infos for device $DEVICE" >&2 > rm -rf $TMPDOC > exit > fi > echo " [ OK ]" > > echo -n " initializing partition table " > # dd if=3D/dev/zero of=3D$DEVICE bs=3D$csz count=3D1 >/dev/null 2>&1 > dd if=3D$BT1 of=3D$DEVICE >/dev/null 2>&1 > round=3D128 > tocyl=3D`expr $hpc '*' $sec '*' $csz` > ret=3D`expr $MSize % $tocyl` > MSize=3D`expr $MSize / $tocyl` > test "$ret" -eq "0" || MSize=3D`expr $MSize + 1` > s2len=3D$MSize > s2off=3D`expr $cyl - $s2len - 1` > s1len=3D`expr $s2off - 1` > s1off=3D1 > sfdisk -DLqf $DEVICE >/dev/null 2>&1 < $s1off $s1len b > $s2off $s2len a5 * > EOF > echo " [ OK ]" > > echo -n " formatting FAT32 partition " > dd if=3D/dev/zero of=3D${DEVICE}1 bs=3D$csz count=3D1 >/dev/null 2>&1 > mkdosfs -i 42424242 -n "Docs" -F 32 ${DEVICE}1 >/dev/null 2>&1 > mount -t vfat ${DEVICE}1 $TMPDOC || ERR=3D1 > if [ "$ERR" ]; then > echo " [ FAIL ]" > echo "$0: unable to mount ${DEVICE}1 on $TMPDOC" > rm -rf $TMPDOC > exit > fi > echo " [ OK ]" > > echo -n " copying documentation files " > cp -rp $DOCDIR/* $TMPDOC/ >/dev/null 2>&1 || ERR=3D2 > if [ "$ERR" ]; then > echo " [ FAIL ]" > echo "$0: unable to copy doc files" > ERR=3D > fi > umount ${DEVICE}1 > echo " [ OK ]" > > echo -n " copying system " > dd if=3D$ISO_FILE of=3D${DEVICE}2 status=3Dnoxfer >/dev/null 2>&1 > echo " [ OK ]" > > mbrsig $DEVICE 2>&1 | awk '{print " marking device with serial " $= 3 > }' > echo " [ Device ready! ]" > echo "" > echo -n " Create new USB key ? [Y/N] : " && read i > test "$i" =3D "Y" -o "$i" =3D "y" -o "$i" =3D "O" -o "$i" =3D "o" || = i=3D > test -z "$i" && echo " [ leaving ]" && break > echo " Please, remove current USB key, insert new one and press enter= " > read i > done > rmdir $TMPDOC > --EOF-- > > So, this is a "USB stick generator" I'm working on. > It seems to work. (I've not tested everything, but the basis is OK) > The stick is correctly parted. > The documentation is copied. > My only problem is that it still don't wan't to boot... > > At the beginning, I was trying to paste my ISO file directly in ${DEVICE}= 2 > Then, I found the following shell script, which is supposed to make my > bootable image from my ISO file > I changed 2/3 things, but some of you may recognize it anyway: > > --ISOtoIMG.sh-- > #!/bin/sh > MAKEFS=3Dmakefs > MKLABEL=3Dbsdlabel > BSDTAR=3Dtar > DD=3D"dd status=3Dnoxfer" > > make_freebsd_image() > { > local tree=3D$1 > local imagefile=3D$2 > local boot1=3D${tree}/boot/boot1 > local boot2=3D${tree}/boot/boot2 > > echo "convert tree $tree image $imagefile" > ${MAKEFS} -t ffs -o bsize=3D4096 -o fsize=3D512 -f 50 ${imagefile} ${tr= ee} > >/dev/null 2>&1 > ${MKLABEL} -w -f ${imagefile} auto >/dev/null 2>&1 > ${MKLABEL} -f ${imagefile} 2>/dev/null | sed -e '/ c:/{p;s/c:/a:/;}' | = \ > ${MKLABEL} -R -f ${imagefile} /dev/stdin >/dev/null 2>&1 > ${DD} if=3D${boot1} of=3D${imagefile} conv=3Dnotrunc >/dev/null 2>&1 > ${DD} if=3D${boot2} iseek=3D1 ibs=3D276 2>/dev/null | \ > ${DD} of=3D${imagefile} oseek=3D1 obs=3D788 conv=3Dnotrunc >/dev/null 2= >&1 > } > > extract_image() > { > [ -f $1 ] || return > local tmp=3D"${tree}.tree" > [ -e ${tmp} ] && rm -rf ${tmp} > mkdir -p $tmp > echo "extracting $tree in $tmp" > (cd $tmp && ${BSDTAR} xf $tree) > tree=3D$tmp > } > > if [ -z "$1" ]; then > echo "$0: usage" >&2 > echo " $0 {ISO_input} | {system_root IMG_output}" >&2 > exit > fi > tree=3D`realpath $1` > [ "$2" ] && image=3D`realpath $2` || image=3D`echo $tree | sed "s/.iso/.i= mg/"` > extract_image $tree > make_freebsd_image $tree $image > [ -d "$tmp" ] && (chmod -R +w $tmp && rm -rf $tmp) > --EOF-- > > This seems to work, too... > I'm just surprised: > root@granit:~/samuel# l -h /r00t/r00t-5.9.3.0* > -rw-r--r-- 1 root root 566M 2009-09-03 15:29 /r00t/r00t-5.9.3.0.img > -rw-r--r-- 1 root root 526M 2009-08-08 06:58 /r00t/r00t-5.9.3.0.iso > new file is 40M heavier than our iso image... > > Also, in the first script, I tried to do the first dd (initializing > ${DEVICE}) with: > - if=3D$MBR > - if=3D$BT1 > - if=3D$BT2 > - if=3D/dev/zero > none of that worked... > > So. > Does someone understand what am I doing wrong?! > > > Thanks for you help! > > Samuel Mart=EDn Moro > CamTrace > {EPITECH.} tek4 > > From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 3 16:07:03 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2C7611065676 for ; Thu, 3 Sep 2009 16:07:03 +0000 (UTC) (envelope-from faust64@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.154]) by mx1.freebsd.org (Postfix) with ESMTP id 7F2C68FC1A for ; Thu, 3 Sep 2009 16:07:02 +0000 (UTC) Received: by fg-out-1718.google.com with SMTP id 16so743622fgg.13 for ; Thu, 03 Sep 2009 09:07:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:from:date:message-id :subject:to:content-type; bh=uoKYdsTqGACU4+JgIe/IQkbW1SAhgXPl126yjdIe7SA=; b=EeqCpJTPTjhSFK3nw1NBMDOtJgt+KbyDOXdEckoKJM3enoINI9rAgtrgyKNbygpQ6x yR5WUQd8yMXF10Gg7vD1yUg8ifiWRCLKQNQ/tBFFEXv0BjjmEdch8Rt+NeRoz6TSu+4y Ndt73PIXLOcl1oN9dr2s9zWVEwxeeJJlBjHRs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:from:date:message-id:subject:to:content-type; b=agJQoOE6sb8BZIRnVbHVcBSg4UxfWQ8d/qRfmlK1hwudEguAW1ENeIPuUZ9m9K+uoS vZWWQ5aNemdrhLqSdAI9ItjXE5J0459IWNQkts4P9QwUjXDce51PBGS91vyeim4M8LSI ZWvddYMclp4DfOZcerqxEtajpvY8CqB12a7y8= MIME-Version: 1.0 Received: by 10.86.190.37 with SMTP id n37mr4042299fgf.39.1251992154210; Thu, 03 Sep 2009 08:35:54 -0700 (PDT) From: =?ISO-8859-1?Q?Samuel_Mart=EDn_Moro?= Date: Thu, 3 Sep 2009 17:35:34 +0200 Message-ID: To: freebsd-questions@freebsd.org, freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: Making bootable USB keys X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Sep 2009 16:07:03 -0000 Hello I'm having some troubles, trying to create bootable USB keys. I found (freebsd-hackers ML archives) a script, supposed to create the bootable image from my iso file. But, it still don't boot... (I may do it wrong) In details: -We distribute a FreeBSD (4.7, 5.4, 6.2 and 7.2) "custom" server. -We burn our install CD (and, in a few, our USB sticks) on a Ferdora 9 (sorry...) -USB sticks must contain a FAT32 partition (we'ld like to provide doc for windows users) Well, my english isn't so great... so I'll post my code (more understandable) --maker.sh-- #!/bin/sh ISO_DIR=3D/r00t ISO_PFIX=3Dr00t VERSION=3D5.9.3.0 ISO_FILE=3D$ISO_DIR/$ISO_PFIX-$VERSION.img DEVICE=3D TMPDOC=3D/mnt/tmpdoc DOCDIR=3D/root/samuel/docdir ERR=3D SFX=3D MBR=3D/root/samuel/mbr BT1=3D/root/samuel/boot1 BT2=3D/root/samuel/boot2 if [ -e "$1" ]; then DEVICE=3D$1 elif [ "$1" -a -e "/dev/$1" ]; then DEVICE=3D/dev/$1 elif [ "$1" ]; then echo "$0: incorrect device specified" >&2 exit else echo "$0: must specify device" >&2 exit fi for i in `mount | cut -d ' ' -f 1` do if [ "`echo $i | grep $DEVICE`" ]; then echo "$0: $i already mounted" >&2 echo " umount it manually or choose an other drive" >&2 exit fi done if [ -e "$TMPDOC" -a -d "$TMPDOC" ]; then echo "$0: removing $TMPDOC directory" >&2 rm -rf $TMPDOC elif [ -e "$TMPDOC" ]; then mv $TMPDOC $TMPDOC.old echo "$0: moved $TMPDOC to $TMPDOC.old" >&2 fi mkdir $TMPDOC if [ "$2" ]; then echo $2 | grep "\.img$" >/dev/null || SFX=3D".img" fi if [ -e "$2$SFX" ]; then ISO_FILE=3D$2$SFX elif [ "$2" -a -e "$ISO_DIR/$2$SFX" ]; then ISO_FILE=3D$ISO_DIR/$2 elif [ "$2" -a -e "$ISO_DIR/$ISO_PFIX-$2$SFX" ]; then ISO_FILE=3D"$ISO_DIR/$ISO_PFX-$2$SFX" else echo "$0: will use default file \`$ISO_FILE'" >&2 echo " as system image source" >&2 fi if [ -e "$ISO_FILE" ]; then MSize=3D`ls -l $ISO_FILE | awk '{print $5}'` else echo "$0: $ISO_FILE doesn't exist!" >&2 rm -rf $TMPDOC exit fi if [ -z "$MSize" -o "$MSize" -lt 1 ]; then echo "$0: bad image size (size=3D$MSize)" >&2 rm -rf $TMPDOC exit fi while : do echo " [ Working on $DEVICE ]" echo -n " determining device geometry " infos=3D`fdisk -l $DEVICE 2>/dev/null | grep "[0-9]* heads"` ident=3D`fdisk -l $DEVICE 2>/dev/null | awk '/Disk identifier/{print $3= }'` csz=3D`fdisk -l $DEVICE 2>/dev/null | awk '/Units =3D cylinders /{print $7}'` eval `echo $infos | awk '{print "hpc=3D" $1 " sec=3D" $3 " cyl=3D" $5}'= ` if [ -z "$hpc" -o -z "$sec" -o -z "$cyl" -o -z "$csz" ]; then echo " [ FAIL ]" echo "$0: can't get infos for device $DEVICE" >&2 rm -rf $TMPDOC exit fi echo " [ OK ]" echo -n " initializing partition table " # dd if=3D/dev/zero of=3D$DEVICE bs=3D$csz count=3D1 >/dev/null 2>&1 dd if=3D$BT1 of=3D$DEVICE >/dev/null 2>&1 round=3D128 tocyl=3D`expr $hpc '*' $sec '*' $csz` ret=3D`expr $MSize % $tocyl` MSize=3D`expr $MSize / $tocyl` test "$ret" -eq "0" || MSize=3D`expr $MSize + 1` s2len=3D$MSize s2off=3D`expr $cyl - $s2len - 1` s1len=3D`expr $s2off - 1` s1off=3D1 sfdisk -DLqf $DEVICE >/dev/null 2>&1 </dev/null 2>&1 mkdosfs -i 42424242 -n "Docs" -F 32 ${DEVICE}1 >/dev/null 2>&1 mount -t vfat ${DEVICE}1 $TMPDOC || ERR=3D1 if [ "$ERR" ]; then echo " [ FAIL ]" echo "$0: unable to mount ${DEVICE}1 on $TMPDOC" rm -rf $TMPDOC exit fi echo " [ OK ]" echo -n " copying documentation files " cp -rp $DOCDIR/* $TMPDOC/ >/dev/null 2>&1 || ERR=3D2 if [ "$ERR" ]; then echo " [ FAIL ]" echo "$0: unable to copy doc files" ERR=3D fi umount ${DEVICE}1 echo " [ OK ]" echo -n " copying system " dd if=3D$ISO_FILE of=3D${DEVICE}2 status=3Dnoxfer >/dev/null 2>&1 echo " [ OK ]" mbrsig $DEVICE 2>&1 | awk '{print " marking device with serial " $3 }' echo " [ Device ready! ]" echo "" echo -n " Create new USB key ? [Y/N] : " && read i test "$i" =3D "Y" -o "$i" =3D "y" -o "$i" =3D "O" -o "$i" =3D "o" || i= =3D test -z "$i" && echo " [ leaving ]" && break echo " Please, remove current USB key, insert new one and press enter" read i done rmdir $TMPDOC --EOF-- So, this is a "USB stick generator" I'm working on. It seems to work. (I've not tested everything, but the basis is OK) The stick is correctly parted. The documentation is copied. My only problem is that it still don't wan't to boot... At the beginning, I was trying to paste my ISO file directly in ${DEVICE}2 Then, I found the following shell script, which is supposed to make my bootable image from my ISO file I changed 2/3 things, but some of you may recognize it anyway: --ISOtoIMG.sh-- #!/bin/sh MAKEFS=3Dmakefs MKLABEL=3Dbsdlabel BSDTAR=3Dtar DD=3D"dd status=3Dnoxfer" make_freebsd_image() { local tree=3D$1 local imagefile=3D$2 local boot1=3D${tree}/boot/boot1 local boot2=3D${tree}/boot/boot2 echo "convert tree $tree image $imagefile" ${MAKEFS} -t ffs -o bsize=3D4096 -o fsize=3D512 -f 50 ${imagefile} ${tree= } >/dev/null 2>&1 ${MKLABEL} -w -f ${imagefile} auto >/dev/null 2>&1 ${MKLABEL} -f ${imagefile} 2>/dev/null | sed -e '/ c:/{p;s/c:/a:/;}' | \ ${MKLABEL} -R -f ${imagefile} /dev/stdin >/dev/null 2>&1 ${DD} if=3D${boot1} of=3D${imagefile} conv=3Dnotrunc >/dev/null 2>&1 ${DD} if=3D${boot2} iseek=3D1 ibs=3D276 2>/dev/null | \ ${DD} of=3D${imagefile} oseek=3D1 obs=3D788 conv=3Dnotrunc >/dev/null 2>&= 1 } extract_image() { [ -f $1 ] || return local tmp=3D"${tree}.tree" [ -e ${tmp} ] && rm -rf ${tmp} mkdir -p $tmp echo "extracting $tree in $tmp" (cd $tmp && ${BSDTAR} xf $tree) tree=3D$tmp } if [ -z "$1" ]; then echo "$0: usage" >&2 echo " $0 {ISO_input} | {system_root IMG_output}" >&2 exit fi tree=3D`realpath $1` [ "$2" ] && image=3D`realpath $2` || image=3D`echo $tree | sed "s/.iso/.img= /"` extract_image $tree make_freebsd_image $tree $image [ -d "$tmp" ] && (chmod -R +w $tmp && rm -rf $tmp) --EOF-- This seems to work, too... I'm just surprised: root@granit:~/samuel# l -h /r00t/r00t-5.9.3.0* -rw-r--r-- 1 root root 566M 2009-09-03 15:29 /r00t/r00t-5.9.3.0.img -rw-r--r-- 1 root root 526M 2009-08-08 06:58 /r00t/r00t-5.9.3.0.iso new file is 40M heavier than our iso image... Also, in the first script, I tried to do the first dd (initializing ${DEVICE}) with: - if=3D$MBR - if=3D$BT1 - if=3D$BT2 - if=3D/dev/zero none of that worked... So. Does someone understand what am I doing wrong?! Thanks for you help! Samuel Mart=EDn Moro CamTrace {EPITECH.} tek4 From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 4 13:39:06 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 616CD1065697 for ; Fri, 4 Sep 2009 13:39:06 +0000 (UTC) (envelope-from doconnor@gsoft.com.au) Received: from cain.gsoft.com.au (cain.gsoft.com.au [203.31.81.10]) by mx1.freebsd.org (Postfix) with ESMTP id C422D8FC1B for ; Fri, 4 Sep 2009 13:39:05 +0000 (UTC) Received: from inchoate.gsoft.com.au (ppp121-45-154-162.lns11.adl6.internode.on.net [121.45.154.162]) (authenticated bits=0) by cain.gsoft.com.au (8.13.8/8.13.8) with ESMTP id n84Dd26B006330 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Fri, 4 Sep 2009 23:09:02 +0930 (CST) (envelope-from doconnor@gsoft.com.au) From: "Daniel O'Connor" To: freebsd-hackers@freebsd.org Date: Fri, 4 Sep 2009 23:08:48 +0930 User-Agent: KMail/1.9.10 References: In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----------=_1252071543-1635-208" Content-Transfer-Encoding: binary Message-Id: <200909042308.56900.doconnor@gsoft.com.au> X-Spam-Score: -1.554 () AWL,BAYES_00,RDNS_DYNAMIC X-Scanned-By: MIMEDefang 2.63 on 203.31.81.10 Cc: Samuel =?utf-8?q?Mart=C3=ADn_Moro?= , freebsd-questions@freebsd.org Subject: Re: Making bootable USB keys X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Sep 2009 13:39:06 -0000 This is a multi-part message in MIME format... ------------=_1252071543-1635-208 Content-Type: text/plain; name="warning1.txt" Content-Disposition: inline; filename="warning1.txt" Content-Transfer-Encoding: 7bit MIME-Version: 1.0 X-Mailer: MIME-tools 5.420 (Entity 5.420) WARNING: This e-mail has been altered by MIMEDefang. Following this paragraph are indications of the actual changes made. For more information about your site's MIMEDefang policy, contact Postmaster . For more information about MIMEDefang, see: http://www.roaringpenguin.com/mimedefang/enduser.php3 An attachment named makeusb.sh was removed from this document as it constituted a security hazard. If you require this document, please contact the sender and arrange an alternate means of receiving it. ------------=_1252071543-1635-208 From: "Daniel O'Connor" To: freebsd-hackers@freebsd.org Subject: Re: Making bootable USB keys Date: Fri, 4 Sep 2009 23:08:48 +0930 User-Agent: KMail/1.9.10 Cc: Samuel =?utf-8?q?Mart=C3=ADn_Moro?= , freebsd-questions@freebsd.org References: In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart5330086.0xA9gWm5I1"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200909042308.56900.doconnor@gsoft.com.au> --nextPart5330086.0xA9gWm5I1 Content-Type: multipart/mixed; boundary="Boundary-01=_phRoKBc8BkhUim6" Content-Transfer-Encoding: 7bit Content-Disposition: inline --Boundary-01=_phRoKBc8BkhUim6 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline On Fri, 4 Sep 2009, Samuel Mart=EDn Moro wrote: > I'm having some troubles, trying to create bootable USB keys. > I found (freebsd-hackers ML archives) a script, supposed to create > the bootable image from my iso file. > But, it still don't boot... (I may do it wrong) > > In details: > -We distribute a FreeBSD (4.7, 5.4, 6.2 and 7.2) "custom" server. > -We burn our install CD (and, in a few, our USB sticks) on a Ferdora > 9 (sorry...) > -USB sticks must contain a FAT32 partition (we'ld like to provide doc > for windows users) > > Well, my english isn't so great... so I'll post my code (more > understandable) I use the attached script (on FreeBSD :) to prep a USB stick for=20 booting. I imagine you could munge it into your setup without too much trouble. --=20 Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C --Boundary-01=_phRoKBc8BkhUim6-- --nextPart5330086.0xA9gWm5I1 Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.12 (FreeBSD) iD8DBQBKoRhw5ZPcIHs/zowRAjNqAJ9J21vz1JguijpSwmmNx6YTmvOl1gCgn734 1rRn5wDuZqPPTSSmiuSp0Kk= =+If5 -----END PGP SIGNATURE----- --nextPart5330086.0xA9gWm5I1-- ------------=_1252071543-1635-208-- From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 4 14:27:59 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3C5D21065679; Fri, 4 Sep 2009 14:27:59 +0000 (UTC) (envelope-from doconnor@gsoft.com.au) Received: from cain.gsoft.com.au (cain.gsoft.com.au [203.31.81.10]) by mx1.freebsd.org (Postfix) with ESMTP id A2BB98FC12; Fri, 4 Sep 2009 14:27:58 +0000 (UTC) Received: from inchoate.gsoft.com.au (ppp121-45-154-162.lns11.adl6.internode.on.net [121.45.154.162]) (authenticated bits=0) by cain.gsoft.com.au (8.13.8/8.13.8) with ESMTP id n84ERtvI007364 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Fri, 4 Sep 2009 23:57:56 +0930 (CST) (envelope-from doconnor@gsoft.com.au) From: "Daniel O'Connor" To: freebsd-hackers@freebsd.org Date: Fri, 4 Sep 2009 23:57:41 +0930 User-Agent: KMail/1.9.10 References: <200909042308.56900.doconnor@gsoft.com.au> In-Reply-To: <200909042308.56900.doconnor@gsoft.com.au> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart3204359.j9oQjvWtTP"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200909042357.50470.doconnor@gsoft.com.au> X-Spam-Score: -1.557 () AWL,BAYES_00,RDNS_DYNAMIC X-Scanned-By: MIMEDefang 2.63 on 203.31.81.10 Cc: Samuel =?utf-8?q?Mart=C3=ADn_Moro?= , freebsd-questions@freebsd.org Subject: Re: Making bootable USB keys X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Sep 2009 14:27:59 -0000 --nextPart3204359.j9oQjvWtTP Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline On Fri, 4 Sep 2009, Daniel O'Connor wrote: > WARNING: This e-mail has been altered by MIMEDefang. Following this > paragraph are indications of the actual changes made. For more > information about your site's MIMEDefang policy, contact > Postmaster . For more information about > MIMEDefang, see: > > http://www.roaringpenguin.com/mimedefang/enduser.php3 > > An attachment named makeusb.sh was removed from this document as it > constituted a security hazard. If you require this document, please > contact the sender and arrange an alternate means of receiving it. Oops try this http://www.gsoft.com.au/~doconnor/makeusb.sh =2D-=20 Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C --nextPart3204359.j9oQjvWtTP Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.12 (FreeBSD) iD8DBQBKoSPm5ZPcIHs/zowRAgQQAJ0TBwaFpG9Tn08ahfa20MABrobGhACcDNg0 ItmxZmLvkrK54edb5cgqdgk= =QAD7 -----END PGP SIGNATURE----- --nextPart3204359.j9oQjvWtTP-- From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 4 17:25:11 2009 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DC1A61065672 for ; Fri, 4 Sep 2009 17:25:11 +0000 (UTC) (envelope-from bright@elvis.mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id CD0148FC25 for ; Fri, 4 Sep 2009 17:25:11 +0000 (UTC) Received: by elvis.mu.org (Postfix, from userid 1192) id 9F02E1A3CE4; Fri, 4 Sep 2009 10:25:11 -0700 (PDT) Date: Fri, 4 Sep 2009 10:25:11 -0700 From: Alfred Perlstein To: Gabor Kovesdan Message-ID: <20090904172511.GI21946@elvis.mu.org> References: <4AA14437.4050507@FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4AA14437.4050507@FreeBSD.org> User-Agent: Mutt/1.4.2.3i Cc: FreeBSD developers Subject: Re: memchr() strangeness X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Sep 2009 17:25:11 -0000 Moved to -hackers. Gabor, can you please make a smaller program to exhibit this behavior? (not just the error line) I will be glad to help out. -Alfred * Gabor Kovesdan [090904 10:04] wrote: > Hello, > > having returned from vacation, I'm trying to track down the (hopefully) > last critical bug in BSDL grep I worked on the last summer. The binary > file detection is implemented as follows: > f->binary = memchr(binbuf, (filebehave != FILE_GZIP) ? '\0' : '\200', i > - 1) != NULL; > > There's some strange with this. In my normal environment it works fine: > server# echo foobar | ./grep -v '^ *+' > foobar > > But in a chroot environment the binary detection is broken: > # echo foobar | grep -v '^ *+' > foobar > Binary file (standard input) matches > > I don't know where things go bad. I've tried to print out the content of > the buffer and the buffer length and they are the same but somehow in > the chrooted environment this sets f->binary to true. > Any suggestions? > > Thanks in advance, > > -- > Gabor Kovesdan > FreeBSD Volunteer > > EMAIL: gabor@FreeBSD.org .:|:. gabor@kovesdan.org > WEB: http://people.FreeBSD.org/~gabor .:|:. http://kovesdan.org > > -- > This mail is for the internal use of the FreeBSD project committers, > and as such is private. This mail may not be published or forwarded > outside the FreeBSD committers' group or disclosed to other unauthorised > parties without the explicit permission of the author(s). -- - Alfred Perlstein .- AMA, VMOA #5191, 03 vmax, 92 gs500, 85 ch250 .- FreeBSD committer From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 4 17:59:05 2009 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8303D1065672 for ; Fri, 4 Sep 2009 17:59:05 +0000 (UTC) (envelope-from gabor@FreeBSD.org) Received: from server.mypc.hu (server.mypc.hu [87.229.73.95]) by mx1.freebsd.org (Postfix) with ESMTP id 3DA2A8FC18 for ; Fri, 4 Sep 2009 17:59:05 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by server.mypc.hu (Postfix) with ESMTP id A826914D94FE; Fri, 4 Sep 2009 19:43:33 +0200 (CEST) X-Virus-Scanned: amavisd-new at t-hosting.hu Received: from server.mypc.hu ([127.0.0.1]) by localhost (server.mypc.hu [127.0.0.1]) (amavisd-new, port 10024) with LMTP id rYp80ndNTJAw; Fri, 4 Sep 2009 19:43:33 +0200 (CEST) Received: from [192.168.1.105] (catv-80-98-231-64.catv.broadband.hu [80.98.231.64]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by server.mypc.hu (Postfix) with ESMTPSA id 3760314D692F; Fri, 4 Sep 2009 19:43:33 +0200 (CEST) Message-ID: <4AA151C9.1090301@FreeBSD.org> Date: Fri, 04 Sep 2009 19:43:37 +0200 From: Gabor Kovesdan User-Agent: Thunderbird 2.0.0.23 (Windows/20090812) MIME-Version: 1.0 To: Alfred Perlstein References: <4AA14437.4050507@FreeBSD.org> <20090904172511.GI21946@elvis.mu.org> In-Reply-To: <20090904172511.GI21946@elvis.mu.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: FreeBSD developers Subject: Re: memchr() strangeness X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Sep 2009 17:59:05 -0000 Alfred Perlstein escribió: > Moved to -hackers. > Thanks, this was my original intention. > Gabor, can you please make a smaller program to exhibit this behavior? > (not just the error line) > > I will be glad to help out. > After reading your mail, I've made a small program: #include #include #include #include int main(int argc, char *argv[]) { bool foo; foo = memchr(argv[1], '\0', strlen(argv[1])); if (foo) fprintf(stderr, "Ooooops!\n"); } And it works correctly, so actually grep fails somewhere else but it's very strange why it behaves differently jailed (or chrooted). Once submitted it for a portbuild test because it had been working correctly for me on a production system and then it failed on the cluster because the package build run jailed. And then I created a jail and in fact I could reproduce this but only in the jail. Regards, -- Gabor Kovesdan FreeBSD Volunteer EMAIL: gabor@FreeBSD.org .:|:. gabor@kovesdan.org WEB: http://people.FreeBSD.org/~gabor .:|:. http://kovesdan.org From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 4 18:14:26 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AE051106568F for ; Fri, 4 Sep 2009 18:14:26 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.186]) by mx1.freebsd.org (Postfix) with ESMTP id 43D6C8FC16 for ; Fri, 4 Sep 2009 18:14:25 +0000 (UTC) Received: from vampire.homelinux.org (dslb-088-066-055-212.pools.arcor-ip.net [88.66.55.212]) by mrelayeu.kundenserver.de (node=mreu1) with ESMTP (Nemesis) id 0MKv1o-1MjdIk0dRd-000Gz5; Fri, 04 Sep 2009 20:14:22 +0200 Received: (qmail 16885 invoked from network); 4 Sep 2009 18:14:21 -0000 Received: from kvm.laiers.local (HELO kvm.localnet) (192.168.4.200) by laiers.local with SMTP; 4 Sep 2009 18:14:21 -0000 From: Max Laier Organization: FreeBSD To: freebsd-hackers@freebsd.org Date: Fri, 4 Sep 2009 20:14:20 +0200 User-Agent: KMail/1.12.0 (Linux/2.6.30-ARCH; KDE/4.3.0; x86_64; ; ) References: <4AA14437.4050507@FreeBSD.org> <20090904172511.GI21946@elvis.mu.org> <4AA151C9.1090301@FreeBSD.org> In-Reply-To: <4AA151C9.1090301@FreeBSD.org> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Message-Id: <200909042014.21290.max@love2party.net> X-Provags-ID: V01U2FsdGVkX19gvuNPkl3Xx4Of8GSFOybWI4F+mUWmcbxZZOY x5/guP1s6P8xyFHQw1YGZDbAwmI92u2M+KlLX7WTEko2NcHz0V dQuqjpS0DTsvyyC0FPb2g== Subject: Re: memchr() strangeness X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Sep 2009 18:14:26 -0000 On Friday 04 September 2009 19:43:37 Gabor Kovesdan wrote: > Alfred Perlstein escribi=F3: > > Moved to -hackers. > > Thanks, this was my original intention. > > > Gabor, can you please make a smaller program to exhibit this behavior? > > (not just the error line) > > > > I will be glad to help out. > > After reading your mail, I've made a small program: > > #include > #include > #include > #include > > int > main(int argc, char *argv[]) > { > bool foo; > > foo =3D memchr(argv[1], '\0', strlen(argv[1])); > if (foo) > fprintf(stderr, "Ooooops!\n"); > > } > > And it works correctly, so actually grep fails somewhere else but it's > very strange why it behaves differently jailed (or chrooted). Once > submitted it for a portbuild test because it had been working correctly > for me on a production system and then it failed on the cluster because > the package build run jailed. And then I created a jail and in fact I > could reproduce this but only in the jail. LC_* set to a locale not available in the jail? Just a wild guess. =2D-=20 /"\ Best regards, | mlaier@freebsd.org \ / Max Laier | ICQ #67774661 X http://pf4freebsd.love2party.net/ | mlaier@EFnet / \ ASCII Ribbon Campaign | Against HTML Mail and News From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 5 17:03:39 2009 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F3950106568B; Sat, 5 Sep 2009 17:03:38 +0000 (UTC) (envelope-from mitchell@wyatt672earp.force9.co.uk) Received: from relay.pcl-ipout01.plus.net (relay.pcl-ipout01.plus.net [212.159.7.99]) by mx1.freebsd.org (Postfix) with ESMTP id 70ADF8FC12; Sat, 5 Sep 2009 17:03:38 +0000 (UTC) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: ApoEABMwokrUnw6U/2dsb2JhbADYOoQYBYFU Received: from fhw-relay07.plus.net ([212.159.14.148]) by relay.pcl-ipout01.plus.net with ESMTP; 05 Sep 2009 17:34:04 +0100 Received: from [81.174.212.6] (helo=81-174-212-6.pth-as5.dial.plus.net) by fhw-relay07.plus.net with esmtp (Exim) id 1MjyDD-0001Nb-EF; Sat, 05 Sep 2009 17:34:03 +0100 From: Frank Mitchell To: ukfreebsd@uk.freebsd.org, freebsd-chat@freebsd.org, freebsd-hackers@freebsd.org Date: Sat, 5 Sep 2009 17:17:15 +0100 User-Agent: KMail/1.9.10 MIME-Version: 1.0 Content-Disposition: inline Message-Id: <200909051717.15321.mitchell@wyatt672earp.force9.co.uk> Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Plusnet-Relay: df64f0a7d9cf4f628b3979aa18f69a87 Cc: Subject: Death By NetBSD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Sep 2009 17:03:39 -0000 Hi: Recently I installed NetBSD, then found FreeBSD wouldn't start. I had this problem before and believed it was due to a bug in the NetBSD Boot Selector, which I avoided installing. But this time it looked as if my FreeBSD Partition got wiped completely. Re-trying, it looked like NetBSD spotted the FreeBSD FFSv2 Partition and decided to assign it a Mount Point of "/". This is listed if you look closely under "NetBSD Disklabel Partitions... last chance to change". I edited that Mount Point away and afterwards my (reinstalled) FreeBSD was still present. Hey, I'm glad I keep my Data on a separate Partition. Am I the only guy who didn't know about this? Yours Truly: Frank Mitchell