From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 04:08:26 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 38B5A1065674 for ; Sun, 29 Apr 2012 04:08:26 +0000 (UTC) (envelope-from access@ymail.com) Received: from doctortodoctormagazine.com (doctortodoctormagazine.com [IPv6:2001:470:0:11b::403e:a75a]) by mx1.freebsd.org (Postfix) with SMTP id 26FFC8FC12 for ; Sun, 29 Apr 2012 04:08:26 +0000 (UTC) Received: from echo.he.net ([127.0.0.9]) by doctortodoctormagazine.com for ; Sat, 28 Apr 2012 21:08:24 -0700 Message-Id: <1335672504.5921@echo.he.net> Date: Sat, 28 Apr 2012 21:08:24 -0700 To: Friend From: Devie Gibson X-Mailer: PHP/5.2.4-2ubuntu5.23 Subject: I found something on the Doctor to Doctor Magazine Web Site X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: access@ymail.com List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 04:08:26 -0000 Hi Friend, Hi Friend, Congratulations: Get $1,500 Proven Commissions!!! We Start putting 25 referrals everyday 25 x 6 day\'s= 150 members in your team start April-23-29/2012 Cut Off Date. YOU ALREADY HAVE 188 Pre-Enrollee\\\'s and 25 PAID Member\\\'s everyday in your TEAM. And Still Growing AND IT IS STILL Waiting the $1,500 Commissions. IMPORTANT: APPLY NOW or Before April.29,2012 is the Cut-Off date!To lock in your Position! Was Price $69 (today It\'s only $10 Promo until April-29-2012) Lifetime Membership to secure $1,500 Commission Send on April-30/2012 Direct to your Paypal Account or C-Card.. So we understand what\'s the Power of our Team so don\'t wasting your time act now!!!. advance member join before cut-off you are early recieved commissions.. Secure your position in the fast growing Powerline above all the people below you! Get Positioned Immediately with Priority Placement in the Fastest Growing TEAM Cash Waiting Here: http://payspree.com/6629/dollar2012 , TYPE = Date & Time == New PAID Members ====== Country\'s M April.28 @ 11:19 PM = Shelly Marquez ===== United States M April.28 @ 11:19 PM == Rolldan Pacson ===== United States M April.28 @ 06:23 PM === Stephen Harris ===== Canada M April.28 @ 11:19 PM ==== Jackie Parkers ===== United States M April.28 @ 11:19 PM ===== Rowena Harison ===== United States M April.28 @ 06:23 PM ====== Geralden Roses ===== New Zealand M April.28 @ 08:26 AM ======= Renee Jenkinse ===== Australia P April.28 @ 02:31 PM ======== Elizabeth Rios ===== Singapore M April.28 @ 02:37 PM ========= Karen Schiller ===== United Kingdom M April.28 @ 04:21 PM ========== Analou Roddman ===== Germany P April.28 @ 09:38 PM =========== Karen Stephens ===== Sri Lanka P April.28 @ 10:45 PM ============ Josephen Coper ===== United States M April.28 @ 10:19 AM ============= Vecky Camptons ===== United States P April.28 @ 08:32 PM ============ Gaynell Bailey ===== South Africa M April.28 @ 09:40 PM =========== Barbara Thunder ===== Netherlands P April.28 @ 10:21 AM ========== James Williams ===== North Carolina P April.28 @ 11:08 PM ========= David Robinson ===== United States M April.28 @ 12:39 AM ======== Carolyn Smiths ===== Hungary M April.28 @ 02:30 AM ======= Andrew Stocton ===== New Zealand P April.28 @ 02:42 AM ====== Matthew Evander ===== Portugal M April.28 @ 08:18 AM ===== Steven Hopekin ===== United States P April.28 @ 02:38 AM ==== Jenny Hamilton ===== United States P April.28 @ 02:53 AM === Stefany Gibson ===== Italy P April.28 @ 02:38 AM == Amie Stephenson ===== United States P April.28 @ 02:53 AM = Roben Mcartney ===== United Kingdom Therefore, you have a GUARANTEED $1,500 Commission every month from now on!. Earn $10 Per Process! Each $10 x 150 =$1,500 Commission will be yours...! Be Sure to Copy the link below & Paste into your browser and press enter: To Secure your $1,500 commission! Cash Waiting Here: http://payspree.com/6629/dollar2012 Once your membership is approved .all referral members under your name.all of the fallowing sales DIRECTLY Deposit to your Paypal account.And also members join on April 2012.And May 2012 all coming Commissions will be yours. Date: April 28, 2012 >From the Desk of: Devie Gibson Director Of Human Resources United States P.P.S. This one-time, limited offer will not last much longer. Don’t let the chance of a lifetime pass you by. This is the opportunity you may have been waiting your entire life for.Don’t delay any longer,click “ Add To Cart” and join now and start making money online today. http://www.doctortodoctormagazine.com/stories.php?storyid=407&advid=2232 Sincerely, Devie Gibson From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 05:17:44 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B5736106564A for ; Sun, 29 Apr 2012 05:17:44 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-wi0-f172.google.com (mail-wi0-f172.google.com [209.85.212.172]) by mx1.freebsd.org (Postfix) with ESMTP id 3AD8A8FC0A for ; Sun, 29 Apr 2012 05:17:44 +0000 (UTC) Received: by wibhj6 with SMTP id hj6so1452548wib.13 for ; Sat, 28 Apr 2012 22:17:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=qM9+XEeGCIniAse/KnTCwe3z51zLYaxT6HGj0zRkGvY=; b=rhAI8016C+3BiyEFpgorQON2LZjTnB+rH8NOcXHwYj39ohZo37JAGm7y4INrV/xXL/ rHiBUipHVA6damq3DfRDcWyynmSHIYeDRjtH+h6OW79BvKASLiAUWw0BKxEtMBDYyJNz k9hsXcrAbvHlT0a/3GHv9mK5JxpxLjxeikdNz2piD7Kl0L4DeR79NYom/cbELJk89V6/ UiAxOkbCXfxayoef2fb2CnSPUpQBoKWx5IZ3zAxsE+VJnFCgdRQPgxNV7gDWNVbTYPtD gTZcrmnM5gMcG9G8WBJeFwtIrvuwBJqNgYthnfLWTP4+qTG0b2Dy3c8PAX7/UWcqomkg Ralw== Received: by 10.181.12.82 with SMTP id eo18mr19228302wid.2.1335676662455; Sat, 28 Apr 2012 22:17:42 -0700 (PDT) Received: from mavbook2.mavhome.dp.ua (pc.mavhome.dp.ua. [212.86.226.226]) by mx.google.com with ESMTPS id fl2sm28597348wib.2.2012.04.28.22.17.39 (version=SSLv3 cipher=OTHER); Sat, 28 Apr 2012 22:17:40 -0700 (PDT) Sender: Alexander Motin Message-ID: <4F9CCEF2.6050609@FreeBSD.org> Date: Sun, 29 Apr 2012 08:17:38 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0.3) Gecko/20120328 Thunderbird/10.0.3 MIME-Version: 1.0 To: Oliver Pinter References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: Albert Shih , freebsd-stable@FreeBSD.org Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 05:17:44 -0000 On 04/29/12 01:53, Oliver Pinter wrote: > Attached the ktr file. This is on core2duo P9400 cpu ( > smbios.system.product="HP ProBook 5310m (WD792EA#ABU)" ). The workload > is only a single user boost: sh + top running, but the load average is > near 0.5. ktr shows no real load there. But it shows that you are using dummynet, that schedules its runs on every hardclock tick. I believe that load you see is the result or synchronization between dummynet calls and loadvg sampling, both of which called from hardclock. I think removing dummynet from equation, should hide this problem and also reduce you laptops power consumption. What's about fixing this, it is loadavg sampling algorithm that should be changed. Fixing dummynet to not run on every hardclock tick would also be great. > On 4/28/12, Alexander Motin wrote: >> On 04/28/12 00:34, Albert Shih wrote: >>> Le 27/04/2012 ? 22:45:40+0200, Oliver Pinter a écrit >>>>> I'm running 9-stable on all my computer. (csup yesterday). >>>>> >>>>> On my desktop everything is fine. But I've two laptop, (both are Dell). >>>>> On >>>>> both latptop I've problem about the load, event when I do nothing I got >>>>> a >>>>> load between 0.5-1. >>>>> >>>>> Here the result of a «top» on the laptop : >>>>> >>>>> last pid: 2434; load averages: 0.63, 0.67, 0.59 up 0+00:23:59 >>>>> 22:25:29 >>>>> 57 processes: 3 running, 54 sleeping >>>>> CPU: 2.7% user, 0.0% nice, 3.7% system, 1.4% interrupt, 92.2% idle >>>>> Mem: 89M Active, 92M Inact, 198M Wired, 13M Cache, 100M Buf, 3529M Free >>>>> Swap: 4096M Total, 4096M Free >>>>> >>>>> Here on the desktop : >>>>> >>>>> last pid: 61010; load averages: 0.00, 0.00, 0.00 up 2+11:02:42 >>>>> 22:29:08 >>>>> 126 processes: 1 running, 125 sleeping >>>>> CPU: % user, % nice, % system, % interrupt, % idle >>>>> Mem: 803M Active, 2874M Inact, 1901M Wired, 112M Cache, 620M Buf, 202M >>>>> Free >>>>> Swap: 6144M Total, 36M Used, 6107M Free >>>>> >>>> >>>> http://lists.freebsd.org/pipermail/freebsd-bugs/2012-April/048213.html >>> >>> What I understand of your message (I'm definitvly not a dev) is that's >>> only >>> a little problem of accounting. >>> >>> I'm not absolute sure of that because my laptop fan never stop... >>> >>> If you want any more information... >> >> Definitely, because here I don't see much. >> >> Generally, all CPU loads and load averages now calculated via sampling, >> so theoretically with spiky load numbers may vary for many reasons. I >> would start from collecting information about running processes. To find >> fast switching processes that could hide from accounting try `top -SH -m >> io -o vcsw`. To get more information about scheduler work, use >> /usr/src/tools/sched/schedgraph.py (instruction inside it). >> >> -- >> Alexander Motin >> -- Alexander Motin From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 06:09:56 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54E6C1065672; Sun, 29 Apr 2012 06:09:56 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) by mx1.freebsd.org (Postfix) with ESMTP id 9A4528FC08; Sun, 29 Apr 2012 06:09:55 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id q3T69Y1e024178; Sun, 29 Apr 2012 16:09:34 +1000 (EST) (envelope-from smithi@nimnet.asn.au) Date: Sun, 29 Apr 2012 16:09:34 +1000 (EST) From: Ian Smith To: Alexander Motin In-Reply-To: <4F9CCEF2.6050609@FreeBSD.org> Message-ID: <20120429155512.M91148@sola.nimnet.asn.au> References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-553176730-1335678991=:91148" Content-ID: <20120429155718.E91148@sola.nimnet.asn.au> Cc: Albert Shih , freebsd-stable@freebsd.org, Luigi Rizzo , Oliver Pinter Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 06:09:56 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-553176730-1335678991=:91148 Content-Type: TEXT/PLAIN; CHARSET=ISO-8859-1 Content-Transfer-Encoding: 8BIT Content-ID: <20120429155718.B91148@sola.nimnet.asn.au> On Sun, 29 Apr 2012 08:17:38 +0300, Alexander Motin wrote: > On 04/29/12 01:53, Oliver Pinter wrote: > > Attached the ktr file. This is on core2duo P9400 cpu ( > > smbios.system.product="HP ProBook 5310m (WD792EA#ABU)" ). The workload > > is only a single user boost: sh + top running, but the load average is > > near 0.5. > > ktr shows no real load there. But it shows that you are using dummynet, that > schedules its runs on every hardclock tick. I believe that load you see is > the result or synchronization between dummynet calls and loadvg sampling, > both of which called from hardclock. I think removing dummynet from equation, > should hide this problem and also reduce you laptops power consumption. > > What's about fixing this, it is loadavg sampling algorithm that should be > changed. Fixing dummynet to not run on every hardclock tick would also be > great. Wading in out of my depth, and copying Luigi in case he misses it .. but even back in the olden days when HZ defaulted to 100, one was advised to use HZ >= 1000 for smooth dummynet traffic shaping dispatch scheduling. I wonder, with the newer clocks and timers, whether there is another clock that could be used for dummynet scheduling, that would not have this effect (even if largely cosmetic?) on load average calculation? cheers, Ian > > On 4/28/12, Alexander Motin wrote: > > > On 04/28/12 00:34, Albert Shih wrote: > > > > Le 27/04/2012 ? 22:45:40+0200, Oliver Pinter a écrit > > > > > > I'm running 9-stable on all my computer. (csup yesterday). > > > > > > > > > > > > On my desktop everything is fine. But I've two laptop, (both are > > > > > > Dell). > > > > > > On > > > > > > both latptop I've problem about the load, event when I do nothing I > > > > > > got > > > > > > a > > > > > > load between 0.5-1. > > > > > > > > > > > > Here the result of a «top» on the laptop : > > > > > > > > > > > > last pid: 2434; load averages: 0.63, 0.67, 0.59 up 0+00:23:59 > > > > > > 22:25:29 > > > > > > 57 processes: 3 running, 54 sleeping > > > > > > CPU: 2.7% user, 0.0% nice, 3.7% system, 1.4% interrupt, 92.2% > > > > > > idle > > > > > > Mem: 89M Active, 92M Inact, 198M Wired, 13M Cache, 100M Buf, 3529M > > > > > > Free > > > > > > Swap: 4096M Total, 4096M Free > > > > > > > > > > > > Here on the desktop : > > > > > > > > > > > > last pid: 61010; load averages: 0.00, 0.00, 0.00 up 2+11:02:42 > > > > > > 22:29:08 > > > > > > 126 processes: 1 running, 125 sleeping > > > > > > CPU: % user, % nice, % system, % interrupt, % > > > > > > idle > > > > > > Mem: 803M Active, 2874M Inact, 1901M Wired, 112M Cache, 620M Buf, > > > > > > 202M > > > > > > Free > > > > > > Swap: 6144M Total, 36M Used, 6107M Free > > > > > > > > > > > > > > > > http://lists.freebsd.org/pipermail/freebsd-bugs/2012-April/048213.html > > > > > > > > What I understand of your message (I'm definitvly not a dev) is that's > > > > only > > > > a little problem of accounting. > > > > > > > > I'm not absolute sure of that because my laptop fan never stop... > > > > > > > > If you want any more information... > > > > > > Definitely, because here I don't see much. > > > > > > Generally, all CPU loads and load averages now calculated via sampling, > > > so theoretically with spiky load numbers may vary for many reasons. I > > > would start from collecting information about running processes. To find > > > fast switching processes that could hide from accounting try `top -SH -m > > > io -o vcsw`. To get more information about scheduler work, use > > > /usr/src/tools/sched/schedgraph.py (instruction inside it). > > > > > > -- > > > Alexander Motin --0-553176730-1335678991=:91148-- From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 06:24:28 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5BB8D1065670; Sun, 29 Apr 2012 06:24:28 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-wi0-f172.google.com (mail-wi0-f172.google.com [209.85.212.172]) by mx1.freebsd.org (Postfix) with ESMTP id 9A5778FC14; Sun, 29 Apr 2012 06:24:27 +0000 (UTC) Received: by wibhj6 with SMTP id hj6so1469000wib.13 for ; Sat, 28 Apr 2012 23:24:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=hHwL3Euf1q8ZF7eMq4bdIP+6fcsns/N324P0yj7/9Ss=; b=AgG1xzghm0DBVs5FweRraf22uaf3+77UMiaoaH1T5JNQlRBx0uiZQNYc4Q0a4rl9XF PX6lHxTJScBoXyXfSrF5Gc1aJQsThezqtedImXBKXrsmyLu3vSN8nuHv7eqwCKs/BFKs w5gGL+jJshBJzi0O/K42VfFJBIOCAvovcV+cu0R4PwpTLvcdmH0XRdbCdJR5U+zJ0gAt EZUud1MZ0IN4vvZAEqkkQOh9YpWUONiUPDrbljpomTlKndDXkBnbSUUvFpcKb0y8zTq5 7/VgQKTdvXeEeavlk4Z8lycNz/9XuBXcT7CUoI7OxIlWlM6Or9cAMeg9gxsddSLbh9lp DSNA== Received: by 10.180.94.33 with SMTP id cz1mr19458466wib.13.1335680660514; Sat, 28 Apr 2012 23:24:20 -0700 (PDT) Received: from mavbook2.mavhome.dp.ua (pc.mavhome.dp.ua. [212.86.226.226]) by mx.google.com with ESMTPS id h8sm29140935wix.4.2012.04.28.23.24.18 (version=SSLv3 cipher=OTHER); Sat, 28 Apr 2012 23:24:19 -0700 (PDT) Sender: Alexander Motin Message-ID: <4F9CDE91.1060300@FreeBSD.org> Date: Sun, 29 Apr 2012 09:24:17 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0.3) Gecko/20120328 Thunderbird/10.0.3 MIME-Version: 1.0 To: Ian Smith References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> In-Reply-To: <20120429155512.M91148@sola.nimnet.asn.au> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Davide Italiano , Albert Shih , freebsd-stable@freebsd.org, Luigi Rizzo , Oliver Pinter Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 06:24:28 -0000 On 04/29/12 09:09, Ian Smith wrote: > On Sun, 29 Apr 2012 08:17:38 +0300, Alexander Motin wrote: > > On 04/29/12 01:53, Oliver Pinter wrote: > > > Attached the ktr file. This is on core2duo P9400 cpu ( > > > smbios.system.product="HP ProBook 5310m (WD792EA#ABU)" ). The workload > > > is only a single user boost: sh + top running, but the load average is > > > near 0.5. > > > > ktr shows no real load there. But it shows that you are using dummynet, that > > schedules its runs on every hardclock tick. I believe that load you see is > > the result or synchronization between dummynet calls and loadvg sampling, > > both of which called from hardclock. I think removing dummynet from equation, > > should hide this problem and also reduce you laptops power consumption. > > > > What's about fixing this, it is loadavg sampling algorithm that should be > > changed. Fixing dummynet to not run on every hardclock tick would also be > > great. > > Wading in out of my depth, and copying Luigi in case he misses it .. but > even back in the olden days when HZ defaulted to 100, one was advised to > use HZ>= 1000 for smooth dummynet traffic shaping dispatch scheduling. > > I wonder, with the newer clocks and timers, whether there is another > clock that could be used for dummynet scheduling, that would not have > this effect (even if largely cosmetic?) on load average calculation? First of all, the easiest solution would be to make dummynet to schedule callout not automatically, but on first queued packet. I believe that in case of laptop the queue should be empty most of time and the callout calls are completely useless there. Luigi promised to look on this once. What's about better precision/removing synchronization -- there is starting GSoC project now (by davide@) to rewrite callout(9) subsystem to use better precision allowed by new timer drivers. While now it is possible to get raw access to additional timer hardware available on some systems, I don't think it is a good idea. -- Alexander Motin From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 06:27:08 2012 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F2EFE106566B; Sun, 29 Apr 2012 06:27:08 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.16.84]) by mx1.freebsd.org (Postfix) with ESMTP id 96C408FC0A; Sun, 29 Apr 2012 06:27:08 +0000 (UTC) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by kabab.cs.huji.ac.il with esmtp id 1SONb5-000AAj-Sz; Sun, 29 Apr 2012 09:27:03 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.3 To: Rick Macklem In-reply-to: <1693565170.26796.1335528520197.JavaMail.root@erie.cs.uoguelph.ca> References: <1693565170.26796.1335528520197.JavaMail.root@erie.cs.uoguelph.ca> Comments: In-reply-to Rick Macklem message dated "Fri, 27 Apr 2012 08:08:40 -0400." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Sun, 29 Apr 2012 09:27:03 +0300 From: Daniel Braniss Message-ID: Cc: killing@multiplay.co.uk, Hiroki Sato , freebsd-stable@FreeBSD.org, ob@e-Gitt.NET Subject: Re: 9-STABLE, ZFS, NFS, ggatec - suspected memory leak X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 06:27:09 -0000 > Daniel Braniss wrote: > > > ----Security_Multipart(Fri_Apr_27_13_35_56_2012_748)-- > > > Content-Type: Text/Plain; charset=us-ascii > > > Content-Transfer-Encoding: 7bit > > > > > > Rick Macklem wrote > > > in > > > <1527622626.3418715.1335445225510.JavaMail.root@erie.cs.uoguelph.ca>: > > > > > > rm> Steven Hartland wrote: > > > rm> > ---- Original Message ----- > > > rm> > From: "Rick Macklem" > > > rm> > > At a glance, it looks to me like 8.x is affected. Note that > > > the > > > rm> > > bug only affects the new NFS server (the experimental one > > > for 8.x) > > > rm> > > when exporting ZFS volumes. (UFS exported volumes don't > > > leak) > > > rm> > > > > > rm> > > If you are running a server that might be affected, just: > > > rm> > > # vmstat -z | fgrep -i namei > > > rm> > > on the server and see if the 3rd number shown is increasing. > > > rm> > > > > rm> > Many thanks Rick wasnt aware we had anything experimental > > > enabled > > > rm> > but I think that would be a yes looking at these number:- > > > rm> > > > > rm> > vmstat -z | fgrep -i namei > > > rm> > NAMEI: 1024, 0, 1, 1483, 25285086096, 0 > > > rm> > vmstat -z | fgrep -i namei > > > rm> > NAMEI: 1024, 0, 0, 1484, 25285945725, 0 > > > rm> > > > > rm> ^ > > > rm> I don't think so, since the 3rd number (USED) is 0 here. > > > rm> If that # is increasing over time, you have the leak. You are > > > rm> probably running the old (default in 8.x) NFS server. > > > > > > Just a report, I confirmed it affected 8.x servers running newnfs. > > > > > > Actually I have been suffered from memory starvation symptom on > > > that > > > server (24GB RAM) for a long time and watching vmstat -z > > > periodically. It stopped working once a week. I investigated the > > > vmstat log again and found the amount of NAMEI leak was 11,543,956 > > > (about 11GB!) just before the locked-up. After applying the patch, > > > the leak disappeared. Thank you for fixing it! > > > > > > -- Hiroki > And thanks Hiroki for testing it on 8.x. > > > this is on 8.2-STABLE/amd64 from around August: > > same here, this zfs+newnfs has been hanging every few months, and I > > can see > > now the leak, it's slowly increasing: > > NAMEI: 1024, 0, 122975, 529, 15417248, 0 > > NAMEI: 1024, 0, 122984, 520, 15421772, 0 > > NAMEI: 1024, 0, 123002, 502, 15424743, 0 > > NAMEI: 1024, 0, 123008, 496, 15425464, 0 > > > > cheers, > > danny > Maybe you could try the patch, too. > > It's at: > http://people.freebsd.org/~rmacklem/namei-leak.patch > > I'll commit it to head soon with a 1 month MFC, so that hopefully > Oliver will have a chance to try it on his production server before > the MFC. > > Thanks everyone, for your help with this, rick I haven't applied the patch yet, but in the meanime I have been running some experiments on a zfs/nfs server running 8.3-STABLE, and don't see any leaks what triggers the leak? thanks, danny From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 12:04:52 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B0CD7106566B; Sun, 29 Apr 2012 12:04:52 +0000 (UTC) (envelope-from oliver.pntr@gmail.com) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 40C968FC17; Sun, 29 Apr 2012 12:04:52 +0000 (UTC) Received: by ghrr20 with SMTP id r20so1222781ghr.13 for ; Sun, 29 Apr 2012 05:04:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Jb3q5vqoNMqeMlt48c8X2eEkMI9mws9lhRBMwLAtPu0=; b=FphnBktPeelb1j/bTUco6y2QL7Txx0vi0IDD7ONmHQ0plWHxno1lPVZKWllMxUDb5n Y16povFPuq7BPZoXaOwSVQvHEdDYwf8aM15oj/Lf+vPLJpc/E8pZvYP9DB+qtdpHZlJy nD3bgeN0Tr/qyIET/Ett8oSpYYWfiroO6B5+/X7sRwFPs3o1NrsyhsVN4LZoMp37lMQ4 +hYWmRnTW8O3cVi4NN+6c0FA/8XuW6d7mPNoT0ki0ffx/iBS93M21ZJ37o9XC7nZYiwe dZcNvo0ybTRxnjfUAtP2hq8ht2Ff5XbPU/rhZyQo5nUPh8nMr3U5iwSeplSAJvoez/J6 57rg== MIME-Version: 1.0 Received: by 10.236.145.34 with SMTP id o22mr19277521yhj.7.1335701091542; Sun, 29 Apr 2012 05:04:51 -0700 (PDT) Received: by 10.236.161.97 with HTTP; Sun, 29 Apr 2012 05:04:51 -0700 (PDT) In-Reply-To: <4F9CDE91.1060300@FreeBSD.org> References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> Date: Sun, 29 Apr 2012 14:04:51 +0200 Message-ID: From: Oliver Pinter To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Cc: Davide Italiano , Albert Shih , Luigi Rizzo , freebsd-stable@freebsd.org, Ian Smith Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 12:04:52 -0000 Hi all! Removing dummynet from kernel don't chanage anything, that is releated to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + top) On 4/29/12, Alexander Motin wrote: > On 04/29/12 09:09, Ian Smith wrote: >> On Sun, 29 Apr 2012 08:17:38 +0300, Alexander Motin wrote: >> > On 04/29/12 01:53, Oliver Pinter wrote: >> > > Attached the ktr file. This is on core2duo P9400 cpu ( >> > > smbios.system.product="HP ProBook 5310m (WD792EA#ABU)" ). The >> workload >> > > is only a single user boost: sh + top running, but the load >> average is >> > > near 0.5. >> > >> > ktr shows no real load there. But it shows that you are using >> dummynet, that >> > schedules its runs on every hardclock tick. I believe that load you >> see is >> > the result or synchronization between dummynet calls and loadvg >> sampling, >> > both of which called from hardclock. I think removing dummynet from >> equation, >> > should hide this problem and also reduce you laptops power >> consumption. >> > >> > What's about fixing this, it is loadavg sampling algorithm that >> should be >> > changed. Fixing dummynet to not run on every hardclock tick would >> also be >> > great. >> >> Wading in out of my depth, and copying Luigi in case he misses it .. but >> even back in the olden days when HZ defaulted to 100, one was advised to >> use HZ>= 1000 for smooth dummynet traffic shaping dispatch scheduling. >> >> I wonder, with the newer clocks and timers, whether there is another >> clock that could be used for dummynet scheduling, that would not have >> this effect (even if largely cosmetic?) on load average calculation? > > First of all, the easiest solution would be to make dummynet to schedule > callout not automatically, but on first queued packet. I believe that in > case of laptop the queue should be empty most of time and the callout > calls are completely useless there. Luigi promised to look on this once. > > What's about better precision/removing synchronization -- there is > starting GSoC project now (by davide@) to rewrite callout(9) subsystem > to use better precision allowed by new timer drivers. While now it is > possible to get raw access to additional timer hardware available on > some systems, I don't think it is a good idea. > > -- > Alexander Motin > From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 12:07:51 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A344D1065688; Sun, 29 Apr 2012 12:07:51 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-bk0-f54.google.com (mail-bk0-f54.google.com [209.85.214.54]) by mx1.freebsd.org (Postfix) with ESMTP id EC14A8FC19; Sun, 29 Apr 2012 12:07:50 +0000 (UTC) Received: by bkvi17 with SMTP id i17so792053bkv.13 for ; Sun, 29 Apr 2012 05:07:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=GOxwLZUSTICV9qJW/4WburFWBBmC8d6uHuLdNrxLNJw=; b=bdecdAYhtLGwLNm62AZzAMxXZSuF8S/cndaUF9fhpp4VMtVYEatyBZpa9inDxkl6yD Wx3eGPkMS8bkNad0R0cuvZeOoJtCjZTJ2QZk6YuvgOY9rselJulzEAO/m+WCG981B8ry O9EX2jwQydVjyDRLOaVQ5Dksj4Y8gyN4mL4HZ4gB4zhT3tUfzJjwCffNaGpTlGMT7qxX nI11NThoEUFV6cH7LOJWEWaR2qZOk2UF/gqI8hFt7P6VAYTaK5UL+7HuRm1MjQyA+Q9S 0XxObe5TRjjaDcYTW/bdkxhO+l0O+Io7Db8aev/KfbnycunjkSrfz1Ms5r9tWz5VhH/r KYdg== Received: by 10.204.154.209 with SMTP id p17mr6182714bkw.6.1335701264396; Sun, 29 Apr 2012 05:07:44 -0700 (PDT) Received: from mavbook2.mavhome.dp.ua (pc.mavhome.dp.ua. [212.86.226.226]) by mx.google.com with ESMTPS id zx16sm21195081bkb.13.2012.04.29.05.07.42 (version=SSLv3 cipher=OTHER); Sun, 29 Apr 2012 05:07:43 -0700 (PDT) Sender: Alexander Motin Message-ID: <4F9D2F0C.4050501@FreeBSD.org> Date: Sun, 29 Apr 2012 15:07:40 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0.3) Gecko/20120328 Thunderbird/10.0.3 MIME-Version: 1.0 To: Oliver Pinter References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Davide Italiano , Albert Shih , Luigi Rizzo , freebsd-stable@freebsd.org, Ian Smith Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 12:07:51 -0000 On 04/29/12 15:04, Oliver Pinter wrote: > Removing dummynet from kernel don't chanage anything, that is releated > to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + > top) New ktr dump? > On 4/29/12, Alexander Motin wrote: >> On 04/29/12 09:09, Ian Smith wrote: >>> On Sun, 29 Apr 2012 08:17:38 +0300, Alexander Motin wrote: >>> > On 04/29/12 01:53, Oliver Pinter wrote: >>> > > Attached the ktr file. This is on core2duo P9400 cpu ( >>> > > smbios.system.product="HP ProBook 5310m (WD792EA#ABU)" ). The >>> workload >>> > > is only a single user boost: sh + top running, but the load >>> average is >>> > > near 0.5. >>> > >>> > ktr shows no real load there. But it shows that you are using >>> dummynet, that >>> > schedules its runs on every hardclock tick. I believe that load you >>> see is >>> > the result or synchronization between dummynet calls and loadvg >>> sampling, >>> > both of which called from hardclock. I think removing dummynet from >>> equation, >>> > should hide this problem and also reduce you laptops power >>> consumption. >>> > >>> > What's about fixing this, it is loadavg sampling algorithm that >>> should be >>> > changed. Fixing dummynet to not run on every hardclock tick would >>> also be >>> > great. >>> >>> Wading in out of my depth, and copying Luigi in case he misses it .. but >>> even back in the olden days when HZ defaulted to 100, one was advised to >>> use HZ>= 1000 for smooth dummynet traffic shaping dispatch scheduling. >>> >>> I wonder, with the newer clocks and timers, whether there is another >>> clock that could be used for dummynet scheduling, that would not have >>> this effect (even if largely cosmetic?) on load average calculation? >> >> First of all, the easiest solution would be to make dummynet to schedule >> callout not automatically, but on first queued packet. I believe that in >> case of laptop the queue should be empty most of time and the callout >> calls are completely useless there. Luigi promised to look on this once. >> >> What's about better precision/removing synchronization -- there is >> starting GSoC project now (by davide@) to rewrite callout(9) subsystem >> to use better precision allowed by new timer drivers. While now it is >> possible to get raw access to additional timer hardware available on >> some systems, I don't think it is a good idea. -- Alexander Motin From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 12:27:15 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E35AE1065673; Sun, 29 Apr 2012 12:27:15 +0000 (UTC) (envelope-from kozlov@ravenloft.kiev.ua) Received: from ravenloft.kiev.ua (ravenloft.kiev.ua [94.244.131.95]) by mx1.freebsd.org (Postfix) with ESMTP id 708338FC12; Sun, 29 Apr 2012 12:27:15 +0000 (UTC) Date: Sun, 29 Apr 2012 15:27:14 +0300 From: Alex Kozlov To: Alexander Motin , freebsd-stable@freebsd.org Message-ID: <20120429122714.GA56829@ravenloft.kiev.ua> References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> <4F9D2F0C.4050501@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4F9D2F0C.4050501@FreeBSD.org> Cc: Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 12:27:16 -0000 On Sun, Apr 29, 2012 at 03:07:40PM +0300, Alexander Motin wrote: > On 04/29/12 15:04, Oliver Pinter wrote: > > Removing dummynet from kernel don't chanage anything, that is releated > > to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + > > top) > > New ktr dump? I have similar issue on one of my laptops. Should I provide ktr dump? http://lists.freebsd.org/pipermail/freebsd-current/2011-September/027133.html -- Adios From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 12:27:33 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A7BC8106566B; Sun, 29 Apr 2012 12:27:33 +0000 (UTC) (envelope-from oliver.pntr@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id 363ED8FC08; Sun, 29 Apr 2012 12:27:33 +0000 (UTC) Received: by yenl9 with SMTP id l9so1219136yen.13 for ; Sun, 29 Apr 2012 05:27:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=5mtaEt6WBvNVe4dyd5+O/x/L5d+FEEXggLoqN7NIZu0=; b=H2qOKQq35xGfEPGl6NFKbC31NbP8zJ1Mats3ByVf5i0hCiiuDmMbe7CeU97/k0ynHT zfXlGeqerB6vuSDMlsKWx4hlq+ZHJJKmEGFX42xDUduZG1zvKaK0uJ2EZPrj8m6C5NgK tb9ZwJiW++tBB/VD3dU/AQm24GSmH8B/ltrsT4XGwv9dDGSkpEmEkgXJjKTCMy7MJRmL Lxp/W7b5ffbgbhgbWgyxVOO4mIF9orrNaSICTVo/WpNKviEqgneZJ4kEUa2kIfg6CzEX Ui5sRlZuWfvBuq9Xp9sWxVTDOzKQThzkeyqkWaHPZQC+kT8ykkHtE1uJ2uGzSRvphTXV 7/qQ== MIME-Version: 1.0 Received: by 10.236.192.136 with SMTP id i8mr11752804yhn.122.1335702452221; Sun, 29 Apr 2012 05:27:32 -0700 (PDT) Received: by 10.236.161.97 with HTTP; Sun, 29 Apr 2012 05:27:32 -0700 (PDT) In-Reply-To: <4F9D2F0C.4050501@FreeBSD.org> References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> <4F9D2F0C.4050501@FreeBSD.org> Date: Sun, 29 Apr 2012 14:27:32 +0200 Message-ID: From: Oliver Pinter To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Cc: Davide Italiano , Albert Shih , Luigi Rizzo , freebsd-stable@freebsd.org, Ian Smith Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 12:27:33 -0000 http://oliverp.teteny.bme.hu/freebsd/ktr/ On 4/29/12, Alexander Motin wrote: > On 04/29/12 15:04, Oliver Pinter wrote: >> Removing dummynet from kernel don't chanage anything, that is releated >> to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + >> top) > > New ktr dump? > >> On 4/29/12, Alexander Motin wrote: >>> On 04/29/12 09:09, Ian Smith wrote: >>>> On Sun, 29 Apr 2012 08:17:38 +0300, Alexander Motin wrote: >>>> > On 04/29/12 01:53, Oliver Pinter wrote: >>>> > > Attached the ktr file. This is on core2duo P9400 cpu ( >>>> > > smbios.system.product="HP ProBook 5310m (WD792EA#ABU)" ). >>>> The >>>> workload >>>> > > is only a single user boost: sh + top running, but the load >>>> average is >>>> > > near 0.5. >>>> > >>>> > ktr shows no real load there. But it shows that you are using >>>> dummynet, that >>>> > schedules its runs on every hardclock tick. I believe that load >>>> you >>>> see is >>>> > the result or synchronization between dummynet calls and loadvg >>>> sampling, >>>> > both of which called from hardclock. I think removing dummynet >>>> from >>>> equation, >>>> > should hide this problem and also reduce you laptops power >>>> consumption. >>>> > >>>> > What's about fixing this, it is loadavg sampling algorithm that >>>> should be >>>> > changed. Fixing dummynet to not run on every hardclock tick >>>> would >>>> also be >>>> > great. >>>> >>>> Wading in out of my depth, and copying Luigi in case he misses it .. >>>> but >>>> even back in the olden days when HZ defaulted to 100, one was advised >>>> to >>>> use HZ>= 1000 for smooth dummynet traffic shaping dispatch scheduling. >>>> >>>> I wonder, with the newer clocks and timers, whether there is another >>>> clock that could be used for dummynet scheduling, that would not have >>>> this effect (even if largely cosmetic?) on load average calculation? >>> >>> First of all, the easiest solution would be to make dummynet to schedule >>> callout not automatically, but on first queued packet. I believe that in >>> case of laptop the queue should be empty most of time and the callout >>> calls are completely useless there. Luigi promised to look on this once. >>> >>> What's about better precision/removing synchronization -- there is >>> starting GSoC project now (by davide@) to rewrite callout(9) subsystem >>> to use better precision allowed by new timer drivers. While now it is >>> possible to get raw access to additional timer hardware available on >>> some systems, I don't think it is a good idea. > > > -- > Alexander Motin > From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 12:51:07 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EC19E106566C; Sun, 29 Apr 2012 12:51:06 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.mail.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id 87F868FC1C; Sun, 29 Apr 2012 12:51:06 +0000 (UTC) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AqAEAMw4nU+DaFvO/2dsb2JhbAA8CA4IhVKtNoIJAQEBAwEBAQEgKyALBQcPDgcDAgINGQIpAQkmBggCBQQBHASHZwULpiySDoEviVoDhH6BGASTT4IvgRGPMYIvVYFA X-IronPort-AV: E=Sophos;i="4.75,501,1330923600"; d="scan'208";a="167116268" Received: from erie.cs.uoguelph.ca (HELO zcs3.mail.uoguelph.ca) ([131.104.91.206]) by esa-annu-pri.mail.uoguelph.ca with ESMTP; 29 Apr 2012 08:50:59 -0400 Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1]) by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id 9B1F2B3F2B; Sun, 29 Apr 2012 08:50:59 -0400 (EDT) Date: Sun, 29 Apr 2012 08:50:59 -0400 (EDT) From: Rick Macklem To: Daniel Braniss Message-ID: <565467754.96294.1335703859588.JavaMail.root@erie.cs.uoguelph.ca> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.91.203] X-Mailer: Zimbra 6.0.10_GA_2692 (ZimbraWebClient - FF3.0 (Win)/6.0.10_GA_2692) Cc: freebsd-stable@FreeBSD.org, Hiroki Sato , killing@multiplay.co.uk, ob@e-Gitt.NET Subject: Re: 9-STABLE, ZFS, NFS, ggatec - suspected memory leak X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 12:51:07 -0000 Daniel Braniss wrote: > > Daniel Braniss wrote: > > > > ----Security_Multipart(Fri_Apr_27_13_35_56_2012_748)-- > > > > Content-Type: Text/Plain; charset=us-ascii > > > > Content-Transfer-Encoding: 7bit > > > > > > > > Rick Macklem wrote > > > > in > > > > <1527622626.3418715.1335445225510.JavaMail.root@erie.cs.uoguelph.ca>: > > > > > > > > rm> Steven Hartland wrote: > > > > rm> > ---- Original Message ----- > > > > rm> > From: "Rick Macklem" > > > > rm> > > At a glance, it looks to me like 8.x is affected. Note > > > > that > > > > the > > > > rm> > > bug only affects the new NFS server (the experimental > > > > one > > > > for 8.x) > > > > rm> > > when exporting ZFS volumes. (UFS exported volumes don't > > > > leak) > > > > rm> > > > > > > rm> > > If you are running a server that might be affected, > > > > just: > > > > rm> > > # vmstat -z | fgrep -i namei > > > > rm> > > on the server and see if the 3rd number shown is > > > > increasing. > > > > rm> > > > > > rm> > Many thanks Rick wasnt aware we had anything experimental > > > > enabled > > > > rm> > but I think that would be a yes looking at these number:- > > > > rm> > > > > > rm> > vmstat -z | fgrep -i namei > > > > rm> > NAMEI: 1024, 0, 1, 1483, 25285086096, 0 > > > > rm> > vmstat -z | fgrep -i namei > > > > rm> > NAMEI: 1024, 0, 0, 1484, 25285945725, 0 > > > > rm> > > > > > rm> ^ > > > > rm> I don't think so, since the 3rd number (USED) is 0 here. > > > > rm> If that # is increasing over time, you have the leak. You > > > > are > > > > rm> probably running the old (default in 8.x) NFS server. > > > > > > > > Just a report, I confirmed it affected 8.x servers running > > > > newnfs. > > > > > > > > Actually I have been suffered from memory starvation symptom on > > > > that > > > > server (24GB RAM) for a long time and watching vmstat -z > > > > periodically. It stopped working once a week. I investigated > > > > the > > > > vmstat log again and found the amount of NAMEI leak was > > > > 11,543,956 > > > > (about 11GB!) just before the locked-up. After applying the > > > > patch, > > > > the leak disappeared. Thank you for fixing it! > > > > > > > > -- Hiroki > > And thanks Hiroki for testing it on 8.x. > > > > > this is on 8.2-STABLE/amd64 from around August: > > > same here, this zfs+newnfs has been hanging every few months, and > > > I > > > can see > > > now the leak, it's slowly increasing: > > > NAMEI: 1024, 0, 122975, 529, 15417248, 0 > > > NAMEI: 1024, 0, 122984, 520, 15421772, 0 > > > NAMEI: 1024, 0, 123002, 502, 15424743, 0 > > > NAMEI: 1024, 0, 123008, 496, 15425464, 0 > > > > > > cheers, > > > danny > > Maybe you could try the patch, too. > > > > It's at: > > http://people.freebsd.org/~rmacklem/namei-leak.patch > > > > I'll commit it to head soon with a 1 month MFC, so that hopefully > > Oliver will have a chance to try it on his production server before > > the MFC. > > > > Thanks everyone, for your help with this, rick > > I haven't applied the patch yet, but in the meanime I have been > running some > experiments on a zfs/nfs server running 8.3-STABLE, and don't see any > leaks > what triggers the leak? > Fortunately Oliver isolated this. It should leak when you do a successful "rm" or "rmdir" while running the new/experimental server. rick > thanks, > danny > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to > "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 12:59:16 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 39E6A1065670; Sun, 29 Apr 2012 12:59:16 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-wg0-f42.google.com (mail-wg0-f42.google.com [74.125.82.42]) by mx1.freebsd.org (Postfix) with ESMTP id 8629D8FC0A; Sun, 29 Apr 2012 12:59:15 +0000 (UTC) Received: by wgbds11 with SMTP id ds11so1730561wgb.1 for ; Sun, 29 Apr 2012 05:59:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=hGOGtvsQ5leu8S1kGc3UeDlV59X8eP2HdCPoBWFDKgg=; b=qKOPodvn68ta1P18FNeOIwxlOHgt4CZmtEOCggMccCWrJfQjwjqi6sPUglxY2Djg2G EYsUZKJnWqbgPfmJr2lmlnbCxQgrQ2CTB3NXyzyOS7iyvROtJG8gIG2KDuFBGUdcOrj4 bQrEiDgEr2r+tFcYxMVv+1scl7iNR55rZzRCYIu2O3/Fx9O2uAuJ3SpjWYR0hMC16DVa /TfQmTkMFPKsaaLq2qw7d5xTGiacQ4Ht6AI1jM5utw8L3bpz+xzzvvuz/EO+HQ74z/Lo ggaDmIMz2KFyk/Ler5RksqzSv3wbMLtXzjHPTlKGP58r7sdbhtCorz3h2kAYpk+5FLmg xVxQ== Received: by 10.180.94.7 with SMTP id cy7mr24284583wib.3.1335704354569; Sun, 29 Apr 2012 05:59:14 -0700 (PDT) Received: from mavbook2.mavhome.dp.ua (pc.mavhome.dp.ua. [212.86.226.226]) by mx.google.com with ESMTPS id fn2sm32771818wib.0.2012.04.29.05.59.12 (version=SSLv3 cipher=OTHER); Sun, 29 Apr 2012 05:59:13 -0700 (PDT) Sender: Alexander Motin Message-ID: <4F9D3B1F.2030208@FreeBSD.org> Date: Sun, 29 Apr 2012 15:59:11 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0.3) Gecko/20120328 Thunderbird/10.0.3 MIME-Version: 1.0 To: Oliver Pinter References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> <4F9D2F0C.4050501@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Davide Italiano , Albert Shih , Luigi Rizzo , freebsd-stable@freebsd.org, Ian Smith Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 12:59:16 -0000 On 04/29/12 15:27, Oliver Pinter wrote: > http://oliverp.teteny.bme.hu/freebsd/ktr/ OK. Now there is no dummynet, but I've found there two more things: 1. for some reason some acpi_thremal thread seems to consume about 0.37s of time every 10s. I have no idea what is this. It's not 0.7 load, but still strange at least. 2. I suspect another possible synchronization between ehci driver and loadavg as result of interrupt sharing between HPET timer used for time events and EHCI USB hardware. Not sure what to do about this. Please send _verbose_ dmesg to check whether this interrupt sharing is unavoidable. > On 4/29/12, Alexander Motin wrote: >> On 04/29/12 15:04, Oliver Pinter wrote: >>> Removing dummynet from kernel don't chanage anything, that is releated >>> to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + >>> top) >> >> New ktr dump? >> >>> On 4/29/12, Alexander Motin wrote: >>>> On 04/29/12 09:09, Ian Smith wrote: >>>>> On Sun, 29 Apr 2012 08:17:38 +0300, Alexander Motin wrote: >>>>> > On 04/29/12 01:53, Oliver Pinter wrote: >>>>> > > Attached the ktr file. This is on core2duo P9400 cpu ( >>>>> > > smbios.system.product="HP ProBook 5310m (WD792EA#ABU)" ). >>>>> The >>>>> workload >>>>> > > is only a single user boost: sh + top running, but the load >>>>> average is >>>>> > > near 0.5. >>>>> > >>>>> > ktr shows no real load there. But it shows that you are using >>>>> dummynet, that >>>>> > schedules its runs on every hardclock tick. I believe that load >>>>> you >>>>> see is >>>>> > the result or synchronization between dummynet calls and loadvg >>>>> sampling, >>>>> > both of which called from hardclock. I think removing dummynet >>>>> from >>>>> equation, >>>>> > should hide this problem and also reduce you laptops power >>>>> consumption. >>>>> > >>>>> > What's about fixing this, it is loadavg sampling algorithm that >>>>> should be >>>>> > changed. Fixing dummynet to not run on every hardclock tick >>>>> would >>>>> also be >>>>> > great. >>>>> >>>>> Wading in out of my depth, and copying Luigi in case he misses it .. >>>>> but >>>>> even back in the olden days when HZ defaulted to 100, one was advised >>>>> to >>>>> use HZ>= 1000 for smooth dummynet traffic shaping dispatch scheduling. >>>>> >>>>> I wonder, with the newer clocks and timers, whether there is another >>>>> clock that could be used for dummynet scheduling, that would not have >>>>> this effect (even if largely cosmetic?) on load average calculation? >>>> >>>> First of all, the easiest solution would be to make dummynet to schedule >>>> callout not automatically, but on first queued packet. I believe that in >>>> case of laptop the queue should be empty most of time and the callout >>>> calls are completely useless there. Luigi promised to look on this once. >>>> >>>> What's about better precision/removing synchronization -- there is >>>> starting GSoC project now (by davide@) to rewrite callout(9) subsystem >>>> to use better precision allowed by new timer drivers. While now it is >>>> possible to get raw access to additional timer hardware available on >>>> some systems, I don't think it is a good idea. -- Alexander Motin From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 13:11:25 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 68DB9106564A for ; Sun, 29 Apr 2012 13:11:25 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-we0-f182.google.com (mail-we0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id E46D98FC12 for ; Sun, 29 Apr 2012 13:11:24 +0000 (UTC) Received: by weyt57 with SMTP id t57so1671350wey.13 for ; Sun, 29 Apr 2012 06:11:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=Th/bhvGsCeE5mO9bkIPBsAi7P/10+qFm8P/8hTkSxfQ=; b=LFZlQd0LryzoCBaU7V0i4PAdE29XjWiSMQCCVU/UxXoFlpVAw/XY5YAsefc9COvHpo RBz66/dFPhoe+Iz+/H50MwUTw2OTML2iLmB/ewpnZuQI2qOoSsQcmhng/PHj0nvOrtS6 6gCr5OM5EIDOylvpmNoCGO1ERr/UJPM6/PQqXQhjsMXY2d98nl7aPRbL6mJfQ7U8ECSI zom3gjny1E0RTZjLibCXFCaSWAfEY/4WjOLRsuS9hOgR6Nofc2Y93JgS4LMI/Xe9pTag 1NeuidD6wPVnVfNa0VTspeTSyUzxpEhOHTS5TajSv6AZZ3jMGyeW6CNpfE6WFGiBG3wU zL2w== Received: by 10.180.92.130 with SMTP id cm2mr13420667wib.4.1335705084093; Sun, 29 Apr 2012 06:11:24 -0700 (PDT) Received: from mavbook2.mavhome.dp.ua (pc.mavhome.dp.ua. [212.86.226.226]) by mx.google.com with ESMTPS id ff9sm20698647wib.2.2012.04.29.06.11.22 (version=SSLv3 cipher=OTHER); Sun, 29 Apr 2012 06:11:23 -0700 (PDT) Sender: Alexander Motin Message-ID: <4F9D3DF8.9000800@FreeBSD.org> Date: Sun, 29 Apr 2012 16:11:20 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0.3) Gecko/20120328 Thunderbird/10.0.3 MIME-Version: 1.0 To: Alex Kozlov References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> <4F9D2F0C.4050501@FreeBSD.org> <20120429122714.GA56829@ravenloft.kiev.ua> In-Reply-To: <20120429122714.GA56829@ravenloft.kiev.ua> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 13:11:25 -0000 On 04/29/12 15:27, Alex Kozlov wrote: > On Sun, Apr 29, 2012 at 03:07:40PM +0300, Alexander Motin wrote: >> On 04/29/12 15:04, Oliver Pinter wrote: >>> Removing dummynet from kernel don't chanage anything, that is releated >>> to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + >>> top) >> >> New ktr dump? > I have similar issue on one of my laptops. Should I provide ktr dump? > http://lists.freebsd.org/pipermail/freebsd-current/2011-September/027133.html In your case HPET also shares interrupt with other devices. I suspect that may be a reason. Every time when swi thread runs loadavg, other CPU runs shared interrupt handler, that is accounted as result. Please show your verbose dmesg. -- Alexander Motin From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 13:39:33 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 16429106564A for ; Sun, 29 Apr 2012 13:39:33 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-wg0-f50.google.com (mail-wg0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id 8B33A8FC17 for ; Sun, 29 Apr 2012 13:39:32 +0000 (UTC) Received: by wgbds12 with SMTP id ds12so2022912wgb.31 for ; Sun, 29 Apr 2012 06:39:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=fb4nyjn89u6Ob0neQN6IPY6MsB2K3EZ04ucK9s7/ilA=; b=tLmlwxKnGtwtv+AyzDWp4qygAlN/Vu+R02tzTJ83QX7gvfdvRIKGt/HBGwMb4979ws pFIUyl+RBtBiKIELfo+1ffzv49J+LWN+VpOVwPMG1FSE8/ZbW7/nq6Jj5Ok+Tp5TY3rU 4ffruHyxughMw7E8rdouJxmP0mB8GXMx94hE22HKoVZh4pREcgUdr6rd0fNbYCNrQF1w y077B9kpNxCMk6tsWWC3eJ32Csj+M7oO0YPEe81eBg1r3yh99RkH9AlTeP8facMr156j bWVzCNnoX/3njScDfsFco+g1r/mAhLrdDOgb5UwBc5GXKwRdFeLqX6Y8xS710/X3MBmc VPZQ== Received: by 10.180.24.66 with SMTP id s2mr21566823wif.7.1335706771697; Sun, 29 Apr 2012 06:39:31 -0700 (PDT) Received: from mavbook2.mavhome.dp.ua (pc.mavhome.dp.ua. [212.86.226.226]) by mx.google.com with ESMTPS id e6sm20865245wix.8.2012.04.29.06.39.30 (version=SSLv3 cipher=OTHER); Sun, 29 Apr 2012 06:39:30 -0700 (PDT) Sender: Alexander Motin Message-ID: <4F9D4491.2060007@FreeBSD.org> Date: Sun, 29 Apr 2012 16:39:29 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0.3) Gecko/20120328 Thunderbird/10.0.3 MIME-Version: 1.0 To: Alex Kozlov References: <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> <4F9D2F0C.4050501@FreeBSD.org> <20120429122714.GA56829@ravenloft.kiev.ua> <4F9D3DF8.9000800@FreeBSD.org> <20120429133056.GA58422@ravenloft.kiev.ua> In-Reply-To: <20120429133056.GA58422@ravenloft.kiev.ua> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-stable@FreeBSD.org Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 13:39:33 -0000 On 04/29/12 16:30, Alex Kozlov wrote: > On Sun, Apr 29, 2012 at 04:11:20PM +0300, Alexander Motin wrote: >> On 04/29/12 15:27, Alex Kozlov wrote: >>> On Sun, Apr 29, 2012 at 03:07:40PM +0300, Alexander Motin wrote: >>>> On 04/29/12 15:04, Oliver Pinter wrote: >>>>> Removing dummynet from kernel don't chanage anything, that is releated >>>>> to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + >>>>> top) >>>> >>>> New ktr dump? >>> I have similar issue on one of my laptops. Should I provide ktr dump? >>> http://lists.freebsd.org/pipermail/freebsd-current/2011-September/027133.html >> In your case HPET also shares interrupt with other devices. I suspect >> that may be a reason. Every time when swi thread runs loadavg, other CPU >> runs shared interrupt handler, that is accounted as result. Please show >> your verbose dmesg. > Attached. In your case HPET could solely use IRQ22 that seems free now. After recent changes in ACPI code it is detected before PCI devices and so doesn't avoids sharing. You may try to hint it specific IRQ by adding to loader,conf line: hint.hpet.0.allowed_irqs="0x00400000" -- Alexander Motin From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 14:29:28 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BCA8A1065672; Sun, 29 Apr 2012 14:29:28 +0000 (UTC) (envelope-from kozlov@ravenloft.kiev.ua) Received: from ravenloft.kiev.ua (ravenloft.kiev.ua [94.244.131.95]) by mx1.freebsd.org (Postfix) with ESMTP id 71ABE8FC0C; Sun, 29 Apr 2012 14:29:28 +0000 (UTC) Date: Sun, 29 Apr 2012 17:29:27 +0300 From: Alex Kozlov To: Alexander Motin , freebsd-stable@freebsd.org Message-ID: <20120429142927.GA59818@ravenloft.kiev.ua> References: <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> <4F9D2F0C.4050501@FreeBSD.org> <20120429122714.GA56829@ravenloft.kiev.ua> <4F9D3DF8.9000800@FreeBSD.org> <20120429133056.GA58422@ravenloft.kiev.ua> <4F9D4491.2060007@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4F9D4491.2060007@FreeBSD.org> Cc: Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 14:29:28 -0000 On Sun, Apr 29, 2012 at 04:39:29PM +0300, Alexander Motin wrote: > On 04/29/12 16:30, Alex Kozlov wrote: > > On Sun, Apr 29, 2012 at 04:11:20PM +0300, Alexander Motin wrote: > >> On 04/29/12 15:27, Alex Kozlov wrote: > >>> On Sun, Apr 29, 2012 at 03:07:40PM +0300, Alexander Motin wrote: > >>>> On 04/29/12 15:04, Oliver Pinter wrote: > >>>>> Removing dummynet from kernel don't chanage anything, that is releated > >>>>> to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + > >>>>> top) > >>>> > >>>> New ktr dump? > >>> I have similar issue on one of my laptops. Should I provide ktr dump? > >>> http://lists.freebsd.org/pipermail/freebsd-current/2011-September/027133.html > >> In your case HPET also shares interrupt with other devices. I suspect > >> that may be a reason. Every time when swi thread runs loadavg, other CPU > >> runs shared interrupt handler, that is accounted as result. Please show > >> your verbose dmesg. > > Attached. > In your case HPET could solely use IRQ22 that seems free now. After > recent changes in ACPI code it is detected before PCI devices and so > doesn't avoids sharing. You may try to hint it specific IRQ by adding to > loader,conf line: > hint.hpet.0.allowed_irqs="0x00400000" Thanks, it helped. Still it would be nice, if loadavg accounting was fixed. -- Adios From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 14:45:51 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CAB56106566B; Sun, 29 Apr 2012 14:45:51 +0000 (UTC) (envelope-from oliver.pntr@gmail.com) Received: from mail-yw0-f54.google.com (mail-yw0-f54.google.com [209.85.213.54]) by mx1.freebsd.org (Postfix) with ESMTP id 572408FC14; Sun, 29 Apr 2012 14:45:51 +0000 (UTC) Received: by yhgm50 with SMTP id m50so1244187yhg.13 for ; Sun, 29 Apr 2012 07:45:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Z1PeX4zzVhZc9QjABGRHfvFEBt91q3LffP509mxeGaw=; b=L3IGT9tEseWVYp7v5m2kRHRbg0Mj6MNf1ZcDUzSE8TsM96P4W9rrr7oqEdVQv4iDxJ iA1lS2FOz7pJSjGu5kjzf01zHyDJxZbaH2wU/Ui0KHUAq0HAORc/uFRMy8/pNDi169in z8LdUV57ykSFYlyAI7NyuY4vQbnweeV50FgB7njiSWq2EVLedOnjqhkqLlgl6s71k7Vj a6901p/XzIn643GUuuLVuWMZK9JYpM8WzX0vf754G1vJgXL+wJ3zn3rrq6U778eQFkIu /wO3rE2RKDU3cZ/py39ot8BEsftG52Rpx4iUI8vl9WwZ/XeMmL90NM4KD4po8Wg2ia5O oa0A== MIME-Version: 1.0 Received: by 10.236.173.6 with SMTP id u6mr8203971yhl.130.1335710750562; Sun, 29 Apr 2012 07:45:50 -0700 (PDT) Received: by 10.236.161.97 with HTTP; Sun, 29 Apr 2012 07:45:50 -0700 (PDT) In-Reply-To: <4F9D3B1F.2030208@FreeBSD.org> References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> <4F9D2F0C.4050501@FreeBSD.org> <4F9D3B1F.2030208@FreeBSD.org> Date: Sun, 29 Apr 2012 16:45:50 +0200 Message-ID: From: Oliver Pinter To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Cc: Davide Italiano , Albert Shih , Luigi Rizzo , freebsd-stable@freebsd.org, Ian Smith Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 14:45:51 -0000 On 4/29/12, Alexander Motin wrote: > On 04/29/12 15:27, Oliver Pinter wrote: >> http://oliverp.teteny.bme.hu/freebsd/ktr/ > > OK. Now there is no dummynet, but I've found there two more things: > 1. for some reason some acpi_thremal thread seems to consume about > 0.37s of time every 10s. I have no idea what is this. It's not 0.7 load, > but still strange at least. > 2. I suspect another possible synchronization between ehci driver and > loadavg as result of interrupt sharing between HPET timer used for time > events and EHCI USB hardware. Not sure what to do about this. Please > send _verbose_ dmesg to check whether this interrupt sharing is > unavoidable. > >> On 4/29/12, Alexander Motin wrote: >>> On 04/29/12 15:04, Oliver Pinter wrote: >>>> Removing dummynet from kernel don't chanage anything, that is releated >>>> to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh + >>>> top) >>> >>> New ktr dump? >>> >>>> On 4/29/12, Alexander Motin wrote: >>>>> On 04/29/12 09:09, Ian Smith wrote: >>>>>> On Sun, 29 Apr 2012 08:17:38 +0300, Alexander Motin wrote: >>>>>> > On 04/29/12 01:53, Oliver Pinter wrote: >>>>>> > > Attached the ktr file. This is on core2duo P9400 cpu ( >>>>>> > > smbios.system.product="HP ProBook 5310m (WD792EA#ABU)" >>>>>> ). >>>>>> The >>>>>> workload >>>>>> > > is only a single user boost: sh + top running, but the >>>>>> load >>>>>> average is >>>>>> > > near 0.5. >>>>>> > >>>>>> > ktr shows no real load there. But it shows that you are >>>>>> using >>>>>> dummynet, that >>>>>> > schedules its runs on every hardclock tick. I believe that >>>>>> load >>>>>> you >>>>>> see is >>>>>> > the result or synchronization between dummynet calls and >>>>>> loadvg >>>>>> sampling, >>>>>> > both of which called from hardclock. I think removing >>>>>> dummynet >>>>>> from >>>>>> equation, >>>>>> > should hide this problem and also reduce you laptops power >>>>>> consumption. >>>>>> > >>>>>> > What's about fixing this, it is loadavg sampling algorithm >>>>>> that >>>>>> should be >>>>>> > changed. Fixing dummynet to not run on every hardclock tick >>>>>> would >>>>>> also be >>>>>> > great. >>>>>> >>>>>> Wading in out of my depth, and copying Luigi in case he misses it .. >>>>>> but >>>>>> even back in the olden days when HZ defaulted to 100, one was advised >>>>>> to >>>>>> use HZ>= 1000 for smooth dummynet traffic shaping dispatch >>>>>> scheduling. >>>>>> >>>>>> I wonder, with the newer clocks and timers, whether there is another >>>>>> clock that could be used for dummynet scheduling, that would not have >>>>>> this effect (even if largely cosmetic?) on load average calculation? >>>>> >>>>> First of all, the easiest solution would be to make dummynet to >>>>> schedule >>>>> callout not automatically, but on first queued packet. I believe that >>>>> in >>>>> case of laptop the queue should be empty most of time and the callout >>>>> calls are completely useless there. Luigi promised to look on this >>>>> once. >>>>> >>>>> What's about better precision/removing synchronization -- there is >>>>> starting GSoC project now (by davide@) to rewrite callout(9) subsystem >>>>> to use better precision allowed by new timer drivers. While now it is >>>>> possible to get raw access to additional timer hardware available on >>>>> some systems, I don't think it is a good idea. http://freebsd.1045724.n5.nabble.com/amd64-160419-acpi-thermal-kernel-thread-high-CPU-usage-td4765266.html but this "high cpu load" is gone, releated to acpi_thermal in 2011 september > > > -- > Alexander Motin > From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 15:05:53 2012 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E5632106564A; Sun, 29 Apr 2012 15:05:52 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.16.84]) by mx1.freebsd.org (Postfix) with ESMTP id 502888FC08; Sun, 29 Apr 2012 15:05:52 +0000 (UTC) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by kabab.cs.huji.ac.il with esmtp id 1SOVh0-000NfQ-2P; Sun, 29 Apr 2012 18:05:42 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.3 To: Rick Macklem In-reply-to: <565467754.96294.1335703859588.JavaMail.root@erie.cs.uoguelph.ca> References: <565467754.96294.1335703859588.JavaMail.root@erie.cs.uoguelph.ca> Comments: In-reply-to Rick Macklem message dated "Sun, 29 Apr 2012 08:50:59 -0400." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Sun, 29 Apr 2012 18:05:41 +0300 From: Daniel Braniss Message-ID: Cc: freebsd-stable@FreeBSD.org, Hiroki Sato , killing@multiplay.co.uk, ob@e-Gitt.NET Subject: Re: 9-STABLE, ZFS, NFS, ggatec - suspected memory leak X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 15:05:53 -0000 > Daniel Braniss wrote: > > > Daniel Braniss wrote: > > > > > ----Security_Multipart(Fri_Apr_27_13_35_56_2012_748)-- > > > > > Content-Type: Text/Plain; charset=us-ascii > > > > > Content-Transfer-Encoding: 7bit > > > > > > > > > > Rick Macklem wrote > > > > > in > > > > > <1527622626.3418715.1335445225510.JavaMail.root@erie.cs.uoguelph.ca>: > > > > > > > > > > rm> Steven Hartland wrote: > > > > > rm> > ---- Original Message ----- > > > > > rm> > From: "Rick Macklem" > > > > > rm> > > At a glance, it looks to me like 8.x is affected. Note > > > > > that > > > > > the > > > > > rm> > > bug only affects the new NFS server (the experimental > > > > > one > > > > > for 8.x) > > > > > rm> > > when exporting ZFS volumes. (UFS exported volumes don't > > > > > leak) > > > > > rm> > > > > > > > rm> > > If you are running a server that might be affected, > > > > > just: > > > > > rm> > > # vmstat -z | fgrep -i namei > > > > > rm> > > on the server and see if the 3rd number shown is > > > > > increasing. > > > > > rm> > > > > > > rm> > Many thanks Rick wasnt aware we had anything experimental > > > > > enabled > > > > > rm> > but I think that would be a yes looking at these number:- > > > > > rm> > > > > > > rm> > vmstat -z | fgrep -i namei > > > > > rm> > NAMEI: 1024, 0, 1, 1483, 25285086096, 0 > > > > > rm> > vmstat -z | fgrep -i namei > > > > > rm> > NAMEI: 1024, 0, 0, 1484, 25285945725, 0 > > > > > rm> > > > > > > rm> ^ > > > > > rm> I don't think so, since the 3rd number (USED) is 0 here. > > > > > rm> If that # is increasing over time, you have the leak. You > > > > > are > > > > > rm> probably running the old (default in 8.x) NFS server. > > > > > > > > > > Just a report, I confirmed it affected 8.x servers running > > > > > newnfs. > > > > > > > > > > Actually I have been suffered from memory starvation symptom on > > > > > that > > > > > server (24GB RAM) for a long time and watching vmstat -z > > > > > periodically. It stopped working once a week. I investigated > > > > > the > > > > > vmstat log again and found the amount of NAMEI leak was > > > > > 11,543,956 > > > > > (about 11GB!) just before the locked-up. After applying the > > > > > patch, > > > > > the leak disappeared. Thank you for fixing it! > > > > > > > > > > -- Hiroki > > > And thanks Hiroki for testing it on 8.x. > > > > > > > this is on 8.2-STABLE/amd64 from around August: > > > > same here, this zfs+newnfs has been hanging every few months, and > > > > I > > > > can see > > > > now the leak, it's slowly increasing: > > > > NAMEI: 1024, 0, 122975, 529, 15417248, 0 > > > > NAMEI: 1024, 0, 122984, 520, 15421772, 0 > > > > NAMEI: 1024, 0, 123002, 502, 15424743, 0 > > > > NAMEI: 1024, 0, 123008, 496, 15425464, 0 > > > > > > > > cheers, > > > > danny > > > Maybe you could try the patch, too. > > > > > > It's at: > > > http://people.freebsd.org/~rmacklem/namei-leak.patch > > > > > > I'll commit it to head soon with a 1 month MFC, so that hopefully > > > Oliver will have a chance to try it on his production server before > > > the MFC. > > > > > > Thanks everyone, for your help with this, rick > > > > I haven't applied the patch yet, but in the meanime I have been > > running some > > experiments on a zfs/nfs server running 8.3-STABLE, and don't see any > > leaks > > what triggers the leak? > > > Fortunately Oliver isolated this. It should leak when you do a successful > "rm" or "rmdir" while running the new/experimental server. > but that's what I did, I'm running the new/experimental nfs server (or so I think :-), and did a huge rm -rf and nothing, nada, no leak. To check the patch, I have to upgrade the production server, the one with the leak, but I wanted to test it on a non production first. Anyways, ill patch the kernel and try it on the leaking production server tomorrow. danny From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 16:06:10 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2008D1065672; Sun, 29 Apr 2012 16:06:10 +0000 (UTC) (envelope-from oliver.pntr@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id B84928FC0C; Sun, 29 Apr 2012 16:06:09 +0000 (UTC) Received: by yenl9 with SMTP id l9so1250608yen.13 for ; Sun, 29 Apr 2012 09:06:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=YQzKLimJYLLufUarpcclv9xO+Gq/FYtczEW6mx3Brsw=; b=Z+rmrg+T2ek7TPZkdI1EqFhHyyd+mpqGXHmpDLSRT0j4q70eKzYSPjIGxNF/ez7+l3 mrZ60F64i/V29QtKPJiHZrR11+UVMWUL6cKm6O4MZCxp5xmUz+M2XJgxu1FZa0T/z/i3 pnwyGX5NfS3/dM+Q9eGKB3etIBbiVYHcJqFwRodBS/NNSFf32nKmZ/vKmZ4kYy3jqNM/ l/UaZAfRBJ9mlB4aH2j4sgqNERxCR5eaO82+OCvCUeZFAUzdDDu1C3r1bdnnKyzAQIKD 92YKVht7nhwRZNjB6p3/T7bFC1yccxKYinYN0CWxj/UTGO/7t6RR79hBDgtzTKIbzqBl oLHA== MIME-Version: 1.0 Received: by 10.236.192.136 with SMTP id i8mr12255097yhn.122.1335715569055; Sun, 29 Apr 2012 09:06:09 -0700 (PDT) Received: by 10.236.161.97 with HTTP; Sun, 29 Apr 2012 09:06:09 -0700 (PDT) In-Reply-To: <4F9D4491.2060007@FreeBSD.org> References: <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> <4F9CCEF2.6050609@FreeBSD.org> <20120429155512.M91148@sola.nimnet.asn.au> <4F9CDE91.1060300@FreeBSD.org> <4F9D2F0C.4050501@FreeBSD.org> <20120429122714.GA56829@ravenloft.kiev.ua> <4F9D3DF8.9000800@FreeBSD.org> <20120429133056.GA58422@ravenloft.kiev.ua> <4F9D4491.2060007@FreeBSD.org> Date: Sun, 29 Apr 2012 18:06:09 +0200 Message-ID: From: Oliver Pinter To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-stable@freebsd.org, Alex Kozlov Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 16:06:10 -0000 On 4/29/12, Alexander Motin wrote: > On 04/29/12 16:30, Alex Kozlov wrote: >> On Sun, Apr 29, 2012 at 04:11:20PM +0300, Alexander Motin wrote: >>> On 04/29/12 15:27, Alex Kozlov wrote: >>>> On Sun, Apr 29, 2012 at 03:07:40PM +0300, Alexander Motin wrote: >>>>> On 04/29/12 15:04, Oliver Pinter wrote: >>>>>> Removing dummynet from kernel don't chanage anything, that is >>>>>> releated >>>>>> to load average. The loadavg hold to 0.70 +/- 0.2. (single user : sh >>>>>> + >>>>>> top) >>>>> >>>>> New ktr dump? >>>> I have similar issue on one of my laptops. Should I provide ktr dump? >>>> http://lists.freebsd.org/pipermail/freebsd-current/2011-September/027133.html >>> In your case HPET also shares interrupt with other devices. I suspect >>> that may be a reason. Every time when swi thread runs loadavg, other CPU >>> runs shared interrupt handler, that is accounted as result. Please show >>> your verbose dmesg. >> Attached. > > In your case HPET could solely use IRQ22 that seems free now. After > recent changes in ACPI code it is detected before PCI devices and so > doesn't avoids sharing. You may try to hint it specific IRQ by adding to > loader,conf line: > hint.hpet.0.allowed_irqs="0x00400000" > > -- > Alexander Motin The hint.hpet.0.allowed_irqs="0x00400000" fixed the issue, thanks. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 17:31:13 2012 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E7FC2106566B for ; Sun, 29 Apr 2012 17:31:13 +0000 (UTC) (envelope-from jhellenthal@dataix.net) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 9740E8FC0C for ; Sun, 29 Apr 2012 17:31:13 +0000 (UTC) Received: by iahk25 with SMTP id k25so4463152iah.13 for ; Sun, 29 Apr 2012 10:31:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dataix.net; s=rsa; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition; bh=SbY+zlHujWxZlq349SfV60BYMer2CHnf5D7eG5tObNw=; b=P1iLVF0NKLSi3GoR2j4u/IkGOB+SxxhAGZ0QlrXqr/8b25g61/WQMg3Mc9pots+/PB 1qeNiseUH6iMlP6cNd/Rf4uBVPeYW3eq4ntsdDFWPvQMDcyladnZ8CfYMJUfiHO9UFmX WWzLZqxZmXLFMHsdRZf5oXND2VYTrvXhFXZNo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:to:subject:message-id:mime-version:content-type :content-disposition:x-gm-message-state; bh=SbY+zlHujWxZlq349SfV60BYMer2CHnf5D7eG5tObNw=; b=d1clwr5noInMhkpfBiQT/QOkoaIi2dmRGr/vsFZoz1HkKUcKuYznhTJsjCv/N7l76d 7Ru19ZMgLwagcDFIxmiY3Ca1WFfONDTninF8cVMNTU2Fsly9tpoPdyWq2i8JobRfbUdC AJwJ/3MQgSm86h3guBKPJfLYF0u4iDxUsav7YpBYiQGzJQ+ofcO1DcoZVYlEJNHw5VTf NhbrZ+HH1uJ1J5/A34fmKkaOyWEv/ZSTgNDOXZCEWwWklUVfuDn3Lc+mLpKGKRjmL0Pm bqamRzmAk5+JxHKhGHERX6ss1rCzcxPqbcavAGGK2iajxXBnOZggPUW2hZyHAuvccPLB l/tA== Received: by 10.50.45.138 with SMTP id n10mr8095142igm.70.1335720673257; Sun, 29 Apr 2012 10:31:13 -0700 (PDT) Received: from DataIX.net ([99.181.146.133]) by mx.google.com with ESMTPS id kn3sm11346630igc.15.2012.04.29.10.31.12 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 29 Apr 2012 10:31:12 -0700 (PDT) Received: from DataIX.net (localhost [127.0.0.1]) by DataIX.net (8.14.5/8.14.5) with ESMTP id q3THVANG007405 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Sun, 29 Apr 2012 13:31:11 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Received: (from jhellenthal@localhost) by DataIX.net (8.14.5/8.14.5/Submit) id q3THVAbv007404 for stable@freebsd.org; Sun, 29 Apr 2012 13:31:10 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Date: Sun, 29 Apr 2012 13:31:10 -0400 From: Jason Hellenthal To: stable@freebsd.org Message-ID: <20120429173110.GA5495@DataIX.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="T4sUOijqQbZv57TR" Content-Disposition: inline X-Gm-Message-State: ALoCoQlQPNz0we00Ipd0pHvW9kcmCFAOAxIqHewk4Q0MqvIUD1XpUtATucjPXD1KgNxeNYnmUtCt Cc: Subject: -DNO_CLEAN compiling & recent changes as of ~two weeks. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 17:31:14 -0000 --T4sUOijqQbZv57TR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Somewhere is the last two weeks it seems something has changed on 8-STABLE that causes a complete rebuild of the kernel every time it is built. While this is not too much of a problem, it is quite a neusense when attempting to make a quick change that would only require a recompile of the effected code and relink that would only amount to about 5 or 10 minutes. I am running FreeBSD 8.3-STABLE #0 r234692 i386 where this has been an issue. The earliest part of the kernel I always see compile is ACPI code if that helps to determine the problem. A few committs that I picked out that might cause it but only a guess is... (I could be wrong about these) After 8.3-RELEASE r234634 r234631 r234604 Before 8.3-RELEASE r234534 r234512 r234509 Maybe just a text or data relocation issue ? Has anyone else noticed this ? To test after a full build of kernel #0. 1) Change config ROUTETABLES=3D{ROUTETABLES+1} 2) cd /usr/src 3) time -h make -DNO_CLEAN buildkernel This should only take a few minutes as an example only recompiling what only is needed. --=20 - (2^(N-1)) --T4sUOijqQbZv57TR Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJPnXreAAoJEBSh2Dr1DU7WBOkH/2ADXmOGr4ECg1dLWkEqFeFD EdKGrzt4gRdGgK/6msb56gWQQL7r/3vYxWeDW5tPY2tEp1ESMTFZknt39Ve96sOV WzsFuAA/2L60JCfBtudeRx6aeUmOuA4f/F5WslwaKOieasWNREF0bfhGPDjcbx8R xjo1SGUI3GvMg3LvHLpP8MNwpz81HJNY4udG0E+Oyu7EhN3btEBvikXOYmLvycYw rvmmnLILhPrvf8dz5aGAxzZycPloOoJIy663RFpN0Px6N4Dh82idxK+6GLFBBu25 Ur5T6TE/wzAlGeg5sY9g5JHarM6gRFhD03D3qhVTUlF7EZ9escjVuiLWY+kNQA4= =/95r -----END PGP SIGNATURE----- --T4sUOijqQbZv57TR-- From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 17:35:52 2012 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AF884106564A for ; Sun, 29 Apr 2012 17:35:52 +0000 (UTC) (envelope-from lists@eitanadler.com) Received: from mail-wi0-f172.google.com (mail-wi0-f172.google.com [209.85.212.172]) by mx1.freebsd.org (Postfix) with ESMTP id 3357B8FC0A for ; Sun, 29 Apr 2012 17:35:52 +0000 (UTC) Received: by wibhj6 with SMTP id hj6so1706768wib.13 for ; Sun, 29 Apr 2012 10:35:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=eitanadler.com; s=0xdeadbeef; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=0QXlEYAzQlN4qLYMexm9V4YVidQjk9BR4D0oAbwy97E=; b=Nl0gtWLpFPcTxwDTtTiOtg8Od4klalSVTvM3vo5TxgabNAGSc0qqiw98WOc8jA/UST +8qbxDYiZ8uDUBQg8tmCQLLN+FUwyp0f9UA6g3dgToY/d5+pkHNJ/k3Z7lBA/UdW6K63 gZjPG8HOlrmkW3l77pe0cJnkD+7LR9T08INuU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:x-gm-message-state; bh=0QXlEYAzQlN4qLYMexm9V4YVidQjk9BR4D0oAbwy97E=; b=YKnIvJjiiq65aGtZRVfoO16IHpvP4Hie4y2QS7u4+nPJIgixWuEBcow6niYF4NvV/i 4ekCWIJllUfwKS67iTRHF4JR2vw+IEhHQ1nCpW/OoIqHCgzCpQjPAW/aIyOuxN4MJHiO WMwp6YViaiHqZe1CsA3ymuwRe5a995KUEsfEjvqNXTLBVqUmZZ2IkiZSige/fRSWdjFe FYbIEZ66hvDYEAUdeAkq5eaABhovZMzWkVMhUiM+UZqyTVTzrfmTt6NB2vKtRc+8NIIR wmUn6Zk+CuTpWnk4ZN/1vIycSDLH7umAzlBHLa3O3GNo3CgQXT3eCyBniy8pZoLRr5v6 t3LQ== Received: by 10.180.85.70 with SMTP id f6mr13851081wiz.5.1335720950930; Sun, 29 Apr 2012 10:35:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.73.195 with HTTP; Sun, 29 Apr 2012 10:35:20 -0700 (PDT) In-Reply-To: <20120429173110.GA5495@DataIX.net> References: <20120429173110.GA5495@DataIX.net> From: Eitan Adler Date: Sun, 29 Apr 2012 13:35:20 -0400 Message-ID: To: Jason Hellenthal Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQkNBut/PfZIMxvYvlyUWng22DCej8WVNekypxia/A3TNME9i4W3e/wGjjECE+85s5ZyOeaa Cc: stable@freebsd.org Subject: Re: -DNO_CLEAN compiling & recent changes as of ~two weeks. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 17:35:52 -0000 On 29 April 2012 13:31, Jason Hellenthal wrote: > > Somewhere is the last two weeks it seems something has changed on > 8-STABLE that causes a complete rebuild of the kernel every time it is > built. > > While this is not too much of a problem, it is quite a neusense when > attempting to make a quick change that would only require a recompile of > the effected code and relink that would only amount to about 5 or 10 > minutes. > > I am running FreeBSD 8.3-STABLE #0 r234692 i386 where this has been an > issue. The earliest part of the kernel I always see compile is ACPI code > if that helps to determine the problem. > > A few committs that I picked out that might cause it but only a guess > is... (I could be wrong about these) > > After 8.3-RELEASE > r234634 > r234631 > r234604 > > Before 8.3-RELEASE > r234534 > r234512 > r234509 > > Maybe just a text or data relocation issue ? Has anyone else noticed this ? > > > To test after a full build of kernel #0. > > 1) Change config ROUTETABLES={ROUTETABLES+1} > 2) cd /usr/src > 3) time -h make -DNO_CLEAN buildkernel use -DKERNFAST or -DNO_KERNELCLEAN -- Eitan Adler From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 17:58:32 2012 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 504321065670 for ; Sun, 29 Apr 2012 17:58:32 +0000 (UTC) (envelope-from jhellenthal@dataix.net) Received: from mail-iy0-f182.google.com (mail-iy0-f182.google.com [209.85.210.182]) by mx1.freebsd.org (Postfix) with ESMTP id 053498FC0A for ; Sun, 29 Apr 2012 17:58:31 +0000 (UTC) Received: by iahk25 with SMTP id k25so4488803iah.13 for ; Sun, 29 Apr 2012 10:58:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dataix.net; s=rsa; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; bh=/EJh2/kN82BKmmkkawe5bLgvqQ2A0R4hV8Cs1i4K7fA=; b=XzJzH6SeWDUOAR35Poivv6c+vZ6AHHAIFKvI8MsmIpXPthkdj9hjrkM/qALKCSHor7 CFE52Vn0sVtwyaOHCnt2SJ/2xGG2r+yVJBvGsI6OdlY9ljNCAsjlEqzYt1+nP0i3vXOO WeNv2iTOxKi4+C5CKsORKCz3mq629hXavk4F8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:x-gm-message-state; bh=/EJh2/kN82BKmmkkawe5bLgvqQ2A0R4hV8Cs1i4K7fA=; b=IJ5MfXaEPLFeaLLAQzmne5FiMmUkmOONBKtSGT4g/2BI+Z0qOSc4+F+BaE8rz5NP5i dZSEbCRyrLTwWVdoEvPuI6SGZ/ybdKoEQ1pXYtz1PdI9yFmImYnHTdAVjuXfN7pxWlcj w8duf7ZfPja8YpW2yKceBmoBuYEyfbck1OBaXBImnLwQUp74KEufesB7Hclh88xvH1Kx zkZrNFGxN4ewixN+92bvjpyDL1hb+ptZ+gRLFyLTTBm2nDcECEkbW1t5DsPDEfUmv+9f jU0QmF3HhWKjz1q/kcldGOdOBqGAgY0Chxf3z9HdygvTEmJq4RwKQ1kHp6bT1jYCnnIZ 9xMg== Received: by 10.50.153.132 with SMTP id vg4mr8315338igb.2.1335722311604; Sun, 29 Apr 2012 10:58:31 -0700 (PDT) Received: from DataIX.net ([99.181.146.133]) by mx.google.com with ESMTPS id gs4sm25466294igc.8.2012.04.29.10.58.30 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 29 Apr 2012 10:58:31 -0700 (PDT) Received: from DataIX.net (localhost [127.0.0.1]) by DataIX.net (8.14.5/8.14.5) with ESMTP id q3THwScC031917 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 29 Apr 2012 13:58:29 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Received: (from jhellenthal@localhost) by DataIX.net (8.14.5/8.14.5/Submit) id q3THwSLn031916; Sun, 29 Apr 2012 13:58:28 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Date: Sun, 29 Apr 2012 13:58:28 -0400 From: Jason Hellenthal To: Eitan Adler Message-ID: <20120429175828.GA29220@DataIX.net> References: <20120429173110.GA5495@DataIX.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Gm-Message-State: ALoCoQlnn2/4ihL52MWB53ONLtMiL40JpWKn2k5nTYOnUJ6orFei4Ce0GUPuwQafq4/s+k6EEGmc Cc: stable@freebsd.org Subject: Re: -DNO_CLEAN compiling & recent changes as of ~two weeks. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 17:58:32 -0000 On Sun, Apr 29, 2012 at 01:35:20PM -0400, Eitan Adler wrote: > On 29 April 2012 13:31, Jason Hellenthal wrote: > > > > Somewhere is the last two weeks it seems something has changed on > > 8-STABLE that causes a complete rebuild of the kernel every time it is > > built. > > > > While this is not too much of a problem, it is quite a neusense when > > attempting to make a quick change that would only require a recompile of > > the effected code and relink that would only amount to about 5 or 10 > > minutes. > > > > I am running FreeBSD 8.3-STABLE #0 r234692 i386 where this has been an > > issue. The earliest part of the kernel I always see compile is ACPI code > > if that helps to determine the problem. > > > > A few committs that I picked out that might cause it but only a guess > > is... (I could be wrong about these) > > > > After 8.3-RELEASE > > r234634 > > r234631 > > r234604 > > > > Before 8.3-RELEASE > > r234534 > > r234512 > > r234509 > > > > Maybe just a text or data relocation issue ? Has anyone else noticed this ? > > > > > > To test after a full build of kernel #0. > > > > 1) Change config ROUTETABLES={ROUTETABLES+1} > > 2) cd /usr/src > > 3) time -h make -DNO_CLEAN buildkernel > > use -DKERNFAST or -DNO_KERNELCLEAN > Sorry but NO_CLEAN has been doing fine for a long time now and has not changed recently. Like I said this happened about 2 weeks ago and was not because of these defines. -- - (2^(N-1)) From owner-freebsd-stable@FreeBSD.ORG Sun Apr 29 20:48:38 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5FDA4106564A; Sun, 29 Apr 2012 20:48:38 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.mail.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id F143D8FC08; Sun, 29 Apr 2012 20:48:37 +0000 (UTC) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AqAEAC6onU+DaFvO/2dsb2JhbAA8CA4IhVKtOIIJAQEBAwEBAQEgKyALBQcPDgcDAgINGQIpAQkmBggCBQQBHASHZwULpn6SBIEviVoDhH6BGASTT4IvgRGPMYIvVYFA X-IronPort-AV: E=Sophos;i="4.75,501,1330923600"; d="scan'208";a="167145853" Received: from erie.cs.uoguelph.ca (HELO zcs3.mail.uoguelph.ca) ([131.104.91.206]) by esa-annu-pri.mail.uoguelph.ca with ESMTP; 29 Apr 2012 16:48:36 -0400 Received: from zcs3.mail.uoguelph.ca (localhost.localdomain [127.0.0.1]) by zcs3.mail.uoguelph.ca (Postfix) with ESMTP id EC3D3B40ED; Sun, 29 Apr 2012 16:48:36 -0400 (EDT) Date: Sun, 29 Apr 2012 16:48:36 -0400 (EDT) From: Rick Macklem To: Daniel Braniss Message-ID: <99719742.103996.1335732516952.JavaMail.root@erie.cs.uoguelph.ca> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.91.201] X-Mailer: Zimbra 6.0.10_GA_2692 (ZimbraWebClient - FF3.0 (Win)/6.0.10_GA_2692) Cc: killing@multiplay.co.uk, Hiroki Sato , freebsd-stable@FreeBSD.org, ob@e-Gitt.NET Subject: Re: 9-STABLE, ZFS, NFS, ggatec - suspected memory leak X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 29 Apr 2012 20:48:38 -0000 Daniel Braniss wrote: > > Daniel Braniss wrote: > > > > Daniel Braniss wrote: > > > > > > ----Security_Multipart(Fri_Apr_27_13_35_56_2012_748)-- > > > > > > Content-Type: Text/Plain; charset=us-ascii > > > > > > Content-Transfer-Encoding: 7bit > > > > > > > > > > > > Rick Macklem wrote > > > > > > in > > > > > > <1527622626.3418715.1335445225510.JavaMail.root@erie.cs.uoguelph.ca>: > > > > > > > > > > > > rm> Steven Hartland wrote: > > > > > > rm> > ---- Original Message ----- > > > > > > rm> > From: "Rick Macklem" > > > > > > rm> > > At a glance, it looks to me like 8.x is affected. > > > > > > Note > > > > > > that > > > > > > the > > > > > > rm> > > bug only affects the new NFS server (the > > > > > > experimental > > > > > > one > > > > > > for 8.x) > > > > > > rm> > > when exporting ZFS volumes. (UFS exported volumes > > > > > > don't > > > > > > leak) > > > > > > rm> > > > > > > > > rm> > > If you are running a server that might be affected, > > > > > > just: > > > > > > rm> > > # vmstat -z | fgrep -i namei > > > > > > rm> > > on the server and see if the 3rd number shown is > > > > > > increasing. > > > > > > rm> > > > > > > > rm> > Many thanks Rick wasnt aware we had anything > > > > > > experimental > > > > > > enabled > > > > > > rm> > but I think that would be a yes looking at these > > > > > > number:- > > > > > > rm> > > > > > > > rm> > vmstat -z | fgrep -i namei > > > > > > rm> > NAMEI: 1024, 0, 1, 1483, 25285086096, 0 > > > > > > rm> > vmstat -z | fgrep -i namei > > > > > > rm> > NAMEI: 1024, 0, 0, 1484, 25285945725, 0 > > > > > > rm> > > > > > > > rm> ^ > > > > > > rm> I don't think so, since the 3rd number (USED) is 0 here. > > > > > > rm> If that # is increasing over time, you have the leak. > > > > > > You > > > > > > are > > > > > > rm> probably running the old (default in 8.x) NFS server. > > > > > > > > > > > > Just a report, I confirmed it affected 8.x servers running > > > > > > newnfs. > > > > > > > > > > > > Actually I have been suffered from memory starvation > > > > > > symptom on > > > > > > that > > > > > > server (24GB RAM) for a long time and watching vmstat -z > > > > > > periodically. It stopped working once a week. I > > > > > > investigated > > > > > > the > > > > > > vmstat log again and found the amount of NAMEI leak was > > > > > > 11,543,956 > > > > > > (about 11GB!) just before the locked-up. After applying the > > > > > > patch, > > > > > > the leak disappeared. Thank you for fixing it! > > > > > > > > > > > > -- Hiroki > > > > And thanks Hiroki for testing it on 8.x. > > > > > > > > > this is on 8.2-STABLE/amd64 from around August: > > > > > same here, this zfs+newnfs has been hanging every few months, > > > > > and > > > > > I > > > > > can see > > > > > now the leak, it's slowly increasing: > > > > > NAMEI: 1024, 0, 122975, 529, 15417248, 0 > > > > > NAMEI: 1024, 0, 122984, 520, 15421772, 0 > > > > > NAMEI: 1024, 0, 123002, 502, 15424743, 0 > > > > > NAMEI: 1024, 0, 123008, 496, 15425464, 0 > > > > > > > > > > cheers, > > > > > danny > > > > Maybe you could try the patch, too. > > > > > > > > It's at: > > > > http://people.freebsd.org/~rmacklem/namei-leak.patch > > > > > > > > I'll commit it to head soon with a 1 month MFC, so that > > > > hopefully > > > > Oliver will have a chance to try it on his production server > > > > before > > > > the MFC. > > > > > > > > Thanks everyone, for your help with this, rick > > > > > > I haven't applied the patch yet, but in the meanime I have been > > > running some > > > experiments on a zfs/nfs server running 8.3-STABLE, and don't see > > > any > > > leaks > > > what triggers the leak? > > > > > Fortunately Oliver isolated this. It should leak when you do a > > successful > > "rm" or "rmdir" while running the new/experimental server. > > > but that's what I did, I'm running the new/experimental nfs server > (or so I think :-), and did a huge rm -rf and nothing, nada, no leak. > To check the patch, I have to upgrade the production server, the one > with the > leak, > but I wanted to test it on a non production first. Anyways, ill patch > the > kernel > and try it on the leaking production server tomorrow. > Well, I think the patch should be harmless. You can check which server you are running by doing: # nfsstat -e -s - and see if the numbers are increasing if they're zero or not increasing, you are running the old (default on 8.x) server rick > danny > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to > "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Mon Apr 30 08:11:38 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1CDDC106564A for ; Mon, 30 Apr 2012 08:11:38 +0000 (UTC) (envelope-from peter.maloney@brockmann-consult.de) Received: from mo6-p05-ob.rzone.de (mo6-p05-ob.rzone.de [IPv6:2a01:238:20a:202:5305::1]) by mx1.freebsd.org (Postfix) with ESMTP id 716CD8FC15 for ; Mon, 30 Apr 2012 08:11:37 +0000 (UTC) X-RZG-AUTH: :LWIKdA2leu0bPbLmhzXgqn0MTG6qiKEwQRWfNxSw4HzYIwjsnvdDt2QV8d370m+nQbyGZQ== X-RZG-CLASS-ID: mo05 Received: from [192.168.179.42] (hmbg-4d06bc54.pool.mediaWays.net [77.6.188.84]) by smtp.strato.de (jored mo86) (RZmta 28.14 DYNA|AUTH) with (DHE-RSA-CAMELLIA256-SHA encrypted) ESMTPA id F027eao3U6wA71 for ; Mon, 30 Apr 2012 10:11:36 +0200 (CEST) Message-ID: <4F9E4937.7040000@brockmann-consult.de> Date: Mon, 30 Apr 2012 10:11:35 +0200 From: Peter Maloney User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:11.0) Gecko/20120327 Thunderbird/11.0.1 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <4E9B7F6B991C46BF9CCBC03F72A56AFB@CMOTUM25PC><795E082973104798BB84124E63C556CB@CMOTUM25PC><4F9AB906.7000400@my.gd> In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Subject: Re: /var getting full X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Apr 2012 08:11:38 -0000 Am 27.04.2012 17:26, schrieb Efraín Déctor: > Thank you all. > > I found out that a Java process was using all this space. I restarted > it and voilá problem solved. Did you write this Java program? If so, you probably need a finally block: File f = ... InputStream in = null; try { in = new FileInputStream(in); //whatever you do here, such as create a Reader, you keep a reference to the InputStream }finally{ //A finally is called regardless of what happens in the try. For example, if there is an Exception thrown, the finally is run anyway. Code at the end of the try is not called when an exception is thrown. if( in != null ) { //you must wrap this in a try{}catch(IOException){}, otherwise the rest of your finally is not run if it throws an Exception try{ in.close(); }catch(IOException e) { logger.log(Level.SEVERE, Failed to close InputStream", e); } } } > > > Thanks. > -----Mensaje original----- From: Tom Evans > Sent: Friday, April 27, 2012 10:22 AM > To: Damien Fleuriot > Cc: freebsd-stable@freebsd.org > Subject: Re: /var getting full > > On Fri, Apr 27, 2012 at 4:19 PM, Damien Fleuriot wrote: >> Type: >> sync >> >> >> Then: >> df -h >> >> Then: >> cd /var && du -hd 1 >> >> >> Post results. >> > > As well as this, any unlinked files that have file handles open by > running processes will not be accounted for in du, but will be counted > in df. You could try restarting services that write to /var. > > Cheers > > Tom > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Mon Apr 30 09:54:05 2012 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DB26D1065674; Mon, 30 Apr 2012 09:54:05 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.16.84]) by mx1.freebsd.org (Postfix) with ESMTP id 4E57E8FC12; Mon, 30 Apr 2012 09:54:05 +0000 (UTC) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by kabab.cs.huji.ac.il with esmtp id 1SOnIu-000Dhp-Tf; Mon, 30 Apr 2012 12:54:01 +0300 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.3 To: Rick Macklem In-reply-to: <99719742.103996.1335732516952.JavaMail.root@erie.cs.uoguelph.ca> References: <99719742.103996.1335732516952.JavaMail.root@erie.cs.uoguelph.ca> Comments: In-reply-to Rick Macklem message dated "Sun, 29 Apr 2012 16:48:36 -0400." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Mon, 30 Apr 2012 12:54:00 +0300 From: Daniel Braniss Message-ID: Cc: killing@multiplay.co.uk, Hiroki Sato , freebsd-stable@FreeBSD.org, ob@e-Gitt.NET Subject: Re: 9-STABLE, ZFS, NFS, ggatec - suspected memory leak X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Apr 2012 09:54:05 -0000 > Daniel Braniss wrote: > > > Daniel Braniss wrote: > > > > > Daniel Braniss wrote: > > > > > > > ----Security_Multipart(Fri_Apr_27_13_35_56_2012_748)-- > > > > > > > Content-Type: Text/Plain; charset=us-ascii > > > > > > > Content-Transfer-Encoding: 7bit > > > > > > > > > > > > > > Rick Macklem wrote > > > > > > > in > > > > > > > <1527622626.3418715.1335445225510.JavaMail.root@erie.cs.uoguelph.ca>: > > > > > > > > > > > > > > rm> Steven Hartland wrote: > > > > > > > rm> > ---- Original Message ----- > > > > > > > rm> > From: "Rick Macklem" > > > > > > > rm> > > At a glance, it looks to me like 8.x is affected. > > > > > > > Note > > > > > > > that > > > > > > > the > > > > > > > rm> > > bug only affects the new NFS server (the > > > > > > > experimental > > > > > > > one > > > > > > > for 8.x) > > > > > > > rm> > > when exporting ZFS volumes. (UFS exported volumes > > > > > > > don't > > > > > > > leak) > > > > > > > rm> > > > > > > > > > rm> > > If you are running a server that might be affected, > > > > > > > just: > > > > > > > rm> > > # vmstat -z | fgrep -i namei > > > > > > > rm> > > on the server and see if the 3rd number shown is > > > > > > > increasing. > > > > > > > rm> > > > > > > > > rm> > Many thanks Rick wasnt aware we had anything > > > > > > > experimental > > > > > > > enabled > > > > > > > rm> > but I think that would be a yes looking at these > > > > > > > number:- > > > > > > > rm> > > > > > > > > rm> > vmstat -z | fgrep -i namei > > > > > > > rm> > NAMEI: 1024, 0, 1, 1483, 25285086096, 0 > > > > > > > rm> > vmstat -z | fgrep -i namei > > > > > > > rm> > NAMEI: 1024, 0, 0, 1484, 25285945725, 0 > > > > > > > rm> > > > > > > > > rm> ^ > > > > > > > rm> I don't think so, since the 3rd number (USED) is 0 here. > > > > > > > rm> If that # is increasing over time, you have the leak. > > > > > > > You > > > > > > > are > > > > > > > rm> probably running the old (default in 8.x) NFS server. > > > > > > > > > > > > > > Just a report, I confirmed it affected 8.x servers running > > > > > > > newnfs. > > > > > > > > > > > > > > Actually I have been suffered from memory starvation > > > > > > > symptom on > > > > > > > that > > > > > > > server (24GB RAM) for a long time and watching vmstat -z > > > > > > > periodically. It stopped working once a week. I > > > > > > > investigated > > > > > > > the > > > > > > > vmstat log again and found the amount of NAMEI leak was > > > > > > > 11,543,956 > > > > > > > (about 11GB!) just before the locked-up. After applying the > > > > > > > patch, > > > > > > > the leak disappeared. Thank you for fixing it! > > > > > > > > > > > > > > -- Hiroki > > > > > And thanks Hiroki for testing it on 8.x. > > > > > > > > > > > this is on 8.2-STABLE/amd64 from around August: > > > > > > same here, this zfs+newnfs has been hanging every few months, > > > > > > and > > > > > > I > > > > > > can see > > > > > > now the leak, it's slowly increasing: > > > > > > NAMEI: 1024, 0, 122975, 529, 15417248, 0 > > > > > > NAMEI: 1024, 0, 122984, 520, 15421772, 0 > > > > > > NAMEI: 1024, 0, 123002, 502, 15424743, 0 > > > > > > NAMEI: 1024, 0, 123008, 496, 15425464, 0 > > > > > > > > > > > > cheers, > > > > > > danny > > > > > Maybe you could try the patch, too. > > > > > > > > > > It's at: > > > > > http://people.freebsd.org/~rmacklem/namei-leak.patch > > > > > > > > > > I'll commit it to head soon with a 1 month MFC, so that > > > > > hopefully > > > > > Oliver will have a chance to try it on his production server > > > > > before > > > > > the MFC. > > > > > > > > > > Thanks everyone, for your help with this, rick > > > > > > > > I haven't applied the patch yet, but in the meanime I have been > > > > running some > > > > experiments on a zfs/nfs server running 8.3-STABLE, and don't see > > > > any > > > > leaks > > > > what triggers the leak? > > > > > > > Fortunately Oliver isolated this. It should leak when you do a > > > successful > > > "rm" or "rmdir" while running the new/experimental server. > > > > > but that's what I did, I'm running the new/experimental nfs server > > (or so I think :-), and did a huge rm -rf and nothing, nada, no leak. > > To check the patch, I have to upgrade the production server, the one > > with the > > leak, > > but I wanted to test it on a non production first. Anyways, ill patch > > the > > kernel > > and try it on the leaking production server tomorrow. > > > Well, I think the patch should be harmless. > > You can check which server you are running by doing: > # nfsstat -e -s > - and see if the numbers are increasing > if they're zero or not increasing, you are running the old (default on 8.x) > server was running the wrong nfsd, now all is ok, and the patch works (obviously :-) BTW, if the if the experimental is not running then # nfsstat -e -s nfsstat: experimental client/server not loaded # danny From owner-freebsd-stable@FreeBSD.ORG Mon Apr 30 10:19:57 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6C3351065670; Mon, 30 Apr 2012 10:19:57 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from smtp-int-m.obspm.fr (smtp-int-m.obspm.fr [145.238.187.15]) by mx1.freebsd.org (Postfix) with ESMTP id 077368FC08; Mon, 30 Apr 2012 10:19:56 +0000 (UTC) Received: from pcjas.obspm.fr (pcjas.obspm.fr [145.238.184.233]) by smtp-int-m.obspm.fr (8.14.3/8.14.3/SIO Observatoire de Paris - 07/2009) with ESMTP id q3UAJno5004955 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Mon, 30 Apr 2012 12:19:50 +0200 Date: Mon, 30 Apr 2012 12:19:49 +0200 From: Albert Shih To: Alexander Motin Message-ID: <20120430101949.GB73975@pcjas.obspm.fr> References: <20120427203013.GB60961@pcjas.obspm.fr> <20120427213459.GA61125@pcjas.obspm.fr> <4F9B946D.3030607@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <4F9B946D.3030607@FreeBSD.org> User-Agent: Mutt/1.5.21 (2010-09-15) X-Miltered: at smtp-int-m.obspm.fr with ID 4F9E6745.000 by Joe's j-chkmail (http : // j-chkmail dot ensmp dot fr)! X-j-chkmail-Enveloppe: 4F9E6745.000/145.238.184.233/pcjas.obspm.fr/pcjas.obspm.fr/ Cc: freebsd-stable@freebsd.org Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Apr 2012 10:19:57 -0000 Le 28/04/2012 ? 09:55:41+0300, Alexander Motin a écrit > >>> > >>> last pid: 61010; load averages: 0.00, 0.00, 0.00 up 2+11:02:42 > >>> 22:29:08 > >>> 126 processes: 1 running, 125 sleeping > >>> CPU: % user, % nice, % system, % interrupt, % idle > >>> Mem: 803M Active, 2874M Inact, 1901M Wired, 112M Cache, 620M Buf, 202M Free > >>> Swap: 6144M Total, 36M Used, 6107M Free > >>> > >> > >> http://lists.freebsd.org/pipermail/freebsd-bugs/2012-April/048213.html > > > > What I understand of your message (I'm definitvly not a dev) is that's only > > a little problem of accounting. > > > > I'm not absolute sure of that because my laptop fan never stop... > > > > If you want any more information... > > Definitely, because here I don't see much. > > Generally, all CPU loads and load averages now calculated via sampling, > so theoretically with spiky load numbers may vary for many reasons. I > would start from collecting information about running processes. To find > fast switching processes that could hide from accounting try `top -SH -m > io -o vcsw`. To get more information about scheduler work, use > /usr/src/tools/sched/schedgraph.py (instruction inside it). I rebuild my kernel with KTR. But I'm not a dev so I have no idea what the schedgraph.py show...:-( If this can help to solve the problem you can find my ktr and my dmesg. http://dl.free.fr/csycL43ad http://dl.free.fr/j0XQFimPM Hope that can help you. If you need anything else .... Thanks. Regards. JAS -- Albert SHIH DIO bâtiment 15 Observatoire de Paris 5 Place Jules Janssen 92195 Meudon Cedex Téléphone : 01 45 07 76 26/06 86 69 95 71 xmpp: jas@obspm.fr Heure local/Local time: lun 30 avr 2012 12:10:13 CEST From owner-freebsd-stable@FreeBSD.ORG Mon Apr 30 16:31:01 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 11E6D1065675 for ; Mon, 30 Apr 2012 16:31:01 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qc0-f182.google.com (mail-qc0-f182.google.com [209.85.216.182]) by mx1.freebsd.org (Postfix) with ESMTP id C42218FC14 for ; Mon, 30 Apr 2012 16:31:00 +0000 (UTC) Received: by qcsg15 with SMTP id g15so1853219qcs.13 for ; Mon, 30 Apr 2012 09:31:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:cc:content-type; bh=RIwBQ3gic0+Uxk3lRld0xmabOd592BD17mXAb0X7Giw=; b=UwzkoRB2WPUE+OcqxZ9lDoMAdppOrp8q7VDyKkaj7ZTPE7vs9ieARmgTenazdx+w4m Dh61zAs4g7WfDpW2qYOwqicziyMPUT450KGeooBo0qdLje+QR1UHO0eqVAEzxzmiMMht 2ZBK96IDtI7VhPKssH4pcRsJ3WChMGubpOU3d6xi2pdtNv3YX9AoE4sz0VW5v4yEzoAm /NRi1YEdP2GU0agdgtzWIOreT4fnHW/YJv9bqKl+pHDW1FBL7wYD3DGXYjezcddBxWWS D6aMeO4C3kkuTcla8OdaQRaZKKXaa+nz9hXki1+D8aCcewGIQxeZQuEwocFAQ5lYZ8Gn nIKg== MIME-Version: 1.0 Received: by 10.224.115.208 with SMTP id j16mr18168406qaq.84.1335803460314; Mon, 30 Apr 2012 09:31:00 -0700 (PDT) Received: by 10.229.91.138 with HTTP; Mon, 30 Apr 2012 09:31:00 -0700 (PDT) Date: Mon, 30 Apr 2012 09:31:00 -0700 Message-ID: From: Freddie Cash To: FreeBSD Stable Content-Type: text/plain; charset=UTF-8 Cc: bzeeb+freebsd+lor@zabbadoz.net Subject: Process for getting data to report LoRs X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Apr 2012 16:31:01 -0000 Is it possible to get the backtrace for a LoR from any of the system logs or anything like that, after the fact? Especially after rebooting into a non-debug kernel? I compiled a custom kernel for our ZFS boxes that have been locking up on me lately, adding INVARIANTS and WITNESS. But, to be safe, I booted the debug kernel using nextboot on Friday. The boxes locked up over the weekend, and we restarted, reverting them back to the non-debug kernel. Going through /var/log/messages, I see a couple LoRs that aren't listed on http://ipv4.sources.zabbadoz.net/freebsd/lor.html However, as I'm not running the debug kernel anymore, I can't go through sysctl to grab the backtrace for it. Is there any other way to get the info? Is there anyway to configure the system to log the backtrace to a file? Here's the info from /var/log/messages, which I'm guessing is not enough to track down the cause of the LoR: lock order reversal: 1st 0xfffffe0019415098 zfs (zfs) @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1704 2nd 0xfffffe00191669f8 ufs (ufs) @ /usr/src/sys/kern/vfs_syscalls.c:1665 lock order reversal: 1st 0xfffffe00194d0eb8 rtentry (rtentry) @ /usr/src/sys/net/route.c:374 2nd 0xfffffe000adb2bc0 if_afdata (if_afdata) @ /usr/src/sys/netinet6/scope6.c:417 System info: FreeBSD betadrive.sd73.bc.ca 9.0-STABLE FreeBSD 9.0-STABLE #0 r234466: Fri Apr 20 10:57:30 PDT 2012 root@betadrive.sd73.bc.ca:/usr/obj/usr/src/sys/ZFSHOST90 amd64 -- Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@FreeBSD.ORG Mon Apr 30 19:19:40 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A7D9E106566B for ; Mon, 30 Apr 2012 19:19:40 +0000 (UTC) (envelope-from adams-freebsd@ateamsystems.com) Received: from fss.sandiego.ateamservers.com (fss.sandiego.ateamservers.com [69.55.229.149]) by mx1.freebsd.org (Postfix) with ESMTP id 804258FC0C for ; Mon, 30 Apr 2012 19:19:40 +0000 (UTC) Received: from [192.168.15.220] (unknown [118.175.84.92]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by fss.sandiego.ateamservers.com (Postfix) with ESMTPSA id 2B630B906C for ; Mon, 30 Apr 2012 15:14:16 -0400 (EDT) Message-ID: <4F9EE487.6020609@ateamsystems.com> Date: Tue, 01 May 2012 02:14:15 +0700 From: Adam Strohl Organization: A-Team Systems User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:11.0) Gecko/20120327 Thunderbird/11.0.1 MIME-Version: 1.0 To: FreeBSD-Stable ML Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: FreeBSD 9 "gptboot: invalid backup GPT header" error (boots fine though) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Apr 2012 19:19:40 -0000 I've been deploying FreeBSD 9 without issue on a number of near-identical servers for a client, but have run into an interesting annoyance when I hit the two DB servers. These DB servers have an LSI 3ware 9750-8i (running a 6 disk RAID 10 in a single 3TB virtual volume) which puts them apart from the other two servers in this cluster (which don't show either issue I am about to discuss). Otherwise the hardware is identical (Dual Xeon E5620s, 16GB RAM). I've also never seen this before on other physical (or VM) FreeBSD 9 instances and I've probably done 50+ FreeBSD 9 VM and physical installs at this point (and run through the installer process probably over 150 times :P). Before I get into the GPT error, I want to mention this in case its relevant: I found I had to partition via the shell (gpart create/gpart add/etc etc) the disks during install or the kernel would fail to re-mount the root disk after booting into the new OS. If I used the default layout, or the partition GUI at all (ie; 'manual mode') the new OS wouldn't remount root on boot. I could manually specify the proper root device ie; ufs:/dev/da0p3 and continue booting without issue, so this is an installer thing. I'm sure I could have fixed this in /boot/loader.conf or similar but wanted to try to figure out what was breaking (now I know its something the installer is doing since it doesn't happen when I do it manually). So I kept reOSing it doing different things and ultimately found shell-based manual partitioning worked fine. However, I see the following error right before BTX comes up (and did previously when using the installer's partition GUI): gptboot: invalid backup GPT header The machine boots fine, so I'm not stuck .... but it is an annoyance for an A-type sysadmin like myself. Even if its superficial I dislike setting up a client's machine to generate "errors" on boot, especially without an explanation or understanding behind it. I also obviously wanted to raise the issue here in case there is actually a rare problem or this is a symptom of one. I could find nothing that related specifically to this issue, so I was wondering if anyone else had seen this or had thoughts. My suspicion is that maybe the large size of the volume (3TB or 2.7TB formatted) makes it too large for the boot loader to "address all of" and thus can't get to the end of the disk where the backup GPT header is to validate it...... Or maybe the RAID adapter is doing something weird at the end of the disk. This seems unlikely since it presents the RAID as a single volume so I'd assume it would hide any tagging or RAID meta data from the OS' virtual volume though. That's about all I can think of. Selected dmesg output: LSI 3ware device driver for SAS/SATA storage controllers, version: 10.80.00.003 tws0: port 0x1000-0x10ff mem 0xb1940000-0xb1943fff,0xb1900000-0xb193ffff irq 32 at device 0.0 on pci4 tws0: Using legacy INTx tws0: Controller details: Model 9750-8i, 8 Phys, Firmware FH9X 5.12.00.007, BIOS BE9X 5.11.00.006 da0 at tws0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SCSI-5 device da0: 6000.000MB/s transfers da0: 2860992MB (5859311616 512 byte sectors: 255H 63S/T 364725C) Let me know anyone wants to see anything else/has seen this/has any theories! -- Adam Strohl A-Team Systems http://ateamsystems.com/ From owner-freebsd-stable@FreeBSD.ORG Tue May 1 06:27:54 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7EC6C1065672 for ; Tue, 1 May 2012 06:27:54 +0000 (UTC) (envelope-from dave@jetcafe.org) Received: from hugeraid.jetcafe.org (hugeraid.jetcafe.org [205.147.26.109]) by mx1.freebsd.org (Postfix) with ESMTP id 4662A8FC20 for ; Tue, 1 May 2012 06:27:54 +0000 (UTC) Received: from hugeraid.jetcafe.org (localhost [127.0.0.1]) by hugeraid.jetcafe.org (8.13.8/8.13.8) with ESMTP id q416L3DD030459 for ; Mon, 30 Apr 2012 23:21:03 -0700 (PDT) Message-Id: <201205010621.q416L3DD030459@hugeraid.jetcafe.org> X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.0.4 To: freebsd-stable@freebsd.org In-reply-to: <201204240710.q3O7AQaQ075735@hugeraid.jetcafe.org> References: <201204240710.q3O7AQaQ075735@hugeraid.jetcafe.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Mon, 30 Apr 2012 23:21:03 -0700 From: Dave Hayes Subject: Re: Attempting to boot into ramdisk on 8.3 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 06:27:54 -0000 Replying to myself here for the edification of those interested. A value of 320 for NKPT eliminated this crash, set in the kernel config file: options NKPT=320 For those of you with large ramdisk booting requirements, this one option will likely save you hours of trial and error. -- Dave Hayes - Consultant - Altadena CA, USA - dave@jetcafe.org >>> The opinions expressed above are entirely my own <<< None should say "I can trust" or "I cannot trust" until they are the master of the option of trusting or not trusting. From owner-freebsd-stable@FreeBSD.ORG Tue May 1 06:41:46 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id F0ABB1065672 for ; Tue, 1 May 2012 06:41:46 +0000 (UTC) (envelope-from bane.ivosev@pmf.uns.ac.rs) Received: from mail.pmf.uns.ac.rs (mail.pmf.uns.ac.rs [147.91.177.13]) by mx1.freebsd.org (Postfix) with ESMTP id A09C88FC21 for ; Tue, 1 May 2012 06:41:46 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail.pmf.uns.ac.rs (Postfix) with ESMTP id C82ED24940 for ; Tue, 1 May 2012 08:36:24 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mail.pmf.uns.ac.rs Received: from mail.pmf.uns.ac.rs ([127.0.0.1]) by localhost (mail.pmf.uns.ac.rs [127.0.0.1]) (amavisd-new, port 10024) with LMTP id Gk0BDvd4aYbH for ; Tue, 1 May 2012 08:36:19 +0200 (CEST) Received: from [10.10.13.5] (unknown [10.10.11.14]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: bane.ivosev@pmf.uns.ac.rs) by mail.pmf.uns.ac.rs (Postfix) with ESMTPSA id 0F1E423BF9 for ; Tue, 1 May 2012 08:36:18 +0200 (CEST) Message-ID: <4F9F8462.6020400@pmf.uns.ac.rs> Date: Tue, 01 May 2012 08:36:18 +0200 From: Bane Ivosev Organization: PMF Novi Sad User-Agent: Mozilla/5.0 (X11; Linux i686; rv:11.0) Gecko/20120411 Thunderbird/11.0.1 MIME-Version: 1.0 To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: kvm & virtio performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: bane.ivosev@pmf.uns.ac.rs List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 06:41:47 -0000 hi, anyone test freebsd as guest on kvm with virtio drivers? any expirience? From owner-freebsd-stable@FreeBSD.ORG Tue May 1 09:03:55 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A5CC2106566B for ; Tue, 1 May 2012 09:03:55 +0000 (UTC) (envelope-from it@galasoluciones.com) Received: from mail.galasoluciones.com (maduixa.galasoluciones.com [178.22.68.108]) by mx1.freebsd.org (Postfix) with ESMTP id 59B718FC12 for ; Tue, 1 May 2012 09:03:54 +0000 (UTC) Received: from maduixa.galasoluciones.com (localhost [127.0.0.1]) by mail.galasoluciones.com (Postfix) with ESMTP id AC603D4C5D; Tue, 1 May 2012 10:57:44 +0200 (CEST) X-Virus-Scanned: amavisd-new at galasoluciones.com Received: from mail.galasoluciones.com ([127.0.0.1]) by maduixa.galasoluciones.com (maduixa.galasoluciones.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ws5UnN9x6af6; Tue, 1 May 2012 10:57:43 +0200 (CEST) Received: from [192.168.0.7] (1.66.79.188.dynamic.jazztel.es [188.79.66.1]) by mail.galasoluciones.com (Postfix) with ESMTPA id 2C215D4C5A; Tue, 1 May 2012 10:57:43 +0200 (CEST) Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: text/plain; charset=iso-8859-1 From: Gala IT In-Reply-To: <4F9F8462.6020400@pmf.uns.ac.rs> Date: Tue, 1 May 2012 10:57:42 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <6DFE7E28-2921-49E5-BBD7-0686226952B9@galasoluciones.com> References: <4F9F8462.6020400@pmf.uns.ac.rs> To: bane.ivosev@pmf.uns.ac.rs X-Mailer: Apple Mail (2.1257) Cc: freebsd-stable@freebsd.org Subject: Re: kvm & virtio performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 09:03:55 -0000 Hi, CloudSigma has a very good kvm platform with virtio support in = Switzerland and Las Vegas, and very good SLA. We've been using it for more than a year now and performance has been = very consistent, even when there was no virtio support yet. You can try it for a week for free, with 2,5ghz, 2,5gb of ram and 22gb = of disk. If you do, please do so via this link: = http://tracking.cloudsigma.com/aff_c?offer_id=3D2&aff_id=3D1092&source=3Df= reebsd-stable&url_id=3D4 Thank you very much. Regards, Gala Soluciones IT. El 01/05/2012, a les 08:36, Bane Ivosev va escriure: > hi, anyone test freebsd as guest on kvm with virtio drivers? any = expirience? > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Tue May 1 10:10:46 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0B1A01065678 for ; Tue, 1 May 2012 10:10:46 +0000 (UTC) (envelope-from regnauld@x0.dk) Received: from moof.catpipe.net (moof.catpipe.net [194.28.252.64]) by mx1.freebsd.org (Postfix) with ESMTP id BB26F8FC12 for ; Tue, 1 May 2012 10:10:45 +0000 (UTC) Received: from localhost (moof.catpipe.net [194.28.252.64]) by localhost.catpipe.net (Postfix) with ESMTP id B4A334CEE49; Tue, 1 May 2012 12:04:48 +0200 (CEST) Received: from moof.catpipe.net ([194.28.252.64]) by localhost (moof.catpipe.net [194.28.252.64]) (amavisd-new, port 10024) with ESMTP id liyDzN24jfUp; Tue, 1 May 2012 12:04:48 +0200 (CEST) Received: from macbook.bluepipe.net (macbook.bluepipe.net [195.249.214.179]) (Authenticated sender: relayuser) by moof.catpipe.net (Postfix) with ESMTPA id 5B3154CEE33; Tue, 1 May 2012 12:04:48 +0200 (CEST) Received: by macbook.bluepipe.net (Postfix, from userid 1001) id 927E5945B58; Tue, 1 May 2012 12:04:49 +0200 (CEST) Date: Tue, 1 May 2012 12:04:49 +0200 From: Phil Regnauld To: Bane Ivosev Message-ID: <20120501100449.GC56950@macbook.bluepipe.net> References: <4F9F8462.6020400@pmf.uns.ac.rs> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4F9F8462.6020400@pmf.uns.ac.rs> X-Operating-System: Darwin 11.3.0 x86_64 User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@freebsd.org Subject: Re: kvm & virtio performance X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 10:10:46 -0000 Bane Ivosev (bane.ivosev) writes: > hi, anyone test freebsd as guest on kvm with virtio drivers? any expirience? http://forums.freebsd.org/archive/index.php/t-28916.html Cheers, Phil From owner-freebsd-stable@FreeBSD.ORG Tue May 1 15:05:32 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A3E2B106566B for ; Tue, 1 May 2012 15:05:32 +0000 (UTC) (envelope-from james@slohall.com) Received: from sam.nabble.com (sam.nabble.com [216.139.236.26]) by mx1.freebsd.org (Postfix) with ESMTP id 7EF088FC1E for ; Tue, 1 May 2012 15:05:32 +0000 (UTC) Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1SPEdw-0000LT-3r for freebsd-stable@freebsd.org; Tue, 01 May 2012 08:05:32 -0700 Date: Tue, 1 May 2012 08:05:32 -0700 (PDT) From: kcuf To: freebsd-stable@freebsd.org Message-ID: <1335884732114-5678227.post@n5.nabble.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: Stable buildkernel warning: no previous prototype for legacy_pcib_map_msi X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 15:05:32 -0000 I'm running stable that I built 1/12/12 on an amd64 system and I just updated the sources and now every time I try to compile the kernel I get the error: ===================== cc1: warnings being treated as errors /usr/src/sys/x86/pci/pci_bus.c:118: warning: no previous prototype for 'legacy_pcib_map_msi' [-Wmissing-prototypes] /usr/src/sys/x86/pci/pci_bus.c: In function 'legacy_pcib_map_msi': /usr/src/sys/x86/pci/pci_bus.c:127: warning: implicit declaration of function 'legacy_get_pcislot' /usr/src/sys/x86/pci/pci_bus.c:127: warning: nested extern declaration of 'legacy_get_pcislot' [-Wnested-externs] /usr/src/sys/x86/pci/pci_bus.c:128: warning: implicit declaration of function 'legacy_get_pcifunc' /usr/src/sys/x86/pci/pci_bus.c:128: warning: nested extern declaration of 'legacy_get_pcifunc' [-Wnested-externs] /usr/src/sys/x86/pci/pci_bus.c: In function 'legacy_pcib_identify': /usr/src/sys/x86/pci/pci_bus.c:470: warning: implicit declaration of function 'legacy_set_pcislot' /usr/src/sys/x86/pci/pci_bus.c:470: warning: nested extern declaration of 'legacy_set_pcislot' [-Wnested-externs] /usr/src/sys/x86/pci/pci_bus.c:471: warning: implicit declaration of function 'legacy_set_pcifunc' /usr/src/sys/x86/pci/pci_bus.c:471: warning: nested extern declaration of 'legacy_set_pcifunc' [-Wnested-externs] *** Error code 1 Stop in /usr/obj/usr/src/sys/ICKERN. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. ===================== I have tried both my custom kernel config and the generic config with the same errror. My src.conf only has the line LOADER_ZFS_SUPPORT="YES" and my make.conf has WRKDIRPREFIX=/usr/obj NOPORTDOCS="YES" WITHOUT_CUPS="YES" WITH_NEW_XORG="YES" WITH_VIM_OPTIONS="YES" # added by use.perl 2012-02-15 23:09:33 PERL_VERSION=5.12.4 If it makes any difference, my current kernel does not have COMPAT_FREEBSD32 enable, however enabling and disabling this option still caused this error. Anyone have any advice? -- View this message in context: http://freebsd.1045724.n5.nabble.com/Stable-buildkernel-warning-no-previous-prototype-for-legacy-pcib-map-msi-tp5678227.html Sent from the freebsd-stable mailing list archive at Nabble.com. From owner-freebsd-stable@FreeBSD.ORG Tue May 1 16:22:18 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8CDB21065676 for ; Tue, 1 May 2012 16:22:18 +0000 (UTC) (envelope-from james@slohall.com) Received: from sam.nabble.com (sam.nabble.com [216.139.236.26]) by mx1.freebsd.org (Postfix) with ESMTP id 659C78FC16 for ; Tue, 1 May 2012 16:22:18 +0000 (UTC) Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1SPFqD-00018I-O3 for freebsd-stable@freebsd.org; Tue, 01 May 2012 09:22:17 -0700 Date: Tue, 1 May 2012 09:22:17 -0700 (PDT) From: James Hall To: freebsd-stable@freebsd.org Message-ID: <1335889337737-5678391.post@n5.nabble.com> In-Reply-To: <1335884732114-5678227.post@n5.nabble.com> References: <1335884732114-5678227.post@n5.nabble.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: Re: Stable buildkernel warning: no previous prototype for legacy_pcib_map_msi X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 16:22:18 -0000 I discovered that my copy of src/sys/amd64/include/legacyvar.h does not include the two lines 60| int legacy_pcib_map_msi(device_t pcib, device_t dev, int irq, 61| uint64_t *addr, uint32_t *data); which is in the stable sources available through svn at http://svnweb.freebsd.org/base/stable/9/sys/amd64/include/legacyvar.h?revision=234150&view=markup&pathrev=234872. I guess I have a bad mirror or something... -- View this message in context: http://freebsd.1045724.n5.nabble.com/Stable-buildkernel-warning-no-previous-prototype-for-legacy-pcib-map-msi-tp5678227p5678391.html Sent from the freebsd-stable mailing list archive at Nabble.com. From owner-freebsd-stable@FreeBSD.ORG Tue May 1 18:32:35 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 779DD1065742 for ; Tue, 1 May 2012 18:32:35 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 4DC588FC1B for ; Tue, 1 May 2012 18:32:35 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id BFD3DB911; Tue, 1 May 2012 14:32:34 -0400 (EDT) From: John Baldwin To: freebsd-stable@freebsd.org Date: Tue, 1 May 2012 14:28:37 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p13; KDE/4.5.5; amd64; ; ) References: <1335884732114-5678227.post@n5.nabble.com> <1335889337737-5678391.post@n5.nabble.com> In-Reply-To: <1335889337737-5678391.post@n5.nabble.com> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201205011428.37200.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Tue, 01 May 2012 14:32:34 -0400 (EDT) Cc: James Hall Subject: Re: Stable buildkernel warning: no previous prototype for legacy_pcib_map_msi X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 18:32:35 -0000 On Tuesday, May 01, 2012 12:22:17 pm James Hall wrote: > I discovered that my copy of src/sys/amd64/include/legacyvar.h does not > include the two lines > > 60| int legacy_pcib_map_msi(device_t pcib, device_t dev, int irq, > 61| uint64_t *addr, uint32_t *data); > > which is in the stable sources available through svn at > http://svnweb.freebsd.org/base/stable/9/sys/amd64/include/legacyvar.h?revision=234150&view=markup&pathrev=234872. > I guess I have a bad mirror or something... Did you use cvsup10? I've had one other report of that mirror being stale specifically in regards to this change. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Tue May 1 18:39:32 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 29558106566C for ; Tue, 1 May 2012 18:39:32 +0000 (UTC) (envelope-from james@slohall.com) Received: from mail-pb0-f54.google.com (mail-pb0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id E7E628FC12 for ; Tue, 1 May 2012 18:39:31 +0000 (UTC) Received: by pbbro2 with SMTP id ro2so4060047pbb.13 for ; Tue, 01 May 2012 11:39:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:x-gm-message-state; bh=TaQb4RrrXr5bIsfsZVfxrvYU7yeBe8x6ghHGQ6gzdK4=; b=jato5kgYTM5CD1D5i26sEnJaszs5QHEaF/YStfzFMAXTJrX2hlMU1AP/rEzW5eh25T u1iKGEniOKQ5qGkbifW+jm3x7R55SzTdHXzamwW3CrvgLsSUEzf/0wL9WwHutT5R1wbC Yr/fWpBaU1JaBRoDjeJLsjX68qjykx+fptTw6dZQPja+nYDRBmDDgYWAOn8dXHz2RRsJ jHoPq6ZNkbwmr4umaHH/3QTn1fEDRNXFbtKmxb0T35143CYjqd/mlfTUP98PezZb1vJI rXADvxvbkSypxsPU9xzfJ+ly2zhMCtHCmV4Va5ZskFA9zjosFSRCcDuj/nmwkVddgg9r FH2A== MIME-Version: 1.0 Received: by 10.68.217.67 with SMTP id ow3mr9864671pbc.16.1335897571541; Tue, 01 May 2012 11:39:31 -0700 (PDT) Received: by 10.143.155.2 with HTTP; Tue, 1 May 2012 11:39:31 -0700 (PDT) Received: by 10.143.155.2 with HTTP; Tue, 1 May 2012 11:39:31 -0700 (PDT) In-Reply-To: <201205011428.37200.jhb@freebsd.org> References: <1335884732114-5678227.post@n5.nabble.com> <1335889337737-5678391.post@n5.nabble.com> <201205011428.37200.jhb@freebsd.org> Date: Tue, 1 May 2012 11:39:31 -0700 Message-ID: From: James Hall To: John Baldwin X-Gm-Message-State: ALoCoQnZum4vijNy/jaBq5cj6xD6hlDYHO5rK3ag7RNMG9Fgx2iWYDjiGraF6J8pYt4Xc9cjfSSn Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable@freebsd.org Subject: Re: Stable buildkernel warning: no previous prototype for legacy_pcib_map_msi X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 18:39:32 -0000 On May 1, 2012 11:32 AM, "John Baldwin" wrote: > > On Tuesday, May 01, 2012 12:22:17 pm James Hall wrote: > > I discovered that my copy of src/sys/amd64/include/legacyvar.h does not > > include the two lines > > > > 60| int legacy_pcib_map_msi(device_t pcib, device_t dev, int irq, > > 61| uint64_t *addr, uint32_t *data); > > > > which is in the stable sources available through svn at > > > http://svnweb.freebsd.org/base/stable/9/sys/amd64/include/legacyvar.h?revision=234150&view=markup&pathrev=234872 . > > I guess I have a bad mirror or something... > > Did you use cvsup10? I've had one other report of that mirror being stale > specifically in regards to this change. > > -- > John Baldwin Yes, I was originally using cvsup10. Sent from my phone. From owner-freebsd-stable@FreeBSD.ORG Tue May 1 19:41:35 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 59E9D106564A for ; Tue, 1 May 2012 19:41:35 +0000 (UTC) (envelope-from lx@redundancy.redundancy.org) Received: from redundancy.redundancy.org (75-101-96-57.dsl.static.sonic.net [75.101.96.57]) by mx1.freebsd.org (Postfix) with SMTP id 2186D8FC0C for ; Tue, 1 May 2012 19:41:35 +0000 (UTC) Received: (qmail 37225 invoked by uid 1001); 1 May 2012 19:41:25 -0000 Date: Tue, 1 May 2012 12:41:25 -0700 From: David Thiel To: freebsd-stable@freebsd.org Message-ID: <20120501194101.GD66263@redundancy.redundancy.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-OpenPGP-Key-fingerprint: 482A 8C46 C844 7E7C 8CBC 2313 96EE BEE5 1F4B CA13 X-OpenPGP-Key-available: http://redundancy.redundancy.org/lx.gpg X-Face: %H~{$1~NOw1y#%mM6{|4:/ List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 19:41:35 -0000 Hello, So, I've been trying to debug an issue running nmap scans within jails, partially documented here: http://seclists.org/nmap-dev/2012/q2/220 On further debugging, it's seeming like jails can't read routing information directly at all: # route get 69.163.203.254 route: writing to routing socket: No such process Now, this is normally done via reading the routing table via something like socket(PF_ROUTE, SOCK_RAW, AF_INET), so one would suspect that this is a problem with raw sockets; but raw sockets are enabled within the jail. netstat is able to read routing information just fine, but I don't think it's doing it via the socket() call. Anyone know why this behavior might be happening? Thanks, David From owner-freebsd-stable@FreeBSD.ORG Tue May 1 21:01:39 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0000D1065672 for ; Tue, 1 May 2012 21:01:38 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (bird.sbone.de [46.4.1.90]) by mx1.freebsd.org (Postfix) with ESMTP id A15AC8FC12 for ; Tue, 1 May 2012 21:01:38 +0000 (UTC) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id 6AFA425D389C; Tue, 1 May 2012 21:01:37 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 9B14CBE609C; Tue, 1 May 2012 21:01:36 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id bkFr7wxKW9uq; Tue, 1 May 2012 21:01:35 +0000 (UTC) Received: from orange-en1.sbone.de (orange-en1.sbone.de [IPv6:fde9:577b:c1a9:31:cabc:c8ff:fecf:e8e3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 76C8DBE609A; Tue, 1 May 2012 21:01:34 +0000 (UTC) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: "Bjoern A. Zeeb" In-Reply-To: <20120501194101.GD66263@redundancy.redundancy.org> Date: Tue, 1 May 2012 21:01:33 +0000 Content-Transfer-Encoding: quoted-printable Message-Id: <597C92B2-02AA-4093-B6A3-B871CCDB70F8@lists.zabbadoz.net> References: <20120501194101.GD66263@redundancy.redundancy.org> To: David Thiel X-Mailer: Apple Mail (2.1084) Cc: freebsd-stable@freebsd.org Subject: Re: Jails can't get routing info X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 May 2012 21:01:39 -0000 On 1. May 2012, at 19:41 , David Thiel wrote: > Hello, >=20 > So, I've been trying to debug an issue running nmap scans within = jails,=20 > partially documented here: >=20 > http://seclists.org/nmap-dev/2012/q2/220 >=20 > On further debugging, it's seeming like jails can't read routing=20 > information directly at all: >=20 > # route get 69.163.203.254 > route: writing to routing socket: No such process >=20 > Now, this is normally done via reading the routing table via something = like=20 > socket(PF_ROUTE, SOCK_RAW, AF_INET), so one would suspect that this is = a=20 > problem with raw sockets; but raw sockets are enabled within the jail.=20= > netstat is able to read routing information just fine, but I don't = think=20 > it's doing it via the socket() call. hmm, sure you don't have /dev/mem in the jail? netstat -rn I think is = still using libkvm *sigh* and not the sysctl API. > Anyone know why this behavior might be happening? Without thinking too much (as in if I got the right case) I think you = are hitting this one: = http://svnweb.freebsd.org/base/head/sys/net/rtsock.c?annotate=3D234572#l79= 2 /bz --=20 Bjoern A. Zeeb You have to have visions! It does not matter how good you are. It matters what good you do! From owner-freebsd-stable@FreeBSD.ORG Wed May 2 05:11:34 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AC99C106564A for ; Wed, 2 May 2012 05:11:34 +0000 (UTC) (envelope-from jhellenthal@dataix.net) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 51DA68FC08 for ; Wed, 2 May 2012 05:11:34 +0000 (UTC) Received: by mail-gy0-f182.google.com with SMTP id r20so330311ghr.13 for ; Tue, 01 May 2012 22:11:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dataix.net; s=rsa; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; bh=ube8Xp+fMSE7m8vh0Nicweaaa123vMDfAYsBuvPgxsM=; b=a2NHimwOVGQb8YFUSjLUk4ySCo9ZD7K2uOUF5ihpaz6FK5TmxNhZWygMqNldbWMjs3 /m78Qh+kf1CvTuJmqiL8LIqETAJTiKA/LvqemnB3edWdwS/SVUl0hyd4/Om8zX+wB6EV JJ9y81paQQrlfL1c8KCEJjKWInEJ+7SgIgnjo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:x-gm-message-state; bh=ube8Xp+fMSE7m8vh0Nicweaaa123vMDfAYsBuvPgxsM=; b=e41X1iPDkCpgXhFTZfonGzoDzTCa3c2hA7AErNvIicCmIOFKaapZ80bPwmLj2inFdc AsTSI04dHglAtRZvkwpJ+n7n1wBxom2qr5/mDdZiNevfhO83yPWAbVDsUnj3F8PEvoqU OOvNED5eVXsHbpMrp8Cu31OwJdikkZGq8KEtcQRASOb47TEOl9R6txuNQSZ7etLiR8sh 2L2gw49sD/UynThpTRO4dMo3n3x4El+3LAEeseAc9bOQknXplcyynw8D9QTvxbgUVowF jTPJ4PMcUt6S1KOmM/e2aARQ4Bji+GXgnZFLWVBlGEM0pkujWAx7d+bKfGs3meuwtLiB H/zg== Received: by 10.42.19.138 with SMTP id c10mr20131028icb.27.1335935493710; Tue, 01 May 2012 22:11:33 -0700 (PDT) Received: from DataIX.net (adsl-99-181-135-185.dsl.klmzmi.sbcglobal.net. [99.181.135.185]) by mx.google.com with ESMTPS id nq4sm1012492igc.5.2012.05.01.22.11.32 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 01 May 2012 22:11:33 -0700 (PDT) Received: from DataIX.net (localhost [127.0.0.1]) by DataIX.net (8.14.5/8.14.5) with ESMTP id q425BUVu085141 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 2 May 2012 01:11:31 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Received: (from jhellenthal@localhost) by DataIX.net (8.14.5/8.14.5/Submit) id q425BRMo084074; Wed, 2 May 2012 01:11:27 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Date: Wed, 2 May 2012 01:11:27 -0400 From: Jason Hellenthal To: "Bjoern A. Zeeb" Message-ID: <20120502051127.GA73032@DataIX.net> References: <20120501194101.GD66263@redundancy.redundancy.org> <597C92B2-02AA-4093-B6A3-B871CCDB70F8@lists.zabbadoz.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <597C92B2-02AA-4093-B6A3-B871CCDB70F8@lists.zabbadoz.net> X-Gm-Message-State: ALoCoQmIWdrwmIre27oI8UU1K7T0BnoXVxTAIN2mY4QR3Xs6epLa00MKGC8qGMcebuoBHR3yNgif Cc: David Thiel , freebsd-stable@freebsd.org Subject: Re: Jails can't get routing info X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 05:11:34 -0000 On Tue, May 01, 2012 at 09:01:33PM +0000, Bjoern A. Zeeb wrote: > On 1. May 2012, at 19:41 , David Thiel wrote: > > > Hello, > > > > So, I've been trying to debug an issue running nmap scans within jails, > > partially documented here: > > > > http://seclists.org/nmap-dev/2012/q2/220 > > > > On further debugging, it's seeming like jails can't read routing > > information directly at all: > > > > # route get 69.163.203.254 > > route: writing to routing socket: No such process > > > > Now, this is normally done via reading the routing table via something like > > socket(PF_ROUTE, SOCK_RAW, AF_INET), so one would suspect that this is a > > problem with raw sockets; but raw sockets are enabled within the jail. > > netstat is able to read routing information just fine, but I don't think > > it's doing it via the socket() call. > > hmm, sure you don't have /dev/mem in the jail? netstat -rn I think is still > using libkvm *sigh* and not the sysctl API. > Good lord I hope this makes it down to stable/8 > > > Anyone know why this behavior might be happening? > > Without thinking too much (as in if I got the right case) I think you are > hitting this one: > > http://svnweb.freebsd.org/base/head/sys/net/rtsock.c?annotate=234572#l792 > > /bz > > -- > Bjoern A. Zeeb You have to have visions! > It does not matter how good you are. It matters what good you do! > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" -- - (2^(N-1)) From owner-freebsd-stable@FreeBSD.ORG Wed May 2 06:01:16 2012 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4D5DB106566C for ; Wed, 2 May 2012 06:01:16 +0000 (UTC) (envelope-from egrosbein@rdtc.ru) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13::5]) by mx1.freebsd.org (Postfix) with ESMTP id AD4088FC0C for ; Wed, 2 May 2012 06:01:15 +0000 (UTC) Received: from eg.sd.rdtc.ru (localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.14.5/8.14.5) with ESMTP id q4261CmS007912 for ; Wed, 2 May 2012 13:01:12 +0700 (NOVT) (envelope-from egrosbein@rdtc.ru) Message-ID: <4FA0CDA8.2060904@rdtc.ru> Date: Wed, 02 May 2012 13:01:12 +0700 From: Eugene Grosbein User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; ru-RU; rv:1.9.2.13) Gecko/20110112 Thunderbird/3.1.7 MIME-Version: 1.0 To: FreeBSD Stable Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: Subject: Unkillable /sbin/ipfw process X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 06:01:16 -0000 Hi! I've found easy way to make ipfw(8) to become unkillable even witk kill -9. It is displayed as "running" and takes all CPU cycles. Just run the following script with argument 122 for 8.3/i386 or with 121 for 8.3/amd64. #!/bin/sh args="add 60001 count ip from any to { " for i in `jot $1 1` do args="${args}127.0.0.$i or " done args="${args}127.0.1.1 }"; ipfw delete 60001 echo ipfw $args ipfw $args #EOF After one /sbin/ipfw is stuck in this state, all others invocations of /sbin/ipfw (including "ipfw show") add another stuck ipfw process. See also http://www.freebsd.org/cgi/query-pr.cgi?pr=65961 Eugene Grosbein. From owner-freebsd-stable@FreeBSD.ORG Wed May 2 06:08:08 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7AE561065672 for ; Wed, 2 May 2012 06:08:08 +0000 (UTC) (envelope-from ae@FreeBSD.org) Received: from mail.kirov.so-ups.ru (ns.kirov.so-ups.ru [178.74.170.1]) by mx1.freebsd.org (Postfix) with ESMTP id 245888FC0A for ; Wed, 2 May 2012 06:08:07 +0000 (UTC) Received: from kas30pipe.localhost (localhost.kirov.so-ups.ru [127.0.0.1]) by mail.kirov.so-ups.ru (Postfix) with SMTP id CB887B801B; Wed, 2 May 2012 09:58:08 +0400 (MSK) Received: from kirov.so-ups.ru (unknown [172.21.81.1]) by mail.kirov.so-ups.ru (Postfix) with ESMTP id C630BB8008; Wed, 2 May 2012 09:58:08 +0400 (MSK) Received: by ns.kirov.so-ups.ru (Postfix, from userid 1010) id BF0CCBA02D; Wed, 2 May 2012 09:58:08 +0400 (MSK) Received: from [127.0.0.1] (unknown [10.118.3.52]) by ns.kirov.so-ups.ru (Postfix) with ESMTP id 8A2BBBA025; Wed, 2 May 2012 09:58:08 +0400 (MSK) Message-ID: <4FA0CCF0.5000607@FreeBSD.org> Date: Wed, 02 May 2012 09:58:08 +0400 From: "Andrey V. Elsukov" User-Agent: Mozilla Thunderbird 1.5 (FreeBSD/20051231) MIME-Version: 1.0 To: Adam Strohl References: <4F9EE487.6020609@ateamsystems.com> In-Reply-To: <4F9EE487.6020609@ateamsystems.com> X-Enigmail-Version: 1.4.1 Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: 7bit X-SpamTest-Version: SMTP-Filter Version 3.0.0 [0284], KAS30/Release X-SpamTest-Info: Not protected Cc: FreeBSD-Stable ML Subject: Re: FreeBSD 9 "gptboot: invalid backup GPT header" error (boots fine though) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 06:08:08 -0000 On 30.04.2012 23:14, Adam Strohl wrote: > da0 at tws0 bus 0 scbus0 target 0 lun 0 > da0: Fixed Direct Access SCSI-5 device > da0: 6000.000MB/s transfers > da0: 2860992MB (5859311616 512 byte sectors: 255H 63S/T 364725C) > > > Let me know anyone wants to see anything else/has seen this/has any theories! Can you try patch from the r234693, update and reinstall gptboot, does it help? http://svnweb.freebsd.org/base?view=revision&revision=234693 -- WBR, Andrey V. Elsukov From owner-freebsd-stable@FreeBSD.ORG Wed May 2 09:03:42 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 25FEC106566C for ; Wed, 2 May 2012 09:03:42 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (mx1.sbone.de [IPv6:2a01:4f8:130:3ffc::401:25]) by mx1.freebsd.org (Postfix) with ESMTP id A33E88FC08 for ; Wed, 2 May 2012 09:03:41 +0000 (UTC) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id 3C84525D3887; Wed, 2 May 2012 09:03:40 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 5BA04BE612D; Wed, 2 May 2012 09:03:39 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id onjsWff0DQMl; Wed, 2 May 2012 09:03:38 +0000 (UTC) Received: from orange-en1.sbone.de (orange-en1.sbone.de [IPv6:fde9:577b:c1a9:31:cabc:c8ff:fecf:e8e3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id DC8EFBE612C; Wed, 2 May 2012 09:03:37 +0000 (UTC) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: "Bjoern A. Zeeb" In-Reply-To: <20120502051127.GA73032@DataIX.net> Date: Wed, 2 May 2012 09:03:36 +0000 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20120501194101.GD66263@redundancy.redundancy.org> <597C92B2-02AA-4093-B6A3-B871CCDB70F8@lists.zabbadoz.net> <20120502051127.GA73032@DataIX.net> To: Jason Hellenthal X-Mailer: Apple Mail (2.1084) Cc: David Thiel , freebsd-stable@freebsd.org Subject: Re: Jails can't get routing info X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 09:03:42 -0000 On 2. May 2012, at 05:11 , Jason Hellenthal wrote: > On Tue, May 01, 2012 at 09:01:33PM +0000, Bjoern A. Zeeb wrote: >> On 1. May 2012, at 19:41 , David Thiel wrote: >>=20 >>> Hello, >>>=20 >>> So, I've been trying to debug an issue running nmap scans within = jails,=20 >>> partially documented here: >>>=20 >>> http://seclists.org/nmap-dev/2012/q2/220 >>>=20 >>> On further debugging, it's seeming like jails can't read routing=20 >>> information directly at all: >>>=20 >>> # route get 69.163.203.254 >>> route: writing to routing socket: No such process >>>=20 >>> Now, this is normally done via reading the routing table via = something like=20 >>> socket(PF_ROUTE, SOCK_RAW, AF_INET), so one would suspect that this = is a=20 >>> problem with raw sockets; but raw sockets are enabled within the = jail.=20 >>> netstat is able to read routing information just fine, but I don't = think=20 >>> it's doing it via the socket() call. >>=20 >> hmm, sure you don't have /dev/mem in the jail? netstat -rn I think is = still >> using libkvm *sigh* and not the sysctl API. >>=20 >=20 > Good lord I hope this makes it down to stable/8 Pardon, what do you mean? >=20 >>=20 >>> Anyone know why this behavior might be happening? >>=20 >> Without thinking too much (as in if I got the right case) I think you = are >> hitting this one: >>=20 >> = http://svnweb.freebsd.org/base/head/sys/net/rtsock.c?annotate=3D234572#l79= 2 --=20 Bjoern A. Zeeb You have to have visions! It does not matter how good you are. It matters what good you do! From owner-freebsd-stable@FreeBSD.ORG Wed May 2 09:03:48 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1449F106566B; Wed, 2 May 2012 09:03:48 +0000 (UTC) (envelope-from adams-freebsd@ateamsystems.com) Received: from fss.sandiego.ateamservers.com (fss.sandiego.ateamservers.com [69.55.229.149]) by mx1.freebsd.org (Postfix) with ESMTP id EB3A58FC0A; Wed, 2 May 2012 09:03:47 +0000 (UTC) Received: from [192.168.15.220] (unknown [118.175.84.92]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by fss.sandiego.ateamservers.com (Postfix) with ESMTPSA id EE55CB906C; Wed, 2 May 2012 05:03:46 -0400 (EDT) Message-ID: <4FA0F872.4040008@ateamsystems.com> Date: Wed, 02 May 2012 16:03:46 +0700 From: Adam Strohl Organization: A-Team Systems User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:11.0) Gecko/20120327 Thunderbird/11.0.1 MIME-Version: 1.0 To: "Andrey V. Elsukov" References: <4F9EE487.6020609@ateamsystems.com> <4FA0CCF0.5000607@FreeBSD.org> In-Reply-To: <4FA0CCF0.5000607@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD-Stable ML Subject: Re: FreeBSD 9 "gptboot: invalid backup GPT header" error (boots fine though) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 09:03:48 -0000 Thanks Andrey, I've just recompiled /boot/gptboot after updating gpt.c and installed it via: gpart bootcode -p /boot/gptboot -i 1 da0 I still see "gptboot: invalid backup GPT header" on boot (but it does still boot). On 5/2/2012 12:58, Andrey V. Elsukov wrote: > On 30.04.2012 23:14, Adam Strohl wrote: >> da0 at tws0 bus 0 scbus0 target 0 lun 0 >> da0: Fixed Direct Access SCSI-5 device >> da0: 6000.000MB/s transfers >> da0: 2860992MB (5859311616 512 byte sectors: 255H 63S/T 364725C) >> >> >> Let me know anyone wants to see anything else/has seen this/has any theories! > > Can you try patch from the r234693, update and reinstall gptboot, does it help? > http://svnweb.freebsd.org/base?view=revision&revision=234693 > From owner-freebsd-stable@FreeBSD.ORG Wed May 2 12:03:20 2012 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8E16A1065675; Wed, 2 May 2012 12:03:20 +0000 (UTC) (envelope-from sukenwoo@gmail.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 2B09A8FC24; Wed, 2 May 2012 12:03:20 +0000 (UTC) Received: by obcni5 with SMTP id ni5so1134141obc.13 for ; Wed, 02 May 2012 05:03:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=IawpFNJbS/NJ0RBQ3bkUH/ewp5nDlt9r6LG1RobEaMM=; b=Jdo/Ewx9JClxPa6TwbuCexBooLVJqTe7fY8NI8B8Zlw4tMGEGgJje9+741Ul7UgYth 4VnEDW3yhNNliPfGJGqPjmiBIgh6arHaOMu1oOgPX3uTr3LJuf/Fc4nVEYDp70h2mxlq 1wp79gK/qX1n93TZQiIZSQbqLvmIE4WbPxxwZgEjurBFMQKr4To0iZVckDOT8p6i4/VV Qa7c+nkhNxtj9e0eN2oMXMqgN+8bmzBpSTs8TbX8C5s7fJ7azKljhH5j59R6ERIT6hr8 aSStmcfrMQv7yFwwyH+SjWTYmIVeRDNzVQjEZmw/NtItvcceD+cYz5gYGeMu/ezauaPz lCJA== MIME-Version: 1.0 Received: by 10.60.13.37 with SMTP id e5mr39160668oec.70.1335960199433; Wed, 02 May 2012 05:03:19 -0700 (PDT) Received: by 10.182.49.71 with HTTP; Wed, 2 May 2012 05:03:19 -0700 (PDT) Date: Wed, 2 May 2012 20:03:19 +0800 Message-ID: From: suken woo To: fs@freebsd.org, current@freebsd.org, stable@freebsd.org, questions@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: urgent system suddenly boot failed due to ZFS:i/o error on FreeBSD 8.2 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 12:03:20 -0000 hi,lists for some reasons I need restart system but it suddenly boot failed today. here is the error: ZFS: i/o error - all block copies unavailable ZFS: can't read object set for dataset 16 Can't find root filesystem - giving up ZFS:unexcepted object set type 0 ZFS:unexcepted object set type 0 FreeBSD/i386 boot Default: zroot:/boot/kernel/kernel boot: ZFS:unexcepted object set type0 FreeBSD/i386 boot Default: zroot:/boot/kernel/kernel boot: _ any ideas to resolved it? thanks in advance From owner-freebsd-stable@FreeBSD.ORG Wed May 2 13:46:41 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7C168106564A for ; Wed, 2 May 2012 13:46:41 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id E72CD8FC1F for ; Wed, 2 May 2012 13:46:40 +0000 (UTC) Received: by lbon10 with SMTP id n10so606225lbo.13 for ; Wed, 02 May 2012 06:46:39 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:in-reply-to:references:date :message-id:subject:from:to:content-type:content-transfer-encoding :x-gm-message-state; bh=7b9pUKRQDy2z2oEq4ZizbTEj758bLqUdr3b9jD19oDU=; b=QE8PDp9jvwqdvBWUPI/NDtzRheJuF1e1k75jrWUDgEyTPQt54lHho+jsHnRxiqV65x iDsXtVd++Mko1aFFvvshjWDUEKfRpMhE/Vn7zPb6izzGv1sPMWemwzcThtk5DALch4e/ TzzxQB1/cSniwpnIayqq8SsHGtdCrMoSv3i3qcWLPLlAzecKC6kl19gHgb8v3mTGp2o8 9rbsI0HDBiT7Aji3ZTI6tEqjc0bowg4I39p6QMTqGp++FisJRTBR7PzoT46asXIKm5d4 bCeSsl59ssZQoj79Bk83oDWARjAeG3BDNTPHnUCw7PkWgW6xnQ19GYZXr+WLmGNWt/+k ktRA== MIME-Version: 1.0 Received: by 10.152.145.228 with SMTP id sx4mr26042644lab.45.1335966399020; Wed, 02 May 2012 06:46:39 -0700 (PDT) Received: by 10.112.26.4 with HTTP; Wed, 2 May 2012 06:46:38 -0700 (PDT) X-Originating-IP: [209.66.78.50] In-Reply-To: <4FA0F872.4040008@ateamsystems.com> References: <4F9EE487.6020609@ateamsystems.com> <4FA0CCF0.5000607@FreeBSD.org> <4FA0F872.4040008@ateamsystems.com> Date: Wed, 2 May 2012 09:46:38 -0400 Message-ID: From: Mark Saad To: FreeBSD-Stable ML Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQkOvl58gabfTa/Ad3foPafLT3cVxP6SVdDYcES2chwfhu4Saw8AryvbtKx1XRvIhJJ8hO20 Subject: Re: FreeBSD 9 "gptboot: invalid backup GPT header" error (boots fine though) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 13:46:41 -0000 On Wed, May 2, 2012 at 5:03 AM, Adam Strohl wrote: > Thanks Andrey, > > I've just recompiled /boot/gptboot after updating gpt.c and installed it > via: > > gpart bootcode -p /boot/gptboot -i 1 da0 > > I still see "gptboot: invalid backup GPT header" on boot (but it does sti= ll > boot). > > > On 5/2/2012 12:58, Andrey V. Elsukov wrote: >> >> On 30.04.2012 23:14, Adam Strohl wrote: >>> >>> da0 at tws0 bus 0 scbus0 target 0 lun 0 >>> da0: =C2=A0Fixed Direct Access SCSI= -5 device >>> da0: 6000.000MB/s transfers >>> da0: 2860992MB (5859311616 512 byte sectors: 255H 63S/T 364725C) >>> >>> >>> Let me know anyone wants to see anything else/has seen this/has any >>> theories! >> >> >> Can you try patch from the r234693, update and reinstall gptboot, does i= t >> help? >> =C2=A0 =C2=A0 =C2=A0 =C2=A0http://svnweb.freebsd.org/base?view=3Drevisio= n&revision=3D234693 >> Did you try to repair the header ? I saw a similar issue on upgraded boxes that were 7-STABLE upgraded to 9-STABLE. and recovering made the warning go away . I may be way off here but just my 2 cents . % gpart recover da0 --=20 mark saad | nonesuch@longcount.org --=20 mark saad | nonesuch@longcount.org From owner-freebsd-stable@FreeBSD.ORG Wed May 2 13:53:15 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 83CE8106566B for ; Wed, 2 May 2012 13:53:15 +0000 (UTC) (envelope-from adams-freebsd@ateamsystems.com) Received: from fss.sandiego.ateamservers.com (fss.sandiego.ateamservers.com [69.55.229.149]) by mx1.freebsd.org (Postfix) with ESMTP id 661908FC08 for ; Wed, 2 May 2012 13:53:15 +0000 (UTC) Received: from [192.168.15.220] (unknown [118.175.84.92]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by fss.sandiego.ateamservers.com (Postfix) with ESMTPSA id B4D9CB906C for ; Wed, 2 May 2012 09:53:13 -0400 (EDT) Message-ID: <4FA13C48.8010700@ateamsystems.com> Date: Wed, 02 May 2012 20:53:12 +0700 From: Adam Strohl Organization: A-Team Systems User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:11.0) Gecko/20120327 Thunderbird/11.0.1 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <4F9EE487.6020609@ateamsystems.com> <4FA0CCF0.5000607@FreeBSD.org> <4FA0F872.4040008@ateamsystems.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: FreeBSD 9 "gptboot: invalid backup GPT header" error (boots fine though) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 13:53:15 -0000 On 5/2/2012 20:46, Mark Saad wrote: > Did you try to repair the header ? I saw a similar issue on upgraded > boxes that were 7-STABLE upgraded to 9-STABLE. and recovering made the > warning go away . I may be way off here but just my 2 cents . > % gpart recover da0 Good thought, but no dice: $ gpart recover da0 da0 recovering is not needed From owner-freebsd-stable@FreeBSD.ORG Wed May 2 16:09:00 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EC5301065670 for ; Wed, 2 May 2012 16:09:00 +0000 (UTC) (envelope-from bu7cher@yandex.ru) Received: from forward17.mail.yandex.net (forward17.mail.yandex.net [IPv6:2a02:6b8:0:1402::2]) by mx1.freebsd.org (Postfix) with ESMTP id 5ABA88FC14 for ; Wed, 2 May 2012 16:09:00 +0000 (UTC) Received: from smtp16.mail.yandex.net (smtp16.mail.yandex.net [95.108.252.16]) by forward17.mail.yandex.net (Yandex) with ESMTP id EF6421061661; Wed, 2 May 2012 20:08:58 +0400 (MSK) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1335974939; bh=XTfQVCy8t8TG2sa0wZfus199amNbmlO32IVF80S0MWY=; h=Message-ID:Date:From:MIME-Version:To:CC:Subject:References: In-Reply-To:Content-Type:Content-Transfer-Encoding; b=sP46ahzGSXdpDepYkPh8Dgo+MqLXGZ1W17P7QQUQgQXnCjYu1Lce/1XWObfhbdtLy d3LDBemk+MHgd+Oe57wFEmstWsI3uidiLYhoH51LMTbLOSdp6xHZckPAOEwRgG9eRI dS1y4sgbVQk+ETVwmKtDAhhMyaa/WcvHhlM6PjKM= Received: from smtp16.mail.yandex.net (localhost [127.0.0.1]) by smtp16.mail.yandex.net (Yandex) with ESMTP id CEE1D6A04AC; Wed, 2 May 2012 20:08:58 +0400 (MSK) Received: from dynamic-178-141-5-166.kirov.comstar-r.ru (dynamic-178-141-5-166.kirov.comstar-r.ru [178.141.5.166]) by smtp16.mail.yandex.net (nwsmtp/Yandex) with ESMTP id 8kMqox2p-8kMeFH0d; Wed, 2 May 2012 20:08:46 +0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1335974938; bh=XTfQVCy8t8TG2sa0wZfus199amNbmlO32IVF80S0MWY=; h=Message-ID:Date:From:User-Agent:MIME-Version:To:CC:Subject: References:In-Reply-To:X-Enigmail-Version:Content-Type: Content-Transfer-Encoding; b=T6PI6wgNMIMNmaLwWx9roKn676M/y97PZTqcTPYDjTlPUwhstM7SUn5UTpEY5zhn9 N+j1x0FHejE+lZWjnA5Xzhx6Sy5w624O51b6EGm7JESj0Cr/zo9GkNGgIX9P2RaLJt NA0MVQsaU6rcQZUZD3APdp68uAG2FgbRN3IOkMYM= Message-ID: <4FA15C0D.2050107@yandex.ru> Date: Wed, 02 May 2012 20:08:45 +0400 From: "Andrey V. Elsukov" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0.3) Gecko/20120406 Thunderbird/10.0.3 MIME-Version: 1.0 To: Adam Strohl References: <4F9EE487.6020609@ateamsystems.com> <4FA0CCF0.5000607@FreeBSD.org> <4FA0F872.4040008@ateamsystems.com> <4FA13C48.8010700@ateamsystems.com> In-Reply-To: <4FA13C48.8010700@ateamsystems.com> X-Enigmail-Version: 1.4 Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: FreeBSD 9 "gptboot: invalid backup GPT header" error (boots fine though) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 16:09:01 -0000 On 02.05.2012 17:53, Adam Strohl wrote: >> % gpart recover da0 > > Good thought, but no dice: > > $ gpart recover da0 > da0 recovering is not needed I already saw several reports about gptboot's complains on 3ware controllers, but don't know what is the problem. The only guess is that a controller incorrectly handles BIOS requests, when gptboot tries to read GPT header from the end of a large virtual disk. -- WBR, Andrey V. Elsukov From owner-freebsd-stable@FreeBSD.ORG Wed May 2 17:27:19 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5CC8B1065673 for ; Wed, 2 May 2012 17:27:19 +0000 (UTC) (envelope-from lx@redundancy.redundancy.org) Received: from redundancy.redundancy.org (75-101-96-57.dsl.static.sonic.net [75.101.96.57]) by mx1.freebsd.org (Postfix) with SMTP id 369A58FC12 for ; Wed, 2 May 2012 17:27:19 +0000 (UTC) Received: (qmail 70686 invoked by uid 1001); 2 May 2012 17:27:13 -0000 Date: Wed, 2 May 2012 10:27:13 -0659 From: David Thiel To: "Bjoern A. Zeeb" Message-ID: <20120502172649.GE66263@redundancy.redundancy.org> References: <20120501194101.GD66263@redundancy.redundancy.org> <597C92B2-02AA-4093-B6A3-B871CCDB70F8@lists.zabbadoz.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <597C92B2-02AA-4093-B6A3-B871CCDB70F8@lists.zabbadoz.net> X-OpenPGP-Key-fingerprint: 482A 8C46 C844 7E7C 8CBC 2313 96EE BEE5 1F4B CA13 X-OpenPGP-Key-available: http://redundancy.redundancy.org/lx.gpg X-Face: %H~{$1~NOw1y#%mM6{|4:/ List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 17:27:19 -0000 On Tue, May 01, 2012 at 09:01:09PM +0000, Bjoern A. Zeeb wrote: > > So, I've been trying to debug an issue running nmap scans within jails, > > partially documented here: > > > > http://seclists.org/nmap-dev/2012/q2/220 > > > > On further debugging, it's seeming like jails can't read routing > > information directly at all: > > > > # route get 69.163.203.254 > > route: writing to routing socket: No such process > > > > Now, this is normally done via reading the routing table via something like > > socket(PF_ROUTE, SOCK_RAW, AF_INET), so one would suspect that this is a > > problem with raw sockets; but raw sockets are enabled within the jail. > > netstat is able to read routing information just fine, but I don't think > > it's doing it via the socket() call. > > hmm, sure you don't have /dev/mem in the jail? netstat -rn I think is still > using libkvm *sigh* and not the sysctl API. Actually I do - in desperation I put a "add path '*' unhide" in the devfs.rules. Now that I think of it, that is what makes netstat work. But, I still don't understand why "route get" doesn't work, given that the very existence of the "security.jail.socket_unixiproute_only" sysctl implies that by default, you should be able to open routing sockets in a jail (presuming raw sockets are enabled, which they are). > > Anyone know why this behavior might be happening? > > Without thinking too much (as in if I got the right case) I think you are > hitting this one: > > http://svnweb.freebsd.org/base/head/sys/net/rtsock.c?annotate=234572#l792 Hmm, that seems to relate to pulling via sysctl, which the "route" command doesn't do. It sounds useful for fixing netstat, though. Thanks, David From owner-freebsd-stable@FreeBSD.ORG Wed May 2 18:50:12 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54256106564A for ; Wed, 2 May 2012 18:50:12 +0000 (UTC) (envelope-from zmiterby@gmail.com) Received: from mail-wi0-f172.google.com (mail-wi0-f172.google.com [209.85.212.172]) by mx1.freebsd.org (Postfix) with ESMTP id C53BA8FC18 for ; Wed, 2 May 2012 18:50:11 +0000 (UTC) Received: by wibhj6 with SMTP id hj6so4064382wib.13 for ; Wed, 02 May 2012 11:50:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type; bh=menhWYOj1Gld7XKc0UbH/+iSEuSDCfzo2ca0LKuoAKI=; b=kAAz1Z9xGkm4CKmMK8kynoUpsGixyhus5IWEySZue2Ml2sZZTCZXjX6hJmGQZZzQ/2 bq14B17x9KofGHP+fVRnp0TaD4Y8jbcqqYZhVqvR62QyBgGkjdXomDWLO1jp76zJ9jvS /5vBOXn6yapN6omtYcVF32bGUL3e9DVOL94jDQ1MrwFbkQsrH9RMXWZ209JGQWd/9Cjr AfwzzyMGf2y0C3LeOUVY7eSwZv5NWcMJGmjYEvFqJb7SjcNyYSKN65uw+n6emu0LGm0x sgtXULsXyYGQPy7MmspQKEq6GdE3UPJzi2fAVugBbw+Wl0odGxFJs9q9tyDslEQRIumm 3o2Q== Received: by 10.216.143.146 with SMTP id l18mr1502401wej.56.1335984610713; Wed, 02 May 2012 11:50:10 -0700 (PDT) Received: from [192.168.100.50] ([178.121.52.113]) by mx.google.com with ESMTPS id o2sm9278477wiv.11.2012.05.02.11.50.08 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 02 May 2012 11:50:09 -0700 (PDT) Message-ID: <4FA181E3.9020303@gmail.com> Date: Wed, 02 May 2012 21:50:11 +0300 From: Zmiter User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; ru; rv:1.9.2.13) Gecko/20101207 Thunderbird/3.1.7 MIME-Version: 1.0 To: Andreas Longwitz References: <4F970899.2040105@incore.de> In-Reply-To: <4F970899.2040105@incore.de> Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-stable@freebsd.org Subject: Re: Support for IPSec NAT-T in transoprt mode X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 18:50:12 -0000 24.04.2012 23:10, Andreas Longwitz ?????: > There is one limitation I would like to get over. From man 8 setkey: > System that do not perform the port check cannot support multiple > endpoints behind the same NAT. I think this is a FreeBSD kernel restriction: > For the first incoming L2TP packet the IPSEC part of the kernel does not > save the source port in the corresponding SA (maybe a field like > natt_l2tp_port). So the kernel does for outgoing L2TP packets not know > the correct SA, if two ore more SA's with the same IP exists. > > I would like to know if the patch mentioned in this thread adresses this > problem. Thank you very much for your attention. I've been testing those patches (actually, without your part) and YES it's a big problem with clients (Android, Windows Mobile) behind the same NAT. I cannot find the solution yet, but I'm very interested in it. So, my Androids is some sort of stupid bricks, they do not send NAT-OA payloads at phase 2, and ipsec-tools fills the SPD with IPs taken from IDs. But this is not the correct way. IDs contain LAN (which is behind the NAT) addresses, and FreeBSD cannot route packets to the IPSec crypto part. I've made some quick patching of IPSec tools to get my devices working, but I don't know if they accomodate to the RFCs and ISAKMP. The main idea is to take NAT-OAi and NAT-OAr addresses not from IDs when we are using NAT-T, but from real source and destination addresses of the server and client NATs. Here is my ipsec-tools patch (i've call it patch-zz-local-2.diff and place at /usr/ports/security/ipsec-tools/files with two other patches from kern /146190) *** src/racoon/pfkey.c 2012-04-13 02:02:02.000000000 +0300 --- src/racoon/pfkey.c 2012-04-19 12:47:57.000000000 +0300 *************** *** 1195,1200 **** --- 1195,1202 ---- #ifdef SADB_X_EXT_NAT_T_FRAG sa_args.l_natt_frag = iph2->ph1->rmconf->esp_frag; #endif + plog(LLV_DEBUG2, LOCATION, NULL, "sa_args.l_natt_oa = %s\n", saddr2str(sa_args.l_natt_oa)); + plog(LLV_DEBUG2, LOCATION, NULL, "sa_args.l_natt_oa_dst = %s\n", saddr2str(sa_args.l_natt_oa_dst)); } #endif *************** *** 1483,1488 **** --- 1485,1492 ---- #ifdef SADB_X_EXT_NAT_T_FRAG sa_args.l_natt_frag = iph2->ph1->rmconf->esp_frag; #endif + plog(LLV_DEBUG2, LOCATION, NULL, "sa_args.l_natt_oa = %s\n", saddr2str(sa_args.l_natt_oa)); + plog(LLV_DEBUG2, LOCATION, NULL, "sa_args.l_natt_oa_dst = %s\n", saddr2str(sa_args.l_natt_oa_dst)); } #endif /* more info to fill in */ *** src/racoon/isakmp_quick.c 2011-03-14 19:18:13.000000000 +0200 --- src/racoon/isakmp_quick.c 2012-04-19 17:23:16.000000000 +0300 *************** *** 562,567 **** --- 562,569 ---- if (daddr == NULL) goto end; + plog(LLV_DEBUG2, LOCATION, NULL, "daddr = %s, natoa_src = %s, natoa_dst = %s\n", saddr2str(daddr), saddr2str(iph2->natoa_src), saddr2str(iph2->natoa_dst)); + if (iph2->natoa_src == NULL) iph2->natoa_src = daddr; else if (iph2->natoa_dst == NULL) *************** *** 1262,1267 **** --- 1264,1271 ---- if (daddr == NULL) goto end; + plog(LLV_DEBUG2, LOCATION, NULL, "daddr = %s, natoa_src = %s, natoa_dst = %s\n", saddr2str(daddr), saddr2str(iph2->natoa_src), saddr2str(iph2->natoa_dst)); + if (iph2->natoa_dst == NULL) iph2->natoa_dst = daddr; else if (iph2->natoa_src == NULL) *************** *** 1309,1314 **** --- 1313,1345 ---- plogdump(LLV_DEBUG, iph2->id->v, iph2->id->l); } + #ifdef ENABLE_NATT + if (iph2->ph1->natt_flags& NAT_DETECTED) + { + struct sockaddr_storage addr; + u_int8_t prefix; + u_int16_t ul_proto; + + if (iph2->natoa_src == NULL) + if (!ipsecdoi_id2sockaddr(iph2->id, + (struct sockaddr *)&addr, + &prefix,&ul_proto)) + { + iph2->natoa_src = dupsaddr((struct sockaddr *)&addr); + plog(LLV_DEBUG2, LOCATION, NULL, "natoa_src set from IDcr2: natoa_src = %s\n", saddr2str(iph2->natoa_src)); + } + + if (iph2->natoa_dst == NULL) + if (!ipsecdoi_id2sockaddr(iph2->id_p, + (struct sockaddr *)&addr, + &prefix,&ul_proto)) + { + iph2->natoa_dst = dupsaddr((struct sockaddr *)&addr); + plog(LLV_DEBUG2, LOCATION, NULL, "natoa_dst set from IDci2: natoa_dst = %s\n", saddr2str(iph2->natoa_dst)); + } + } + #endif + /* adjust buffer length for HASH */ hbuf->l = tlen; *************** *** 2297,2302 **** --- 2328,2340 ---- } #endif + #ifdef ENABLE_NATT + if (iph2->ph1->natt_flags& NAT_DETECTED) + { + memcpy(&((struct sockaddr_in *)&spidx.dst)->sin_addr,&((struct sockaddr_in *)iph2->src)->sin_addr, sizeof(in_addr_t)); + } + #endif + if (_XIDT(iph2->id) == IPSECDOI_ID_IPV4_ADDR || _XIDT(iph2->id) == IPSECDOI_ID_IPV6_ADDR) idi2type = _XIDT(iph2->id); *************** *** 2356,2361 **** --- 2394,2405 ---- } #endif + #ifdef ENABLE_NATT + if (iph2->ph1->natt_flags& NAT_DETECTED) + { + memcpy(&((struct sockaddr_in *)&spidx.src)->sin_addr,&((struct sockaddr_in *)iph2->dst)->sin_addr, sizeof(in_addr_t)); + } + #endif /* Before setting iph2->[sa_src, sa_dst] with the addresses * provided in ID payloads, we check: * - they are both addresses of same family ************************ end of patch ************************ And here is my sys/netipsec/ipsec_input.c patch: *** sys/netipsec/ipsec_input.c 2011-10-17 15:29:28.000000000 +0300 --- sys/netipsec/ipsec_input.c 2012-04-13 14:42:00.000000000 +0300 *************** *** 76,81 **** --- 76,86 ---- #include #endif + #ifdef IPSEC_NAT_T + #include + #include + #endif + #include #ifdef INET6 #include *************** *** 347,352 **** --- 352,383 ---- } prot = ip->ip_p; + #ifdef IPSEC_NAT_T + if (saidx->mode == IPSEC_MODE_TRANSPORT&& sproto == IPPROTO_ESP) { + if (V_esp_ignore_natt_cksum != 0) { + /* Ignore checksum of packet protected by ESP. */ + if (prot == IPPROTO_TCP || prot == IPPROTO_UDP) { + m->m_pkthdr.csum_flags |= (CSUM_DATA_VALID | CSUM_PSEUDO_HDR); + m->m_pkthdr.csum_data = 0xffff; + } + } else if (sav->natt_cksum != 0) { + if (prot == IPPROTO_TCP || prot == IPPROTO_UDP) { + u_int16_t proto_cksum; + int off = sizeof(struct ip); + if (prot == IPPROTO_TCP) { + off += offsetof(struct tcphdr, th_sum); + } else if (prot == IPPROTO_UDP) { + off += offsetof(struct udphdr, uh_sum); + } + m_copydata(m, off, sizeof(u_int16_t), (caddr_t)&proto_cksum); + proto_cksum = in_addword(sav->natt_cksum, ~ntohs(proto_cksum)); + proto_cksum = ~htons(proto_cksum); + m_copyback(m, off, sizeof(u_int16_t), (caddr_t)&proto_cksum); + } + } + } + #endif + #ifdef notyet /* IP-in-IP encapsulation */ if (prot == IPPROTO_IPIP) { ***************************** end of patch ***************************** It differs from that in kern/146190 in one simple thing. I have problems with the original patch from kern/146190. When there was no NAT-OAi or NAT-OAr values in the kernel space, checksums was calculated at 0, but they were not ignored despite of the sysctl net.inet.esp.esp_ignore_natt_cksum value. The improvement allows to ignore every checksum in esp packets when net.inet.esp.esp_ignore_natt_cksum=1. Thanks. Zmiter 02.05.2012 From owner-freebsd-stable@FreeBSD.ORG Wed May 2 20:00:30 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C2A1A106564A for ; Wed, 2 May 2012 20:00:30 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (bird.sbone.de [46.4.1.90]) by mx1.freebsd.org (Postfix) with ESMTP id 6260B8FC0A for ; Wed, 2 May 2012 20:00:30 +0000 (UTC) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id 9D2A725D3A82; Wed, 2 May 2012 20:00:28 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id C4F8EBE61B0; Wed, 2 May 2012 20:00:27 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id U8RugaUQ4XZf; Wed, 2 May 2012 20:00:26 +0000 (UTC) Received: from orange-en1.sbone.de (orange-en1.sbone.de [IPv6:fde9:577b:c1a9:31:cabc:c8ff:fecf:e8e3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id E6109BE61AE; Wed, 2 May 2012 20:00:25 +0000 (UTC) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: "Bjoern A. Zeeb" In-Reply-To: <4FA181E3.9020303@gmail.com> Date: Wed, 2 May 2012 20:00:24 +0000 Content-Transfer-Encoding: quoted-printable Message-Id: <4579CE0F-2318-4FF1-B1EA-1EC69B24B1DF@lists.zabbadoz.net> References: <4F970899.2040105@incore.de> <4FA181E3.9020303@gmail.com> To: Zmiter X-Mailer: Apple Mail (2.1084) Cc: freebsd-stable@freebsd.org, Andreas Longwitz Subject: Re: Support for IPSec NAT-T in transoprt mode X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2012 20:00:30 -0000 On 2. May 2012, at 18:50 , Zmiter wrote: > 24.04.2012 23:10, Andreas Longwitz ?????: >> There is one limitation I would like to get over. =46rom man 8 = setkey: >> System that do not perform the port check cannot support multiple >> endpoints behind the same NAT. I think this is a FreeBSD kernel = restriction: >> For the first incoming L2TP packet the IPSEC part of the kernel does = not >> save the source port in the corresponding SA (maybe a field like >> natt_l2tp_port). So the kernel does for outgoing L2TP packets not = know >> the correct SA, if two ore more SA's with the same IP exists. >>=20 >> I would like to know if the patch mentioned in this thread adresses = this >> problem. > Thank you very much for your attention. > I've been testing those patches (actually, without your part) and YES = it's a big problem with clients (Android, Windows Mobile) behind the = same NAT. I cannot find the solution yet, but I'm very interested in it. > So, my Androids is some sort of stupid bricks, they do not send NAT-OA = payloads at phase 2, and ipsec-tools fills the SPD with IPs taken from = IDs. But this is not the correct way. IDs contain LAN (which is behind = the NAT) addresses, and FreeBSD cannot route packets to the IPSec crypto = part. > I've made some quick patching of IPSec tools to get my devices = working, but I don't know if they accomodate to the RFCs and ISAKMP. The = main idea is to take NAT-OAi and NAT-OAr addresses not from IDs when we = are using NAT-T, but from real source and destination addresses of the = server and client NATs. >=20 > Here is my ipsec-tools patch (i've call it patch-zz-local-2.diff and = place at /usr/ports/security/ipsec-tools/files with two other patches = from kern /146190) ... > It differs from that in kern/146190 in one simple thing. I have = problems with the original patch from kern/146190. When there was no = NAT-OAi or NAT-OAr values in the kernel space, checksums was calculated = at 0, but they were not ignored despite of the sysctl = net.inet.esp.esp_ignore_natt_cksum value. The improvement allows to = ignore every checksum in esp packets when = net.inet.esp.esp_ignore_natt_cksum=3D1. Just replying to the last one -- you all need to make sure that this = will work with a double-NAT (both i and r sitting behind a NAT) and not = just i behind a NAT and r sitting there with a globally routable IP. The changes suddenly become a lot more complex. Just my 5cts. /bz --=20 Bjoern A. Zeeb You have to have visions! It does not matter how good you are. It matters what good you do! From owner-freebsd-stable@FreeBSD.ORG Thu May 3 14:21:12 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4C5F3106566C for ; Thu, 3 May 2012 14:21:12 +0000 (UTC) (envelope-from prabhpal@digital-infotech.net) Received: from mail.digital-infotech.net (mail.digital-infotech.net [41.211.25.193]) by mx1.freebsd.org (Postfix) with ESMTP id E174E8FC12 for ; Thu, 3 May 2012 14:21:11 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail.digital-infotech.net (Postfix) with ESMTP id 446112E401F for ; Thu, 3 May 2012 14:22:09 +0000 (GMT) Received: from mail.digital-infotech.net ([127.0.0.1]) by localhost (mail.digital-infotech.net [127.0.0.1]) (maiad, port 10024) with ESMTP id 01708-05 for ; Thu, 3 May 2012 14:22:09 +0000 (GMT) Received: from mail.digital-infotech.net (localhost [127.0.0.1]) by mail.digital-infotech.net (Postfix) with ESMTP id E268F2E400C for ; Thu, 3 May 2012 14:22:08 +0000 (GMT) X-DKIM: OpenDKIM Filter v2.5.0 mail.digital-infotech.net E268F2E400C DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=digital-infotech.net; s=digital; t=1336054929; bh=7Mzb7IsGHKXgzYzBaYLSka/9/0egWwYwtr+4qCy4cK4=; h=Date:Subject:From:To:Reply-To; b=Gwvf72cDZlVTdpoPuteI7MDHe9GyP9EP4Dup+EL0l2bp8NmThVKRRnyEMI8Lnj0jU 3NmWrfzvFhgsLwCxU9iTTx2h6o8zsIUxumzmDFLPPWHKiYWtUdtzhi0JfGCqDAN8E6 Fur/YNRi5jIDJ9ARoUxgTB8i2oXJos2aauP1IsAE= Received: from 41.211.25.193 (SquirrelMail authenticated user prabhpal@digital-infotech.net) by mail.digital-infotech.net with HTTP; Thu, 3 May 2012 14:22:08 -0000 Message-ID: <02aab6ca59e4f75eeeb622299188093d.squirrel@mail.digital-infotech.net> Date: Thu, 3 May 2012 14:22:08 -0000 From: "Prabhpal S. Mavi" To: freebsd-stable@freebsd.org User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal Subject: mysql-bin files - filling up the space. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: prabhpal@digital-infotech.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 May 2012 14:21:12 -0000 Dear All Greetings, i am seeking help from guys with mysql knowledge. i can see lot of these files in mysql directory. And they are eventually filling up the space on the server. what these files are? some exists with very old time stamps. such as February 2012. can these be deleted? This Number Starts From -----------------------mysql-bin.000001 -rw-rw---- 1 mysql mysql 159M Apr 25 12:24 mysql-bin.000197 -rw-rw---- 1 mysql mysql 5M Apr 26 00:00 mysql-bin.000198 -rw-rw---- 1 mysql mysql 8.1M Apr 27 00:00 mysql-bin.000200 -rw-rw---- 1 mysql mysql 125B MAY 27 20:29 mysql-bin.000230 Prabh S. Mavi From owner-freebsd-stable@FreeBSD.ORG Thu May 3 14:34:37 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 41758106566C for ; Thu, 3 May 2012 14:34:37 +0000 (UTC) (envelope-from sergey.dyatko@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id AF5E68FC0C for ; Thu, 3 May 2012 14:34:36 +0000 (UTC) Received: by lbon10 with SMTP id n10so1750695lbo.13 for ; Thu, 03 May 2012 07:34:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:subject:message-id:in-reply-to:references:x-mailer :mime-version:content-type:content-transfer-encoding; bh=eEPOBOpAzwnD92j/7cn50zHkk0F1CurZMEpoOBWWrng=; b=OzLqgwZnfWwkPKP6HPMpRdZI2xRsfhAPZ90CrWY2wzwS9z741X2cM25Bwlzypk1hKH 6N8G91BGmtPOTKSkvkgjq8Tt5cZkJHV548Fs24U7I22J5udEwL0L/J5zAt7qCzG0tKac wfyP4dUxaWCRBk5NOts8PPzyk+/XnPPh2N/YSZjNwFCSBfctCbSYfEzpWSPgJAZ/tyoN tR4p3C2MVCnunqFBEE4bN5YPD3pmX1HScBzNiOJiz2PAO2ikCiQ1HoI9IwOobeHTQdeM JlBNQwdHbE2CYUFUv4/vYF2TQe0zmfYSBPKljCvOS9Siy39d5MSJoqYBkqb/j4q1tXzA 9nkg== Received: by 10.152.111.41 with SMTP id if9mr2267395lab.19.1336055670250; Thu, 03 May 2012 07:34:30 -0700 (PDT) Received: from laptop (m-s.agava.net. [195.222.84.203]) by mx.google.com with ESMTPS id pv14sm5751524lab.2.2012.05.03.07.34.27 (version=SSLv3 cipher=OTHER); Thu, 03 May 2012 07:34:28 -0700 (PDT) Date: Thu, 3 May 2012 17:35:04 +0300 From: "Sergey V. Dyatko" To: freebsd-stable@freebsd.org Message-ID: <20120503173504.6a07c4fd@laptop> In-Reply-To: <02aab6ca59e4f75eeeb622299188093d.squirrel@mail.digital-infotech.net> References: <02aab6ca59e4f75eeeb622299188093d.squirrel@mail.digital-infotech.net> X-Mailer: Claws Mail 3.8.0 (GTK+ 2.24.6; amd64-portbld-freebsd10.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: Re: mysql-bin files - filling up the space. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 May 2012 14:34:37 -0000 On Thu, 3 May 2012 14:22:08 -0000 "Prabhpal S. Mavi" wrote: > Dear All Greetings, > > i am seeking help from guys with mysql knowledge. i can see lot of > these files in mysql directory. And they are eventually filling up > the space on the server. what these files are? some exists with very > old time stamps. such as February 2012. can these be deleted? > > This Number Starts From -----------------------mysql-bin.000001 > > -rw-rw---- 1 mysql mysql 159M Apr 25 12:24 mysql-bin.000197 > -rw-rw---- 1 mysql mysql 5M Apr 26 00:00 mysql-bin.000198 > -rw-rw---- 1 mysql mysql 8.1M Apr 27 00:00 mysql-bin.000200 > > -rw-rw---- 1 mysql mysql 125B MAY 27 20:29 mysql-bin.000230 > > you should read official documentation, I think. http://dev.mysql.com/doc/refman/5.0/en/purge-binary-logs.html for example > > Prabh S. Mavi > > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to > "freebsd-stable-unsubscribe@freebsd.org" -- wbr, tiger From owner-freebsd-stable@FreeBSD.ORG Thu May 3 16:30:28 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7A7B3106566C for ; Thu, 3 May 2012 16:30:28 +0000 (UTC) (envelope-from prabhpal@digital-infotech.net) Received: from mail.digital-infotech.net (mail.digital-infotech.net [41.211.25.193]) by mx1.freebsd.org (Postfix) with ESMTP id 17CAE8FC19 for ; Thu, 3 May 2012 16:30:28 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail.digital-infotech.net (Postfix) with ESMTP id 207522E401F for ; Thu, 3 May 2012 16:30:54 +0000 (GMT) Received: from mail.digital-infotech.net ([127.0.0.1]) by localhost (mail.digital-infotech.net [127.0.0.1]) (maiad, port 10024) with ESMTP id 04405-07 for ; Thu, 3 May 2012 16:30:53 +0000 (GMT) Received: from mail.digital-infotech.net (localhost [127.0.0.1]) by mail.digital-infotech.net (Postfix) with ESMTP id BFECB2E400C for ; Thu, 3 May 2012 16:30:53 +0000 (GMT) X-DKIM: OpenDKIM Filter v2.5.0 mail.digital-infotech.net BFECB2E400C DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=digital-infotech.net; s=digital; t=1336062653; bh=1nCR9jSaLauViyqlBXbOXmRYwutlCSEJwbKZnR+4uqs=; h=Date:Subject:From:To:Reply-To; b=HVlSCTrVJ/qPfON5LPRVFvjSFVUGSv7XQ/j6x4utEedXIH6WMH1ZTdiPqyiFcIijf Vzs8WutlH2c8NNNnGNQW/kxP4Po4xF2BmhChzjSVnDooLb+joKAUYEFoK86FGEYLME U9MlXTz0lcQ2t3ayaslzWf/JvXJOK2L/YkL4+e0U= Received: from 41.211.25.193 (SquirrelMail authenticated user prabhpal@digital-infotech.net) by mail.digital-infotech.net with HTTP; Thu, 3 May 2012 16:30:53 -0000 Message-ID: <761dfef3fa092c96bc96e62ebc6af6d4.squirrel@mail.digital-infotech.net> Date: Thu, 3 May 2012 16:30:53 -0000 From: "Prabhpal S. Mavi" To: freebsd-stable@freebsd.org User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal Subject: Reject Action For SPF X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: prabhpal@digital-infotech.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 May 2012 16:30:28 -0000 Dear Friends, i have setup SPF alright, postfix is performing check as well (results below), but even if there is no SPF record exist for a domain, message is still accepted. how can i set the reject action, if no SPF available. May 3 16:11:14 titan postfix/policy-spf[5353]: : SPF none (No applicable sender policy available): Envelope-from: somedomain.com Prabh S. Mavi Prabh S. Mavi From owner-freebsd-stable@FreeBSD.ORG Thu May 3 16:54:29 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 516BC10656F0 for ; Thu, 3 May 2012 16:54:29 +0000 (UTC) (envelope-from glen.j.barber@gmail.com) Received: from mail-qc0-f182.google.com (mail-qc0-f182.google.com [209.85.216.182]) by mx1.freebsd.org (Postfix) with ESMTP id 05A0A8FC08 for ; Thu, 3 May 2012 16:54:28 +0000 (UTC) Received: by qcsg15 with SMTP id g15so1653102qcs.13 for ; Thu, 03 May 2012 09:54:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:x-operating-system :user-agent; bh=2KWZZDfT4H85q5KRSkH+bPwdlo6jwl/vDC4Mlca2yb0=; b=F0C4NqExfUdq17H1XHxkpuAIZy602FAjcENTeCxMtWmGqlxwXwxWRE2AnFDy7joNGE f+S3X0JB3aXQ5Adli+zNM5VhcTZhw6rIONTvc35o1uEZ0EJy/PcGOL5hi/Qdm/UvRhxB qjU2oogds3gjG7VNxoSAAGudmTK+BxxhhiDGp4WYENsBpFP8jjfdKsANGlMrhRTtzfk1 0w9bRhJNVNL02IKygQuQJjyjgQWB6WfVXyBz+wd89PTOb064xyvsCquBeotVomIdtCLa 2iUjF7EOrcuzjkIGcpCSAOb5APWwg6hJnR0aLFL3lohL2qRUSJReMf/NBNbmw1ye3rHU iHzQ== Received: by 10.224.76.146 with SMTP id c18mr4016988qak.56.1336064068329; Thu, 03 May 2012 09:54:28 -0700 (PDT) Received: from schism.local (c-76-124-49-145.hsd1.pa.comcast.net. [76.124.49.145]) by mx.google.com with ESMTPS id s20sm9878785qap.16.2012.05.03.09.54.26 (version=SSLv3 cipher=OTHER); Thu, 03 May 2012 09:54:27 -0700 (PDT) Date: Thu, 3 May 2012 12:54:25 -0400 From: Glen Barber To: "Prabhpal S. Mavi" Message-ID: <20120503165424.GA1727@schism.local> References: <761dfef3fa092c96bc96e62ebc6af6d4.squirrel@mail.digital-infotech.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <761dfef3fa092c96bc96e62ebc6af6d4.squirrel@mail.digital-infotech.net> X-Operating-System: FreeBSD 10.0-CURRENT amd64 User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-stable@freebsd.org Subject: Re: Reject Action For SPF X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 May 2012 16:54:29 -0000 On Thu, May 03, 2012 at 04:30:53PM -0000, Prabhpal S. Mavi wrote: > > Dear Friends, > > i have setup SPF alright, postfix is performing check as well (results > below), but even if there is no SPF record exist for a domain, message is > still accepted. > > how can i set the reject action, if no SPF available. > Why would you want to reject mail from legitimite senders that do not have SPF records published? Glen From owner-freebsd-stable@FreeBSD.ORG Thu May 3 16:59:24 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3E75A106566B for ; Thu, 3 May 2012 16:59:24 +0000 (UTC) (envelope-from prabhpal@digital-infotech.net) Received: from mail.digital-infotech.net (mail.digital-infotech.net [41.211.25.193]) by mx1.freebsd.org (Postfix) with ESMTP id D2A8D8FC17 for ; Thu, 3 May 2012 16:59:23 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail.digital-infotech.net (Postfix) with ESMTP id 3B1B92E401F; Thu, 3 May 2012 16:59:42 +0000 (GMT) Received: from mail.digital-infotech.net ([127.0.0.1]) by localhost (mail.digital-infotech.net [127.0.0.1]) (maiad, port 10024) with ESMTP id 04405-10; Thu, 3 May 2012 16:59:42 +0000 (GMT) Received: from mail.digital-infotech.net (localhost [127.0.0.1]) by mail.digital-infotech.net (Postfix) with ESMTP id 9EB9E2E400C; Thu, 3 May 2012 16:59:41 +0000 (GMT) X-DKIM: OpenDKIM Filter v2.5.0 mail.digital-infotech.net 9EB9E2E400C DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=digital-infotech.net; s=digital; t=1336064381; bh=/lNMetY/iIeDw3UdSo32l0CPw+mkSqLjMxxjMxFDEFk=; h=In-Reply-To:References:Date:Subject:From:To:Cc:Reply-To; b=qkVE8lYUR+9JLTj56qoZjQCROFK9I9b/GFV/r0Tt2Dz3Byuctk6kVxpfZ11YB7Yyp 7YO24kVbrm/wBfexUnMyGDK7Oy0ZGdHXWMk4fZR2gAUuLBWAlkNfzQEj0CCe39SDvY V+Yol/pZtDZo4hHtXoDHiUFTLCtq0uGbQF0mGKn0= Received: from 41.211.25.193 (SquirrelMail authenticated user prabhpal@digital-infotech.net) by mail.digital-infotech.net with HTTP; Thu, 3 May 2012 16:59:41 -0000 Message-ID: In-Reply-To: <20120503165424.GA1727@schism.local> References: <761dfef3fa092c96bc96e62ebc6af6d4.squirrel@mail.digital-infotech.net> <20120503165424.GA1727@schism.local> Date: Thu, 3 May 2012 16:59:41 -0000 From: "Prabhpal S. Mavi" To: "Glen Barber" User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal Cc: "Prabhpal S. Mavi" , freebsd-stable@freebsd.org Subject: Re: Reject Action For SPF X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: prabhpal@digital-infotech.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 May 2012 16:59:24 -0000 > Why would you want to reject mail from legitimite senders that do not > have SPF records published? > > Glen Dear Glen. B Thanks for your response, We want to implement this no our backup MX server. i trust this explains the reason. i know SPF is not spam prevention mechanize. Can you tell me how to set reject action? Prabh S. Mavi From owner-freebsd-stable@FreeBSD.ORG Thu May 3 22:55:53 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C88CA1065673 for ; Thu, 3 May 2012 22:55:53 +0000 (UTC) (envelope-from efraindector@motumweb.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 810848FC0C for ; Thu, 3 May 2012 22:55:53 +0000 (UTC) Received: by obcni5 with SMTP id ni5so3934395obc.13 for ; Thu, 03 May 2012 15:55:52 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:from:to:references:in-reply-to:subject:date:organization :mime-version:content-type:content-transfer-encoding:x-priority :x-msmail-priority:importance:x-mailer:x-mimeole:x-gm-message-state; bh=GBOaQtVPyPbkhWO22G95A8ZhKMCbe7R6++Wgm3+7DK0=; b=dGO9bNjVbnVaBKmk+wnm276spyAOHhyuLuvlMkItRR66sS4qr2QIMLm8aZalWewtla Am0GNXaE9EnBt9fnwADEymj4Pr/H4mIucLDksaLlf3eLSameFJh6pzBxx6mjiatMzWg/ OEItZDShwoeprAgL2HV0ubiZD+To0ifSzhu0afPj23mT8IutTijz8qnva15UTRxVWZ52 lEKamizJi+q4SM3uZgFEZPazfRJXgximas/o8fPAz+gsOr97Tl8Ep2Yu64nEr2LzFdPF ZDOm32DMRqxV/41swyYkTsmGKZBYCXxKhC7mkKNQOls2Oc/3m8TAl+ZQEzCC1qc4e2Qw Fd6Q== Received: by 10.60.22.138 with SMTP id d10mr5295624oef.69.1336085752767; Thu, 03 May 2012 15:55:52 -0700 (PDT) Received: from CMOTUM25PC ([189.130.181.109]) by mx.google.com with ESMTPS id n9sm5819138oen.2.2012.05.03.15.55.50 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 03 May 2012 15:55:51 -0700 (PDT) Message-ID: <47BB1C7132924E42AD623CEDEAE673EA@CMOTUM25PC> From: =?UTF-8?Q?Efra=C3=ADn_D=C3=A9ctor?= To: "Peter Maloney" , References: <4E9B7F6B991C46BF9CCBC03F72A56AFB@CMOTUM25PC><795E082973104798BB84124E63C556CB@CMOTUM25PC><4F9AB906.7000400@my.gd> <4F9E4937.7040000@brockmann-consult.de> In-Reply-To: <4F9E4937.7040000@brockmann-consult.de> Date: Thu, 3 May 2012 17:55:47 -0500 Organization: =?UTF-8?Q?HESA_T=C3=A9cnica?= MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="UTF-8"; reply-type=original Content-Transfer-Encoding: 8bit X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 15.4.3555.308 X-MimeOLE: Produced By Microsoft MimeOLE V15.4.3555.308 X-Gm-Message-State: ALoCoQmoSvQme85OM9IHU73qrVYNd8GpTz3FvCz8CRzlFIo70+mjgMUTHARa8jYcVezDvDypz2oC Cc: Subject: Re: /var getting full X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 May 2012 22:55:54 -0000 Hello. I did not write the Java program. I've sent your recomendation to our programmers. Thank you. -----Mensaje original----- From: Peter Maloney Sent: Monday, April 30, 2012 3:11 AM To: freebsd-stable@freebsd.org Subject: Re: /var getting full Am 27.04.2012 17:26, schrieb Efraín Déctor: > Thank you all. > > I found out that a Java process was using all this space. I restarted > it and voilá problem solved. Did you write this Java program? If so, you probably need a finally block: File f = ... InputStream in = null; try { in = new FileInputStream(in); //whatever you do here, such as create a Reader, you keep a reference to the InputStream }finally{ //A finally is called regardless of what happens in the try. For example, if there is an Exception thrown, the finally is run anyway. Code at the end of the try is not called when an exception is thrown. if( in != null ) { //you must wrap this in a try{}catch(IOException){}, otherwise the rest of your finally is not run if it throws an Exception try{ in.close(); }catch(IOException e) { logger.log(Level.SEVERE, Failed to close InputStream", e); } } } > > > Thanks. > -----Mensaje original----- From: Tom Evans > Sent: Friday, April 27, 2012 10:22 AM > To: Damien Fleuriot > Cc: freebsd-stable@freebsd.org > Subject: Re: /var getting full > > On Fri, Apr 27, 2012 at 4:19 PM, Damien Fleuriot wrote: >> Type: >> sync >> >> >> Then: >> df -h >> >> Then: >> cd /var && du -hd 1 >> >> >> Post results. >> > > As well as this, any unlinked files that have file handles open by > running processes will not be accounted for in du, but will be counted > in df. You could try restarting services that write to /var. > > Cheers > > Tom > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" _______________________________________________ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Thu May 3 23:09:49 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 401F11065670 for ; Thu, 3 May 2012 23:09:49 +0000 (UTC) (envelope-from efraindector@motumweb.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id F1D858FC17 for ; Thu, 3 May 2012 23:09:48 +0000 (UTC) Received: by obcni5 with SMTP id ni5so3953641obc.13 for ; Thu, 03 May 2012 16:09:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:from:to:subject:date:organization:mime-version :content-type:x-priority:x-msmail-priority:importance:x-mailer :x-mimeole:x-gm-message-state; bh=Udxz1fbwAEVAOOla8ZD2EnzIkOfpZCPOiQrxWawbz6Q=; b=eWzf3wDUH9jiUnTdOwcqxwBE/0TE3hh1q+SwxE/tu7O1GcyZ0Qhtf8HohqDY9898mm bMgKzoaxTv6/Lc9hIiysUt+zQPCKbfNsrRrwFBHdgk6a4g/wwtkpSuKqkRJBYI4g8FWg QVIzjBg4pXlVTVFV/ouSOJVhaadz/VksHIxVBkEcK8NcgSAMYusNXdN0L641aNvhIu8y wF0bIFsU3HGCoIlth4dQJDzMhLvGVlVfMYhx4HRvZkcEfqh4txuWb8rJtyXnaBA1e7ac cINa36TxJ5RgrcQj6WDophmGBBHnROLlm9HcmAiSL7MPwt+jFNhczXqIqWXBnrYRp9+y OzJw== Received: by 10.60.22.234 with SMTP id h10mr2903583oef.54.1336086156923; Thu, 03 May 2012 16:02:36 -0700 (PDT) Received: from CMOTUM25PC ([189.130.181.109]) by mx.google.com with ESMTPS id gf8sm7146612obc.3.2012.05.03.16.02.35 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 03 May 2012 16:02:36 -0700 (PDT) Message-ID: From: =?UTF-8?Q?Efra=C3=ADn_D=C3=A9ctor?= To: Date: Thu, 3 May 2012 18:02:35 -0500 Organization: =?UTF-8?Q?HESA_T=C3=A9cnica?= MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 15.4.3555.308 X-MimeOLE: Produced By Microsoft MimeOLE V15.4.3555.308 X-Gm-Message-State: ALoCoQng95DwEY9XONWJ1wsXEoPtJP4eEPw+SVxkG2dK+T+ESHM/RzyXBUx/C7xV84waK2PQcWMi Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: User root can't get email X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 May 2012 23:09:49 -0000 Hello. I have a FreeBSD Server 8.2, the past few days I=E2=80=99ve noticed that = the user root was not recieving email. I ran a test simply by using: mail root Then in /var/log/messsages I got this message: May 3 22:47:56 edh sendmail[74022]: q3RFM513074022: SYSERR(root): = Cannot reopen ./dfq3RFM513074022: No such file or directory May 3 22:47:56 edh sendmail[74022]: q3RFM514074022: SYSERR(root): = putbody: Cannot open ./dfq3RFM513074022 for MAILER-DAEMON from root: No = such file or directory Im not using this server as a email server, but it is very important to = me because I have some scripts running by cron that send the output by = email to the user that is running them, in this case root. Thanks in advance. From owner-freebsd-stable@FreeBSD.ORG Fri May 4 01:06:29 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ADDBF106566C for ; Fri, 4 May 2012 01:06:29 +0000 (UTC) (envelope-from marka@isc.org) Received: from mx.ams1.isc.org (mx.ams1.isc.org [IPv6:2001:500:60::65]) by mx1.freebsd.org (Postfix) with ESMTP id 3FD658FC08 for ; Fri, 4 May 2012 01:06:28 +0000 (UTC) Received: from bikeshed.isc.org (bikeshed.isc.org [IPv6:2001:4f8:3:d::19]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "mail.isc.org", Issuer "RapidSSL CA" (not verified)) by mx.ams1.isc.org (Postfix) with ESMTPS id 6898F5F9A45; Fri, 4 May 2012 01:06:14 +0000 (UTC) (envelope-from marka@isc.org) Received: from drugs.dv.isc.org (unknown [IPv6:2001:470:1f00:820:ada5:f16c:1a15:3716]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by bikeshed.isc.org (Postfix) with ESMTPSA id 737A4216C31; Fri, 4 May 2012 01:06:07 +0000 (UTC) (envelope-from marka@isc.org) Received: from drugs.dv.isc.org (localhost [127.0.0.1]) by drugs.dv.isc.org (Postfix) with ESMTP id 67E382064422; Fri, 4 May 2012 11:05:54 +1000 (EST) To: prabhpal@digital-infotech.net From: Mark Andrews References: <761dfef3fa092c96bc96e62ebc6af6d4.squirrel@mail.digital-infotech.net> <20120503165424.GA1727@schism.local> In-reply-to: Your message of "Thu, 03 May 2012 16:59:41 GMT." Date: Fri, 04 May 2012 11:05:53 +1000 Message-Id: <20120504010554.67E382064422@drugs.dv.isc.org> X-Spam-Status: No, score=-1.6 required=5.0 tests=AWL,BAYES_00, T_RP_MATCHES_RCVD autolearn=ham version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on mx.ams1.isc.org Cc: freebsd-stable@freebsd.org, Glen Barber Subject: Re: Reject Action For SPF X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 01:06:29 -0000 In message , "Prabhpal S. Mavi" writes: > > > Why would you want to reject mail from legitimite senders that do not > > have SPF records published? > > > > Glen > > Dear Glen. B > > Thanks for your response, We want to implement this no our backup MX > server. i trust this explains the reason. i know SPF is not spam > prevention mechanize. Can you tell me how to set reject action? Fix your backup server to have the data required to perform the filtering. Don't force the rest of the world to waste cycles and bandwidth attempting to send email to a backup MX that you have advertised. If you can't do it correctly, DO NOT DO IT. > Prabh S. Mavi > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" -- Mark Andrews, ISC 1 Seymour St., Dundas Valley, NSW 2117, Australia PHONE: +61 2 9871 4742 INTERNET: marka@isc.org From owner-freebsd-stable@FreeBSD.ORG Fri May 4 05:05:10 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 79F86106566B for ; Fri, 4 May 2012 05:05:10 +0000 (UTC) (envelope-from jhellenthal@dataix.net) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id 1EF4A8FC08 for ; Fri, 4 May 2012 05:05:10 +0000 (UTC) Received: by yenl9 with SMTP id l9so3186303yen.13 for ; Thu, 03 May 2012 22:05:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dataix.net; s=rsa; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to; bh=4AoSdRkOEs2ccDy462LlnFnt/8qyDwM/ljSAazLOQ5s=; b=MyBdieO1bdUynTW3Qv3m2rN82jW1qA+SpVFuEagSLVOqi48Osg5vPa67J9Ftw9oSUn /E1DafcjLV4pYhH0I+O+i7s2fhbEP3HFwmvdfHJC2jtD4KtlspuNwN69SckHM1IO2iaV 8VLkPqoVQpTOG7jisbAkcPoDxopMBuZHB7iZc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:x-gm-message-state; bh=4AoSdRkOEs2ccDy462LlnFnt/8qyDwM/ljSAazLOQ5s=; b=Sq1TcAg9aaG6oFRv12GrG2Gc3WpVAuI08XC/5KGi/u/J/9VCFdGxL01SJoVNyuOOq0 B6kEjZIzpSGAZyWraKRHff7+bXAlrMFXmu4p7UrRlKEGC9p7VEUsToOk46oiJr3Z1y+C tzcOAao0wldBSh4BNhGOYEVPjp/O/PH2U236BY7CW+x+56J4O3V/Cij6lsuHqoeBiKA9 6LHiyZs4xs0ax9A4IhiwQCxvhzurI2+xJc0zxyiw43QDlJPnQA0CwAzR+lKM3s23YGr4 7DLqQLxYshB7d/QyArgYxf1vn0xRKis3mpMIEfli7BSnE4tdCqhChU4EIJY98lN/h8jw 5EYw== Received: by 10.50.197.132 with SMTP id iu4mr2265742igc.4.1336107909207; Thu, 03 May 2012 22:05:09 -0700 (PDT) Received: from DataIX.net (adsl-99-181-155-184.dsl.klmzmi.sbcglobal.net. [99.181.155.184]) by mx.google.com with ESMTPS id k8sm3940632igz.4.2012.05.03.22.05.08 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 03 May 2012 22:05:08 -0700 (PDT) Received: from DataIX.net (localhost [127.0.0.1]) by DataIX.net (8.14.5/8.14.5) with ESMTP id q44555K2038394 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 4 May 2012 01:05:05 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Received: (from jhellenthal@localhost) by DataIX.net (8.14.5/8.14.5/Submit) id q445550K037596; Fri, 4 May 2012 01:05:05 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Date: Fri, 4 May 2012 01:05:05 -0400 From: Jason Hellenthal To: =?iso-8859-1?Q?Efra=EDn_D=E9ctor?= Message-ID: <20120504050505.GA3940@DataIX.net> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="J2SCkAp4GZ/dPZZf" Content-Disposition: inline In-Reply-To: X-Gm-Message-State: ALoCoQnwIUYyky/altNnh8+9PhVaIUlrBYQQPNJpaBxAvezhFEUVdwyjmAyGE3udy+Sea0wAYVlQ Cc: freebsd-stable@freebsd.org Subject: Re: User root can't get email X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 05:05:10 -0000 --J2SCkAp4GZ/dPZZf Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, May 03, 2012 at 06:02:35PM -0500, Efra=C3=ADn D=C3=A9ctor wrote: > Hello. >=20 > I have a FreeBSD Server 8.2, the past few days I=E2=80=99ve noticed that = the user root was not recieving email. I ran a test simply by using: >=20 > mail root >=20 > Then in /var/log/messsages I got this message: >=20 > May 3 22:47:56 edh sendmail[74022]: q3RFM513074022: SYSERR(root): Cannot= reopen ./dfq3RFM513074022: No such file or directory > May 3 22:47:56 edh sendmail[74022]: q3RFM514074022: SYSERR(root): putbod= y: Cannot open ./dfq3RFM513074022 for MAILER-DAEMON from root: No such file= or directory >=20 > Im not using this server as a email server, but it is very important to m= e because I have some scripts running by cron that send the output by email= to the user that is running them, in this case root. >=20 If you have recently been working on upgrading your system in any way I would check the perms on all the directories in /var and possibly other systems as can be advised in a upgrade procedure within the handbook. You may also attempt the following which may fix it but it comes with a disclaimer and you should know how to fix it if it breaks. mtree -deU -f /etc/mtree/BSD.var.dist Before doing the above, I would seriously ask myself... What did I do in those last few days or week or so... and at least attempt to backtrack to a conclusive result. Good luck. --=20 - (2^(N-1)) --J2SCkAp4GZ/dPZZf Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJPo2OAAAoJEBSh2Dr1DU7WR2UIAKLOmkBTCWBM0/xb3doNmz5o c5swCGZ23wDumuruLcfq+kCvFLicRS1Sge2l2C2wyoYCeJ/runGQqvMRDpnTqMcy xoQgJcf8cIQkgVaRPHxg1rb0Q5fOrMuLUROEM4w+s0Cya5znHwcm1bxnikp5WEpG Nw6+FHoAJApakjGEQIONNXuWf3Ks9K6efJd55UBNKNnXpcu0WpviXr9/5Y/Ah0mW PZ/VT2RogIF/7xki4c2s/3/LUkcp3pkaVG4NpXvP4LIu1Wje9ulBi2DrUiOrc0RL kpcxVsZY4IN0oGwRECEN1NuaFru5WoYRTosdg7+uyUCqMXrqC0l9GA2DH8bF6pU= =6HpV -----END PGP SIGNATURE----- --J2SCkAp4GZ/dPZZf-- From owner-freebsd-stable@FreeBSD.ORG Fri May 4 05:09:22 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A5A1A106566B for ; Fri, 4 May 2012 05:09:22 +0000 (UTC) (envelope-from jhellenthal@dataix.net) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 565C58FC0C for ; Fri, 4 May 2012 05:09:22 +0000 (UTC) Received: by obcni5 with SMTP id ni5so4417544obc.13 for ; Thu, 03 May 2012 22:09:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dataix.net; s=rsa; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:content-transfer-encoding :in-reply-to; bh=sWJiLUC8ggPcnvUhydb/NIcqiurzabuN5usa1UZyqxo=; b=OumfL4Ni+WNSjFTThsm0u1k2v2xd+MqvYBb02ilNgCZ817xSm4TJEY7tR2xb71b69V BntNbyKO8SUo6GMvlu7FS5o3y5SCp0gTJiy42fM8R0Jo5AoH6K42BF/PhidrIE98KXST O/sOlNPD6ve4xrx4lpO4+aECRuEBgRNtNOmO8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:content-transfer-encoding :in-reply-to:x-gm-message-state; bh=sWJiLUC8ggPcnvUhydb/NIcqiurzabuN5usa1UZyqxo=; b=P1h8v+wuLbC4Yl2dQpBX0KiaK/lXiUkhmRZwCFjQYyx+A+htPBwPJZeGyjXwi9u0Cj 0T5ADxjmvDdfU2QXSIX7QzGj2prV/m6To7nKtb63fA4I1AIYDl3NvQ6hnPCmpwX/4HDj iFrZHDh70iIBbR06PiU/yTV97nIyanyFGcevHi4xYbFXWonFRowo4YJz64jeenx8Opks 0x/V0108RBkRtYxvdf4LVwYacWLOUiaUf59BjUxzwRLMYWQgGTuSRmFHYdmsFKZ96M32 dgU9p5D/1osk3CMpgteNHEeYd51NGPE3FUFPNU+nb5GOUvlrCh60H1pTuRmZH29yO7r4 qJlA== Received: by 10.50.89.200 with SMTP id bq8mr296817igb.12.1336108161584; Thu, 03 May 2012 22:09:21 -0700 (PDT) Received: from DataIX.net ([99.181.155.184]) by mx.google.com with ESMTPS id t3sm3924611igb.16.2012.05.03.22.09.21 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 03 May 2012 22:09:21 -0700 (PDT) Received: from DataIX.net (localhost [127.0.0.1]) by DataIX.net (8.14.5/8.14.5) with ESMTP id q4457k8K074800 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 4 May 2012 01:07:47 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Received: (from jhellenthal@localhost) by DataIX.net (8.14.5/8.14.5/Submit) id q4457kFC073812; Fri, 4 May 2012 01:07:46 -0400 (EDT) (envelope-from jhellenthal@DataIX.net) Date: Fri, 4 May 2012 01:07:46 -0400 From: Jason Hellenthal To: =?iso-8859-1?Q?Efra=EDn_D=E9ctor?= Message-ID: <20120504050746.GB3940@DataIX.net> References: <20120504050505.GA3940@DataIX.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20120504050505.GA3940@DataIX.net> X-Gm-Message-State: ALoCoQngRv5n0HAYD8hVZEOmiyX+ATut+FmE5/SKReRfubos5YcOxjwijAzYyvxxpdjR63/M03vn Cc: freebsd-stable@freebsd.org Subject: Re: User root can't get email X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 05:09:22 -0000 And possibly /etc/mtree/BSD.sendmail.dist On Fri, May 04, 2012 at 01:05:05AM -0400, Jason Hellenthal wrote: > > > On Thu, May 03, 2012 at 06:02:35PM -0500, Efraín Déctor wrote: > > Hello. > > > > I have a FreeBSD Server 8.2, the past few days I’ve noticed that the user root was not recieving email. I ran a test simply by using: > > > > mail root > > > > Then in /var/log/messsages I got this message: > > > > May 3 22:47:56 edh sendmail[74022]: q3RFM513074022: SYSERR(root): Cannot reopen ./dfq3RFM513074022: No such file or directory > > May 3 22:47:56 edh sendmail[74022]: q3RFM514074022: SYSERR(root): putbody: Cannot open ./dfq3RFM513074022 for MAILER-DAEMON from root: No such file or directory > > > > Im not using this server as a email server, but it is very important to me because I have some scripts running by cron that send the output by email to the user that is running them, in this case root. > > > > If you have recently been working on upgrading your system in any way I > would check the perms on all the directories in /var and possibly other > systems as can be advised in a upgrade procedure within the handbook. > > You may also attempt the following which may fix it but it comes with a > disclaimer and you should know how to fix it if it breaks. > > mtree -deU -f /etc/mtree/BSD.var.dist > > > Before doing the above, I would seriously ask myself... What did I do in > those last few days or week or so... and at least attempt to backtrack > to a conclusive result. > > > Good luck. > > -- > > - (2^(N-1)) -- - (2^(N-1)) From owner-freebsd-stable@FreeBSD.ORG Fri May 4 07:45:57 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A8F20106564A for ; Fri, 4 May 2012 07:45:57 +0000 (UTC) (envelope-from prabhpal@digital-infotech.net) Received: from mail.digital-infotech.net (mail.digital-infotech.net [41.211.25.193]) by mx1.freebsd.org (Postfix) with ESMTP id 485388FC12 for ; Fri, 4 May 2012 07:45:57 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mail.digital-infotech.net (Postfix) with ESMTP id CA96E2E4043; Fri, 4 May 2012 07:45:53 +0000 (GMT) Received: from mail.digital-infotech.net ([127.0.0.1]) by localhost (mail.digital-infotech.net [127.0.0.1]) (maiad, port 10024) with ESMTP id 01707-05; Fri, 4 May 2012 07:45:53 +0000 (GMT) Received: from mail.digital-infotech.net (localhost [127.0.0.1]) by mail.digital-infotech.net (Postfix) with ESMTP id 372E62E400A; Fri, 4 May 2012 07:45:53 +0000 (GMT) X-DKIM: OpenDKIM Filter v2.5.0 mail.digital-infotech.net 372E62E400A DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=digital-infotech.net; s=digital; t=1336117553; bh=6gO/Viy8t3+ltZ31WVu66XLASZf48sSyOvw1NG6xg8I=; h=In-Reply-To:References:Date:Subject:From:To:Cc:Reply-To; b=h+XpmaZcplpUDNZev0HfVPZVwy12vddz566MOufOK35i1eeOwvmYsiEDaICsVmoPJ 1a08PLnicsGZHQeU6z4Ox3Ys2zFI8TcKqTo8ooZ5JqQd7iF6cIxWtou8VtJ1GtKy+9 3Bz9MvS186AUyrxyCYm247k8A2nN9spfv4xNKBa8= Received: from 41.211.25.193 (SquirrelMail authenticated user prabhpal@digital-infotech.net) by mail.digital-infotech.net with HTTP; Fri, 4 May 2012 07:45:53 -0000 Message-ID: <2f1204d76bb419f655909d5edd11257e.squirrel@mail.digital-infotech.net> In-Reply-To: <20120504010554.67E382064422@drugs.dv.isc.org> References: <761dfef3fa092c96bc96e62ebc6af6d4.squirrel@mail.digital-infotech.net> <20120503165424.GA1727@schism.local> <20120504010554.67E382064422@drugs.dv.isc.org> Date: Fri, 4 May 2012 07:45:53 -0000 From: "Prabhpal S. Mavi" To: "Mark Andrews" User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal Cc: freebsd-stable@freebsd.org, Glen Barber Subject: Re: Reject Action For SPF X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: prabhpal@digital-infotech.net List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 07:45:57 -0000 > Fix your backup server to have the data required to perform the > filtering. Don't force the rest of the world to waste cycles and > bandwidth attempting to send email to a backup MX that you have > advertised. If you can't do it correctly, DO NOT DO IT. Hello Mark. A Don't you think you guys are telling that what is SPF and how should we use it. SPF is in system for a while, almost everyone is aware what it is. And what it does. funny enough, no one answered to the actual question. all this info is available on the web. Anyways Prabh S. Mavi From owner-freebsd-stable@FreeBSD.ORG Fri May 4 08:36:46 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 87E031065672 for ; Fri, 4 May 2012 08:36:46 +0000 (UTC) (envelope-from Holger.Kipp@alogis.com) Received: from alogis.com (firewall.solit-ag.de [212.184.102.1]) by mx1.freebsd.org (Postfix) with ESMTP id EC21D8FC0C for ; Fri, 4 May 2012 08:36:45 +0000 (UTC) Received: from msx3.exchange.alogis.com (msx3exchange.alogis.com [10.1.1.6] (may be forged)) by alogis.com (8.13.4/8.13.1) with ESMTP id q448W4DC074967; Fri, 4 May 2012 10:32:04 +0200 (CEST) (envelope-from Holger.Kipp@alogis.com) Received: from MSX3.exchange.alogis.com ([fe80::c8ed:428a:a157:b61]) by msx3.exchange.alogis.com ([fe80::c8ed:428a:a157:b61%13]) with mapi id 14.01.0255.000; Fri, 4 May 2012 10:32:00 +0200 From: Holger Kipp To: "" Thread-Topic: Reject Action For SPF Thread-Index: AQHNKZINxSo21l1C5EGtouArrilkO5a5HzGAgAAM2oA= Date: Fri, 4 May 2012 08:32:00 +0000 Message-ID: <16191BD9-A9F0-4A04-9CA4-9FD98275A89E@alogis.com> References: <761dfef3fa092c96bc96e62ebc6af6d4.squirrel@mail.digital-infotech.net> <20120503165424.GA1727@schism.local> <20120504010554.67E382064422@drugs.dv.isc.org> <2f1204d76bb419f655909d5edd11257e.squirrel@mail.digital-infotech.net> In-Reply-To: <2f1204d76bb419f655909d5edd11257e.squirrel@mail.digital-infotech.net> Accept-Language: en-GB, de-DE, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.1.1.4] Content-Type: text/plain; charset="iso-8859-1" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Glen Barber , "" Subject: Re: Reject Action For SPF X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 08:36:46 -0000 Am 04.05.2012 um 09:45 schrieb Prabhpal S. Mavi: > >> Fix your backup server to have the data required to perform the >> filtering. Don't force the rest of the world to waste cycles and >> bandwidth attempting to send email to a backup MX that you have >> advertised. If you can't do it correctly, DO NOT DO IT. > > Hello Mark. A > > Don't you think you guys are telling that what is SPF and how should we > use it. SPF is in system for a while, almost everyone is aware what it is= . > And what it does. Good reading: http://david.woodhou.se/why-not-spf.html > funny enough, no one answered to the actual question. all this info is > available on the web. Anyways You might want to alter http://bazaar.launchpad.net/~kitterman/postfix-poli= cyd-spf-perl/trunk/view/head:/postfix-policyd-spf-perl to return a proper reject-message if no spy-record was found. Best regards, Holger -- Holger Kipp Diplom-Mathematiker Senior Consultant Tel. : +49 30 436 58 114 Fax. : +49 30 436 58 214 Mobil: +49 178 36 58 114 Email: holger.kipp@alogis.com alogis AG Alt-Moabit 90b D-10559 Berlin web : http://www.alogis.com ---------------------------------------------------------- alogis AG Sitz/Registergericht: Berlin/AG Charlottenburg, HRB 71484 Vorstand: Arne Friedrichs, Joern Samuelson Aufsichtsratsvorsitzender: Reinhard Mielke From owner-freebsd-stable@FreeBSD.ORG Fri May 4 10:39:30 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9504A106564A for ; Fri, 4 May 2012 10:39:30 +0000 (UTC) (envelope-from backup@mail.unimark.az) Received: from mail.unimark.az (mail.unimark.az [85.132.37.130]) by mx1.freebsd.org (Postfix) with ESMTP id 1203C8FC08 for ; Fri, 4 May 2012 10:39:29 +0000 (UTC) Received: by mail.unimark.az (Postfix, from userid 34) id 3BFD272E1; Fri, 4 May 2012 15:19:46 +0500 (AZST) To: freebsd-stable@freebsd.org Message-ID: <1336126786.189396.qmail@americanexpress.com> From: "AmericanExpress@email.americanexpress.com" Date: Fri, 4 May 2012 15:19:46 +0500 (AZST) MIME-Version: 1.0 Content-Type: text/plain X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: American Express Alert - Personal Security Key Reset X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 10:39:30 -0000 American Express Alert - Personal Security Key Reset American Express Alert - Personal Security Key Reset For your security: _________________________________________________________________ Dear American Express member, To protect your account(s), we need you to re-authenticate your account by updating your Pers onal Security Key. For authenticate your identity please click on the following link. [1]http://www.americanexpress.com/myca/form/serverstack/action?request _type=75629812604 . As a reminder, your Personal Security Key is not the password associated with your User ID when you log in to [2]www.americanexpress.com. You created this unique key when you activated your Card. We will ask for your Personal Security Key when you call American Express to validate your identification and to securely and promptly service your requests. Your Personal Security Key applies to all of your American Express Card accounts where you are the Basic Cardmember. Thank you for your Cardmembership. Sincerely, American Express Customer Care Cardmember: Account Ending: _________________________________________________________________ [3]Contact Customer Service [4]View Our Privacy Statement [5]Add Us to Your Address Book Your Cardmember information is included in the upper-right corner to help you recognize this as a customer service e-mail from American Express. Using the spam/junk mail function may not block servicing messages from being sent to your email account. . Copyright 2011 American Express Company. All rights reserved. CASEUPSW0001005 References 1. http://89.38.204.111/home.americanexpress.com/ 2. https://www.americanexpress.com/ 3. http://www.americanexpress.com/Tracking?mid=CASEUPSW0001005C96900389B51EA03A&msrc=MYCA&url=https://www.americanexpress.com/messagecenter 4. http://www.americanexpress.com/Tracking?mid=CASEUPSW0001005C96900389B51EA03A&msrc=MYCA&url=http://www.americanexpress.com/privacy 5. http://www.americanexpress.com/Tracking?mid=CASEUPSW0001005C96900389B51EA03A&msrc=MYCA&url=https://www212.americanexpress.com/dsmlive/dsm/dom/us/addustoyouraddressbook.do?vgnextoid=46c001cc1e65b110VgnVCM100000defaad94RCRD From owner-freebsd-stable@FreeBSD.ORG Fri May 4 16:05:18 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 40A91106564A for ; Fri, 4 May 2012 16:05:18 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-qa0-f49.google.com (mail-qa0-f49.google.com [209.85.216.49]) by mx1.freebsd.org (Postfix) with ESMTP id EE42D8FC12 for ; Fri, 4 May 2012 16:05:17 +0000 (UTC) Received: by qabj40 with SMTP id j40so1483786qab.15 for ; Fri, 04 May 2012 09:05:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=sN9fvYodsX0O4b8fYD9HHMqI7Uz+yKHXj09PtlnxCEE=; b=bdFRJoijQ37SD/I7xtbXGmcwM67fCMlRPVW1cyTPVon6T1NEu3BWI5T6y5DGV5mwpm mQPBYF8XwjB+FLrjZChEPgGNO8vowN5zY/Knp2Uj+frUERQ2uBpS17IwKUi2q9emNor3 r9kIBEGEUT1PcZwHjuLIHMsE9HgRywPwvwjT6erScOWCGiSRxdbeVgbn4tU6RsD9LMB+ TqY8NvP+6gb1PRlWlUr94nTgLzQYEtcu9F7neob3yrkpX/OacqvXSQsKJvmxaJPVSLm9 9lyNPsKyjVO6v83ncyIcUN5U1sxSv4FnlBhhrG8fNG/N+UuTVqUpfrG/C2V8ORKncNj+ Tarw== MIME-Version: 1.0 Received: by 10.229.136.208 with SMTP id s16mr3196770qct.50.1336147517371; Fri, 04 May 2012 09:05:17 -0700 (PDT) Received: by 10.229.191.82 with HTTP; Fri, 4 May 2012 09:05:17 -0700 (PDT) Date: Fri, 4 May 2012 09:05:17 -0700 Message-ID: From: Freddie Cash To: FreeBSD Stable Content-Type: text/plain; charset=UTF-8 Subject: Make filesystem type configurable for periodic(8)? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 16:05:18 -0000 A few of the periodic(8) scripts in FreeBSD have constructs similar to the following to get which filesystems to scan for various things: MP=`mount -t ufs,zfs | awk '$0 !~ /no(suid|exec)/ { print $3 }'` For systems with large ZFS pools, and many ZFS filesystems, these periodic scripts can grind it to its knees, and then some. For backups servers where we don't really care about the ownership/permissions of files from the FreeBSD perspective, we really don't want the ZFS filesytems to be scanned; only the UFS ones for the FreeBSD OS install. To that end, I have to manually edit these files to remove the ",zfs": MP=`mount -t ufs | awk '$0 !~ /no(suid|exec)/ { print $3 }'` ^^^^^^^^ Would it be worthwhile to anyone else to make the filesystem type(s) to scan via the periodic(8) scripts a variable that's set by default in /etc/defaults/periodic.conf and that user's can override via /etc/periodic.conf? Or, am I the only one that's suffering here? :) If there's interesting in this, I can look into coming up with some patches. But wanted to check if anyone else would find it useful. -- Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@FreeBSD.ORG Fri May 4 16:09:01 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 47A0B106566C for ; Fri, 4 May 2012 16:09:01 +0000 (UTC) (envelope-from bryan@shatow.net) Received: from secure.xzibition.com (secure.xzibition.com [173.160.118.92]) by mx1.freebsd.org (Postfix) with ESMTP id E42018FC12 for ; Fri, 4 May 2012 16:09:00 +0000 (UTC) DomainKey-Signature: a=rsa-sha1; c=nofws; d=shatow.net; h=message-id :date:from:mime-version:to:cc:subject:references:in-reply-to :content-type:content-transfer-encoding; q=dns; s=sweb; b=j+z//p J6Ny7PkgojfYucFa+PPdQAibw3INg4HeVKbCfvnLXHKv6fu6CvuCZsh4cuEtgpVM wHoV5HG2QmA8daw3ZBiaskrBnT2Bt+nJGQk7SrDT3uZDTSAROj6OnttmRoqljv3t TJSgtzRl/xKjoohC8bahntDD9rVvwew+pnWes= DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=shatow.net; h=message-id :date:from:mime-version:to:cc:subject:references:in-reply-to :content-type:content-transfer-encoding; s=sweb; bh=IqDQqRYYIvvJ YOP2a9I8LH2dz5wV2f7KbSXfBOONdlU=; b=dvGobeEOSNNRDC1kPh2f2u1ll/he sCkq0SJzpWHQSnrWTnQZIRp47FwzreTLFDs0rLsb++YnPLobATvhEkVRE0TQemm3 prmV4oEIDRn+262rN7SrXwFESZCWOR7AqWjkj4rGZ/gPQRfuYNZ0hJ0WEUwFPWz4 17tP+QeBa8MRwYY= Received: (qmail 79730 invoked from network); 4 May 2012 11:08:58 -0500 Received: from unknown (HELO ?192.168.0.107?) (bryan@shatow.net@74.94.87.209) by sweb.xzibition.com with ESMTPA; 4 May 2012 11:08:58 -0500 Message-ID: <4FA3FF18.4000309@shatow.net> Date: Fri, 04 May 2012 11:08:56 -0500 From: Bryan Drewery User-Agent: Mozilla/5.0 (X11; Linux i686; rv:11.0) Gecko/20120329 Thunderbird/11.0.1 MIME-Version: 1.0 To: Freddie Cash References: In-Reply-To: X-Enigmail-Version: 1.4.1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: FreeBSD Stable Subject: Re: Make filesystem type configurable for periodic(8)? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 16:09:01 -0000 On 05/04/2012 11:05 AM, Freddie Cash wrote: > A few of the periodic(8) scripts in FreeBSD have constructs similar to > the following to get which filesystems to scan for various things: > MP=`mount -t ufs,zfs | awk '$0 !~ /no(suid|exec)/ { print $3 }'` > > For systems with large ZFS pools, and many ZFS filesystems, these > periodic scripts can grind it to its knees, and then some. For > backups servers where we don't really care about the > ownership/permissions of files from the FreeBSD perspective, we really > don't want the ZFS filesytems to be scanned; only the UFS ones for the > FreeBSD OS install. To that end, I have to manually edit these files > to remove the ",zfs": > MP=`mount -t ufs | awk '$0 !~ /no(suid|exec)/ { print $3 }'` > ^^^^^^^^ > Would it be worthwhile to anyone else to make the filesystem type(s) > to scan via the periodic(8) scripts a variable that's set by default > in /etc/defaults/periodic.conf and that user's can override via > /etc/periodic.conf? > > Or, am I the only one that's suffering here? :) > > If there's interesting in this, I can look into coming up with some > patches. But wanted to check if anyone else would find it useful. > I would find this useful. But further, I have a ZFS root pool as well as a ZFS backup pool. I don't want to exclude all of ZFS, just certain pools, or even certain datasets. Regards, Bryan Drewery From owner-freebsd-stable@FreeBSD.ORG Fri May 4 18:02:01 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 96CAB1065675 for ; Fri, 4 May 2012 18:02:01 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-pz0-f48.google.com (mail-pz0-f48.google.com [209.85.210.48]) by mx1.freebsd.org (Postfix) with ESMTP id 6663D8FC0C for ; Fri, 4 May 2012 18:02:01 +0000 (UTC) Received: by dadz8 with SMTP id z8so243366dad.7 for ; Fri, 04 May 2012 11:02:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=QC7hdX6WP3D9M1LtWeiTmIK0ya0rTA3Kf+laUnwwEPs=; b=i0Z+lGsI8b8Akj8h6QHcR+eMDTn+RvmfAago0A1bEYXkhlBpRclXyvcXDjTLfRgI3K ammsV/xpc6pCX+R8GItN1bVMcI7Bn79RWXXX2uzU2NdmKf8dpokexjsm89Khw2+N7yuL 7AWDVNG7s8Wmv6jDRT3Rsqfmq/jgYqFaD8aexYlqGwT33Zf4Tt8ACHw6kpQTYJCYLwH4 vMIpu4h1aE69fm19ZNnmlfVxkXGJ0BLe9i+O2Bx6sxh9nh+7zjqXbFGhNZvK1mLtafUB a/xUDuhuRxDmGRGj42/aqRx81WAV4zwUz3VenK21at6T22JoHBFOT1kxcDfnQRYlR6Rw pamg== MIME-Version: 1.0 Received: by 10.68.222.134 with SMTP id qm6mr1444528pbc.14.1336154521198; Fri, 04 May 2012 11:02:01 -0700 (PDT) Received: by 10.68.223.165 with HTTP; Fri, 4 May 2012 11:02:01 -0700 (PDT) In-Reply-To: <4FA3FF18.4000309@shatow.net> References: <4FA3FF18.4000309@shatow.net> Date: Fri, 4 May 2012 11:02:01 -0700 Message-ID: From: Freddie Cash To: Bryan Drewery Content-Type: multipart/mixed; boundary=047d7b2ed48f99e0f904bf39b7e9 Cc: FreeBSD Stable Subject: Re: Make filesystem type configurable for periodic(8)? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 18:02:01 -0000 --047d7b2ed48f99e0f904bf39b7e9 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Fri, May 4, 2012 at 9:08 AM, Bryan Drewery wrote: > On 05/04/2012 11:05 AM, Freddie Cash wrote: >> A few of the periodic(8) scripts in FreeBSD have constructs similar to >> the following to get which filesystems to scan for various things: >> =C2=A0 =C2=A0 MP=3D`mount -t ufs,zfs | awk '$0 !~ /no(suid|exec)/ { prin= t $3 }'` >> >> For systems with large ZFS pools, and many ZFS filesystems, these >> periodic scripts can grind it to its knees, and then some. =C2=A0For >> backups servers where we don't really care about the >> ownership/permissions of files from the FreeBSD perspective, we really >> don't want the ZFS filesytems to be scanned; only the UFS ones for the >> FreeBSD OS install. =C2=A0To that end, I have to manually edit these fil= es >> to remove the ",zfs": >> =C2=A0 =C2=A0 MP=3D`mount -t ufs | awk '$0 !~ /no(suid|exec)/ { print $3= }'` >> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 ^^^^^^^^ >> Would it be worthwhile to anyone else to make the filesystem type(s) >> to scan via the periodic(8) scripts a variable that's set by default >> in /etc/defaults/periodic.conf and that user's can override via >> /etc/periodic.conf? >> >> Or, am I the only one that's suffering here? =C2=A0:) >> >> If there's interesting in this, I can look into coming up with some >> patches. =C2=A0But wanted to check if anyone else would find it useful. >> > > I would find this useful. But further, I have a ZFS root pool as well as > a ZFS backup pool. I don't want to exclude all of ZFS, just certain > pools, or even certain datasets. Would you mind testing the attached patch? It adds four new variables for use in periodic.conf (defaults shown): daily_status_security_chksetuid_fs=3D"ufs,zfs" daily_status_security_chksetuid_fs_ignore=3D"" daily_status_security_neggrpperm_fs=3D"ufs,zfs" daily_status_security_neggrpperm_fs_ignore=3D"" The _fs variables take filesystem types, as would be passed to mount(8). These limit the entire search based on type, so an all or nothing approach. The _fs_ignore variables are space separated lists of mountpoints to skip. So you can leave zfs in the _fs list, and then list specific filesystems here that you do not want to be scanned. I don't claim to be any great shell script writer, but this appears to do the job. Any suggestions, pointers, comments, etc welcomed. :) --=20 Freddie Cash fjwcash@gmail.com --047d7b2ed48f99e0f904bf39b7e9 Content-Type: application/octet-stream; name="periodic-fs-type.patch" Content-Disposition: attachment; filename="periodic-fs-type.patch" Content-Transfer-Encoding: base64 X-Attachment-Id: f_h1tjroap0 LS0tIGRlZmF1bHRzL3BlcmlvZGljLmNvbmYub3JpZwkyMDEyLTA1LTA0IDEwOjQ0OjEzLjAwMDAw MDAwMCAtMDcwMAorKysgZGVmYXVsdHMvcGVyaW9kaWMuY29uZgkyMDEyLTA1LTA0IDA5OjM4OjE4 LjAwMDAwMDAwMCAtMDcwMApAQCAtMTcwLDkgKzE3MCwxMyBAQAogCiAjIDEwMC5jaGtzZXR1aWQK IGRhaWx5X3N0YXR1c19zZWN1cml0eV9jaGtzZXR1aWRfZW5hYmxlPSJZRVMiCitkYWlseV9zdGF0 dXNfc2VjdXJpdHlfY2hrc2V0dWlkX2ZzPSJ1ZnMsemZzIgkJIyBGaWxlc3lzdGVtIHR5cGVzIHRv IHNjYW4KK2RhaWx5X3N0YXR1c19zZWN1cml0eV9jaGtzZXR1aWRfZnNfaWdub3JlPSIiCQkjIExp c3Qgb2YgZmlsZXN5c3RlbXMgdG8gc2tpcAogCiAjIDExMC5uZWdncnBwZXJtCiBkYWlseV9zdGF0 dXNfc2VjdXJpdHlfbmVnZ3JwcGVybV9lbmFibGU9IllFUyIKK2RhaWx5X3N0YXR1c19zZWN1cml0 eV9uZWdncnBwZXJtX2ZzPSJ1ZnMsemZzIgkJIyBGaWxlc3lzdGVtIHR5cGVzIHRvIHNjYW4KK2Rh aWx5X3N0YXR1c19zZWN1cml0eV9uZWdncnBwZXJtX2ZzPSIiCQkJIyBMaXN0IG9mIGZpbGVzeXN0 ZW1zIHRvIHNraXAKIAogIyAyMDAuY2hrbW91bnRzCiBkYWlseV9zdGF0dXNfc2VjdXJpdHlfY2hr bW91bnRzX2VuYWJsZT0iWUVTIgoKLS0tIHBlcmlvZGljL3NlY3VyaXR5LzEwMC5jaGtzZXR1aWQu b3JpZwkyMDEyLTA1LTA0IDEwOjQ2OjA1LjAwMDAwMDAwMCAtMDcwMAorKysgcGVyaW9kaWMvc2Vj dXJpdHkvMTAwLmNoa3NldHVpZAkyMDEyLTA1LTA0IDEwOjQ2OjQ3LjAwMDAwMDAwMCAtMDcwMApA QCAtNDMsNyArNDMsMTIgQEAKICAgICBbWXldW0VlXVtTc10pCiAJZWNobyAiIgogCWVjaG8gJ0No ZWNraW5nIHNldHVpZCBmaWxlcyBhbmQgZGV2aWNlczonCi0JTVA9YG1vdW50IC10IHVmcyx6ZnMg fCBhd2sgJyQwICF+IC9ubyhzdWlkfGV4ZWMpLyB7IHByaW50ICQzIH0nYAorCWlmIFsgLXogIiRk YWlseV9zdGF0dXNfc2VjdXJpdHlfY2hrc2V0dWlkX2ZzX2lnbm9yZSIgXTsgdGhlbgorCQlNUD1g bW91bnQgLXQgJGRhaWx5X3N0YXR1c19zZWN1cml0eV9jaGtzZXR1aWRfZnMgfCBhd2sgJyQwICF+ IC9ubyhzdWlkfGV4ZWMpLyB7IHByaW50ICQzIH0nYAorCWVsc2UKKwkJZGFpbHlfc3RhdHVzX3Nl Y3VyaXR5X2Noa3NldHVpZF9mc19pZ25vcmU9YCBlY2hvICRkYWlseV9zdGF0dXNfc2VjdXJpdHlf Y2hrc2V0dWlkX2ZzX2lnbm9yZSB8IHNlZCAncy9cIC9cfC9nJ2AKKwkJTVA9YG1vdW50IC10ICRk YWlseV9zdGF0dXNfc2VjdXJpdHlfY2hrc2V0dWlkX2ZzIHwgYXdrICckMCAhfiAvbm8oc3VpZHxl eGVjKS8geyBwcmludCAkMyB9J3wgZWdyZXAgLXZlICIkZGFpbHlfc3RhdHVzX3NlY3VyaXR5X2No a3NldHVpZF9mc19pZ25vcmUiYAorCWZpCiAJZmluZCAtc3ggJE1QIC9kZXYvbnVsbCAtdHlwZSBm IFwKIAkgICAgXCggLXBlcm0gLXUreCAtb3IgLXBlcm0gLWcreCAtb3IgLXBlcm0gLW8reCBcKSBc CiAJICAgIFwoIC1wZXJtIC11K3MgLW9yIC1wZXJtIC1nK3MgXCkgLWV4ZWMgbHMgLWxpVGQgXHtc fSBcKyB8CgotLS0gcGVyaW9kaWMvc2VjdXJpdHkvMTEwLm5lZ2dycHBlcm0ub3JpZwkyMDEyLTA1 LTA0IDEwOjU0OjIzLjAwMDAwMDAwMCAtMDcwMAorKysgcGVyaW9kaWMvc2VjdXJpdHkvMTEwLm5l Z2dycHBlcm0JMjAxMi0wNS0wNCAxMDo0ODoxNi4wMDAwMDAwMDAgLTA3MDAKQEAgLTQxLDYgKzQx LDEyIEBACiAgICAgW1l5XVtFZV1bU3NdKQogCWVjaG8gIiIKIAllY2hvICdDaGVja2luZyBuZWdh dGl2ZSBncm91cCBwZXJtaXNzaW9uczonCisJaWYgWyAteiAiJGRhaWx5X3N0YXR1c19zZWN1cml0 eV9uZWdncnBwZXJtX2ZzX2lnbm9yZSIgXTsgdGhlbgorCQlNUD1gbW91bnQgLXQgJGRhaWx5X3N0 YXR1c19zZWN1cml0eV9uZWdncnBwZXJtX2ZzIHwgYXdrICckMCAhfiAvbm8oc3VpZHxleGVjKS8g eyBwcmludCAkMyB9J2AKKwllbHNlCisJCWRhaWx5X3N0YXR1c19zZWN1cml0eV9uZWdncnBwZXJt X2ZzX2lnbm9yZT1gIGVjaG8gJGRhaWx5X3N0YXR1c19zZWN1cml0eV9uZWdncnBwZXJtX2ZzX2ln bm9yZSB8IHNlZCAncy9cIC9cfC9nJ2AKKwkJTVA9YG1vdW50IC10ICRkYWlseV9zdGF0dXNfc2Vj dXJpdHlfbmVnZ3JwcGVybV9mcyB8IGF3ayAnJDAgIX4gL25vKHN1aWR8ZXhlYykvIHsgcHJpbnQg JDMgfSd8IGVncmVwIC12ZSAiJGRhaWx5X3N0YXR1c19zZWN1cml0eV9uZWdncnBwZXJtX2ZzX2ln bm9yZSJgCisgICAgICAgIGZpCiAJTVA9YG1vdW50IC10IHVmcyx6ZnMgfCBhd2sgJyQwICF+IC9u byhzdWlkfGV4ZWMpLyB7IHByaW50ICQzIH0nYAogCW49JChmaW5kIC1zeCAkTVAgL2Rldi9udWxs IC10eXBlIGYgXAogCSAgICBcKCBcKCAhIC1wZXJtICswMTAgLWFuZCAtcGVybSArMDAxIFwpIC1v ciBcCg== --047d7b2ed48f99e0f904bf39b7e9-- From owner-freebsd-stable@FreeBSD.ORG Fri May 4 18:06:01 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 46142106566B for ; Fri, 4 May 2012 18:06:01 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from mail-pb0-f54.google.com (mail-pb0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id 181088FC12 for ; Fri, 4 May 2012 18:06:01 +0000 (UTC) Received: by pbbro2 with SMTP id ro2so4558053pbb.13 for ; Fri, 04 May 2012 11:06:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=FphS3rZsDKg2iQ5Tr8vRqLFJAV20VnvoMPVbNvPOH7M=; b=qEQE8AS2UiZ5V6oxFtANFeGW4SBfWFe8iXOoV3fYE5nzrxbDgySbCXf9xtzuJrDRbE 6hfGL00vW9f44j98g5iSx2pAxb0eG3UkQNIBw6iZpy79UiKSMv0991b94Hs3bW6ijhVj QcqeQ5PWAXg7BGKPE6kGIWCy3EiKS7VGeNuFwqx775QBYSP8G5YPhVBsBEieKhJ7oOJO GaY10312k60QME/3QkFxAbCGRQE7FLAV0/6fJGke86CDVdZJsB8qWVZOstHhdmjGnxCj iAHWyo0uWNBmBDnFn0h6I3MKhvP27yhp9JN/l6oVFKIbKLn6NNm10pXVX3hu1JC88fL9 S5VA== MIME-Version: 1.0 Received: by 10.68.217.40 with SMTP id ov8mr2890692pbc.35.1336154760822; Fri, 04 May 2012 11:06:00 -0700 (PDT) Received: by 10.68.223.165 with HTTP; Fri, 4 May 2012 11:06:00 -0700 (PDT) In-Reply-To: References: <4FA3FF18.4000309@shatow.net> Date: Fri, 4 May 2012 11:06:00 -0700 Message-ID: From: Freddie Cash To: Bryan Drewery Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD Stable Subject: Re: Make filesystem type configurable for periodic(8)? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 18:06:01 -0000 On Fri, May 4, 2012 at 11:02 AM, Freddie Cash wrote: > On Fri, May 4, 2012 at 9:08 AM, Bryan Drewery wrote: >> On 05/04/2012 11:05 AM, Freddie Cash wrote: >>> A few of the periodic(8) scripts in FreeBSD have constructs similar to >>> the following to get which filesystems to scan for various things: >>> =C2=A0 =C2=A0 MP=3D`mount -t ufs,zfs | awk '$0 !~ /no(suid|exec)/ { pri= nt $3 }'` >>> >>> For systems with large ZFS pools, and many ZFS filesystems, these >>> periodic scripts can grind it to its knees, and then some. =C2=A0For >>> backups servers where we don't really care about the >>> ownership/permissions of files from the FreeBSD perspective, we really >>> don't want the ZFS filesytems to be scanned; only the UFS ones for the >>> FreeBSD OS install. =C2=A0To that end, I have to manually edit these fi= les >>> to remove the ",zfs": >>> =C2=A0 =C2=A0 MP=3D`mount -t ufs | awk '$0 !~ /no(suid|exec)/ { print $= 3 }'` >>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 ^^^^^^^^ >>> Would it be worthwhile to anyone else to make the filesystem type(s) >>> to scan via the periodic(8) scripts a variable that's set by default >>> in /etc/defaults/periodic.conf and that user's can override via >>> /etc/periodic.conf? >>> >>> Or, am I the only one that's suffering here? =C2=A0:) >>> >>> If there's interesting in this, I can look into coming up with some >>> patches. =C2=A0But wanted to check if anyone else would find it useful. >>> >> >> I would find this useful. But further, I have a ZFS root pool as well as >> a ZFS backup pool. I don't want to exclude all of ZFS, just certain >> pools, or even certain datasets. > > Would you mind testing the attached patch? =C2=A0It adds four new variabl= es > for use in periodic.conf (defaults shown): > > daily_status_security_chksetuid_fs=3D"ufs,zfs" > daily_status_security_chksetuid_fs_ignore=3D"" > daily_status_security_neggrpperm_fs=3D"ufs,zfs" > daily_status_security_neggrpperm_fs_ignore=3D"" > > The _fs variables take filesystem types, as would be passed to > mount(8). =C2=A0These limit the entire search based on type, so an all or > nothing approach. > > The _fs_ignore variables are space separated lists of mountpoints to > skip. =C2=A0So you can leave zfs in the _fs list, and then list specific > filesystems here that you do not want to be scanned. > > I don't claim to be any great shell script writer, but this appears to > do the job. =C2=A0Any suggestions, pointers, comments, etc welcomed. =C2= =A0:) Guess I should mention how to use the patch. :) cd /etc patch -p0 < /path/to/periodic-fs-type.patch --=20 Freddie Cash fjwcash@gmail.com From owner-freebsd-stable@FreeBSD.ORG Fri May 4 19:44:10 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5C3BA1065670 for ; Fri, 4 May 2012 19:44:10 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from smtp-int-m.obspm.fr (smtp-int-m.obspm.fr [145.238.187.15]) by mx1.freebsd.org (Postfix) with ESMTP id E545A8FC1B for ; Fri, 4 May 2012 19:44:09 +0000 (UTC) Received: from pcjas.obspm.fr (pcjas.obspm.fr [145.238.184.233]) by smtp-int-m.obspm.fr (8.14.3/8.14.3/SIO Observatoire de Paris - 07/2009) with ESMTP id q44Ji7gj014508 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT) for ; Fri, 4 May 2012 21:44:08 +0200 Date: Fri, 4 May 2012 21:44:07 +0200 From: Albert Shih To: freebsd-stable@freebsd.org Message-ID: <20120504194407.GA13111@pcjas.obspm.fr> References: <20120427203013.GB60961@pcjas.obspm.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20120427203013.GB60961@pcjas.obspm.fr> User-Agent: Mutt/1.5.21 (2010-09-15) X-Miltered: at smtp-int-m.obspm.fr with ID 4FA43187.000 by Joe's j-chkmail (http : // j-chkmail dot ensmp dot fr)! X-j-chkmail-Enveloppe: 4FA43187.000/145.238.184.233/pcjas.obspm.fr/pcjas.obspm.fr/ Subject: Re: High load event idl. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 19:44:10 -0000 Le 27/04/2012 ? 22:30:13+0200, Albert Shih a écrit > Hi all > > I'm running 9-stable on all my computer. (csup yesterday). > > On my desktop everything is fine. But I've two laptop, (both are Dell). On > both latptop I've problem about the load, event when I do nothing I got a load between 0.5-1. > > Here the result of a «top» on the laptop : > > last pid: 2434; load averages: 0.63, 0.67, 0.59 up 0+00:23:59 22:25:29 > 57 processes: 3 running, 54 sleeping > CPU: 2.7% user, 0.0% nice, 3.7% system, 1.4% interrupt, 92.2% idle > Mem: 89M Active, 92M Inact, 198M Wired, 13M Cache, 100M Buf, 3529M Free > Swap: 4096M Total, 4096M Free > > Here on the desktop : > > last pid: 61010; load averages: 0.00, 0.00, 0.00 up 2+11:02:42 22:29:08 > 126 processes: 1 running, 125 sleeping > CPU: % user, % nice, % system, % interrupt, % idle > Mem: 803M Active, 2874M Inact, 1901M Wired, 112M Cache, 620M Buf, 202M Free > Swap: 6144M Total, 36M Used, 6107M Free > > On attachment the dmesg. > > Any idea ? > Any news about this problem ? I make a buildworld/kernel yesterday and nothing change. Regards. JAS -- Albert SHIH DIO bâtiment 15 Observatoire de Paris 5 Place Jules Janssen 92195 Meudon Cedex Téléphone : 01 45 07 76 26/06 86 69 95 71 xmpp: jas@obspm.fr Heure local/Local time: ven 4 mai 2012 21:43:25 CEST From owner-freebsd-stable@FreeBSD.ORG Fri May 4 21:25:34 2012 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E7C571065678 for ; Fri, 4 May 2012 21:25:34 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 3CDD48FC14 for ; Fri, 4 May 2012 21:25:34 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id AAA13156; Sat, 05 May 2012 00:25:10 +0300 (EEST) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1SQPzy-0006GW-D9; Sat, 05 May 2012 00:25:10 +0300 Message-ID: <4FA44933.4040902@FreeBSD.org> Date: Sat, 05 May 2012 00:25:07 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:12.0) Gecko/20120425 Thunderbird/12.0 MIME-Version: 1.0 To: Bryan Drewery , Freddie Cash References: <4FA3FF18.4000309@shatow.net> In-Reply-To: <4FA3FF18.4000309@shatow.net> X-Enigmail-Version: 1.4 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: FreeBSD Stable Subject: Re: Make filesystem type configurable for periodic(8)? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 21:25:35 -0000 on 04/05/2012 19:08 Bryan Drewery said the following: > On 05/04/2012 11:05 AM, Freddie Cash wrote: >> A few of the periodic(8) scripts in FreeBSD have constructs similar to >> the following to get which filesystems to scan for various things: >> MP=`mount -t ufs,zfs | awk '$0 !~ /no(suid|exec)/ { print $3 }'` >> >> For systems with large ZFS pools, and many ZFS filesystems, these >> periodic scripts can grind it to its knees, and then some. For >> backups servers where we don't really care about the >> ownership/permissions of files from the FreeBSD perspective, we really >> don't want the ZFS filesytems to be scanned; only the UFS ones for the >> FreeBSD OS install. To that end, I have to manually edit these files >> to remove the ",zfs": >> MP=`mount -t ufs | awk '$0 !~ /no(suid|exec)/ { print $3 }'` >> ^^^^^^^^ >> Would it be worthwhile to anyone else to make the filesystem type(s) >> to scan via the periodic(8) scripts a variable that's set by default >> in /etc/defaults/periodic.conf and that user's can override via >> /etc/periodic.conf? >> >> Or, am I the only one that's suffering here? :) >> >> If there's interesting in this, I can look into coming up with some >> patches. But wanted to check if anyone else would find it useful. >> > > I would find this useful. But further, I have a ZFS root pool as well as > a ZFS backup pool. I don't want to exclude all of ZFS, just certain > pools, or even certain datasets. Guys, why do you think that FS type is significant for these periodic security checks? Why ZFS (or some other FS) must be immune to a rogue suid script or some other permissions-based security threat? If you are sure that your ZFS datasets can not be a source of such an attack, then why not: 1) either disable the periodic security check altogether? 2) or mark the appropriate datasets as noexec or nosuid to ensure your belief? -- Andriy Gapon From owner-freebsd-stable@FreeBSD.ORG Fri May 4 22:15:08 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 976941065678 for ; Fri, 4 May 2012 22:15:08 +0000 (UTC) (envelope-from efraindector@motumweb.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 4BB9B8FC22 for ; Fri, 4 May 2012 22:15:08 +0000 (UTC) Received: by obcni5 with SMTP id ni5so5835496obc.13 for ; Fri, 04 May 2012 15:15:07 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=message-id:from:to:references:in-reply-to:subject:date:organization :mime-version:content-type:content-transfer-encoding:x-priority :x-msmail-priority:importance:x-mailer:x-mimeole:x-gm-message-state; bh=XHNaO+gXPGkW2RQX21ZW6SVPUZKe+ZQyRFo6MOuACsA=; b=VoNZkCgll0oX1mndtkoNNhTSiwnaF7miC7GMRnmosjwJFLvPTmT1r3HsqsExvNXRZC d8heN6/cp0GaQZRpiSZO0d+V4lVyF/mq94jeccdlu9eIEx20ftdAuCwb1HjGy6syK/gX 2T7+S521YfEV9f9r3dnhA/xVQUYfnYLmpPg+GHN51AMRzrSDq7bbk9ozs2uNuOs9ew2a cepBJpvtsN86sLDDedLugK+wE1OB6jh/2raS7k+uIJo3QpFJ9B+mZOH9T57JCarEqVa5 PxFkoX3Akoh+A3+QQCNCWW/WDlk8QKWiN5KYZ98nLlXKU17f7C4a1uvx1+1BYakRSsSd kyyw== Received: by 10.182.187.42 with SMTP id fp10mr1181170obc.30.1336169707586; Fri, 04 May 2012 15:15:07 -0700 (PDT) Received: from CMOTUM25PC ([189.130.119.176]) by mx.google.com with ESMTPS id v5sm10346882obl.11.2012.05.04.15.15.01 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 04 May 2012 15:15:06 -0700 (PDT) Message-ID: From: =?UTF-8?Q?Efra=C3=ADn_D=C3=A9ctor?= To: References: <20120504050505.GA3940@DataIX.net> <20120504050746.GB3940@DataIX.net> <714B9C65D2454FBFB6677D6AAA74A8AC@CMOTUM25PC> In-Reply-To: <714B9C65D2454FBFB6677D6AAA74A8AC@CMOTUM25PC> Date: Fri, 4 May 2012 17:14:50 -0500 Organization: =?UTF-8?Q?HESA_T=C3=A9cnica?= MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="UTF-8"; reply-type=response Content-Transfer-Encoding: 8bit X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 15.4.3555.308 X-MimeOLE: Produced By Microsoft MimeOLE V15.4.3555.308 X-Gm-Message-State: ALoCoQkxpOjyvVK1VsUwa9Gpxekl3O7j/V3At2PR6FSoWFXNYM26CJXID2vEY2eD8m2ek+OYOXpL Subject: Re: User root can't get email X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2012 22:15:08 -0000 Hello. Silly me didn't tought about doing a service sendmail onerestart before sending this email. Executing that command solved my problem. Thank you. -----Mensaje original----- From: Efraín Déctor Sent: Friday, May 04, 2012 5:13 PM To: Jason Hellenthal Subject: Re: User root can't get email Hello. Silly me didn't tought about doing a service sendmail onerestart before sending this email. Executing that command solved my problem. Thank you. -----Mensaje original----- From: Jason Hellenthal Sent: Friday, May 04, 2012 12:07 AM To: Efraín Déctor Cc: freebsd-stable@freebsd.org Subject: Re: User root can't get email And possibly /etc/mtree/BSD.sendmail.dist On Fri, May 04, 2012 at 01:05:05AM -0400, Jason Hellenthal wrote: > > > On Thu, May 03, 2012 at 06:02:35PM -0500, Efraín Déctor wrote: > > Hello. > > > > I have a FreeBSD Server 8.2, the past few days I’ve noticed that the > > user root was not recieving email. I ran a test simply by using: > > > > mail root > > > > Then in /var/log/messsages I got this message: > > > > May 3 22:47:56 edh sendmail[74022]: q3RFM513074022: SYSERR(root): > > Cannot reopen ./dfq3RFM513074022: No such file or directory > > May 3 22:47:56 edh sendmail[74022]: q3RFM514074022: SYSERR(root): > > putbody: Cannot open ./dfq3RFM513074022 for MAILER-DAEMON from root: No > > such file or directory > > > > Im not using this server as a email server, but it is very important to > > me because I have some scripts running by cron that send the output by > > email to the user that is running them, in this case root. > > > > If you have recently been working on upgrading your system in any way I > would check the perms on all the directories in /var and possibly other > systems as can be advised in a upgrade procedure within the handbook. > > You may also attempt the following which may fix it but it comes with a > disclaimer and you should know how to fix it if it breaks. > > mtree -deU -f /etc/mtree/BSD.var.dist > > > Before doing the above, I would seriously ask myself... What did I do in > those last few days or week or so... and at least attempt to backtrack > to a conclusive result. > > > Good luck. > > -- > > - (2^(N-1)) -- - (2^(N-1)) From owner-freebsd-stable@FreeBSD.ORG Sat May 5 14:19:26 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 85DAE1065670 for ; Sat, 5 May 2012 14:19:26 +0000 (UTC) (envelope-from fastearning@gmail.com) Received: from p3smtphosting03-01.prod.phx3.secureserver.net (p3smtphosting03-01.prod.phx3.secureserver.net [208.109.80.73]) by mx1.freebsd.org (Postfix) with SMTP id 5642A8FC15 for ; Sat, 5 May 2012 14:19:26 +0000 (UTC) Received: (qmail 661 invoked from network); 5 May 2012 14:19:26 -0000 Received: from p3swh195.shr.phx3.secureserver.net (HELO p3swh195.gdhosting.gdg) ([72.167.131.134]) (envelope-sender ) by p3smtphosting03-01.prod.phx3.secureserver.net (qmail-ldap-1.03) with SMTP for ; 5 May 2012 14:19:26 -0000 Received: from mail pickup service by p3swh195.gdhosting.gdg with Microsoft SMTPSVC; Sat, 5 May 2012 07:19:25 -0700 From: To: Date: Sat, 5 May 2012 07:19:25 -0700 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.3790.4913 Message-ID: X-OriginalArrivalTime: 05 May 2012 14:19:25.0850 (UTC) FILETIME=[134287A0:01CD2ACA] Subject: GetTicketsDirect-Tell a Friend X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 May 2012 14:19:26 -0000 A Message for you from John Douglas: Congratulations! Friend, Get Your Waiting $630 Commissions Now!!!! Let me tell you my success story A Product A Day 100% instant Payment and the success it has given to the few individuals that I have shared it with so far. You just referred a Paying Members. $630 has been added to your Referral Earnings Section. As Referral Commission. We make 4 payments to our affiliate called weekly Earnings! Details of the members you Referred: This are paid referrals,placed DIRECTLY under you.If you are a Powerline member, If You Take Action today You"ll Also get the Following $630 Commissions sales automatic will be yours w/in 1 Week after you finish sign up . http://instantpaysites.com/websites/productad/index.html?refer=cashnow ACTIVE MEMBER COUNTRY No.# of Sales Robert Peterson-------------United States----$45 --3--sales David Hamilton-----------United States-------$30 --2--sales Mandene Jonhson-------------United States----$15 --1--sales Rebecca William-----------------Germany------$60 --4--sales Annalie Hanford----------United States-------$30 --2--sales Jericho Jackson-----------United States------$75 --5--sales Katherine Levies----------United States------$15 --1--sales Stephanie Dinver----------------Germany------$30 --2--sales Justine Claptons ----------------Canada------$45 --3--sales Jennefer Petters--------------Australia------$90 --7--sales Rebicca Jackjone----------------Hungary------$45 --3--sales Kietth Robensons------------------Italy------$30 --2--sales Yuhans Limtuacco--------------Singapore------$15 --1--sales Adrian Paulbergs---------United Kingdom------$45 --3--sales Rechelle Parkker ----------------Alaska------$60 --4--sales Total ------------ $630 All paid members will placed DIRECTLY under you.If you are a Powerline member, Any sales this persons make will be passed up DIRECTLY to you,$630 will be yours. and you will be notified by email. http://instantpaysites.com/websites/productad/index.html?refer=cashnow Remember: You will be a regular member recieved $630 every week as Affiliate Commission, as long as he/she stays with us. So, it's your responsibility to make sure they remain a member for a Long time. IMPORTANT: Order NOW or Before May-07-2012 Weekly Cycle is the Cut-Off date!To lock in your Position! For Only $15 (Lifetime Membership) to secure your $630 Commission. ATTENTION: This Position is Limited Only and we have 3 remaining Copies left Hurry Grab it Now!And If You are interested to join early.you become a regular member received $630 Partime Commissions every Month. You Get-Paid US $630 USD direct to your PAYPAL Account this May-12-2012. and you will be notified by email. http://instantpaysites.com/websites/productad/index.html?refer=cashnow Invited You, John Douglas U.K. Click on the link(s) above for more details. From owner-freebsd-stable@FreeBSD.ORG Sat May 5 19:50:36 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5C3C5106564A for ; Sat, 5 May 2012 19:50:36 +0000 (UTC) (envelope-from COGOYOO@HOTMAIL.COM) Received: from li214-161.members.linode.com (unknown [IPv6:2600:3c00::f03c:91ff:fedf:ba8c]) by mx1.freebsd.org (Postfix) with ESMTP id 038B98FC0C for ; Sat, 5 May 2012 19:50:35 +0000 (UTC) Received: from li214-161.members.linode.com (localhost [127.0.0.1]) by li214-161.members.linode.com (8.14.4/8.14.4) with ESMTP id q45JobUL018913 for ; Sun, 6 May 2012 03:50:37 +0800 Received: (from root@localhost) by li214-161.members.linode.com (8.14.4/8.14.4/Submit) id q45Jobww018912; Sun, 6 May 2012 03:50:37 +0800 To: freebsd-stable@freebsd.org X-PHP-Originating-Script: 0:email.php Message-ID: Date: Sun, 06 May 2012 01:46:08 +0800 From: "ECPSS" MIME-Version: 1.0 X-Mailer-LID: 4 X-Mailer-RecptId: 40570 X-Mailer-SID: 6 X-Mailer-Sent-By: 1 Content-Type: text/plain; format=flowed; charset="UTF-8" Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: =?utf-8?b?ZWNwc3Ms5peg5Lqn5ZOB6ZmQ5Yi277yM6auY5oiQ5Yqf546H77yM?= =?utf-8?b?5LiK5rW3RUNQU1M=?= X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: COGOYOO@HOTMAIL.COM List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 May 2012 19:50:36 -0000 你邮件客户ä¸èƒ½é˜…读此邮件. 在线预览,请到这里: http://demo.email001.com/display.php?M=40570&C=90d2feaf3a4b52c4ebb253116ce0de09&S=6&L=4&N=2 åœæ­¢æ”¶åˆ°è¿™äº›é‚®ä»¶:http://demo.email001.com/unsubscribe.php?M=40570&C=90d2feaf3a4b52c4ebb253116ce0de09&L=4&N=6 From owner-freebsd-stable@FreeBSD.ORG Sat May 5 23:50:58 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C8E52106564A for ; Sat, 5 May 2012 23:50:58 +0000 (UTC) (envelope-from elon@emmi.physik-pool.tu-berlin.de) Received: from mail.tu-berlin.de (mail.tu-berlin.de [130.149.7.33]) by mx1.freebsd.org (Postfix) with ESMTP id 6BFE08FC08 for ; Sat, 5 May 2012 23:50:58 +0000 (UTC) X-tubIT-Incoming-IP: 130.149.58.163 Received: from mail.physik-pool.tu-berlin.de ([130.149.58.163] helo=mail.physik.tu-berlin.de) by mail.tu-berlin.de (exim-4.75/mailfrontend-4) with esmtp for id 1SQoka-00007U-Bw; Sun, 06 May 2012 01:50:57 +0200 Received: from emmi.physik-pool.tu-berlin.de (emmi.physik-pool.tu-berlin.de [130.149.58.146]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.physik.tu-berlin.de (Postfix) with ESMTPS id D504B11402 for ; Sun, 6 May 2012 01:50:49 +0200 (CEST) Received: (from elon@localhost) by emmi.physik-pool.tu-berlin.de (8.14.5/8.14.5/Submit) id q45NonQS029330 for freebsd-stable@freebsd.org; Sun, 6 May 2012 01:50:49 +0200 (CEST) (envelope-from elon) Date: Sun, 6 May 2012 01:50:49 +0200 From: Leon =?iso-8859-15?Q?Me=DFner?= To: freebsd-stable@freebsd.org Message-ID: <20120505235049.GH20333@emmi.physik-pool.tu-berlin.de> Mail-Followup-To: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) Subject: Probable drive failure not recognized by ZFS on mps(4) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 May 2012 23:50:58 -0000 Hi, running 9-STABLE from 2 weeks ago i'm having a problem where ZFS is not recognizing a failing SATA disk on an LSI SAS2x36 expander. The gnop(8) device in the zpool status output is for testing purpose. ZFS fails those alright. What could i do to check if the SCSI sense code actually makes sense for this drive ? Thanks, Leon uname : FreeBSD fred.physik-pool.tu-berlin.de 9.0-STABLE FreeBSD 9.0-STABLE #0: Wed Apr 18 20:05:08 CEST 2012 master@fred.physik-pool.tu-berlin.de:/usr/obj/usr/src/sys/GENERIC amd64 /var/log/messages (a lot of this and similar): May 6 01:32:53 fred kernel: (da17:mps0:0:26:0): READ(6). CDB: 8 e ab a3 1 0 length 512 SMID 809 terminated ioc 804b scsi 0 state 0 xfer 0 May 6 01:32:53 fred kernel: (da17:mps0:0:26:0): READ(6). CDB: 8 e ab a4 1 0 length 512 SMID 633 terminated ioc 804b scsi 0 state 0 xfer 0 May 6 01:32:53 fred kernel: (da17:mps0:0:26:0): READ(6). CDB: 8 e af 31 1 0 length 512 SMID 253 terminated ioc 804b scsi 0 state 0 xfer 0 May 6 01:32:53 fred kernel: (da17:mps0:0:26:0): READ(10). CDB: 28 0 5 79 c2 a6 0 0 1 0 May 6 01:32:53 fred kernel: (da17:mps0:0:26:0): CAM status: SCSI Status Error May 6 01:32:53 fred kernel: (da17:mps0:0:26:0): SCSI status: Check Condition May 6 01:32:53 fred kernel: (da17:mps0:0:26:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) May 6 01:32:53 fred kernel: (da17:mps0:0:26:0): Info: 0x579c2a6 May 6 01:32:58 fred kernel: (da17:mps0:0:26:0): READ(6). CDB: 8 e ab ee 1 0 length 512 SMID 344 terminated ioc 804b scsi 0 state 0 xfer 0 May 6 01:32:58 fred kernel: (da17:mps0:0:26:0): READ(10). CDB: 28 0 3a 38 3c 10 0 0 10 0 length 8192 SMID 304 terminated ioc 804b scsi 0 state 0 xfer 0 May 6 01:32:58 fred kernel: (da17:mps0:0:26:0): READ(10). CDB: 28 0 3a 38 3a 10 0 0 10 0 length 8192 SMID 712 terminated ioc 804b scsi 0 state 0 xfer 0 May 6 01:32:58 fred kernel: (da17:mps0:0:26:0): READ(10). CDB: 28 0 5 79 c2 56 0 0 46 0 May 6 01:32:58 fred kernel: (da17:mps0:0:26:0): CAM status: SCSI Status Error May 6 01:32:58 fred kernel: (da17:mps0:0:26:0): SCSI status: Check Condition May 6 01:32:58 fred kernel: (da17:mps0:0:26:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) May 6 01:32:58 fred kernel: (da17:mps0:0:26:0): Info: 0x579c298 smartctl -a /dev/da17 (excerpt): Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x002f 163 163 051 Pre-fail Always - 929442 3 Spin_Up_Time 0x0027 238 238 021 Pre-fail Always - 1083 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 40 5 Reallocated_Sector_Ct 0x0033 174 174 140 Pre-fail Always - 207 7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0 9 Power_On_Hours 0x0032 095 095 000 Old_age Always - 4077 10 Spin_Retry_Count 0x0032 100 253 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 38 192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 33 193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 40 194 Temperature_Celsius 0x0022 118 104 000 Old_age Always - 29 196 Reallocated_Event_Count 0x0032 001 001 000 Old_age Always - 207 197 Current_Pending_Sector 0x0032 184 183 000 Old_age Always - 1342 198 Offline_Uncorrectable 0x0030 186 183 000 Old_age Offline - 1168 199 UDMA_CRC_Error_Count 0x0032 200 199 000 Old_age Always - 9 200 Multi_Zone_Error_Rate 0x0008 001 001 000 Old_age Offline - 397969 zpool status: # zpool status pool: POOL state: DEGRADED status: One or more devices is currently being resilvered. The pool will continue to function, possibly in a degraded state. action: Wait for the resilver to complete. scan: resilver in progress since Sat May 5 23:55:44 2012 606G scanned out of 3.22T at 104M/s, 7h23m to go 2.26G resilvered, 18.38% done config: NAME STATE READ WRITE CKSUM POOL DEGRADED 0 0 0 raidz2-0 ONLINE 0 0 0 gpt/port0-2035c2485 ONLINE 0 0 0 gpt/port2-0565e5416 ONLINE 0 0 0 gpt/port4-200162460 ONLINE 0 0 0 gpt/port6-2556b79f8 ONLINE 0 0 0 gpt/port8-2aac22cb4 ONLINE 0 0 0 gpt/port10-2aac226d2 ONLINE 0 0 0 gpt/port12-0ad6e26d8 ONLINE 0 0 0 gpt/port14-2b0024fed ONLINE 0 0 10 (resilvering) gpt/port16-2afc39a37 ONLINE 0 0 0 gpt/port18-2556b7770 ONLINE 0 0 0 raidz2-1 DEGRADED 0 0 0 gpt/port1-2acfb0988 ONLINE 0 0 0 gpt/port3-202b5e684 ONLINE 0 0 0 gpt/port5-2025090a1 ONLINE 0 0 0 gpt/port7-2557e4c7a ONLINE 0 0 0 gpt/port9-2adcaf4a5 ONLINE 0 0 0 gpt/port11-2acfb6ab3 ONLINE 0 0 0 gpt/port13-2afc67e75 ONLINE 0 0 0 gpt/port15-25aaca07f ONLINE 0 0 0 gpt/port17-2ad60c96d ONLINE 0 0 40 (resilvering) replacing-9 OFFLINE 0 0 0 2488369476163776260 OFFLINE 0 0 0 was /dev/da19p1 da19p1.nop ONLINE 0 0 0 (resilvering) errors: No known data errors