From owner-freebsd-stable@freebsd.org Sun Dec 18 00:38:38 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1AB06C717A5 for ; Sun, 18 Dec 2016 00:38:38 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-wm0-x233.google.com (mail-wm0-x233.google.com [IPv6:2a00:1450:400c:c09::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B42371ABE for ; Sun, 18 Dec 2016 00:38:37 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by mail-wm0-x233.google.com with SMTP id c184so21462512wmd.0 for ; Sat, 17 Dec 2016 16:38:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=Xf5/Sr7xe0WNukw6pWRYy5/ncp6Do3/W8laVy+2j9dg=; b=G8lbZlksA9u3ezgaPcAUtmXlSV3+C+kOYkHQznBtIZRMdRkYm2FvMRSI+HF7jaERLU bQwDCOxVvC6di+1BovCbuuuFnUsvfnVShQ2AB1DZb8NczEVa4v9MLii8IbBIK5med8Be Rxs7OkL54RmmBuyI/EsPtoLucNsbaQprqCUMNuAkPt2OJT27cublIKflDkJMN6BvudKZ BktOdIu41D/f3GpygnzP5vW/rVa9eNcwtKPmGsRcYvkR/zcEVAjdY/46KITbDOg2Vh1V nJVjZOdT4EBeJm/jak7p/AbA0RwLDGBZyftFSxkXaATo3nR63lZyRTA75ZOp0wU7Sdxh 8XeA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=Xf5/Sr7xe0WNukw6pWRYy5/ncp6Do3/W8laVy+2j9dg=; b=h73o1VoM8fAK8JM9rR+j++3DSZ14oV+nPMSuDi07Q7AbhNCPVhTSGRxpGSROtczPHf egpgXaY9nAqt9J0y+I2p0TIucB//aG1Jq0/Ke+cIu6yTgCVKAkNzwRI11aSd0GE6gbWN vFvQ/Z/Xx7kj5IkDLgXsbiWTQ/zMHEouQuTtnX2j/qqCBHVKehcDu1c8QoSMckDXJrgA 3RnEjMhNsQ3UGVYjTKQkaZo5uBnFGjAn1OAZspB6Y1gS+O1W+jh2sqwOTmifuKhvY48s TSuzWndSbO0lIxNSib+MfDRxV9Ux0G9Ty5UPDZsuCrRyMspcHqsOo6VvMzQ3Q3Cw5xOp eBFA== X-Gm-Message-State: AIkVDXJ62ODBr26tlH35Xi/wG7BJebVsUTQ1n2HVL1DrysX6TIEJLBQw0prUTlcQdl3eO0+pLlaSCqLSGAPfeQ== X-Received: by 10.28.224.5 with SMTP id x5mr7954259wmg.70.1482021515870; Sat, 17 Dec 2016 16:38:35 -0800 (PST) MIME-Version: 1.0 Received: by 10.80.169.195 with HTTP; Sat, 17 Dec 2016 16:38:35 -0800 (PST) In-Reply-To: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> References: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> From: Adam Vande More Date: Sat, 17 Dec 2016 18:38:35 -0600 Message-ID: Subject: Re: [ZFS] files in a weird situtation To: David Marec Cc: freebsd-stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 00:38:38 -0000 On Sat, Dec 17, 2016 at 3:01 PM, David Marec wrote: > [I had first posted onto the Forum about this issue] > > Two months ago, > > - next to a call to |`||delete-old-libs`| or `install world`, I don't > really know - > > my box that is following FreeBSD-11 Stable ran into a weird situation. > > A set of files, especially `/lib/libjail.so.1` are in both states > `existing` and `not existing`: > > I means: > > david:~>cp ~david/libjail.so.1 /lib > cp: /lib/libjail.so.1: File exists > > But: > > david:~>ls /lib/libjail.so.1 > ls: /lib/libjail.so.1: No such file or directory > david:~>find /lib -name "libjail.so.1" -print > /lib/libjail.so.1 > david:~>find /lib -name "libjail.so.1" -ls > find: /lib/libjail.so.1: No such file or directory > > With deeper investigation, the file is in fact mapped to an `inode`: > > root@dmarec:~ # ls -di /lib > 13 /lib > root@dmarec:~ # zdb -dddd zroot/ 13 | grep libjail.so.1 > libjail.so.1 = 10552574 (type: Regular File) > > Which fails with `zdb` on: > > root@dmarec:~ # zdb -dddd zroot/ 10552574 > Dataset zroot [ZPL], ID 21, cr_txg 1, 114G, 2570002 objects, rootbp > DVA[0]=<0:b97d6ea00:200> DVA[1]=<0:1c212b0400:200> [L0 DMU objset] > fletcher4 lz4 LE contiguous unique double size=800L/200P > birth=3852240L/3852240P fill=2570002 > cksum=17b78fb7e4:7c87a526a07:16251edfaae60:2ce0c5734ccf2f > > Object lvl iblk dblk dsize lsize %full type > zdb: dmu_bonus_hold(10552574) failed, errno 2 > > > `stat (2)` returns ENOENT when checking for the file: > david:~>truss stat -L /lib/libjail.so.1 > ... > stat("/lib/libjail.so.1",0x7fffffffe7e8) ERR#2 'No such > file or > directory' david:~>truss stat -L /lib/libjail.so.1 > > A pass with `zfs scrub` didn't help. > > Any clue is welcome. What's that `dmu_bonus_hold` stands for ? > I am unable to understand what your intent is here. If you wish to delete it, you can do: find . -inum 10552574 -exec rm {} \; -- Adam From owner-freebsd-stable@freebsd.org Sun Dec 18 00:39:25 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 33FB3C718BF for ; Sun, 18 Dec 2016 00:39:25 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-it0-x244.google.com (mail-it0-x244.google.com [IPv6:2607:f8b0:4001:c0b::244]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0980C1D4F for ; Sun, 18 Dec 2016 00:39:24 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-it0-x244.google.com with SMTP id 75so6757328ite.1 for ; Sat, 17 Dec 2016 16:39:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=ySXg3PYbDOrYXyQAY0iYbOFGogOiboi0uj3awoKxn0I=; b=A1jY7nHdz7yp2e+XOE7YWl+TuFyVikZbFyUz4SHhNbbJFbF+vQ7jVry5u80KuwlK+3 R3yLrNski0ZDemA1obvxgC5HJEQiLuYLSUABBV/zzzmTCPVZnMwuHH2yOZuYpkPQ3w92 zWiBFE4ae6d42WsngyMwe8hBRDf0pJ77P96OBU/EoqZe5neebCNS3B994yaNckzeF3TI 5lYS/n5kBC2YwQEU+C5oF3nfpcaHDzdI2oJOWNorXeIGZBnrG8GOs9XxJI5owoDodBVN 953sq8BSINc9mnkPRDn+zmMk4pzOjgVgsk5Xls3Q2ORLwIhQocFkPa89V8yddL5Yriai Gdew== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=ySXg3PYbDOrYXyQAY0iYbOFGogOiboi0uj3awoKxn0I=; b=lGymEBB1U6zWXmzbaNG+O6Bc5w3SB76S5sKD5GtAk055kPrPwrqBxuAYT6bMW36FQJ Gy1zC6iBFIn/gt2dj5oELxWOrR0f6hzrBENPsPJI4xoRK7sjfljLIoof7pVMkP2xmHx9 YHOMbxr0tjD0N3s0fjiEAqqy8hmWYPN3sTrn1aYItYl3QNwV0i5mmzqSMLmk70x4cAFl NRSNgRCZH813jL5qRSwkc8AIxcqLcvFpA1E3ehhfjgr8DnBlvYSZV+i+dr5daPbsutiw 0JLzQE7i2MuYt674fyN1M2PxRgb38AMcWoV8WWFyAY/acvt4mlaaFMMWwiJRH8h3ScJc LePA== X-Gm-Message-State: AKaTC02iXGsfjLM0T//aMfXoYrb/NJDBsIKquY8o8gDBSM/GBloH/EBtK9iAHdbvNdMG+ySo9r0pBf00e/9U9Q== X-Received: by 10.36.61.207 with SMTP id n198mr10660693itn.60.1482021564161; Sat, 17 Dec 2016 16:39:24 -0800 (PST) MIME-Version: 1.0 Sender: wlosh@bsdimp.com Received: by 10.79.22.135 with HTTP; Sat, 17 Dec 2016 16:39:23 -0800 (PST) X-Originating-IP: [216.9.110.9] In-Reply-To: <2720DE76-B524-4AEA-ACC0-1EBD8813547D@FreeBSD.org> References: <20161216173930.GD90401@zxy.spb.ru> <85F3F813-D821-439B-B700-DCE51C53E035@FreeBSD.org> <2720DE76-B524-4AEA-ACC0-1EBD8813547D@FreeBSD.org> From: Warner Losh Date: Sat, 17 Dec 2016 16:39:23 -0800 X-Google-Sender-Auth: VYDYVjPaqgwDCKIZ4_pDM58KTRA Message-ID: Subject: Re: Upgrading boot from GPT(BIOS) to GPT(UEFI) To: Dimitry Andric Cc: Antony Uspensky , =?UTF-8?Q?Fernando_Herrero_Carr=C3=B3n?= , Eric van Gyzen , freebsd-stable , Slawa Olhovchenkov Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 00:39:25 -0000 On Sat, Dec 17, 2016 at 6:38 AM, Dimitry Andric wrote: > On 16 Dec 2016, at 23:56, Warner Losh wrote: >> >> On Fri, Dec 16, 2016 at 11:00 AM, Dimitry Andric wrote: > ... >>> Yes, this is almost exactly what I have done on a machine that was >>> originally installed with gptzfsboot on the first partition, which was >>> 512K. Since all the partitions on this SSD were aligned to 1M, I >>> reduced the size of the first partition to 224K, freeing up a hole of >>> exactly 800K for an EFI partition: > ... >> You likely want to carve out more like 50MB instead of 800k for UEFI >> partition. 800k is the minimum, but it also precludes many things you >> may need to do with UEFI applications down the line. > > Well, this is the default boot1.efifat size. If you think 50MB is more > reasonable, the boot1.efifat size should have a corresponding size. We shouldn't have a boot1.efifat at all. We should make the fat based on what the size of the partition is. boot1.efifat is an ugly hack to make the installers happy when we should have fixed the installers. The standard suggests an even larger 200MB. On most modern drives, the delta this usage is tiny, though on SD card-based systems 200MB takes up too large a percentage. > That said, as long as there are almost no such UEFI applications, I'm > not bothering. Besides, even if there were, I don't have any interest > in the UEFI "ecosphere" as-is. I see it as an ugly-but-necessary > pre-bootloader environment only. At work we get programs to run from time to time that upgrade BIOS that's in different cards in our system, or to dump diagnostics. It's helpful to have the space space when you need it, because when you need it, you really need it. It's also used to deploy "capsules" that have the upgrades for the BIOS (there's a standard now, but we don't implement it all yet). There are secure boot things you need space for as well. If you judge from today's, barely enough to boot a single partition w/o the other features of our traditional pre-/boot/loader environment, I can see how you might think there's nothing but 'waste' here. However, as we flesh out things, I think we'd be doing our users a disservice from doing anything less than ~50MB by default. Warner From owner-freebsd-stable@freebsd.org Sun Dec 18 05:11:17 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 44B46C8674D for ; Sun, 18 Dec 2016 05:11:17 +0000 (UTC) (envelope-from wblock@wonkity.com) Received: from wonkity.com (wonkity.com [67.158.26.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "wonkity.com", Issuer "wonkity.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E67881455; Sun, 18 Dec 2016 05:11:16 +0000 (UTC) (envelope-from wblock@wonkity.com) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.15.2/8.15.2) with ESMTPS id uBI5B97l086689 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 17 Dec 2016 22:11:09 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.15.2/8.15.2/Submit) with ESMTP id uBI5B9uY086686; Sat, 17 Dec 2016 22:11:09 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Sat, 17 Dec 2016 22:11:09 -0700 (MST) From: Warren Block To: Eric van Gyzen cc: =?ISO-8859-15?Q?Fernando_Herrero_Carr=F3n?= , freebsd-stable Subject: Re: Upgrading boot from GPT(BIOS) to GPT(UEFI) In-Reply-To: <71c128ef-8ad0-3cd8-9c34-8fc349d61447@FreeBSD.org> Message-ID: References: <71c128ef-8ad0-3cd8-9c34-8fc349d61447@FreeBSD.org> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.1 (wonkity.com [127.0.0.1]); Sat, 17 Dec 2016 22:11:09 -0700 (MST) Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8BIT X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 05:11:17 -0000 On Fri, 16 Dec 2016, Eric van Gyzen wrote: > On 12/16/2016 11:08, Fernando Herrero Carrón wrote: >> Hi everyone, >> >> A few months ago I got myself a new box and I have been happily running >> FreeBSD on it ever since. I noticed that the boot was not as fast as I had >> expected and I've realized that, while my disk is GPT partitioned, the boot >> process is still BIOS based: >> >> % gpart show >> => 34 976773101 ada0 GPT (466G) >> 34 6 - free - (3.0K) >> 40 1024 1 freebsd-boot (512K) >> 1064 984 - free - (492K) >> 2048 67108864 2 freebsd-swap (32G) >> 67110912 909662208 3 freebsd-zfs (434G) >> 976773120 15 - free - (7.5K) >> >> I am reading uefi(8) and it looks like FreeBSD 11 should be able to boot >> using UEFI straight into ZFS, so I am thinking of converting that >> freebsd-boot partition to an EFI partition, creating a FAT filesystem and >> copying /boot/boot.efi there. >> >> How good of an idea is that? Would it really be that simple or am I missing >> something? My only reason for wanting to boot with UEFI is faster boot, >> everything is working fine otherwise. > > I would recommend creating another partition for EFI instead of replacing your > freebsd-boot partition, in order to have a working fallback in case EFI boot > doesn't work. You would need to steal some space from your swap partition. Be aware that some newer Dells really don't like to have both and will refuse to boot in either mode with such a setup. From owner-freebsd-stable@freebsd.org Sun Dec 18 05:12:35 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DF69FC86834 for ; Sun, 18 Dec 2016 05:12:35 +0000 (UTC) (envelope-from wblock@wonkity.com) Received: from wonkity.com (wonkity.com [67.158.26.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "wonkity.com", Issuer "wonkity.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 960BF16A4; Sun, 18 Dec 2016 05:12:35 +0000 (UTC) (envelope-from wblock@wonkity.com) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.15.2/8.15.2) with ESMTPS id uBI5CXoB086956 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 17 Dec 2016 22:12:33 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.15.2/8.15.2/Submit) with ESMTP id uBI5CXvp086953; Sat, 17 Dec 2016 22:12:33 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Sat, 17 Dec 2016 22:12:33 -0700 (MST) From: Warren Block To: Eric van Gyzen cc: Slawa Olhovchenkov , =?ISO-8859-15?Q?Fernando_Herrero_Carr=F3n?= , freebsd-stable Subject: Re: Upgrading boot from GPT(BIOS) to GPT(UEFI) In-Reply-To: Message-ID: References: <20161216173930.GD90401@zxy.spb.ru> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.1 (wonkity.com [127.0.0.1]); Sat, 17 Dec 2016 22:12:33 -0700 (MST) Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8BIT X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 05:12:36 -0000 On Fri, 16 Dec 2016, Eric van Gyzen wrote: > On 12/16/2016 11:39, Slawa Olhovchenkov wrote: >> On Fri, Dec 16, 2016 at 06:08:34PM +0100, Fernando Herrero Carrón wrote: >> >>> Hi everyone, >>> >>> A few months ago I got myself a new box and I have been happily running >>> FreeBSD on it ever since. I noticed that the boot was not as fast as I had >>> expected and I've realized that, while my disk is GPT partitioned, the boot >>> process is still BIOS based: >>> >>> % gpart show >>> => 34 976773101 ada0 GPT (466G) >>> 34 6 - free - (3.0K) >>> 40 1024 1 freebsd-boot (512K) >>> 1064 984 - free - (492K) >>> 2048 67108864 2 freebsd-swap (32G) >>> 67110912 909662208 3 freebsd-zfs (434G) >>> 976773120 15 - free - (7.5K) >>> >>> I am reading uefi(8) and it looks like FreeBSD 11 should be able to boot >>> using UEFI straight into ZFS, so I am thinking of converting that >>> freebsd-boot partition to an EFI partition, creating a FAT filesystem and >>> copying /boot/boot.efi there. >>> >>> How good of an idea is that? Would it really be that simple or am I missing >>> something? My only reason for wanting to boot with UEFI is faster boot, >>> everything is working fine otherwise. >>> >>> Thanks in advance for your help. >> >> I am also interesting by this case. >> I think expand freebsd-boot to about 1M (size of /boot/boot1.efifat), >> dding /boot/boot1.efifat and set to type to 'efi' may be enough. I am >> never tried this. > > I expect that would work. It's slightly risky, though, since it doesn't let you > fall back to BIOS boot if EFI doesn't work. The fallback in that case would just be changing that partition back to freebsd-boot and rewriting the bootcode to it. From owner-freebsd-stable@freebsd.org Sun Dec 18 08:37:50 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 46C81C86CCB for ; Sun, 18 Dec 2016 08:37:50 +0000 (UTC) (envelope-from david.marec@davenulle.org) Received: from smtp.smtpout.orange.fr (smtp13.smtpout.orange.fr [80.12.242.135]) by mx1.freebsd.org (Postfix) with ESMTP id B72F61D04 for ; Sun, 18 Dec 2016 08:37:48 +0000 (UTC) (envelope-from david.marec@davenulle.org) Received: from dmarec.local ([109.214.21.61]) by mwinf5d76 with ME id MLW91u0021K4e8l03LW9dC; Sun, 18 Dec 2016 09:30:10 +0100 X-ME-Helo: dmarec.local X-ME-Date: Sun, 18 Dec 2016 09:30:10 +0100 X-ME-IP: 109.214.21.61 Subject: Re: [ZFS] files in a weird situtation References: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> To: freebsd-stable From: David Marec Message-ID: <61624b8e-9917-1129-113a-4398077005f7@davenulle.org> Date: Sun, 18 Dec 2016 09:30:08 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 08:37:50 -0000 On 18.12.2016 01:38, Adam Vande More wrote: > > I am unable to understand what your intent is here. If you wish to > delete it, you can do: > > find . -inum 10552574 -exec rm {} \; It fails on «No such file or directory». This file missing, not much works. I have installed a copy into `/usr/lib` to make the system run again. So, I can't install a new world: `install -C` fails in the same way. -- David Marec https://lapinbilly.eu From owner-freebsd-stable@freebsd.org Sun Dec 18 12:40:53 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3ED97C8514F for ; Sun, 18 Dec 2016 12:40:53 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 06886771 for ; Sun, 18 Dec 2016 12:40:52 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id C0DB328422; Sun, 18 Dec 2016 13:40:50 +0100 (CET) Received: from illbsd.quip.test (ip-86-49-16-209.net.upcbroadband.cz [86.49.16.209]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 16B7E28417; Sun, 18 Dec 2016 13:40:50 +0100 (CET) Subject: Re: [ZFS] files in a weird situtation To: David Marec , freebsd-stable References: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> <61624b8e-9917-1129-113a-4398077005f7@davenulle.org> From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: <585683D1.30701@quip.cz> Date: Sun, 18 Dec 2016 13:40:49 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:42.0) Gecko/20100101 Firefox/42.0 SeaMonkey/2.39 MIME-Version: 1.0 In-Reply-To: <61624b8e-9917-1129-113a-4398077005f7@davenulle.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 12:40:53 -0000 David Marec wrote on 2016/12/18 09:30: > On 18.12.2016 01:38, Adam Vande More wrote: >> >> I am unable to understand what your intent is here. If you wish to >> delete it, you can do: >> >> find . -inum 10552574 -exec rm {} \; > > It fails on «No such file or directory». > > This file missing, not much works. > I have installed a copy into `/usr/lib` to make the system run again. > > So, I can't install a new world: `install -C` fails in the same way. Then you can boot from recovery media like mfsBSD and unpack good known distribution from kernel.txz and base.txz (or do make installkernel && make installworld from NFS mounted /usr/src and /usr/obj). But if dataset in question is somehow corrupted maybe you need to make different dataset, extract all files, remove old dataset and rename this new dataset. If this is pool error than it will be better to scratch it and start again from backups. Miroslav Lachman From owner-freebsd-stable@freebsd.org Sun Dec 18 15:58:45 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0CCD6C878F9 for ; Sun, 18 Dec 2016 15:58:45 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from mail.in-addr.com (mail.in-addr.com [IPv6:2a01:4f8:191:61e8::2525:2525]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CE011155B for ; Sun, 18 Dec 2016 15:58:44 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from gjp by mail.in-addr.com with local (Exim 4.87 (FreeBSD)) (envelope-from ) id 1cIdrG-000P9p-9t; Sun, 18 Dec 2016 15:58:42 +0000 Date: Sun, 18 Dec 2016 15:58:42 +0000 From: Gary Palmer To: David Marec Cc: freebsd-stable Subject: Re: [ZFS] files in a weird situtation Message-ID: <20161218155842.GD7032@in-addr.com> References: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: gpalmer@freebsd.org X-SA-Exim-Scanned: No (on mail.in-addr.com); SAEximRunCond expanded to false X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 15:58:45 -0000 On Sat, Dec 17, 2016 at 11:25:41PM +0100, David Marec wrote: > On 17.12.2016 22:15, Brandon Allbery wrote: > > > > You have a directory entry pointing at a freed inode (or zfs equivalent). > > ZFS may have mapped this inode that points to nowhere. That makes sense. > > In this case, what should be the best solution to clean this up ? > > As I said, as far scrubbing the pool didn't show any error, it didn't > solve the issue. Have you tried deleting the /lib directory, or at least renaming it to /lib.bad (or something similar)? You'll need to boot from a rescue disc or boot single user with /rescue/sh as your shell, and then reinstall /lib from known good media (or "make installworld" in /usr/src) That may leave problems in the ZFS metadata still, but it should (in theory) let you continue using the system Gary P.S. I haven't tried any of this myself so be careful From owner-freebsd-stable@freebsd.org Sun Dec 18 17:16:54 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C0DFAC876BE for ; Sun, 18 Dec 2016 17:16:54 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-wj0-x236.google.com (mail-wj0-x236.google.com [IPv6:2a00:1450:400c:c01::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 55E9E1A4C for ; Sun, 18 Dec 2016 17:16:54 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by mail-wj0-x236.google.com with SMTP id xy5so130980593wjc.0 for ; Sun, 18 Dec 2016 09:16:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=z/IDUkuDtoQpuYfl1JJiy1IwbarAsF54RcnIEvGXuLU=; b=u7lid5d3X16fe3FxE0c6nfam52v9+6IMskpqDuJvEP4gsimuen329ptq9l91Bqk94a BDoVNda9od72UcwuorfpnejYY7V5sVL96phgSBWiKVub5PVgL1ZsR+Eju8us1qW35jkD UleCqDZi2i1tMRFTioXKepp+XawFEbLu4hEz7e/N0IkFn/x1yv1alGJJWtkq8w2Vf6PH 8I2SV7G+YQi+i65CbpiN94dXTkuJ05gbu+WwhsYrfxe5I5pbM7OgJENT3Nr95+d4ecLX /YqY25Zjn7AinZx0c6Ekk97ialqIQUx/8Z5XCNZ4qUCK/VeWUgVsSnb91xAleXEtGcsy Ib/Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=z/IDUkuDtoQpuYfl1JJiy1IwbarAsF54RcnIEvGXuLU=; b=jZPCR+umJEWF3/sQJ5PzTDUdpTE1Scl9K+QNrCTDwEvtdX7mEHLGsm5NlX9oqDfI5p sUnJTpYeEoFBaxQW3lHaXp1CDn5tf6xOig6I9NPZXUQNeaEJZxlonvzKrxwz7BHVuVQe l9O4BGRVv5g14AmhT7h2yUflBrsD8n35B98xEreprRO88Y3A83mgZ104JJ8Ck9Txaxuj wwR06kmneYgExAzw4VaWLs3wASmBszwP6S2aHWnEP1qNJSC1fX5Ml5j96ZkNQACm9O6q lgFZjUwpL+7KCJqb985NzSLaG3ZuicrfjqaABul5hufRdZxlA0Mrfjz2sQM/nCSUmvvm ED3A== X-Gm-Message-State: AIkVDXJKzWZJIXzpRb9ufNMT5mUv69aBoHEiFryfgIq5/UC5VDDKtIDJMEYspuAHTEkJLadcJrrefdKwT3lRBw== X-Received: by 10.194.156.233 with SMTP id wh9mr3834633wjb.187.1482081412708; Sun, 18 Dec 2016 09:16:52 -0800 (PST) MIME-Version: 1.0 Received: by 10.80.169.195 with HTTP; Sun, 18 Dec 2016 09:16:52 -0800 (PST) In-Reply-To: <61624b8e-9917-1129-113a-4398077005f7@davenulle.org> References: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> <61624b8e-9917-1129-113a-4398077005f7@davenulle.org> From: Adam Vande More Date: Sun, 18 Dec 2016 11:16:52 -0600 Message-ID: Subject: Re: [ZFS] files in a weird situtation To: David Marec Cc: freebsd-stable Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 17:16:54 -0000 On Sun, Dec 18, 2016 at 2:30 AM, David Marec wrote: > It fails on =C2=ABNo such file or directory=C2=BB. > I can't even replicate this portion of things. Running it under truss might provide more insight into what is happening. > > This file missing, not much works. > I have installed a copy into `/usr/lib` to make the system run again. > > So, I can't install a new world: `install -C` fails in the same way. I think you have larger issues than a single corrupt file. --=20 Adam From owner-freebsd-stable@freebsd.org Sun Dec 18 17:26:11 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B1B8BC87E2D; Sun, 18 Dec 2016 17:26:11 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2001:470:1f0f:3ad:223:7dff:fe9e:6e8a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "thebighonker.lerctr.org", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8EEE01922; Sun, 18 Dec 2016 17:26:11 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date: Content-Transfer-Encoding:Content-Type:MIME-Version:Sender:Reply-To: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=l5vpQlrXIw3y5BhzzoCy2Swh4ZjivJe/mZudForzEDY=; b=rJ3j6yyOrCghkyTFDuOy03RZ8o aOyaot6YhxESprdTDZ+ATjnpzqhfwOHERj9Cw+E7ABGzHFP153VnOqoBskDl18Uvc+Etn6Lff2rhm cvXhTBEOu2AUP8FApYUVsb4L5kpxud5B5ZtvAq7sJ2CTOEqT4fNzAEaNt0keRgEeUtdQ=; Received: from thebighonker.lerctr.org ([2001:470:1f0f:3ad:223:7dff:fe9e:6e8a]:56804 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.87 (FreeBSD)) (envelope-from ) id 1cIfDu-000N9w-2q; Sun, 18 Dec 2016 11:26:10 -0600 Received: from 2001:470:1f0f:42c:8cdf:d0cd:53b6:614d by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Sun, 18 Dec 2016 11:26:10 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Date: Sun, 18 Dec 2016 11:26:10 -0600 From: Larry Rosenman To: Adam Vande More Cc: David Marec , freebsd-stable , owner-freebsd-stable@freebsd.org Subject: Re: [ZFS] files in a weird situtation In-Reply-To: References: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> <61624b8e-9917-1129-113a-4398077005f7@davenulle.org> Message-ID: <526b29e7734f9224e35465086cd7c277@lerctr.org> X-Sender: ler@lerctr.org User-Agent: Roundcube Webmail/1.2.3 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 17:26:11 -0000 On 2016-12-18 11:16, Adam Vande More wrote: > On Sun, Dec 18, 2016 at 2:30 AM, David Marec > > wrote: > >> It fails on «No such file or directory». >> > > I can't even replicate this portion of things. Running it under truss > might provide more insight into what is happening. > > >> >> This file missing, not much works. >> I have installed a copy into `/usr/lib` to make the system run again. >> >> So, I can't install a new world: `install -C` fails in the same way. > > > I think you have larger issues than a single corrupt file. I had a similar weirdness back a few weeks ago. I basically rebuilt my boot filesystem with a full make installworld destdir= and killed off the old one once I had everything there. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 From owner-freebsd-stable@freebsd.org Sun Dec 18 18:09:09 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9FB5AC85ED3 for ; Sun, 18 Dec 2016 18:09:09 +0000 (UTC) (envelope-from steven@multiplay.co.uk) Received: from mail-it0-x22d.google.com (mail-it0-x22d.google.com [IPv6:2607:f8b0:4001:c0b::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6E95A1FA4 for ; Sun, 18 Dec 2016 18:09:09 +0000 (UTC) (envelope-from steven@multiplay.co.uk) Received: by mail-it0-x22d.google.com with SMTP id y23so64493830itc.0 for ; Sun, 18 Dec 2016 10:09:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=oJSSHuMKFuvxQhdOkzKl9jQxY8X1m/XvcQLLdR/JaRo=; b=FQ4iG8h2ju4efGNQEjZVjZOfeRax7TJhp6jwlnDrqZsQYZkM8Qoxq+iUvbkvrp85Vq Usm9Fpg2sNX+URJ5abuISCCEI3AKZOxFEkRwFXWK7hLXvgQOVvmflxP5td1tSaXu6TAo Gy4YdtShBJ4hxD2wEsXnrLVAP8q+CVELhzBDxgTiefhsJ4u9ZXPv+CBmFuP2GE0PLuco TaptTTBVeFGKhO+Xfkh1wYbl5LA1a2SnJRVBiyGxd50YcOKmL+RXjMgewvf8pW240dYZ zt9QwstxGpkxWxoMClyFosQ45CKm06CtuZpYmNK8w9wb9qYARRmnJlm7a4JSP9b2HrLD /zzg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=oJSSHuMKFuvxQhdOkzKl9jQxY8X1m/XvcQLLdR/JaRo=; b=WdUoCyW3Rcma3/AZNJLiM7E2hLFM/+RJrNSZ0uRp4ISO11qh49XNdTVyPUMGgT+kFn YnNnYj0yOa8JkEEuRzA3UE2D4jL/3Z3bAPZhgjDz9ykobpVdrLhNEgT+jHZLE6rktKKs yhyjjvxeITQ52CAM9ev1h75cRhy0Oxc7hx4nNXTgkzxsw6tgrpf7oHzZPfYOQeXek20B dLtETrXVRm8gTpaPJRKtcoA1JbLPu/OdEfRkcCYyazFe0u8s8s4v4Y2DLd289vLwzpXn jdfeSKmVdsSFB2QE4Ot2g+IdEpAZxxo2oZfV9UX4mjTQW8+mr557wT68kk9+9cl7BJ/I 6yfQ== X-Gm-Message-State: AKaTC01l5tvH3WsWCEy5jr/4S38AxT6OlMTdDHIOT9FD4I4Uag//HEhomUsbMAEoaaKgvy46/sKuAX3N/SjLkREn X-Received: by 10.36.117.138 with SMTP id y132mr11341284itc.42.1482084547335; Sun, 18 Dec 2016 10:09:07 -0800 (PST) MIME-Version: 1.0 Received: by 10.36.203.6 with HTTP; Sun, 18 Dec 2016 10:08:36 -0800 (PST) In-Reply-To: References: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> From: Steven Hartland Date: Sun, 18 Dec 2016 18:08:36 +0000 Message-ID: Subject: Re: [ZFS] files in a weird situtation To: Adam Vande More Cc: David Marec , freebsd-stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Dec 2016 18:09:09 -0000 find also has -delete which avoids the exec overhead, not much of an impact here but worth noting if you're removing lots. On 18 December 2016 at 00:38, Adam Vande More wrote: > On Sat, Dec 17, 2016 at 3:01 PM, David Marec > wrote: > > > [I had first posted onto the Forum about this issue] > > > > Two months ago, > > > > - next to a call to |`||delete-old-libs`| or `install world`, I don't > > really know - > > > > my box that is following FreeBSD-11 Stable ran into a weird situation. > > > > A set of files, especially `/lib/libjail.so.1` are in both states > > `existing` and `not existing`: > > > > I means: > > > > david:~>cp ~david/libjail.so.1 /lib > > cp: /lib/libjail.so.1: File exists > > > > But: > > > > david:~>ls /lib/libjail.so.1 > > ls: /lib/libjail.so.1: No such file or directory > > david:~>find /lib -name "libjail.so.1" -print > > /lib/libjail.so.1 > > david:~>find /lib -name "libjail.so.1" -ls > > find: /lib/libjail.so.1: No such file or directory > > > > With deeper investigation, the file is in fact mapped to an `inode`: > > > > root@dmarec:~ # ls -di /lib > > 13 /lib > > root@dmarec:~ # zdb -dddd zroot/ 13 | grep libjail.so.1 > > libjail.so.1 = 10552574 (type: Regular File) > > > > Which fails with `zdb` on: > > > > root@dmarec:~ # zdb -dddd zroot/ 10552574 > > Dataset zroot [ZPL], ID 21, cr_txg 1, 114G, 2570002 objects, > rootbp > > DVA[0]=<0:b97d6ea00:200> DVA[1]=<0:1c212b0400:200> [L0 DMU > objset] > > fletcher4 lz4 LE contiguous unique double size=800L/200P > > birth=3852240L/3852240P fill=2570002 > > cksum=17b78fb7e4:7c87a526a07:16251edfaae60:2ce0c5734ccf2f > > > > Object lvl iblk dblk dsize lsize %full type > > zdb: dmu_bonus_hold(10552574) failed, errno 2 > > > > > > `stat (2)` returns ENOENT when checking for the file: > > david:~>truss stat -L /lib/libjail.so.1 > > ... > > stat("/lib/libjail.so.1",0x7fffffffe7e8) ERR#2 'No such > > file or > > directory' david:~>truss stat -L /lib/libjail.so.1 > > > > A pass with `zfs scrub` didn't help. > > > > Any clue is welcome. What's that `dmu_bonus_hold` stands for ? > > > > I am unable to understand what your intent is here. If you wish to delete > it, you can do: > > find . -inum 10552574 -exec rm {} \; > > -- > Adam > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Mon Dec 19 06:15:36 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3EB1AC8782B for ; Mon, 19 Dec 2016 06:15:36 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A3CD91A61 for ; Mon, 19 Dec 2016 06:15:34 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from bsdrookie.norma.com. (pc846408.norma.com [IPv6:fd00::73d] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id uBJ6FUHo092425 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Mon, 19 Dec 2016 11:15:30 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1482128131; bh=0727juYt44HGvTLi+bCRCXdKvMXuZI4dmzb+uefgF/0=; h=Subject:To:References:From:Date:In-Reply-To; b=iwfWeGPE5cqPG+greNqVPjSJlVWePigXzX7UjqSJVroD7DjzIMzrmbxEj3mve4sZz 8FnN3kvtLxpVl09iAloHrNJ2CDLI/bwUkFKKv7rUtyQcRx3d+O6hZTd/FGidvBlTbO hp7A7ryDSOpcP9czlpf/mWAk0n1h6+7cMv8W0Isc= Subject: Re: [ZFS] files in a weird situtation To: freebsd-stable@freebsd.org References: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> From: "Eugene M. Zheganin" Message-ID: <58577B02.1030204@norma.perm.ru> Date: Mon, 19 Dec 2016 11:15:30 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.0 MIME-Version: 1.0 In-Reply-To: <914db6e5-2d8d-15b4-ee96-bc267ce1dbda@davenulle.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 06:15:36 -0000 Hi, On 18.12.2016 02:01, David Marec wrote: > > A pass with `zfs scrub` didn't help. > > Any clue is welcome. What's that `dmu_bonus_hold` stands for ? > Just out of the curiosity - is it on a redundant pool and does the 'zpool status' report any error ? Eugene. From owner-freebsd-stable@freebsd.org Mon Dec 19 06:17:47 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E57E2C879C5 for ; Mon, 19 Dec 2016 06:17:47 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 635C51DC5 for ; Mon, 19 Dec 2016 06:17:47 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from bsdrookie.norma.com. (pc846408.norma.com [IPv6:fd00::73d] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id uBJ6HiIT092563 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Mon, 19 Dec 2016 11:17:44 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1482128264; bh=99aBQ6Hxuopiz9nYnsUE6XHqrj5axxtspFj36Q9B5AQ=; h=To:From:Subject:Date; b=S1cjfLdLx+jDHFwlu6VrjmSLPm8oz1rtPVhDiLqNzyQMjRp2YKL9FIgl9tZOV1LvM 4IcI5O4MMuDvfAdla9+H20ZrHzoc8AlWEal0YFrOBeKgrC/mK1wvT0ijvkvDJqg2ok c9006N5L0BKizxQNoAKZj7S2hIIxtY4vXocBKLFs= To: freebsd-stable From: "Eugene M. Zheganin" Subject: iscsi limit to 255 entities Message-ID: <58577B88.1070204@norma.perm.ru> Date: Mon, 19 Dec 2016 11:17:44 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 06:17:48 -0000 Hi. I kind of stepped on a limit of 255 targets (a bunch of VMs), what is the possible workaround for this, besides running a secont ctld in bhyve ? I guess I cannot run ctld inside a jail, since it's the kernel daemon, right ? Is the 255 limit a limit on entities - I mean can I ran like 255 luns in 255 targets ? Thanks. Eugene. From owner-freebsd-stable@freebsd.org Mon Dec 19 06:35:02 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 680C6C87FE9 for ; Mon, 19 Dec 2016 06:35:02 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D835218CB for ; Mon, 19 Dec 2016 06:35:01 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from bsdrookie.norma.com. (pc846408.norma.com [IPv6:fd00::73d] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id uBJ6YwsE093538 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Mon, 19 Dec 2016 11:34:58 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1482129299; bh=heWWqku9fsb7s7uBiqwZXQYm8Ikb/ljxzm1OXZjk2zE=; h=Subject:To:References:From:Date:In-Reply-To; b=mlkFpAp9GN9N5QdjSpPOYb+HdJVKO+0Wp/Zxido2phHKWoy6dcUUi+rZ9K64HyA0q uKwwTLwnBf/8K8BZFEG1evOC0LH8qiosuk3tJFmYao9edLSIXV6kPjwdf5VQ0ie/bq 9BVuAT0ZhEYY/6l5icMQMMV2nFQc6wpa2d//EjTU= Subject: Re: Upgrading boot from GPT(BIOS) to GPT(UEFI) To: freebsd-stable@freebsd.org References: From: "Eugene M. Zheganin" Message-ID: <58577F91.2000406@norma.perm.ru> Date: Mon, 19 Dec 2016 11:34:57 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 06:35:02 -0000 Hi. On 16.12.2016 22:08, Fernando Herrero Carrón wrote: > I am reading uefi(8) and it looks like FreeBSD 11 should be able to boot > using UEFI straight into ZFS, so I am thinking of converting that > freebsd-boot partition to an EFI partition, creating a FAT filesystem and > copying /boot/boot.efi there. > > How good of an idea is that? Would it really be that simple or am I missing > something? My only reason for wanting to boot with UEFI is faster boot, > everything is working fine otherwise. > I tried the UEFI boot sequence on a Supermicro server. It boots only manually, gives some cryptic error while booting automatically. When entering the path to the EFI loader in a appearing prompt - it boots fine, but this kills the idea. I've written a message here about this, so far nobody answered (August, 14th, "FreeBSD doesn't boot automatically from UEFI"). Now it runs on gptzfsboot again, so .... Eugene. From owner-freebsd-stable@freebsd.org Mon Dec 19 06:51:16 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0FA04C873B0 for ; Mon, 19 Dec 2016 06:51:16 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-io0-x22e.google.com (mail-io0-x22e.google.com [IPv6:2607:f8b0:4001:c06::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DD3601278 for ; Mon, 19 Dec 2016 06:51:15 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-io0-x22e.google.com with SMTP id d9so145473162ioe.0 for ; Sun, 18 Dec 2016 22:51:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-transfer-encoding; bh=Zviql/8RdIOkyCBjlonHSZUCBhYgEDBPGvwbsal+22w=; b=K1ZNmNveqUFaJrEHVZgJL2SLnB8yC9kFRJAtfIcwFae2JKH+WHN/gzqETV4wz7xPWd 3T8Lpq5Si+3vwa+zUW2aMHxoqnPlN1zg1xwDDz/MFD03fFaRZnTyWfvISqBgABH8FXbR 9zhnXCraeU6lKsyIuVds1+KJ02RnUVt/Qc/vG0R11wgGFHOwoL3sLO0B+TQLsXpMpH/U bur+UdVgZzihLtKThdpUDTROf2EozHCG5EHZJRjgsp88+Hxv/SBqjRMQqv5uUljcIJuH +aVrmFeP/vt9eQ0KiMYVojtDKmWGAezq27dHc3rJLDoZeatwVuCCceQIlItOke2zxZFK jGxA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc:content-transfer-encoding; bh=Zviql/8RdIOkyCBjlonHSZUCBhYgEDBPGvwbsal+22w=; b=H8UH9ftwDUeD/FMIvsCf6l7Ajq0kkx5XxX0l0SkbllQDVgIEYNEMjNsl+Ox1kbP9fr 2tXneb7V2GOZO+a+OSCC7TZ5GOC1wszd42HyZhchPguRlZLcP/uZ3qoHSUL9wd4Wm2So XTC0zjpYviZxPVHrwbyoPuPxgENcnX8r5vFB6OyQKYPwwuitlhGLbasMlQ/EGRXZpVG5 BhKNFzsl6ZoFIwPGG805tNfbWq4eYWiQL5I1QsMRywGGDiwJB4LNpUjGhYltfK4qyYHX Upm8kaf3YL4X2OYWYJ6PhDfdX3KJ7V47cThaktXbIisJ+0srtHRBZ1HzBe0JFLTbfM29 3qzg== X-Gm-Message-State: AIkVDXLgawlCp0/2Uwg3yzkbZjxNJZ2HQ956rwA9BtxDFnWdcuYvnfTIyloG9QYF+THrtzbzaY8cJpknKXYLMQ== X-Received: by 10.107.132.74 with SMTP id g71mr14009720iod.19.1482130275024; Sun, 18 Dec 2016 22:51:15 -0800 (PST) MIME-Version: 1.0 Sender: wlosh@bsdimp.com Received: by 10.79.22.135 with HTTP; Sun, 18 Dec 2016 22:51:14 -0800 (PST) X-Originating-IP: [50.253.99.174] In-Reply-To: <58577F91.2000406@norma.perm.ru> References: <58577F91.2000406@norma.perm.ru> From: Warner Losh Date: Sun, 18 Dec 2016 23:51:14 -0700 X-Google-Sender-Auth: mwK4ujJqH66Fq1cagDa5-tNrfN0 Message-ID: Subject: Re: Upgrading boot from GPT(BIOS) to GPT(UEFI) To: "Eugene M. Zheganin" Cc: FreeBSD-STABLE Mailing List Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 06:51:16 -0000 On Sun, Dec 18, 2016 at 11:34 PM, Eugene M. Zheganin wr= ote: > Hi. > > On 16.12.2016 22:08, Fernando Herrero Carr=C3=B3n wrote: >> I am reading uefi(8) and it looks like FreeBSD 11 should be able to boot >> using UEFI straight into ZFS, so I am thinking of converting that >> freebsd-boot partition to an EFI partition, creating a FAT filesystem an= d >> copying /boot/boot.efi there. >> >> How good of an idea is that? Would it really be that simple or am I miss= ing >> something? My only reason for wanting to boot with UEFI is faster boot, >> everything is working fine otherwise. >> > I tried the UEFI boot sequence on a Supermicro server. It boots only > manually, gives some cryptic error while booting automatically. When > entering the path to the EFI loader in a appearing prompt - it boots > fine, but this kills the idea. > > I've written a message here about this, so far nobody answered (August, > 14th, "FreeBSD doesn't boot automatically from UEFI"). > > Now it runs on gptzfsboot again, so .... Which SuperMicro board? Our X9's have big issues with UEFI (though some versions of the boards seem to work). The X10's are rock solid. Warner From owner-freebsd-stable@freebsd.org Mon Dec 19 07:00:23 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA944C876AB for ; Mon, 19 Dec 2016 07:00:23 +0000 (UTC) (envelope-from snowiswhite@gmail.com) Received: from mail-wj0-x235.google.com (mail-wj0-x235.google.com [IPv6:2a00:1450:400c:c01::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5641B1E1F for ; Mon, 19 Dec 2016 07:00:23 +0000 (UTC) (envelope-from snowiswhite@gmail.com) Received: by mail-wj0-x235.google.com with SMTP id v7so141611012wjy.2 for ; Sun, 18 Dec 2016 23:00:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=XzIHfc3rIrAdiOoIX0L3+6kEn4g9hSkK+kPh0yXFlMQ=; b=qdvru9HrUKah7nj5eZ/TF6PjM3zoGCPl9xpcXzNv3wOVZm9Bv86a4puX1elb4QsIpI QHcQjTg9Ow03SK3zp4ASsPa2/3eV6MlFVtSlehKsZ5l4I7xis39Efa8AKQ7MLDC2Xjsn XOOa8kIaXTrhh+yWYErS7TH9CujYhak3JXexduEFK9QvBmkLbEYM8KKTNS67z+16VPPS 5hoObiobvrm4j+fEHW2U71yV0vRIfJXfH+W96voLzCt1JFF3AnF9bNBNayE5X+zlEd+C k7A64WXk71CkIMnok2oSuo6EyF4jc7GRktD7ct/Tu4XxADqiuIrKxL59RPZcwam+o7xq W8XQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=XzIHfc3rIrAdiOoIX0L3+6kEn4g9hSkK+kPh0yXFlMQ=; b=YNMiRgu+9c4gmWTU7f0Y8eXw9XJBKUIWYJiNX8KtLV3/ZvL6RqD3l74gebgo7/1Cpz yCrCcd7saP334GuRdSqQrAbMzqft4SVPgIDawEVqjCGn7RlthQk9tObelSa4y6fy9nUj uzF9kq6JSl6z8tdhYUr1EUonSu8TCeYrCAjBaxPt8aMt8RWvcnRZeglGNcqo1OKJ3YUk Ak0IBbe1XINhSaCM12mssaz68dDE5Ak9Ss8HFS6bQRSqoc5enIMSkwGrQmRwOCnlLiBC /JRtSL+rAxOAjjr6pDkhBCbSiCl33k1CX7c+sPreDUqz3h83BBbO+5SrcBP2Crq+OrDZ stWg== X-Gm-Message-State: AKaTC02rNCqHQ08Vv71McR04O2rH8FLd5g1cSLQ4KhebEO5tJS9ie4BYQ9bFmq3/ViwCnw== X-Received: by 10.194.39.7 with SMTP id l7mr12209074wjk.182.1482130820891; Sun, 18 Dec 2016 23:00:20 -0800 (PST) Received: from [10.18.37.10] (213.231.197.178.dynamic.wless.zhbmb00p-cgnat.res.cust.swisscom.ch. [178.197.231.213]) by smtp.gmail.com with ESMTPSA id 138sm15684953wms.20.2016.12.18.23.00.20 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 18 Dec 2016 23:00:20 -0800 (PST) Subject: Re: suspend/resume on Skylake (Lenovo T460s) with FreeBSD11 stable To: Christian Schwarz References: <20161217140223.tql6nmpd5gcgjryn@csarch> Cc: freebsd-stable@freebsd.org From: Chris Ernst Message-ID: Date: Mon, 19 Dec 2016 08:00:19 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 In-Reply-To: <20161217140223.tql6nmpd5gcgjryn@csarch> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 07:00:23 -0000 > On Wed, Dec 14, 2016 at 05:15:12PM +0100, Chris Ernst wrote: >> >> i have been hardly trying to get my Lenovo T460s to suspend *and to resume >> again*. >> >> Eventually the system suspends when i close the lid. >> The power LED is slowly blinking on and off. >> >> That is it! I am not able to resume my system anymore. >> When I push the power button once the power LED *keeps* slowly blinking on >> and off. :( > > What was the last revision where suspend/resume worked on your T460s? > > Approximately two months ago, I tried the then HEAD of drm-next-4.7 > of the FreeBSDDesktop repo [1] and had no success. > > -- Christian > > [1] https://github.com/FreeBSDDesktop/freebsd-base-graphics > Hi Christian Hi all it never worked. I tried using the FreeBSD 11-STABLE (Revision 310008). As i pointed out in my first post. Suspend is working but i am unable to resume again. Actually i am interested in having an exchange of experiences which kernel modules and configs are needed and which one should be avoided to successfully enable suspend/resume. I already found "Suspend/Resume on FreeBSD-Wiki" [1]. Unfortunately the information provided there is not valuable for me. Anyone interested in sharing experiences? best regards Chris [1]https://wiki.freebsd.org/SuspendResume From owner-freebsd-stable@freebsd.org Mon Dec 19 07:28:13 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D67BC87D29 for ; Mon, 19 Dec 2016 07:28:13 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C5246A2D for ; Mon, 19 Dec 2016 07:28:11 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from bsdrookie.norma.com. (pc846408.norma.com [IPv6:fd00::73d] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id uBJ7S72m096712 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Mon, 19 Dec 2016 12:28:08 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1482132488; bh=B5bcFQmId4sEiVAObn+abiv2/Hy8bxWcZ0VGZSbAV0g=; h=Subject:To:References:From:Date:In-Reply-To; b=O464NbP1o0LySql2VSO2qBTDcojvRLQ/6o2o14XkqXLmPtqasc1XLwImorbVCBzjZ 0uGXBKD+A7+gMaTUzI+t38MA041jODe6PBIyNc4cZeNMBUEMkpDJwhDtJwV+UBkB6s AewJ5qIAimMZ3MeKbPtcEuZXxnoGEqYMHTf0QkSM= Subject: Re: Upgrading boot from GPT(BIOS) to GPT(UEFI) To: FreeBSD-STABLE Mailing List References: <58577F91.2000406@norma.perm.ru> From: "Eugene M. Zheganin" Message-ID: <58578C07.7070502@norma.perm.ru> Date: Mon, 19 Dec 2016 12:28:07 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 07:28:13 -0000 Hi. On 19.12.2016 11:51, Warner Losh wrote: > On Sun, Dec 18, 2016 at 11:34 PM, Eugene M. Zheganin wrote: >> I tried the UEFI boot sequence on a Supermicro server. It boots only >> manually, gives some cryptic error while booting automatically. When >> entering the path to the EFI loader in a appearing prompt - it boots >> fine, but this kills the idea. >> >> I've written a message here about this, so far nobody answered (August, >> 14th, "FreeBSD doesn't boot automatically from UEFI"). >> >> Now it runs on gptzfsboot again, so .... > Which SuperMicro board? Our X9's have big issues with UEFI (though > some versions of the boards seem to work). The X10's are rock solid. > The affected server has X9SCL/X9SCM, yup. Is there some workaround to this, like flashing newer BIOS ? Eugene. From owner-freebsd-stable@freebsd.org Mon Dec 19 09:07:58 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2E53AC88B33 for ; Mon, 19 Dec 2016 09:07:58 +0000 (UTC) (envelope-from ashrafbasit2016@gmail.com) Received: from daviear1.miniserver.com (daviear1.miniserver.com [5.153.250.166]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E9AF51B31 for ; Mon, 19 Dec 2016 09:07:57 +0000 (UTC) (envelope-from ashrafbasit2016@gmail.com) Received: from prestigecorpserv by daviear1.miniserver.com with local (Exim 4.87) (envelope-from ) id 1cItvF-0007ez-FW for freebsd-stable@freebsd.org; Mon, 19 Dec 2016 09:07:53 +0000 To: freebsd-stable@freebsd.org Subject: Please Get Back To Me X-PHP-Script: prestigecorpservices.com/admin/index.php for 92.114.35.50 X-PHP-Originating-Script: 1001:email.php Message-ID: <57070dea1973d4b48bd23646bc68156b@prestigecorpservices.com> Date: Mon, 19 Dec 2016 09:07:53 +0000 From: "Afshur Basir" Reply-To: abasit@secsuremailer.com MIME-Version: 1.0 X-Mailer-LID: 5 X-Mailer-RecptId: 203995 X-Mailer-SID: 8 X-Mailer-Sent-By: 1 Content-Type: text/plain; format=flowed; charset="UTF-8" Content-Transfer-Encoding: 8bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - daviear1.miniserver.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [1001 992] / [47 12] X-AntiAbuse: Sender Address Domain - gmail.com X-Get-Message-Sender-Via: daviear1.miniserver.com: authenticated_id: prestigecorpserv/only user confirmed/virtual account not confirmed X-Authenticated-Sender: daviear1.miniserver.com: prestigecorpserv X-Source: X-Source-Args: X-Source-Dir: prestigecorpservices.com:/public_html/admin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 09:07:58 -0000 Hello Sir, I know we have not met before or have any prior contact with each other but this is very important and I am hoping that you can at least take your time to read my message carefully. My name is Ashraf Basit, I am contacting you from the crisis torn country of Syria. I am contacting you because I have a proposal that I think may interest you. I represent the interest of my brother in-law who is a minister in the Syrian Government. As you probably know, there is a lot of crisis going on currently in Syria and my brother in-law has fallen out with the ruling Government and the president because he publicly opposed the war and the irresponsible killings of innocent citizens especially children. Now the president and his allies and trying to silence anybody opposing his war policies. They have been arresting all the poitical leaders in the country that do not support this war. Due to this situation, my brother in-law has asked me to help him find a foreign investor that can help him secure and invest his assets that he has in Europe. He wants to do this privately and discretely so that if anything should happen to him, the future of his family can be secured. I cannot go through regular channels due to the confidential nature of this proposal. I got your contact details from an online business directory and I hope you can help us. Please note that this proposal will be executed in a legal manner and it will not bring any risk to you or your family. My brother in-law has also promised to compensate you handsomely for your role in this transaction. He wants this to be done discretely so I will be acting as his eyes and ears during the course of this transaction. I have intentionally left some vital details out of this proposal to protect our interest. If you indicate your intetest, I will then be able to give you all the necessary details. I hope to hear from you soon and hope we can work together successfully on this proposal. Reards, Ashraf. Powered by Interspire From owner-freebsd-stable@freebsd.org Mon Dec 19 10:02:27 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 084CAC87643 for ; Mon, 19 Dec 2016 10:02:27 +0000 (UTC) (envelope-from me@cschwarz.com) Received: from orion.uberspace.de (orion.uberspace.de [95.143.172.79]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5DEFD1A67 for ; Mon, 19 Dec 2016 10:02:25 +0000 (UTC) (envelope-from me@cschwarz.com) Received: (qmail 29302 invoked from network); 19 Dec 2016 10:02:14 -0000 Received: from localhost (HELO csarch.local) (127.0.0.1) by orion.uberspace.de with SMTP; 19 Dec 2016 10:02:14 -0000 Received: by csarch.local (Postfix, from userid 1000) id 6C9D938C15D; Mon, 19 Dec 2016 11:02:12 +0100 (CET) Date: Mon, 19 Dec 2016 11:02:12 +0100 From: Christian Schwarz To: Chris Ernst Cc: freebsd-stable@freebsd.org Subject: Re: suspend/resume on Skylake (Lenovo T460s) with FreeBSD11 stable Message-ID: <20161219100212.7lso76t7acdfzsji@csarch> References: <20161217140223.tql6nmpd5gcgjryn@csarch> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20161126 (1.7.1) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 10:02:27 -0000 On Mon, Dec 19, 2016 at 08:00:19AM +0100, Chris Ernst wrote: > it never worked. > I tried using the FreeBSD 11-STABLE (Revision 310008). > As i pointed out in my first post. Suspend is working but i am unable to > resume again. Same experience that I had ;) One idea that just came across my mind: maybe it's the graphics that don't resume. You could start some network service on the laptop, then suspend & resume, and check if the network service is reachable. From owner-freebsd-stable@freebsd.org Mon Dec 19 10:09:11 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5BEACC87748 for ; Mon, 19 Dec 2016 10:09:11 +0000 (UTC) (envelope-from andrnils@gmail.com) Received: from mail-ua0-x233.google.com (mail-ua0-x233.google.com [IPv6:2607:f8b0:400c:c08::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0972C1C39 for ; Mon, 19 Dec 2016 10:09:11 +0000 (UTC) (envelope-from andrnils@gmail.com) Received: by mail-ua0-x233.google.com with SMTP id 3so81771208uaz.3 for ; Mon, 19 Dec 2016 02:09:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=89KsMFfSclgKNqnNcwMXdZg6YshGZXhtEwNElbSu2+o=; b=BOK01x7K40IZ1dvnwE83tZzdFK73mKwnqKYmmtpIMfeQI8g00CIF5+YRtu2HS0NyMw VYGAW1/+ovvFm+sLy6wgMCLlM9PZ9Ej7QXWIK0BsR3VeT/l7HnM09UAvqYgX/KtNty5j AkF0TiLeHubqxW/WOL6GMMwa8D9T450kH+ItnePJtoTMaECBxFgOz2vdtO4hSD0Cp6Cg HHUXe6lE7BJv0qgsHTrp+3uX2cncWV2Ku3zYmJeJUM3epFeuMwz/LFitexc472xPeeph eLLRJ+1OE6pR71dXjweEfeX53wr+2IFveynGFZO6V1A/Oi42fymTefrWvDxiJZY/svvq mRWg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=89KsMFfSclgKNqnNcwMXdZg6YshGZXhtEwNElbSu2+o=; b=A7dP0s8kds04tjrgEww1dFBJaMd7GneXrwUiTxlGRPjV8GqiPQG+kYqCv8Zz7ISR0N rVatl43hsTKacL2FX3p6Q5QWhzXFxRihM5bFbZaPytOblxf0JEH7WP1oeL4MHOO9j7Vr c3SyvxJWB9t4xDF+21p4o+pcoekZGXTYz6vnO7IwQ95PrywGW0Mr7ZuBXT7sMt8BKaBC 0uETB8hXVNCEJPPLcTUPXN32iZpmQONNiRJwR5/95bavEr4XhEtEUpJoyuPKQKiki180 7X2MDmTYKeKDlDiAZJ8oxv86+EAhTpgPUc6LeE2kvHgzpl+7TA8sbvszEXrfZBEojlRH mIEQ== X-Gm-Message-State: AKaTC02FGNjo0N4xdiKSBjeyI2K13ZNprcU2pNexAz80WEgYB6i/sjzpwpkx1s70IM4IxpDnPZrDONwh2A9rtg== X-Received: by 10.176.5.69 with SMTP id 63mr9689928uax.71.1482142150068; Mon, 19 Dec 2016 02:09:10 -0800 (PST) MIME-Version: 1.0 Received: by 10.159.37.74 with HTTP; Mon, 19 Dec 2016 02:09:09 -0800 (PST) In-Reply-To: <20161219100212.7lso76t7acdfzsji@csarch> References: <20161217140223.tql6nmpd5gcgjryn@csarch> <20161219100212.7lso76t7acdfzsji@csarch> From: Andreas Nilsson Date: Mon, 19 Dec 2016 11:09:09 +0100 Message-ID: Subject: Re: suspend/resume on Skylake (Lenovo T460s) with FreeBSD11 stable To: Christian Schwarz Cc: Chris Ernst , FreeBSD Stable Mailing List Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 10:09:11 -0000 On Mon, Dec 19, 2016 at 11:02 AM, Christian Schwarz wrote: > On Mon, Dec 19, 2016 at 08:00:19AM +0100, Chris Ernst wrote: > > it never worked. > > I tried using the FreeBSD 11-STABLE (Revision 310008). > > As i pointed out in my first post. Suspend is working but i am unable to > > resume again. > > Same experience that I had ;) > > One idea that just came across my mind: maybe it's the graphics that > don't resume. > > You could start some network service on the laptop, then suspend & > resume, and check if the network service is reachable. > > Hello, my Lenovo X1 yoga exhibits the same traits, it does suspend, but graphics are corrupted after resume. Machine usually is reachable over the network though. Best regards Andreas From owner-freebsd-stable@freebsd.org Mon Dec 19 11:50:32 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A79CC872DF for ; Mon, 19 Dec 2016 11:50:32 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from sola.nimnet.asn.au (paqi.nimnet.asn.au [115.70.110.159]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 98F851F39 for ; Mon, 19 Dec 2016 11:50:30 +0000 (UTC) (envelope-from smithi@nimnet.asn.au) Received: from localhost (localhost [127.0.0.1]) by sola.nimnet.asn.au (8.14.2/8.14.2) with ESMTP id uBJBo2sZ064464; Mon, 19 Dec 2016 22:50:03 +1100 (EST) (envelope-from smithi@nimnet.asn.au) Date: Mon, 19 Dec 2016 22:50:02 +1100 (EST) From: Ian Smith To: Chris Ernst cc: Christian Schwarz , freebsd-stable@freebsd.org Subject: Re: suspend/resume on Skylake (Lenovo T460s) with FreeBSD11 stable In-Reply-To: Message-ID: <20161219214242.N26979@sola.nimnet.asn.au> References: <20161217140223.tql6nmpd5gcgjryn@csarch> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 11:50:32 -0000 On Mon, 19 Dec 2016 08:00:19 +0100, Chris Ernst wrote: > > On Wed, Dec 14, 2016 at 05:15:12PM +0100, Chris Ernst wrote: > > > > > > i have been hardly trying to get my Lenovo T460s to suspend *and to > > > resume > > > again*. > > > > > > Eventually the system suspends when i close the lid. > > > The power LED is slowly blinking on and off. > > > > > > That is it! I am not able to resume my system anymore. > > > When I push the power button once the power LED *keeps* slowly blinking > > > on > > > and off. :( > > > > What was the last revision where suspend/resume worked on your T460s? > > > > Approximately two months ago, I tried the then HEAD of drm-next-4.7 > > of the FreeBSDDesktop repo [1] and had no success. > > > > -- Christian > > > > [1] https://github.com/FreeBSDDesktop/freebsd-base-graphics > > > > Hi Christian > Hi all > > it never worked. Have you only tried 11.x? Have you tried for example a 10.3 memstick? > I tried using the FreeBSD 11-STABLE (Revision 310008). > As i pointed out in my first post. Suspend is working but i am unable to > resume again. You haven't said .. is this trying to suspend and resume from text or graphics mode? As you see on the Wiki page at your [1], some machines work ok with one but not the other. Others will - or used to - work if switching X to text mode before suspending, where that's still possible. My much older X200 suspends 100% on 9.x, text or X, and on test memstick boots of 10.2 and 10.3, from text mode at least. But not from an 11.0-R memstick boot - it suspends fine (text mode, VT) but resumes sans video; 'Live CD' boot can't onestart sshd (RO /var) so I've not yet pursued it. Mine's a far older machine, most likely a different issue to yours and I'm not chasing that here, just pointing out that mine has worked fine for years without tuning on earlier releases, including (before trying with latest X) on 10.3-R memstick boots with fairly thorough testing. > Actually i am interested in having an exchange of experiences which kernel > modules and configs are needed and which one should be avoided to > successfully enable suspend/resume. > > I already found "Suspend/Resume on FreeBSD-Wiki" [1]. Unfortunately the > information provided there is not valuable for me. > > Anyone interested in sharing experiences? > > best regards > Chris > > > [1]https://wiki.freebsd.org/SuspendResume That poge points to https://wiki.freebsd.org/DebuggingSuspendResume which may be helpful, especially re reducing your system to minimum services and loaded modules. Odds seem to favour video card issues. You could browse freebsd-acpi@ and freebsd-mobile@ archives; not sure about "s" model but various T460 appear over the time. Happy hunting. cheers, Ian From owner-freebsd-stable@freebsd.org Mon Dec 19 19:36:07 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C045AC872AA; Mon, 19 Dec 2016 19:36:07 +0000 (UTC) (envelope-from hiren@strugglingcoder.info) Received: from mail.strugglingcoder.info (strugglingcoder.info [104.236.146.68]) by mx1.freebsd.org (Postfix) with ESMTP id A3C8E12BE; Mon, 19 Dec 2016 19:36:07 +0000 (UTC) (envelope-from hiren@strugglingcoder.info) Received: from localhost (unknown [10.1.1.3]) (Authenticated sender: hiren@strugglingcoder.info) by mail.strugglingcoder.info (Postfix) with ESMTPA id C6982178B2; Mon, 19 Dec 2016 11:36:06 -0800 (PST) Date: Mon, 19 Dec 2016 11:36:06 -0800 From: hiren panchasara To: "Andrey V. Elsukov" Cc: "Eugene M. Zheganin" , freebsd-net , freebsd-stable@freebsd.org Subject: Re: sonewconn: pcb [...]: Listen queue overflow to human-readable form Message-ID: <20161219193606.GQ82166@strugglingcoder.info> References: <58528B50.8030600@norma.perm.ru> <20161215175141.GE82166@strugglingcoder.info> <010586a3-0d44-7f83-32f1-d3ad79788fad@yandex.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="XQ/JOjNzrAcf1KaA" Content-Disposition: inline In-Reply-To: <010586a3-0d44-7f83-32f1-d3ad79788fad@yandex.ru> User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 19:36:07 -0000 --XQ/JOjNzrAcf1KaA Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 12/16/16 at 11:20P, Andrey V. Elsukov wrote: > On 15.12.2016 20:51, hiren panchasara wrote: > > On 12/15/16 at 05:23P, Eugene M. Zheganin wrote: > >> Hi. > >> > >> Sometimes on one of my servers I got dmesg full of > >> > >> sonewconn: pcb 0xfffff80373aec000: Listen queue overflow: 49 already in > >> queue awaiting acceptance (6 occurrences) > > [skip] > >> > >> but at the time of investigation the socket is already closed and lsof > >> cannot show me the owner. I wonder if the kernel can itself decode this > >> output and write it in the human-readable form ? > >=20 > > I have this not-quite-correct patch that may help you. (If you follow t= he > > discussion there, you'd know why its not complete.)=20 > >=20 > > https://lists.freebsd.org/pipermail/freebsd-net/2014-March/038074.html >=20 > Hi Hiren, >=20 > I think the check for socket's domain should be enough? >=20 >=20 > --=20 > WBR, Andrey V. Elsukov > Index: sys/kern/uipc_socket.c > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > --- sys/kern/uipc_socket.c (revision 309834) > +++ sys/kern/uipc_socket.c (working copy) > @@ -139,6 +139,7 @@ __FBSDID("$FreeBSD$"); > #include > #include > #include > +#include > =20 > #include > =20 > @@ -577,10 +578,15 @@ sonewconn(struct socket *head, int connstatus) > overcount++; > =20 > if (ratecheck(&lastover, &overinterval)) { > - log(LOG_DEBUG, "%s: pcb %p: Listen queue overflow: " > - "%i already in queue awaiting acceptance " > - "(%d occurrences)\n", > - __func__, head->so_pcb, head->so_qlen, overcount); > + if (INP_CHECK_SOCKAF(head, AF_INET) || > + INP_CHECK_SOCKAF(head, AF_INET6)) > + over =3D ntohs(sotoinpcb(head)->inp_lport); > + else > + over =3D 0; > + log(LOG_DEBUG, "%s: pcb %p: Listen queue overflow on " > + "port %d: %i already in queue awaiting acceptance " > + "(%d occurrences)\n", __func__, head->so_pcb, > + over, head->so_qlen, overcount); > =20 > overcount =3D 0; > } Andrey, Thanks, this seems correct to me. :-) Cheers, Hiren --XQ/JOjNzrAcf1KaA Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQF8BAABCgBmBQJYWDajXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRBNEUyMEZBMUQ4Nzg4RjNGMTdFNjZGMDI4 QjkyNTBFMTU2M0VERkU1AAoJEIuSUOFWPt/l8w8H/RpSEXSdSJUazfH2Hl+NaqHv 2dtgPLQkRnwz3+XvosDLEJdNRzqMXGdTKm/Vs9NvC5KjERCp3JgmmkGFRTjBx1BE ABe8K7Io2cEhlXeDrDVoKrs8o7x94XYarGb2EcVyR0IPoX1Io5BGn+lGmNa+Sczk xEaMZryNx+B+EyehiBZnVxksdVQkqMNyBtgL5aTENBhArqC5Pcya4m9jqiHg1r+4 oQTC/e4AsrZhU3CaOH6NcurrAPMFVm/9O30g3zpVuFUqXf90kuss7EhBv5lva+wy chsmJhq4+A0uWgE7rDVUWAEhYIPwl7kbmAnSTPftMqohH6jYu4ebVaoqTPHCvkg= =Zwm9 -----END PGP SIGNATURE----- --XQ/JOjNzrAcf1KaA-- From owner-freebsd-stable@freebsd.org Mon Dec 19 21:36:52 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED4ECC885EB for ; Mon, 19 Dec 2016 21:36:52 +0000 (UTC) (envelope-from allbery.b@gmail.com) Received: from mail-it0-x234.google.com (mail-it0-x234.google.com [IPv6:2607:f8b0:4001:c0b::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B43771C12 for ; Mon, 19 Dec 2016 21:36:52 +0000 (UTC) (envelope-from allbery.b@gmail.com) Received: by mail-it0-x234.google.com with SMTP id x2so5934934itf.1 for ; Mon, 19 Dec 2016 13:36:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=7OatshI8o+5doZ1xakKvTwicSe8YKa1o6/gO+1+GpEc=; b=UF7KMC0PmU2UrwIc8kbBc/Zo0NUmCJVkGEHvnlZPs9gWLwIjAlrncJDGLHNGTHkPqg w+OXUnwMIIFcP7ij5TYziF+PuD7aWvFwDflrTtOiXt+IPkLsqq5b1suSroLRJC0A5BzA sr8R4lyGhsoRtZSwHN/QizAyJNnhtmGql6DijmbH+lO1sj1rjzNpB/T+OT3gE1fKVzHe EBmkiEJjmpZU4iM9jMAJUd8OlqB+o81V39EbMzCjmPrIBE7KWttrytST/6rqJsTkaoQw tmpeoV+WF2zOwVH5LIRRPfnotupUwwo/Bj/Mleg7BI8D4ZytCR+4O20/d0pPp2jxrsY+ PvgQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=7OatshI8o+5doZ1xakKvTwicSe8YKa1o6/gO+1+GpEc=; b=sRyORjTtLD1n+pW1/weciOhZx+lgCJPqFRnMLpxJy2r4VXm2ZXUTEDrTz+qOAFPqvk SjvpbOYuyzlzpLofmTlVFcCp+phZfIYA6I2j7FGK7sXSPIPhYD9QwAsf3Y0lhoR+emw4 Nz8IF87P8hBxr76AOkmzXgut5JQ+DoruZ31i0+y06iGiXk8BTsHRfQ5a26Ilscs+QgME nd4CLYvxeV7WEruB5B11MkZ7iPzSgQ50NNXi+jiYHkT9PKL1Mhp8pJt+7x4+V6tkHOAR MGxHHuNdccLH7JODKdQVQf7rB/Pi2RnaaAn/z//lwyXT5AqTmVGPSfosmXgi4Ig7fxp1 1nUQ== X-Gm-Message-State: AKaTC012hJBkJGF0lMBxNc4+o8HTnhmM5S321CXUAGZOhatoeky3/hl0f2DMbnvc/V+1vmbTB3fzKzjVLj/h7Q== X-Received: by 10.36.0.137 with SMTP id 131mr17290515ita.1.1482183412143; Mon, 19 Dec 2016 13:36:52 -0800 (PST) MIME-Version: 1.0 Received: by 10.36.192.138 with HTTP; Mon, 19 Dec 2016 13:36:51 -0800 (PST) In-Reply-To: References: <20161217140223.tql6nmpd5gcgjryn@csarch> <20161219100212.7lso76t7acdfzsji@csarch> From: Brandon Allbery Date: Mon, 19 Dec 2016 21:36:51 +0000 Message-ID: Subject: Re: suspend/resume on Skylake (Lenovo T460s) with FreeBSD11 stable To: Andreas Nilsson Cc: Christian Schwarz , Chris Ernst , FreeBSD Stable Mailing List Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Dec 2016 21:36:53 -0000 On Mon, Dec 19, 2016 at 10:09 AM, Andreas Nilsson wrote: > my Lenovo X1 yoga exhibits the same traits, it does suspend, but graphics > are corrupted after resume. Machine usually is reachable over the network > though. > Isn't that related to sc vs. vt? Various video cards, notably many NVidia based, don't recover from suspend. sc can't reinitialize them. vt can, and knows how to reinit some cards but needs to be taught how to reinit others. -- brandon s allbery kf8nh sine nomine associates allbery.b@gmail.com ballbery@sinenomine.net unix, openafs, kerberos, infrastructure, xmonad http://sinenomine.net From owner-freebsd-stable@freebsd.org Wed Dec 21 06:24:19 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 171BAC8AC14; Wed, 21 Dec 2016 06:24:19 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (wollman-1-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E2BFF1297; Wed, 21 Dec 2016 06:24:18 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.15.2/8.15.2) with ESMTP id uBL6OGbG006929; Wed, 21 Dec 2016 01:24:16 -0500 (EST) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.15.2/8.14.4/Submit) id uBL6OGsJ006928; Wed, 21 Dec 2016 01:24:16 -0500 (EST) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <22618.8208.273426.702678@hergotha.csail.mit.edu> Date: Wed, 21 Dec 2016 01:24:16 -0500 From: Garrett Wollman To: freebsd-fs@freebsd.org Cc: freebsd-stable@freebsd.org, rmacklem@freebsd.org Subject: NFS server hang with backing store on ZFS and quota nearly exhausted X-Mailer: VM 8.2.0b under 25.1.1 (amd64-portbld-freebsd10.3) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.1 (hergotha.csail.mit.edu [127.0.0.1]); Wed, 21 Dec 2016 01:24:17 -0500 (EST) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED, HEADER_FROM_DIFFERENT_DOMAINS autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hergotha.csail.mit.edu X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2016 06:24:19 -0000 I've opened a bug about this before, which I can't cite by number because bugzilla appears to be down at the moment. But I had this problem recur tonight under otherwise idle conditions, so I was able to get a set of kernel stacks without any confounding RPC activity going on. This is on 10.2; we're not scheduled to take these servers to 10.3 until next week. Here's the "procstat -kk" output. PID TID COMM TDNAME KSTACK 1055 101965 nfsd - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _cv_wait_sig+0x16a seltdwait+0xae kern_select+0x8fa sys_select+0x54 amd64_syscall+0x357 Xfast_syscall+0xfb 1058 101012 nfsd nfsd: service mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _cv_wait_sig+0x16a svc_run_internal+0x8be svc_thread_start+0xb fork_exit+0x9a fork_trampoline+0xe [Threads with the stack trace above are simply idle and waiting for incoming requests, and I've deleted the other 5 of them.] 1058 101688 nfsd nfsd: service mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_timedwait_sig+0x10 _cv_timedwait_sig_sbt+0x18b svc_run_internal+0x4bd svc_thread_start+0xb fork_exit+0x9a fork_trampoline+0xe [Not sure what these threads are doing: obviously they are waiting for a condvar, but at a different spot in svc_run_internal(). I've deleted the other 7 of them.] 1058 101720 nfsd nfsd: service mi_switch+0xe1 sleepq_wait+0x3a _cv_wait+0x16d txg_wait_open+0x85 dmu_tx_wait+0x2ac dmu_tx_assign+0x48 zfs_freebsd_write+0x544 VOP_WRITE_APV+0x149 nfsvno_write+0x13e nfsrvd_write+0x496 nfsrvd_dorpc+0x6f1 nfssvc_program+0x54e svc_run_internal+0xd7b svc_thread_start+0xb fork_exit+0x9a fork_trampoline+0xe 1058 102015 nfsd nfsd: master mi_switch+0xe1 sleepq_wait+0x3a _cv_wait+0x16d txg_wait_open+0x85 dmu_tx_wait+0x2ac dmu_tx_assign+0x48 zfs_freebsd_write+0x544 VOP_WRITE_APV+0x149 nfsvno_write+0x13e nfsrvd_write+0x496 nfsrvd_dorpc+0x6f1 nfssvc_program+0x54e svc_run_internal+0xd7b svc_run+0x1de nfsrvd_nfsd+0x242 nfssvc_nfsd+0x107 sys_nfssvc+0x9c amd64_syscall+0x357 Then there are these two threads, both servicing WRITE RPCs, both sleeping deep inside the ZFS code. Note that one of them is the "master" krpc thread in this service pool; I don't know if this accounts for the fact that requests are not getting processed even though plenty of idle threads exist. (Note that zfs_write() does not appear in the stack due to tail-call optimization.) I don't know the ZFS code well enough to understand what running out of quota has to do with this situation (you'd think it would just return immediately with [EDQUOT]) but perhaps it matters that the clients are not well-behaved and that the filesystem is often almost at quota but not quite there yet. -GAWollman From owner-freebsd-stable@freebsd.org Wed Dec 21 06:45:27 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9458C8A29A for ; Wed, 21 Dec 2016 06:45:27 +0000 (UTC) (envelope-from kmacybsd@gmail.com) Received: from mail-lf0-f65.google.com (mail-lf0-f65.google.com [209.85.215.65]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7BF211FDC for ; Wed, 21 Dec 2016 06:45:27 +0000 (UTC) (envelope-from kmacybsd@gmail.com) Received: by mail-lf0-f65.google.com with SMTP id y21so12729246lfa.0 for ; Tue, 20 Dec 2016 22:45:27 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=2h/lrk26EWhn5fTV1Wg0zDGRgXarmI2ql+olmtq+qbw=; b=XV1G/TTKkj2Jl9WoZmYAL7dAUi5KIil5ZCkBVsOxu97hM6tKUuGlXEmfWbcbAjCagV x4+nJg3JGIDOS6eu3pQ3aeXVrc8fRFrOnpaLHZiBy+OvVSikf32ZEJSvsrbFO55INcKA 1keUcN/Dge0aYfuVj0MFCHjVUcm+jkmxyELHbRAM5ToQRqgWxrw+N/ka55lgCx+e9aSU RasbkRNUitpWTIU8YOvbfmTmrzqDtaQMN8yG9N4XthP0+wSvsW9sS+Tah3jB7FFCJDG0 8RLBFTLZG7DtUi2Is/LVzeK9lCieP08nZIFOEA8j3fYtAV7wSpRFu+/YwBo9UhgFSquI lRKA== X-Gm-Message-State: AIkVDXI60lxiNeJWShg4WINqKP6QE0FhGXlfBBHoZ9FDZ/DlWYOalV3XZq9eDOJmrZcqCm2yr2X4ERpvkvwwQA== X-Received: by 10.25.99.138 with SMTP id v10mr350691lfi.26.1482301069687; Tue, 20 Dec 2016 22:17:49 -0800 (PST) MIME-Version: 1.0 References: <20161217140223.tql6nmpd5gcgjryn@csarch> <20161219100212.7lso76t7acdfzsji@csarch> In-Reply-To: From: "K. Macy" Date: Wed, 21 Dec 2016 06:17:38 +0000 Message-ID: Subject: Re: suspend/resume on Skylake (Lenovo T460s) with FreeBSD11 stable To: Andreas Nilsson , Brandon Allbery Cc: Chris Ernst , Christian Schwarz , FreeBSD Stable Mailing List Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2016 06:45:28 -0000 You need a graphics driver that supports suspend. That's only going to be i915. Right now suspend / resume doesn't work in drm-next-4.7 for anything newer than Broadwell. Your two choices for Skylake are either to debug the issue in drm-next or add suspend / resume to sc or VT. I'm assuming that if the latter were easy someone would already have done it. On Mon, Dec 19, 2016 at 13:37 Brandon Allbery wrote: > On Mon, Dec 19, 2016 at 10:09 AM, Andreas Nilsson > > wrote: > > > > > my Lenovo X1 yoga exhibits the same traits, it does suspend, but graphics > > > are corrupted after resume. Machine usually is reachable over the network > > > though. > > > > > > > Isn't that related to sc vs. vt? Various video cards, notably many NVidia > > based, don't recover from suspend. sc can't reinitialize them. vt can, and > > knows how to reinit some cards but needs to be taught how to reinit others. > > > > -- > > brandon s allbery kf8nh sine nomine > associates > > allbery.b@gmail.com > ballbery@sinenomine.net > > unix, openafs, kerberos, infrastructure, xmonad > http://sinenomine.net > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > > From owner-freebsd-stable@freebsd.org Wed Dec 21 07:33:19 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2242BC8AE3A; Wed, 21 Dec 2016 07:33:19 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x242.google.com (mail-wm0-x242.google.com [IPv6:2a00:1450:400c:c09::242]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9E954188B; Wed, 21 Dec 2016 07:33:18 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x242.google.com with SMTP id g23so28835578wme.1; Tue, 20 Dec 2016 23:33:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=K2uFvCdQLAozHJBveM83HGVGsknGw/9aVU0V5mFw4Fg=; b=kg6f1U9YjVjVrXgOj9Zv9bxkct1bzGmkBjEp2y4K52lml9Bkoluvxjzf78IgfWC6Dn n/syUqlFOcO1ltwfct+kWde2QU1kAPb9pIeOyxoWnTHTsV4IGxGErNtiAGIabuMdhnPy rKH6oHfi5/OAN2EP2x5Qzh2I7ikuOPTQygf42XH867WgIBcOeaa1CM5QR6qwnZkQgGXF iALJzgKA0c+ohm3hABHgcQj+G938WX2Nc5VDV/iUx28URS4A9bzWlNY2v7IJ1xvEdUsJ kOR6s3r2iNKFJG1chh/G0EbSLcotmp9DfVr1y3qjwhwf4GBBoTcUCfwnpYehRytReTRJ IZTw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=K2uFvCdQLAozHJBveM83HGVGsknGw/9aVU0V5mFw4Fg=; b=YnMq9NYWUGYHHx4BfvQzjtU121u5X/v709/WKlaBtAUZ/rNMeAgGS8zIpj4/6bLsvM t927Rl/FHh6G0oKWMnNfnFwmefOCS415eKa0K7ZSgkE5ik679EIvXvx9U0ZmI+l1pcWH pxJOIZJO7sGsY1B+4qsqfWgM3PAe1l188/Qgp86qUjeS+onMsOlFnTTwY122jQSKXKOc YPJngAu04lwQ8PZIZy/yySCHHSb0Yt2glWinQ+WAcHQTQphIH0GRmgH7pWkir/b1empT kDw6cJG3Z1H1tUmAwBLZovx826p4dOfOakt8efJuNZzqPAQucyBqJIm5daDd79a5GVOY e4IQ== X-Gm-Message-State: AIkVDXLooLk8t7w73XzJbtpmnjaOe5TQP/oFR+D62yPQT4lCL99gi1TKBkejTHlsqwzELg== X-Received: by 10.28.169.74 with SMTP id s71mr5408777wme.1.1482305596948; Tue, 20 Dec 2016 23:33:16 -0800 (PST) Received: from ben.home (LFbn-1-7159-4.w90-116.abo.wanadoo.fr. [90.116.90.4]) by smtp.gmail.com with ESMTPSA id x188sm25622937wmx.4.2016.12.20.23.33.16 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 20 Dec 2016 23:33:16 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: NFS server hang with backing store on ZFS and quota nearly exhausted From: Ben RUBSON In-Reply-To: <22618.8208.273426.702678@hergotha.csail.mit.edu> Date: Wed, 21 Dec 2016 08:33:17 +0100 Cc: freebsd-stable@freebsd.org Content-Transfer-Encoding: 7bit Message-Id: References: <22618.8208.273426.702678@hergotha.csail.mit.edu> To: freebsd-fs X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2016 07:33:19 -0000 > On 21 Dec 2016, at 07:24, Garrett Wollman wrote: > > I don't know the ZFS code well enough to understand what running out > of quota has to do with this situation (you'd think it would just > return immediately with [EDQUOT]) but perhaps it matters that the > clients are not well-behaved and that the filesystem is often almost > at quota but not quite there yet. Hi Garrett, ZFS is slow when your are playing around the quota limit, due to how quota are implemented. See this thread : https://lists.freebsd.org/pipermail/freebsd-fs/2016-September/023874.html Ben From owner-freebsd-stable@freebsd.org Thu Dec 22 00:24:07 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED234C8B83C for ; Thu, 22 Dec 2016 00:24:07 +0000 (UTC) (envelope-from faturamento@ilhadejaguarium.online) Received: from rdns16.ilhadejaguarium.online (rdns16.ilhadejaguarium.online [78.157.194.178]) by mx1.freebsd.org (Postfix) with ESMTP id BEE29770 for ; Thu, 22 Dec 2016 00:24:07 +0000 (UTC) (envelope-from faturamento@ilhadejaguarium.online) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; s=default; d=ilhadejaguarium.online; h=From:Subject:To:Content-Type:Date:Message-Id; i=abuse@ilhadejaguarium.online; bh=MSneFpQDkrb2d9fV2aTt5CS8EhY=; b=wre/wbqxsRXzgnmxlbSyApDSuBzYVQDprONKZ7QHChqXVghb45g7Zycio1Wk/7uwPsNZv8E8h9L8 Z+zpF8xtYG5VmO5PLq4wQ13aaXfFD6p1JdDOUwNEt5EL5OzXoHtYDdVRHDv9NRgcn4NXkZSXddMd D/52OvbqqQfxrLL3ohM= From: "Setor Financeiro" Subject: Comprovante Bancario. To: freebsd-stable@freebsd.org Date: Wed, 21 Dec 2016 22:13:58 -0200 Message-Id: <20161221221356A875852347$9C52FA09CA@WINPC> Status: N MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 00:24:08 -0000 From owner-freebsd-stable@freebsd.org Thu Dec 22 06:51:32 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E3A58C8B5AC for ; Thu, 22 Dec 2016 06:51:32 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 6D97A12A7 for ; Thu, 22 Dec 2016 06:51:31 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from bsdrookie.norma.com. (CHAYKA-OP1.norma.com [IPv6:fd00::7af] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id uBM6pRZU011669 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Thu, 22 Dec 2016 11:51:27 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1482389487; bh=Q6HyW1pDswyhmarza+G6j19j8bjhLIGOBkfvEsUidT0=; h=To:From:Subject:Date; b=HoEgBUvPpMPogSjEOzjkx9VwLa0zWTCyNSMzUQGF3esQ7nIZV9V3qg+RGkssPOJZw cG/HD8+ztk5F+J7LUa1AW30ATFXmH1agD7vVRnE84M8G+wgnxQsifjRaoHEuxl4htE PLR0AgThQS5u1cjTkoWnm3tj+KHYAg26HoX5Nvo0= To: freebsd-stable From: "Eugene M. Zheganin" Subject: camcontrol rescan seems to be broken Message-ID: <585B77EF.2000805@norma.perm.ru> Date: Thu, 22 Dec 2016 11:51:27 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 06:51:33 -0000 Hi, could anyone tell me where am I wrong: # camcontrol rescan all camcontrol: CAMIOCOMMAND ioctl failed: Invalid argument # uname -U 1100122 # uname -K 1100122 # uname -a FreeBSD bsdrookie.norma.com. 11.0-RELEASE-p5 FreeBSD 11.0-RELEASE-p5 #0 r310364: Wed Dec 21 19:03:58 YEKT 2016 emz@bsdrookie.norma.com.:/usr/obj/usr/src/sys/BSDROOKIE amd64 # camcontrol devlist at scbus0 target 0 lun 0 (pass0,ada0) at scbus1 target 0 lun 0 (pass1,ada1) at scbus2 target 0 lun 0 (pass2,ada2) at scbus3 target 0 lun 0 (pass3,ada3) at scbus4 target 0 lun 0 (cd0,pass4) at scbus5 target 0 lun 0 (pass5,ses0) at scbus6 target 0 lun 0 (da0,pass6) # egrep 'ahci0|ada' /var/run/dmesg.boot ahci0: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xf7202000-0xf72027ff irq 19 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahciem0: on ahci0 ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA8-ACS SATA 3.x device ada0: Serial Number Z1D45ETV ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA8-ACS SATA 2.x device ada1: Serial Number 5XW0K4AP ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 1907729MB (3907029168 512 byte sectors) ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ATA8-ACS SATA 3.x device ada2: Serial Number Z1E2SLEV ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 1907729MB (3907029168 512 byte sectors) ada2: quirks=0x1<4K> ada3 at ahcich3 bus 0 scbus3 target 0 lun 0 ada3: ATA8-ACS SATA 2.x device ada3: Serial Number WD-WMAYP0516506 ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada3: Command Queueing enabled ada3: 476940MB (976773168 512 byte sectors) GEOM: ada3: the primary GPT table is corrupt or invalid. GEOM: ada3: using the secondary instead -- recovery strongly advised. GEOM_ELI: Device ada2p5.eli created. ahci0: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xf7202000-0xf72027ff irq 19 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahciem0: on ahci0 ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA8-ACS SATA 3.x device ada0: Serial Number Z1D45ETV ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors) ada0: quirks=0x1<4K> ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA8-ACS SATA 2.x device ada1: Serial Number 5XW0K4AP ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 1907729MB (3907029168 512 byte sectors) ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ATA8-ACS SATA 3.x device ada2: Serial Number Z1E2SLEV ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 1907729MB (3907029168 512 byte sectors) ada2: quirks=0x1<4K> ada3 at ahcich3 bus 0 scbus3 target 0 lun 0 ada3: ATA8-ACS SATA 2.x device ada3: Serial Number WD-WMAYP0516506 ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada3: Command Queueing enabled ada3: 476940MB (976773168 512 byte sectors) Thanks. Eugene. From owner-freebsd-stable@freebsd.org Thu Dec 22 09:11:44 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8EAC6C8C1C9 for ; Thu, 22 Dec 2016 09:11:44 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id DA3111595 for ; Thu, 22 Dec 2016 09:11:43 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from bsdrookie.norma.com. (CHAYKA-OP1.norma.com [IPv6:fd00::7af] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id uBM9BbOu021238 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Thu, 22 Dec 2016 14:11:38 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1482397898; bh=BN+jNkfxYNiabgG7nmhf1Ha2vHLuOc9SACmZDHywjV8=; h=To:From:Subject:Date; b=tcIdGWNLUJ/L0pMRA3ky5vaf7sspdaYa+tUawvu/MwiFHhCro9jlH0ZQkfIuQ3TEB NRb4ugsu0A4qE6nMhtpUpQesmB8ChyTM7QCPPtzszg/9Z0wm7UygvGDqvEeIsxGDYw TZfTeqSzWPnzggAATOSg+ZsAu23PN4s2y3ERjdxc= To: freebsd-stable From: "Eugene M. Zheganin" Subject: cannot detach vdev from zfs pool Message-ID: <585B98C9.4070607@norma.perm.ru> Date: Thu, 22 Dec 2016 14:11:37 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.7.0 MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 09:11:44 -0000 Hi, Recently I decided to remove the bogus zfs-inside-geli-inside-zvol pool, since it's now officially unsupported. So, I needed to reslice my disk, hence to detach one of the disks from a mirrored pool. I issued 'zpool detach zroot gpt/zroot1' and my system livelocked almost immidiately, so I pressed reset. Now I got this: # zpool status zroot pool: zroot state: DEGRADED status: One or more devices has been taken offline by the administrator. Sufficient replicas exist for the pool to continue functioning in= a degraded state. action: Online the device using 'zpool online' or replace the device with= 'zpool replace'. scan: resilvered 687G in 5h26m with 0 errors on Sat Oct 17 19:41:49 201= 5 config: NAME STATE READ WRITE CKSUM zroot DEGRADED 0 0 0 mirror-0 DEGRADED 0 0 0 gpt/zroot0 ONLINE 0 0 0 1151243332124505229 OFFLINE 0 0 0 was /dev/gpt/zroot1 errors: No known data errors This isn't a big deal by itself, since I was able to create second zfs pool and now I'm relocating my data to it, although I should say that this is very disturbing sequence of events, because I'm now unable to even delete the UNAVAIL vdev from the pool. I tried to boot from a FreeBSD USB stick and detach it there, but all I discovered was the fact that zfs subsystem locks up upon the command 'zpool detach zroot 1151243332124505229'. I waited for several minutes but nothing happened, furthermore subsequent zpool/zfs commands are hanging up too. Is this worth submitting a pr, or may be it does need additional investigation ? In general I intend to destroy this pool after relocation it, but I'm afraid someone (or even myself again) could step on this later. Both disks are healthy, and I don't see the complains in dmesg. I'm running a FreeBSD 11.0-release-p5 here. The pool was initialy created somewhere under 9.0 I guess. Thanks. Eugene. From owner-freebsd-stable@freebsd.org Thu Dec 22 16:26:39 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 66F8BC8C737 for ; Thu, 22 Dec 2016 16:26:39 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-qk0-x22b.google.com (mail-qk0-x22b.google.com [IPv6:2607:f8b0:400d:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 23B0212F0 for ; Thu, 22 Dec 2016 16:26:39 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-qk0-x22b.google.com with SMTP id u25so108174666qki.2 for ; Thu, 22 Dec 2016 08:26:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=PF4HgfGS1+mfkIDO7AuQkWIvEGI4Tdy7dePY2KTHZ/g=; b=bN2LfLu6DTbaxaFw4Ing0WMHkB1AIlXHpZnXSZ8V9zEsw+HynindrkkRQdLE9/iR1k qlMlMbBscwiiV4rc9I/9PlbQbhBbNFNLjhsaFsQd7ynsTbE3RnVvXaPefzEqRSLU5oaj CXr18CUZ6joZxvIeny69tkQuI0HZrVkUvaf1vmysfvCOyw38owC1DHZCoQ2ZTsmkxCrr T9TTk51NZppdoLld0a/cVjmssUDGuUa5juc59EiYIjXxpsH9bqit0BCVl/ntOl7C58V0 aT+Bq0xofJ/62kAa8xYyycMKPcCgZvJ4HhUl0+/XbFSKW8oraBv8X2YRkJsHks8bgg+e 68VA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=PF4HgfGS1+mfkIDO7AuQkWIvEGI4Tdy7dePY2KTHZ/g=; b=k2kRpzswk0E1Pv3p6l8GD135rMe+sQTiQdrgYzM4cvGp9I9p0acQs14erzQGHf+muI WxUj6FvqU/YnonIrQVxkof/OpQE1el1Pv0O4BHm4xlhG7dLNfyOH5yrYJ3QUTva3cqlC hgUDTpMbq7Ox9Qk1GE+QOzu0v0meP59UODS3QexWK2GKkvq5a0ibDRzkkjjn+3A4346c tGkk6Q3qz7S8n7oMouCcAvM3wq2CdSPODyKC/v1+7F9FMHKtk+cFub122zH7fzOGIPTV b39gsxrF7G/a9VXdqL8HVMf0vLLLw2KH3hE79PPZ06aF9t3oeg7fMYQVOdhmaEWBSG4T yRqA== X-Gm-Message-State: AIkVDXLwW8CWpYz/ehsAw2BWrFlvAevDQyAARmdc61XlnFPQnzkvbdlRz1DrQz85YDsR9QtBCUoNhNbptgfzcg== X-Received: by 10.55.12.19 with SMTP id 19mr11967749qkm.100.1482423998210; Thu, 22 Dec 2016 08:26:38 -0800 (PST) MIME-Version: 1.0 Sender: asomers@gmail.com Received: by 10.12.181.208 with HTTP; Thu, 22 Dec 2016 08:26:37 -0800 (PST) In-Reply-To: <585B98C9.4070607@norma.perm.ru> References: <585B98C9.4070607@norma.perm.ru> From: Alan Somers Date: Thu, 22 Dec 2016 09:26:37 -0700 X-Google-Sender-Auth: gq0_eXYr-0B4PUNQ1OnaHgzZpnQ Message-ID: Subject: Re: cannot detach vdev from zfs pool To: "Eugene M. Zheganin" Cc: freebsd-stable Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 16:26:39 -0000 On Thu, Dec 22, 2016 at 2:11 AM, Eugene M. Zheganin wrote: > Hi, > > Recently I decided to remove the bogus zfs-inside-geli-inside-zvol pool, > since it's now officially unsupported. So, I needed to reslice my disk, > hence to detach one of the disks from a mirrored pool. I issued 'zpool > detach zroot gpt/zroot1' and my system livelocked almost immidiately, so > I pressed reset. Now I got this: > > # zpool status zroot > pool: zroot > state: DEGRADED > status: One or more devices has been taken offline by the administrator. > Sufficient replicas exist for the pool to continue functioning in a > degraded state. > action: Online the device using 'zpool online' or replace the device with > 'zpool replace'. > scan: resilvered 687G in 5h26m with 0 errors on Sat Oct 17 19:41:49 2015 > config: > > NAME STATE READ WRITE CKSUM > zroot DEGRADED 0 0 0 > mirror-0 DEGRADED 0 0 0 > gpt/zroot0 ONLINE 0 0 0 > 1151243332124505229 OFFLINE 0 0 0 was > /dev/gpt/zroot1 > > errors: No known data errors > > This isn't a big deal by itself, since I was able to create second zfs > pool and now I'm relocating my data to it, although I should say that > this is very disturbing sequence of events, because I'm now unable to > even delete the UNAVAIL vdev from the pool. I tried to boot from a > FreeBSD USB stick and detach it there, but all I discovered was the fact > that zfs subsystem locks up upon the command 'zpool detach zroot > 1151243332124505229'. I waited for several minutes but nothing happened, > furthermore subsequent zpool/zfs commands are hanging up too. > > Is this worth submitting a pr, or may be it does need additional > investigation ? In general I intend to destroy this pool after > relocation it, but I'm afraid someone (or even myself again) could step > on this later. Both disks are healthy, and I don't see the complains in > dmesg. I'm running a FreeBSD 11.0-release-p5 here. The pool was initialy > created somewhere under 9.0 I guess. > > Thanks. > Eugene. I'm not surprised to see this kind of error in a ZFS on GELI on Zvol pool. ZFS on Zvols has known deadlocks, even without involving GELI. GELI only makes it worse, because it foils the recursion detection in zvol_open. I wouldn't bother opening a PR if I were you, because it probably wouldn't add any new information. Sorry it didn't meet your expectations, -Alan From owner-freebsd-stable@freebsd.org Thu Dec 22 16:33:22 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5F5E1C8CC26 for ; Thu, 22 Dec 2016 16:33:22 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id CEDFE1892 for ; Thu, 22 Dec 2016 16:33:21 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from [IPv6:2a02:2698:25:3ab8:74b0:74:e9f4:52df] ([IPv6:2a02:2698:25:3ab8:74b0:74:e9f4:52df]) (authenticated bits=0) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPSA id uBMGXF9I040996 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Thu, 22 Dec 2016 21:33:15 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1482424395; bh=ZQsz5LrMdD/EIEa6WavtZwnWXAMvcn50Yqzu8Zxr+pA=; h=Subject:To:References:From:Date:In-Reply-To; b=fw60P1n+Zp1HVTkdx8dEI3JfC1gWrtxoffBdIFZyddo6CWkB/sGZrC1DKobknJyRG MQ7frx0bZPrnHALbrwEiBKMwe5CAoBcMi3/t0GwxLbWNGKuqmWadgmFWyXvZ9HvMjy CYnxfCzU9g4XfS5ldu2H2TgyXJF3Ct7awkO0SdoM= Subject: Re: cannot detach vdev from zfs pool To: freebsd-stable References: <585B98C9.4070607@norma.perm.ru> From: "Eugene M. Zheganin" Message-ID: <9f21d484-b6d9-7434-b23b-c21c17a469c1@norma.perm.ru> Date: Thu, 22 Dec 2016 21:33:20 +0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 16:33:22 -0000 Hi. On 22.12.2016 21:26, Alan Somers wrote: > I'm not surprised to see this kind of error in a ZFS on GELI on Zvol > pool. ZFS on Zvols has known deadlocks, even without involving GELI. > GELI only makes it worse, because it foils the recursion detection in > zvol_open. I wouldn't bother opening a PR if I were you, because it > probably wouldn't add any new information. > > Sorry it didn't meet your expectations, > -Alan Oh, so that's why it happened. Okay, that's pertfectly fine with me. Thanks. Eugene. From owner-freebsd-stable@freebsd.org Thu Dec 22 16:37:07 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BD232C8CE50 for ; Thu, 22 Dec 2016 16:37:07 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 24F211B22 for ; Thu, 22 Dec 2016 16:37:06 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from [IPv6:2a02:2698:25:3ab8:74b0:74:e9f4:52df] ([IPv6:2a02:2698:25:3ab8:74b0:74:e9f4:52df]) (authenticated bits=0) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPSA id uBMGb3Ej041120 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Thu, 22 Dec 2016 21:37:04 +0500 (YEKT) (envelope-from emz@norma.perm.ru) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=norma.perm.ru; s=key; t=1482424624; bh=+vJb0QhZ9+zzl9yOuUHj2MXKidOorKkOC+m/md9SQkY=; h=Subject:To:References:From:Date:In-Reply-To; b=btgay+bDa2rJORccmoGigBbXK6N2OuHBEGH8g138SlNx8DAEST28s7bGOuTlXK3c3 6W8Hl+dkssN8NZessBg0EZxfcWT4WcysdoJZnCFReAHgL/ZZTlOT37kDpdxo4VYf41 +YJz3i14eD9dImorc27Hz0ABjxuuzPeZN3PiPmdU= Subject: Re: camcontrol rescan seems to be broken To: freebsd-stable@freebsd.org References: <585B77EF.2000805@norma.perm.ru> From: "Eugene M. Zheganin" Message-ID: <34645c95-2b83-c92b-0195-c1fae9b28df4@norma.perm.ru> Date: Thu, 22 Dec 2016 21:37:09 +0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 In-Reply-To: <585B77EF.2000805@norma.perm.ru> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 16:37:07 -0000 Hi. On 22.12.2016 11:51, Eugene M. Zheganin wrote: > Hi, > > could anyone tell me where am I wrong: > > # camcontrol rescan all > camcontrol: CAMIOCOMMAND ioctl failed: Invalid argument > # uname -U > 1100122 > # uname -K > 1100122 > # uname -a > FreeBSD bsdrookie.norma.com. 11.0-RELEASE-p5 FreeBSD 11.0-RELEASE-p5 #0 > r310364: Wed Dec 21 19:03:58 YEKT 2016 > emz@bsdrookie.norma.com.:/usr/obj/usr/src/sys/BSDROOKIE amd64 > Furthermore, there's definitely something wrong on my machine, because smartctl complains too: # smartctl -a /dev/ada1 smartctl 6.4 2015-06-04 r4109 [FreeBSD 11.0-RELEASE-p5 amd64] (local build) Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org error sending CAMIOCOMMAND ioctl: Inappropriate ioctl for device # smartctl -a /dev/ada0 smartctl 6.4 2015-06-04 r4109 [FreeBSD 11.0-RELEASE-p5 amd64] (local build) Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org error sending CAMIOCOMMAND ioctl: Inappropriate ioctl for device Unable to get CAM device list /dev/ada0: Unable to detect device type Please specify device type with the -d option. Use smartctl -h to get a usage summary ktrace part, if it will help: [...] 4291 smartctl NAMI "/dev/xpt0" 4291 smartctl RET openat 3 4291 smartctl CALL ioctl(0x3,0xc4d81802,0x7fffffffa978) 4291 smartctl RET ioctl -1 errno 25 Inappropriate ioctl for device Does anyone have an idea on how to fix things back to normal ? Thanks. From owner-freebsd-stable@freebsd.org Thu Dec 22 17:12:20 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA695C8D604 for ; Thu, 22 Dec 2016 17:12:20 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: from mail-lf0-x233.google.com (mail-lf0-x233.google.com [IPv6:2a00:1450:4010:c07::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 355A1E66 for ; Thu, 22 Dec 2016 17:12:20 +0000 (UTC) (envelope-from alexvpetrov@gmail.com) Received: by mail-lf0-x233.google.com with SMTP id c13so123122206lfg.0 for ; Thu, 22 Dec 2016 09:12:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding; bh=wfrwtcyhuCttebHY+CVaVEFvcSmrMz1S3Mxo8105Mo8=; b=BZV5B0f61D6pqTETSxNnEPcJuJo8uoWotzhQWvkatStgbXVus33TnKiHcapNWIh6Mc p2TH76DN6lRASLpvKXbQ25ayBnDddE2Flm3qiRXBiKnaieJ/e4PCCPHvaY5yQrZAaAmz UWXp3hOHVKhzwGJZZG1B8b0plb+mIqXBrxrYCaS5CSRMm0qUyJfWJqAWAw2NYGmpciY3 919dxwB+Tx4APATMb2kEUX4O1FBmAa2kAqRIrtvbr1pLUHxa5NoPHJCz67GBRjZlZ9ST S0zR/f0NAtWuJr8nM7D+v026Z7znvN+L+5alvz/emGwwIllR8O79F3UKLBKliuqY/3Xy dONA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding; bh=wfrwtcyhuCttebHY+CVaVEFvcSmrMz1S3Mxo8105Mo8=; b=H6ovWUjHLRr8NrAJICQxEegpllA96huyS/GlYuzsF1m0QP/cAKzbj4CEuuBqXII4dJ HVzHtYMpTxOO5ooItqPwF1xM7Pvuf9wToMzSy/xOIDyt48TiZXrvvJbyEI4pmh9PU4a8 lIe9J2h9oQkz/bvbYNz1AgQu8aBFEHncdpiaOYE3rBXuVfz01Y+G9OZVS+AGORdgDipg Ba1XFnftQdgmP08ASDrA8RwE4wqQyh2S0kWnz9e0fyyTOVvmt/KvcXElJiRcMDwCYeYP tq05KZs7YMNzrDwgI4viQoE+YFykDPzmyHIgpXubYJ5wsv4OrcdITMdLC5taQ/0ARTOA 2vZg== X-Gm-Message-State: AIkVDXIO5J3fKMVyhp2MR6f+ODW8VUjAcE0quZajeAtfn1bG6a1lZ9afGTIn0JHK0fPuXw== X-Received: by 10.46.78.1 with SMTP id c1mr4688230ljb.39.1482426737477; Thu, 22 Dec 2016 09:12:17 -0800 (PST) Received: from alex.super (stone.g-service.ru. [84.22.141.217]) by smtp.googlemail.com with ESMTPSA id v9sm7194894lja.0.2016.12.22.09.12.16 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 22 Dec 2016 09:12:17 -0800 (PST) To: freebsd-stable@freebsd.org From: "Alex V. Petrov" Subject: 11-stable on AMD FX-8370 Eight-Core Processor no cpufreq support Message-ID: <9f4172f0-b2ba-6d79-62a9-7d245798dba3@gmail.com> Date: Fri, 23 Dec 2016 00:12:15 +0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 17:12:20 -0000 After about 6 nov 2016 stoped work powerd and powerd++ # service powerd onestart Starting powerd. powerd: no cpufreq(4) support -- aborting: No such file or directory /etc/rc.d/powerd: WARNING: failed to start powerd # service powerd++ onestart Starting powerdxx. powerd++: (ENOFREQ) at least the first CPU core must support frequency updates /usr/local/etc/rc.d/powerd++: WARNING: failed to start powerdxx -- ----- Alex. From owner-freebsd-stable@freebsd.org Thu Dec 22 18:03:39 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F2FD7C8BD9B for ; Thu, 22 Dec 2016 18:03:39 +0000 (UTC) (envelope-from bounce@ims2.isendservice.com.br) Received: from ims2.isendservice.com.br (ims2.isendservice.com.br [54.232.111.224]) by mx1.freebsd.org (Postfix) with ESMTP id 7A8401EE5 for ; Thu, 22 Dec 2016 18:03:39 +0000 (UTC) (envelope-from bounce@ims2.isendservice.com.br) Received: from localhost (localhost [127.0.0.1]) by ims2.isendservice.com.br (Postfix) with ESMTP id 7D41F43C01 for ; Thu, 22 Dec 2016 15:49:55 -0200 (BRST) Date: Thu, 22 Dec 2016 15:49:55 -0200 (BRST) From: FIERGS | FATEC - Faculdade SENAI de Tecnologia Reply-To: joel.ferreira@senairs.org.br To: freebsd-stable@freebsd.org Message-ID: <1151089581.51652.1482428995324.JavaMail.root@ims2> Subject: =?ISO-8859-1?Q?O_Que_Voc=EA_Quer_ser_Amanh=E3=3F_Curso?= =?ISO-8859-1?Q?s_T=E9cnicos_2017_na_Faculdade_SENAI?= bounce-key: <2420-22522874-1488733> MIME-Version: 1.0 Content-Type: text/plain; charset="ISO-8859-1" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 18:03:40 -0000 From owner-freebsd-stable@freebsd.org Thu Dec 22 18:46:16 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13FF9C8D04B for ; Thu, 22 Dec 2016 18:46:16 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-io0-x234.google.com (mail-io0-x234.google.com [IPv6:2607:f8b0:4001:c06::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CCB40233 for ; Thu, 22 Dec 2016 18:46:15 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-io0-x234.google.com with SMTP id h133so817118ioe.3 for ; Thu, 22 Dec 2016 10:46:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=FVX1yXnuTNI2KNPxnWm8ETOpFAvDstEYP8e4M8NrzB8=; b=q9KNAC6E2HZKAXoA8xDBY6cevQ44O26SW2iCWqhPVRR1IB5xIlveQzrZiBfkD4Fwsl 6KShSsOIAoZnn6lruSzL7bOxFIlWxmQ8mZaVbUNY0N0/UrtUrGzOYv9ZFsb7EpSCJXQG rhoJd5Xiq2Lpno4quGw59pxTMNPWU+tjZstvhQjVqb6/XlSrkhKXVCcKTMqyhjpT7xlQ 4qXNPlfUQT+n1QGRNqZxRG6SYMFG40fDGC/+f83Vvrgs7DZfYCtmPVJ9m7PPPCpECt3R mV+ILtJJxHjNycJhd5M7aLaVnmj/9zXLjblG+IKxU0OXcF/n1PC339n9l79DPEjrqq67 2nAw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=FVX1yXnuTNI2KNPxnWm8ETOpFAvDstEYP8e4M8NrzB8=; b=jhIZuQ+PjCzrIZnDjADTT5ozxjNfcsLisZ6zD6M7p9VHTrPsmyYzRIAHiDxfx9Z/tZ hbAbwqzKUkOvjqkr8H7CCOsz9rUlUgZVn2TD5txqtkem0d2qr5l8QXjVEh64gE4B+SCD lTGGevJSpy+PT0EB9oJWqLDgEIeNqq3FTtbHBBKvgLAX5vudnHYM9aMGfLAB94K83bnx Tajlsu5VhqlpeaoAzi1+SErRZE2jSx6GpODf1J49vAXYRdLn+70C5vg0a02kxfxSj6Ib DViGPZXzxOxdGi76yhYXfhOTdBw3cT/O7xhdONB4HwSUwnLL44i3p9pZNIJMIdaqHT0U 2j1w== X-Gm-Message-State: AIkVDXJEA47WQgNDtxrILY430DXDtgUAHGWMCpPoDPyr14zkFG6kbVuap2peG4+1t90RK5S1R1LSvgoONKQZ+w== X-Received: by 10.107.139.74 with SMTP id n71mr11748653iod.166.1482432375077; Thu, 22 Dec 2016 10:46:15 -0800 (PST) MIME-Version: 1.0 Sender: wlosh@bsdimp.com Received: by 10.79.22.135 with HTTP; Thu, 22 Dec 2016 10:46:14 -0800 (PST) X-Originating-IP: [69.53.245.200] In-Reply-To: <34645c95-2b83-c92b-0195-c1fae9b28df4@norma.perm.ru> References: <585B77EF.2000805@norma.perm.ru> <34645c95-2b83-c92b-0195-c1fae9b28df4@norma.perm.ru> From: Warner Losh Date: Thu, 22 Dec 2016 11:46:14 -0700 X-Google-Sender-Auth: P5eXwLZu3kpQ9QJItLLd7nrTfEc Message-ID: Subject: Re: camcontrol rescan seems to be broken To: "Eugene M. Zheganin" Cc: FreeBSD-STABLE Mailing List Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 18:46:16 -0000 Sure sounds like your binaries are cross-threaded with the kernel. what was "file `which camcontrol`" tell you? Warner On Thu, Dec 22, 2016 at 9:37 AM, Eugene M. Zheganin wrote: > Hi. > > On 22.12.2016 11:51, Eugene M. Zheganin wrote: >> >> Hi, >> >> could anyone tell me where am I wrong: >> >> # camcontrol rescan all >> camcontrol: CAMIOCOMMAND ioctl failed: Invalid argument >> # uname -U >> 1100122 >> # uname -K >> 1100122 >> # uname -a >> FreeBSD bsdrookie.norma.com. 11.0-RELEASE-p5 FreeBSD 11.0-RELEASE-p5 #0 >> r310364: Wed Dec 21 19:03:58 YEKT 2016 >> emz@bsdrookie.norma.com.:/usr/obj/usr/src/sys/BSDROOKIE amd64 >> > Furthermore, there's definitely something wrong on my machine, because > smartctl complains too: > > # smartctl -a /dev/ada1 > smartctl 6.4 2015-06-04 r4109 [FreeBSD 11.0-RELEASE-p5 amd64] (local build) > Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org > > error sending CAMIOCOMMAND ioctl: Inappropriate ioctl for device > > # smartctl -a /dev/ada0 > smartctl 6.4 2015-06-04 r4109 [FreeBSD 11.0-RELEASE-p5 amd64] (local build) > Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org > > error sending CAMIOCOMMAND ioctl: Inappropriate ioctl for device > Unable to get CAM device list > /dev/ada0: Unable to detect device type > Please specify device type with the -d option. > > Use smartctl -h to get a usage summary > > ktrace part, if it will help: > > [...] > 4291 smartctl NAMI "/dev/xpt0" > 4291 smartctl RET openat 3 > 4291 smartctl CALL ioctl(0x3,0xc4d81802,0x7fffffffa978) > 4291 smartctl RET ioctl -1 errno 25 Inappropriate ioctl for device > > Does anyone have an idea on how to fix things back to normal ? > > Thanks. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Thu Dec 22 19:07:09 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A8F7DC8D8BC for ; Thu, 22 Dec 2016 19:07:09 +0000 (UTC) (envelope-from bounce@ims11.isendservice.com.br) Received: from ims11.isendservice.com.br (ims11.isendservice.com.br [54.232.115.234]) by mx1.freebsd.org (Postfix) with ESMTP id 36107145D for ; Thu, 22 Dec 2016 19:07:09 +0000 (UTC) (envelope-from bounce@ims11.isendservice.com.br) Received: from localhost (localhost [127.0.0.1]) by ims11.isendservice.com.br (Postfix) with ESMTP id 8F1FB44E90 for ; Thu, 22 Dec 2016 16:45:54 -0200 (BRST) Date: Thu, 22 Dec 2016 16:45:54 -0200 (BRST) From: FIERGS | FATEC - Faculdade SENAI de Tecnologia Reply-To: faculdadesenai@senairs.org.br To: freebsd-stable@freebsd.org Message-ID: <830309631.714002.1482432354579.JavaMail.root@ims11> Subject: =?ISO-8859-1?Q?Vestibular_SENAI_2017/1_-_Oportunidade_de_50?= =?ISO-8859-1?Q?%_de_desconto_no_1=BA_semestre_para_Diplomados?= bounce-key: <2420-22522874-1489714> MIME-Version: 1.0 Content-Type: text/plain; charset="ISO-8859-1" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 19:07:09 -0000 From owner-freebsd-stable@freebsd.org Fri Dec 23 13:56:46 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2BEF8C8E3D1 for ; Fri, 23 Dec 2016 13:56:46 +0000 (UTC) (envelope-from 577d0b42b4b86a5adf76f31f_68144@jhaibf.nihrod.com) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 115BC15F7 for ; Fri, 23 Dec 2016 13:56:46 +0000 (UTC) (envelope-from 577d0b42b4b86a5adf76f31f_68144@jhaibf.nihrod.com) Received: by mailman.ysv.freebsd.org (Postfix) id 0DCB1C8E3D0; Fri, 23 Dec 2016 13:56:46 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0D6B3C8E3CF for ; Fri, 23 Dec 2016 13:56:46 +0000 (UTC) (envelope-from 577d0b42b4b86a5adf76f31f_68144@jhaibf.nihrod.com) Received: from hgdeo.jhaibf.nihrod.com (hgdeo.jhaibf.nihrod.com [50.19.97.238]) by mx1.freebsd.org (Postfix) with ESMTP id DB35115F6 for ; Fri, 23 Dec 2016 13:56:45 +0000 (UTC) (envelope-from 577d0b42b4b86a5adf76f31f_68144@jhaibf.nihrod.com) Received: by hgdeo.jhaibf.nihrod.com (MailerWeb, from userid 106) id 4808971D7C; Fri, 23 Dec 2016 11:56:06 -0200 (BRST) Received: from localhost (localhost [127.0.0.1]) (Authenticated sender: mailer@mlsender.com) by hgdeo.jhaibf.nihrod.com (MailerWeb) with ESMTPA id 52E897170D for ; Fri, 23 Dec 2016 11:50:36 -0200 (BRST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nihrod.com; s=mailer; t=1482501036; bh=wkvMNY4Qug1Wd7hPrpgAORNTAXMJeVCCFGNjM4PcaO4=; h=From:To:Reply-To:Subject:List-Unsubscribe:Date; b=DBDnzpcS18X+thilHzLaB6MgFEzPFaps6KcuHSe661mclzU/sZzd4QCO5nN7o06WS 5KOK7xVpfBT3bquT927mX++yi6lh4279x1oeDruDrnz/AXcyYCD8Iqz+wcfpsu+fBA iDqH4y/q0U/CDtRHMwW29Ft+ApTuvjqFDIDj51YE= MIME-Version: 1.0 From: "Netself" To: "stable@freebsd.org" Reply-To: Subject: =?utf-8?q?Feliz_Natal_e_um_Ano_Novo_com_muitas_realiza=C3=A7=C3=B5?= =?utf-8?q?es?= Errors-To: <577d0b42b4b86a5adf76f31f_68144@jhaibf.nihrod.com> X-Identity: 577d0b42b4b86a5adf76f31f_68144 Precedence: bulk Date: Fri, 23 Dec 2016 11:50:36 -0200 Sender: "Netself" Feedback-ID: 577d0b42b4b86a5adf76f31f_68144:adf76f31f_68144 Message-Id: <20161223135036.52E897170D@hgdeo.jhaibf.nihrod.com> Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Dec 2016 13:56:46 -0000 = = = = = Caso não esteja visualizando corretamente esta mensagem, acesse aqu= i.   = = = = Feliz Natal e um Ano Novo com muitas realizações, são nos= sos votos para toda sua família ! !   =     Netself Consultoria de Negócios Gilberto Silveira Piccina SOLUÇOÊS E BENEFÍCIOS PARA VOCÊ, SUA FAMILIA E SUA E= MPRESA Praça das Flores, 40 - Centro Comercial Alphaville - Barueri - SP Tel (011) : 3441-3151 -  99930-1785 Oi e Whatsapp - 94172-2901= Vivo - 95371-3788 Tim  - 99377-1741 Claro www.netself.com.br   -  contato@netself.com.br.   = = = Este e-mail foi enviado para stable@freebsd.org. Se voc&= #234; não deseja mais receber nossos e-mails, cancele sua inscriç= ;ão aqui.Esta mensagem foi enviada por NETSELF Consultoria de Negó= ;cios utilizando Mailerweb. A Mailerweb não se responsabiliza pelo con= teúdo dessa mensagem = =