From owner-freebsd-stable@freebsd.org Sun Feb 7 01:10:32 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A36F1A9FB3D for ; Sun, 7 Feb 2016 01:10:32 +0000 (UTC) (envelope-from marius@alchemy.franken.de) Received: from alchemy.franken.de (alchemy.franken.de [194.94.249.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "alchemy.franken.de", Issuer "alchemy.franken.de" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 3D2231E96 for ; Sun, 7 Feb 2016 01:10:31 +0000 (UTC) (envelope-from marius@alchemy.franken.de) Received: from alchemy.franken.de (localhost [127.0.0.1]) by alchemy.franken.de (8.15.2/8.15.2/ALCHEMY.FRANKEN.DE) with ESMTPS id u170fWfh032312 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 7 Feb 2016 01:41:32 +0100 (CET) (envelope-from marius@alchemy.franken.de) Received: (from marius@localhost) by alchemy.franken.de (8.15.2/8.15.2/Submit) id u170fVMs032311; Sun, 7 Feb 2016 01:41:31 +0100 (CET) (envelope-from marius) Date: Sun, 7 Feb 2016 01:41:31 +0100 From: Marius Strobl To: Mike Tancsa Cc: FreeBSD-STABLE Mailing List Subject: Re: possible em regression (was Re: svn commit: r294958 - in stable/10: share/man/man4 sys/dev/e1000 sys/dev/ixgb sys/dev/netmap) Message-ID: <20160207004131.GM15359@alchemy.franken.de> References: <201601272231.u0RMV8LW019394@repo.freebsd.org> <56ABAA92.5050901@sentex.net> <56ABB291.5040305@omnilan.de> <56ABCE95.3030807@sentex.net> <20160130012358.GY15359@alchemy.franken.de> <56ACE917.80502@sentex.net> <20160130172618.GA15359@alchemy.franken.de> <56B0C217.1070706@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <56B0C217.1070706@sentex.net> User-Agent: Mutt/1.5.24 (2015-08-30) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (alchemy.franken.de [0.0.0.0]); Sun, 07 Feb 2016 01:41:32 +0100 (CET) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Feb 2016 01:10:32 -0000 On Tue, Feb 02, 2016 at 09:49:59AM -0500, Mike Tancsa wrote: > On 1/30/2016 12:26 PM, Marius Strobl wrote: > > On Sat, Jan 30, 2016 at 11:47:19AM -0500, Mike Tancsa wrote: > >> On 1/29/2016 8:23 PM, Marius Strobl wrote: > >>> On Fri, Jan 29, 2016 at 03:41:57PM -0500, Mike Tancsa wrote: > >>>> > >>>> No multi queue. Stock GENERIC kernel with a couple of things removed. > >>>> hw.em are just the defaults. I will try without TSO > >>>> > >>>> % ifconfig em0 > >>>> em0: flags=8843 metric 0 mtu 1500 > >>>> > >>>> options=4209b > >>>> > >>> > >>> Hrm, that's strange, TSO4 should be enabled by default so apparently > >>> you are already disabling it; what is the behavior if you turn it on? > >>> Do you use a < Gigabit link? > >> > >> Hi Marius, > >> Thanks for looking. The ifconfig output was after I turned off tso as > >> Harry suggested to try. Its been 24hrs and I have not seen any resets. > >> I will wait another 36hrs or so and then turn it back on to see if the > >> problem comes back. > >> > >> this link is 100Mb. > > > > Ah, okay, that at least makes sense. Can you please verify that with > > the attached patch applied, you have a setup that works out of the > > box? > > Hi, > Should the nic come up with TSO disabled by default ? After reboot, I see > Yes, that's expected; the default still is to enable TSO4, but with the patch, em(4) will silently ignore/disable administratively set TSO4 if the link speed negotiated is < Gigabit Ethernet. However, could you please do an experiment? Revert the patch again and in if_em.h change EM_MAX_SCATTER from 64 to 40, recompile and test. Thanks Marius From owner-freebsd-stable@freebsd.org Sun Feb 7 01:23:36 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED84CAA0315 for ; Sun, 7 Feb 2016 01:23:36 +0000 (UTC) (envelope-from mckusick@mckusick.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id DDAD517F8 for ; Sun, 7 Feb 2016 01:23:36 +0000 (UTC) (envelope-from mckusick@mckusick.com) Received: by mailman.ysv.freebsd.org (Postfix) id DC827AA0314; Sun, 7 Feb 2016 01:23:36 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DC188AA0313 for ; Sun, 7 Feb 2016 01:23:36 +0000 (UTC) (envelope-from mckusick@mckusick.com) Received: from chez.mckusick.com (chez.mckusick.com [IPv6:2001:5a8:4:7e72:d250:99ff:fe57:4030]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 900B117F7; Sun, 7 Feb 2016 01:23:36 +0000 (UTC) (envelope-from mckusick@mckusick.com) Received: from chez.mckusick.com (localhost [IPv6:::1]) by chez.mckusick.com (8.15.2/8.14.9) with ESMTP id u171NYxe005594; Sat, 6 Feb 2016 17:23:34 -0800 (PST) (envelope-from mckusick@chez.mckusick.com) Message-Id: <201602070123.u171NYxe005594@chez.mckusick.com> From: Kirk McKusick To: Thierry Thomas Subject: Re: 10-STABLE hangups frequently cc: Konstantin Belousov , Hajimu UMEMOTO , stable@FreeBSD.org In-reply-to: <20160202183913.GG8270@graf.pompo.net> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <5592.1454808214.1@chez.mckusick.com> Content-Transfer-Encoding: quoted-printable Date: Sat, 06 Feb 2016 17:23:34 -0800 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Feb 2016 01:23:37 -0000 > Date: Tue, 2 Feb 2016 19:39:14 +0100 > From: Thierry Thomas > To: Hajimu UMEMOTO > Cc: stable@FreeBSD.org, mckusick@FreeBSD.org > Subject: Re: 10-STABLE hangups frequently > = >> Hi, > = > Hello, > = >> I'm disturbed by a frequent hangup of my 10-STABLE boxes since this >> year. It seems occur during running the periodic daily scripts. >> I've narrowed which commit causes this problem. It seems r292895 >> causes it. I see many `Resource temporarily unavailable' message just >> before hangup occurs. >> Any idea? > = > Not exactly the same problem, but it is also occuring during periodic > daily: > > = > and also: > > = > I'm also experiencing problems during daily periodic on a -STABLE box, > but no kernel panics: the machine is frozen, and no login is possible, I > have to hard reboot it. > = > For the time being, I have commented out almost every entry in > periodic.conf, and I'm trying to find the culprit. > = > Regards, > -- > Th. Thomas. Please let me know if you are able to come up with an example that shows the problem as that would give me something with which to try to track down the problem. Kirk McKusick From owner-freebsd-stable@freebsd.org Sun Feb 7 09:08:27 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 84BEAAA1C0B for ; Sun, 7 Feb 2016 09:08:27 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-ig0-x22c.google.com (mail-ig0-x22c.google.com [IPv6:2607:f8b0:4001:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5021F174E for ; Sun, 7 Feb 2016 09:08:27 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: by mail-ig0-x22c.google.com with SMTP id 5so40899432igt.0 for ; Sun, 07 Feb 2016 01:08:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=0PHxPRbCu2UVksFKMwuHcjEVc7cdUGvR/gK08drmneA=; b=I8GP7AJxlMI4jhA3r7xA1fnYlBezXy9x2zkyzHPK+9+5431krYTlEYv5PeygCPStpM LEeFYTp6GrgdpoXnEVAnWSf8SWpFBixs+ybE3NWDinwVVDyhXxVW5VBa9+O4CZxpEJju 2bHbUMshPkEuaTsDRNqKUcoN5S09+XdItJQkMierOIGOOtMN3vhUixU3mVR6UyRd+m8E ZioatMknXWzeJZilCoR5SsobrHI8VezO9MG5GbJqNNx0EnwqFLi9grRVWZY3Yj/HAClX hj5ay71c+Owxl3/r2N95b40mqPwVGBbuep7h6U8R33vS6vwjFqEHzbLrTqraetL9YygG ws7A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=0PHxPRbCu2UVksFKMwuHcjEVc7cdUGvR/gK08drmneA=; b=S3TDVoDxzWTZW/TfO5TWiO9tv2xYJ+J4yhRsB/GWSCySl0FQM0HdQ+feZ2ph+dHahK ss3zwSqiDRQXTp20SRZyGTMz9I9VXpT5tz23KQ1qaE9gZZk2rROat8NRfBeO0j96uF/O FBP8sliophGexTbZAf2rv+6DW1zMMp2cVrX8CcZLPGNnYjUdWTio9tl71BLt+ZPfNeCq RXvZPRPlxMcsPoTd5yCMNcKanS/uAf9Vyzu8ZXjuG+lx7g+cOWun6dw04DDLIdKcksMm /08eyeet3mSwULDCuB5e5aJt6CApWJIgvWpjyh3SwavZy++Vu06VcDyusEBG1n1RIvFg +25Q== X-Gm-Message-State: AG10YOQjZpJizcXaykPxi7ZjfV420jjr3aoUmrS8B6MaCQSKoW7Ycr9ecjmOV84Y9uptsL7u1I6gJA2jbg3ILA== MIME-Version: 1.0 X-Received: by 10.50.93.36 with SMTP id cr4mr22507672igb.22.1454836106657; Sun, 07 Feb 2016 01:08:26 -0800 (PST) Received: by 10.36.14.19 with HTTP; Sun, 7 Feb 2016 01:08:26 -0800 (PST) In-Reply-To: References: Date: Sun, 7 Feb 2016 01:08:26 -0800 Message-ID: Subject: Re: 10.2 Release seems to be crashing on Azure with "Standard DS" VM sizes From: Adrian Chadd To: Scott Otis Cc: "freebsd-stable@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Feb 2016 09:08:27 -0000 Hm, the runtime going backwards is a bit odd, maybe they fixed that in -HEAD recently. Other than that, yeah, you'll need a crash dump or at least some screenshot when it does reboot. -a From owner-freebsd-stable@freebsd.org Sun Feb 7 09:21:40 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 32070A9F303 for ; Sun, 7 Feb 2016 09:21:40 +0000 (UTC) (envelope-from scott.otis@tandemcal.com) Received: from Filter02.GreenHouseData.com (outmail.fchosted.com [205.234.75.57]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "filter.greenhousedata.com", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 12FA91F0C for ; Sun, 7 Feb 2016 09:21:39 +0000 (UTC) (envelope-from scott.otis@tandemcal.com) X-ASG-Debug-ID: 1454836891-0a955d7334180b4e0001-BIHDGU Received: from mail.fchosted.com (mailflow.greenhousedata.com [10.36.251.68]) by Filter02.GreenHouseData.com with ESMTP id 0dGGDz21aCKUgJsw (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO); Sun, 07 Feb 2016 01:21:31 -0800 (PST) X-Barracuda-Envelope-From: scott.otis@tandemcal.com Received: from EVT01FEVWEXA001.fchosted.com ([10.10.2.130]) by sea02fevwexa001 ([10.10.2.131]) with mapi id 14.03.0266.001; Sun, 7 Feb 2016 01:21:30 -0800 From: Scott Otis To: Adrian Chadd CC: "freebsd-stable@freebsd.org" Subject: Re: 10.2 Release seems to be crashing on Azure with "Standard DS" VM sizes Thread-Topic: 10.2 Release seems to be crashing on Azure with "Standard DS" VM sizes X-ASG-Orig-Subj: Re: 10.2 Release seems to be crashing on Azure with "Standard DS" VM sizes Thread-Index: AdFgXh+MGR2ZakJhS8y7lHqrkKi5uwAXKNQAAAhAj7AAO5jVAP//fYr8 Date: Sun, 7 Feb 2016 09:21:30 +0000 Message-ID: References: , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Barracuda-Connect: mailflow.greenhousedata.com[10.36.251.68] X-Barracuda-Start-Time: 1454836891 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: https://Filter.GreenHouseData.com:443/cgi-mod/mark.cgi X-Barracuda-Scan-Msg-Size: 459 X-Virus-Scanned: by bsmtpd at GreenHouseData.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=9.0 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.26823 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Feb 2016 09:21:40 -0000 After setting crash dump settings correctly I'm still not seeing a dump in = /var/crash/ - will try to get screenshot my of the boot screen after the cr= ash and get back to you. Scott On Feb 7, 2016, at 12:08 AM, Adrian Chadd wrote: Hm, the runtime going backwards is a bit odd, maybe they fixed that in -HEAD recently. Other than that, yeah, you'll need a crash dump or at least some screenshot when it does reboot. -a From owner-freebsd-stable@freebsd.org Sun Feb 7 15:24:37 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 46B18AA1D04 for ; Sun, 7 Feb 2016 15:24:37 +0000 (UTC) (envelope-from hlh@restart.be) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 2549C19AA for ; Sun, 7 Feb 2016 15:24:37 +0000 (UTC) (envelope-from hlh@restart.be) Received: by mailman.ysv.freebsd.org (Postfix) id 23AC7AA1D03; Sun, 7 Feb 2016 15:24:37 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 096C4AA1D02 for ; Sun, 7 Feb 2016 15:24:37 +0000 (UTC) (envelope-from hlh@restart.be) Received: from tignes.restart.be (tignes.restart.be [IPv6:2001:41d0:8:bdbe:0:1::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tignes.restart.be", Issuer "CA master" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 97BAE19A9; Sun, 7 Feb 2016 15:24:36 +0000 (UTC) (envelope-from hlh@restart.be) X-Comment: SPF check N/A for local connections - client-ip=2001:41d0:8:bdbe:1:1::; helo=restart.be; envelope-from=hlh@restart.be; receiver=ume@mahoroba.org DKIM-Filter: OpenDKIM Filter v2.10.3 tignes.restart.be 3pyvRG756nznqb DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=restart.be; s=tignes; t=1454858667; bh=2AkEGuhmz221In/Tuu/wWvlNmuln2PL8bNNUCTriOVQ=; h=Subject:To:References:Cc:From:Date:In-Reply-To; z=Subject:=20Re:=2010-STABLE=20hangups=20frequently|To:=20Hajimu=20 UMEMOTO=20,=20Peter=20Jeremy=20|References:=20=0D=0A=20<20160 202200738.GA78969@server.rulingia.com>=0D=0A=20|Cc:=20stable@FreeBSD.org,=20mckusick@FreeBSD.org|Fr om:=20Henri=20Hennebert=20|Date:=20Sun,=207=20Feb= 202016=2016:24:20=20+0100|In-Reply-To:=20; b=fdPNZaiysrZICwS5KObEJghvLpaklfg9CZ89AX+y6RMJzKKbjoUE9syndee69g2wP /Aou38sarVdS1mA9Oazr6PePpQlAjrAcu7xEQWUlRiR6DxtMESzGzDJ3JopKEykapP LQ9VctDU939WnUBBU6+C/crQ103qr925NrQRQPJyepX7wbmnkyml/aWH2BUAuQ0jTJ xC0eK/JkjSzS2WmNZijXEgok/EDIFTlApP2x0nxYAi0JG72+ensBWef7cKyX6PNTv4 qzZUZVJ8H99Z31TGk17My7oCv/rOFBrgDby/0K0je1/b0X4SsEPPY+7H9iMwjEHJOs LyNDMkJba74fw== Received: from restart.be (avoriaz.restart.be [IPv6:2001:41d0:8:bdbe:1:1::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.restart.be", Issuer "CA master" (verified OK)) by tignes.restart.be (Postfix) with ESMTPS id 3pyvRG756nznqb; Sun, 7 Feb 2016 16:24:26 +0100 (CET) Received: from meribel.restart.bel (meribel.restart.bel [IPv6:2001:41d0:8:bdbe:1:8:0:0]) (authenticated bits=0) by restart.be (8.15.2/8.15.2) with ESMTPSA id u17FOLKe007724 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=OK); Sun, 7 Feb 2016 16:24:22 +0100 (CET) (envelope-from hlh@restart.be) Subject: Re: 10-STABLE hangups frequently To: Hajimu UMEMOTO , Peter Jeremy References: <20160202200738.GA78969@server.rulingia.com> Cc: stable@FreeBSD.org, mckusick@FreeBSD.org From: Henri Hennebert Openpgp: id=D1248BB28D7F9271D27E9D1E84EC2196D351A503 X-Enigmail-Draft-Status: N1110 Message-ID: <56B761A4.7010901@restart.be> Date: Sun, 7 Feb 2016 16:24:20 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD i386; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 Feb 2016 15:24:37 -0000 On 02/03/2016 02:03, Hajimu UMEMOTO wrote: > Hi, > >>>>>> On Wed, 3 Feb 2016 07:07:38 +1100 >>>>>> Peter Jeremy said: > > peter> As others have said, you need to provide lots more detail on your > peter> configuration. > > CPU: AMD Athlon(tm) 64 Processor 3500+ > Memory: 4GB > HDD: 3TB > > I'm using ZFS only setup. > > peter> There were no problems at r290231 but after I upgraded to r295005, I > peter> started seeing "out of swap" errors and hangs during the periodic > peter> daily runs. I'm not seeing this on 1GB instances - though they are > peter> all running UFS. > > r292875 runs well: > > FreeBSD asuka.mahoroba.org 10.2-STABLEFreeBSD 10.2-STABLE #5 r292875: Tue Feb 2 07:08:29 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd6 > > r292895 hangs: > > FreeBSD asuka.mahoroba.org 10.2-STABLE FreeBSD 10.2-STABLE #6 r292895: Tue Feb 2 10:17:28 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd64 > > I tried latest stable (r295137) with the sys/kern/vfs_subr.c part of > r292895 reverted, and it seems running well, here: > > FreeBSD asuka.mahoroba.org 10.3-PRERELEASE FreeBSD 10.3-PRERELEASE #0 r295137M: Tue Feb 2 20:39:11 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd64 > > peter> Some experimentation suggested that just "find /" was enough to wedge > peter> my system. I did some experimenting and found that the following > peter> loader config was enough to prevent it hanging: > peter> vfs.zfs.arc_max="128M" > peter> vfs.zfs.arc_meta_limit="50M" > peter> vfs.zfs.arc_min="25M" > peter> (previously, I had no ZFS tuning at all). > > I had ZFS tuning before. However, after this problem was occur, I > removed all of ZFS tuning. > The FS related setting is only kern.maxvnodes=400000, now. > > Sincerely, > > -- > Hajimu UMEMOTO > ume@mahoroba.org ume@FreeBSD.org > http://www.mahoroba.org/~ume/ I encounter a hangup 3 times after I upgrade to 10.3-PRERELEASE r295247M in a zfs configuration (i386 with 2GB memory) while trying to run security/tripwire (compute checksum on all the files). With /usr/src/sys/kern/vfs_subr.c at revision 291757 all return to normal. Henri PS thanks Hajimu From owner-freebsd-stable@freebsd.org Mon Feb 8 09:10:35 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 92673A9E43E for ; Mon, 8 Feb 2016 09:10:35 +0000 (UTC) (envelope-from marius@alchemy.franken.de) Received: from alchemy.franken.de (alchemy.franken.de [194.94.249.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "alchemy.franken.de", Issuer "alchemy.franken.de" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 291AE1B2D for ; Mon, 8 Feb 2016 09:10:34 +0000 (UTC) (envelope-from marius@alchemy.franken.de) Received: from alchemy.franken.de (localhost [127.0.0.1]) by alchemy.franken.de (8.15.2/8.15.2/ALCHEMY.FRANKEN.DE) with ESMTPS id u189AW1M093487 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 8 Feb 2016 10:10:32 +0100 (CET) (envelope-from marius@alchemy.franken.de) Received: (from marius@localhost) by alchemy.franken.de (8.15.2/8.15.2/Submit) id u189AWbr093485; Mon, 8 Feb 2016 10:10:32 +0100 (CET) (envelope-from marius) Date: Mon, 8 Feb 2016 10:10:32 +0100 From: Marius Strobl To: mike tancsa Cc: FreeBSD-STABLE Mailing List Subject: Re: possible em regression (was Re: svn commit: r294958 - in stable/10: share/man/man4 sys/dev/e1000 sys/dev/ixgb sys/dev/netmap) Message-ID: <20160208091032.GR15359@alchemy.franken.de> References: <201601272231.u0RMV8LW019394@repo.freebsd.org> <56ABAA92.5050901@sentex.net> <56ABB291.5040305@omnilan.de> <56ABCE95.3030807@sentex.net> <20160130012358.GY15359@alchemy.franken.de> <56ACE917.80502@sentex.net> <20160130172618.GA15359@alchemy.franken.de> <56B0C217.1070706@sentex.net> <20160207004131.GM15359@alchemy.franken.de> <152b9314d10.2765.e68d32c7521a042b3773fe36a0156dc7@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <152b9314d10.2765.e68d32c7521a042b3773fe36a0156dc7@sentex.net> User-Agent: Mutt/1.5.24 (2015-08-30) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (alchemy.franken.de [0.0.0.0]); Mon, 08 Feb 2016 10:10:32 +0100 (CET) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Feb 2016 09:10:35 -0000 On Sat, Feb 06, 2016 at 07:46:02PM -0500, mike tancsa wrote: > Sure, I will try Monday when at the office Actually, thinking about it, could you please try the following patch on top of the previous one/r295287? https://people.freebsd.org/~marius/e1000_max_scatter_tso_10.diff Thanks Marius From owner-freebsd-stable@freebsd.org Mon Feb 8 12:34:24 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 47726AA1989 for ; Mon, 8 Feb 2016 12:34:24 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 36C47135E; Mon, 8 Feb 2016 12:34:24 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id DD97D544; Mon, 8 Feb 2016 12:34:21 +0000 (UTC) Date: Mon, 8 Feb 2016 12:34:17 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org Message-ID: <1597950544.117.1454934857372.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: Build failed in Jenkins: FreeBSD_stable_10 #73 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Instance-Identity: MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAkKKb2VAfYQKfu1t7qk4nR5qzUBEI+UqT4BPec4qHVhqUy0FFdq50sMH+3y9bCDNOufctov6VqTNffZ3YXArnZK95YF0OX97fh+E9txYOUX1adc+TikcKjuYpHmL5dE62eaZTI+4A5jnRonskQ1PaoIFz0Kbu4mWzkFsmdiXTraGzomXq4cHUCATA2+K4eDYgjXEQI30z3GOMmmZ4t/+6QGk1cMb/BqMWHbn80AsRCb4tU7Hpd72XLDpsuO7YRP1Q0CjmNAuBOTj+sFiiOe6U9HpqOlQN+iFUvBdZo/ybuy5Kh71cAaYQNL68cYdZJ6binH/DkG3KY/fS7DFYAeuwjwIDAQAB X-Jenkins-Job: FreeBSD_stable_10 X-Jenkins-Result: FAILURE X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Feb 2016 12:34:24 -0000 See ------------------------------------------ [...truncated 64803 lines...] printf '#include "compat.h"\n' > nnpfs_syscall.S printf '#include "SYS.h"\nRSYSCALL(nnpfs_syscall)\n' >> nnpfs_syscall.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>nnpfs_syscall.S --- getresuid.S --- --- eaccess.S --- --- __acl_aclcheck_fd.S --- printf '#include "compat.h"\n' > __acl_aclcheck_fd.S printf '#include "SYS.h"\nRSYSCALL(__acl_aclcheck_fd)\n' >> __acl_aclcheck_= fd.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>__acl_aclcheck_fd.S --- extattr_get_file.S --- printf '#include "compat.h"\n' > extattr_get_file.S printf '#include "SYS.h"\nRSYSCALL(extattr_get_file)\n' >> extattr_get_file= .S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>extattr_get_file.S --- nmount.S --- --- getresuid.S --- printf '#include "compat.h"\n' > getresuid.S printf '#include "SYS.h"\nRSYSCALL(getresuid)\n' >> getresuid.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>getresuid.S --- __mac_set_file.S --- --- eaccess.S --- printf '#include "compat.h"\n' > eaccess.S printf '#include "SYS.h"\nRSYSCALL(eaccess)\n' >> eaccess.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>eaccess.S --- ksem_init.S --- --- nmount.S --- printf '#include "compat.h"\n' > nmount.S printf '#include "SYS.h"\nRSYSCALL(nmount)\n' >> nmount.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>nmount.S --- ksem_destroy.S --- --- __mac_set_file.S --- printf '#include "compat.h"\n' > __mac_set_file.S printf '#include "SYS.h"\nRSYSCALL(__mac_set_file)\n' >> __mac_set_file.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>__mac_set_file.S --- extattr_get_link.S --- --- ksem_init.S --- printf '#include "compat.h"\n' > ksem_init.S printf '#include "SYS.h"\nRSYSCALL(ksem_init)\n' >> ksem_init.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>ksem_init.S --- thr_create.S --- --- ksem_destroy.S --- printf '#include "compat.h"\n' > ksem_destroy.S printf '#include "SYS.h"\nRSYSCALL(ksem_destroy)\n' >> ksem_destroy.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>ksem_destroy.S --- extattr_list_file.S --- --- extattr_get_link.S --- printf '#include "compat.h"\n' > extattr_get_link.S printf '#include "SYS.h"\nRSYSCALL(extattr_get_link)\n' >> extattr_get_link= .S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>extattr_get_link.S --- thr_suspend.S --- --- thr_create.S --- printf '#include "compat.h"\n' > thr_create.S printf '#include "SYS.h"\nRSYSCALL(thr_create)\n' >> thr_create.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>thr_create.S --- thr_new.S --- --- extattr_list_file.S --- printf '#include "compat.h"\n' > extattr_list_file.S printf '#include "SYS.h"\nRSYSCALL(extattr_list_file)\n' >> extattr_list_fi= le.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>extattr_list_file.S --- kmq_timedreceive.S --- --- thr_suspend.S --- printf '#include "compat.h"\n' > thr_suspend.S printf '#include "SYS.h"\nRSYSCALL(thr_suspend)\n' >> thr_suspend.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>thr_suspend.S --- sctp_peeloff.S --- --- thr_new.S --- printf '#include "compat.h"\n' > thr_new.S printf '#include "SYS.h"\nRSYSCALL(thr_new)\n' >> thr_new.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>thr_new.S --- sctp_generic_sendmsg.S --- --- thr_kill2.S --- --- kmq_timedreceive.S --- printf '#include "compat.h"\n' > kmq_timedreceive.S printf '#include "SYS.h"\nRSYSCALL(kmq_timedreceive)\n' >> kmq_timedreceive= .S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>kmq_timedreceive.S --- sctp_peeloff.S --- printf '#include "compat.h"\n' > sctp_peeloff.S printf '#include "SYS.h"\nRSYSCALL(sctp_peeloff)\n' >> sctp_peeloff.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>sctp_peeloff.S --- cpuset_setaffinity.S --- --- sctp_generic_sendmsg.S --- printf '#include "compat.h"\n' > sctp_generic_sendmsg.S printf '#include "SYS.h"\nRSYSCALL(sctp_generic_sendmsg)\n' >> sctp_generic= _sendmsg.S --- mkfifoat.S --- --- sctp_generic_sendmsg.S --- printf '\t.section .note.GNU-stack,"",%%progbits\n' >>sctp_generic_sendmsg= .S --- thr_kill2.S --- printf '#include "compat.h"\n' > thr_kill2.S printf '#include "SYS.h"\nRSYSCALL(thr_kill2)\n' >> thr_kill2.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>thr_kill2.S --- mknodat.S --- --- cpuset_setaffinity.S --- printf '#include "compat.h"\n' > cpuset_setaffinity.S printf '#include "SYS.h"\nRSYSCALL(cpuset_setaffinity)\n' >> cpuset_setaffi= nity.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>cpuset_setaffinity.S --- posix_openpt.S --- --- mkfifoat.S --- printf '#include "compat.h"\n' > mkfifoat.S printf '#include "SYS.h"\nRSYSCALL(mkfifoat)\n' >> mkfifoat.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>mkfifoat.S --- jail_remove.S --- --- mknodat.S --- printf '#include "compat.h"\n' > mknodat.S printf '#include "SYS.h"\nRSYSCALL(mknodat)\n' >> mknodat.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>mknodat.S --- shmctl.S --- --- posix_openpt.S --- printf '#include "compat.h"\n' > posix_openpt.S printf '#include "SYS.h"\nRSYSCALL(posix_openpt)\n' >> posix_openpt.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>posix_openpt.S --- rctl_add_rule.S --- --- jail_remove.S --- printf '#include "compat.h"\n' > jail_remove.S printf '#include "SYS.h"\nRSYSCALL(jail_remove)\n' >> jail_remove.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>jail_remove.S --- connectat.S --- --- _truncate.S --- --- shmctl.S --- printf '#include "compat.h"\n' > shmctl.S printf '#include "SYS.h"\nRSYSCALL(shmctl)\n' >> shmctl.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>shmctl.S --- rctl_add_rule.S --- printf '#include "compat.h"\n' > rctl_add_rule.S printf '#include "SYS.h"\nRSYSCALL(rctl_add_rule)\n' >> rctl_add_rule.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>rctl_add_rule.S --- _clock_gettime.S --- --- connectat.S --- printf '#include "compat.h"\n' > connectat.S printf '#include "SYS.h"\nRSYSCALL(connectat)\n' >> connectat.S --- _connect.S --- --- connectat.S --- printf '\t.section .note.GNU-stack,"",%%progbits\n' >>connectat.S --- _truncate.S --- printf '#include "compat.h"\n' > _truncate.S printf '#include "SYS.h"\nPSEUDO(truncate)\n' >> _truncate.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>_truncate.S --- _fork.S --- --- _clock_gettime.S --- printf '#include "compat.h"\n' > _clock_gettime.S printf '#include "SYS.h"\nPSEUDO(clock_gettime)\n' >> _clock_gettime.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>_clock_gettime.S --- _msync.S --- --- _connect.S --- printf '#include "compat.h"\n' > _connect.S printf '#include "SYS.h"\nPSEUDO(connect)\n' >> _connect.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>_connect.S --- _ppoll.S --- --- _recvmsg.S --- --- _fork.S --- printf '#include "compat.h"\n' > _fork.S printf '#include "SYS.h"\nPSEUDO(fork)\n' >> _fork.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>_fork.S --- _msync.S --- printf '#include "compat.h"\n' > _msync.S printf '#include "SYS.h"\nPSEUDO(msync)\n' >> _msync.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>_msync.S --- _swapcontext.S --- --- _ppoll.S --- printf '#include "compat.h"\n' > _ppoll.S printf '#include "SYS.h"\nPSEUDO(ppoll)\n' >> _ppoll.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>_ppoll.S --- gdtoa_hd_init.c --- --- _swapcontext.S --- printf '#include "compat.h"\n' > _swapcontext.S printf '#include "SYS.h"\nPSEUDO(swapcontext)\n' >> _swapcontext.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>_swapcontext.S --- _recvmsg.S --- printf '#include "compat.h"\n' > _recvmsg.S printf '#include "SYS.h"\nPSEUDO(recvmsg)\n' >> _recvmsg.S printf '\t.section .note.GNU-stack,"",%%progbits\n' >>_recvmsg.S --- gdtoa_hexnan.c --- --- gdtoa_strtof.c --- --- gdtoa_ulp.c --- --- gdtoa_hd_init.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/gdtoa= /hd_init.c gdtoa_hd_init.c --- gdtoa_hexnan.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/gdtoa= /hexnan.c gdtoa_hexnan.c --- gdtoa_strtof.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/gdtoa= /strtof.c gdtoa_strtof.c --- jemalloc_hash.c --- --- gdtoa_ulp.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/gdtoa= /ulp.c gdtoa_ulp.c --- jemalloc_mb.c --- --- jemalloc_prof.c --- --- jemalloc_tcache.c --- --- jemalloc_hash.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/jemal= loc/src/hash.c jemalloc_hash.c --- jemalloc_mb.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/jemal= loc/src/mb.c jemalloc_mb.c --- jemalloc_tsd.c --- --- jemalloc_prof.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/jemal= loc/src/prof.c jemalloc_prof.c --- jemalloc_tcache.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/jemal= loc/src/tcache.c jemalloc_tcache.c --- crypt_clnt.c --- --- jemalloc_tsd.c --- ln -sf /builds/workspace/FreeBSD_stable_10/src/lib/libc/../../contrib/jemal= loc/src/tsd.c jemalloc_tsd.c --- nslexer.c --- --- crypt_clnt.c --- RPCGEN_CPP=3Dcpp\ rpcgen -C -l -o crypt_clnt.c /builds/workspace/FreeBSD_s= table_10/obj/builds/workspace/FreeBSD_stable_10/src/tmp/usr/include/rpcsvc/= crypt.x --- nslexer.c --- lex -P_nsyy -o/dev/stdout /builds/workspace/FreeBSD_stable_10/src/lib/libc= /net/nslexer.l | sed -e '/YY_BUF_SIZE/s/16384/1024/' >nslexer.c --- .depend --- rm -f .depend CC=3D'cc ' mkdep -f .depend -a -I/builds/workspace/FreeBSD_stable_10/src= /lib/libc/include -I/builds/workspace/FreeBSD_stable_10/src/lib/libc/../../= include -I/builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64 -DNLS -D__= DBINTERFACE_PRIVATE -I/builds/workspace/FreeBSD_stable_10/src/lib/libc/../.= ./contrib/gdtoa -I/builds/workspace/FreeBSD_stable_10/src/lib/libc/../../co= ntrib/libc-vis -DINET6 -I/builds/workspace/FreeBSD_stable_10/obj/builds/wor= kspace/FreeBSD_stable_10/src/lib/libc -I/builds/workspace/FreeBSD_stable_10= /src/lib/libc/resolv -D_ACL_PRIVATE -DPOSIX_MISTAKE -I/builds/workspace/Fre= eBSD_stable_10/src/lib/libc/../libmd -I/builds/workspace/FreeBSD_stable_10/= src/lib/libc/../../contrib/jemalloc/include -I/builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/../../contrib/tzcode/stdtime -I/builds/workspace/FreeBS= D_stable_10/src/lib/libc/stdtime -I/builds/workspace/FreeBSD_stable_10/src/= lib/libc/locale -DBROKEN_DES -DPORTMAP -DDES_BUILTIN -I/builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/rpc -DYP -DNS_CACHING -DSYMBOL_VERSIONING -DSY= SCALL_COMPAT -std=3Dgnu99 /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/db/btree/bt_close.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/= btree/bt_conv.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/btree/b= t_debug.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/btree/bt_dele= te.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/btree/bt_get.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/db/btree/bt_open.c /builds/wo= rkspace/FreeBSD_stable_10/src/lib/libc/db/btree/bt_overflow.c /builds/works= pace/FreeBSD_stable_10/src/lib/libc/db/btree/bt_page.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/db/btree/bt_put.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/db/btree/bt_search.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/db/btree/bt_seq.c /builds/workspace/FreeBSD_stable_10/src/l= ib/libc/db/btree/bt_split.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/db/btree/bt_utils.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/d= b/db.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/hash/hash.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/db/hash/hash_bigkey.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/db/hash/hash_buf.c /builds/workspa= ce/FreeBSD_stable_10/src/lib/libc/db/hash/hash_func.c /builds/workspace/Fre= eBSD_stable_10/src/lib/libc/db/hash/hash_log2.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/db/hash/hash_page.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/db/hash/ndbm.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/db/mpool/mpool.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/m= pool/mpool-compat.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/rec= no/rec_close.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/recno/re= c_delete.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/recno/rec_ge= t.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/db/recno/rec_open.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/db/recno/rec_put.c /builds/w= orkspace/FreeBSD_stable_10/src/lib/libc/db/recno/rec_search.c /builds/works= pace/FreeBSD_stable_10/src/lib/libc/db/recno/rec_seq.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/db/recno/rec_utils.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/compat-43/creat.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/compat-43/gethostid.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/compat-43/getwd.c /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/compat-43/killpg.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/com= pat-43/sethostid.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/compat-= 43/setpgrp.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/compat-43/set= rgid.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/compat-43/setruid.c= /builds/workspace/FreeBSD_stable_10/src/lib/libc/compat-43/sigcompat.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/gen/__getosreldate.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/gen/__pthread_mutex_init_calloc_cb= _stub.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/__xuname.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/gen/_once_stub.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/gen/_pthread_stubs.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/gen/_rand48.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/gen/_spinlock_stub.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/gen/_thread_init.c /builds/workspace/FreeBSD_stable_10/src/l= ib/libc/gen/alarm.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/ar= c4random.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/assert.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/gen/auxv.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/gen/basename.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/gen/cap_sandboxed.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/gen/check_utility_compat.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/gen/clock.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/gen/clock_getcpuclockid.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/gen/closedir.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/confs= tr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/crypt.c /builds/w= orkspace/FreeBSD_stable_10/src/lib/libc/gen/ctermid.c /builds/workspace/Fre= eBSD_stable_10/src/lib/libc/gen/daemon.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/gen/devname.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/gen/dirfd.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/dirname= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/disklabel.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/gen/dlfcn.c /builds/workspace/Fre= eBSD_stable_10/src/lib/libc/gen/drand48.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/gen/dup3.c /builds/workspace/FreeBSD_stable_10/src/lib/libc= /gen/elf_utils.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/erand= 48.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/err.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/gen/errlst.c /builds/workspace/FreeBS= D_stable_10/src/lib/libc/gen/errno.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/gen/exec.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/= fdevname.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/feature_pre= sent.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/fmtcheck.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/gen/fmtmsg.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/gen/fnmatch.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/gen/fpclassify.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/gen/frexp.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen= /fstab.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/ftok.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/gen/fts.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/gen/fts-compat.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/gen/ftw.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/gen/getbootfile.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/ge= tbsize.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/getcap.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/gen/getcwd.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/gen/getdomainname.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/gen/getgrent.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/gen/getgrouplist.c /builds/workspace/FreeBSD_stable_10/src/l= ib/libc/gen/gethostname.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/= gen/getloadavg.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/getlo= gin.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/getmntinfo.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/gen/getnetgrent.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/gen/getosreldate.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/gen/getpagesize.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/gen/getpagesizes.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/gen/getpeereid.c /builds/workspace/FreeBSD_stable_10/src/li= b/libc/gen/getprogname.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/g= en/getpwent.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/getttyen= t.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/getusershell.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/gen/getutxent.c /builds/works= pace/FreeBSD_stable_10/src/lib/libc/gen/getvfsbyname.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/gen/glob.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/gen/initgroups.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/gen/isatty.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/isin= f.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/isnan.c /builds/wo= rkspace/FreeBSD_stable_10/src/lib/libc/gen/jrand48.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/gen/lcong48.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/gen/libc_dlopen.c /builds/workspace/FreeBSD_stable_10/src/li= b/libc/gen/lockf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/lra= nd48.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/mrand48.c /buil= ds/workspace/FreeBSD_stable_10/src/lib/libc/gen/nftw.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/gen/nice.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/gen/nlist.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/= gen/nrand48.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/opendir.= c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/pause.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/gen/pmadvise.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/gen/popen.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/gen/posix_spawn.c /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/gen/psignal.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/putu= txline.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/pw_scan.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/gen/raise.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/gen/readdir.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/gen/readpassphrase.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/gen/rewinddir.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/gen/scandir.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/see= d48.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/seekdir.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/gen/semctl.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/gen/setdomainname.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/gen/sethostname.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/gen/setjmperr.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/gen/setmode.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/se= tproctitle.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/setprogna= me.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/siginterrupt.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/gen/siglist.c /builds/worksp= ace/FreeBSD_stable_10/src/lib/libc/gen/signal.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/gen/sigsetops.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/gen/sleep.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/ge= n/srand48.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/statvfs.c = /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/stringlist.c /builds/w= orkspace/FreeBSD_stable_10/src/lib/libc/gen/strtofflags.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/gen/sysconf.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/gen/sysctl.c /builds/workspace/FreeBSD_stable_10/src/li= b/libc/gen/sysctlbyname.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/= gen/sysctlnametomib.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/= syslog.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/telldir.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/gen/termios.c /builds/workspa= ce/FreeBSD_stable_10/src/lib/libc/gen/time.c /builds/workspace/FreeBSD_stab= le_10/src/lib/libc/gen/times.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/gen/timezone.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/tl= s.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/ttyname.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/gen/ttyslot.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/gen/ualarm.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/gen/ulimit.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/gen/uname.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/unvis-c= ompat.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/usleep.c /buil= ds/workspace/FreeBSD_stable_10/src/lib/libc/gen/utime.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/gen/utxdb.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/gen/valloc.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/gen/wait.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/wait3.c = /builds/workspace/FreeBSD_stable_10/src/lib/libc/gen/waitpid.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/gen/waitid.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/gen/wordexp.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/../../contrib/libc-pwcache/pwcache.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/../../contrib/libc-vis/unvis.c /builds/workspace/Fre= eBSD_stable_10/src/lib/libc/../../contrib/libc-vis/vis.c cancelpoints_sem.c= cancelpoints_sem_new.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/am= d64/gen/_setjmp.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/ge= n/_set_tp.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/gen/rfor= k_thread.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/gen/setjm= p.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/gen/sigsetjmp.S = /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/gen/fabs.S /builds/w= orkspace/FreeBSD_stable_10/src/lib/libc/amd64/gen/getcontextx.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/amd64/gen/infinity.c /builds/workspac= e/FreeBSD_stable_10/src/lib/libc/gen/ldexp.c /builds/workspace/FreeBSD_stab= le_10/src/lib/libc/amd64/gen/makecontext.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/amd64/gen/signalcontext.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/amd64/gen/flt_rounds.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/amd64/gen/fpgetmask.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/amd64/gen/fpsetmask.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/amd64/gen/fpgetprec.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/amd64/gen/fpsetprec.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/am= d64/gen/fpgetround.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64= /gen/fpsetround.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/ge= n/fpgetsticky.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gmon/gmon.= c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gmon/mcount.c /builds/wo= rkspace/FreeBSD_stable_10/src/lib/libc/iconv/citrus_bcs.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/iconv/citrus_bcs_strtol.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/iconv/citrus_bcs_strtoul.c /builds/workspac= e/FreeBSD_stable_10/src/lib/libc/iconv/citrus_csmapper.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/iconv/citrus_db.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/iconv/citrus_db_factory.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/iconv/citrus_db_hash.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/iconv/citrus_esdb.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/iconv/citrus_hash.c /builds/workspace/FreeBSD_stable_10/src/l= ib/libc/iconv/citrus_iconv.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/iconv/citrus_lookup.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/i= conv/citrus_lookup_factory.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/iconv/citrus_mapper.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/i= conv/citrus_memstream.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/ic= onv/citrus_mmap.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/iconv/ci= trus_module.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/iconv/citrus= _none.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/iconv/citrus_pivot= _factory.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/iconv/citrus_pr= op.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/iconv/citrus_stdenc.c= /builds/workspace/FreeBSD_stable_10/src/lib/libc/iconv/bsd_iconv.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/iconv/iconv_compat.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/inet/inet_addr.c /builds/workspace/Fre= eBSD_stable_10/src/lib/libc/inet/inet_cidr_ntop.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/inet/inet_cidr_pton.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/inet/inet_lnaof.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/inet/inet_makeaddr.c /builds/workspace/FreeBSD_stable_10/src/li= b/libc/inet/inet_net_ntop.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/inet/inet_net_pton.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/ine= t/inet_neta.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/inet/inet_ne= tof.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/inet/inet_network.c = /builds/workspace/FreeBSD_stable_10/src/lib/libc/inet/inet_ntoa.c /builds/w= orkspace/FreeBSD_stable_10/src/lib/libc/inet/inet_ntop.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/inet/inet_pton.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/inet/nsap_addr.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/isc/ev_streams.c /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/isc/ev_timers.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale= /ascii.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/big5.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/locale/btowc.c /builds/worksp= ace/FreeBSD_stable_10/src/lib/libc/locale/collate.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/locale/collcmp.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/locale/euc.c /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/locale/fix_grouping.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/= locale/gb18030.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/gb= 2312.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/gbk.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/locale/ctype.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/locale/isctype.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/locale/iswctype.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/locale/ldpart.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/locale/lmessages.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/lo= cale/lmonetary.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/ln= umeric.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/localeconv= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/mblen.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/locale/mbrlen.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/locale/mbrtowc.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/locale/mbsinit.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/locale/mbsnrtowcs.c /builds/workspace/FreeBSD_stable_10/src/li= b/libc/locale/mbsrtowcs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/= locale/mbtowc.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/mbs= towcs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/mskanji.c /= builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/nextwctype.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/locale/nl_langinfo.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/locale/nomacros.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/locale/none.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/locale/rpmatch.c /builds/workspace/FreeBSD_stable_10/src/l= ib/libc/locale/rune.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/loca= le/runetype.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/setlo= cale.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/setrunelocal= e.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/table.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/locale/tolower.c /builds/workspac= e/FreeBSD_stable_10/src/lib/libc/locale/toupper.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/locale/utf8.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/locale/wcrtomb.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/locale/wcsnrtombs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/loc= ale/wcsrtombs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/wcs= ftime.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/wcstof.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/locale/wcstod.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/locale/wcstoimax.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/locale/wcstol.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/locale/wcstold.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/locale/wcstoll.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/locale/wcstombs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale= /wcstoul.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/wcstoull= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/wcstoumax.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/locale/wctob.c /builds/workspa= ce/FreeBSD_stable_10/src/lib/libc/locale/wctomb.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/locale/wctrans.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/locale/wctype.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/locale/wcwidth.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/loca= le/xlocale.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/c16rto= mb_iconv.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/c32rtomb= _iconv.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/mbrtoc16_i= conv.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/locale/mbrtoc32_ico= nv.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/../libmd/md5c.c /buil= ds/workspace/FreeBSD_stable_10/src/lib/libc/nameser/ns_name.c /builds/works= pace/FreeBSD_stable_10/src/lib/libc/nameser/ns_netint.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/nameser/ns_parse.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/nameser/ns_print.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/nameser/ns_samedomain.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/nameser/ns_ttl.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/net/base64.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/ethe= r_addr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/eui64.c /buil= ds/workspace/FreeBSD_stable_10/src/lib/libc/net/gai_strerror.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/net/getaddrinfo.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/net/gethostbydns.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/net/gethostbyht.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/net/gethostbynis.c /builds/workspace/FreeBSD_stable_10/src/li= b/libc/net/gethostnamadr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc= /net/getifaddrs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/geti= fmaddrs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/getnameinfo.= c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/getnetbydns.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/net/getnetbyht.c /builds/workspa= ce/FreeBSD_stable_10/src/lib/libc/net/getnetbynis.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/net/getnetnamadr.c /builds/workspace/FreeBSD_stab= le_10/src/lib/libc/net/getproto.c /builds/workspace/FreeBSD_stable_10/src/l= ib/libc/net/getprotoent.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/= net/getprotoname.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/get= servent.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/if_indextona= me.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/if_nameindex.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/net/if_nametoindex.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/net/ip6opt.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/net/linkaddr.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/net/map_v4v6.c /builds/workspace/FreeBSD_stable_10/src/li= b/libc/net/name6.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/nto= h.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/nsdispatch.c nslex= er.c nsparser.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/nss_co= mpat.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/rcmd.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/net/rcmdsh.c /builds/workspace/Fre= eBSD_stable_10/src/lib/libc/net/recv.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/net/rthdr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/n= et/sctp_sys_calls.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/se= nd.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/sockatmark.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/net/sourcefilter.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/net/vars.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/net/nscache.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/net/nscachedcli.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/nls/msgcat.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/ac= l_branding.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_c= alc_mask.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_cop= y.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_compat.c /= builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_delete.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_delete_entry.c /buil= ds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_entry.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_flag.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/posix1e/acl_free.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/posix1e/acl_from_text.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/posix1e/acl_from_text_nfs4.c /builds/workspace/FreeBS= D_stable_10/src/lib/libc/posix1e/acl_get.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/posix1e/acl_id_to_name.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/posix1e/acl_init.c /builds/workspace/FreeBSD_stable_10/src/= lib/libc/posix1e/acl_perm.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/posix1e/acl_set.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1= e/acl_strip.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_= support.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_supp= ort_nfs4.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_to_= text.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_to_text= _nfs4.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/acl_valid.= c /builds/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/extattr.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/posix1e/mac.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/posix1e/mac_exec.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/posix1e/mac_get.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/posix1e/mac_set.c subr_acl_nfs4.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/regex/regcomp.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/regex/regerror.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/regex/regexec.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/regex= /regfree.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/resolv/herror.c= /builds/workspace/FreeBSD_stable_10/src/lib/libc/resolv/h_errno.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/resolv/mtctxres.c /builds/workspac= e/FreeBSD_stable_10/src/lib/libc/resolv/res_comp.c /builds/workspace/FreeBS= D_stable_10/src/lib/libc/resolv/res_data.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/resolv/res_debug.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/resolv/res_findzonecut.c /builds/workspace/FreeBSD_stable_10/src/= lib/libc/resolv/res_init.c /builds/workspace/FreeBSD_stable_10/src/lib/libc= /resolv/res_mkquery.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/reso= lv/res_mkupdate.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/resolv/r= es_query.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/resolv/res_send= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/resolv/res_state.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/resolv/res_update.c /builds/wo= rkspace/FreeBSD_stable_10/src/lib/libc/stdio/_flock_stub.c /builds/workspac= e/FreeBSD_stable_10/src/lib/libc/stdio/asprintf.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/stdio/clrerr.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/stdio/dprintf.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/stdio/fclose.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fc= loseall.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fdopen.c /= builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/feof.c /builds/worksp= ace/FreeBSD_stable_10/src/lib/libc/stdio/ferror.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/stdio/fflush.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/stdio/fgetc.c /builds/workspace/FreeBSD_stable_10/src/lib/libc= /stdio/fgetln.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fget= pos.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fgets.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fgetwc.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/stdio/fgetwln.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/stdio/fgetws.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/stdio/fileno.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/= stdio/findfp.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/flags= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fmemopen.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fopen.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/stdio/fprintf.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/stdio/fpurge.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/stdio/fputc.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/st= dio/fputs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fputwc.c= /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fputws.c /builds/wo= rkspace/FreeBSD_stable_10/src/lib/libc/stdio/fread.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/stdio/freopen.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/stdio/fscanf.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/stdio/fseek.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/= fsetpos.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/ftell.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/funopen.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/stdio/fvwrite.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/stdio/fwalk.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/stdio/fwide.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/stdio/fwprintf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/= fwscanf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/fwrite.c /= builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/getc.c /builds/worksp= ace/FreeBSD_stable_10/src/lib/libc/stdio/getchar.c /builds/workspace/FreeBS= D_stable_10/src/lib/libc/stdio/getdelim.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/stdio/getline.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/stdio/gets.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/g= etw.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/getwc.c /build= s/workspace/FreeBSD_stable_10/src/lib/libc/stdio/getwchar.c /builds/workspa= ce/FreeBSD_stable_10/src/lib/libc/stdio/makebuf.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/stdio/mktemp.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/stdio/open_memstream.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/stdio/open_wmemstream.c /builds/workspace/FreeBSD_stable_10/src/l= ib/libc/stdio/perror.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/std= io/printf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/printf-p= os.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/putc.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/stdio/putchar.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/stdio/puts.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/stdio/putw.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/stdio/putwc.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/p= utwchar.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/refill.c /= builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/remove.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/stdio/rewind.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/stdio/rget.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/stdio/scanf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc= /stdio/setbuf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/setb= uffer.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/setvbuf.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/snprintf.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/stdio/sprintf.c /builds/workspace/Fre= eBSD_stable_10/src/lib/libc/stdio/sscanf.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/stdio/stdio.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/stdio/swprintf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdi= o/swscanf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/tempnam.= c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/tmpfile.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/stdio/tmpnam.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/stdio/ungetc.c /builds/workspace/FreeBSD_stab= le_10/src/lib/libc/stdio/ungetwc.c /builds/workspace/FreeBSD_stable_10/src/= lib/libc/stdio/vasprintf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc= /stdio/vdprintf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/vf= printf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/vfscanf.c /= builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/vfwprintf.c /builds/w= orkspace/FreeBSD_stable_10/src/lib/libc/stdio/vfwscanf.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/stdio/vprintf.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/stdio/vscanf.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/stdio/vsnprintf.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/stdio/vsprintf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/v= sscanf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/vswprintf.c= /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/vswscanf.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/stdio/vwprintf.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/stdio/vwscanf.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/stdio/wbuf.c /builds/workspace/FreeBSD_stable_10/src/= lib/libc/stdio/wprintf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/s= tdio/wscanf.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/wsetup= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdio/xprintf.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/stdio/xprintf_float.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/stdio/xprintf_int.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/stdio/xprintf_str.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/stdio/xprintf_errno.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/stdio/xprintf_hexdump.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/stdio/xprintf_quote.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/stdio/xprintf_time.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/stdio/xprintf_vis.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/../../contrib/tzcode/stdtime/asctime.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/../../contrib/tzcode/stdtime/difftime.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/../../contrib/tzcode/stdtime/localtime.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/stdtime/strftime.c /builds/w= orkspace/FreeBSD_stable_10/src/lib/libc/stdtime/strptime.c /builds/workspac= e/FreeBSD_stable_10/src/lib/libc/stdtime/timelocal.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/stdtime/time32.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/amd64/sys/amd64_get_fsbase.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/amd64/sys/amd64_get_gsbase.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/amd64/sys/amd64_set_fsbase.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/amd64/sys/amd64_set_gsbase.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/amd64/sys/__vdso_gettc.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/sys/clock_gettime.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/sys/gettimeofday.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/sys/__vdso_gettimeofday.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/sys/stack_protector.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/sys/stack_protector_compat.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/sys/__error.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/sys/interposing_table.c /builds/workspace/FreeBSD_stable_10/src/lib/libc= /sys/ftruncate.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/lseek= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/mmap.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/sys/pread.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/sys/pwrite.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/sys/truncate.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/s= ys/futimens.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/utimensa= t.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/accept.c /builds/w= orkspace/FreeBSD_stable_10/src/lib/libc/sys/accept4.c /builds/workspace/Fre= eBSD_stable_10/src/lib/libc/sys/aio_suspend.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/sys/close.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/sys/connect.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/fc= ntl.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/fsync.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/sys/fork.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/sys/kevent.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/sys/msync.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/s= ys/nanosleep.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/open.c = /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/openat.c /builds/works= pace/FreeBSD_stable_10/src/lib/libc/sys/poll.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/sys/ppoll.c /builds/workspace/FreeBSD_stable_10/src/li= b/libc/sys/pselect.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/r= ead.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/readv.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/sys/recvfrom.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/sys/recvmsg.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/sys/select.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/sys/sendmsg.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/sen= dto.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/setcontext.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/sys/sigprocmask.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/sys/sigsuspend.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/sys/sigtimedwait.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/sys/sigwait.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/sys/sigwaitinfo.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/sys/swapcontext.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/wa= it4.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/sys/wait6.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/sys/write.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/sys/writev.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/sys/sigaction.c /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/amd64/sys/vfork.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd6= 4/sys/brk.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/sys/cerr= or.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/sys/exect.S /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/sys/getcontext.S /build= s/workspace/FreeBSD_stable_10/src/lib/libc/amd64/sys/pipe.S /builds/workspa= ce/FreeBSD_stable_10/src/lib/libc/amd64/sys/ptrace.S /builds/workspace/Free= BSD_stable_10/src/lib/libc/amd64/sys/sbrk.S /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/amd64/sys/setlogin.S /builds/workspace/FreeBSD_stable_10/= src/lib/libc/amd64/sys/sigreturn.S syscall.S link.S unlink.S chdir.S fchdir= .S mknod.S chmod.S chown.S freebsd4_getfsstat.S getpid.S mount.S unmount.S = setuid.S getuid.S geteuid.S getpeername.S getsockname.S access.S chflags.S = fchflags.S sync.S kill.S getppid.S dup.S getegid.S profil.S ktrace.S getgid= .S acct.S sigaltstack.S ioctl.S reboot.S revoke.S symlink.S readlink.S exec= ve.S umask.S chroot.S vadvise.S munmap.S mprotect.S madvise.S mincore.S get= groups.S setgroups.S getpgrp.S setpgid.S setitimer.S swapon.S getitimer.S g= etdtablesize.S dup2.S setpriority.S socket.S getpriority.S bind.S setsockop= t.S listen.S getrusage.S getsockopt.S settimeofday.S fchown.S fchmod.S setr= euid.S setregid.S rename.S flock.S mkfifo.S shutdown.S socketpair.S mkdir.S= rmdir.S utimes.S adjtime.S setsid.S quotactl.S nlm_syscall.S nfssvc.S free= bsd4_statfs.S freebsd4_fstatfs.S lgetfh.S getfh.S freebsd4_getdomainname.S = freebsd4_setdomainname.S freebsd4_uname.S sysarch.S rtprio.S semsys.S msgsy= s.S shmsys.S freebsd6_pread.S freebsd6_pwrite.S setfib.S ntp_adjtime.S setg= id.S setegid.S seteuid.S stat.S fstat.S lstat.S pathconf.S fpathconf.S getr= limit.S setrlimit.S getdirentries.S freebsd6_mmap.S __syscall.S freebsd6_ls= eek.S freebsd6_truncate.S freebsd6_ftruncate.S __sysctl.S mlock.S munlock.S= undelete.S futimes.S getpgid.S freebsd7___semctl.S semget.S semop.S freebs= d7_msgctl.S msgget.S msgsnd.S msgrcv.S shmat.S freebsd7_shmctl.S shmdt.S sh= mget.S clock_settime.S clock_getres.S ktimer_create.S ktimer_delete.S ktime= r_settime.S ktimer_gettime.S ktimer_getoverrun.S ffclock_getcounter.S ffclo= ck_setestimate.S ffclock_getestimate.S clock_getcpuclockid2.S ntp_gettime.S= minherit.S rfork.S issetugid.S lchown.S aio_read.S aio_write.S lio_listio.= S getdents.S lchmod.S netbsd_lchown.S lutimes.S netbsd_msync.S nstat.S nfst= at.S nlstat.S preadv.S pwritev.S freebsd4_fhstatfs.S fhopen.S fhstat.S modn= ext.S modstat.S modfnext.S modfind.S kldload.S kldunload.S kldfind.S kldnex= t.S kldstat.S kldfirstmod.S getsid.S setresuid.S setresgid.S aio_return.S a= io_cancel.S aio_error.S oaio_read.S oaio_write.S olio_listio.S mlockall.S m= unlockall.S __getcwd.S sched_setparam.S sched_getparam.S sched_setscheduler= .S sched_getscheduler.S sched_yield.S sched_get_priority_max.S sched_get_pr= iority_min.S sched_rr_get_interval.S utrace.S freebsd4_sendfile.S kldsym.S = jail.S nnpfs_syscall.S freebsd4_sigaction.S sigpending.S freebsd4_sigreturn= .S __acl_get_file.S __acl_set_file.S __acl_get_fd.S __acl_set_fd.S __acl_de= lete_file.S __acl_delete_fd.S __acl_aclcheck_file.S __acl_aclcheck_fd.S ext= attrctl.S extattr_set_file.S extattr_get_file.S extattr_delete_file.S aio_w= aitcomplete.S getresuid.S getresgid.S kqueue.S extattr_set_fd.S extattr_get= _fd.S extattr_delete_fd.S __setugid.S eaccess.S afs3_syscall.S nmount.S __m= ac_get_proc.S __mac_set_proc.S __mac_get_fd.S __mac_get_file.S __mac_set_fd= .S __mac_set_file.S kenv.S lchflags.S uuidgen.S sendfile.S mac_syscall.S ge= tfsstat.S statfs.S fstatfs.S fhstatfs.S ksem_close.S ksem_post.S ksem_wait.= S ksem_trywait.S ksem_init.S ksem_open.S ksem_unlink.S ksem_getvalue.S ksem= _destroy.S __mac_get_pid.S __mac_get_link.S __mac_set_link.S extattr_set_li= nk.S extattr_get_link.S extattr_delete_link.S __mac_execve.S swapoff.S __ac= l_get_link.S __acl_set_link.S __acl_delete_link.S __acl_aclcheck_link.S thr= _create.S thr_exit.S thr_self.S thr_kill.S _umtx_lock.S _umtx_unlock.S jail= _attach.S extattr_list_fd.S extattr_list_file.S extattr_list_link.S ksem_ti= medwait.S thr_suspend.S thr_wake.S kldunloadf.S audit.S auditon.S getauid.S= setauid.S getaudit.S setaudit.S getaudit_addr.S setaudit_addr.S auditctl.S= _umtx_op.S thr_new.S sigqueue.S kmq_open.S kmq_setattr.S kmq_timedreceive.= S kmq_timedsend.S kmq_notify.S kmq_unlink.S abort2.S thr_set_name.S aio_fsy= nc.S rtprio_thread.S sctp_peeloff.S sctp_generic_sendmsg.S sctp_generic_sen= dmsg_iov.S sctp_generic_recvmsg.S thr_kill2.S shm_open.S shm_unlink.S cpuse= t.S cpuset_setid.S cpuset_getid.S cpuset_getaffinity.S cpuset_setaffinity.S= faccessat.S fchmodat.S fchownat.S fexecve.S fstatat.S futimesat.S linkat.S= mkdirat.S mkfifoat.S mknodat.S readlinkat.S renameat.S symlinkat.S unlinka= t.S posix_openpt.S gssd_syscall.S jail_get.S jail_set.S jail_remove.S close= from.S __semctl.S msgctl.S shmctl.S lpathconf.S __cap_rights_get.S cap_ente= r.S cap_getmode.S pdfork.S pdkill.S pdgetpid.S getloginclass.S setloginclas= s.S rctl_get_racct.S rctl_get_rules.S rctl_get_limits.S rctl_add_rule.S rct= l_remove_rule.S posix_fallocate.S posix_fadvise.S cap_rights_limit.S cap_io= ctls_limit.S cap_ioctls_get.S cap_fcntls_limit.S cap_fcntls_get.S bindat.S = connectat.S chflagsat.S pipe2.S aio_mlock.S procctl.S _getlogin.S _exit.S _= pread.S _pwrite.S _lseek.S _mmap.S _ftruncate.S _truncate.S _clock_gettime.= S _gettimeofday.S _futimens.S _utimensat.S _accept.S _accept4.S _aio_suspen= d.S _close.S _connect.S _fcntl.S _fsync.S _fork.S _kevent.S _msync.S _nanos= leep.S _open.S _openat.S _poll.S _ppoll.S _pselect.S _read.S _readv.S _recv= from.S _recvmsg.S _select.S _sendmsg.S _sendto.S _setcontext.S _sigprocmask= .S _sigsuspend.S _sigtimedwait.S _sigwait.S _sigwaitinfo.S _swapcontext.S _= wait4.S _wait6.S _write.S _writev.S _sigaction.S /builds/workspace/FreeBSD_= stable_10/src/lib/libc/rpc/auth_none.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/rpc/auth_unix.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/rpc/authunix_prot.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc= /bindresvport.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/clnt_b= cast.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/clnt_dg.c /buil= ds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/clnt_generic.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/rpc/clnt_perror.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/rpc/clnt_raw.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/rpc/clnt_simple.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/rpc/clnt_vc.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rp= c/rpc_dtablesize.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/get= netconfig.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/getnetpath= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/getrpcent.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/rpc/getrpcport.c /builds/workspac= e/FreeBSD_stable_10/src/lib/libc/rpc/mt_misc.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/rpc/pmap_clnt.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/rpc/pmap_getmaps.c /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/rpc/pmap_getport.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc= /pmap_prot.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/pmap_prot= 2.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/pmap_rmt.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/rpc/rpc_prot.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/rpc/rpc_commondata.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/rpc/rpc_callmsg.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/rpc/rpc_generic.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/rpc/rpc_soc.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rp= c/rpcb_clnt.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/rpcb_pro= t.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/rpcb_st_xdr.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/rpcsec_gss_stub.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/rpc/svc.c /builds/workspace/FreeBS= D_stable_10/src/lib/libc/rpc/svc_auth.c /builds/workspace/FreeBSD_stable_10= /src/lib/libc/rpc/svc_dg.c /builds/workspace/FreeBSD_stable_10/src/lib/libc= /rpc/svc_auth_unix.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/s= vc_generic.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/svc_raw.c= /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/svc_run.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/rpc/svc_simple.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/rpc/svc_vc.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/rpc/auth_time.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/rpc/auth_des.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/a= uthdes_prot.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/des_cryp= t.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/des_soft.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/rpc/crypt_client.c /builds/worksp= ace/FreeBSD_stable_10/src/lib/libc/rpc/key_call.c /builds/workspace/FreeBSD= _stable_10/src/lib/libc/rpc/key_prot_xdr.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/rpc/getpublickey.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/rpc/svc_auth_des.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/rpc/netname.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/netna= mer.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/rpcdname.c /buil= ds/workspace/FreeBSD_stable_10/src/lib/libc/rpc/rtime.c crypt_clnt.c crypt_= xdr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/uuid/uuid_compare.c = /builds/workspace/FreeBSD_stable_10/src/lib/libc/uuid/uuid_create.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/uuid/uuid_create_nil.c /builds/wo= rkspace/FreeBSD_stable_10/src/lib/libc/uuid/uuid_equal.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/uuid/uuid_from_string.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/uuid/uuid_hash.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/uuid/uuid_is_nil.c /builds/workspace/FreeBSD_stable_10/= src/lib/libc/uuid/uuid_stream.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/uuid/uuid_to_string.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/xdr/xdr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/xdr/xdr_array.= c /builds/workspace/FreeBSD_stable_10/src/lib/libc/xdr/xdr_float.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/xdr/xdr_mem.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/xdr/xdr_rec.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/xdr/xdr_reference.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/xdr/xdr_sizeof.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/xdr/xdr_stdio.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/yp/xdryp= .c yp_xdr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/yp/yplib.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/../../sys/kern/subr_capabilit= y.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gdtoa/machdep_ldisx.c = /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/stdlib/div.S /builds= /workspace/FreeBSD_stable_10/src/lib/libc/amd64/stdlib/ldiv.S /builds/works= pace/FreeBSD_stable_10/src/lib/libc/amd64/stdlib/lldiv.S /builds/workspace/= FreeBSD_stable_10/src/lib/libc/amd64/string/bcmp.S /builds/workspace/FreeBS= D_stable_10/src/lib/libc/amd64/string/bcopy.S /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/amd64/string/bzero.S /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/amd64/string/memcmp.S /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/amd64/string/memcpy.S /builds/workspace/FreeBSD_stable_10/src/li= b/libc/amd64/string/memmove.S /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/amd64/string/memset.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/= amd64/string/strcat.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd6= 4/string/strcmp.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/st= ring/stpcpy.S /builds/workspace/FreeBSD_stable_10/src/lib/libc/amd64/string= /strcpy.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/gdtoa/_hdtoa.c /= builds/workspace/FreeBSD_stable_10/src/lib/libc/gdtoa/_hldtoa.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/gdtoa/_ldtoa.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/gdtoa/glue.c gdtoa_strtorx.c gdtoa_dmisc.c gdtoa= _dtoa.c gdtoa_gdtoa.c gdtoa_gethex.c gdtoa_gmisc.c gdtoa_hd_init.c gdtoa_he= xnan.c gdtoa_misc.c gdtoa_smisc.c gdtoa_strtod.c gdtoa_strtodg.c gdtoa_strt= of.c gdtoa_strtord.c gdtoa_sum.c gdtoa_ulp.c /builds/workspace/FreeBSD_stab= le_10/src/lib/libc/gen/modf.c /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/stdlib/_Exit.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/= a64l.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/abort.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/abs.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/stdlib/atexit.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/stdlib/atof.c /builds/workspace/FreeBSD_stable_10/src= /lib/libc/stdlib/atoi.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/st= dlib/atol.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/atoll.c= /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/bsearch.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/stdlib/exit.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/stdlib/getenv.c /builds/workspace/FreeBSD_stab= le_10/src/lib/libc/stdlib/getopt.c /builds/workspace/FreeBSD_stable_10/src/= lib/libc/stdlib/getopt_long.c /builds/workspace/FreeBSD_stable_10/src/lib/l= ibc/stdlib/getsubopt.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/std= lib/hcreate.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/heaps= ort.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/imaxabs.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/imaxdiv.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/stdlib/insque.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/stdlib/l64a.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/stdlib/labs.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/stdlib/llabs.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/l= search.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/merge.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/ptsname.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/stdlib/qsort.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/stdlib/qsort_r.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/stdlib/quick_exit.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/stdlib/radixsort.c /builds/workspace/FreeBSD_stable_10/src/lib/= libc/stdlib/rand.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/= random.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/reallocf.c= /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/realpath.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/stdlib/remque.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/stdlib/strfmon.c /builds/workspace/FreeBSD_= stable_10/src/lib/libc/stdlib/strtoimax.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/stdlib/strtol.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/stdlib/strtoll.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/std= lib/strtoq.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/strtou= l.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/strtonum.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/strtoull.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/stdlib/strtoumax.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/stdlib/strtouq.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/stdlib/system.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/stdlib/tdelete.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/stdlib/tfind.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/ts= earch.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stdlib/twalk.c jem= alloc_jemalloc.c jemalloc_arena.c jemalloc_atomic.c jemalloc_base.c jemallo= c_bitmap.c jemalloc_chunk.c jemalloc_chunk_dss.c jemalloc_chunk_mmap.c jema= lloc_ckh.c jemalloc_ctl.c jemalloc_extent.c jemalloc_hash.c jemalloc_huge.c= jemalloc_mb.c jemalloc_mutex.c jemalloc_prof.c jemalloc_quarantine.c jemal= loc_rtree.c jemalloc_stats.c jemalloc_tcache.c jemalloc_util.c jemalloc_tsd= .c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/ffs.c /builds/wo= rkspace/FreeBSD_stable_10/src/lib/libc/string/ffsl.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/string/ffsll.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/string/fls.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/string/flsl.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/fl= sll.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/memccpy.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/string/memchr.c /builds/works= pace/FreeBSD_stable_10/src/lib/libc/string/memrchr.c /builds/workspace/Free= BSD_stable_10/src/lib/libc/string/memmem.c /builds/workspace/FreeBSD_stable= _10/src/lib/libc/string/stpncpy.c /builds/workspace/FreeBSD_stable_10/src/l= ib/libc/string/strcasecmp.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/string/strcasestr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/stri= ng/strchr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/strchrn= ul.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/strcoll.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/string/strcspn.c /builds/works= pace/FreeBSD_stable_10/src/lib/libc/string/strdup.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/string/strerror.c /builds/workspace/FreeBSD_stabl= e_10/src/lib/libc/string/strlcat.c /builds/workspace/FreeBSD_stable_10/src/= lib/libc/string/strlcpy.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/= string/strlen.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/str= mode.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/strncat.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/string/strncmp.c /builds/wor= kspace/FreeBSD_stable_10/src/lib/libc/string/strncpy.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/string/strndup.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/string/strnlen.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/string/strnstr.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/string/strpbrk.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/= strrchr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/strsep.c = /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/strsignal.c /builds= /workspace/FreeBSD_stable_10/src/lib/libc/string/strspn.c /builds/workspace= /FreeBSD_stable_10/src/lib/libc/string/strstr.c /builds/workspace/FreeBSD_s= table_10/src/lib/libc/string/strtok.c /builds/workspace/FreeBSD_stable_10/s= rc/lib/libc/string/strxfrm.c /builds/workspace/FreeBSD_stable_10/src/lib/li= bc/string/swab.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/wc= pcpy.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/wcpncpy.c /b= uilds/workspace/FreeBSD_stable_10/src/lib/libc/string/wcscasecmp.c /builds/= workspace/FreeBSD_stable_10/src/lib/libc/string/wcscat.c /builds/workspace/= FreeBSD_stable_10/src/lib/libc/string/wcschr.c /builds/workspace/FreeBSD_st= able_10/src/lib/libc/string/wcscmp.c /builds/workspace/FreeBSD_stable_10/sr= c/lib/libc/string/wcscoll.c /builds/workspace/FreeBSD_stable_10/src/lib/lib= c/string/wcscpy.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/w= cscspn.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/wcsdup.c /= builds/workspace/FreeBSD_stable_10/src/lib/libc/string/wcslcat.c /builds/wo= rkspace/FreeBSD_stable_10/src/lib/libc/string/wcslcpy.c /builds/workspace/F= reeBSD_stable_10/src/lib/libc/string/wcslen.c /builds/workspace/FreeBSD_sta= ble_10/src/lib/libc/string/wcsncasecmp.c /builds/workspace/FreeBSD_stable_1= 0/src/lib/libc/string/wcsncat.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/string/wcsncmp.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/str= ing/wcsncpy.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/wcsnl= en.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/wcspbrk.c /bui= lds/workspace/FreeBSD_stable_10/src/lib/libc/string/wcsrchr.c /builds/works= pace/FreeBSD_stable_10/src/lib/libc/string/wcsspn.c /builds/workspace/FreeB= SD_stable_10/src/lib/libc/string/wcsstr.c /builds/workspace/FreeBSD_stable_= 10/src/lib/libc/string/wcstok.c /builds/workspace/FreeBSD_stable_10/src/lib= /libc/string/wcswidth.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/st= ring/wcsxfrm.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/wmem= chr.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/string/wmemcmp.c /bu= ilds/workspace/FreeBSD_stable_10/src/lib/libc/string/wmemcpy.c /builds/work= space/FreeBSD_stable_10/src/lib/libc/string/wmemmove.c /builds/workspace/Fr= eeBSD_stable_10/src/lib/libc/string/wmemset.c /builds/workspace/FreeBSD_stable_10/src/lib/libc/net/nslexer.l:47:10: fatal= error: 'nsparser.h' file not found #include "nsparser.h" ^ 1 error generated. mkdep: compile failed *** [.depend] Error code 1 make[4]: stopped in /builds/workspace/FreeBSD_stable_10/src/lib/libc 1 error make[4]: stopped in /builds/workspace/FreeBSD_stable_10/src/lib/libc *** [lib/libc__L] Error code 2 make[3]: stopped in /builds/workspace/FreeBSD_stable_10/src 1 error make[3]: stopped in /builds/workspace/FreeBSD_stable_10/src *** [libraries] Error code 2 make[2]: stopped in /builds/workspace/FreeBSD_stable_10/src 1 error make[2]: stopped in /builds/workspace/FreeBSD_stable_10/src *** [_libraries] Error code 2 make[1]: stopped in /builds/workspace/FreeBSD_stable_10/src 1 error make[1]: stopped in /builds/workspace/FreeBSD_stable_10/src *** [buildworld] Error code 2 make: stopped in /builds/workspace/FreeBSD_stable_10/src 1 error make: stopped in /builds/workspace/FreeBSD_stable_10/src [Pipeline] } //withEnv [Pipeline] Set environment variables : End [Pipeline] } //dir [Pipeline] Change current directory : End [Pipeline] } //node [Pipeline] Allocate node : End [Pipeline] Allocate node : Start Running on master in /usr/local/jenkins/workspace/FreeBSD_stable_10 [Pipeline] node { [Pipeline] step From owner-freebsd-stable@freebsd.org Mon Feb 8 17:39:40 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 50A09AA2065 for ; Mon, 8 Feb 2016 17:39:40 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 3A5671A03 for ; Mon, 8 Feb 2016 17:39:40 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: by mailman.ysv.freebsd.org (Postfix) id 386D2AA2064; Mon, 8 Feb 2016 17:39:40 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 37F26AA2063 for ; Mon, 8 Feb 2016 17:39:40 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E9F721A02 for ; Mon, 8 Feb 2016 17:39:39 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1aSpmh-000JvV-7e; Mon, 08 Feb 2016 20:39:35 +0300 Date: Mon, 8 Feb 2016 20:39:35 +0300 From: Slawa Olhovchenkov To: Adrian Chadd Cc: Luigi Rizzo , "stable@freebsd.org" Subject: Re: 82576 + NETMAP + VLAN Message-ID: <20160208173935.GK68298@zxy.spb.ru> References: <20151018210049.GT6469@zxy.spb.ru> <20151022163519.GF6469@zxy.spb.ru> <20160202204446.GQ88527@zxy.spb.ru> <20160204130029.GC88527@zxy.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Feb 2016 17:39:40 -0000 On Thu, Feb 04, 2016 at 10:47:34AM -0800, Adrian Chadd wrote: > .. but if it does, can you enable witness and see what it reports as > lock order violations? last STABLE: 1. first LOR (with poll, don't cause direct problems now): lock order reversal: 1st 0xfffff800946e6700 vm object (vm object) @ /usr/src/sys/vm/vm_fault.c:363 2nd 0xffffffff813e14d8 netmap memory allocator lock (netmap memory allocator lock) @ /usr/src/sys/dev/netmap/netmap_mem2.c:393 KDB: stack backtrace: #0 0xffffffff80970320 at kdb_backtrace+0x60 #1 0xffffffff809882ce at witness_checkorder+0xc7e #2 0xffffffff8091fcbc at __mtx_lock_flags+0x4c #3 0xffffffff806784f6 at netmap_mem_ofstophys+0x36 #4 0xffffffff80676834 at netmap_dev_pager_fault+0x34 #5 0xffffffff80b81a0f at dev_pager_getpages+0x3f #6 0xffffffff80b8cc1e at vm_fault_hold+0x86e #7 0xffffffff80b8c367 at vm_fault+0x77 #8 0xffffffff80d0e2c9 at trap_pfault+0x199 #9 0xffffffff80d0db47 at trap+0x527 #10 0xffffffff80cf4ce2 at calltrap+0x8 2. kqueue issuse (not LOR!) acquiring duplicate lock of same type: "nm_kn_lock" 1st nm_kn_lock @ /usr/src/sys/kern/kern_event.c:2003 2nd nm_kn_lock @ /usr/src/sys/kern/kern_event.c:2003 KDB: stack backtrace: #0 0xffffffff80970320 at kdb_backtrace+0x60 #1 0xffffffff809882ce at witness_checkorder+0xc7e #2 0xffffffff8091fcbc at __mtx_lock_flags+0x4c #3 0xffffffff808fd899 at knote+0x39 #4 0xffffffff8067636b at freebsd_selwakeup+0x8b #5 0xffffffff80674eb5 at netmap_notify+0x55 #6 0xffffffff8067ccb6 at netmap_pipe_txsync+0x156 #7 0xffffffff80674740 at netmap_poll+0x400 #8 0xffffffff80676b8e at netmap_knrw+0x6e #9 0xffffffff808fc57a at kqueue_register+0x64a #10 0xffffffff808fcdd4 at kern_kevent_fp+0x144 #11 0xffffffff808fcc4f at kern_kevent+0x9f #12 0xffffffff808fcaea at sys_kevent+0x12a #13 0xffffffff80d0e914 at amd64_syscall+0x2d4 #14 0xffffffff80cf4fcb at Xfast_syscall+0xfb Do you need anything? > On 4 February 2016 at 10:47, Adrian Chadd wrote: > > I've no time to help with this, I'm sorry :( > > > > > > -a > > > > > > On 4 February 2016 at 05:00, Slawa Olhovchenkov wrote: > >> On Tue, Feb 02, 2016 at 11:44:47PM +0300, Slawa Olhovchenkov wrote: > >> > >>> On Thu, Oct 22, 2015 at 11:24:53AM -0700, Luigi Rizzo wrote: > >>> > >>> > On Thu, Oct 22, 2015 at 11:12 AM, Adrian Chadd wrote: > >>> > > On 22 October 2015 at 09:35, Slawa Olhovchenkov wrote: > >>> > >> On Sun, Oct 18, 2015 at 07:45:52PM -0700, Adrian Chadd wrote: > >>> > >> > >>> > >>> Heh, file a bug with luigi; it should be defined better inside netmap itself. > >>> > >> > >>> > >> I am CC: luigi. > >>> > >> > >>> > >> Next question: do kevent RX/TX sync? > >>> > >> In my setup I am need to manual NIOCTXSYNC/NIOCRXSYNC. > >>> > > > >>> > > Hi, > >>> > > > >>> > > Nope. kqueue() doesn't do the implicit sync like poll() does; it's > >>> > > just the notification path. > >>> > > >>> > actually not. When the file descriptor is registered there > >>> > is an implicit sync, and there is another one when an event > >>> > is posted for the file descriptor. > >>> > > >>> > unless there are bugs, of course. > >>> > >>> I found strange behaivor: > >>> > >>> 1. open netmap and register in main thread > >>> 2. kevent register in different thread > >>> 3. result: got event by kevent but no ring sinc (all head,tail,cur > >>> still 0). > >>> > >>> Is this normal? Or is this bug? > >>> > >>> open and registering netmap in same thread as kevent resolve this. > >> > >> Also, kevent+netmap deadlocked for me: > >> > >> PID TID COMM TDNAME KSTACK > >> 1095 100207 addos - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_timedwait_sig+0x10 _sleep+0x238 kern_nanosleep+0x10e sys_nanosleep+0x51 amd64_syscall+0x40f Xfast_syscall+0xfb > >> 1095 100208 addos worker#0 mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > >> 1095 100209 addos worker#1 mi_switch+0xe1 turnstile_wait+0x42a __mtx_lock_sleep+0x26b knote+0x38 freebsd_selwakeup+0x8b netmap_notify+0x55 netmap_pipe_txsync+0x156 netmap_poll+0x400 netmap_knrw+0x6e kqueue_register+0x799 kern_kevent+0x158 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > >> 1095 100210 addos worker#2 mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > >> 1095 100211 addos worker#NOIP mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > >> 1095 100212 addos balancer mi_switch+0xe1 turnstile_wait+0x42a __mtx_lock_sleep+0x26b knote+0x38 freebsd_selwakeup+0x8b netmap_notify+0x2a netmap_pipe_rxsync+0x54 netmap_poll+0x774 netmap_knrw+0x6e kern_kevent+0x5cc sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb From owner-freebsd-stable@freebsd.org Mon Feb 8 18:31:19 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D4A8EAA15F6 for ; Mon, 8 Feb 2016 18:31:19 +0000 (UTC) (envelope-from scott.otis@tandemcal.com) Received: from Filter01.GreenHouseData.com (outmail.fchosted.com [205.234.75.57]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "filter.greenhousedata.com", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B5FEE1B21 for ; Mon, 8 Feb 2016 18:31:18 +0000 (UTC) (envelope-from scott.otis@tandemcal.com) X-ASG-Debug-ID: 1454956271-0a955c0aaa197bf40001-BIHDGU Received: from mail.fchosted.com (mailflow.greenhousedata.com [10.36.251.68]) by Filter01.GreenHouseData.com with ESMTP id GQL7NyQawneyvwCp (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO); Mon, 08 Feb 2016 10:31:11 -0800 (PST) X-Barracuda-Envelope-From: scott.otis@tandemcal.com Received: from EVT01FEVWEXA001.fchosted.com ([10.10.2.130]) by sea02fevwexa001 ([10.10.2.131]) with mapi id 14.03.0266.001; Mon, 8 Feb 2016 10:31:11 -0800 From: Scott Otis To: Adrian Chadd CC: "freebsd-stable@freebsd.org" Subject: RE: 10.2 Release seems to be crashing on Azure with "Standard DS" VM sizes Thread-Topic: 10.2 Release seems to be crashing on Azure with "Standard DS" VM sizes X-ASG-Orig-Subj: RE: 10.2 Release seems to be crashing on Azure with "Standard DS" VM sizes Thread-Index: AdFgXh+MGR2ZakJhS8y7lHqrkKi5uwAXKNQAAAhAj7AAO5jVAAA1BxZg Date: Mon, 8 Feb 2016 18:31:10 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [66.223.182.52] Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-Barracuda-Connect: mailflow.greenhousedata.com[10.36.251.68] X-Barracuda-Start-Time: 1454956271 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: https://Filter.GreenHouseData.com:443/cgi-mod/mark.cgi X-Barracuda-Scan-Msg-Size: 10036 X-Virus-Scanned: by bsmtpd at GreenHouseData.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=9.0 tests= X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.26861 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Feb 2016 18:31:20 -0000 SGVyZSBpcyB0aGUgYm9vdCBsb2cgYWZ0ZXIgYSBjcmFzaCAoc2F5cyB0aGVyZSBhcmUgbm8gY29y ZSBkdW1wcyBmb3VuZC4uLiBhbnkgd2F5IHRvIGZpZ3VyZSBvdXQgd2h5IGl0IGlzIG5vdCBkdW1w aW5nIHRoZSBjb3JlPyk6DQoNCi0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwI LwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgv CC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCBtbSBtbSi0I XAh8CC8ILQhcCCAbWzc7NDZIIGBgYCAgICAgICAgICAgICAgICAgICAgICAgIGAbWzg7NDZIc2Ag YC4uLi4uLS0tLi4uLi4uLi0tLmBgYCAgIC0vG1s5OzQ2SCtvICAgLi0tYCAgICAgICAgIC95OmAg ICAgICArLhtbMTA7NDZIIHlvYDouICAgICAgICAgICAgOm8gICAgICBgKy0bWzExOzQ2SCAgeS8g ICAgICAgICAgICAgICAtL2AgICAtby8bWzEyOzQ2SCAuLSAgICAgICAgICAgICAgICAgIDo6L3N5 KzouG1sxMzs0NkggLyAgICAgICAgICAgICAgICAgICAgIGAtLSAgLxtbMTQ7NDZIYDogICAgICAg ICAgICAgICAgICAgICAgICAgIDpgG1sxNTs0NkhgOiAgICAgICAgICAgICAgICAgICAgICAgICAg OmAbWzE2OzQ2SCAvICAgICAgICAgICAgICAgICAgICAgICAgICAvG1sxNzs0NkggLi0gICAgICAg ICAgICAgICAgICAgICAgICAtLhtbMTg7NDZIICAtLSAgICAgICAgICAgICAgICAgICAgICAtLhtb MTk7NDZIICAgYDpgICAgICAgICAgICAgICAgICAgYDpgG1syMDs0NkggICAgIC4tLSAgICAgICAg ICAgICBgLS0uG1syMTs0NkggICAgICAgIC4tLS0uLi4uLi0tLS0ufAgvCC0IXAggG1sxOzJIIF9f X19fXyAgICAgICAgICAgICAgIF9fX18gICBfX19fXyBfX19fXyAgG1syOzJIfCAgX19fX3wgICAg ICAgICAgICAgfCAgXyBcIC8gX19fX3wgIF9fIFwgG1szOzJIfCB8X19fIF8gX18gX19fICBfX18g fCB8XykgfCAoX19fIHwgfCAgfCB8G1s0OzJIfCAgX19ffCAnX18vIF8gXC8gXyBcfCAgXyA8IFxf X18gXHwgfCAgfCB8G1s1OzJIfCB8ICAgfCB8IHwgIF9fLyAgX18vfCB8XykgfF9fX18pIHwgfF9f fCB8G1s2OzJIfCB8ICAgfCB8IHwgICAgfCAgICB8fCAgICAgfCAgICAgIHwgICAgICB8G1s3OzJI fF98ICAgfF98ICBcX19ffFxfX198fF9fX18vfF9fX19fL3xfX19fXy8gG1sxMDsySHwbWzExOzJI fBtbMTI7Mkh8G1sxMzsySHwbWzE0OzJIfBtbMTU7Mkh8G1sxNjsySHwbWzE3OzJIfBtbMTg7Mkh8 G1sxOTsySHwbWzIwOzJIfBtbMjE7Mkh8G1sxMDs0NEh8G1sxMTs0NEh8G1sxMjs0NEh8G1sxMzs0 NEh8G1sxNDs0NEh8G1sxNTs0NEh8G1sxNjs0NEh8G1sxNzs0NEh8G1sxODs0NEh8G1sxOTs0NEh8 G1syMDs0NEh8G1syMTs0NEh8G1s5OzNIPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT0bWzIyOzNIPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0b Wzk7MkgrG1syMjsySCsbWzk7NDRIKxtbMjI7NDRIKxtbMjU7MEh8CC8ILQhcCHwILwgtCFwIfAgv CC0IXAh8CC8IG1s5OzE1SFdlbGNvbWUgdG8gRnJlZUJTRBtbMTE7NUgxIBtbMTE7NkguG1sxMTs4 SEJvb3QgTXVsdGkgVXNlciBbRW50ZXJdG1sxMjs1SDIgG1sxMjs2SC4bWzEyOzhIQm9vdCBbU11p bmdsZSBVc2VyG1sxMzs1SDMgG1sxMzs2SC4bWzEzOzhIW0VzY11hcGUgdG8gbG9hZGVyIHByb21w dBtbMTQ7NUg0IBtbMTQ7NkguG1sxNDs4SFJlYm9vdBtbMTY7NUhPcHRpb25zOhtbMTc7NUg1IBtb MTc7NkguG1sxNzs4SFtLXWVybmVsOiBrZXJuZWwgKDEgb2YgMikbWzE4OzVINiAbWzE4OzZILhtb MTg7OEhDb25maWd1cmUgQm9vdCBbT11wdGlvbnMuLi4bWzI1OzBIG1syMzs0SEF1dG9ib290IGlu IDkgc2Vjb25kcy4gW1NwYWNlXSB0byBwYXVzZRtbMjU7MEgbWzIzOzRIQXV0b2Jvb3QgaW4gOCBz ZWNvbmRzLiBbU3BhY2VdIHRvIHBhdXNlG1syNTswSBtbMjM7NEhBdXRvYm9vdCBpbiA3IHNlY29u ZHMuIFtTcGFjZV0gdG8gcGF1c2UbWzI1OzBIG1syMzs0SEF1dG9ib290IGluIDYgc2Vjb25kcy4g W1NwYWNlXSB0byBwYXVzZRtbMjU7MEgbWzIzOzRIQXV0b2Jvb3QgaW4gNSBzZWNvbmRzLiBbU3Bh Y2VdIHRvIHBhdXNlG1syNTswSBtbMjM7NEhBdXRvYm9vdCBpbiA0IHNlY29uZHMuIFtTcGFjZV0g dG8gcGF1c2UbWzI1OzBIG1syMzs0SEF1dG9ib290IGluIDMgc2Vjb25kcy4gW1NwYWNlXSB0byBw YXVzZRtbMjU7MEgbWzIzOzRIQXV0b2Jvb3QgaW4gMiBzZWNvbmRzLiBbU3BhY2VdIHRvIHBhdXNl G1syNTswSBtbMjM7NEhBdXRvYm9vdCBpbiAxIHNlY29uZHMuIFtTcGFjZV0gdG8gcGF1c2UbWzI1 OzBIG1syMzs0SCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIBtbMjU7MEgt CFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC9i b290L2tlcm5lbC9rZXJuZWwgdGV4dD0weGZjOGRlOCAtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgt CFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0I XAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhc CHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwI fAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8CC8ILQhcCHwILwgtCFwIfAgvCC0IXAh8 CGRhdGE9MHgxMjgzYjArMHgyMDc4ODAgLwgtCFwIfAgvCC0IXAh8CC8ILQhzeW1zPVsweDgrMHgx NDUzNTBcCHwILwgtCFwIfAgvCC0IXAh8CCsweDgrMHgxNWZlMjAvCC0IXAh8CC8ILQhcCHwILwgt CFwIXQ0KQm9vdGluZy4uLg0KfAgvCC0IXAh8CC8IQ29weXJpZ2h0IChjKSAxOTkyLTIwMTUgVGhl IEZyZWVCU0QgUHJvamVjdC4NCkNvcHlyaWdodCAoYykgMTk3OSwgMTk4MCwgMTk4MywgMTk4Niwg MTk4OCwgMTk4OSwgMTk5MSwgMTk5MiwgMTk5MywgMTk5NA0KICAgICAgICBUaGUgUmVnZW50cyBv ZiB0aGUgVW5pdmVyc2l0eSBvZiBDYWxpZm9ybmlhLiBBbGwgcmlnaHRzIHJlc2VydmVkLg0KRnJl ZUJTRCBpcyBhIHJlZ2lzdGVyZWQgdHJhZGVtYXJrIG9mIFRoZSBGcmVlQlNEIEZvdW5kYXRpb24u DQpGcmVlQlNEIDEwLjItUkVMRUFTRSAjMCByMjg2NjY2OiBXZWQgQXVnIDEyIDE1OjI2OjM3IFVU QyAyMDE1DQogICAgcm9vdEByZWxlbmcxLm55aS5mcmVlYnNkLm9yZzovdXNyL29iai91c3Ivc3Jj L3N5cy9HRU5FUklDIGFtZDY0DQpGcmVlQlNEIGNsYW5nIHZlcnNpb24gMy40LjEgKHRhZ3MvUkVM RUFTRV8zNC9kb3QxLWZpbmFsIDIwODAzMikgMjAxNDA1MTINCkNQVTogSW50ZWwoUikgWGVvbihS KSBDUFUgRTUtMjY2MCAwIEAgMi4yMEdIeiAoMTEwOS4yOS1NSHogSzgtY2xhc3MgQ1BVKQ0KICBP cmlnaW49IkdlbnVpbmVJbnRlbCIgIElkPTB4MjA2ZDcgIEZhbWlseT0weDYgIE1vZGVsPTB4MmQg IFN0ZXBwaW5nPTcNCiAgRmVhdHVyZXM9MHhmODNmYmZmPEZQVSxWTUUsREUsUFNFLFRTQyxNU1Is UEFFLE1DRSxDWDgsQVBJQyxTRVAsTVRSUixQR0UsTUNBLENNT1YsUEFULFBTRTM2LE1NWCxGWFNS LFNTRSxTU0UyLFNTPg0KICBGZWF0dXJlczI9MHg5ZTk4MjIwMzxTU0UzLFBDTE1VTFFEUSxTU1NF MyxDWDE2LFNTRTQuMSxTU0U0LjIsUE9QQ05ULEFFU05JLFhTQVZFLE9TWFNBVkUsQVZYLEhWPg0K ICBBTUQgRmVhdHVyZXM9MHgyMDEwMDgwMDxTWVNDQUxMLE5YLExNPg0KICBBTUQgRmVhdHVyZXMy PTB4MTxMQUhGPg0KICBYU0FWRSBGZWF0dXJlcz0weDE8WFNBVkVPUFQ+DQpIeXBlcnZpc29yOiBP cmlnaW4gPSAiTWljcm9zb2Z0IEh2Ig0KcmVhbCBtZW1vcnkgID0gMzc1ODA5NjM4NCAoMzU4NCBN QikNCmF2YWlsIG1lbW9yeSA9IDM1MTUxNDIxNDQgKDMzNTIgTUIpDQpFdmVudCB0aW1lciAiTEFQ SUMiIHF1YWxpdHkgNDAwDQpBQ1BJIEFQSUMgVGFibGU6IDxWUlRVQUwgTUlDUk9TRlQ+DQpyYW5k b20gZGV2aWNlIG5vdCBsb2FkZWQ7IHVzaW5nIGluc2VjdXJlIGVudHJvcHkNCmlvYXBpYzA6IENo YW5naW5nIEFQSUMgSUQgdG8gMA0KaW9hcGljMCA8VmVyc2lvbiAxLjE+IGlycXMgMC0yMyBvbiBt b3RoZXJib2FyZA0KcmFuZG9tOiA8U29mdHdhcmUsIFlhcnJvdz4gaW5pdGlhbGl6ZWQNCmtiZDEg YXQga2JkbXV4MA0Kdm1idXMwOiA8Vm1idXMgRGV2aWNlcz4gb24gbW90aGVyYm9hcmQNCmFjcGkw OiA8VlJUVUFMIE1JQ1JPU0ZUPiBvbiBtb3RoZXJib2FyZA0KYWNwaTA6IFBvd2VyIEJ1dHRvbiAo Zml4ZWQpDQpjcHUwOiA8QUNQSSBDUFU+IG9uIGFjcGkwDQphdHRpbWVyMDogPEFUIHRpbWVyPiBw b3J0IDB4NDAtMHg0MyBpcnEgMCBvbiBhY3BpMA0KVGltZWNvdW50ZXIgImk4MjU0IiBmcmVxdWVu Y3kgMTE5MzE4MiBIeiBxdWFsaXR5IDANCkV2ZW50IHRpbWVyICJpODI1NCIgZnJlcXVlbmN5IDEx OTMxODIgSHogcXVhbGl0eSAxMDANCmF0cnRjMDogPEFUIHJlYWx0aW1lIGNsb2NrPiBwb3J0IDB4 NzAtMHg3MSBpcnEgOCBvbiBhY3BpMA0KRXZlbnQgdGltZXIgIlJUQyIgZnJlcXVlbmN5IDMyNzY4 IEh6IHF1YWxpdHkgMA0KVGltZWNvdW50ZXIgIkFDUEktZmFzdCIgZnJlcXVlbmN5IDM1Nzk1NDUg SHogcXVhbGl0eSA5MDANCmFjcGlfdGltZXIwOiA8MzItYml0IHRpbWVyIGF0IDMuNTc5NTQ1TUh6 PiBwb3J0IDB4NDA4LTB4NDBiIG9uIGFjcGkwDQpwY2liMDogPEFDUEkgSG9zdC1QQ0kgYnJpZGdl PiBwb3J0IDB4Y2Y4LTB4Y2ZmIG9uIGFjcGkwDQpwY2kwOiA8QUNQSSBQQ0kgYnVzPiBvbiBwY2li MA0KaXNhYjA6IDxQQ0ktSVNBIGJyaWRnZT4gYXQgZGV2aWNlIDcuMCBvbiBwY2kwDQppc2EwOiA8 SVNBIGJ1cz4gb24gaXNhYjANCmF0YXBjaTA6IDxJbnRlbCBQSUlYNCBVRE1BMzMgY29udHJvbGxl cj4gcG9ydCAweDFmMC0weDFmNywweDNmNiwweDE3MC0weDE3NywweDM3NiwweGZmYTAtMHhmZmFm IGF0IGRldmljZSA3LjEgb24gcGNpMA0KYXRhMDogPEh5cGVyLVYgQVRBIHN0b3JhZ2UgZGlzZW5n YWdlIGRyaXZlcj4gYXQgY2hhbm5lbCAwIG9uIGF0YXBjaTANCmF0YTE6IDxBVEEgY2hhbm5lbD4g YXQgY2hhbm5lbCAxIG9uIGF0YXBjaTANCnBjaTA6IDxicmlkZ2U+IGF0IGRldmljZSA3LjMgKG5v IGRyaXZlciBhdHRhY2hlZCkNCnZnYXBjaTA6IDxWR0EtY29tcGF0aWJsZSBkaXNwbGF5PiBtZW0g MHhmODAwMDAwMC0weGZiZmZmZmZmIGlycSAxMSBhdCBkZXZpY2UgOC4wIG9uIHBjaTANCnZnYXBj aTA6IEJvb3QgdmlkZW8gZGV2aWNlDQphdGtiZGMwOiA8S2V5Ym9hcmQgY29udHJvbGxlciAoaTgw NDIpPiBwb3J0IDB4NjAsMHg2NCBpcnEgMSBvbiBhY3BpMA0KYXRrYmQwOiA8QVQgS2V5Ym9hcmQ+ IGlycSAxIG9uIGF0a2JkYzANCmtiZDAgYXQgYXRrYmQwDQphdGtiZDA6IFtHSUFOVC1MT0NLRURd DQpwc20wOiA8UFMvMiBNb3VzZT4gaXJxIDEyIG9uIGF0a2JkYzANCnBzbTA6IFtHSUFOVC1MT0NL RURdDQpwc20wOiBtb2RlbCBJbnRlbGxpTW91c2UgRXhwbG9yZXIsIGRldmljZSBJRCA0DQp1YXJ0 MDogPDE2NTUwIG9yIGNvbXBhdGlibGU+IHBvcnQgMHgzZjgtMHgzZmYgaXJxIDQgZmxhZ3MgMHgx MCBvbiBhY3BpMA0KdWFydDA6IGNvbnNvbGUgKDExNTIwMCxuLDgsMSkNCnVhcnQxOiA8MTY1NTAg b3IgY29tcGF0aWJsZT4gcG9ydCAweDJmOC0weDJmZiBpcnEgMyBvbiBhY3BpMA0KZmRjMDogPGZs b3BweSBkcml2ZSBjb250cm9sbGVyIChGREUpPiBwb3J0IDB4M2YwLTB4M2Y1LDB4M2Y3IGlycSA2 IGRycSAyIG9uIGFjcGkwDQpmZDA6IDwxNDQwLUtCIDMuNSIgZHJpdmU+IG9uIGZkYzAgZHJpdmUg MA0Kb3JtMDogPElTQSBPcHRpb24gUk9NPiBhdCBpb21lbSAweGMwMDAwLTB4Y2JmZmYgb24gaXNh MA0Kc2MwOiA8U3lzdGVtIGNvbnNvbGU+IGF0IGZsYWdzIDB4MTAwIG9uIGlzYTANCnNjMDogVkdB IDwxNiB2aXJ0dWFsIGNvbnNvbGVzLCBmbGFncz0weDMwMD4NCnZnYTA6IDxHZW5lcmljIElTQSBW R0E+IGF0IHBvcnQgMHgzYzAtMHgzZGYgaW9tZW0gMHhhMDAwMC0weGJmZmZmIG9uIGlzYTANCnBw YzA6IGNhbm5vdCByZXNlcnZlIEkvTyBwb3J0IHJhbmdlDQpUaW1lY291bnRlcnMgdGljayBldmVy eSAxLjAwMCBtc2VjDQpyYW5kb206IHVuYmxvY2tpbmcgZGV2aWNlLg0KVGltZWNvdW50ZXIgIlRT QyIgZnJlcXVlbmN5IDExMDkyODc1NzAgSHogcXVhbGl0eSA4MDANClRpbWVjb3VudGVyICJIeXBl ci1WIiBmcmVxdWVuY3kgMTAwMDAwMDAgSHogcXVhbGl0eSAxMDAwMDAwMA0Kc3RvcnZzYzAgb24g dm1idXMwDQpzdG9ydnNjMSBvbiB2bWJ1czANCmh5cGVydi11dGlsczAgb24gdm1idXMwDQpoeXBl cnYtdXRpbHMwOiBIeXBlci1WIFNlcnZpY2UgYXR0YWNoaW5nOiBIeXBlci1WIEhlYXJ0YmVhdCBT ZXJ2aWNlDQoNCmh5cGVydi11dGlsczEgb24gdm1idXMwDQpoeXBlcnYtdXRpbHMxOiBIeXBlci1W IFNlcnZpY2UgYXR0YWNoaW5nOiBIeXBlci1WIEtWUCBTZXJ2aWNlDQoNCmRhMCBhdCBibGt2c2Mw IGJ1cyAwIHNjYnVzMSB0YXJnZXQgMCBsdW4gMA0KaHlwZXJ2LXV0aWxzMiBvbiB2bWJ1czANCmh5 cGVydi11dGlsczI6IEh5cGVyLVYgU2VydmljZSBhdHRhY2hpbmc6IEh5cGVyLVYgU2h1dGRvd24g U2VydmljZQ0KDQpkYTA6IDxNc2Z0IFZpcnR1YWwgRGlzayAxLjA+IEZpeGVkIERpcmVjdCBBY2Nl c3MgU1BDLTIgU0NTSSBkZXZpY2UNCmh5cGVydi11dGlsczMgb24gdm1idXMwDQpoeXBlcnYtdXRp bHMzOiBIeXBlci1WIFNlcnZpY2UgYXR0YWNoaW5nOiBIeXBlci1WIFRpbWUgU3luY2ggU2Vydmlj ZQ0KDQpkYTA6IDMwMC4wMDBNQi9zIHRyYW5zZmVycw0KaG4wOiA8U3ludGhldGljIE5ldHdvcmsg SW50ZXJmYWNlPiBvbiB2bWJ1czANCmRhMDogQ29tbWFuZCBRdWV1ZWluZyBlbmFibGVkDQpkYTA6 IDIxNTA1TUIgKDQ0MDQyMjQwIDUxMiBieXRlIHNlY3RvcnM6IDI1NUggNjNTL1QgMjc0MUMpDQpk YTEgYXQgYmxrdnNjMSBidXMgMCBzY2J1czIgdGFyZ2V0IDEgbHVuIDANCmRhMTogPE1zZnQgVmly dHVhbCBEaXNrIDEuMD4gRml4ZWQgRGlyZWN0IEFjY2VzcyBTUEMtMiBTQ1NJIGRldmljZQ0KZGEx OiAzMDAuMDAwTUIvcyB0cmFuc2ZlcnNobjA6IHVua25vd24gc3RhdHVzIDEwNzM4NzI5MDIgcmVj ZWl2ZWQNCg0KaG4wOiB1bmtub3duIHN0YXR1cyAxMDczODcyOTAyIHJlY2VpdmVkDQpobjA6IGh2 IHNlbmQgb2ZmbG9hZCByZXF1ZXN0IHN1Y2NlZWRlZA0KZGExOiBDb21tYW5kIFF1ZXVlaW5nIGVu YWJsZWQNCmhuMDogVXNpbmcgZGVmYXVsdHMgZm9yIFRTTzogNjU1MTgvMzUvMjA0OA0KaG4wOiBF dGhlcm5ldCBhZGRyZXNzOiAwMDowZDozYTozMTowZDpmYw0Kc3RvcnZzYzIgb24gdm1idXMwDQpk YTE6IDcxNjhNQiAoMTQ2ODAwNjQgNTEyIGJ5dGUgc2VjdG9yczogMjU1SCA2M1MvVCA5MTNDKQ0K c3RvcnZzYzMgb24gdm1idXMwDQpUcnlpbmcgdG8gbW91bnQgcm9vdCBmcm9tIHVmczovZGV2L2dw dC9yb290ZnMgW3J3XS4uLg0KV0FSTklORzogLyB3YXMgbm90IHByb3Blcmx5IGRpc21vdW50ZWQN ClNldHRpbmcgaG9zdHV1aWQ6IDI1M2QzMGM1LWQyMjEtODU0OC1iODg3LWY4N2JhYTIzMWIyZC4N ClNldHRpbmcgaG9zdGlkOiAweGQ5OTU3MjRjLg0KRW50cm9weSBoYXJ2ZXN0aW5nOiBpbnRlcnJ1 cHRzIGV0aGVybmV0IHBvaW50X3RvX3BvaW50IHN3aS4NClN0YXJ0aW5nIGZpbGUgc3lzdGVtIGNo ZWNrczoNCioqIFNVK0ogUmVjb3ZlcmluZyAvZGV2L2dwdC9yb290ZnMNCioqIFJlYWRpbmcgMzM1 NTQ0MzIgYnl0ZSBqb3VybmFsIGZyb20gaW5vZGUgOC4NCioqIEJpaWxkaW5nIHJlY292ZXJ5IHRh YmxlLg0KKiogUmVzb2x2aW5nIHVucmVmZXJlbmNlZCBpbm9kZSBsaXN0Lg0KKiogUHJvY2Vzc2lu ZyBqb3VybmFsIGVudHJpZXMuDQoqKiAxIGpvdXJuYWwgcmVjb3JkcyBpbiA1MTIgYnl0ZXMgZm9y IDYuMjUlIHV0aWxpemF0aW9uDQoqKiBGcmVlZCAxIGlub2RlcyAoMCBkaXJzKSAwIGJsb2Nrcywg YW5kIDAgZnJhZ3MuDQoNCioqKioqIEZJTEUgU1lTVEVNIE1BUktFRCBDTEVBTiAqKioqKg0KTW91 bnRpbmcgbG9jYWwgZmlsZSBzeXN0ZW1zOi4NCldyaXRpbmcgZW50cm9weSBmaWxlOi4NClNldHRp bmcgaG9zdG5hbWU6IFstLXJlZGFjdGVkLS1dDQpobjA6IGxpbmsgc3RhdGUgY2hhbmdlZCB0byBV UA0KU3RhcnRpbmcgZGhjbGllbnQuDQpESENQRElTQ09WRVIgb24gaG4wIHRvIDI1NS4yNTUuMjU1 LjI1NSBwb3J0IDY3IGludGVydmFsIDcNCkRIQ1BPRkZFUiBmcm9tIDE2OC42My4xMjkuMTYNCnVu a25vd24gZGhjcCBvcHRpb24gdmFsdWUgMHhmNQ0KREhDUFJFUVVFU1Qgb24gaG4wIHRvIDI1NS4y NTUuMjU1LjI1NSBwb3J0IDY3DQpESENQQUNLIGZyb20gMTY4LjYzLjEyOS4xNg0KdW5rbm93biBk aGNwIG9wdGlvbiB2YWx1ZSAweGY1DQpib3VuZCB0byAxMC4wLjIuNSAtLSByZW5ld2FsIGluIC0x IHNlY29uZHMuDQpTdGFydGluZyBOZXR3b3JrOiBsbzAgaG4wLg0KbG8wOiBmbGFncz04MDQ5PFVQ LExPT1BCQUNLLFJVTk5JTkcsTVVMVElDQVNUPiBtZXRyaWMgMCBtdHUgMTYzODQNCiAgICAgICAg b3B0aW9ucz02MDAwMDM8UlhDU1VNLFRYQ1NVTSxSWENTVU1fSVBWNixUWENTVU1fSVBWNj4NCiAg ICAgICAgaW5ldDYgOjoxIHByZWZpeGxlbiAxMjggDQogICAgICAgIGluZXQ2IGZlODA6OjElbG8w IHByZWZpeGxlbiA2NCBzY29wZWlkIDB4MSANCiAgICAgICAgaW5ldCAxMjcuMC4wLjEgbmV0bWFz ayAweGZmMDAwMDAwIA0KICAgICAgICBuZDYgb3B0aW9ucz0yMTxQRVJGT1JNTlVELEFVVE9fTElO S0xPQ0FMPg0KaG4wOiBmbGFncz04ODQzPFVQLEJST0FEQ0FTVCxSVU5OSU5HLFNJTVBMRVgsTVVM VElDQVNUPiBtZXRyaWMgMCBtdHUgMTUwMA0KICAgICAgICBvcHRpb25zPTMxYjxSWENTVU0sVFhD U1VNLFZMQU5fTVRVLFZMQU5fSFdUQUdHSU5HLFRTTzQsVFNPNj4NCiAgICAgICAgZXRoZXIgMDA6 MGQ6M2E6MzE6MGQ6ZmMNCiAgICAgICAgaW5ldCAxMC4wLjIuNSBuZXRtYXNrIDB4ZmZmZmZmMDAg YnJvYWRjYXN0IDEwLjAuMi4yNTUgDQogICAgICAgIG5kNiBvcHRpb25zPTI5PFBFUkZPUk1OVUQs SUZESVNBQkxFRCxBVVRPX0xJTktMT0NBTD4NClN0YXJ0aW5nIGRldmQuDQphZGQgbmV0IGZlODA6 OjogZ2F0ZXdheSA6OjENCmFkZCBuZXQgZmYwMjo6OiBnYXRld2F5IDo6MQ0KYWRkIG5ldCA6OmZm ZmY6MC4wLjAuMDogZ2F0ZXdheSA6OjENCmFkZCBuZXQgOjowLjAuMC4wOiBnYXRld2F5IDo6MQ0K RUxGIGxkY29uZmlnIHBhdGg6IC9saWIgL3Vzci9saWIgL3Vzci9saWIvY29tcGF0IC91c3IvbG9j YWwvbGliDQozMi1iaXQgY29tcGF0aWJpbGl0eSBsZGNvbmZpZyBwYXRoOiAvdXNyL2xpYjMyDQpD cmVhdGluZyBhbmQvb3IgdHJpbW1pbmcgbG9nIGZpbGVzLg0KU3RhcnRpbmcgc3lzbG9nZC4NCk5v IGNvcmUgZHVtcHMgZm91bmQuDQpDbGVhcmluZyAvdG1wIChYIHJlbGF0ZWQpLg0KVXBkYXRpbmcg bW90ZDouDQpNb3VudGluZyBsYXRlIGZpbGUgc3lzdGVtczouDQpQZXJmb3JtaW5nIHNhbml0eSBj aGVjayBvbiBzc2hkIGNvbmZpZ3VyYXRpb24uDQoNClNjb3R0DQoNCi0tLS0tT3JpZ2luYWwgTWVz c2FnZS0tLS0tDQpGcm9tOiBBZHJpYW4gQ2hhZGQgW21haWx0bzphZHJpYW4uY2hhZGRAZ21haWwu Y29tXSANClNlbnQ6IFN1bmRheSwgRmVicnVhcnkgNywgMjAxNiAxMjowOCBBTQ0KVG86IFNjb3R0 IE90aXMgPHNjb3R0Lm90aXNAdGFuZGVtY2FsLmNvbT4NCkNjOiBmcmVlYnNkLXN0YWJsZUBmcmVl YnNkLm9yZw0KU3ViamVjdDogUmU6IDEwLjIgUmVsZWFzZSBzZWVtcyB0byBiZSBjcmFzaGluZyBv biBBenVyZSB3aXRoICJTdGFuZGFyZCBEUyIgVk0gc2l6ZXMNCg0KSG0sIHRoZSBydW50aW1lIGdv aW5nIGJhY2t3YXJkcyBpcyBhIGJpdCBvZGQsIG1heWJlIHRoZXkgZml4ZWQgdGhhdCBpbiAtSEVB RCByZWNlbnRseS4gT3RoZXIgdGhhbiB0aGF0LCB5ZWFoLCB5b3UnbGwgbmVlZCBhIGNyYXNoIGR1 bXAgb3IgYXQgbGVhc3Qgc29tZSBzY3JlZW5zaG90IHdoZW4gaXQgZG9lcyByZWJvb3QuDQoNCg0K LWENCg== From owner-freebsd-stable@freebsd.org Mon Feb 8 19:25:04 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E575EAA2F2A for ; Mon, 8 Feb 2016 19:25:04 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4AF21D14 for ; Mon, 8 Feb 2016 19:25:04 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id u18JP2hl009478 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Mon, 8 Feb 2016 14:25:02 -0500 (EST) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:5c30:ed1b:e203:c55c] ([IPv6:2607:f3e0:0:4:5c30:ed1b:e203:c55c]) by lava.sentex.ca (8.14.9/8.14.9) with ESMTP id u18JP1xs073247; Mon, 8 Feb 2016 14:25:01 -0500 (EST) (envelope-from mike@sentex.net) Subject: Re: possible em regression (was Re: svn commit: r294958 - in stable/10: share/man/man4 sys/dev/e1000 sys/dev/ixgb sys/dev/netmap) To: Marius Strobl References: <201601272231.u0RMV8LW019394@repo.freebsd.org> <56ABAA92.5050901@sentex.net> <56ABB291.5040305@omnilan.de> <56ABCE95.3030807@sentex.net> <20160130012358.GY15359@alchemy.franken.de> <56ACE917.80502@sentex.net> <20160130172618.GA15359@alchemy.franken.de> <56B0C217.1070706@sentex.net> <20160207004131.GM15359@alchemy.franken.de> <152b9314d10.2765.e68d32c7521a042b3773fe36a0156dc7@sentex.net> <20160208091032.GR15359@alchemy.franken.de> Cc: FreeBSD-STABLE Mailing List From: Mike Tancsa Organization: Sentex Communications Message-ID: <56B8EB7A.2000508@sentex.net> Date: Mon, 8 Feb 2016 14:24:42 -0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 In-Reply-To: <20160208091032.GR15359@alchemy.franken.de> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Feb 2016 19:25:05 -0000 On 2/8/2016 4:10 AM, Marius Strobl wrote: > On Sat, Feb 06, 2016 at 07:46:02PM -0500, mike tancsa wrote: >> Sure, I will try Monday when at the office > > Actually, thinking about it, could you please try the following > patch on top of the previous one/r295287? > https://people.freebsd.org/~marius/e1000_max_scatter_tso_10.diff Didnt take too long ( ~5hrs post reboot). It does at least recover on its own which is good. em0: Watchdog timeout Queue[0]-- resetting Interface is RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw tdh = 576, hw tdt = 866 em0: Tx Queue Status = -2147483648 em0: TX descriptors avail = 733 em0: Tx Descriptors avail failure = 0 em0: RX Queue 0 ------ em0: hw rdh = 573, hw rdt = 572 em0: RX discarded packets = 0 em0: RX Next to Check = 574 em0: RX Next to Refresh = 578 em0: link state changed to DOWN em0: link state changed to UP % sysctl -a dev.em.0 dev.em.0.interrupts.rx_overrun: 0 dev.em.0.interrupts.rx_desc_min_thresh: 0 dev.em.0.interrupts.tx_queue_min_thresh: 2 dev.em.0.interrupts.tx_queue_empty: 0 dev.em.0.interrupts.tx_abs_timer: 23 dev.em.0.interrupts.tx_pkt_timer: 14 dev.em.0.interrupts.rx_abs_timer: 0 dev.em.0.interrupts.rx_pkt_timer: 9 dev.em.0.interrupts.asserts: 1266419 dev.em.0.mac_stats.tso_ctx_fail: 0 dev.em.0.mac_stats.tso_txd: 378579 dev.em.0.mac_stats.tx_frames_1024_1522: 1556661 dev.em.0.mac_stats.tx_frames_512_1023: 39043 dev.em.0.mac_stats.tx_frames_256_511: 78275 dev.em.0.mac_stats.tx_frames_128_255: 67735 dev.em.0.mac_stats.tx_frames_65_127: 112191 dev.em.0.mac_stats.tx_frames_64: 41640 dev.em.0.mac_stats.mcast_pkts_txd: 10 dev.em.0.mac_stats.bcast_pkts_txd: 14 dev.em.0.mac_stats.good_pkts_txd: 1895545 dev.em.0.mac_stats.total_pkts_txd: 1895545 dev.em.0.mac_stats.good_octets_txd: 2392873221 dev.em.0.mac_stats.good_octets_recvd: 157831335 dev.em.0.mac_stats.rx_frames_1024_1522: 41856 dev.em.0.mac_stats.rx_frames_512_1023: 15434 dev.em.0.mac_stats.rx_frames_256_511: 32906 dev.em.0.mac_stats.rx_frames_128_255: 21500 dev.em.0.mac_stats.rx_frames_65_127: 413405 dev.em.0.mac_stats.rx_frames_64: 594421 dev.em.0.mac_stats.mcast_pkts_recvd: 0 dev.em.0.mac_stats.bcast_pkts_recvd: 6284 dev.em.0.mac_stats.good_pkts_recvd: 1119522 dev.em.0.mac_stats.total_pkts_recvd: 1119522 dev.em.0.mac_stats.xoff_txd: 0 dev.em.0.mac_stats.xoff_recvd: 0 dev.em.0.mac_stats.xon_txd: 0 dev.em.0.mac_stats.xon_recvd: 0 dev.em.0.mac_stats.coll_ext_errs: 0 dev.em.0.mac_stats.alignment_errs: 0 dev.em.0.mac_stats.crc_errs: 0 dev.em.0.mac_stats.recv_errs: 0 dev.em.0.mac_stats.recv_jabber: 0 dev.em.0.mac_stats.recv_oversize: 0 dev.em.0.mac_stats.recv_fragmented: 0 dev.em.0.mac_stats.recv_undersize: 0 dev.em.0.mac_stats.recv_no_buff: 0 dev.em.0.mac_stats.missed_packets: 0 dev.em.0.mac_stats.defer_count: 0 dev.em.0.mac_stats.sequence_errors: 0 dev.em.0.mac_stats.symbol_errors: 0 dev.em.0.mac_stats.collision_count: 0 dev.em.0.mac_stats.late_coll: 0 dev.em.0.mac_stats.multiple_coll: 0 dev.em.0.mac_stats.single_coll: 0 dev.em.0.mac_stats.excess_coll: 0 dev.em.0.queue_rx_0.rx_irq: 0 dev.em.0.queue_rx_0.rxd_tail: 749 dev.em.0.queue_rx_0.rxd_head: 750 dev.em.0.queue_tx_0.no_desc_avail: 0 dev.em.0.queue_tx_0.tx_irq: 0 dev.em.0.queue_tx_0.txd_tail: 1001 dev.em.0.queue_tx_0.txd_head: 1002 dev.em.0.fc_low_water: 8740 dev.em.0.fc_high_water: 10240 dev.em.0.rx_control: 67141634 dev.em.0.device_control: 1075053128 dev.em.0.watchdog_timeouts: 1 dev.em.0.rx_overruns: 0 dev.em.0.tx_dma_fail: 0 dev.em.0.mbuf_defrag_fail: 0 dev.em.0.link_irq: 0 dev.em.0.dropped: 0 dev.em.0.eee_control: 1 dev.em.0.rx_processing_limit: 100 dev.em.0.itr: 488 dev.em.0.tx_abs_int_delay: 66 dev.em.0.rx_abs_int_delay: 66 dev.em.0.tx_int_delay: 66 dev.em.0.rx_int_delay: 0 dev.em.0.fc: 3 dev.em.0.debug: -1 dev.em.0.nvm: -1 dev.em.0.%parent: pci13 dev.em.0.%pnpinfo: vendor=0x8086 device=0x108c subvendor=0x15d9 subdevice=0x108c class=0x020000 dev.em.0.%location: pci0:13:0:0 dev.em.0.%driver: em dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.4.2 -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@freebsd.org Mon Feb 8 20:06:42 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA46DAA14A1 for ; Mon, 8 Feb 2016 20:06:42 +0000 (UTC) (envelope-from marius@alchemy.franken.de) Received: from alchemy.franken.de (alchemy.franken.de [194.94.249.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "alchemy.franken.de", Issuer "alchemy.franken.de" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 64C1B1B3D for ; Mon, 8 Feb 2016 20:06:41 +0000 (UTC) (envelope-from marius@alchemy.franken.de) Received: from alchemy.franken.de (localhost [127.0.0.1]) by alchemy.franken.de (8.15.2/8.15.2/ALCHEMY.FRANKEN.DE) with ESMTPS id u18K6cPv000283 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 8 Feb 2016 21:06:38 +0100 (CET) (envelope-from marius@alchemy.franken.de) Received: (from marius@localhost) by alchemy.franken.de (8.15.2/8.15.2/Submit) id u18K6c66000282; Mon, 8 Feb 2016 21:06:38 +0100 (CET) (envelope-from marius) Date: Mon, 8 Feb 2016 21:06:38 +0100 From: Marius Strobl To: Mike Tancsa Cc: FreeBSD-STABLE Mailing List Subject: Re: possible em regression (was Re: svn commit: r294958 - in stable/10: share/man/man4 sys/dev/e1000 sys/dev/ixgb sys/dev/netmap) Message-ID: <20160208200638.GX15359@alchemy.franken.de> References: <56ABB291.5040305@omnilan.de> <56ABCE95.3030807@sentex.net> <20160130012358.GY15359@alchemy.franken.de> <56ACE917.80502@sentex.net> <20160130172618.GA15359@alchemy.franken.de> <56B0C217.1070706@sentex.net> <20160207004131.GM15359@alchemy.franken.de> <152b9314d10.2765.e68d32c7521a042b3773fe36a0156dc7@sentex.net> <20160208091032.GR15359@alchemy.franken.de> <56B8EB7A.2000508@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <56B8EB7A.2000508@sentex.net> User-Agent: Mutt/1.5.24 (2015-08-30) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (alchemy.franken.de [0.0.0.0]); Mon, 08 Feb 2016 21:06:39 +0100 (CET) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Feb 2016 20:06:42 -0000 On Mon, Feb 08, 2016 at 02:24:42PM -0500, Mike Tancsa wrote: > On 2/8/2016 4:10 AM, Marius Strobl wrote: > > On Sat, Feb 06, 2016 at 07:46:02PM -0500, mike tancsa wrote: > >> Sure, I will try Monday when at the office > > > > Actually, thinking about it, could you please try the following > > patch on top of the previous one/r295287? > > https://people.freebsd.org/~marius/e1000_max_scatter_tso_10.diff > > > Didnt take too long ( ~5hrs post reboot). It does at least recover on > its own which is good. Nevertheless, thank you very much for testing. Marius From owner-freebsd-stable@freebsd.org Mon Feb 8 20:21:43 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CAF08AA1C7B for ; Mon, 8 Feb 2016 20:21:43 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id BF3DD98B; Mon, 8 Feb 2016 20:21:43 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id 623EB61A; Mon, 8 Feb 2016 20:21:43 +0000 (UTC) Date: Mon, 8 Feb 2016 20:21:41 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org Message-ID: <457117590.118.1454962901889.JavaMail.jenkins@jenkins-9.freebsd.org> In-Reply-To: <1597950544.117.1454934857372.JavaMail.jenkins@jenkins-9.freebsd.org> References: <1597950544.117.1454934857372.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: Jenkins build is back to normal : FreeBSD_stable_10 #74 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Instance-Identity: MIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAkKKb2VAfYQKfu1t7qk4nR5qzUBEI+UqT4BPec4qHVhqUy0FFdq50sMH+3y9bCDNOufctov6VqTNffZ3YXArnZK95YF0OX97fh+E9txYOUX1adc+TikcKjuYpHmL5dE62eaZTI+4A5jnRonskQ1PaoIFz0Kbu4mWzkFsmdiXTraGzomXq4cHUCATA2+K4eDYgjXEQI30z3GOMmmZ4t/+6QGk1cMb/BqMWHbn80AsRCb4tU7Hpd72XLDpsuO7YRP1Q0CjmNAuBOTj+sFiiOe6U9HpqOlQN+iFUvBdZo/ybuy5Kh71cAaYQNL68cYdZJ6binH/DkG3KY/fS7DFYAeuwjwIDAQAB X-Jenkins-Job: FreeBSD_stable_10 X-Jenkins-Result: SUCCESS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Feb 2016 20:21:43 -0000 See From owner-freebsd-stable@freebsd.org Mon Feb 8 22:36:55 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 010D1AA1F2B for ; Mon, 8 Feb 2016 22:36:55 +0000 (UTC) (envelope-from rahaf_bilell@icloud.com) Received: from pv33p38im-asmtp004.me.com (pv33p38im-asmtp004.me.com [17.143.238.70]) (using TLSv1.2 with cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DDABB799 for ; Mon, 8 Feb 2016 22:36:54 +0000 (UTC) (envelope-from rahaf_bilell@icloud.com) Received: from [192.168.8.100] (unknown [197.115.147.178]) by pv33p38im-asmtp004.me.com (Oracle Communications Messaging Server 7.0.5.36.0 64bit (built Sep 8 2015)) with ESMTPSA id <0O2900HPA018XX10@pv33p38im-asmtp004.me.com> for freebsd-stable@freebsd.org; Mon, 08 Feb 2016 21:36:48 +0000 (GMT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:,, definitions=2016-02-08_13:,, signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 clxscore=1011 suspectscore=1 malwarescore=0 phishscore=0 adultscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1510270003 definitions=main-1602080365 From: =?utf-8?B?2KjZhNin2YQg2LTYp9mK2Kg=?= MIME-version: 1.0 (1.0) Date: Mon, 08 Feb 2016 22:36:43 +0100 Subject: Re: FreeBSD 9.3-BETA3 Now Available Message-id: To: freebsd-stable@freebsd.org X-Mailer: iPhone Mail (13E5191d) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Feb 2016 22:36:55 -0000 DQoNCuKAj+KAq9mF2YYg2KzZh9in2LIg2KfZhNmAINin2YTYrtin2LUg2KjZiuKArA== From owner-freebsd-stable@freebsd.org Tue Feb 9 11:28:39 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 55BB6AA24E8 for ; Tue, 9 Feb 2016 11:28:39 +0000 (UTC) (envelope-from export@vascofilters.eu) Received: from karieraserlg.nazwa.pl (aju23.rev.netart.pl [77.55.254.23]) by mx1.freebsd.org (Postfix) with ESMTP id 5B061D5A for ; Tue, 9 Feb 2016 11:28:38 +0000 (UTC) (envelope-from export@vascofilters.eu) Received: from pc (unknown [194.33.77.155]) by karieraserlg.nazwa.pl (Postfix) with ESMTPA id 77B493CE18B7 for ; Tue, 9 Feb 2016 12:28:37 +0100 (CET) From: "=?iso-8859-2?Q?Marcin_Tomzi=F1ski?=" To: "freebsd-stable" Subject: cooperation Message-ID: <5532AF2615726725A9C4CB37DDF3EE0D@pc> Date: Tue, 9 Feb 2016 12:28:45 +0100 Organization: AnoMail - oprogramowanie do emailingow X-Priority: 3 MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-2; format=flowed Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2016 11:28:39 -0000 =20 Are you looking for a new automotive parts brand to be different from your = competitors?=20 Do you want to be a direct importer?=20 Are you looking for high quality products at fair and individual quotation?= =20 Fed up with late deliveries and low availability from the stock?=20 Do you want to join young and effective organisation?=20 Do you need fast orders handling and flexibility in market approach? We have a great proposal for your business! =20 Our products range consists of more than 1500 references under 4 brands - VASCO FILTERS (oil, fuel air and cabin filters) - FLUXAR FILTERS (red line) - PEXA WIPERS (universal and dedicated sets of wipers) - BREYKO (brake pads)=20 We are expanding our business in your country and looking for direct import= ers.=20 Join our Team! More info on web page: www.vascofilters.com or facebook = =20 If you have any questions do not hesitate to contact us, we speak English, = French and Spanish. Marketing and Operations Manager Olaf Tomzi=F1ski If you do not wish to receive further information. From owner-freebsd-stable@freebsd.org Tue Feb 9 12:31:53 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0C633AA110A for ; Tue, 9 Feb 2016 12:31:53 +0000 (UTC) (envelope-from rizzo.unipi@gmail.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id DD9148A9 for ; Tue, 9 Feb 2016 12:31:52 +0000 (UTC) (envelope-from rizzo.unipi@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id DC3BFAA1108; Tue, 9 Feb 2016 12:31:52 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DBC34AA1107 for ; Tue, 9 Feb 2016 12:31:52 +0000 (UTC) (envelope-from rizzo.unipi@gmail.com) Received: from mail-lb0-x232.google.com (mail-lb0-x232.google.com [IPv6:2a00:1450:4010:c04::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 603928A5 for ; Tue, 9 Feb 2016 12:31:52 +0000 (UTC) (envelope-from rizzo.unipi@gmail.com) Received: by mail-lb0-x232.google.com with SMTP id cw1so99468951lbb.1 for ; Tue, 09 Feb 2016 04:31:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=N0ictRSCaFnaUno2uPUl7zThgw2ETA9uRRnJhnCscRU=; b=VobRC59nbGOtIzqJdLy0zq2laXkR0RpE3JcCLNMqHD6Lgo9TGQQufQuCxCb4CUejgC T31Ixog54yrpzYrSvcS1+HejeI9JF5wteg3cVx+/t4fY+H/HdP2CEYKTgcJA8F7hGyb3 mdn7u+bbyGjI+eAuTgXeMkS5SCKpCxTrW2wMoA2fOPnb9jNi9+6n267s9m4ZCvm6mKIK Xvg0PJXKYoY/UOfVrROyFRFPq3aubk/R8kWjludPsP9g6Gg0Wc2d40KEJY7r/VpoebZQ eAlcgec9exfVy/vDXfI8OizjkHB9UIRwI/SdovzIIW2yc3mNHY0fU+ZCVmIRZeiN9r/Q DbRw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:date :message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=N0ictRSCaFnaUno2uPUl7zThgw2ETA9uRRnJhnCscRU=; b=FD90rEnv/aX9Jic4axjDrcgBq0MkUtqDI7j2hqxvNnWQHxwByHBCpGfbn8qTOugsYz tWtExsuOvgQylg9SG7hqU7b96HAA7DCVpGfjV4X3LD20zYTjQ86UF5UfugGzV96qtFC/ vjVsEcD+fJhwO5Ct45l5j8n3LslbKP4gkt5Erkg7QKccpVGtdvqTB4t9XM4AqZMwM4Pj wY9gd3PpNCBNX84Je9XAbaFTCsSqzgIH96FyGQn/aiyClqB1F81UUC9ttCvUZK50cvN6 tWS9Ppf+nJzrkbKidY1eFFVgO9ijALj4CjrRpQL8iVgfS/kkSWqGJ8KJ+FSDKzALclgc HE5g== X-Gm-Message-State: AG10YORIEd8ULKySN7vvwh8+z6Bhx+mj8P6KWLgrfW8gxlpj0C7dn0dqNhvc7U1ue+1aQXNppIXt3mPOkmGwGQ== MIME-Version: 1.0 X-Received: by 10.112.13.165 with SMTP id i5mr11493436lbc.79.1455021110382; Tue, 09 Feb 2016 04:31:50 -0800 (PST) Sender: rizzo.unipi@gmail.com Received: by 10.114.4.232 with HTTP; Tue, 9 Feb 2016 04:31:50 -0800 (PST) In-Reply-To: <20160208173935.GK68298@zxy.spb.ru> References: <20151018210049.GT6469@zxy.spb.ru> <20151022163519.GF6469@zxy.spb.ru> <20160202204446.GQ88527@zxy.spb.ru> <20160204130029.GC88527@zxy.spb.ru> <20160208173935.GK68298@zxy.spb.ru> Date: Tue, 9 Feb 2016 04:31:50 -0800 X-Google-Sender-Auth: YqAGFGTLBf5tq0AdoHmXYqeDC6E Message-ID: Subject: Re: 82576 + NETMAP + VLAN From: Luigi Rizzo To: Slawa Olhovchenkov Cc: Adrian Chadd , "stable@freebsd.org" , Giuseppe Lettieri Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2016 12:31:53 -0000 I am Cc-ing Giuseppe Lettieri who has looked at the problem and may have some comments to share cheers luigi On Mon, Feb 8, 2016 at 9:39 AM, Slawa Olhovchenkov wrote: > On Thu, Feb 04, 2016 at 10:47:34AM -0800, Adrian Chadd wrote: > >> .. but if it does, can you enable witness and see what it reports as >> lock order violations? > > last STABLE: > > 1. first LOR (with poll, don't cause direct problems now): > > lock order reversal: > 1st 0xfffff800946e6700 vm object (vm object) @ /usr/src/sys/vm/vm_fault.= c:363 > 2nd 0xffffffff813e14d8 netmap memory allocator lock (netmap memory alloc= ator lock) @ /usr/src/sys/dev/netmap/netmap_mem2.c:393 > KDB: stack backtrace: > #0 0xffffffff80970320 at kdb_backtrace+0x60 > #1 0xffffffff809882ce at witness_checkorder+0xc7e > #2 0xffffffff8091fcbc at __mtx_lock_flags+0x4c > #3 0xffffffff806784f6 at netmap_mem_ofstophys+0x36 > #4 0xffffffff80676834 at netmap_dev_pager_fault+0x34 > #5 0xffffffff80b81a0f at dev_pager_getpages+0x3f > #6 0xffffffff80b8cc1e at vm_fault_hold+0x86e > #7 0xffffffff80b8c367 at vm_fault+0x77 > #8 0xffffffff80d0e2c9 at trap_pfault+0x199 > #9 0xffffffff80d0db47 at trap+0x527 > #10 0xffffffff80cf4ce2 at calltrap+0x8 > > 2. kqueue issuse (not LOR!) > > acquiring duplicate lock of same type: "nm_kn_lock" > 1st nm_kn_lock @ /usr/src/sys/kern/kern_event.c:2003 > 2nd nm_kn_lock @ /usr/src/sys/kern/kern_event.c:2003 > KDB: stack backtrace: > #0 0xffffffff80970320 at kdb_backtrace+0x60 > #1 0xffffffff809882ce at witness_checkorder+0xc7e > #2 0xffffffff8091fcbc at __mtx_lock_flags+0x4c > #3 0xffffffff808fd899 at knote+0x39 > #4 0xffffffff8067636b at freebsd_selwakeup+0x8b > #5 0xffffffff80674eb5 at netmap_notify+0x55 > #6 0xffffffff8067ccb6 at netmap_pipe_txsync+0x156 > #7 0xffffffff80674740 at netmap_poll+0x400 > #8 0xffffffff80676b8e at netmap_knrw+0x6e > #9 0xffffffff808fc57a at kqueue_register+0x64a > #10 0xffffffff808fcdd4 at kern_kevent_fp+0x144 > #11 0xffffffff808fcc4f at kern_kevent+0x9f > #12 0xffffffff808fcaea at sys_kevent+0x12a > #13 0xffffffff80d0e914 at amd64_syscall+0x2d4 > #14 0xffffffff80cf4fcb at Xfast_syscall+0xfb > > Do you need anything? > >> On 4 February 2016 at 10:47, Adrian Chadd wrote= : >> > I've no time to help with this, I'm sorry :( >> > >> > >> > -a >> > >> > >> > On 4 February 2016 at 05:00, Slawa Olhovchenkov wrote= : >> >> On Tue, Feb 02, 2016 at 11:44:47PM +0300, Slawa Olhovchenkov wrote: >> >> >> >>> On Thu, Oct 22, 2015 at 11:24:53AM -0700, Luigi Rizzo wrote: >> >>> >> >>> > On Thu, Oct 22, 2015 at 11:12 AM, Adrian Chadd wrote: >> >>> > > On 22 October 2015 at 09:35, Slawa Olhovchenkov = wrote: >> >>> > >> On Sun, Oct 18, 2015 at 07:45:52PM -0700, Adrian Chadd wrote: >> >>> > >> >> >>> > >>> Heh, file a bug with luigi; it should be defined better inside= netmap itself. >> >>> > >> >> >>> > >> I am CC: luigi. >> >>> > >> >> >>> > >> Next question: do kevent RX/TX sync? >> >>> > >> In my setup I am need to manual NIOCTXSYNC/NIOCRXSYNC. >> >>> > > >> >>> > > Hi, >> >>> > > >> >>> > > Nope. kqueue() doesn't do the implicit sync like poll() does; it= 's >> >>> > > just the notification path. >> >>> > >> >>> > actually not. When the file descriptor is registered there >> >>> > is an implicit sync, and there is another one when an event >> >>> > is posted for the file descriptor. >> >>> > >> >>> > unless there are bugs, of course. >> >>> >> >>> I found strange behaivor: >> >>> >> >>> 1. open netmap and register in main thread >> >>> 2. kevent register in different thread >> >>> 3. result: got event by kevent but no ring sinc (all head,tail,cur >> >>> still 0). >> >>> >> >>> Is this normal? Or is this bug? >> >>> >> >>> open and registering netmap in same thread as kevent resolve this. >> >> >> >> Also, kevent+netmap deadlocked for me: >> >> >> >> PID TID COMM TDNAME KSTACK >> >> 1095 100207 addos - mi_switch+0xe1 sleepq_= catch_signals+0xab sleepq_timedwait_sig+0x10 _sleep+0x238 kern_nanosleep+0x= 10e sys_nanosleep+0x51 amd64_syscall+0x40f Xfast_syscall+0xfb >> >> 1095 100208 addos worker#0 mi_switch+0xe1 sleepq_= catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_k= event+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb >> >> 1095 100209 addos worker#1 mi_switch+0xe1 turnsti= le_wait+0x42a __mtx_lock_sleep+0x26b knote+0x38 freebsd_selwakeup+0x8b netm= ap_notify+0x55 netmap_pipe_txsync+0x156 netmap_poll+0x400 netmap_knrw+0x6e = kqueue_register+0x799 kern_kevent+0x158 sys_kevent+0x12a amd64_syscall+0x40= f Xfast_syscall+0xfb >> >> 1095 100210 addos worker#2 mi_switch+0xe1 sleepq_= catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_k= event+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb >> >> 1095 100211 addos worker#NOIP mi_switch+0xe1 sleepq_= catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_k= event+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb >> >> 1095 100212 addos balancer mi_switch+0xe1 turnsti= le_wait+0x42a __mtx_lock_sleep+0x26b knote+0x38 freebsd_selwakeup+0x8b netm= ap_notify+0x2a netmap_pipe_rxsync+0x54 netmap_poll+0x774 netmap_knrw+0x6e k= ern_kevent+0x5cc sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb --=20 -----------------------------------------+------------------------------- Prof. Luigi RIZZO, rizzo@iet.unipi.it . Dip. di Ing. dell'Informazione http://www.iet.unipi.it/~luigi/ . Universita` di Pisa TEL +39-050-2217533 . via Diotisalvi 2 Mobile +39-338-6809875 . 56122 PISA (Italy) -----------------------------------------+------------------------------- From owner-freebsd-stable@freebsd.org Tue Feb 9 13:05:16 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D2D1DAA2209 for ; Tue, 9 Feb 2016 13:05:16 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id BC90E19A9 for ; Tue, 9 Feb 2016 13:05:16 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: by mailman.ysv.freebsd.org (Postfix) id B8EABAA2208; Tue, 9 Feb 2016 13:05:16 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B8732AA2207 for ; Tue, 9 Feb 2016 13:05:16 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from smtp.unipi.it (smtp1.unipi.it [131.114.21.19]) by mx1.freebsd.org (Postfix) with ESMTP id 68C6319A8 for ; Tue, 9 Feb 2016 13:05:14 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from localhost (localhost [127.0.0.1]) by smtp.unipi.it (Postfix) with ESMTP id E7D4B41E9D; Tue, 9 Feb 2016 13:57:26 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at unipi.it Received: from [10.216.1.203] (prova.iet.unipi.it [131.114.58.86]) (Authenticated User) by smtp.unipi.it (Postfix) with ESMTPSA id 0662F41E8E; Tue, 9 Feb 2016 13:57:26 +0100 (CET) Subject: Re: 82576 + NETMAP + VLAN To: Luigi Rizzo , Slawa Olhovchenkov References: <20151018210049.GT6469@zxy.spb.ru> <20151022163519.GF6469@zxy.spb.ru> <20160202204446.GQ88527@zxy.spb.ru> <20160204130029.GC88527@zxy.spb.ru> <20160208173935.GK68298@zxy.spb.ru> Cc: Adrian Chadd , "stable@freebsd.org" From: Giuseppe Lettieri Message-ID: <56B9E398.1060105@iet.unipi.it> Date: Tue, 9 Feb 2016 14:03:20 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2016 13:05:16 -0000 Hi all, I have only looked into the fist LOR, which has actually been there for a long time. It should be triggered by the following paths: 1) application does an ioctl(, NIOCREGIF) (or GETINFO) ->netmap_mem_finalize() [locks the netmap allocator] ->contigmalloc() [locks things related to vm] 2) application mmap()s the netmap fd and then accesses the area -> page fault [locks things related to vm] ->netmap_mem_ofstophys() [locks the netmap allocator] As a quick check, the LOR disappears if I replace the contigmalloc() with a dummy operation returning a static buffer. If this is correct, there cannot be any concurrency between the two paths, since the 1st one must be completed before the first mmap(). I also think that the vm objects locked in the two paths are not the same, but I don't know whether WITNESS keeps track of (some?) lock instances, or just lock types. Cheers, Giuseppe Il 09/02/2016 13:31, Luigi Rizzo ha scritto: > I am Cc-ing Giuseppe Lettieri who has looked at the problem and may > have some comments to share > > cheers > luigi > > On Mon, Feb 8, 2016 at 9:39 AM, Slawa Olhovchenkov wrote: >> On Thu, Feb 04, 2016 at 10:47:34AM -0800, Adrian Chadd wrote: >> >>> .. but if it does, can you enable witness and see what it reports as >>> lock order violations? >> >> last STABLE: >> >> 1. first LOR (with poll, don't cause direct problems now): >> >> lock order reversal: >> 1st 0xfffff800946e6700 vm object (vm object) @ /usr/src/sys/vm/vm_fault.c:363 >> 2nd 0xffffffff813e14d8 netmap memory allocator lock (netmap memory allocator lock) @ /usr/src/sys/dev/netmap/netmap_mem2.c:393 >> KDB: stack backtrace: >> #0 0xffffffff80970320 at kdb_backtrace+0x60 >> #1 0xffffffff809882ce at witness_checkorder+0xc7e >> #2 0xffffffff8091fcbc at __mtx_lock_flags+0x4c >> #3 0xffffffff806784f6 at netmap_mem_ofstophys+0x36 >> #4 0xffffffff80676834 at netmap_dev_pager_fault+0x34 >> #5 0xffffffff80b81a0f at dev_pager_getpages+0x3f >> #6 0xffffffff80b8cc1e at vm_fault_hold+0x86e >> #7 0xffffffff80b8c367 at vm_fault+0x77 >> #8 0xffffffff80d0e2c9 at trap_pfault+0x199 >> #9 0xffffffff80d0db47 at trap+0x527 >> #10 0xffffffff80cf4ce2 at calltrap+0x8 >> >> 2. kqueue issuse (not LOR!) >> >> acquiring duplicate lock of same type: "nm_kn_lock" >> 1st nm_kn_lock @ /usr/src/sys/kern/kern_event.c:2003 >> 2nd nm_kn_lock @ /usr/src/sys/kern/kern_event.c:2003 >> KDB: stack backtrace: >> #0 0xffffffff80970320 at kdb_backtrace+0x60 >> #1 0xffffffff809882ce at witness_checkorder+0xc7e >> #2 0xffffffff8091fcbc at __mtx_lock_flags+0x4c >> #3 0xffffffff808fd899 at knote+0x39 >> #4 0xffffffff8067636b at freebsd_selwakeup+0x8b >> #5 0xffffffff80674eb5 at netmap_notify+0x55 >> #6 0xffffffff8067ccb6 at netmap_pipe_txsync+0x156 >> #7 0xffffffff80674740 at netmap_poll+0x400 >> #8 0xffffffff80676b8e at netmap_knrw+0x6e >> #9 0xffffffff808fc57a at kqueue_register+0x64a >> #10 0xffffffff808fcdd4 at kern_kevent_fp+0x144 >> #11 0xffffffff808fcc4f at kern_kevent+0x9f >> #12 0xffffffff808fcaea at sys_kevent+0x12a >> #13 0xffffffff80d0e914 at amd64_syscall+0x2d4 >> #14 0xffffffff80cf4fcb at Xfast_syscall+0xfb >> >> Do you need anything? >> >>> On 4 February 2016 at 10:47, Adrian Chadd wrote: >>>> I've no time to help with this, I'm sorry :( >>>> >>>> >>>> -a >>>> >>>> >>>> On 4 February 2016 at 05:00, Slawa Olhovchenkov wrote: >>>>> On Tue, Feb 02, 2016 at 11:44:47PM +0300, Slawa Olhovchenkov wrote: >>>>> >>>>>> On Thu, Oct 22, 2015 at 11:24:53AM -0700, Luigi Rizzo wrote: >>>>>> >>>>>>> On Thu, Oct 22, 2015 at 11:12 AM, Adrian Chadd wrote: >>>>>>>> On 22 October 2015 at 09:35, Slawa Olhovchenkov wrote: >>>>>>>>> On Sun, Oct 18, 2015 at 07:45:52PM -0700, Adrian Chadd wrote: >>>>>>>>> >>>>>>>>>> Heh, file a bug with luigi; it should be defined better inside netmap itself. >>>>>>>>> >>>>>>>>> I am CC: luigi. >>>>>>>>> >>>>>>>>> Next question: do kevent RX/TX sync? >>>>>>>>> In my setup I am need to manual NIOCTXSYNC/NIOCRXSYNC. >>>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> Nope. kqueue() doesn't do the implicit sync like poll() does; it's >>>>>>>> just the notification path. >>>>>>> >>>>>>> actually not. When the file descriptor is registered there >>>>>>> is an implicit sync, and there is another one when an event >>>>>>> is posted for the file descriptor. >>>>>>> >>>>>>> unless there are bugs, of course. >>>>>> >>>>>> I found strange behaivor: >>>>>> >>>>>> 1. open netmap and register in main thread >>>>>> 2. kevent register in different thread >>>>>> 3. result: got event by kevent but no ring sinc (all head,tail,cur >>>>>> still 0). >>>>>> >>>>>> Is this normal? Or is this bug? >>>>>> >>>>>> open and registering netmap in same thread as kevent resolve this. >>>>> >>>>> Also, kevent+netmap deadlocked for me: >>>>> >>>>> PID TID COMM TDNAME KSTACK >>>>> 1095 100207 addos - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_timedwait_sig+0x10 _sleep+0x238 kern_nanosleep+0x10e sys_nanosleep+0x51 amd64_syscall+0x40f Xfast_syscall+0xfb >>>>> 1095 100208 addos worker#0 mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb >>>>> 1095 100209 addos worker#1 mi_switch+0xe1 turnstile_wait+0x42a __mtx_lock_sleep+0x26b knote+0x38 freebsd_selwakeup+0x8b netmap_notify+0x55 netmap_pipe_txsync+0x156 netmap_poll+0x400 netmap_knrw+0x6e kqueue_register+0x799 kern_kevent+0x158 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb >>>>> 1095 100210 addos worker#2 mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb >>>>> 1095 100211 addos worker#NOIP mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb >>>>> 1095 100212 addos balancer mi_switch+0xe1 turnstile_wait+0x42a __mtx_lock_sleep+0x26b knote+0x38 freebsd_selwakeup+0x8b netmap_notify+0x2a netmap_pipe_rxsync+0x54 netmap_poll+0x774 netmap_knrw+0x6e kern_kevent+0x5cc sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > > > -- Dr. Ing. Giuseppe Lettieri Dipartimento di Ingegneria della Informazione Universita' di Pisa Largo Lucio Lazzarino 1, 56122 Pisa - Italy Ph. : (+39) 050-2217.649 (direct) .599 (switch) Fax : (+39) 050-2217.600 e-mail: g.lettieri@iet.unipi.it From owner-freebsd-stable@freebsd.org Tue Feb 9 16:14:12 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 70825AA3CB8 for ; Tue, 9 Feb 2016 16:14:12 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 143089DF for ; Tue, 9 Feb 2016 16:14:11 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id u19FsYGm068849 for ; Tue, 9 Feb 2016 16:54:34 +0100 (CET) Received: from [217.29.44.208] ([217.29.44.208]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id u19FsYlT071824 for ; Tue, 9 Feb 2016 16:54:34 +0100 (CET) (envelope-from hausen@punkt.de) From: "Patrick M. Hausen" Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Best practices for ZFS setup for a strictly SSD based system? Message-Id: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> Date: Tue, 9 Feb 2016 16:54:36 +0100 To: freebsd-stable Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\)) X-Mailer: Apple Mail (2.3112) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2016 16:14:12 -0000 Hi, all, while there is quite a bit of documentation on how to improve ZFS = performance by using a combination of rotating disks and SSDs, I have not found much = about an SSD only setup. We are planning to try a hosting server with 8 SATA SSDs with ZFS. = Things I am not at all sure about: * Does the recommended limit of 6 disks for a RAIDZ2 still hold? 2x 4 disks is quite a bit of overhead, could I use all 8 in one vdev and get away with it? (The maximum of 6 recommendation is in some old Sun doc) * Will e.g. MySQL still profit from residing on a mirror instead of a RAIDZ2, even if all disks are SSDs? * Does a separate ZIL and/or ARC cache device still make sense? Any pointers or direct help greatly appreciated. Or should I take this = to freebsd-fs@? Thanks and best regards, Patrick --=20 punkt.de GmbH * Kaiserallee 13a * 76133 Karlsruhe Tel. 0721 9109 0 * Fax 0721 9109 100 info@punkt.de http://www.punkt.de Gf: J=C3=BCrgen Egeling AG Mannheim 108285 From owner-freebsd-stable@freebsd.org Tue Feb 9 16:35:26 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E4FE6AA2685 for ; Tue, 9 Feb 2016 16:35:25 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-oi0-x229.google.com (mail-oi0-x229.google.com [IPv6:2607:f8b0:4003:c06::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AC4B713B2 for ; Tue, 9 Feb 2016 16:35:25 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-oi0-x229.google.com with SMTP id m82so18259915oif.2 for ; Tue, 09 Feb 2016 08:35:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=1/wxarL/jvmnm/fTbrr0ssfOFQvpsaxTazG6rNwo630=; b=dj8Vl9AhSEZL3f0yny1dcbgDeOVMonkIfcethsJ2QjJYMD6jWEn8/RluWT5s+Pflza dKfZQP+63CmQqa3tip8/Orz3eqnRpDkajER/VYf99XaNuPhizgw1dh1i+y3vNV9DjSH4 P3+M+UAfsx4mIixRxmfq7izYAvFj4Yd9z6tpUuhk8QMl0WUbYcXZxDuMEokXUIXI9yQm OBF5xLABJJ1AJ2lU4jKzLwEjN5SeremGj9CkKN7Ig8Gy1NtumVauX5hWBS6nrVm+u7uu 51aylKSNgf3KsqvxQ/g1GEq6BKExd8yRAYkPTB6GZhN9gFfq70zvQtLjWabKC35XWWct vp4w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=1/wxarL/jvmnm/fTbrr0ssfOFQvpsaxTazG6rNwo630=; b=AqDy6Mbf/vtExG4gNrmxQrkvjb7LANeb3mFvKJWPdIUQdv39Xd34OPittCpVqoRQhn zdz2XZaglyX56b+qAgwThLesosCpYJzGVZU3HGTiuTo6ROzCgNC9gpOT/5Du/aipYh2x 9i3FVtlDE9kR5v3LgdTTMu7Z75lEnNhhe41W6KL57mcKw8bnMJzcv1+jzxlyKBEsYzM8 cnVIVbRjipDmj4zhySthnUfGvQ539X53y302z6e9ojSV6L7+xSbMz/Yh1wJSRofjztk8 koiRKMe+NETsRm8b/HnUxl4umnQJBeYRJsUgSuy9zxuKXw2G5z4t8M753Hj+FLUHelkF Y3Jg== X-Gm-Message-State: AG10YOTFnu5qvfpYL5Bn0ti3piRIyOV0kDJe3ph+06AYYTFecF0MJvO1/+y65IGFq++yeZTUOiEw329LfS62ww== MIME-Version: 1.0 X-Received: by 10.202.199.214 with SMTP id x205mr4305569oif.107.1455035535227; Tue, 09 Feb 2016 08:32:15 -0800 (PST) Sender: asomers@gmail.com Received: by 10.202.210.79 with HTTP; Tue, 9 Feb 2016 08:32:15 -0800 (PST) In-Reply-To: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> References: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> Date: Tue, 9 Feb 2016 09:32:15 -0700 X-Google-Sender-Auth: epMGRjZrZJPJg7r6mJZl_wDvXdM Message-ID: Subject: Re: Best practices for ZFS setup for a strictly SSD based system? From: Alan Somers To: "Patrick M. Hausen" Cc: freebsd-stable Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2016 16:35:26 -0000 On Tue, Feb 9, 2016 at 8:54 AM, Patrick M. Hausen wrote: > Hi, all, > > while there is quite a bit of documentation on how to improve ZFS performance > by using a combination of rotating disks and SSDs, I have not found much about > an SSD only setup. > > We are planning to try a hosting server with 8 SATA SSDs with ZFS. Things I am > not at all sure about: > > * Does the recommended limit of 6 disks for a RAIDZ2 still > hold? 2x 4 disks is quite a bit of overhead, could I use all 8 > in one vdev and get away with it? > (The maximum of 6 recommendation is in some old Sun doc) Nah, you can go much higher. This post describes the RAIDZ overhead. The main penalty to larger stripes is lower IOPs. Your RAIDZ array will have the same read IOPs as a single SSD, no matter how large it is. So, for example, a pool of two RAIDZ stripes each containing 4+2 disks will have twice the IOPS as a pool containing one RAIDZ stripe with 8+2 disks, and about the same storage overhead. http://blog.delphix.com/matt/2014/06/06/zfs-stripe-width/ > > * Will e.g. MySQL still profit from residing on a mirror > instead of a RAIDZ2, even if all disks are SSDs? Yes, because a mirrored vdev has as many read IOPs as all of its disks combined. So a RAID10 of SSDs will have many read IOPs indeed. > > * Does a separate ZIL and/or ARC cache device still > make sense? Usually no. But it might make a difference if the ZIL or L2ARC devices have different characteristics from the regular devices. For example, you might use medium speed MLC flash for your regular vdevs and a very fast, small SLC device for the ZIL. But I wouldn't do it unless you thoroughly test it with your workload. > > Any pointers or direct help greatly appreciated. Or should I take this to freebsd-fs@? Will MySQL access its files in fixed-size records? If so, you can set the recsize filesystem property accordingly. If not, you should probably leave recsize at the default. If you profile MySQL's disk accesses and determine that there is a dominant recordsize, then go ahead and set ZFS's recsize to the next highest power of two. As usual, disable atime. > > Thanks and best regards, > Patrick > -- -Alan From owner-freebsd-stable@freebsd.org Tue Feb 9 17:05:25 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 430BAAA362D for ; Tue, 9 Feb 2016 17:05:25 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D89E3C51; Tue, 9 Feb 2016 17:05:24 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id u19H5Mcc069405; Tue, 9 Feb 2016 18:05:22 +0100 (CET) Received: from [217.29.44.208] ([217.29.44.208]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id u19H5Mso078168; Tue, 9 Feb 2016 18:05:22 +0100 (CET) (envelope-from hausen@punkt.de) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\)) Subject: Re: Best practices for ZFS setup for a strictly SSD based system? From: "Patrick M. Hausen" In-Reply-To: Date: Tue, 9 Feb 2016 18:05:25 +0100 Cc: freebsd-stable Content-Transfer-Encoding: quoted-printable Message-Id: References: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> To: Alan Somers X-Mailer: Apple Mail (2.3112) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2016 17:05:25 -0000 Hi! > Am 09.02.2016 um 17:32 schrieb Alan Somers : > [...] > http://blog.delphix.com/matt/2014/06/06/zfs-stripe-width/ >=20 >>=20 >> * Will e.g. MySQL still profit from residing on a mirror >> instead of a RAIDZ2, even if all disks are SSDs? >=20 > Yes, because a mirrored vdev has as many read IOPs as all of its disks > combined. So a RAID10 of SSDs will have many read IOPs indeed. Ah =E2=80=A6 yes. Now I remember :) > [=E2=80=A6] > Will MySQL access its files in fixed-size records? If so, you can set > the recsize filesystem property accordingly. If not, you should > probably leave recsize at the default. If you profile MySQL's disk > accesses and determine that there is a dominant recordsize, then go > ahead and set ZFS's recsize to the next highest power of two. >=20 > As usual, disable atime. We already knew these. But thanks a lot for the vdev setup hints! So it will be a mirror for OS and DB and a 4+2 raidz2 for the rest of the data. Our MySQL zvols are currently set up like this: DB files: recordsize=3D16k atime=3Doff primarycache=3Dmetadata InnoDB log files: recordsize=3D128k (rest inherited from above) Kind regards, Patrick --=20 punkt.de GmbH * Kaiserallee 13a * 76133 Karlsruhe Tel. 0721 9109 0 * Fax 0721 9109 100 info@punkt.de http://www.punkt.de Gf: J=C3=BCrgen Egeling AG Mannheim 108285 From owner-freebsd-stable@freebsd.org Tue Feb 9 17:28:34 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 36E0AAA2131 for ; Tue, 9 Feb 2016 17:28:34 +0000 (UTC) (envelope-from crest@rlwinm.de) Received: from smtp.rlwinm.de (smtp.rlwinm.de [IPv6:2a01:4f8:201:31ef::e]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 02C181D3E for ; Tue, 9 Feb 2016 17:28:34 +0000 (UTC) (envelope-from crest@rlwinm.de) Received: from crest.local (unknown [87.253.189.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.rlwinm.de (Postfix) with ESMTPSA id 7E503595E for ; Tue, 9 Feb 2016 18:28:22 +0100 (CET) Subject: Re: Best practices for ZFS setup for a strictly SSD based system? To: freebsd-stable@freebsd.org References: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> From: Jan Bramkamp Message-ID: <56BA21B6.3070308@rlwinm.de> Date: Tue, 9 Feb 2016 18:28:22 +0100 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 In-Reply-To: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2016 17:28:34 -0000 On 09/02/16 16:54, Patrick M. Hausen wrote: > Hi, all, > > while there is quite a bit of documentation on how to improve ZFS performance > by using a combination of rotating disks and SSDs, I have not found much about > an SSD only setup. > > We are planning to try a hosting server with 8 SATA SSDs with ZFS. Things I am > not at all sure about: > > * Does the recommended limit of 6 disks for a RAIDZ2 still > hold? 2x 4 disks is quite a bit of overhead, could I use all 8 > in one vdev and get away with it? > (The maximum of 6 recommendation is in some old Sun doc) There are multiple reasons to limit number of disks per RAID-Z VDEV. * Resilver time: ZFS has to process all objects ordered by transaction id to resilver a RAID-Z. Resilvering is a torture test for the remaining disks of your degraded RAID-Z and with the ratio of bandwidth to capacity of current hard disks resilvering takes too long. This isn't an issue for SSDs. * For performance estimations think of the RAID-Z of one huge disk with larger blocks but the same IOPS as the slowest disk in the RAID-Z. Databases perform disk I/O in small blocks limiting your RAID-Z to the performance of about one of its member disks. * A ZFS pool can only grow by adding whole VDEVS or replacing all disks in a VDEV one at a time. Using mirror allows the pool to grow in smaller increments. > * Will e.g. MySQL still profit from residing on a mirror > instead of a RAIDZ2, even if all disks are SSDs? Yes OpenZFS schedules reads on mirrors to the disk with the shortest queue thus a mirror offers about sum of its member disks in read performance (IOPS and bandwidth) and the minimum of its member disks in write performance (IOPS and bandwidth). A pool with as many mirrored VDEVs as possible will offer the optimal performance for a given number of disks. For write heavy workloads the quality of the SSDs matters a lot as well. Cheap consumer SSDs can't sustain high write rates for any length of time. Even medium quality SSDs have a lot of jitter and suffer from throughput degradation under sustained write loads. Optimized server SSDs can sustain random write workloads with little jitter and bounded latency. A NVMe SSD can offer an additional order of magnitude performance increase over SATA SSDs but at a significant increase in price. With multiple NVMe SSDs you will run into the current scalability limits of ZFS and GEOM. > * Does a separate ZIL and/or ARC cache device still > make sense? Most likely not. An other optimization is splitting the log and table space and creating a dedicated ZFS dataset for each. Create the dataset containing the table space with the fixed record size of your MySQL backend. ZFS also offers a lot more consistency and atomicity quarantines than required by a minimal POSIX file system. This allows you to further reduce the syncing overhead by tuning MySQL to take advantage of ZFS quarantines. From owner-freebsd-stable@freebsd.org Wed Feb 10 10:15:19 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89264AA3E9B for ; Wed, 10 Feb 2016 10:15:19 +0000 (UTC) (envelope-from kraduk@gmail.com) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 20ECD1367 for ; Wed, 10 Feb 2016 10:15:19 +0000 (UTC) (envelope-from kraduk@gmail.com) Received: by mail-wm0-x232.google.com with SMTP id g62so19745843wme.0 for ; Wed, 10 Feb 2016 02:15:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Sj42b1fluPg9zeOLMZLR4FHLnE3BSbrrKYtl1CNF++0=; b=lFfu7wNIp7kRKrM+NAQCdT4tro8DHSAe30ApYy2xl1Qk/KPm5VsEMEHD3Io4315rZ/ ztskvkD8qyWMN7pZnjNPK/oXhve2XlwXXBsYjVDUNbF2JyNYbgfQkr/0inJ2YVxIBG2e hgXeHgV2xEpWZ/cQneW8fAz90PzvTIpUnoa74k2Kxkt6+Zgy4iXTV8tU2eN72FV7Q/rm NUQ4LeJRfBc0rrCV8dCd1/41Py5IfJ+CrUSHVwePOLJDCbqjPcdOeYwhk1iqxuVw3wG/ hwVZD+amHZa1lkARsYDixkJt9hyX+hisCUPO9dfToqheFRPUmsfT5b1LBMYU36f2ym25 5gXA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=Sj42b1fluPg9zeOLMZLR4FHLnE3BSbrrKYtl1CNF++0=; b=bwopscGli7xuG+Xi4GiXmFOYa4jz+4/1cNymXAhpzdLPAsojSYcjaB8vDmAoxyFq3N 4kRHr2xyhWHdRXwQRhhZpOWzLKXwugGIkk9p1mtmBuXY5/a3ynUtvC6lv5l9mBEIwNc2 ZvWQ9H8zO31J+B5ioHdWPWE4tl8Z2D/qapCX3+KistA1ZBvnoUKRLRcDT5qM40rtzZlN dtVle3lXFjScka83rEZZu+Cl+G216LVxR/hvJnePDITqT91iT6Ng+VID93O9TIgsCEkG dWHE1N9yF/Dm3qWvn510SDcOreP4OXx0NPiIqUDYFdQ18BQ2Z1a9wLPDk08kwMW4EH2B ClvA== X-Gm-Message-State: AG10YOQ7wS1VHnKS8JqnQoldQfjmkiGCzDj03vwNHSUvzcHnS5gg0LH8Q3y7B7GLiBlAgYL9vT/V948R2V5DWg== MIME-Version: 1.0 X-Received: by 10.194.103.164 with SMTP id fx4mr39210889wjb.56.1455099317582; Wed, 10 Feb 2016 02:15:17 -0800 (PST) Received: by 10.28.31.77 with HTTP; Wed, 10 Feb 2016 02:15:17 -0800 (PST) In-Reply-To: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> References: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> Date: Wed, 10 Feb 2016 10:15:17 +0000 Message-ID: Subject: Re: Best practices for ZFS setup for a strictly SSD based system? From: krad To: "Patrick M. Hausen" Cc: freebsd-stable Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Feb 2016 10:15:19 -0000 Dont forget alignment and ashift. You may also want to test compression as well. IF you have spare cpu cycles I would imagine the systems cpu will handle it faster than any onboard ssd compression. Benchmarking would be of use here though. On 9 February 2016 at 15:54, Patrick M. Hausen wrote: > Hi, all, > > while there is quite a bit of documentation on how to improve ZFS > performance > by using a combination of rotating disks and SSDs, I have not found much > about > an SSD only setup. > > We are planning to try a hosting server with 8 SATA SSDs with ZFS. Things > I am > not at all sure about: > > * Does the recommended limit of 6 disks for a RAIDZ2 still > hold? 2x 4 disks is quite a bit of overhead, could I use all 8 > in one vdev and get away with it? > (The maximum of 6 recommendation is in some old Sun doc) > > * Will e.g. MySQL still profit from residing on a mirror > instead of a RAIDZ2, even if all disks are SSDs? > > * Does a separate ZIL and/or ARC cache device still > make sense? > > Any pointers or direct help greatly appreciated. Or should I take this to > freebsd-fs@? > > Thanks and best regards, > Patrick > -- > punkt.de GmbH * Kaiserallee 13a * 76133 Karlsruhe > Tel. 0721 9109 0 * Fax 0721 9109 100 > info@punkt.de http://www.punkt.de > Gf: J=C3=BCrgen Egeling AG Mannheim 108285 > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Wed Feb 10 11:59:49 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B951FAA40A5 for ; Wed, 10 Feb 2016 11:59:49 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A3191239 for ; Wed, 10 Feb 2016 11:59:49 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: by mailman.ysv.freebsd.org (Postfix) id A2F86AA40A4; Wed, 10 Feb 2016 11:59:49 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A284DAA40A3 for ; Wed, 10 Feb 2016 11:59:49 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 598D1238 for ; Wed, 10 Feb 2016 11:59:49 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1aTTQo-00023r-0N; Wed, 10 Feb 2016 14:59:38 +0300 Date: Wed, 10 Feb 2016 14:59:37 +0300 From: Slawa Olhovchenkov To: Giuseppe Lettieri Cc: Luigi Rizzo , Adrian Chadd , "stable@freebsd.org" Subject: Re: 82576 + NETMAP + VLAN Message-ID: <20160210115937.GA37895@zxy.spb.ru> References: <20151022163519.GF6469@zxy.spb.ru> <20160202204446.GQ88527@zxy.spb.ru> <20160204130029.GC88527@zxy.spb.ru> <20160208173935.GK68298@zxy.spb.ru> <56B9E398.1060105@iet.unipi.it> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <56B9E398.1060105@iet.unipi.it> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Feb 2016 11:59:49 -0000 On Tue, Feb 09, 2016 at 02:03:20PM +0100, Giuseppe Lettieri wrote: > Hi all, > > I have only looked into the fist LOR, which has actually been there for > a long time. > > It should be triggered by the following paths: > 1) application does an ioctl(, NIOCREGIF) (or GETINFO) > ->netmap_mem_finalize() [locks the netmap allocator] > ->contigmalloc() [locks things related to vm] > 2) application mmap()s the netmap fd and then accesses the area > -> page fault [locks things related to vm] > ->netmap_mem_ofstophys() [locks the netmap allocator] > > As a quick check, the LOR disappears if I replace the contigmalloc() > with a dummy operation returning a static buffer. > > If this is correct, there cannot be any concurrency between the two > paths, since the 1st one must be completed before the first mmap(). I > also think that the vm objects locked in the two paths are not the same, > but I don't know whether WITNESS keeps track of (some?) lock instances, > or just lock types. Thanks, Giuseppe. Can you look also on second issue? PS: What need from me? May be open PR? > Il 09/02/2016 13:31, Luigi Rizzo ha scritto: > > I am Cc-ing Giuseppe Lettieri who has looked at the problem and may > > have some comments to share > > > > cheers > > luigi > > > > On Mon, Feb 8, 2016 at 9:39 AM, Slawa Olhovchenkov wrote: > >> On Thu, Feb 04, 2016 at 10:47:34AM -0800, Adrian Chadd wrote: > >> > >>> .. but if it does, can you enable witness and see what it reports as > >>> lock order violations? > >> > >> last STABLE: > >> > >> 1. first LOR (with poll, don't cause direct problems now): > >> > >> lock order reversal: > >> 1st 0xfffff800946e6700 vm object (vm object) @ /usr/src/sys/vm/vm_fault.c:363 > >> 2nd 0xffffffff813e14d8 netmap memory allocator lock (netmap memory allocator lock) @ /usr/src/sys/dev/netmap/netmap_mem2.c:393 > >> KDB: stack backtrace: > >> #0 0xffffffff80970320 at kdb_backtrace+0x60 > >> #1 0xffffffff809882ce at witness_checkorder+0xc7e > >> #2 0xffffffff8091fcbc at __mtx_lock_flags+0x4c > >> #3 0xffffffff806784f6 at netmap_mem_ofstophys+0x36 > >> #4 0xffffffff80676834 at netmap_dev_pager_fault+0x34 > >> #5 0xffffffff80b81a0f at dev_pager_getpages+0x3f > >> #6 0xffffffff80b8cc1e at vm_fault_hold+0x86e > >> #7 0xffffffff80b8c367 at vm_fault+0x77 > >> #8 0xffffffff80d0e2c9 at trap_pfault+0x199 > >> #9 0xffffffff80d0db47 at trap+0x527 > >> #10 0xffffffff80cf4ce2 at calltrap+0x8 > >> > >> 2. kqueue issuse (not LOR!) > >> > >> acquiring duplicate lock of same type: "nm_kn_lock" > >> 1st nm_kn_lock @ /usr/src/sys/kern/kern_event.c:2003 > >> 2nd nm_kn_lock @ /usr/src/sys/kern/kern_event.c:2003 > >> KDB: stack backtrace: > >> #0 0xffffffff80970320 at kdb_backtrace+0x60 > >> #1 0xffffffff809882ce at witness_checkorder+0xc7e > >> #2 0xffffffff8091fcbc at __mtx_lock_flags+0x4c > >> #3 0xffffffff808fd899 at knote+0x39 > >> #4 0xffffffff8067636b at freebsd_selwakeup+0x8b > >> #5 0xffffffff80674eb5 at netmap_notify+0x55 > >> #6 0xffffffff8067ccb6 at netmap_pipe_txsync+0x156 > >> #7 0xffffffff80674740 at netmap_poll+0x400 > >> #8 0xffffffff80676b8e at netmap_knrw+0x6e > >> #9 0xffffffff808fc57a at kqueue_register+0x64a > >> #10 0xffffffff808fcdd4 at kern_kevent_fp+0x144 > >> #11 0xffffffff808fcc4f at kern_kevent+0x9f > >> #12 0xffffffff808fcaea at sys_kevent+0x12a > >> #13 0xffffffff80d0e914 at amd64_syscall+0x2d4 > >> #14 0xffffffff80cf4fcb at Xfast_syscall+0xfb > >> > >> Do you need anything? > >> > >>> On 4 February 2016 at 10:47, Adrian Chadd wrote: > >>>> I've no time to help with this, I'm sorry :( > >>>> > >>>> > >>>> -a > >>>> > >>>> > >>>> On 4 February 2016 at 05:00, Slawa Olhovchenkov wrote: > >>>>> On Tue, Feb 02, 2016 at 11:44:47PM +0300, Slawa Olhovchenkov wrote: > >>>>> > >>>>>> On Thu, Oct 22, 2015 at 11:24:53AM -0700, Luigi Rizzo wrote: > >>>>>> > >>>>>>> On Thu, Oct 22, 2015 at 11:12 AM, Adrian Chadd wrote: > >>>>>>>> On 22 October 2015 at 09:35, Slawa Olhovchenkov wrote: > >>>>>>>>> On Sun, Oct 18, 2015 at 07:45:52PM -0700, Adrian Chadd wrote: > >>>>>>>>> > >>>>>>>>>> Heh, file a bug with luigi; it should be defined better inside netmap itself. > >>>>>>>>> > >>>>>>>>> I am CC: luigi. > >>>>>>>>> > >>>>>>>>> Next question: do kevent RX/TX sync? > >>>>>>>>> In my setup I am need to manual NIOCTXSYNC/NIOCRXSYNC. > >>>>>>>> > >>>>>>>> Hi, > >>>>>>>> > >>>>>>>> Nope. kqueue() doesn't do the implicit sync like poll() does; it's > >>>>>>>> just the notification path. > >>>>>>> > >>>>>>> actually not. When the file descriptor is registered there > >>>>>>> is an implicit sync, and there is another one when an event > >>>>>>> is posted for the file descriptor. > >>>>>>> > >>>>>>> unless there are bugs, of course. > >>>>>> > >>>>>> I found strange behaivor: > >>>>>> > >>>>>> 1. open netmap and register in main thread > >>>>>> 2. kevent register in different thread > >>>>>> 3. result: got event by kevent but no ring sinc (all head,tail,cur > >>>>>> still 0). > >>>>>> > >>>>>> Is this normal? Or is this bug? > >>>>>> > >>>>>> open and registering netmap in same thread as kevent resolve this. > >>>>> > >>>>> Also, kevent+netmap deadlocked for me: > >>>>> > >>>>> PID TID COMM TDNAME KSTACK > >>>>> 1095 100207 addos - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_timedwait_sig+0x10 _sleep+0x238 kern_nanosleep+0x10e sys_nanosleep+0x51 amd64_syscall+0x40f Xfast_syscall+0xfb > >>>>> 1095 100208 addos worker#0 mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > >>>>> 1095 100209 addos worker#1 mi_switch+0xe1 turnstile_wait+0x42a __mtx_lock_sleep+0x26b knote+0x38 freebsd_selwakeup+0x8b netmap_notify+0x55 netmap_pipe_txsync+0x156 netmap_poll+0x400 netmap_knrw+0x6e kqueue_register+0x799 kern_kevent+0x158 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > >>>>> 1095 100210 addos worker#2 mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > >>>>> 1095 100211 addos worker#NOIP mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d kern_kevent+0x401 sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > >>>>> 1095 100212 addos balancer mi_switch+0xe1 turnstile_wait+0x42a __mtx_lock_sleep+0x26b knote+0x38 freebsd_selwakeup+0x8b netmap_notify+0x2a netmap_pipe_rxsync+0x54 netmap_poll+0x774 netmap_knrw+0x6e kern_kevent+0x5cc sys_kevent+0x12a amd64_syscall+0x40f Xfast_syscall+0xfb > > > > > > > > > -- > Dr. Ing. Giuseppe Lettieri > Dipartimento di Ingegneria della Informazione > Universita' di Pisa > Largo Lucio Lazzarino 1, 56122 Pisa - Italy > Ph. : (+39) 050-2217.649 (direct) .599 (switch) > Fax : (+39) 050-2217.600 > e-mail: g.lettieri@iet.unipi.it > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Wed Feb 10 13:27:38 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A7C11AA36FC for ; Wed, 10 Feb 2016 13:27:38 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 931E51F99 for ; Wed, 10 Feb 2016 13:27:38 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: by mailman.ysv.freebsd.org (Postfix) id 916B7AA36FA; Wed, 10 Feb 2016 13:27:38 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90FFDAA36F9 for ; Wed, 10 Feb 2016 13:27:38 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from smtp.unipi.it (smtp1.unipi.it [131.114.21.19]) by mx1.freebsd.org (Postfix) with ESMTP id 5A70B1F98 for ; Wed, 10 Feb 2016 13:27:37 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from localhost (localhost [127.0.0.1]) by smtp.unipi.it (Postfix) with ESMTP id 96C7041FDF; Wed, 10 Feb 2016 14:27:30 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at unipi.it Received: from [10.216.1.203] (prova.iet.unipi.it [131.114.58.86]) (Authenticated User) by smtp.unipi.it (Postfix) with ESMTPSA id 3244F41FDD; Wed, 10 Feb 2016 14:27:25 +0100 (CET) Subject: Re: 82576 + NETMAP + VLAN To: Slawa Olhovchenkov References: <20151022163519.GF6469@zxy.spb.ru> <20160202204446.GQ88527@zxy.spb.ru> <20160204130029.GC88527@zxy.spb.ru> <20160208173935.GK68298@zxy.spb.ru> <56B9E398.1060105@iet.unipi.it> <20160210115937.GA37895@zxy.spb.ru> Cc: Luigi Rizzo , Adrian Chadd , "stable@freebsd.org" From: Giuseppe Lettieri Message-ID: <56BB3C20.600@iet.unipi.it> Date: Wed, 10 Feb 2016 14:33:20 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 In-Reply-To: <20160210115937.GA37895@zxy.spb.ru> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Feb 2016 13:27:38 -0000 Il 10/02/2016 12:59, Slawa Olhovchenkov ha scritto: > Can you look also on second issue? > > PS: What need from me? May be open PR? May you provide some example code that triggers the issue? Cheers, Giuseppe -- Dr. Ing. Giuseppe Lettieri Dipartimento di Ingegneria della Informazione Universita' di Pisa Largo Lucio Lazzarino 1, 56122 Pisa - Italy Ph. : (+39) 050-2217.649 (direct) .599 (switch) Fax : (+39) 050-2217.600 e-mail: g.lettieri@iet.unipi.it From owner-freebsd-stable@freebsd.org Wed Feb 10 13:53:22 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9B4EAA441E for ; Wed, 10 Feb 2016 13:53:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D632BF63 for ; Wed, 10 Feb 2016 13:53:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: by mailman.ysv.freebsd.org (Postfix) id D22FDAA441D; Wed, 10 Feb 2016 13:53:22 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D1D02AA441C for ; Wed, 10 Feb 2016 13:53:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 93135F62 for ; Wed, 10 Feb 2016 13:53:22 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1aTVCo-0004on-8S; Wed, 10 Feb 2016 16:53:18 +0300 Date: Wed, 10 Feb 2016 16:53:18 +0300 From: Slawa Olhovchenkov To: Giuseppe Lettieri Cc: Luigi Rizzo , Adrian Chadd , "stable@freebsd.org" Subject: Re: 82576 + NETMAP + VLAN Message-ID: <20160210135318.GL68298@zxy.spb.ru> References: <20160202204446.GQ88527@zxy.spb.ru> <20160204130029.GC88527@zxy.spb.ru> <20160208173935.GK68298@zxy.spb.ru> <56B9E398.1060105@iet.unipi.it> <20160210115937.GA37895@zxy.spb.ru> <56BB3C20.600@iet.unipi.it> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <56BB3C20.600@iet.unipi.it> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Feb 2016 13:53:23 -0000 On Wed, Feb 10, 2016 at 02:33:20PM +0100, Giuseppe Lettieri wrote: > Il 10/02/2016 12:59, Slawa Olhovchenkov ha scritto: > > Can you look also on second issue? > > > > PS: What need from me? May be open PR? > > May you provide some example code that triggers the issue? This is about 700 lines of code (not very clear), may be I can describe it? First: this is thread code. I think it impotant point. All sync with netmap go throw kevent() interface. Main thread got information about two NIC (determine number of rings) and spawn 1 balancer thread and NCPU worker thread. All thread pinned to cores. Balancer thread open all rings on both NIC separate (i.e. open 6+6 NETMAP fds for hardware rings) and allocate on first NIC and open NCPU*2 master NETMAP pipes. All fds register in kevent for read event as EV_SET(kp, fd, EVFILT_READ, EV_ADD | EV_ENABLE | EV_CLEAR, 0, 0, kidx); and for future write event as EV_SET(kp, fd, EVFILT_WRITE, EV_ADD | EV_DISABLE, 0, 0, 0); after write occur next event will be added: EV_SET(kp, fd, EVFILT_WRITE, EV_ADD | EV_DISPATCH, 0, 0, 0); Each worker thread open two slave NETMAP pipes in same maner as above. Balancer got packet from inside hardware ring, dispatch (zero-copy) to inside master pipe. Worker got packet from inside slave pipe and zero-copy to outside slave pipe. Balancer got packet from outside master pipe and dispatch (zero-copy) to outside hardware ring. And vise versa. After program start I have deadlock instantly (with WITNESS enabled kernel). W/o WITNESS deadloc occur only under load. W/o EV_DISABLE/EV_DISPATCH NETAMP don't see output packets. NETMAP don't forward incoming packet to program when open and attach to NETMAP do in main thread. From owner-freebsd-stable@freebsd.org Thu Feb 11 07:58:24 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91F50AA5F28 for ; Thu, 11 Feb 2016 07:58:24 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 348EB1A4 for ; Thu, 11 Feb 2016 07:58:23 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id u1B7wF0K089223 for ; Thu, 11 Feb 2016 08:58:15 +0100 (CET) Received: from [217.29.44.208] ([217.29.44.208]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id u1B7wFlo060002 for ; Thu, 11 Feb 2016 08:58:15 +0100 (CET) (envelope-from hausen@punkt.de) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\)) Subject: Re: Best practices for ZFS setup for a strictly SSD based system? From: "Patrick M. Hausen" In-Reply-To: Date: Thu, 11 Feb 2016 08:58:15 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <4D656008-1E48-46CF-A799-1C90777EAAF1@punkt.de> References: <2D296837-3B06-4E72-B8B0-A33AE6CE48AE@punkt.de> To: freebsd-stable X-Mailer: Apple Mail (2.3112) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Feb 2016 07:58:24 -0000 Hi, all, > Am 10.02.2016 um 11:15 schrieb krad : >=20 > Dont forget alignment and ashift. You may also want to test = compression as well. IF you have spare cpu cycles I would imagine the = systems cpu will handle it faster than any onboard ssd compression. = Benchmarking would be of use here though. Correct. Just for the record: since 10.2 the FreeBSD installer does the = right thing [tm]. ashift=3D12 and partitions are 1M aligned. Patrick --=20 punkt.de GmbH * Kaiserallee 13a * 76133 Karlsruhe Tel. 0721 9109 0 * Fax 0721 9109 100 info@punkt.de http://www.punkt.de Gf: J=C3=BCrgen Egeling AG Mannheim 108285 From owner-freebsd-stable@freebsd.org Thu Feb 11 09:06:07 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 65DE4AA5258 for ; Thu, 11 Feb 2016 09:06:07 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4A8591DB1 for ; Thu, 11 Feb 2016 09:06:07 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: by mailman.ysv.freebsd.org (Postfix) id 4A168AA5257; Thu, 11 Feb 2016 09:06:07 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49B0AAA5256 for ; Thu, 11 Feb 2016 09:06:07 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from smtp.unipi.it (smtp1.unipi.it [131.114.21.19]) by mx1.freebsd.org (Postfix) with ESMTP id 123121DB0 for ; Thu, 11 Feb 2016 09:06:06 +0000 (UTC) (envelope-from g.lettieri@iet.unipi.it) Received: from localhost (localhost [127.0.0.1]) by smtp.unipi.it (Postfix) with ESMTP id 1AD1F42073; Thu, 11 Feb 2016 10:06:04 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at unipi.it Received: from [10.216.1.203] (prova.iet.unipi.it [131.114.58.86]) (Authenticated User) by smtp.unipi.it (Postfix) with ESMTPSA id 557C64207C; Thu, 11 Feb 2016 10:06:03 +0100 (CET) Subject: Re: 82576 + NETMAP + VLAN To: Slawa Olhovchenkov References: <20160202204446.GQ88527@zxy.spb.ru> <20160204130029.GC88527@zxy.spb.ru> <20160208173935.GK68298@zxy.spb.ru> <56B9E398.1060105@iet.unipi.it> <20160210115937.GA37895@zxy.spb.ru> <56BB3C20.600@iet.unipi.it> <20160210135318.GL68298@zxy.spb.ru> Cc: Luigi Rizzo , Adrian Chadd , "stable@freebsd.org" From: Giuseppe Lettieri Message-ID: <56BC505F.7080309@iet.unipi.it> Date: Thu, 11 Feb 2016 10:11:59 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 In-Reply-To: <20160210135318.GL68298@zxy.spb.ru> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Feb 2016 09:06:07 -0000 Il 10/02/2016 14:53, Slawa Olhovchenkov ha scritto: > On Wed, Feb 10, 2016 at 02:33:20PM +0100, Giuseppe Lettieri wrote: > >> Il 10/02/2016 12:59, Slawa Olhovchenkov ha scritto: >>> Can you look also on second issue? >>> >>> PS: What need from me? May be open PR? >> >> May you provide some example code that triggers the issue? > > This is about 700 lines of code (not very clear), may be I can describe it? I just need some code to trigger the problem locally. Don't worry about the clarity and the line count, unless you cannot share the code for other reasons. Cheers, Giuseppe > First: this is thread code. I think it impotant point. > All sync with netmap go throw kevent() interface. > > Main thread got information about two NIC (determine number of rings) > and spawn 1 balancer thread and NCPU worker thread. > All thread pinned to cores. > > Balancer thread open all rings on both NIC separate (i.e. open 6+6 > NETMAP fds for hardware rings) and allocate on first NIC and open > NCPU*2 master NETMAP pipes. > All fds register in kevent for read event as > > EV_SET(kp, fd, EVFILT_READ, EV_ADD | EV_ENABLE | EV_CLEAR, 0, 0, kidx); > > and for future write event as > > EV_SET(kp, fd, EVFILT_WRITE, EV_ADD | EV_DISABLE, 0, 0, 0); > > after write occur next event will be added: > > EV_SET(kp, fd, EVFILT_WRITE, EV_ADD | EV_DISPATCH, 0, 0, 0); > > Each worker thread open two slave NETMAP pipes in same maner as above. > > Balancer got packet from inside hardware ring, dispatch (zero-copy) to inside master pipe. > Worker got packet from inside slave pipe and zero-copy to outside slave pipe. > Balancer got packet from outside master pipe and dispatch (zero-copy) to outside hardware ring. > And vise versa. > > After program start I have deadlock instantly (with WITNESS enabled kernel). > W/o WITNESS deadloc occur only under load. > > W/o EV_DISABLE/EV_DISPATCH NETAMP don't see output packets. > NETMAP don't forward incoming packet to program when open and attach to NETMAP do in main thread. > -- Dr. Ing. Giuseppe Lettieri Dipartimento di Ingegneria della Informazione Universita' di Pisa Largo Lucio Lazzarino 1, 56122 Pisa - Italy Ph. : (+39) 050-2217.649 (direct) .599 (switch) Fax : (+39) 050-2217.600 e-mail: g.lettieri@iet.unipi.it From owner-freebsd-stable@freebsd.org Thu Feb 11 10:54:46 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9E89DAA5162 for ; Thu, 11 Feb 2016 10:54:46 +0000 (UTC) (envelope-from export@vascofilters.eu) Received: from karieraserlg.nazwa.pl (aju23.rev.netart.pl [77.55.254.23]) by mx1.freebsd.org (Postfix) with ESMTP id 1822F1A08 for ; Thu, 11 Feb 2016 10:54:45 +0000 (UTC) (envelope-from export@vascofilters.eu) Received: from pc (unknown [194.33.77.155]) by karieraserlg.nazwa.pl (Postfix) with ESMTPA id 1F4363CE1A31 for ; Thu, 11 Feb 2016 11:54:43 +0100 (CET) From: "=?iso-8859-2?Q?Marcin_Tomzi=F1ski?=" To: "freebsd-stable" Subject: cooperation Message-ID: Date: Thu, 11 Feb 2016 11:54:47 +0100 Organization: AnoMail - oprogramowanie do emailingow X-Priority: 3 MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-2; format=flowed Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Feb 2016 10:54:46 -0000 =20 Are you looking for a new automotive parts brand to be different from your = competitors?=20 Do you want to be a direct importer?=20 Are you looking for high quality products at fair and individual quotation?= =20 Fed up with late deliveries and low availability from the stock?=20 Do you want to join young and effective organisation?=20 Do you need fast orders handling and flexibility in market approach? We have a great proposal for your business! =20 Our products range consists of more than 1500 references under 4 brands - VASCO FILTERS (oil, fuel air and cabin filters) - FLUXAR FILTERS (red line) - PEXA WIPERS (universal and dedicated sets of wipers) - BREYKO (brake pads)=20 We are expanding our business in your country and looking for direct import= ers.=20 Join our Team! More info on web page: www.vascofilters.com or facebook = =20 If you have any questions do not hesitate to contact us, we speak English, = French and Spanish. Marketing and Operations Manager Olaf Tomzi=F1ski If you do not wish to receive further information. From owner-freebsd-stable@freebsd.org Thu Feb 11 13:34:40 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A8692AA44B8 for ; Thu, 11 Feb 2016 13:34:40 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 91B261B66 for ; Thu, 11 Feb 2016 13:34:40 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: by mailman.ysv.freebsd.org (Postfix) id 8E7F3AA44B6; Thu, 11 Feb 2016 13:34:40 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 742A2AA44B2 for ; Thu, 11 Feb 2016 13:34:40 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0C7211B63 for ; Thu, 11 Feb 2016 13:34:40 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1aTrO9-000CPQ-1X; Thu, 11 Feb 2016 16:34:29 +0300 Date: Thu, 11 Feb 2016 16:34:28 +0300 From: Slawa Olhovchenkov To: Giuseppe Lettieri Cc: Luigi Rizzo , Adrian Chadd , "stable@freebsd.org" Subject: Re: 82576 + NETMAP + VLAN Message-ID: <20160211133428.GM68298@zxy.spb.ru> References: <20160204130029.GC88527@zxy.spb.ru> <20160208173935.GK68298@zxy.spb.ru> <56B9E398.1060105@iet.unipi.it> <20160210115937.GA37895@zxy.spb.ru> <56BB3C20.600@iet.unipi.it> <20160210135318.GL68298@zxy.spb.ru> <56BC505F.7080309@iet.unipi.it> MIME-Version: 1.0 In-Reply-To: <56BC505F.7080309@iet.unipi.it> User-Agent: Mutt/1.5.24 (2015-08-30) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Feb 2016 13:34:40 -0000 On Thu, Feb 11, 2016 at 10:11:59AM +0100, Giuseppe Lettieri wrote: > Il 10/02/2016 14:53, Slawa Olhovchenkov ha scritto: > > On Wed, Feb 10, 2016 at 02:33:20PM +0100, Giuseppe Lettieri wrote: > > > >> Il 10/02/2016 12:59, Slawa Olhovchenkov ha scritto: > >>> Can you look also on second issue? > >>> > >>> PS: What need from me? May be open PR? > >> > >> May you provide some example code that triggers the issue? > > > > This is about 700 lines of code (not very clear), may be I can describe it? > > I just need some code to trigger the problem locally. Don't worry about > the clarity and the line count, unless you cannot share the code for > other reasons. I am attach source. run as "prog if1 if2" Got `acquiring duplicate lock of same type: "nm_kn_lock"` immediatly after start. Dead locking may be occur immediatly after start or may be need traffic flooding. From owner-freebsd-stable@freebsd.org Thu Feb 11 15:02:49 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 86286AA547A for ; Thu, 11 Feb 2016 15:02:49 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 59D711942; Thu, 11 Feb 2016 15:02:49 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id u1BF2lm9052320 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 11 Feb 2016 10:02:47 -0500 (EST) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:5c30:ed1b:e203:c55c] ([IPv6:2607:f3e0:0:4:5c30:ed1b:e203:c55c]) by lava.sentex.ca (8.14.9/8.14.9) with ESMTP id u1BF2kCM096078; Thu, 11 Feb 2016 10:02:46 -0500 (EST) (envelope-from mike@sentex.net) To: FreeBSD-STABLE Mailing List , garga@freebsd.org From: Mike Tancsa Subject: passwd and pw speed regression? X-Enigmail-Draft-Status: N1110 Organization: Sentex Communications Message-ID: <56BCA298.9060000@sentex.net> Date: Thu, 11 Feb 2016 10:02:48 -0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Feb 2016 15:02:49 -0000 I noticed that on a new RELENG_10 box we are building, password updates are taking a very long time to build. On the old RELENG_8 box, doing something simple like adding a user # time pw useradd test12345 0.062u 0.063s 0:00.14 85.7% 54+988k 196+134io 0pf+0w # time pw userdel test12345 0.164u 0.044s 0:00.20 100.0% 28+1181k 0+18io 0pf+0w On the new RELENG_10 box, # time pw useradd test12345 0.060u 0.120s 0:58.89 0.3% 58+146k 12+6485io 0pf+0w # time pw userdel test12345 0.125u 0.133s 0:58.80 0.4% 46+214k 13+9326io 0pf+0w # wc /etc/passwd 6113 14792 376128 /etc/passwd Yes, almost 60 seconds to add a user to the password file? Does anyone know what is going on to account for the large difference and how to work around it ? I am guessing https://svnweb.freebsd.org/base?view=revision&revision=285205 is the issue. Apart from keeping local source code changes, is there not a better way to not have reasonable speeds ? ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@freebsd.org Thu Feb 11 16:04:17 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9BD41AA52FB for ; Thu, 11 Feb 2016 16:04:17 +0000 (UTC) (envelope-from se@freebsd.org) Received: from mailout10.t-online.de (mailout10.t-online.de [194.25.134.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailout00.t-online.de", Issuer "TeleSec ServerPass DE-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 65E5E196B; Thu, 11 Feb 2016 16:04:17 +0000 (UTC) (envelope-from se@freebsd.org) Received: from fwd34.aul.t-online.de (fwd34.aul.t-online.de [172.20.26.145]) by mailout10.t-online.de (Postfix) with SMTP id 0B45556B527; Thu, 11 Feb 2016 17:04:09 +0100 (CET) Received: from [192.168.119.17] (rxUvP8ZcwhpsrOIQTREeke5DmbVsXZ1pJvqGx1upnpDxuRgfZgfohGUSe7Lik3+ZHb@[87.151.208.3]) by fwd34.t-online.de with (TLSv1.2:ECDHE-RSA-AES256-SHA encrypted) esmtp id 1aTtis-4KFU120; Thu, 11 Feb 2016 17:04:02 +0100 Subject: Re: passwd and pw speed regression? To: freebsd-stable@freebsd.org References: <56BCA298.9060000@sentex.net> From: Stefan Esser X-Enigmail-Draft-Status: N1110 Message-ID: <56BCB0EF.9060204@freebsd.org> Date: Thu, 11 Feb 2016 17:03:59 +0100 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 In-Reply-To: <56BCA298.9060000@sentex.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-ID: rxUvP8ZcwhpsrOIQTREeke5DmbVsXZ1pJvqGx1upnpDxuRgfZgfohGUSe7Lik3+ZHb X-TOI-MSGID: 41e73540-8115-472e-8c03-f8bed9b8a0fa X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Feb 2016 16:04:17 -0000 Am 11.02.2016 um 16:02 schrieb Mike Tancsa: > I noticed that on a new RELENG_10 box we are building, password updates > are taking a very long time to build. On the old RELENG_8 box, doing > something simple like adding a user > > # time pw useradd test12345 > 0.062u 0.063s 0:00.14 85.7% 54+988k 196+134io 0pf+0w > > # time pw userdel test12345 > 0.164u 0.044s 0:00.20 100.0% 28+1181k 0+18io 0pf+0w > > > On the new RELENG_10 box, > > # time pw useradd test12345 > 0.060u 0.120s 0:58.89 0.3% 58+146k 12+6485io 0pf+0w > > # time pw userdel test12345 > 0.125u 0.133s 0:58.80 0.4% 46+214k 13+9326io 0pf+0w > > > # wc /etc/passwd > 6113 14792 376128 /etc/passwd > > > Yes, almost 60 seconds to add a user to the password file? > > Does anyone know what is going on to account for the large difference > and how to work around it ? I am guessing You are affected by the problem mentioned in https://reviews.freebsd.org/D5186 The output file is written with O_SYNC a record at a time and this is slow (100 to 200 records per second on a non-SSD drive). This will be fixed in -CURRENT soon and I think the fix should qualify for inclusion in the next 10-BETA, thereafter. Regards, STefan > https://svnweb.freebsd.org/base?view=revision&revision=285205 > > is the issue. Apart from keeping local source code changes, is there not > a better way to not have reasonable speeds ? > > ---Mike From owner-freebsd-stable@freebsd.org Thu Feb 11 23:32:52 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 62E83AA5EE1 for ; Thu, 11 Feb 2016 23:32:52 +0000 (UTC) (envelope-from scott.otis@tandemcal.com) Received: from Filter01.GreenHouseData.com (outmail.fchosted.com [205.234.75.57]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "filter.greenhousedata.com", Issuer "Go Daddy Secure Certificate Authority - G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46D4BBE4 for ; Thu, 11 Feb 2016 23:32:51 +0000 (UTC) (envelope-from scott.otis@tandemcal.com) X-ASG-Debug-ID: 1455233569-0a955c0aa71ba09b0001-BIHDGU Received: from mail.fchosted.com (mailflow.greenhousedata.com [10.36.251.68]) by Filter01.GreenHouseData.com with ESMTP id cyEzYbEqHBR8z9FR (version=TLSv1 cipher=AES128-SHA bits=128 verify=NO) for ; Thu, 11 Feb 2016 15:32:49 -0800 (PST) X-Barracuda-Envelope-From: scott.otis@tandemcal.com Received: from EVT01FEVWEXA001.fchosted.com ([10.10.2.130]) by sea02fevwexa001 ([10.10.2.131]) with mapi id 14.03.0266.001; Thu, 11 Feb 2016 15:32:48 -0800 From: Scott Otis To: "freebsd-stable@freebsd.org" Subject: 10.2 Release - no core dump found after crash Thread-Topic: 10.2 Release - no core dump found after crash X-ASG-Orig-Subj: 10.2 Release - no core dump found after crash Thread-Index: AdFlJINNYruivLnGQDOZOcHy/Exhyw== Date: Thu, 11 Feb 2016 23:32:48 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [24.19.233.47] MIME-Version: 1.0 X-Barracuda-Connect: mailflow.greenhousedata.com[10.36.251.68] X-Barracuda-Start-Time: 1455233569 X-Barracuda-Encrypted: AES128-SHA X-Barracuda-URL: https://Filter.GreenHouseData.com:443/cgi-mod/mark.cgi X-Barracuda-Scan-Msg-Size: 39546 X-Virus-Scanned: by bsmtpd at GreenHouseData.com X-Barracuda-BRTS-Status: 1 X-Barracuda-Spam-Score: 0.00 X-Barracuda-Spam-Status: No, SCORE=0.00 using per-user scores of TAG_LEVEL=1000.0 QUARANTINE_LEVEL=1000.0 KILL_LEVEL=9.0 tests=HTML_MESSAGE X-Barracuda-Spam-Report: Code version 3.2, rules version 3.2.3.26959 Rule breakdown below pts rule name description ---- ---------------------- -------------------------------------------------- 0.00 HTML_MESSAGE BODY: HTML included in message Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Feb 2016 23:32:52 -0000 Been trying to get a FreeBSD VM server running on Azure on a "Standard DS" = size VM (so I have access to SSD storage for PostgreSQL). The "Standard DS= " series of VMs also have faster/newer CPUs than the original "Standard A" = series of VMs. I am using the image of FreeBSD from here: https://vmdepot.= msopentech.com/Vhd/Show?vhdId=3D56718&version=3D61117 . After setting up t= he VM it started rebooting every hour or so. Initially I thought this was = an Azure issue and Azure was forcibly rebooting the VM because it wasn't ge= tting health reports back. But I don't' believe this is the case anymore a= nd I think FreeBSD is crashing. (Note: I have setup a FreeBSD VM with a "S= tandard A" series VM and that seems to be running fine - though it looks li= ke it might have crashed after about 38 hours which is much better than cra= shing after 1 hour). Here is the "last" log from the last two days: [--redacted--] pts/2 [--redacted--] Fri Feb 5 21:10 still logged in [--redacted--] pts/1 [--redacted--] Fri Feb 5 21:10 still logged in [--redacted--] pts/0 [--redacted--] Fri Feb 5 20:58 - 21:10 (00:12) boot time Fri Feb 5 20:53 [--redacted--] pts/1 [--redacted--] Fri Feb 5 04:59 - crash (15:54) [--redacted--] pts/0 [--redacted--] Fri Feb 5 04:59 - 04:59 (00:00) boot time Fri Feb 5 04:41 boot time Fri Feb 5 02:16 [--redacted--] pts/1 [--redacted--] Fri Feb 5 00:36 - crash (01:40) [--redacted--] pts/0 [--redacted--] Fri Feb 5 00:36 - 00:36 (00:00) boot time Fri Feb 5 00:29 shutdown time Thu Feb 4 09:33 boot time Thu Feb 4 08:47 [--redacted--] pts/0 [--redacted--] Thu Feb 4 07:25 - crash (01:21) boot time Thu Feb 4 07:00 boot time Thu Feb 4 05:03 boot time Thu Feb 4 02:45 [--redacted--] pts/0 [--redacted--] Thu Feb 4 01:08 - crash (01:36) boot time Thu Feb 4 00:58 There are boot times without previous shutdown times - and there is that "c= rash" text (which is why I'm thinking it is a crash). I added this to /etc/rc.conf: dumpdev=3D"AUTO" dumpdir=3D"/var/crash" Here is the info on the swapfile: sudo swapinfo -h Device 512-blocks Used Avail Capacity /dev/gpt/swapfs 2097152 0B 1.0G 0% Server has 3.5 GB of RAM. Here is the boot log after a crash (says there are no core dumps found... a= ny way to figure out why it is not dumping the core?): -=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|= =08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08= \=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/= =08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08[H[J-=08= \=08|=08/=08-=08\=08 [7;46H ``` `[8;46Hs` `.....---.= ......--.``` -/[9;46H+o .--` /y:` +.[10;46H yo`:. = :o `+-[11;46H y/ -/` -o/[12;46H .- = ::/sy+:.[13;46H / `-- /[14;46H`: = :`[15;46H`: :`[16;46H / = /[17;46H .- -.[18;46H -- = -.[19;46H `:` `:`[20;46H .-- `--.[21;46H= .---.....----.|=08/=08-=08\=08 [1;2H ______ ____ __= ___ _____ [2;2H| ____| | _ \ / ____| __ \ [3;2H| |___ _ __ = ___ ___ | |_) | (___ | | | |[4;2H| ___| '__/ _ \/ _ \| _ < \___ \| | |= |[5;2H| | | | | __/ __/| |_) |____) | |__| |[6;2H| | | | | | |= | | | |[7;2H|_| |_| \___|\___||____/|_____/|_____/ [10;2H|= [11;2H|[12;2H|[13;2H|[14;2H|[15;2H|[16;2H|[17;2H|[18;2H|[19;2H|[20;2H|[21;2= H|[10;44H|[11;44H|[12;44H|[13;44H|[14;44H|[15;44H|[16;44H|[17;44H|[18;44H|[= 19;44H|[20;44H|[21;44H|[9;3H=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D[22;3H=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D[9;2H+[22;2H+[9;44= H+[22;44H+[25;0H|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08[9;= 15HWelcome to FreeBSD[11;5H1 [11;6H.[11;8HBoot Multi User [Enter][12;5H2 [1= 2;6H.[12;8HBoot [S]ingle User[13;5H3 [13;6H.[13;8H[Esc]ape to loader prompt= [14;5H4 [14;6H.[14;8HReboot[16;5HOptions:[17;5H5 [17;6H.[17;8H[K]ernel: ker= nel (1 of 2)[18;5H6 [18;6H.[18;8HConfigure Boot [O]ptions...[25;0H[23;4HAut= oboot in 9 seconds. [Space] to pause[25;0H[23;4HAutoboot in 8 seconds. [Spa= ce] to pause[25;0H[23;4HAutoboot in 7 seconds. [Space] to pause[25;0H[23;4H= Autoboot in 6 seconds. [Space] to pause[25;0H[23;4HAutoboot in 5 seconds. [= Space] to pause[25;0H[23;4HAutoboot in 4 seconds. [Space] to pause[25;0H[23= ;4HAutoboot in 3 seconds. [Space] to pause[25;0H[23;4HAutoboot in 2 seconds= . [Space] to pause[25;0H[23;4HAutoboot in 1 seconds. [Space] to pause[25;0H= [23;4H [25;0H-=08\=08|=08/=08-=08\=08= |=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-= =08\=08|=08/=08/boot/kernel/kernel text=3D0xfc8de8 -=08\=08|=08/=08-=08\=08= |=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-= =08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08= /=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\= =08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08= -=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|= =08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08= \=08|=08/=08-=08\=08|=08/=08-=08\=08|=08data=3D0x1283b0+0x207880 /=08-=08\= =08|=08/=08-=08\=08|=08/=08-=08syms=3D[0x8+0x145350\=08|=08/=08-=08\=08|=08= /=08-=08\=08|=08+0x8+0x15fe20/=08-=08\=08|=08/=08-=08\=08|=08/=08-=08\=08] Booting... |=08/=08-=08\=08|=08/=08Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015 root at releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 CPU: Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz (1109.29-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x206d7 Family=3D0x6 Model=3D0x2d Steppi= ng=3D7 Features=3D0xf83fbff Features2=3D0x9e982203 AMD Features=3D0x20100800 AMD Features2=3D0x1 XSAVE Features=3D0x1 Hypervisor: Origin =3D "Microsoft Hv" real memory =3D 3758096384 (3584 MB) avail memory =3D 3515142144 (3352 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: random device not loaded; using insecure entropy ioapic0: Changing APIC ID to 0 ioapic0 irqs 0-23 on motherboard random: initialized kbd1 at kbdmux0 vmbus0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 7.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177= ,0x376,0xffa0-0xffaf at device 7.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 pci0: at device 7.3 (no driver attached) vgapci0: mem 0xf8000000-0xfbffffff irq 11 at devic= e 8.0 on pci0 vgapci0: Boot video device atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (115200,n,8,1) uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on= acpi0 fd0: <1440-KB 3.5" drive> on fdc0 drive 0 orm0: at iomem 0xc0000-0xcbfff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ppc0: cannot reserve I/O port range Timecounters tick every 1.000 msec random: unblocking device. Timecounter "TSC" frequency 1109287570 Hz quality 800 Timecounter "Hyper-V" frequency 10000000 Hz quality 10000000 storvsc0 on vmbus0 storvsc1 on vmbus0 hyperv-utils0 on vmbus0 hyperv-utils0: Hyper-V Service attaching: Hyper-V Heartbeat Service hyperv-utils1 on vmbus0 hyperv-utils1: Hyper-V Service attaching: Hyper-V KVP Service da0 at blkvsc0 bus 0 scbus1 target 0 lun 0 hyperv-utils2 on vmbus0 hyperv-utils2: Hyper-V Service attaching: Hyper-V Shutdown Service da0: Fixed Direct Access SPC-2 SCSI device hyperv-utils3 on vmbus0 hyperv-utils3: Hyper-V Service attaching: Hyper-V Time Synch Service da0: 300.000MB/s transfers hn0: on vmbus0 da0: Command Queueing enabled da0: 21505MB (44042240 512 byte sectors: 255H 63S/T 2741C) da1 at blkvsc1 bus 0 scbus2 target 1 lun 0 da1: Fixed Direct Access SPC-2 SCSI device da1: 300.000MB/s transfershn0: unknown status 1073872902 received hn0: unknown status 1073872902 received hn0: hv send offload request succeeded da1: Command Queueing enabled hn0: Using defaults for TSO: 65518/35/2048 hn0: Ethernet address: 00:0d:3a:31:0d:fc storvsc2 on vmbus0 da1: 7168MB (14680064 512 byte sectors: 255H 63S/T 913C) storvsc3 on vmbus0 Trying to mount root from ufs:/dev/gpt/rootfs [rw]... WARNING: / was not properly dismounted Setting hostuuid: 253d30c5-d221-8548-b887-f87baa231b2d. Setting hostid: 0xd995724c. Entropy harvesting: interrupts ethernet point_to_point swi. Starting file system checks: ** SU+J Recovering /dev/gpt/rootfs ** Reading 33554432 byte journal from inode 8. ** Biilding recovery table. ** Resolving unreferenced inode list. ** Processing journal entries. ** 1 journal records in 512 bytes for 6.25% utilization ** Freed 1 inodes (0 dirs) 0 blocks, and 0 frags. ***** FILE SYSTEM MARKED CLEAN ***** Mounting local file systems:. Writing entropy file:. Setting hostname: [--redacted--] hn0: link state changed to UP Starting dhclient. DHCPDISCOVER on hn0 to 255.255.255.255 port 67 interval 7 DHCPOFFER from 168.63.129.16 unknown dhcp option value 0xf5 DHCPREQUEST on hn0 to 255.255.255.255 port 67 DHCPACK from 168.63.129.16 unknown dhcp option value 0xf5 bound to 10.0.2.5 -- renewal in -1 seconds. Starting Network: lo0 hn0. lo0: flags=3D8049 metric 0 mtu 16384 options=3D600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 inet 127.0.0.1 netmask 0xff000000 nd6 options=3D21 hn0: flags=3D8843 metric 0 mtu 1500 options=3D31b ether 00:0d:3a:31:0d:fc inet 10.0.2.5 netmask 0xffffff00 broadcast 10.0.2.255 nd6 options=3D29 Starting devd. add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Clearing /tmp (X related). Updating motd:. Mounting late file systems:. Performing sanity check on sshd configuration. Any help would be appreciated! Scott Otis CTO & Co-Founder Tandem www.tandemcal.com From owner-freebsd-stable@freebsd.org Fri Feb 12 09:06:02 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 10A27AA568B for ; Fri, 12 Feb 2016 09:06:02 +0000 (UTC) (envelope-from freebsd@lidstrom.eu) Received: from ch-p-mailout01.sth.basefarm.net (ch-p-owweb-vips.sth.basefarm.net [164.40.177.54]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C0CA310F0 for ; Fri, 12 Feb 2016 09:06:01 +0000 (UTC) (envelope-from freebsd@lidstrom.eu) Received: from c83-251-49-235.bredband.comhem.se ([83.251.49.235]:57684 helo=zimbra01.henriklidstrom.se) by ch-p-mailout01.sth.basefarm.net with esmtps (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.84) (envelope-from ) id 1aU9cr-000DNO-3i for freebsd-stable@freebsd.org; Fri, 12 Feb 2016 10:04:07 +0100 Received: from localhost (localhost [127.0.0.1]) by zimbra01.henriklidstrom.se (Postfix) with ESMTP id 4DCD5120524 for ; Fri, 12 Feb 2016 10:02:52 +0100 (CET) Received: from zimbra01.henriklidstrom.se ([127.0.0.1]) by localhost (zimbra01.henriklidstrom.se [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id eYGIAkI8dUJa for ; Fri, 12 Feb 2016 10:02:50 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by zimbra01.henriklidstrom.se (Postfix) with ESMTP id C42A3120522 for ; Fri, 12 Feb 2016 10:02:50 +0100 (CET) X-Virus-Scanned: amavisd-new at zimbra01.henriklidstrom.se Received: from zimbra01.henriklidstrom.se ([127.0.0.1]) by localhost (zimbra01.henriklidstrom.se [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id h9jd8-DYB3hQ for ; Fri, 12 Feb 2016 10:02:50 +0100 (CET) Received: from [192.168.226.114] (unknown [83.255.229.1]) by zimbra01.henriklidstrom.se (Postfix) with ESMTPSA id 97A39120248 for ; Fri, 12 Feb 2016 10:02:50 +0100 (CET) Subject: Re: 10-STABLE hangups frequently To: freebsd-stable@freebsd.org References: <20160202200738.GA78969@server.rulingia.com> <56B761A4.7010901@restart.be> From: =?UTF-8?Q?Henrik_Lidstr=c3=b6m?= Message-ID: <56BD9FBA.3040002@lidstrom.eu> Date: Fri, 12 Feb 2016 10:02:50 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.5.0 MIME-Version: 1.0 In-Reply-To: <56B761A4.7010901@restart.be> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: 83.251.49.235 X-Scan-Result: No virus found in message 1aU9cr-000DNO-3i. X-Scan-Signature: ch-p-mailout01.sth.basefarm.net 1aU9cr-000DNO-3i 431885181e1c9b267b6f7a7d64c620cc X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Feb 2016 09:06:02 -0000 On 02/07/16 16:24, Henri Hennebert wrote: > On 02/03/2016 02:03, Hajimu UMEMOTO wrote: >> Hi, >> >>>>>>> On Wed, 3 Feb 2016 07:07:38 +1100 >>>>>>> Peter Jeremy said: >> peter> As others have said, you need to provide lots more detail on your >> peter> configuration. >> >> CPU: AMD Athlon(tm) 64 Processor 3500+ >> Memory: 4GB >> HDD: 3TB >> >> I'm using ZFS only setup. >> >> peter> There were no problems at r290231 but after I upgraded to r295005, I >> peter> started seeing "out of swap" errors and hangs during the periodic >> peter> daily runs. I'm not seeing this on 1GB instances - though they are >> peter> all running UFS. >> >> r292875 runs well: >> >> FreeBSD asuka.mahoroba.org 10.2-STABLEFreeBSD 10.2-STABLE #5 r292875: Tue Feb 2 07:08:29 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd6 >> >> r292895 hangs: >> >> FreeBSD asuka.mahoroba.org 10.2-STABLE FreeBSD 10.2-STABLE #6 r292895: Tue Feb 2 10:17:28 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd64 >> >> I tried latest stable (r295137) with the sys/kern/vfs_subr.c part of >> r292895 reverted, and it seems running well, here: >> >> FreeBSD asuka.mahoroba.org 10.3-PRERELEASE FreeBSD 10.3-PRERELEASE #0 r295137M: Tue Feb 2 20:39:11 JST 2016 root@asuka.mahoroba.org:/usr/obj/usr/src/sys/ASUKA amd64 >> >> peter> Some experimentation suggested that just "find /" was enough to wedge >> peter> my system. I did some experimenting and found that the following >> peter> loader config was enough to prevent it hanging: >> peter> vfs.zfs.arc_max="128M" >> peter> vfs.zfs.arc_meta_limit="50M" >> peter> vfs.zfs.arc_min="25M" >> peter> (previously, I had no ZFS tuning at all). >> >> I had ZFS tuning before. However, after this problem was occur, I >> removed all of ZFS tuning. >> The FS related setting is only kern.maxvnodes=400000, now. >> >> Sincerely, >> >> -- >> Hajimu UMEMOTO >> ume@mahoroba.org ume@FreeBSD.org >> http://www.mahoroba.org/~ume/ > I encounter a hangup 3 times after I upgrade to > 10.3-PRERELEASE r295247M in a zfs configuration (i386 with 2GB memory) > while trying to run security/tripwire (compute checksum on all the files). > > With /usr/src/sys/kern/vfs_subr.c at revision 291757 all return to normal. > > Henri > > PS thanks Hajimu Thanks for the tip. Reverting vfs_subr.c to 291757 keeps things stable again. /Henrik From owner-freebsd-stable@freebsd.org Fri Feb 12 15:34:04 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 774D3AA67CD for ; Fri, 12 Feb 2016 15:34:04 +0000 (UTC) (envelope-from lausts@acm.org) Received: from cdptpa-oedge-vip.email.rr.com (cdptpa-outbound-snat.email.rr.com [107.14.166.232]) by mx1.freebsd.org (Postfix) with ESMTP id 4359B137D for ; Fri, 12 Feb 2016 15:34:03 +0000 (UTC) (envelope-from lausts@acm.org) Received: from [173.88.10.122] ([173.88.10.122:17495] helo=mail.laus.org) by cdptpa-oedge02 (envelope-from ) (ecelerity 3.5.0.35861 r(Momo-dev:tip)) with ESMTP id 60/43-12379-9AAFDB65; Fri, 12 Feb 2016 15:30:50 +0000 Received: from [192.168.1.100] (laust2 [192.168.1.100]) by mail.laus.org (8.15.2/8.15.2) with ESMTPS id u1CFUlut092101 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Fri, 12 Feb 2016 10:30:49 -0500 (EST) (envelope-from lausts@acm.org) X-Authentication-Warning: mail.laus.org: Host laust2 [192.168.1.100] claimed to be [192.168.1.100] From: "Thomas Laus" Organization: ABB To: freebsd-stable@freebsd.org Date: Fri, 12 Feb 2016 10:30:44 -0500 Subject: Is UEFI required for ZFS? Reply-to: lausts@acm.org Message-ID: <56BDFAA4.17139.1EEE35@lausts.acm.org> Priority: normal X-mailer: Pegasus Mail for Windows (4.70) X-RR-Connecting-IP: 107.14.168.130:25 X-Cloudmark-Score: 0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Feb 2016 15:34:04 -0000 I have a new Asus H170-Plus-D3 motherboard that will be used for a DOM0 Xen Server. It uses an Intel i5-6300 processor and a Samsung 840 EVO SSD. I would like to use ZFS on this new installation. The Xen Kernel does not have UEFI support at this time, so I installed FreeBSD CURRENT r295345 in 'legacy mode'. It takes about 7 minutes to go from the first '|' character to getting the 'beastie' menu. I changed the BIOS to UEFI and did another installation. The boot process goes in an instant. Thinking that it may be an issue with FreeBSD CURRENT, I installed FreeBSD 10.3 BETA 1 in both legacy and UEFI mode. The results were the same. BIOS Legacy mode with a default ZFS installation takes nearly 7 minutes to get the Beastie menu. An UEFI installation with ZFS is instantanious. A default GPT installation of both CURRENT and FreeBSD 10.3 BETA1, either legacy or UEFI, also gives an instant bootup. How can I dig deeper into my problem? I would like to use ZFS with my Xen Server. Tom -- Public Keys: PGP KeyID = 0x5F22FDC1 GnuPG KeyID = 0x620836CF From owner-freebsd-stable@freebsd.org Fri Feb 12 18:50:15 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90667AA7601 for ; Fri, 12 Feb 2016 18:50:15 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5650A10BE for ; Fri, 12 Feb 2016 18:50:14 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1aUIn7-0001eu-Js for freebsd-stable@freebsd.org; Fri, 12 Feb 2016 19:50:05 +0100 Received: from 114.165.187.81.in-addr.arpa ([81.187.165.114]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 12 Feb 2016 19:50:05 +0100 Received: from mnd999 by 114.165.187.81.in-addr.arpa with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 12 Feb 2016 19:50:05 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Mark Dixon Subject: Re: Is UEFI required for ZFS? Date: Fri, 12 Feb 2016 18:42:49 +0000 (UTC) Lines: 20 Message-ID: References: <56BDFAA4.17139.1EEE35@lausts.acm.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: sea.gmane.org User-Agent: Loom/3.14 (http://gmane.org/) X-Loom-IP: 81.187.165.114 (Mozilla/5.0 (X11; FreeBSD amd64; rv:44.0) Gecko/20100101 Firefox/44.0) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Feb 2016 18:50:15 -0000 Thomas Laus acm.org> writes: > > I have a new Asus H170-Plus-D3 motherboard that will be used for a DOM0 Xen > Server. It uses an Intel i5-6300 processor and a Samsung 840 EVO SSD. I > would like to use ZFS on this new installation. The Xen Kernel does not have > UEFI support at this time, so I installed FreeBSD CURRENT r295345 in 'legacy > mode'. It takes about 7 minutes to go from the first '|' character to > getting the 'beastie' menu. I changed the BIOS to UEFI and did another > installation. The boot process goes in an instant. Several others have the same problem. See here on the freebsd forums: http://tinyurl.com/z9oldkc (URL shortened cos I'm only allowed 80chars per line) Mark From owner-freebsd-stable@freebsd.org Fri Feb 12 18:56:59 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2AEC2AA7952 for ; Fri, 12 Feb 2016 18:56:59 +0000 (UTC) (envelope-from lists@opsec.eu) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E4C811877 for ; Fri, 12 Feb 2016 18:56:58 +0000 (UTC) (envelope-from lists@opsec.eu) Received: from pi by home.opsec.eu with local (Exim 4.86 (FreeBSD)) (envelope-from ) id 1aUItn-0007WM-Ek; Fri, 12 Feb 2016 19:56:59 +0100 Date: Fri, 12 Feb 2016 19:56:59 +0100 From: Kurt Jaeger To: Thomas Laus Cc: freebsd-stable@freebsd.org Subject: Re: Is UEFI required for ZFS? Message-ID: <20160212185659.GC26283@home.opsec.eu> References: <56BDFAA4.17139.1EEE35@lausts.acm.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <56BDFAA4.17139.1EEE35@lausts.acm.org> X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Feb 2016 18:56:59 -0000 Hi! > I have a new Asus H170-Plus-D3 motherboard that will be used for a DOM0 Xen > Server. It uses an Intel i5-6300 processor and a Samsung 840 EVO SSD. I > would like to use ZFS on this new installation. The Xen Kernel does not have > UEFI support at this time, so I installed FreeBSD CURRENT r295345 in 'legacy > mode'. It takes about 7 minutes to go from the first '|' character to > getting the 'beastie' menu. This is strange. To answer the question in the subject, no, UEFI is not required for ZFS. > How can I dig deeper into my problem? I would like to use ZFS with my Xen > Server. Can you put a dmesg.boot from the server ? An pciconf -lvb ? -- pi@opsec.eu +49 171 3101372 4 years to go ! From owner-freebsd-stable@freebsd.org Fri Feb 12 20:39:30 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E1731AA66E6 for ; Fri, 12 Feb 2016 20:39:30 +0000 (UTC) (envelope-from lausts@acm.org) Received: from cdptpa-oedge-vip.email.rr.com (cdptpa-outbound-snat.email.rr.com [107.14.166.228]) by mx1.freebsd.org (Postfix) with ESMTP id AC965134B for ; Fri, 12 Feb 2016 20:39:30 +0000 (UTC) (envelope-from lausts@acm.org) Received: from [173.88.10.122] ([173.88.10.122:46092] helo=mail.laus.org) by cdptpa-oedge02 (envelope-from ) (ecelerity 3.5.0.35861 r(Momo-dev:tip)) with ESMTP id 0F/81-12379-1424EB65; Fri, 12 Feb 2016 20:36:17 +0000 Received: from [192.168.1.100] (laust2 [192.168.1.100]) by mail.laus.org (8.15.2/8.15.2) with ESMTPS id u1CKaFjp092745 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Fri, 12 Feb 2016 15:36:16 -0500 (EST) (envelope-from lausts@acm.org) X-Authentication-Warning: mail.laus.org: Host laust2 [192.168.1.100] claimed to be [192.168.1.100] From: "Thomas Laus" Organization: ABB To: freebsd-stable@freebsd.org Date: Fri, 12 Feb 2016 15:36:10 -0500 Subject: UEFI & ZFS Reply-to: lausts@acm.org Message-ID: <56BE423A.12522.27C542@lausts.acm.org> Priority: normal X-mailer: Pegasus Mail for Windows (4.70) X-RR-Connecting-IP: 107.14.168.130:25 X-Cloudmark-Score: 0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Feb 2016 20:39:31 -0000 > I have a new Asus H170-Plus-D3 motherboard that will be used for a DOM0 Xen > Server. It uses an Intel i5-6300 processor and a Samsung 840 EVO SSD. I > would like to use ZFS on this new installation. The Xen Kernel does not > have UEFI support at this time, so I installed FreeBSD CURRENT r295345 in > 'legacy mode'. It takes about 7 minutes to go from the first '|' character > to getting the 'beastie' menu. I changed the BIOS to UEFI and did another > installation. The boot process goes in an instant. Several others have the same problem. See here on the freebsd forums: http://tinyurl.com/z9oldkc That is my exact problem. It takes 4 minutes to get a complete 'beastie' menu and 7 minutes 34 seconds to login. Tom -- Public Keys: PGP KeyID = 0x5F22FDC1 GnuPG KeyID = 0x620836CF From owner-freebsd-stable@freebsd.org Fri Feb 12 21:06:37 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3E03DAA7772 for ; Fri, 12 Feb 2016 21:06:37 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wm0-x22d.google.com (mail-wm0-x22d.google.com [IPv6:2a00:1450:400c:c09::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D522C173A for ; Fri, 12 Feb 2016 21:06:36 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-wm0-x22d.google.com with SMTP id c200so37804017wme.0 for ; Fri, 12 Feb 2016 13:06:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-type:content-transfer-encoding; bh=B/JObDXXtUznD+9rkBKgqn35D8kB6vsOB64ypDsQIR0=; b=N+eprVeDctVDxIxxxFw6J6XXp5OaHdaKxB1r867EWazKd4hJWAkMTiBJpsGDHxURO1 j117YdG2rPB1sH0xw4HlWVMKlQ1D4cSsBNPy9udxJBl+fVtw3Qfb576L4nXle7mKX2yF HSa87wR9NVI9atTq131DJC47F+1tDYatLsKbTjgBNxw6DalRBJmbC1ZVd/Rfv7WR521h xXq1I1L3wtrhy36jYkwbPlI9XVzWm2j+Ebg/Z7+ja8dg9yzdKdZWtt7DJa5iDFf9QcMM t3M/Ot3FM3PuNTMDRhttr59smi+R6EnA8g8CyI2VTjBFC/sXaXrRVYQ5CoHeWXSj4nYM 5geQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-type :content-transfer-encoding; bh=B/JObDXXtUznD+9rkBKgqn35D8kB6vsOB64ypDsQIR0=; b=cfPU9D/CC2dkdxPzXkKygEMrfJbnMyUOsIn7KynYKSHN6xFQUlG91SCuEYmX7boIHm Tx5O9ooe/OO4oAMMxJ5Gcq+IB9EvWqeOLGmD5pjT049yFKSiPTQnw8XPMYSH4jLKrEm8 voN9j6OoNMQSeozdZxYoZWP6J2J4UwD9bioBOCNNnAI43dNdrBw/UouZsQZaB16f4a0q Ji5K7Og6SZEdE0V9vblFWlK5udHiP0K5hQWEEWUIjnehKfcCfbz2g0hQWzHgZUgjPqHw lPP6sTVQssVBvcRW5O8jMgi8bKeseku+V01ZKnNwjvH/sUp2Oay2VeoRLEqogKYpIntp g3ng== X-Gm-Message-State: AG10YOR/eaXTfu9K1p92sO7bg947m7BldGE9krbglROVkOURVBlaT7T/7xiLgwLkvQaWETsv X-Received: by 10.194.187.240 with SMTP id fv16mr4395092wjc.53.1455311194993; Fri, 12 Feb 2016 13:06:34 -0800 (PST) Received: from [10.10.1.58] (liv3d.labs.multiplay.co.uk. [82.69.141.171]) by smtp.gmail.com with ESMTPSA id w62sm3963783wmg.21.2016.02.12.13.06.32 for (version=TLSv1/SSLv3 cipher=OTHER); Fri, 12 Feb 2016 13:06:32 -0800 (PST) Subject: Re: UEFI & ZFS To: freebsd-stable@freebsd.org References: <56BE423A.12522.27C542@lausts.acm.org> From: Steven Hartland Message-ID: <56BE495A.2070807@multiplay.co.uk> Date: Fri, 12 Feb 2016 21:06:34 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.5.1 MIME-Version: 1.0 In-Reply-To: <56BE423A.12522.27C542@lausts.acm.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Feb 2016 21:06:37 -0000 On 12/02/2016 20:36, Thomas Laus wrote: >> I have a new Asus H170-Plus-D3 motherboard that will be used for a DOM0 Xen >> Server. It uses an Intel i5-6300 processor and a Samsung 840 EVO SSD. I >> would like to use ZFS on this new installation. The Xen Kernel does not >> have UEFI support at this time, so I installed FreeBSD CURRENT r295345 in >> 'legacy mode'. It takes about 7 minutes to go from the first '|' character >> to getting the 'beastie' menu. I changed the BIOS to UEFI and did another >> installation. The boot process goes in an instant. > Several others have the same problem. See here on the freebsd forums: > > http://tinyurl.com/z9oldkc > > That is my exact problem. It takes 4 minutes to get a complete 'beastie' > menu and 7 minutes 34 seconds to login. > What sort of timings do you see if its a UFS install? Regards Steve From owner-freebsd-stable@freebsd.org Fri Feb 12 21:16:05 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 591D0AA7DC9 for ; Fri, 12 Feb 2016 21:16:05 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F31D02B2 for ; Fri, 12 Feb 2016 21:16:04 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1aUL4K-0006Kp-9Z for freebsd-stable@freebsd.org; Fri, 12 Feb 2016 22:16:00 +0100 Received: from 114.165.187.81.in-addr.arpa ([81.187.165.114]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 12 Feb 2016 22:16:00 +0100 Received: from mnd999 by 114.165.187.81.in-addr.arpa with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 12 Feb 2016 22:16:00 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Mark Dixon Subject: Re: Is UEFI required for ZFS? Date: Fri, 12 Feb 2016 21:15:49 +0000 (UTC) Lines: 547 Message-ID: References: <56BDFAA4.17139.1EEE35@lausts.acm.org> <20160212185659.GC26283@home.opsec.eu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: sea.gmane.org User-Agent: Loom/3.14 (http://gmane.org/) X-Loom-IP: 81.187.165.114 (Mozilla/5.0 (X11; FreeBSD amd64; rv:44.0) Gecko/20100101 Firefox/44.0) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Feb 2016 21:16:05 -0000 Kurt Jaeger opsec.eu> writes: > > Hi! > > > I have a new Asus H170-Plus-D3 motherboard that will be used for a DOM0 Xen > > Server. It uses an Intel i5-6300 processor and a Samsung 840 EVO SSD. I > > would like to use ZFS on this new installation. The Xen Kernel does not have > > UEFI support at this time, so I installed FreeBSD CURRENT r295345 in 'legacy > > mode'. It takes about 7 minutes to go from the first '|' character to > > getting the 'beastie' menu. > > This is strange. To answer the question in the subject, no, UEFI is > not required for ZFS. > > > How can I dig deeper into my problem? I would like to use ZFS with my Xen > > Server. > > Can you put a dmesg.boot from the server ? An pciconf -lvb ? > I have the exact same issue on the forum, so I can: Dmesg: Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.3-BETA1 #0 r295289: Fri Feb 5 01:23:50 UTC 2016 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 VT(vga): resolution 640x480 CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz (4008.20-MHz K8-class CPU) Origin="GenuineIntel" Id=0x506e3 Family=0x6 Model=0x5e Stepping=3 Features=0xbfebfbff Features2=0x7ffafbbf AMD Features=0x2c100800 AMD Features2=0x121 Structured Extended Features=0x29c6fbf XSAVE Features=0xf VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 66582614016 (63498 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 random device not loaded; using insecure entropy ioapic0 irqs 0-119 on motherboard module_register_init: MOD_LOAD (vesa, 0xffffffff80dc6bc0, 0) error 19 kbd1 at kbdmux0 random: initialized acpi0: on motherboard ACPI Error: [\134_SB_.PCI0.XHC_.RHUB.HS11] Namespace lookup failure, AE_NOT_FOUND (20150515/dswload-219) ACPI Exception: AE_NOT_FOUND, During name lookup/catalog (20150515/psobject-233) acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 24000000 Hz quality 950 Event timer "HPET" frequency 24000000 Hz quality 550 atrtc0: port 0x70-0x77 irq 8 on acpi0 atrtc0: Warning: Couldn't map I/O. Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0 acpi_ec0: port 0x62,0x66 on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 16 at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xe000-0xe07f mem 0xde000000-0xdeffffff,0xc0000000-0xcfffffff,0xd0000000-0xd1ffffff irq 16 at device 0.0 on pci1 nvidia0: on vgapci0 vgapci0: child nvidia0 requested pci_enable_io vgapci0: child nvidia0 requested pci_enable_io vgapci0: Boot video device hdac0: mem 0xdf080000-0xdf083fff irq 17 at device 0.1 on pci1 xhci0: mem 0xdfb30000-0xdfb3ffff irq 16 at device 20.0 on pci0 xhci0: 32 bytes context size, 64-bit DMA usbus0: waiting for BIOS to give up control usbus0 on xhci0 pci0: at device 22.0 (no driver attached) ahci0: port 0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xdfb48000-0xdfb49fff,0xdfb4c000-0xdfb4c0ff,0xdfb4b000-0xdfb4b7ff irq 23 at device 23.0 on pci0 ahci0: AHCI v1.31 with 6 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahcich5: at channel 5 on ahci0 ahciem0: on ahci0 pcib2: irq 16 at device 27.0 on pci0 pci2: on pcib2 pcib3: irq 16 at device 28.0 on pci0 pci3: on pcib3 xhci1: mem 0xdfa00000-0xdfa07fff irq 16 at device 0.0 on pci3 xhci1: 32 bytes context size, 64-bit DMA usbus1: waiting for BIOS to give up control usbus1 on xhci1 pcib4: irq 18 at device 28.2 on pci0 pci4: on pcib4 pcib5: irq 18 at device 0.0 on pci4 pci5: on pcib5 pcib6: irq 19 at device 1.0 on pci5 pci6: on pcib6 pcib7: irq 16 at device 2.0 on pci5 pci7: on pcib7 pci7: at device 0.0 (no driver attached) pcib8: irq 17 at device 3.0 on pci5 pci8: on pcib8 ahci1: port 0xd050-0xd057,0xd040-0xd043,0xd030-0xd037,0xd020-0xd023,0xd000-0xd01f mem 0xdf700000-0xdf7001ff irq 17 at device 0.0 on pci8 ahci1: AHCI v1.20 with 2 6Gbps ports, Port Multiplier supported ahcich6: at channel 0 on ahci1 ahcich7: at channel 1 on ahci1 pcib9: irq 18 at device 4.0 on pci5 pci9: on pcib9 pcib10: irq 19 at device 5.0 on pci5 pci10: on pcib10 pcib11: irq 16 at device 6.0 on pci5 pci11: on pcib11 igb0: port 0xc000-0xc01f mem 0xdf600000-0xdf61ffff,0xdf620000-0xdf623fff irq 16 at device 0.0 on pci11 igb0: Using MSIX interrupts with 3 vectors igb0: Ethernet address: 9c:5c:8e:71:89:0b igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 pcib12: irq 17 at device 7.0 on pci5 pci12: on pcib12 pcib13: irq 16 at device 28.4 on pci0 pci13: on pcib13 xhci2: mem 0xdf900000-0xdf907fff irq 16 at device 0.0 on pci13 xhci2: 32 bytes context size, 64-bit DMA usbus2: waiting for BIOS to give up control usbus2 on xhci2 pcib14: irq 18 at device 28.6 on pci0 pci14: on pcib14 xhci3: mem 0xdf800000-0xdf807fff irq 18 at device 0.0 on pci14 xhci3: 32 bytes context size, 64-bit DMA usbus3: waiting for BIOS to give up control usbus3 on xhci3 pcib15: irq 16 at device 29.0 on pci0 pci15: on pcib15 isab0: at device 31.0 on pci0 isa0: on isab0 pci0: at device 31.2 (no driver attached) hdac1: mem 0xdfb40000-0xdfb43fff,0xdfb20000-0xdfb2ffff irq 16 at device 31.3 on pci0 pci0: at device 31.6 (no driver attached) acpi_button0: on acpi0 acpi_button1: on acpi0 acpi_tz0: on acpi0 acpi_tz1: on acpi0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: cannot reserve I/O port range coretemp0: on cpu0 est0: on cpu0 coretemp1: on cpu1 est1: on cpu1 coretemp2: on cpu2 est2: on cpu2 coretemp3: on cpu3 est3: on cpu3 coretemp4: on cpu4 est4: on cpu4 coretemp5: on cpu5 est5: on cpu5 coretemp6: on cpu6 est6: on cpu6 coretemp7: on cpu7 est7: on cpu7 random: unblocking device. usbus0: 5.0Gbps Super Speed USB v3.0 fuse-freebsd: version 0.4.4, FUSE ABI 7.8 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec vboxdrv: fAsync=0 offMin=0x323 offMax=0x57b hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 pcm0: at nid 4 on hdaa0 pcm1: at nid 5 on hdaa0 pcm2: at nid 6 on hdaa0 pcm3: at nid 7 on hdaa0 hdacc1: at cad 0 on hdac1 hdaa1: at nid 1 on hdacc1 pcm4: at nid 20,22,21,23 and 24,26 on hdaa1 pcm5: at nid 27 and 25 on hdaa1 pcm6: at nid 17 on hdaa1 pcm7: at nid 30 on hdaa1 usbus1: 5.0Gbps Super Speed USB v3.0 usbus2: 5.0Gbps Super Speed USB v3.0 usbus3: 5.0Gbps Super Speed USB v3.0 ugen0.1: <0x8086> at usbus0 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen1.1: <0x1b21> at usbus1 uhub1: <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1 ugen2.1: <0x1b21> at usbus2 uhub2: <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2 ugen3.1: <0x1b21> at usbus3 uhub3: <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus3 uhub1: 4 ports with 4 removable, self powered uhub2: 4 ports with 4 removable, self powered uhub3: 4 ports with 4 removable, self powered ada0 at ahcich3 bus 0 scbus3 target 0 lun 0 ada0: ATA8-ACS SATA 2.x device ada0: Serial Number WD-WMASU0754532 ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors) ada0: Previously was known as ad10 ada1 at ahcich4 bus 0 scbus4 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number Z1X3S5XD ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 1907729MB (3907029168 512 byte sectors) ada1: Previously was known as ad12 ada2 at ahcich5 bus 0 scbus5 target 0 lun 0 ada2: ATA8-ACS SATA 2.x device ada2: Serial Number GEA530RE1L82SA ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 476940MB (976773168 512 byte sectors) ada2: Previously was known as ad14 ada3 at ahcich6 bus 0 scbus7 target 0 lun 0 ada3: ACS-2 ATA SATA 3.x device ada3: Serial Number S1SMNSAFC21908L ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada3: Command Queueing enabled ada3: 122104MB (250069680 512 byte sectors) ada3: quirks=0x1<4K> ada3: Previously was known as ad16 ada4 at ahcich7 bus 0 scbus8 target 0 lun 0 ada4: ACS-2 ATA SATA 3.x device ada4: Serial Number W1H1K74S ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada4: Command Queueing enabled ada4: 1907729MB (3907029168 512 byte sectors) ada4: Previously was known as ad18 ses0 at ahciem0 bus 0 scbus6 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device cd0 at ahcich2 bus 0 scbus2 target 0 lun 0 cd0: Removable CD-ROM SCSI device cd0: Serial Number R8BZ68DB840995 cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed SMP: AP CPU #1 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #5 Launched! Timecounter "TSC-low" frequency 2004099175 Hz quality 1000 ugen3.2: at usbus3 ukbd0: on usbus3 kbd2 at ukbd0 uhub0: 26 ports with 26 removable, self powered Root mount waiting for: usbus3 usbus0 ugen3.3: at usbus3 uhub4: on usbus3 ugen0.2: at usbus0 uhub4: 2 ports with 2 removable, self powered Trying to mount root from zfs:zroot2 []... uhid0: on usbus3 igb0: link state changed to UP WARNING: attempt to domain_add(bluetooth) after domainfinalize() ugen0.3: at usbus0 uhub5: on usbus0 uhub5: MTT enabled uhub5: 4 ports with 4 removable, self powered ugen0.4: at usbus0 ums0: on usbus0 ums0: 5 buttons and [XYZT] coordinates ID=26 pciconf; hostb0@pci0:0:0:0: class=0x060000 card=0x86941043 chip=0x191f8086 rev=0x07 hdr=0x00 vendor = 'Intel Corporation' device = 'Sky Lake Host Bridge/DRAM Registers' class = bridge subclass = HOST-PCI pcib1@pci0:0:1:0: class=0x060400 card=0x86941043 chip=0x19018086 rev=0x07 hdr=0x01 vendor = 'Intel Corporation' device = 'Sky Lake PCIe Controller (x16)' class = bridge subclass = PCI-PCI xhci0@pci0:0:20:0: class=0x0c0330 card=0x86941043 chip=0xa12f8086 rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H USB 3.0 xHCI Controller' class = serial bus subclass = USB bar [10] = type Memory, range 64, base 0xdfb30000, size 65536, enabled none0@pci0:0:22:0: class=0x078000 card=0x86941043 chip=0xa13a8086 rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H CSME HECI' class = simple comms bar [10] = type Memory, range 64, base 0xdfb4d000, size 4096, enabled ahci0@pci0:0:23:0: class=0x010601 card=0x86941043 chip=0xa1028086 rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H SATA controller [AHCI mode]' class = mass storage subclass = SATA bar [10] = type Memory, range 32, base 0xdfb48000, size 8192, enabled bar [14] = type Memory, range 32, base 0xdfb4c000, size 256, enabled bar [18] = type I/O Port, range 32, base 0xf050, size 8, enabled bar [1c] = type I/O Port, range 32, base 0xf040, size 4, enabled bar [20] = type I/O Port, range 32, base 0xf020, size 32, enabled bar [24] = type Memory, range 32, base 0xdfb4b000, size 2048, enabled pcib2@pci0:0:27:0: class=0x060400 card=0x86941043 chip=0xa1678086 rev=0xf1 hdr=0x01 vendor = 'Intel Corporation' device = 'Sunrise Point-H PCI Root Port' class = bridge subclass = PCI-PCI pcib3@pci0:0:28:0: class=0x060400 card=0x86941043 chip=0xa1108086 rev=0xf1 hdr=0x01 vendor = 'Intel Corporation' device = 'Sunrise Point-H PCI Express Root Port' class = bridge subclass = PCI-PCI pcib4@pci0:0:28:2: class=0x060400 card=0x86941043 chip=0xa1128086 rev=0xf1 hdr=0x01 vendor = 'Intel Corporation' device = 'Sunrise Point-H PCI Express Root Port' class = bridge subclass = PCI-PCI pcib13@pci0:0:28:4: class=0x060400 card=0x86941043 chip=0xa1148086 rev=0xf1 hdr=0x01 vendor = 'Intel Corporation' device = 'Sunrise Point-H PCI Express Root Port' class = bridge subclass = PCI-PCI pcib14@pci0:0:28:6: class=0x060400 card=0x86941043 chip=0xa1168086 rev=0xf1 hdr=0x01 vendor = 'Intel Corporation' device = 'Sunrise Point-H PCI Express Root Port' class = bridge subclass = PCI-PCI pcib15@pci0:0:29:0: class=0x060400 card=0x86941043 chip=0xa1188086 rev=0xf1 hdr=0x01 vendor = 'Intel Corporation' device = 'Sunrise Point-H PCI Express Root Port' class = bridge subclass = PCI-PCI isab0@pci0:0:31:0: class=0x060100 card=0x86941043 chip=0xa1458086 rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H LPC Controller' class = bridge subclass = PCI-ISA none1@pci0:0:31:2: class=0x058000 card=0x86941043 chip=0xa1218086 rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H PMC' class = memory bar [10] = type Memory, range 32, base 0xdfb44000, size 16384, enabled hdac1@pci0:0:31:3: class=0x040300 card=0x868f1043 chip=0xa1708086 rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H HD Audio' class = multimedia subclass = HDA bar [10] = type Memory, range 64, base 0xdfb40000, size 16384, enabled bar [20] = type Memory, range 64, base 0xdfb20000, size 65536, enabled none2@pci0:0:31:4: class=0x0c0500 card=0x86941043 chip=0xa1238086 rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H SMBus' class = serial bus subclass = SMBus bar [10] = type Memory, range 64, base 0xdfb4a000, size 256, enabled bar [20] = type I/O Port, range 32, base 0xf000, size 32, enabled none3@pci0:0:31:6: class=0x020000 card=0x86721043 chip=0x15b88086 rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Ethernet Connection (2) I219-V' class = network subclass = ethernet bar [10] = type Memory, range 32, base 0xdfb00000, size 131072, enabled vgapci0@pci0:1:0:0: class=0x030000 card=0x85081043 chip=0x13c210de rev=0xa1 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'GM204 [GeForce GTX 970]' class = display subclass = VGA bar [10] = type Memory, range 32, base 0xde000000, size 16777216, enabled bar [14] = type Prefetchable Memory, range 64, base 0xc0000000, size 268435456, enabled bar [1c] = type Prefetchable Memory, range 64, base 0xd0000000, size 33554432, enabled bar [24] = type I/O Port, range 32, base 0xe000, size 128, enabled hdac0@pci0:1:0:1: class=0x040300 card=0x85081043 chip=0x0fbb10de rev=0xa1 hdr=0x00 vendor = 'NVIDIA Corporation' device = 'GM204 High Definition Audio Controller' class = multimedia subclass = HDA bar [10] = type Memory, range 32, base 0xdf080000, size 16384, enabled xhci1@pci0:3:0:0: class=0x0c0330 card=0x86751043 chip=0x12421b21 rev=0x00 hdr=0x00 vendor = 'ASMedia Technology Inc.' device = 'ASM1142 USB 3.1 Host Controller' class = serial bus subclass = USB bar [10] = type Memory, range 64, base 0xdfa00000, size 32768, enabled pcib5@pci0:4:0:0: class=0x060400 card=0x118f1b21 chip=0x11871b21 rev=0x00 hdr=0x01 vendor = 'ASMedia Technology Inc.' class = bridge subclass = PCI-PCI pcib6@pci0:5:1:0: class=0x060400 card=0x118f1b21 chip=0x11871b21 rev=0x00 hdr=0x01 vendor = 'ASMedia Technology Inc.' class = bridge subclass = PCI-PCI pcib7@pci0:5:2:0: class=0x060400 card=0x118f1b21 chip=0x11871b21 rev=0x00 hdr=0x01 vendor = 'ASMedia Technology Inc.' class = bridge subclass = PCI-PCI pcib8@pci0:5:3:0: class=0x060400 card=0x118f1b21 chip=0x11871b21 rev=0x00 hdr=0x01 vendor = 'ASMedia Technology Inc.' class = bridge subclass = PCI-PCI pcib9@pci0:5:4:0: class=0x060400 card=0x118f1b21 chip=0x11871b21 rev=0x00 hdr=0x01 vendor = 'ASMedia Technology Inc.' class = bridge subclass = PCI-PCI pcib10@pci0:5:5:0: class=0x060400 card=0x118f1b21 chip=0x11871b21 rev=0x00 hdr=0x01 vendor = 'ASMedia Technology Inc.' class = bridge subclass = PCI-PCI pcib11@pci0:5:6:0: class=0x060400 card=0x118f1b21 chip=0x11871b21 rev=0x00 hdr=0x01 vendor = 'ASMedia Technology Inc.' class = bridge subclass = PCI-PCI pcib12@pci0:5:7:0: class=0x060400 card=0x118f1b21 chip=0x11871b21 rev=0x00 hdr=0x01 vendor = 'ASMedia Technology Inc.' class = bridge subclass = PCI-PCI none4@pci0:7:0:0: class=0x028000 card=0x86591043 chip=0x43a014e4 rev=0x03 hdr=0x00 vendor = 'Broadcom Corporation' device = 'BCM4360 802.11ac Wireless Network Adapter' class = network bar [10] = type Memory, range 64, base 0xdf400000, size 32768, enabled bar [18] = type Memory, range 64, base 0xdf200000, size 2097152, enabled ahci1@pci0:8:0:0: class=0x010601 card=0x858d1043 chip=0x06121b21 rev=0x02 hdr=0x00 vendor = 'ASMedia Technology Inc.' device = 'ASM1062 Serial ATA Controller' class = mass storage subclass = SATA bar [10] = type I/O Port, range 32, base 0xd050, size 8, enabled bar [14] = type I/O Port, range 32, base 0xd040, size 4, enabled bar [18] = type I/O Port, range 32, base 0xd030, size 8, enabled bar [1c] = type I/O Port, range 32, base 0xd020, size 4, enabled bar [20] = type I/O Port, range 32, base 0xd000, size 32, enabled bar [24] = type Memory, range 32, base 0xdf700000, size 512, enabled igb0@pci0:11:0:0: class=0x020000 card=0x85f01043 chip=0x15398086 rev=0x03 hdr=0x00 vendor = 'Intel Corporation' device = 'I211 Gigabit Network Connection' class = network subclass = ethernet bar [10] = type Memory, range 32, base 0xdf600000, size 131072, enabled bar [18] = type I/O Port, range 32, base 0xc000, size 32, enabled bar [1c] = type Memory, range 32, base 0xdf620000, size 16384, enabled xhci2@pci0:13:0:0: class=0x0c0330 card=0x86751043 chip=0x12421b21 rev=0x00 hdr=0x00 vendor = 'ASMedia Technology Inc.' device = 'ASM1142 USB 3.1 Host Controller' class = serial bus subclass = USB bar [10] = type Memory, range 64, base 0xdf900000, size 32768, enabled xhci3@pci0:14:0:0: class=0x0c0330 card=0x86751043 chip=0x12421b21 rev=0x00 hdr=0x00 vendor = 'ASMedia Technology Inc.' device = 'ASM1142 USB 3.1 Host Controller' class = serial bus subclass = USB bar [10] = type Memory, range 64, base 0xdf800000, size 32768, enabled From owner-freebsd-stable@freebsd.org Sat Feb 13 10:09:43 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 39C9AAA7B05 for ; Sat, 13 Feb 2016 10:09:43 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5DB2D1FF1 for ; Sat, 13 Feb 2016 10:09:42 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id u1DA9a98024182 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Sat, 13 Feb 2016 12:09:36 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua u1DA9a98024182 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id u1DA9aIO024161; Sat, 13 Feb 2016 12:09:36 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 13 Feb 2016 12:09:36 +0200 From: Konstantin Belousov To: Mark Dixon Cc: freebsd-stable@freebsd.org Subject: Re: Is UEFI required for ZFS? Message-ID: <20160213100936.GY91220@kib.kiev.ua> References: <56BDFAA4.17139.1EEE35@lausts.acm.org> <20160212185659.GC26283@home.opsec.eu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on tom.home X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Feb 2016 10:09:43 -0000 On Fri, Feb 12, 2016 at 09:15:49PM +0000, Mark Dixon wrote: > > Can you put a dmesg.boot from the server ? An pciconf -lvb ? > > > > I have the exact same issue on the forum, so I can: As a blind shot, try to lower the CPU frequency in the BIOS, to 3 or even to 2 Ghz. If you can try a dos (real dos from MS) on usb stick and see if it works it could be also telling. Also, could you obtain verbose dmesg ? From owner-freebsd-stable@freebsd.org Sat Feb 13 15:46:33 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0BABDAA06EC for ; Sat, 13 Feb 2016 15:46:33 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from plane.gmane.org (plane.gmane.org [80.91.229.3]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8195B11A3 for ; Sat, 13 Feb 2016 15:46:32 +0000 (UTC) (envelope-from freebsd-stable@m.gmane.org) Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1aUcOy-0001s3-Le for freebsd-stable@freebsd.org; Sat, 13 Feb 2016 16:46:28 +0100 Received: from 114.165.187.81.in-addr.arpa ([81.187.165.114]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sat, 13 Feb 2016 16:46:28 +0100 Received: from mnd999 by 114.165.187.81.in-addr.arpa with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sat, 13 Feb 2016 16:46:28 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-stable@freebsd.org From: Mark Dixon Subject: Re: Is UEFI required for ZFS? Date: Sat, 13 Feb 2016 15:46:16 +0000 (UTC) Lines: 1814 Message-ID: References: <56BDFAA4.17139.1EEE35@lausts.acm.org> <20160212185659.GC26283@home.opsec.eu> <20160213100936.GY91220@kib.kiev.ua> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: sea.gmane.org User-Agent: Loom/3.14 (http://gmane.org/) X-Loom-IP: 81.187.165.114 (Mozilla/5.0 (X11; FreeBSD amd64; rv:44.0) Gecko/20100101 Firefox/44.0) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Feb 2016 15:46:33 -0000 Konstantin Belousov gmail.com> writes: > > On Fri, Feb 12, 2016 at 09:15:49PM +0000, Mark Dixon wrote: > > > Can you put a dmesg.boot from the server ? An pciconf -lvb ? > > > > > > > I have the exact same issue on the forum, so I can: > As a blind shot, try to lower the CPU frequency in the BIOS, to 3 or even > to 2 Ghz. If you can try a dos (real dos from MS) on usb stick and see > if it works it could be also telling. > > Also, could you obtain verbose dmesg ? I don't think I can clock it down, although the UEFI bios screens are massively confusing so I could be wrong. Verbose dmesg: Table 'FACP' at 0x866249f0 Table 'APIC' at 0x86624b00 APIC: Found table at 0x86624b00 APIC: Using the MADT enumerator. MADT: Found CPU APIC ID 0 ACPI ID 1: enabled SMP: Added CPU 0 (AP) MADT: Found CPU APIC ID 2 ACPI ID 2: enabled SMP: Added CPU 2 (AP) MADT: Found CPU APIC ID 4 ACPI ID 3: enabled SMP: Added CPU 4 (AP) MADT: Found CPU APIC ID 6 ACPI ID 4: enabled SMP: Added CPU 6 (AP) MADT: Found CPU APIC ID 1 ACPI ID 5: enabled SMP: Added CPU 1 (AP) MADT: Found CPU APIC ID 3 ACPI ID 6: enabled SMP: Added CPU 3 (AP) MADT: Found CPU APIC ID 5 ACPI ID 7: enabled SMP: Added CPU 5 (AP) MADT: Found CPU APIC ID 7 ACPI ID 8: enabled SMP: Added CPU 7 (AP) Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.3-BETA2 #0 r295552: Fri Feb 12 01:09:31 UTC 2016 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 PPIM 0: PA=0xa0000, VA=0xffffffff82c10000, size=0x10000, mode=0 VT(vga): resolution 640x480 Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff829eb000. Preloaded elf obj module "/boot/kernel/zfs.ko" at 0xffffffff829ebde8. Preloaded elf obj module "/boot/kernel/opensolaris.ko" at 0xffffffff829ec610. Preloaded elf obj module "/boot/kernel/linux.ko" at 0xffffffff829ecc40. Preloaded elf obj module "/boot/kernel/linux_common.ko" at 0xffffffff829ed528. Preloaded elf obj module "/boot/kernel/if_tap.ko" at 0xffffffff829edc58. Preloaded elf obj module "/boot/kernel/aio.ko" at 0xffffffff829ee2c0. Preloaded elf obj module "/boot/kernel/coretemp.ko" at 0xffffffff829ee968. Preloaded elf obj module "/boot/modules/nvidia.ko" at 0xffffffff829eef18. Preloaded elf obj module "/boot/kernel/drm.ko" at 0xffffffff829ef540. Preloaded elf obj module "/boot/modules/vboxdrv.ko" at 0xffffffff829efbe8. Preloaded elf obj module "/boot/kernel/fuse.ko" at 0xffffffff829f01d8. Preloaded elf obj module "/boot/kernel/ng_ubt.ko" at 0xffffffff829f0880. Preloaded elf obj module "/boot/kernel/ng_hci.ko" at 0xffffffff829f0e68. Preloaded elf obj module "/boot/kernel/ng_bluetooth.ko" at 0xffffffff829f1490. Preloaded elf obj module "/boot/kernel/netgraph.ko" at 0xffffffff829f1a40. Preloaded elf obj module "/boot/kernel/if_ipheth.ko" at 0xffffffff829f20f0. Preloaded elf obj module "/boot/kernel/uether.ko" at 0xffffffff829f2760. Calibrating TSC clock ... TSC clock: 4008172549 Hz CPU: Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz (4008.17-MHz K8-class CPU) Origin="GenuineIntel" Id=0x506e3 Family=0x6 Model=0x5e Stepping=3 Features=0xbfebfbff Features2=0x7ffafbbf AMD Features=0x2c100800 AMD Features2=0x121 Structured Extended Features=0x29c6fbf XSAVE Features=0xf VT-x: Basic Features=0xda0400 Pin-Based Controls=0x7f Primary Processor Controls=0xfff9fffe Secondary Processor Controls=0x1ffcff Exit Controls=0xda0400 Entry Controls=0xda0400 EPT Features=0x6334141 VPID Features=0xf01 TSC: P-state invariant, performance statistics Data TLB: 1 GByte pages, 4-way set associative, 4 entries Data TLB: 4 KB pages, 4-way set associative, 64 entries Instruction TLB: 2M/4M pages, fully associative, 8 entries Instruction TLB: 4KByte pages, 8-way set associative, 64 entries 64-Byte prefetching Shared 2nd-Level TLB: 4 KByte /2 MByte pages, 6-way associative, 1536 entries. Also 1GBbyte pages, 4-way, 16 entries L2 cache: 256 kbytes, 8-way associative, 64 bytes/line real memory = 68719476736 (65536 MB) Physical memory chunk(s): 0x0000000000010000 - 0x0000000000098fff, 561152 bytes (137 pages) 0x0000000000100000 - 0x00000000001fffff, 1048576 bytes (256 pages) 0x0000000002a39000 - 0x000000007eda6fff, 2083971072 bytes (508782 pages) 0x000000007edf2000 - 0x000000007ee36fff, 282624 bytes (69 pages) 0x000000007f948000 - 0x0000000084ed7fff, 89718784 bytes (21904 pages) 0x0000000087fff000 - 0x0000000087ffffff, 4096 bytes (1 pages) 0x0000000100000000 - 0x000000100b366fff, 64612626432 bytes (15774567 pages) avail memory = 66583150592 (63498 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: INTR: Adding local APIC 1 as a target INTR: Adding local APIC 2 as a target INTR: Adding local APIC 3 as a target INTR: Adding local APIC 4 as a target INTR: Adding local APIC 5 as a target INTR: Adding local APIC 6 as a target INTR: Adding local APIC 7 as a target FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 APIC: CPU 0 has ACPI ID 1 APIC: CPU 1 has ACPI ID 5 APIC: CPU 2 has ACPI ID 2 APIC: CPU 3 has ACPI ID 6 APIC: CPU 4 has ACPI ID 3 APIC: CPU 5 has ACPI ID 7 APIC: CPU 6 has ACPI ID 4 APIC: CPU 7 has ACPI ID 8 lapic0: CMCI unmasked XEN: CPU 0 has VCPU ID 1 XEN: CPU 1 has VCPU ID 5 XEN: CPU 2 has VCPU ID 2 XEN: CPU 3 has VCPU ID 6 XEN: CPU 4 has VCPU ID 3 XEN: CPU 5 has VCPU ID 7 XEN: CPU 6 has VCPU ID 4 XEN: CPU 7 has VCPU ID 8 x86bios: IVT 0x000000-0x0004ff at 0xfffff80000000000 x86bios: SSEG 0x098000-0x098fff at 0xfffffe1002984000 x86bios: EBDA 0x09c000-0x09ffff at 0xfffff8000009c000 x86bios: ROM 0x0a0000-0x0fefff at 0xfffff800000a0000 Hardware, VIA Nehemiah Padlock RNG: VIA Padlock RNG not present Falling back to random adaptor random: initialized ULE: setup cpu 0 ULE: setup cpu 1 ULE: setup cpu 2 ULE: setup cpu 3 ULE: setup cpu 4 ULE: setup cpu 5 ULE: setup cpu 6 ULE: setup cpu 7 ACPI: RSDP 0x00000000000F0580 000024 (v02 ALASKA) ACPI: XSDT 0x00000000866010A0 0000B4 (v01 ALASKA A M I 01072009 AMI 00010013) ACPI: FACP 0x00000000866249F0 00010C (v05 ALASKA A M I 01072009 AMI 00010013) ACPI: DSDT 0x00000000866011E8 023806 (v02 ALASKA A M I 01072009 INTL 20120913) ACPI: FACS 0x00000000871BCF80 000040 ACPI: APIC 0x0000000086624B00 0000BC (v03 ALASKA A M I 01072009 AMI 00010013) ACPI: FPDT 0x0000000086624BC0 000044 (v01 ALASKA A M I 01072009 AMI 00010013) ACPI: FIDT 0x0000000086624C08 00009C (v01 ALASKA A M I 01072009 AMI 00010013) ACPI: MCFG 0x0000000086624CA8 00003C (v01 ALASKA A M I 01072009 MSFT 00000097) ACPI: HPET 0x0000000086624CE8 000038 (v01 ALASKA A M I 01072009 AMI. 0005000B) ACPI: SSDT 0x0000000086624D20 00036D (v01 SataRe SataTabl 00001000 INTL 20120913) ACPI: LPIT 0x0000000086625090 000094 (v01 INTEL SKL 00000000 MSFT 0000005F) ACPI: SSDT 0x0000000086625128 000248 (v02 INTEL sensrhub 00000000 INTL 20120913) ACPI: SSDT 0x0000000086625370 002BAE (v02 INTEL PtidDevc 00001000 INTL 20120913) ACPI: SSDT 0x0000000086627F20 000BE3 (v02 INTEL Ther_Rvp 00001000 INTL 20120913) ACPI: SSDT 0x0000000086628B08 00002B (v02 INTEL UsbCTabl 00001000 INTL 20120913) ACPI: DBGP 0x0000000086628B38 000034 (v01 INTEL 00000000 MSFT 0000005F) ACPI: DBG2 0x0000000086628B70 000054 (v00 INTEL 00000000 MSFT 0000005F) ACPI: SSDT 0x0000000086628BC8 0006FD (v02 INTEL xh_rvp08 00000000 INTL 20120913) ACPI: SSDT 0x00000000866292C8 0052EA (v02 SaSsdt SaSsdt 00003000 INTL 20120913) ACPI: UEFI 0x000000008662E5B8 000042 (v01 00000000 00000000) ACPI: SSDT 0x000000008662E600 000E58 (v02 CpuRef CpuSsdt 00003000 INTL 20120913) MADT: Found IO APIC ID 2, Interrupt 0 at 0xfec00000 ioapic0: Routing external 8259A's -> intpin 0 lapic0: Routing NMI -> LINT1 lapic0: LINT1 trigger: edge lapic0: LINT1 polarity: high lapic2: Routing NMI -> LINT1 lapic2: LINT1 trigger: edge lapic2: LINT1 polarity: high lapic4: Routing NMI -> LINT1 lapic4: LINT1 trigger: edge lapic4: LINT1 polarity: high lapic6: Routing NMI -> LINT1 lapic6: LINT1 trigger: edge lapic6: LINT1 polarity: high lapic1: Routing NMI -> LINT1 lapic1: LINT1 trigger: edge lapic1: LINT1 polarity: high lapic3: Routing NMI -> LINT1 lapic3: LINT1 trigger: edge lapic3: LINT1 polarity: high lapic5: Routing NMI -> LINT1 lapic5: LINT1 trigger: edge lapic5: LINT1 polarity: high lapic7: Routing NMI -> LINT1 lapic7: LINT1 trigger: edge lapic7: LINT1 polarity: high MADT: Interrupt override: source 0, irq 2 ioapic0: Routing IRQ 0 -> intpin 2 MADT: Interrupt override: source 9, irq 9 ioapic0: intpin 9 trigger: level ioapic0 irqs 0-119 on motherboard cpu0 BSP: ID: 0x00000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000300ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 cmci: 0x000000f2 wlan: <802.11 Link Layer> snd_unit_init() u=0x00ff8000 [512] d=0x00007c00 [32] c=0x000003ff [1024] feeder_register: snd_unit=-1 snd_maxautovchans=16 latency=5 feeder_rate_min=1 feeder_rate_max=2016000 feeder_rate_round=25 nfslock: pseudo-device module_register_init: MOD_LOAD (vesa, 0xffffffff80dc4b20, 0) error 19 io: VMBUS: load kbd: new array size 4 kbd1 at kbdmux0 mem: null: hpt27xx: RocketRAID 27xx controller driver v1.2.7 hptrr: RocketRAID 17xx/2xxx SATA controller driver v1.2 hptnr: R750/DC7280 controller driver v1.1.4 acpi0: on motherboard ACPI Error: [\134_SB_.PCI0.XHC_.RHUB.HS11] Namespace lookup failure, AE_NOT_FOUND (20150515/dswload-219) ACPI Exception: AE_NOT_FOUND, During name lookup/catalog (20150515/psobject-233) ACPI: All ACPI Tables successfully acquired PCIe: Memory Mapped configuration base @ 0xe0000000 ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48 ACPI: Executed 24 blocks of module-level executable AML code acpi0: Power Button (fixed) cpu0: Processor \134_PR_.CPU0 (ACPI ID 1) -> APIC ID 0 cpu0: on acpi0 ACPI: Dynamic OEM Table Load: ACPI: SSDT 0xFFFFF8000D468800 0007AA (v02 PmRef Cpu0Ist 00003000 INTL 20120913) cpu0: switching to generic Cx mode cpu1: Processor \134_PR_.CPU1 (ACPI ID 2) -> APIC ID 2 cpu1: on acpi0 ACPI: Dynamic OEM Table Load: ACPI: SSDT 0xFFFFF8000D653000 0005AA (v02 PmRef ApIst 00003000 INTL 20120913) cpu2: Processor \134_PR_.CPU2 (ACPI ID 3) -> APIC ID 4 cpu2: on acpi0 cpu3: Processor \134_PR_.CPU3 (ACPI ID 4) -> APIC ID 6 cpu3: on acpi0 cpu4: Processor \134_PR_.CPU4 (ACPI ID 5) -> APIC ID 1 cpu4: on acpi0 cpu5: Processor \134_PR_.CPU5 (ACPI ID 6) -> APIC ID 3 cpu5: on acpi0 cpu6: Processor \134_PR_.CPU6 (ACPI ID 7) -> APIC ID 5 cpu6: on acpi0 cpu7: Processor \134_PR_.CPU7 (ACPI ID 8) -> APIC ID 7 cpu7: on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 hpet0: vendor 0x8086, rev 0x1, 24000000Hz 64bit, 8 timers, legacy route hpet0: t0: irqs 0x00f00000 (0), MSI, 64bit, periodic hpet0: t1: irqs 0x00f00000 (0), MSI hpet0: t2: irqs 0x00f00800 (0), MSI hpet0: t3: irqs 0x00f01000 (0), MSI hpet0: t4: irqs 0x00000000 (0), MSI hpet0: t5: irqs 0x00000000 (0), MSI hpet0: t6: irqs 0x00000000 (0), MSI hpet0: t7: irqs 0x00000000 (0), MSI Timecounter "HPET" frequency 24000000 Hz quality 950 msi: routing MSI-X IRQ 256 to local APIC 0 vector 49 msi: routing MSI-X IRQ 257 to local APIC 0 vector 50 msi: routing MSI-X IRQ 258 to local APIC 0 vector 51 msi: routing MSI-X IRQ 259 to local APIC 0 vector 52 msi: routing MSI-X IRQ 260 to local APIC 0 vector 53 msi: routing MSI-X IRQ 261 to local APIC 0 vector 54 msi: routing MSI-X IRQ 262 to local APIC 0 vector 55 msi: routing MSI-X IRQ 263 to local APIC 0 vector 56 Event timer "HPET" frequency 24000000 Hz quality 550 atrtc0: port 0x70-0x77 irq 8 on acpi0 atrtc0: Warning: Couldn't map I/O. atrtc0: registered as a time-of-day clock (resolution 1000000us, adjustment 0.500000000s) ioapic0: routing intpin 8 (ISA IRQ 8) to lapic 0 vector 57 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 ioapic0: routing intpin 2 (ISA IRQ 0) to lapic 0 vector 58 Event timer "i8254" frequency 1193182 Hz quality 100 ACPI timer: 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 -> 10 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0 acpi_ec0: port 0x62,0x66 on acpi0 pci_link0: Index IRQ Rtd Ref IRQs Initial Probe 0 11 N 0 3 4 5 6 10 11 12 14 15 Validation 0 11 N 0 3 4 5 6 10 11 12 14 15 After Disable 0 255 N 0 3 4 5 6 10 11 12 14 15 pci_link1: Index IRQ Rtd Ref IRQs Initial Probe 0 10 N 0 3 4 5 6 10 11 12 14 15 Validation 0 10 N 0 3 4 5 6 10 11 12 14 15 After Disable 0 255 N 0 3 4 5 6 10 11 12 14 15 pci_link2: Index IRQ Rtd Ref IRQs Initial Probe 0 5 N 0 3 4 5 6 10 11 12 14 15 Validation 0 5 N 0 3 4 5 6 10 11 12 14 15 After Disable 0 255 N 0 3 4 5 6 10 11 12 14 15 pci_link3: Index IRQ Rtd Ref IRQs Initial Probe 0 3 N 0 3 4 5 6 10 11 12 14 15 Validation 0 3 N 0 3 4 5 6 10 11 12 14 15 After Disable 0 255 N 0 3 4 5 6 10 11 12 14 15 pci_link4: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 3 4 5 6 10 11 12 14 15 Validation 0 255 N 0 3 4 5 6 10 11 12 14 15 After Disable 0 255 N 0 3 4 5 6 10 11 12 14 15 pci_link5: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 3 4 5 6 10 11 12 14 15 Validation 0 255 N 0 3 4 5 6 10 11 12 14 15 After Disable 0 255 N 0 3 4 5 6 10 11 12 14 15 pci_link6: Index IRQ Rtd Ref IRQs Initial Probe 0 255 N 0 3 4 5 6 10 11 12 14 15 Validation 0 255 N 0 3 4 5 6 10 11 12 14 15 After Disable 0 255 N 0 3 4 5 6 10 11 12 14 15 pci_link7: Index IRQ Rtd Ref IRQs Initial Probe 0 15 N 0 3 4 5 6 10 11 12 14 15 Validation 0 15 N 0 3 4 5 6 10 11 12 14 15 After Disable 0 255 N 0 3 4 5 6 10 11 12 14 15 pcib0: port 0xcf8-0xcff on acpi0 pcib0: decoding 5 range 0-0xfe pcib0: decoding 4 range 0-0xcf7 pcib0: decoding 4 range 0xd00-0xffff pcib0: decoding 3 range 0xa0000-0xbffff pcib0: decoding 3 range 0x89800000-0xdfffffff pcib0: decoding 3 range 0xfd000000-0xfe7fffff pci0: on pcib0 pci0: domain=0, physical bus=0 found-> vendor=0x8086, dev=0x191f, revid=0x07 domain=0, bus=0, slot=0, func=0 class=06-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x2090, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x8086, dev=0x1901, revid=0x07 domain=0, bus=0, slot=1, func=0 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message pcib0: matched entry for 0.1.INTA pcib0: slot 1 INTA hardwired to IRQ 16 secbus=1, subbus=1 found-> vendor=0x8086, dev=0xa12f, revid=0x31 domain=0, bus=0, slot=20, func=0 class=0c-03-30, hdrtype=0x00, mfdev=1 cmdreg=0x0006, statreg=0x0290, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 2 supports D0 D3 current D0 MSI supports 8 messages, 64 bit map[10]: type Memory, range 64, base 0xdfb30000, size 16, enabled pcib0: allocated type 3 (0xdfb30000-0xdfb3ffff) for rid 10 of pci0:0:20:0 pcib0: matched entry for 0.20.INTA pcib0: slot 20 INTA hardwired to IRQ 16 found-> vendor=0x8086, dev=0xa13a, revid=0x31 domain=0, bus=0, slot=22, func=0 class=07-80-00, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 64, base 0xdfb4d000, size 12, memory disabled pcib0: allocated type 3 (0xdfb4d000-0xdfb4dfff) for rid 10 of pci0:0:22:0 pcib0: matched entry for 0.22.INTA pcib0: slot 22 INTA hardwired to IRQ 16 found-> vendor=0x8086, dev=0xa102, revid=0x31 domain=0, bus=0, slot=23, func=0 class=01-06-01, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x02b0, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=15 powerspec 3 supports D0 D3 current D0 MSI supports 1 message map[10]: type Memory, range 32, base 0xdfb48000, size 13, enabled pcib0: allocated type 3 (0xdfb48000-0xdfb49fff) for rid 10 of pci0:0:23:0 map[14]: type Memory, range 32, base 0xdfb4c000, size 8, enabled pcib0: allocated type 3 (0xdfb4c000-0xdfb4c0ff) for rid 14 of pci0:0:23:0 map[18]: type I/O Port, range 32, base 0xf050, size 3, enabled pcib0: allocated type 4 (0xf050-0xf057) for rid 18 of pci0:0:23:0 map[1c]: type I/O Port, range 32, base 0xf040, size 2, enabled pcib0: allocated type 4 (0xf040-0xf043) for rid 1c of pci0:0:23:0 map[20]: type I/O Port, range 32, base 0xf020, size 5, enabled pcib0: allocated type 4 (0xf020-0xf03f) for rid 20 of pci0:0:23:0 map[24]: type Memory, range 32, base 0xdfb4b000, size 11, enabled pcib0: allocated type 3 (0xdfb4b000-0xdfb4b7ff) for rid 24 of pci0:0:23:0 pcib0: matched entry for 0.23.INTA pcib0: slot 23 INTA hardwired to IRQ 23 found-> vendor=0x8086, dev=0xa167, revid=0xf1 domain=0, bus=0, slot=27, func=0 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message pcib0: matched entry for 0.27.INTA pcib0: slot 27 INTA hardwired to IRQ 16 secbus=2, subbus=2 found-> vendor=0x8086, dev=0xa110, revid=0xf1 domain=0, bus=0, slot=28, func=0 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message pcib0: matched entry for 0.28.INTA pcib0: slot 28 INTA hardwired to IRQ 16 secbus=3, subbus=3 found-> vendor=0x8086, dev=0xa112, revid=0xf1 domain=0, bus=0, slot=28, func=2 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=c, irq=5 powerspec 3 supports D0 D3 current D0 MSI supports 1 message pcib0: matched entry for 0.28.INTC pcib0: slot 28 INTC hardwired to IRQ 18 secbus=4, subbus=12 found-> vendor=0x8086, dev=0xa114, revid=0xf1 domain=0, bus=0, slot=28, func=4 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message pcib0: matched entry for 0.28.INTA pcib0: slot 28 INTA hardwired to IRQ 16 secbus=13, subbus=13 found-> vendor=0x8086, dev=0xa116, revid=0xf1 domain=0, bus=0, slot=28, func=6 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=c, irq=5 powerspec 3 supports D0 D3 current D0 MSI supports 1 message pcib0: matched entry for 0.28.INTC pcib0: slot 28 INTC hardwired to IRQ 18 secbus=14, subbus=14 found-> vendor=0x8086, dev=0xa118, revid=0xf1 domain=0, bus=0, slot=29, func=0 class=06-04-00, hdrtype=0x01, mfdev=1 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message pcib0: matched entry for 0.29.INTA pcib0: slot 29 INTA hardwired to IRQ 16 secbus=15, subbus=15 found-> vendor=0x8086, dev=0xa145, revid=0x31 domain=0, bus=0, slot=31, func=0 class=06-01-00, hdrtype=0x00, mfdev=1 cmdreg=0x0007, statreg=0x0200, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x8086, dev=0xa121, revid=0x31 domain=0, bus=0, slot=31, func=2 class=05-80-00, hdrtype=0x00, mfdev=1 cmdreg=0x0006, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[10]: type Memory, range 32, base 0xdfb44000, size 14, enabled pcib0: allocated type 3 (0xdfb44000-0xdfb47fff) for rid 10 of pci0:0:31:2 found-> vendor=0x8086, dev=0xa170, revid=0x31 domain=0, bus=0, slot=31, func=3 class=04-03-00, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x20 (960 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 64, base 0xdfb40000, size 14, enabled pcib0: allocated type 3 (0xdfb40000-0xdfb43fff) for rid 10 of pci0:0:31:3 map[20]: type Memory, range 64, base 0xdfb20000, size 16, enabled pcib0: allocated type 3 (0xdfb20000-0xdfb2ffff) for rid 20 of pci0:0:31:3 pcib0: matched entry for 0.31.INTA pcib0: slot 31 INTA hardwired to IRQ 16 found-> vendor=0x8086, dev=0xa123, revid=0x31 domain=0, bus=0, slot=31, func=4 class=0c-05-00, hdrtype=0x00, mfdev=0 cmdreg=0x0003, statreg=0x0280, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 map[10]: type Memory, range 64, base 0xdfb4a000, size 8, enabled pcib0: allocated type 3 (0xdfb4a000-0xdfb4a0ff) for rid 10 of pci0:0:31:4 map[20]: type I/O Port, range 32, base 0xf000, size 5, enabled pcib0: allocated type 4 (0xf000-0xf01f) for rid 20 of pci0:0:31:4 pcib0: matched entry for 0.31.INTA pcib0: slot 31 INTA hardwired to IRQ 16 found-> vendor=0x8086, dev=0x15b8, revid=0x31 domain=0, bus=0, slot=31, func=6 class=02-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 32, base 0xdfb00000, size 17, enabled pcib0: allocated type 3 (0xdfb00000-0xdfb1ffff) for rid 10 of pci0:0:31:6 pcib0: matched entry for 0.31.INTA pcib0: slot 31 INTA hardwired to IRQ 16 pcib1: irq 16 at device 1.0 on pci0 pcib0: allocated type 4 (0xe000-0xefff) for rid 1c of pcib1 pcib0: allocated type 3 (0xde000000-0xdf0fffff) for rid 20 of pcib1 pcib0: allocated type 3 (0xc0000000-0xd1ffffff) for rid 24 of pcib1 pcib1: domain 0 pcib1: secondary bus 1 pcib1: subordinate bus 1 pcib1: I/O decode 0xe000-0xefff pcib1: memory decode 0xde000000-0xdf0fffff pcib1: prefetched decode 0xc0000000-0xd1ffffff pcib1: special decode VGA pci1: on pcib1 pcib1: allocated bus range (1-1) for rid 0 of pci1 pci1: domain=0, physical bus=1 found-> vendor=0x10de, dev=0x13c2, revid=0xa1 domain=0, bus=1, slot=0, func=0 class=03-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 32, base 0xde000000, size 24, enabled pcib1: allocated memory range (0xde000000-0xdeffffff) for rid 10 of pci0:1:0:0 map[14]: type Prefetchable Memory, range 64, base 0xc0000000, size 28, enabled pcib1: allocated prefetch range (0xc0000000-0xcfffffff) for rid 14 of pci0:1:0:0 map[1c]: type Prefetchable Memory, range 64, base 0xd0000000, size 25, enabled pcib1: allocated prefetch range (0xd0000000-0xd1ffffff) for rid 1c of pci0:1:0:0 map[24]: type I/O Port, range 32, base 0xe000, size 7, enabled pcib1: allocated I/O port range (0xe000-0xe07f) for rid 24 of pci0:1:0:0 pcib1: matched entry for 1.0.INTA pcib1: slot 0 INTA hardwired to IRQ 16 found-> vendor=0x10de, dev=0x0fbb, revid=0xa1 domain=0, bus=1, slot=0, func=1 class=04-03-00, hdrtype=0x00, mfdev=1 cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=b, irq=10 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 32, base 0xdf080000, size 14, enabled pcib1: allocated memory range (0xdf080000-0xdf083fff) for rid 10 of pci0:1:0:1 pcib1: matched entry for 1.0.INTB pcib1: slot 0 INTB hardwired to IRQ 17 vgapci0: port 0xe000-0xe07f mem 0xde000000-0xdeffffff,0xc0000000-0xcfffffff,0xd0000000-0xd1ffffff irq 16 at device 0.0 on pci1 nvidia0: on vgapci0 vgapci0: child nvidia0 requested pci_enable_io vgapci0: attempting to allocate 1 MSI vectors (1 supported) msi: routing MSI IRQ 264 to local APIC 0 vector 59 vgapci0: using IRQ 264 for MSI vgapci0: child nvidia0 requested pci_enable_io vgapci0: Boot video device hdac0: mem 0xdf080000-0xdf083fff irq 17 at device 0.1 on pci1 hdac0: PCI card vendor: 0x1043, device: 0x8508 hdac0: HDA Driver Revision: 20120126_0002 hdac0: Config options: on=0x00000000 off=0x00000000 hdac0: attempting to allocate 1 MSI vectors (1 supported) msi: routing MSI IRQ 265 to local APIC 0 vector 60 hdac0: using IRQ 265 for MSI hdac0: Caps: OSS 4, ISS 4, BSS 0, NSDO 4, 64bit, CORB 256, RIRB 256 xhci0: mem 0xdfb30000-0xdfb3ffff irq 16 at device 20.0 on pci0 xhci0: 32 bytes context size, 64-bit DMA xhci0: attempting to allocate 1 MSI vectors (8 supported) msi: routing MSI IRQ 266 to local APIC 0 vector 61 xhci0: using IRQ 266 for MSI xhci0: MSI enabled usbus0: waiting for BIOS to give up control usbus0 on xhci0 xhci0: usbpf: Attached pci0: at device 22.0 (no driver attached) ahci0: port 0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xdfb48000-0xdfb49fff,0xdfb4c000-0xdfb4c0ff,0xdfb4b000-0xdfb4b7ff irq 23 at device 23.0 on pci0 ahci0: attempting to allocate 1 MSI vectors (1 supported) msi: routing MSI IRQ 267 to local APIC 0 vector 62 ahci0: using IRQ 267 for MSI ahci0: AHCI v1.31 with 6 6Gbps ports, Port Multiplier not supported ahci0: Caps: 64bit NCQ SNTF AL CLO 6Gbps PMD SSC PSC 32cmd EM 6ports ahci0: Caps2: DESO SADM SDS APST ahcich0: at channel 0 on ahci0 ahcich0: Caps: ahcich1: at channel 1 on ahci0 ahcich1: Caps: ahcich2: at channel 2 on ahci0 ahcich2: Caps: ahcich3: at channel 3 on ahci0 ahcich3: Caps: ahcich4: at channel 4 on ahci0 ahcich4: Caps: ahcich5: at channel 5 on ahci0 ahcich5: Caps: ahciem0: on ahci0 ahciem0: Caps: ALHD XMT SMB LED pcib2: irq 16 at device 27.0 on pci0 pcib2: domain 0 pcib2: secondary bus 2 pcib2: subordinate bus 2 pci2: on pcib2 pcib2: allocated bus range (2-2) for rid 0 of pci2 pci2: domain=0, physical bus=2 pcib3: irq 16 at device 28.0 on pci0 pcib0: allocated type 3 (0xdfa00000-0xdfafffff) for rid 20 of pcib3 pcib3: domain 0 pcib3: secondary bus 3 pcib3: subordinate bus 3 pcib3: memory decode 0xdfa00000-0xdfafffff pci3: on pcib3 pcib3: allocated bus range (3-3) for rid 0 of pci3 pci3: domain=0, physical bus=3 found-> vendor=0x1b21, dev=0x1242, revid=0x00 domain=0, bus=3, slot=0, func=0 class=0c-03-30, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 8 messages, 64 bit MSI-X supports 8 messages in map 0x10 map[10]: type Memory, range 64, base 0xdfa00000, size 15, enabled pcib3: allocated memory range (0xdfa00000-0xdfa07fff) for rid 10 of pci0:3:0:0 pcib3: matched entry for 3.0.INTA pcib3: slot 0 INTA hardwired to IRQ 16 xhci1: mem 0xdfa00000-0xdfa07fff irq 16 at device 0.0 on pci3 xhci1: 32 bytes context size, 64-bit DMA xhci1: attempting to allocate 1 MSI vectors (8 supported) msi: routing MSI IRQ 268 to local APIC 0 vector 63 xhci1: using IRQ 268 for MSI xhci1: MSI enabled usbus1: waiting for BIOS to give up control usbus1 on xhci1 xhci1: usbpf: Attached pcib4: irq 18 at device 28.2 on pci0 pcib0: allocated type 4 (0xc000-0xdfff) for rid 1c of pcib4 pcib0: allocated type 3 (0xdf200000-0xdf7fffff) for rid 20 of pcib4 pcib4: domain 0 pcib4: secondary bus 4 pcib4: subordinate bus 12 pcib4: I/O decode 0xc000-0xdfff pcib4: memory decode 0xdf200000-0xdf7fffff pci4: on pcib4 pcib4: allocated bus range (4-4) for rid 0 of pci4 pci4: domain=0, physical bus=4 found-> vendor=0x1b21, dev=0x1187, revid=0x00 domain=0, bus=4, slot=0, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=5 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit pcib4: matched entry for 4.0.INTA pcib4: slot 0 INTA hardwired to IRQ 18 secbus=5, subbus=12 pcib4: allocated bus range (5-12) for rid 0 of pci0:4:0:0 pcib5: irq 18 at device 0.0 on pci4 pcib4: allocated I/O port range (0xc000-0xdfff) for rid 1c of pcib5 pcib4: allocated memory range (0xdf200000-0xdf7fffff) for rid 20 of pcib5 pcib5: domain 0 pcib5: secondary bus 5 pcib5: subordinate bus 12 pcib5: I/O decode 0xc000-0xdfff pcib5: memory decode 0xdf200000-0xdf7fffff pci5: on pcib5 pcib5: allocated bus range (5-5) for rid 0 of pci5 pci5: domain=0, physical bus=5 found-> vendor=0x1b21, dev=0x1187, revid=0x00 domain=0, bus=5, slot=1, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=3 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit pcib5: matched entry for 5.1.INTA pcib5: slot 1 INTA hardwired to IRQ 19 secbus=6, subbus=6 pcib5: allocated bus range (6-6) for rid 0 of pci0:5:1:0 found-> vendor=0x1b21, dev=0x1187, revid=0x00 domain=0, bus=5, slot=2, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit pcib5: matched entry for 5.2.INTA pcib5: slot 2 INTA hardwired to IRQ 16 secbus=7, subbus=7 pcib5: allocated bus range (7-7) for rid 0 of pci0:5:2:0 found-> vendor=0x1b21, dev=0x1187, revid=0x00 domain=0, bus=5, slot=3, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=10 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit pcib5: matched entry for 5.3.INTA pcib5: slot 3 INTA hardwired to IRQ 17 secbus=8, subbus=8 pcib5: allocated bus range (8-8) for rid 0 of pci0:5:3:0 found-> vendor=0x1b21, dev=0x1187, revid=0x00 domain=0, bus=5, slot=4, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=5 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit pcib5: matched entry for 5.4.INTA pcib5: slot 4 INTA hardwired to IRQ 18 secbus=9, subbus=9 pcib5: allocated bus range (9-9) for rid 0 of pci0:5:4:0 found-> vendor=0x1b21, dev=0x1187, revid=0x00 domain=0, bus=5, slot=5, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=3 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit pcib5: matched entry for 5.5.INTA pcib5: slot 5 INTA hardwired to IRQ 19 secbus=10, subbus=10 pcib5: allocated bus range (10-10) for rid 0 of pci0:5:5:0 found-> vendor=0x1b21, dev=0x1187, revid=0x00 domain=0, bus=5, slot=6, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit pcib5: matched entry for 5.6.INTA pcib5: slot 6 INTA hardwired to IRQ 16 secbus=11, subbus=11 pcib5: allocated bus range (11-11) for rid 0 of pci0:5:6:0 found-> vendor=0x1b21, dev=0x1187, revid=0x00 domain=0, bus=5, slot=7, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=10 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit pcib5: matched entry for 5.7.INTA pcib5: slot 7 INTA hardwired to IRQ 17 secbus=12, subbus=12 pcib5: allocated bus range (12-12) for rid 0 of pci0:5:7:0 pcib6: irq 19 at device 1.0 on pci5 pcib6: domain 0 pcib6: secondary bus 6 pcib6: subordinate bus 6 pci6: on pcib6 pcib6: allocated bus range (6-6) for rid 0 of pci6 pci6: domain=0, physical bus=6 pcib7: irq 16 at device 2.0 on pci5 pcib5: allocated memory range (0xdf200000-0xdf4fffff) for rid 20 of pcib7 pcib7: domain 0 pcib7: secondary bus 7 pcib7: subordinate bus 7 pcib7: memory decode 0xdf200000-0xdf4fffff pci7: on pcib7 pcib7: allocated bus range (7-7) for rid 0 of pci7 pci7: domain=0, physical bus=7 found-> vendor=0x14e4, dev=0x43a0, revid=0x03 domain=0, bus=7, slot=0, func=0 class=02-80-00, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D1 D2 D3 current D0 MSI supports 1 message, 64 bit map[10]: type Memory, range 64, base 0xdf400000, size 15, enabled pcib7: allocated memory range (0xdf400000-0xdf407fff) for rid 10 of pci0:7:0:0 map[18]: type Memory, range 64, base 0xdf200000, size 21, enabled pcib7: allocated memory range (0xdf200000-0xdf3fffff) for rid 18 of pci0:7:0:0 pcib7: matched entry for 7.0.INTA pcib7: slot 0 INTA hardwired to IRQ 16 pci7: at device 0.0 (no driver attached) pcib8: irq 17 at device 3.0 on pci5 pcib5: allocated I/O port range (0xd000-0xdfff) for rid 1c of pcib8 pcib5: allocated memory range (0xdf700000-0xdf7fffff) for rid 20 of pcib8 pcib8: domain 0 pcib8: secondary bus 8 pcib8: subordinate bus 8 pcib8: I/O decode 0xd000-0xdfff pcib8: memory decode 0xdf700000-0xdf7fffff pci8: on pcib8 pcib8: allocated bus range (8-8) for rid 0 of pci8 pci8: domain=0, physical bus=8 found-> vendor=0x1b21, dev=0x0612, revid=0x02 domain=0, bus=8, slot=0, func=0 class=01-06-01, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=10 powerspec 3 supports D0 D3 current D0 map[10]: type I/O Port, range 32, base 0xd050, size 3, enabled pcib8: allocated I/O port range (0xd050-0xd057) for rid 10 of pci0:8:0:0 map[14]: type I/O Port, range 32, base 0xd040, size 2, enabled pcib8: allocated I/O port range (0xd040-0xd043) for rid 14 of pci0:8:0:0 map[18]: type I/O Port, range 32, base 0xd030, size 3, enabled pcib8: allocated I/O port range (0xd030-0xd037) for rid 18 of pci0:8:0:0 map[1c]: type I/O Port, range 32, base 0xd020, size 2, enabled pcib8: allocated I/O port range (0xd020-0xd023) for rid 1c of pci0:8:0:0 map[20]: type I/O Port, range 32, base 0xd000, size 5, enabled pcib8: allocated I/O port range (0xd000-0xd01f) for rid 20 of pci0:8:0:0 map[24]: type Memory, range 32, base 0xdf700000, size 9, enabled pcib8: allocated memory range (0xdf700000-0xdf7001ff) for rid 24 of pci0:8:0:0 pcib8: matched entry for 8.0.INTA pcib8: slot 0 INTA hardwired to IRQ 17 ahci1: port 0xd050-0xd057,0xd040-0xd043,0xd030-0xd037,0xd020-0xd023,0xd000-0xd01f mem 0xdf700000-0xdf7001ff irq 17 at device 0.0 on pci8 ioapic0: routing intpin 17 (PCI IRQ 17) to lapic 0 vector 64 ahci1: AHCI v1.20 with 2 6Gbps ports, Port Multiplier supported ahci1: Caps: 64bit NCQ SNTF SS AL CLO 6Gbps PM PMD SSC PSC 32cmd CCC 2ports ahci1: Caps2: ahcich6: at channel 0 on ahci1 ahcich6: Caps: ESP ahcich7: at channel 1 on ahci1 ahcich7: Caps: ESP pcib9: irq 18 at device 4.0 on pci5 pcib9: domain 0 pcib9: secondary bus 9 pcib9: subordinate bus 9 pci9: on pcib9 pcib9: allocated bus range (9-9) for rid 0 of pci9 pci9: domain=0, physical bus=9 pcib10: irq 19 at device 5.0 on pci5 pcib10: domain 0 pcib10: secondary bus 10 pcib10: subordinate bus 10 pci10: on pcib10 pcib10: allocated bus range (10-10) for rid 0 of pci10 pci10: domain=0, physical bus=10 pcib11: irq 16 at device 6.0 on pci5 pcib5: allocated I/O port range (0xc000-0xcfff) for rid 1c of pcib11 pcib5: allocated memory range (0xdf600000-0xdf6fffff) for rid 20 of pcib11 pcib11: domain 0 pcib11: secondary bus 11 pcib11: subordinate bus 11 pcib11: I/O decode 0xc000-0xcfff pcib11: memory decode 0xdf600000-0xdf6fffff pci11: on pcib11 pcib11: allocated bus range (11-11) for rid 0 of pci11 pci11: domain=0, physical bus=11 found-> vendor=0x8086, dev=0x1539, revid=0x03 domain=0, bus=11, slot=0, func=0 class=02-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 1 message, 64 bit, vector masks MSI-X supports 5 messages in map 0x1c map[10]: type Memory, range 32, base 0xdf600000, size 17, enabled pcib11: allocated memory range (0xdf600000-0xdf61ffff) for rid 10 of pci0:11:0:0 map[18]: type I/O Port, range 32, base 0xc000, size 5, enabled pcib11: allocated I/O port range (0xc000-0xc01f) for rid 18 of pci0:11:0:0 map[1c]: type Memory, range 32, base 0xdf620000, size 14, enabled pcib11: allocated memory range (0xdf620000-0xdf623fff) for rid 1c of pci0:11:0:0 pcib11: matched entry for 11.0.INTA pcib11: slot 0 INTA hardwired to IRQ 16 igb0: port 0xc000-0xc01f mem 0xdf600000-0xdf61ffff,0xdf620000-0xdf623fff irq 16 at device 0.0 on pci11 igb0: attempting to allocate 3 MSI-X vectors (5 supported) msi: routing MSI-X IRQ 269 to local APIC 0 vector 65 msi: routing MSI-X IRQ 270 to local APIC 0 vector 66 msi: routing MSI-X IRQ 271 to local APIC 0 vector 67 igb0: using IRQs 269-271 for MSI-X igb0: Using MSIX interrupts with 3 vectors igb0: bpf attached igb0: Ethernet address: 9c:5c:8e:71:89:0b igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 pcib12: irq 17 at device 7.0 on pci5 pcib12: domain 0 pcib12: secondary bus 12 pcib12: subordinate bus 12 pci12: on pcib12 pcib12: allocated bus range (12-12) for rid 0 of pci12 pci12: domain=0, physical bus=12 pcib13: irq 16 at device 28.4 on pci0 pcib0: allocated type 3 (0xdf900000-0xdf9fffff) for rid 20 of pcib13 pcib13: domain 0 pcib13: secondary bus 13 pcib13: subordinate bus 13 pcib13: memory decode 0xdf900000-0xdf9fffff pci13: on pcib13 pcib13: allocated bus range (13-13) for rid 0 of pci13 pci13: domain=0, physical bus=13 found-> vendor=0x1b21, dev=0x1242, revid=0x00 domain=0, bus=13, slot=0, func=0 class=0c-03-30, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 3 supports D0 D3 current D0 MSI supports 8 messages, 64 bit MSI-X supports 8 messages in map 0x10 map[10]: type Memory, range 64, base 0xdf900000, size 15, enabled pcib13: allocated memory range (0xdf900000-0xdf907fff) for rid 10 of pci0:13:0:0 pcib13: matched entry for 13.0.INTA pcib13: slot 0 INTA hardwired to IRQ 16 xhci2: mem 0xdf900000-0xdf907fff irq 16 at device 0.0 on pci13 xhci2: 32 bytes context size, 64-bit DMA xhci2: attempting to allocate 1 MSI vectors (8 supported) msi: routing MSI IRQ 272 to local APIC 0 vector 68 xhci2: using IRQ 272 for MSI xhci2: MSI enabled usbus2: waiting for BIOS to give up control usbus2 on xhci2 xhci2: usbpf: Attached pcib14: irq 18 at device 28.6 on pci0 pcib0: allocated type 3 (0xdf800000-0xdf8fffff) for rid 20 of pcib14 pcib14: domain 0 pcib14: secondary bus 14 pcib14: subordinate bus 14 pcib14: memory decode 0xdf800000-0xdf8fffff pci14: on pcib14 pcib14: allocated bus range (14-14) for rid 0 of pci14 pci14: domain=0, physical bus=14 found-> vendor=0x1b21, dev=0x1242, revid=0x00 domain=0, bus=14, slot=0, func=0 class=0c-03-30, hdrtype=0x00, mfdev=0 cmdreg=0x0006, statreg=0x0010, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=a, irq=5 powerspec 3 supports D0 D3 current D0 MSI supports 8 messages, 64 bit MSI-X supports 8 messages in map 0x10 map[10]: type Memory, range 64, base 0xdf800000, size 15, enabled pcib14: allocated memory range (0xdf800000-0xdf807fff) for rid 10 of pci0:14:0:0 pcib14: matched entry for 14.0.INTA pcib14: slot 0 INTA hardwired to IRQ 18 xhci3: mem 0xdf800000-0xdf807fff irq 18 at device 0.0 on pci14 xhci3: 32 bytes context size, 64-bit DMA xhci3: attempting to allocate 1 MSI vectors (8 supported) msi: routing MSI IRQ 273 to local APIC 0 vector 69 xhci3: using IRQ 273 for MSI xhci3: MSI enabled usbus3: waiting for BIOS to give up control usbus3 on xhci3 xhci3: usbpf: Attached pcib15: irq 16 at device 29.0 on pci0 pcib15: domain 0 pcib15: secondary bus 15 pcib15: subordinate bus 15 pci15: on pcib15 pcib15: allocated bus range (15-15) for rid 0 of pci15 pci15: domain=0, physical bus=15 isab0: at device 31.0 on pci0 isa0: on isab0 pci0: at device 31.2 (no driver attached) hdac1: mem 0xdfb40000-0xdfb43fff,0xdfb20000-0xdfb2ffff irq 16 at device 31.3 on pci0 hdac1: PCI card vendor: 0x1043, device: 0x868f hdac1: HDA Driver Revision: 20120126_0002 hdac1: Config options: on=0x00000000 off=0x00000000 hdac1: attempting to allocate 1 MSI vectors (1 supported) msi: routing MSI IRQ 274 to local APIC 0 vector 70 hdac1: using IRQ 274 for MSI hdac1: Caps: OSS 9, ISS 7, BSS 0, NSDO 1, 64bit, CORB 256, RIRB 256 pci0: at device 31.4 (no driver attached) pci0: at device 31.6 (no driver attached) acpi_button0: on acpi0 acpi_button1: on acpi0 acpi_tz0: on acpi0 acpi_tz1: on acpi0 ACPI: Enabled 6 GPEs in block 00 to 7F acpi0: wakeup code va 0xfffffe1044ba7000 pa 0x90000 ex_isa_identify() pcib0: allocated type 3 (0xa0000-0xa07ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa0800-0xa0fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa1000-0xa17ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa1800-0xa1fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa2000-0xa27ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa2800-0xa2fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa3000-0xa37ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa3800-0xa3fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa4000-0xa47ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa4800-0xa4fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa5000-0xa57ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa5800-0xa5fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa6000-0xa67ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa6800-0xa6fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa7000-0xa77ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa7800-0xa7fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa8000-0xa87ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa8800-0xa8fff) for rid 0 of orm0 pcib0: allocated type 3 (0xa9000-0xa97ff) for rid 0 of orm0 pcib0: allocated type 3 (0xa9800-0xa9fff) for rid 0 of orm0 pcib0: allocated type 3 (0xaa000-0xaa7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xaa800-0xaafff) for rid 0 of orm0 pcib0: allocated type 3 (0xab000-0xab7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xab800-0xabfff) for rid 0 of orm0 pcib0: allocated type 3 (0xac000-0xac7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xac800-0xacfff) for rid 0 of orm0 pcib0: allocated type 3 (0xad000-0xad7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xad800-0xadfff) for rid 0 of orm0 pcib0: allocated type 3 (0xae000-0xae7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xae800-0xaefff) for rid 0 of orm0 pcib0: allocated type 3 (0xaf000-0xaf7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xaf800-0xaffff) for rid 0 of orm0 pcib0: allocated type 3 (0xb0000-0xb07ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb0800-0xb0fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb1000-0xb17ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb1800-0xb1fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb2000-0xb27ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb2800-0xb2fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb3000-0xb37ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb3800-0xb3fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb4000-0xb47ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb4800-0xb4fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb5000-0xb57ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb5800-0xb5fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb6000-0xb67ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb6800-0xb6fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb7000-0xb77ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb7800-0xb7fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb8000-0xb87ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb8800-0xb8fff) for rid 0 of orm0 pcib0: allocated type 3 (0xb9000-0xb97ff) for rid 0 of orm0 pcib0: allocated type 3 (0xb9800-0xb9fff) for rid 0 of orm0 pcib0: allocated type 3 (0xba000-0xba7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xba800-0xbafff) for rid 0 of orm0 pcib0: allocated type 3 (0xbb000-0xbb7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xbb800-0xbbfff) for rid 0 of orm0 pcib0: allocated type 3 (0xbc000-0xbc7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xbc800-0xbcfff) for rid 0 of orm0 pcib0: allocated type 3 (0xbd000-0xbd7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xbd800-0xbdfff) for rid 0 of orm0 pcib0: allocated type 3 (0xbe000-0xbe7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xbe800-0xbefff) for rid 0 of orm0 pcib0: allocated type 3 (0xbf000-0xbf7ff) for rid 0 of orm0 pcib0: allocated type 3 (0xbf800-0xbffff) for rid 0 of orm0 ahc_isa_identify 0: ioport 0xc00 alloc failed ahc_isa_identify 1: ioport 0x1c00 alloc failed ahc_isa_identify 2: ioport 0x2c00 alloc failed ahc_isa_identify 3: ioport 0x3c00 alloc failed ahc_isa_identify 4: ioport 0x4c00 alloc failed ahc_isa_identify 5: ioport 0x5c00 alloc failed ahc_isa_identify 6: ioport 0x6c00 alloc failed ahc_isa_identify 7: ioport 0x7c00 alloc failed ahc_isa_identify 8: ioport 0x8c00 alloc failed ahc_isa_identify 9: ioport 0x9c00 alloc failed ahc_isa_identify 10: ioport 0xac00 alloc failed ahc_isa_identify 11: ioport 0xbc00 alloc failed ahc_isa_identify 12: ioport 0xcc00 alloc failed ahc_isa_identify 13: ioport 0xdc00 alloc failed ahc_isa_identify 14: ioport 0xec00 alloc failed isa_probe_children: disabling PnP devices atrtc: atrtc0 already exists; skipping it attimer: attimer0 already exists; skipping it sc: sc0 already exists; skipping it isa_probe_children: probing non-PnP devices sc0 failed to probe on isa0 vga0 failed to probe on isa0 pcib0: allocated type 4 (0x60-0x60) for rid 0 of atkbdc0 pcib0: allocated type 4 (0x64-0x64) for rid 1 of atkbdc0 atkbdc0: at port 0x60,0x64 on isa0 pcib0: allocated type 4 (0x60-0x60) for rid 0 of atkbdc0 pcib0: allocated type 4 (0x64-0x64) for rid 1 of atkbdc0 atkbd0: irq 1 on atkbdc0 atkbd: the current kbd controller command byte 0065 atkbd: keyboard ID 0xffffffff (1) kbdc: RESET_KBD return code:00fe kbdc: RESET_KBD return code:00fe kbdc: RESET_KBD return code:00fe kbdc: DIAGNOSE status:0055 kbdc: TEST_KBD_PORT status:0000 atkbd: failed to reset the keyboard. kbd0 at atkbd0 kbd0: atkbd0, AT 84 (1), config:0x0, flags:0x1d0000 ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 0 vector 71 atkbd0: [GIANT-LOCKED] psm0: unable to allocate IRQ pcib0: allocated type 4 (0x3f0-0x3f5) for rid 0 of fdc0 pcib0: allocated type 4 (0x3f7-0x3f7) for rid 1 of fdc0 fdc0 failed to probe at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 ppc0: cannot reserve I/O port range ppc0 failed to probe at irq 7 on isa0 pcib0: allocated type 4 (0x3f8-0x3ff) for rid 0 of uart0 uart0 failed to probe at port 0x3f8-0x3ff irq 4 on isa0 pcib0: allocated type 4 (0x2f8-0x2ff) for rid 0 of uart1 uart1 failed to probe at port 0x2f8-0x2ff irq 3 on isa0 wbwd0 failed to probe on isa0 isa_probe_children: probing PnP devices coretemp0: on cpu0 coretemp0: Setting TjMax=100 est0: on cpu0 coretemp1: on cpu1 coretemp1: Setting TjMax=100 est1: on cpu1 coretemp2: on cpu2 coretemp2: Setting TjMax=100 est2: on cpu2 coretemp3: on cpu3 coretemp3: Setting TjMax=100 est3: on cpu3 coretemp4: on cpu4 coretemp4: Setting TjMax=100 est4: on cpu4 coretemp5: on cpu5 coretemp5: Setting TjMax=100 est5: on cpu5 coretemp6: on cpu6 coretemp6: Setting TjMax=100 est6: on cpu6 coretemp7: on cpu7 coretemp7: Setting TjMax=100 est7: on cpu7 Device configuration finished. random: unblocking device. usbus0: 5.0Gbps Super Speed USB v3.0 procfs registered fuse-freebsd: version 0.4.4, FUSE ABI 7.8 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) lapic: Divisor 2, Frequency 12000518 Hz Timecounters tick every 1.000 msec vboxdrv: fAsync=0 offMin=0x339 offMax=0x487 vlan: initialized, using hash tables with chaining Linux ELF exec handler installed tcp_init: net.inet.tcp.tcbhashsize auto tuned to 524288 lo0: bpf attached hpt27xx: no controller detected. hptrr: no controller detected. hptnr: no controller detected. hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 hdaa0: Subsystem ID: 0x10438508 hdaa0: NumGPIO=0 NumGPO=0 NumGPI=0 GPIWake=0 GPIUnsol=0 hdaa0: Original pins configuration: hdaa0: nid 0x as seq device conn jack loc color misc hdaa0: 4 185600f0 15 0 Digital-out Jack Digital 0x18 Unknown 0 hdaa0: 5 185600f0 15 0 Digital-out Jack Digital 0x18 Unknown 0 hdaa0: 6 185600f0 15 0 Digital-out Jack Digital 0x18 Unknown 0 hdaa0: 7 185600f0 15 0 Digital-out Jack Digital 0x18 Unknown 0 hdaa0: Patched pins configuration: hdaa0: nid 0x as seq device conn jack loc color misc hdaa0: 4 185600f0 15 0 Digital-out Jack Digital 0x18 Unknown 0 hdaa0: 5 185600f0 15 0 Digital-out Jack Digital 0x18 Unknown 0 hdaa0: 6 185600f0 15 0 Digital-out Jack Digital 0x18 Unknown 0 hdaa0: 7 185600f0 15 0 Digital-out Jack Digital 0x18 Unknown 0 hdaa0: 4 associations found: hdaa0: Association 0 (15) out: hdaa0: Pin nid=4 seq=0 hdaa0: Association 1 (15) out: hdaa0: Pin nid=5 seq=0 hdaa0: Association 2 (15) out: hdaa0: Pin nid=6 seq=0 hdaa0: Association 3 (15) out: hdaa0: Pin nid=7 seq=0 hdaa0: Tracing association 0 (15) hdaa0: Pin 4 traced to DAC 8 hdaa0: Association 0 (15) trace succeeded hdaa0: Tracing association 1 (15) hdaa0: Pin 5 traced to DAC 9 hdaa0: Association 1 (15) trace succeeded hdaa0: Tracing association 2 (15) hdaa0: Pin 6 traced to DAC 10 hdaa0: Association 2 (15) trace succeeded hdaa0: Tracing association 3 (15) hdaa0: Pin 7 traced to DAC 11 hdaa0: Association 3 (15) trace succeeded hdaa0: Looking for additional DAC for association 0 (15) hdaa0: Looking for additional DAC for association 1 (15) hdaa0: Looking for additional DAC for association 2 (15) hdaa0: Looking for additional DAC for association 3 (15) hdaa0: Tracing input monitor hdaa0: Tracing other input monitors hdaa0: Tracing beeper hdaa0: FG config/quirks: forcestereo ivref50 ivref80 ivref100 ivref pcm0: at nid 4 on hdaa0 pcm0: Playback: pcm0: Stream cap: 0x00000005 AC3 PCM pcm0: PCM cap: 0x000e07f0 16 20 24 bits, 32 44 48 88 96 176 192 KHz pcm0: DAC: 8 pcm0: pcm0: nid=4 [pin: Digital-out (Jack)] pcm0: + <- nid=8 [audio output] [src: pcm] pcm0: pcm0: Mixer "vol" -> "none": child=0x00000010 pcm0: Mixer "pcm": parent="vol" pcm0: Soft PCM mixer ENABLED pcm0: Playback channel matrix is: unknown, assuming 7.1 (disconnected) pcm1: at nid 5 on hdaa0 pcm1: Playback: pcm1: Stream cap: 0x00000005 AC3 PCM pcm1: PCM cap: 0x000e07f0 16 20 24 bits, 32 44 48 88 96 176 192 KHz pcm1: DAC: 9 pcm1: pcm1: nid=5 [pin: Digital-out (Jack)] pcm1: + <- nid=9 [audio output] [src: pcm] pcm1: pcm1: Mixer "vol" -> "none": child=0x00000010 pcm1: Mixer "pcm": parent="vol" pcm1: Soft PCM mixer ENABLED pcm1: Playback channel matrix is: unknown, assuming 7.1 (disconnected) pcm2: at nid 6 on hdaa0 pcm2: Playback: pcm2: Stream cap: 0x00000005 AC3 PCM pcm2: PCM cap: 0x000e07f0 16 20 24 bits, 32 44 48 88 96 176 192 KHz pcm2: DAC: 10 pcm2: pcm2: nid=6 [pin: Digital-out (Jack)] pcm2: + <- nid=10 [audio output] [src: pcm] pcm2: pcm2: Mixer "vol" -> "none": child=0x00000010 pcm2: Mixer "pcm": parent="vol" pcm2: Soft PCM mixer ENABLED pcm2: Playback channel matrix is: unknown, assuming 7.1 (disconnected) pcm3: at nid 7 on hdaa0 pcm3: Playback: pcm3: Stream cap: 0x00000005 AC3 PCM pcm3: PCM cap: 0x000e07f0 16 20 24 bits, 32 44 48 88 96 176 192 KHz pcm3: DAC: 11 pcm3: pcm3: nid=7 [pin: Digital-out (Jack)] pcm3: + <- nid=11 [audio output] [src: pcm] pcm3: pcm3: Mixer "vol" -> "none": child=0x00000010 pcm3: Mixer "pcm": parent="vol" pcm3: Soft PCM mixer ENABLED pcm3: Playback channel matrix is: unknown, assuming 7.1 (disconnected) hdacc1: at cad 0 on hdac1 hdaa1: at nid 1 on hdacc1 hdaa1: Subsystem ID: 0x1043868f hdaa1: NumGPIO=2 NumGPO=0 NumGPI=0 GPIWake=0 GPIUnsol=1 hdaa1: GPIO0: disabled hdaa1: GPIO1: disabled hdaa1: Original pins configuration: hdaa1: nid 0x as seq device conn jack loc color misc hdaa1: 17 99430130 3 0 SPDIF-out Fixed ATAPI Onboard Unknown 1 hdaa1: 20 01014010 1 0 Line-out Jack 1/8 Rear Green 0 hdaa1: 21 01011012 1 2 Line-out Jack 1/8 Rear Black 0 hdaa1: 22 01016011 1 1 Line-out Jack 1/8 Rear Orange 0 hdaa1: 23 01012014 1 4 Line-out Jack 1/8 Rear Grey 0 hdaa1: 24 01a19050 5 0 Mic Jack 1/8 Rear Pink 0 hdaa1: 25 02a19060 6 0 Mic Jack 1/8 Front Pink 0 hdaa1: 26 0181305f 5 15 Line-in Jack 1/8 Rear Blue 0 hdaa1: 27 02214020 2 0 Headphones Jack 1/8 Front Green 0 hdaa1: 30 01456140 4 0 SPDIF-out Jack Optical Rear Orange 1 hdaa1: Patching widget caps nid=29 0x00f00000 -> 0x00700000 hdaa1: Patched pins configuration: hdaa1: nid 0x as seq device conn jack loc color misc hdaa1: 17 99430130 3 0 SPDIF-out Fixed ATAPI Onboard Unknown 1 hdaa1: 20 01014010 1 0 Line-out Jack 1/8 Rear Green 0 hdaa1: 21 01011012 1 2 Line-out Jack 1/8 Rear Black 0 hdaa1: 22 01016011 1 1 Line-out Jack 1/8 Rear Orange 0 hdaa1: 23 01012014 1 4 Line-out Jack 1/8 Rear Grey 0 hdaa1: 24 01a19050 5 0 Mic Jack 1/8 Rear Pink 0 hdaa1: 25 02a19060 6 0 Mic Jack 1/8 Front Pink 0 hdaa1: 26 0181305f 5 15 Line-in Jack 1/8 Rear Blue 0 hdaa1: 27 02214020 2 0 Headphones Jack 1/8 Front Green 0 hdaa1: 30 01456140 4 0 SPDIF-out Jack Optical Rear Orange 1 hdaa1: 6 associations found: hdaa1: Association 0 (1) out: hdaa1: Pin nid=20 seq=0 hdaa1: Pin nid=22 seq=1 hdaa1: Pin nid=21 seq=2 hdaa1: Pin nid=23 seq=4 hdaa1: Association 1 (2) out: hdaa1: Pin nid=27 seq=0 hdaa1: Association 2 (3) out: hdaa1: Pin nid=17 seq=0 hdaa1: Association 3 (4) out: hdaa1: Pin nid=30 seq=0 hdaa1: Association 4 (5) in: hdaa1: Pin nid=24 seq=0 hdaa1: Pin nid=26 seq=15 hdaa1: Association 5 (6) in: hdaa1: Pin nid=25 seq=0 hdaa1: Tracing association 0 (1) hdaa1: Pin 20 traced to DAC 2 hdaa1: Pin 22 traced to DAC 4 hdaa1: Pin 21 traced to DAC 3 hdaa1: Pin 23 traced to DAC 5 hdaa1: Association 0 (1) trace succeeded hdaa1: Tracing association 1 (2) hdaa1: Pin 27 traced to DAC 37 hdaa1: Association 1 (2) trace succeeded hdaa1: Tracing association 2 (3) hdaa1: Pin 17 traced to DAC 16 hdaa1: Association 2 (3) trace succeeded hdaa1: Tracing association 3 (4) hdaa1: Pin 30 traced to DAC 6 hdaa1: Association 3 (4) trace succeeded hdaa1: Tracing association 4 (5) hdaa1: Pin 24 traced to ADC 8 hdaa1: Pin 26 traced to ADC 8 hdaa1: Association 4 (5) trace succeeded hdaa1: Tracing association 5 (6) hdaa1: Pin 25 traced to ADC 9 hdaa1: Association 5 (6) trace succeeded hdaa1: Looking for additional DAC for association 0 (1) hdaa1: Looking for additional DAC for association 1 (2) hdaa1: Looking for additional DAC for association 2 (3) hdaa1: Looking for additional DAC for association 3 (4) hdaa1: Looking for additional ADC for association 4 (5) hdaa1: Looking for additional ADC for association 5 (6) hdaa1: Tracing input monitor hdaa1: Tracing nid 11 to out hdaa1: nid 11 is input monitor hdaa1: Tracing nid 34 to out hdaa1: Tracing nid 35 to out hdaa1: Tracing other input monitors hdaa1: Tracing nid 24 to out hdaa1: Tracing nid 25 to out hdaa1: Tracing nid 26 to out hdaa1: Tracing beeper hdaa1: FG config/quirks: forcestereo ivref50 ivref80 ivref100 ivref pcm4: at nid 20,22,21,23 and 24,26 on hdaa1 pcm4: Playback: pcm4: Stream cap: 0x00000001 PCM pcm4: PCM cap: 0x000e0560 16 20 24 bits, 44 48 96 192 KHz pcm4: DAC: 2 4 3 5 pcm4: pcm4: nid=20 [pin: Line-out (Green Jack)] pcm4: + <- nid=12 [audio mixer] [src: pcm, mix] pcm4: + <- nid=2 [audio output] [src: pcm] pcm4: + <- nid=11 [audio mixer] [src: mix] pcm4: pcm4: nid=22 [pin: Line-out (Orange Jack)] pcm4: + <- nid=14 [audio mixer] [src: pcm, mix] pcm4: + <- nid=4 [audio output] [src: pcm] pcm4: + <- nid=11 [audio mixer] [src: mix] pcm4: pcm4: nid=21 [pin: Line-out (Black Jack)] pcm4: + <- nid=13 [audio mixer] [src: pcm, mix] pcm4: + <- nid=3 [audio output] [src: pcm] pcm4: + <- nid=11 [audio mixer] [src: mix] pcm4: pcm4: nid=23 [pin: Line-out (Grey Jack)] pcm4: + <- nid=15 [audio mixer] [src: pcm, mix] pcm4: + <- nid=5 [audio output] [src: pcm] pcm4: + <- nid=11 [audio mixer] [src: mix] pcm4: pcm4: Record: pcm4: Stream cap: 0x00000001 PCM pcm4: PCM cap: 0x000e0560 16 20 24 bits, 44 48 96 192 KHz pcm4: ADC: 8 pcm4: pcm4: nid=8 [audio input] pcm4: + <- nid=35 [audio mixer] [src: line, mic, mix] pcm4: + <- nid=24 [pin: Mic (Pink Jack)] [src: mic] pcm4: + <- nid=26 [pin: Line-in (Blue Jack)] [src: line] pcm4: + <- nid=11 [audio mixer] [src: mix] pcm4: pcm4: Input Mix: pcm4: pcm4: nid=11 [audio mixer] pcm4: + <- nid=24 [pin: Mic (Pink Jack)] [src: mic] pcm4: + <- nid=26 [pin: Line-in (Blue Jack)] [src: line] pcm4: pcm4: Master Volume (OSS: vol): -65/0dB pcm4: +- ctl 1 (nid 2 out): -65/0dB (88 steps) pcm4: +- ctl 2 (nid 3 out): -65/0dB (88 steps) pcm4: +- ctl 3 (nid 4 out): -65/0dB (88 steps) pcm4: +- ctl 4 (nid 5 out): -65/0dB (88 steps) pcm4: +- ctl 15 (nid 12 in 0): mute pcm4: +- ctl 16 (nid 12 in 1): mute pcm4: +- ctl 17 (nid 13 in 0): mute pcm4: +- ctl 18 (nid 13 in 1): mute pcm4: +- ctl 19 (nid 14 in 0): mute pcm4: +- ctl 20 (nid 14 in 1): mute pcm4: +- ctl 21 (nid 15 in 0): mute pcm4: +- ctl 22 (nid 15 in 1): mute pcm4: +- ctl 23 (nid 20 in ): mute pcm4: +- ctl 24 (nid 21 in ): mute pcm4: +- ctl 25 (nid 22 in ): mute pcm4: +- ctl 26 (nid 23 in ): mute pcm4: pcm4: PCM Volume (OSS: pcm): -65/0dB pcm4: +- ctl 1 (nid 2 out): -65/0dB (88 steps) pcm4: +- ctl 2 (nid 3 out): -65/0dB (88 steps) pcm4: +- ctl 3 (nid 4 out): -65/0dB (88 steps) pcm4: +- ctl 4 (nid 5 out): -65/0dB (88 steps) pcm4: +- ctl 15 (nid 12 in 0): mute pcm4: +- ctl 17 (nid 13 in 0): mute pcm4: +- ctl 19 (nid 14 in 0): mute pcm4: +- ctl 21 (nid 15 in 0): mute pcm4: pcm4: Microphone Volume (OSS: mic): 0/30dB pcm4: +- ctl 7 (nid 11 in 0): -34/12dB (32 steps) + mute pcm4: +- ctl 28 (nid 24 out): 0/30dB (4 steps) pcm4: +- ctl 44 (nid 35 in 0): mute pcm4: pcm4: Line-in Volume (OSS: line): 0/30dB pcm4: +- ctl 9 (nid 11 in 2): -34/12dB (32 steps) + mute pcm4: +- ctl 32 (nid 26 out): 0/30dB (4 steps) pcm4: +- ctl 46 (nid 35 in 2): mute pcm4: pcm4: Recording Level (OSS: rec): -17/30dB pcm4: +- ctl 5 (nid 8 in 0): -17/30dB (64 steps) + mute pcm4: +- ctl 44 (nid 35 in 0): mute pcm4: +- ctl 46 (nid 35 in 2): mute pcm4: +- ctl 52 (nid 35 in 8): mute pcm4: pcm4: Input Mix Level (OSS: mix): -34/12dB pcm4: +- ctl 7 (nid 11 in 0): -34/12dB (32 steps) + mute pcm4: +- ctl 9 (nid 11 in 2): -34/12dB (32 steps) + mute pcm4: +- ctl 16 (nid 12 in 1): mute pcm4: +- ctl 18 (nid 13 in 1): mute pcm4: +- ctl 20 (nid 14 in 1): mute pcm4: +- ctl 22 (nid 15 in 1): mute pcm4: +- ctl 52 (nid 35 in 8): mute pcm4: pcm4: Input Monitoring Level (OSS: igain): 0/0dB pcm4: +- ctl 16 (nid 12 in 1): mute pcm4: +- ctl 18 (nid 13 in 1): mute pcm4: +- ctl 20 (nid 14 in 1): mute pcm4: +- ctl 22 (nid 15 in 1): mute pcm4: pcm4: Mixer "vol": pcm4: Mixer "pcm": pcm4: Mixer "line": pcm4: Mixer "mic": pcm4: Mixer "mix": pcm4: Mixer "rec": pcm4: Mixer "igain": pcm4: Mixer "ogain": pcm4: Playback channel set is: Front Left, Front Right, Front Center, Low Frequency Effects, Back Left, Back Right, Side Left, Side Right, pcm4: Playback channel matrix is: 7.1 (disconnected) pcm4: Recording channel set is: Front Left, Front Right, pcm4: Recording channel matrix is: 2.0 (disconnected) pcm5: at nid 27 and 25 on hdaa1 pcm5: Playback: pcm5: Stream cap: 0x00000001 PCM pcm5: PCM cap: 0x000e0560 16 20 24 bits, 44 48 96 192 KHz pcm5: DAC: 37 pcm5: pcm5: nid=27 [pin: Headphones (Green Jack)] pcm5: + <- nid=38 [audio mixer] [src: pcm, mix] pcm5: + <- nid=37 [audio output] [src: pcm] pcm5: + <- nid=11 [audio mixer] [src: mix] pcm5: pcm5: Record: pcm5: Stream cap: 0x00000001 PCM pcm5: PCM cap: 0x000e0560 16 20 24 bits, 44 48 96 192 KHz pcm5: ADC: 9 pcm5: pcm5: nid=9 [audio input] pcm5: + <- nid=34 [audio mixer] [src: monitor] pcm5: + <- nid=25 [pin: Mic (Pink Jack)] [src: monitor] pcm5: pcm5: Master Volume (OSS: vol): -65/0dB pcm5: +- ctl 33 (nid 27 in ): mute pcm5: +- ctl 53 (nid 37 out): -65/0dB (88 steps) pcm5: +- ctl 54 (nid 38 in 0): mute pcm5: +- ctl 55 (nid 38 in 1): mute pcm5: pcm5: PCM Volume (OSS: pcm): -65/0dB pcm5: +- ctl 53 (nid 37 out): -65/0dB (88 steps) pcm5: +- ctl 54 (nid 38 in 0): mute pcm5: pcm5: Microphone2 Volume (OSS: monitor): 0/30dB pcm5: +- ctl 6 (nid 9 in 0): -17/30dB (64 steps) + mute pcm5: +- ctl 30 (nid 25 out): 0/30dB (4 steps) pcm5: +- ctl 36 (nid 34 in 1): mute pcm5: pcm5: Recording Level (OSS: rec): -17/30dB pcm5: +- ctl 6 (nid 9 in 0): -17/30dB (64 steps) + mute pcm5: +- ctl 30 (nid 25 out): 0/30dB (4 steps) pcm5: +- ctl 36 (nid 34 in 1): mute pcm5: pcm5: Input Mix Level (OSS: mix) pcm5: +- ctl 55 (nid 38 in 1): mute pcm5: pcm5: Input Monitoring Level (OSS: igain): 0/0dB pcm5: +- ctl 55 (nid 38 in 1): mute pcm5: pcm5: Mixer "vol": pcm5: Mixer "pcm": pcm5: Mixer "rec": pcm5: Mixer "igain": pcm5: Mixer "ogain": pcm5: Mixer "monitor": pcm5: Playback channel set is: Front Left, Front Right, pcm5: Playback channel matrix is: 2.0 (disconnected) pcm5: Recording channel set is: Front Left, Front Right, pcm5: Recording channel matrix is: 2.0 (disconnected) pcm6: at nid 17 on hdaa1 pcm6: Playback: pcm6: Stream cap: 0x00000005 AC3 PCM pcm6: PCM cap: 0x000e05f0 16 20 24 bits, 32 44 48 88 96 192 KHz pcm6: DAC: 16 pcm6: pcm6: nid=17 [pin: SPDIF-out (Fixed)] pcm6: + <- nid=16 [audio output] [src: pcm] pcm6: pcm6: Mixer "vol" -> "none": child=0x00000010 pcm6: Mixer "pcm": parent="vol" pcm6: Soft PCM mixer ENABLED pcm6: Playback channel set is: Front Left, Front Right, pcm6: Playback channel matrix is: 2.0 (unknown) pcm7: at nid 30 on hdaa1 pcm7: Playback: pcm7: Stream cap: 0x00000005 AC3 PCM pcm7: PCM cap: 0x000e05f0 16 20 24 bits, 32 44 48 88 96 192 KHz pcm7: DAC: 6 pcm7: pcm7: nid=30 [pin: SPDIF-out (Orange Jack)] pcm7: + <- nid=6 [audio output] [src: pcm] pcm7: pcm7: Mixer "vol" -> "none": child=0x00000010 pcm7: Mixer "pcm": parent="vol" pcm7: Soft PCM mixer ENABLED pcm7: Playback channel set is: Front Left, Front Right, pcm7: Playback channel matrix is: 2.0 (unknown) usbus1: 5.0Gbps Super Speed USB v3.0 usbus2: 5.0Gbps Super Speed USB v3.0 usbus3: 5.0Gbps Super Speed USB v3.0 ahcich0: AHCI reset... ugen0.1: <0x8086> at usbus0 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ugen1.1: <0x1b21> at usbus1 uhub1: <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1 ugen2.1: <0x1b21> at usbus2 uhub2: <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2 ugen3.1: <0x1b21> at usbus3 uhub3: <0x1b21 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus3 ahcich0: SATA offline status=00000004 ahcich0: AHCI reset: device not found ahcich1: AHCI reset... ahcich1: SATA offline status=00000004 ahcich1: AHCI reset: device not found ahcich2: AHCI reset... ahcich2: SATA connect time=1900us status=00000113 ahcich2: AHCI reset: device found ahcich2: AHCI reset: device ready after 0ms ahcich3: AHCI reset... ahcich3: SATA connect time=1000us status=00000123 ahcich3: AHCI reset: device found ahcich4: AHCI reset... ahcich4: SATA connect time=100us status=00000133 ahcich4: AHCI reset: device found ahcich5: AHCI reset... ahcich5: SATA connect time=1700us status=00000123 ahcich5: AHCI reset: device found ahcich6: AHCI reset... ahcich6: SATA connect time=100us status=00000133 ahcich6: AHCI reset: device found ahcich6: AHCI reset: device ready after 0ms ahcich7: AHCI reset... ahcich7: SATA connect time=100us status=00000133 ahcich7: AHCI reset: device found ahcich3: AHCI reset: device ready after 100ms uhub1: 4 ports with 4 removable, self powered uhub2: 4 ports with 4 removable, self powered uhub3: 4 ports with 4 removable, self powered ahcich4: AHCI reset: device ready after 100ms ahcich5: AHCI reset: device ready after 100ms ahcich7: AHCI reset: device ready after 100ms pass0 at ahcich2 bus 0 scbus2 target 0 lun 0 pass0: Removable CD-ROM SCSI device pass0: Serial Number R8BZ68DB840995 pass0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes) pass1 at ahcich3 bus 0 scbus3 target 0 lun 0 pass1: ATA8-ACS SATA 2.x device pass1: Serial Number WD-WMASU0754532 pass1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) pass1: Command Queueing enabled pass2 at ahcich4 bus 0 scbus4 target 0 lun 0 pass2: ACS-2 ATA SATA 3.x device pass2: Serial Number Z1X3S5XD pass2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) pass2: Command Queueing enabled pass3 at ahcich5 bus 0 scbus5 target 0 lun 0 pass3: ATA8-ACS SATA 2.x device pass3: Serial Number GEA530RE1L82SA pass3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) pass3: Command Queueing enabled pass4 at ahciem0 bus 0 scbus6 target 0 lun 0 pass4: SEMB S-E-S 2.00 device pass5 at ahcich6 bus 0 scbus7 target 0 lun 0 pass5: ACS-2 ATA SATA 3.x device pass5: Serial Number S1SMNSAFC21908L pass5: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) pass5: Command Queueing enabled pass6 at ahcich7 bus 0 scbus8 target 0 lun 0 pass6: ACS-2 ATA SATA 3.x device pass6: Serial Number W1H1K74S pass6: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) pass6: Command Queueing enabled ada0 at ahcich3 bus 0 scbus3 target 0 lun 0 ada0: ATA8-ACS SATA 2.x device ada0: Serial Number WD-WMASU0754532 ada0: 300.000MB/s transfersGEOM: new disk ada0 (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors) ada0: Previously was known as ad10 ada1 at ahcich4 bus 0 scbus4 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number Z1X3S5XD ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 1907729MB (3907029168 512 byte sectors) ada1: Previously was known as ad12 ada2 at ahcich5 bus 0 scbus5 target 0 lun 0 ada2: ATA8-ACS SATA 2.x device ada2: Serial Number GEA530RE1L82SA ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada2: Command Queueing enabled ada2: 476940MB (976773168 512 byte sectors) ada2: Previously was known as ad14 ada3 at ahcich6 bus 0 scbus7 target 0 lun 0 ada3: ACS-2 ATA SATA 3.x device ada3: Serial Number S1SMNSAFC21908L ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada3: Command Queueing enabled ada3: 122104MB (250069680 512 byte sectors) ada3: quirks=0x1<4K> ada3: Previously was known as ad16 ada4 at ahcich7 bus 0 scbus8 target 0 lun 0 ada4: ACS-2 ATA SATA 3.x device ada4: Serial Number W1H1K74S ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada4: Command Queueing enabled ada4: 1907729MB (3907029168 512 byte sectors) ada4: Previously was known as ad18 ses0 at ahciem0 bus 0 scbus6 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device ses0: Generation Code 0x0 has 1 SubEnclosures ses0: SubEnclosure ID 0, 1 Types With this ID, Descriptor Length 36, offset 8 ses0: WWN: 0 cd0 at ahcich2 bus 0 scbus2 target 0 lun 0 ses0: Type Desc[0]: Type 0x17, MaxElt 6, In Subenc 0, Text Length 0: cd0: Removable CD-ROM SCSI device cd0: Serial Number R8BZ68DB840995 cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed ugen3.2: at usbus3 GEOM: new disk ada1 GEOM: new disk ada2 GEOM: new disk ada3 GEOM: new disk ada4 ukbd0: on usbus3 kbd2 at ukbd0 kbd2: ukbd0, generic (0), config:0x0, flags:0x3d0000 uhub0: 26 ports with 26 removable, self powered Netvsc initializing... done! lapic5: CMCI unmasked lapic6: CMCI unmasked lapic7: CMCI unmasked lapic4: CMCI unmasked lapic3: CMCI unmasked lapic2: CMCI unmasked SMP: AP CPU #1 Launched! cpu1 AP: ID: 0x01000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 cmci: 0x000100f2 SMP: AP CPU #3 Launched! cpu3 AP: ID: 0x03000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 cmci: 0x000000f2 SMP: AP CPU #4 Launched! cpu4 AP: ID: 0x04000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 cmci: 0x000000f2 SMP: AP CPU #7 Launched! cpu7 AP: ID: 0x07000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 cmci: 0x000000f2 SMP: AP CPU #2 Launched! cpu2 AP: ID: 0x02000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 cmci: 0x000000f2 SMP: AP CPU #6 Launched! cpu6 AP: ID: 0x06000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 cmci: 0x000000f2 SMP: AP CPU #5 Launched! cpu5 AP: ID: 0x05000000 VER: 0x01060015 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 cmci: 0x000000f2 ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 1 vector 48 ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 2 vector 48 ioapic0: routing intpin 17 (PCI IRQ 17) to lapic 3 vector 48 msi: Assigning MSI-X IRQ 257 to local APIC 1 vector 49 msi: Assigning MSI-X IRQ 258 to local APIC 2 vector 49 msi: Assigning MSI-X IRQ 259 to local APIC 3 vector 49 msi: Assigning MSI-X IRQ 260 to local APIC 4 vector 48 msi: Assigning MSI-X IRQ 261 to local APIC 5 vector 48 msi: Assigning MSI-X IRQ 262 to local APIC 6 vector 48 msi: Assigning MSI-X IRQ 263 to local APIC 7 vector 48 msi: Assigning MSI IRQ 264 to local APIC 4 vector 49 msi: Assigning MSI IRQ 265 to local APIC 5 vector 49 msi: Assigning MSI IRQ 266 to local APIC 6 vector 49 msi: Assigning MSI IRQ 267 to local APIC 7 vector 49 msi: Assigning MSI-X IRQ 270 to local APIC 1 vector 50 msi: Assigning MSI-X IRQ 271 to local APIC 1 vector 51 msi: Assigning MSI IRQ 272 to local APIC 2 vector 50 msi: Assigning MSI IRQ 273 to local APIC 3 vector 50 msi: Assigning MSI IRQ 274 to local APIC 4 vector 50 GEOM: new disk cd0 SMP: passed TSC synchronization test TSC timecounter discards lower 1 bit(s) Timecounter "TSC-low" frequency 2004086274 Hz quality 1000 GEOM_PART: partition 1 on (ada4, GPT) is not aligned on 4096 bytes GEOM_PART: partition 1 on (diskid/DISK-W1H1K74S, GPT) is not aligned on 4096 bytes Root mount waiting for: usbus3 usbus0 ugen3.3: at usbus3 uhub4: on usbus3 ugen0.2: at usbus0 uhub5: on usbus0 uhub5: MTT enabled uhub4: 2 ports with 2 removable, self powered uhub5: 4 ports with 4 removable, self powered ugen0.3: at usbus0 Root mount waiting for: usbus0 ugen0.4: at usbus0 Trying to mount root from zfs:zroot2 []... start_init: trying /sbin/init linprocfs registered uhid0: on usbus3 ums0: on usbus0 ums0: 5 buttons and [XYZT] coordinates ID=26 igb0: Link is up 1000 Mbps Full Duplex, Flow Control: Full igb0: link state changed to UP WARNING: attempt to domain_add(bluetooth) after domainfinalize() hdaa0: Pin sense: nid=5 sense=0x80000000 (connected) pcm1: Playback channel matrix is: unknown, assuming 7.1 (connected) hdaa0: Pin sense: nid=5 sense=0xc0000000 (connected, ELD valid) hdaa0: ELD nid=5: ELD_Ver=2 Baseline_ELD_Len=8 hdaa0: ELD nid=5: CEA_EDID_Ver=3 MNL=13 hdaa0: ELD nid=5: SAD_Count=1 Conn_Type=1 S_AI=0 HDCP=0 hdaa0: ELD nid=5: Aud_Synch_Delay=0ms hdaa0: ELD nid=5: Channels=0x1 hdaa0: ELD nid=5: Port_ID=0x0004000000000000 hdaa0: ELD nid=5: Manufacturer_Name=0x10ac hdaa0: ELD nid=5: Product_Code=0xbd40 hdaa0: ELD nid=5: Monitor_Name_String='DELL P2715Q ' hdaa0: ELD nid=5: LPCM 2ch freqs=0x1f<96,88,48,44,32> sizes=0x7<24,20,16> pcm1: Playback channel set is: Front Left, Front Right, pcm1: Playback channel matrix is: 2.0 (connected) From owner-freebsd-stable@freebsd.org Sat Feb 13 17:02:51 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 923BFAA6B02 for ; Sat, 13 Feb 2016 17:02:51 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1212F1597 for ; Sat, 13 Feb 2016 17:02:50 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id u1DH2eVm015308 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Sat, 13 Feb 2016 19:02:40 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua u1DH2eVm015308 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id u1DH2doh015307; Sat, 13 Feb 2016 19:02:39 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 13 Feb 2016 19:02:39 +0200 From: Konstantin Belousov To: Mark Dixon Cc: freebsd-stable@freebsd.org Subject: Re: Is UEFI required for ZFS? Message-ID: <20160213170239.GD91220@kib.kiev.ua> References: <56BDFAA4.17139.1EEE35@lausts.acm.org> <20160212185659.GC26283@home.opsec.eu> <20160213100936.GY91220@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on tom.home X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Feb 2016 17:02:51 -0000 On Sat, Feb 13, 2016 at 03:46:16PM +0000, Mark Dixon wrote: > I don't think I can clock it down, although the UEFI bios screens are > massively confusing so I could be wrong. > > Verbose dmesg: Might be, try the following (mostly debugging) change. diff --git a/sys/boot/i386/libi386/time.c b/sys/boot/i386/libi386/time.c index c27dcf6..592d64a 100644 --- a/sys/boot/i386/libi386/time.c +++ b/sys/boot/i386/libi386/time.c @@ -97,8 +97,8 @@ time(time_t *t) * Resolution of this function is variable, but typically around * 1ms. */ -void -delay(int period) +static void +delay_bios(int period) { v86.ctl = 0; v86.addr = 0x15; /* int 0x15, function 0x86 */ @@ -107,3 +107,53 @@ delay(int period) v86.edx = period & 0xffff; v86int(); } + +static uint64_t rd; + +static __inline uint64_t +rdtsc(void) +{ + uint64_t rv; + + __asm __volatile("rdtsc" : "=A" (rv)); + return (rv); +} + +static void +delay_rdtsc_calibrate(void) +{ + int x1, x2; + uint64_t s, f; + + for (x1 = bios_seconds(); x1 == (x2 = bios_seconds());) + ; + s = rdtsc(); + for (; x2 == (x1 = bios_seconds());) + ; + f = rdtsc(); + rd = f - s; + printf("rd %llx\n", rd); +} + +static void +delay_rdtsc(int period) +{ + uint64_t x; + + x = rdtsc() + rd / 1000000; + while (rdtsc() < x) + ; +} + +void +delay(int period) +{ + + if (0) { + delay_bios(period); + } else { + if (rd == 0) + delay_rdtsc_calibrate(); + delay_rdtsc(period); + } +} From owner-freebsd-stable@freebsd.org Sat Feb 13 21:51:46 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 61FA8AA7505 for ; Sat, 13 Feb 2016 21:51:46 +0000 (UTC) (envelope-from richard.huber@computeroxy.com) Received: from v071065.home.net.pl (v071065.home.net.pl [79.96.79.199]) by mx1.freebsd.org (Postfix) with SMTP id CB18D1DE9 for ; Sat, 13 Feb 2016 21:51:44 +0000 (UTC) (envelope-from richard.huber@computeroxy.com) Received: from v071065.home.net.pl (79.96.79.199) (HELO www.computeroxy.com) by serwer1571831.home.pl (79.96.79.199) with SMTP (IdeaSmtpServer v0.80) id 644ace9ea44479b0; Sat, 13 Feb 2016 22:45:02 +0100 Date: Sat, 13 Feb 2016 22:45:02 +0100 To: freebsd-stable@freebsd.org From: Richard Huber Subject: New academic vacancies at Computeroxy Message-ID: <307c40757196e193a81b7d7628bbf6d2@www.computeroxy.com> X-Priority: 3 X-Mailer: PHPMailer [version 1.73] MIME-Version: 1.0 Content-Type: text/plain; charset = "UTF-8" Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Feb 2016 21:51:46 -0000 Computeroxy Dear Colleague, We are pleased to present you our specialised newsletter including your academic vacancies in schools of computer, electrical and mathematical sciences and engineering at Computeroxy.com worldwide. Australia Associate Professor/Professor of Maintenance Engineering PRIORITY! School of Engineering and Information Technology Charles Darwin University Postdoctoral Research Fellow in Artificial Intelligence Western Sydney University, School of Computing, Engineering, and Mathematics Research Fellow in Mathematics University of Melbourne, School of Mathematics and Statistics Postdoctoral Fellow in Statistics Research School of Finance, Actuarial Studies and Statistics, Australian National University Research Fellow in Computer Science Department of Computing and Information Systems, Melbourne University Austria Research Group Leader, Theoretical Quantum Physics PRIORITY! The Institute for Quantum Optics and Quantum Information – Vienna Head of Central Service Computer Science University of Innsbruck,Central of Computer Science Assistant Professor of Nanosciences University of Innsbruck,Department of Engineering Belgium Senior Academic Staff, Experimental research on transport phenomena in energy applications PRIORITY! KU Leuven Postdoctoral position in Statistics Ghent Univgersity, Department of Applied mathematics,Computer Science and Statistics Faculty Position in Data Backup Ghent Univgersity, Department of Telecommunications and Information Processing Senior Lecturer in Data Analytics Ghent University, Department of Information Technology Canada Research Chair Engineering Physics PRIORITY! Polytechnique Montréal Instructor in Software Engineering University of Calgary, Department of Electrical and Computer Engineering Tenure-Track Assistant Professor Position in Artificial Intelligence University of Alberta, Department of Computing Science Tenure-Track Assistant Professor Position in Software Systems University of Alberta, Department of Computing Science Assistant Professor of Dynamical Systems University of Alberta, Department of Mathematical and Statistical Sciences Term Assistant Professor of Maths University of Alberta, Department of Mathematical and Statistical Sciences Instructor in Computer Science University of Calgary, Department of Computer Science China Senior and Junior Faculty Positions, different disciplines of Engineering and Sciences PRIORITY! Guangdong-Technion Israel Institute of Technology Faculty positions in School of Information Science and Technology PRIORITY! ShanghaiTech University China Colombia Head of the Department of Electrical and Electronic Engineering PRIORITY! The Universidad de los Andes Estonia Professor for Cognitronics PRIORITY! Department of Electronics, Tallinn University of Technology Finland Tenure track or tenured position in algorithms, logic and complexity PRIORITY! Aalto University School of Science, Finland France Full professor position in Computational Mechanics of Solids and Structures PRIORITY! Université Pierre et Marie Curie Germany Research Assistant in Computer Science Technical University of Munich, Faculty of Software Engineering Research Assistant in Web Development Technical University of Munich, Department of Electrical and Computer Engineering PhD Positions in Multicore Processor Architectures Technical University of Munich, Institute for Integrated Systems Research Assistant in Computer Architecture Technical University of Munich, Department of Informatics Professorship of Computer Science Technical University of Munich, Faculty of Computer Science Research Assistant in Electrical Engineering Technical University of Munich, Department of Electrical and Computer Engineering Research Associate in Cyber Security Institute of computer science, Chair Mobile and Distributed Systems, University of Munich Research Associate in Mobile Internet Institute of computer science, Chair Mobile and Distributed Systems, University of Munich Hong Kong Professors of Systems Engineering and Engineering Management PRIORITY! The Chineese University of Hong Kong Professors / Associate Professors / Assistant Professors of Energy and Environmental Engineering PRIORITY! Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Professors / Associate Professors / Assistant Professors of Robotics and Automation PRIORITY! Department of Mechanical and Automation Engineering The Chinese University of Hong Kong Ireland Postdoc recruitment in Computer Science and Electronic and Electrical Engineering PRIORITY! CONNECT, Trinity College of Dublin, Ireland Lectureship in Financial Mathematics University College Cork, School of Mathematical Sciences Lecturer in Applied Mathematics University College Cork, School of Mathematical Sciences Japan Professor of Computer Science Kyoto University, Department of Computer Engineering Lebanon Part-Time Faculty Position in Computer Science Lebanese American University, Department of Computer Science and Mathematics Part-Time Faculty Position in Computer Engineering Lebanese American University, Department of Electrical and Computer Engineering Netherlands Full Professor of Computational Materials Science PRIORITY! TU Delft Tenure Track Assistant Professor Software Engineering University of Groningen, Faculty of Mathematics and Natural Sciences Tenure Track Assistant Professor of Information Systems University of Groningen, Faculty of Mathematics and Natural Sciences Tenure Track Assistant Professor of Information Systems University of Groningen, Faculty of Mathematics and Natural Sciences PhD Candidate in Simulation-aided Runtime System Optimization University of Amsterdam, Information Institute Tenure Track Assistant Professor of Information Systems University of Groningen, Faculty of Mathematics and Natural Sciences PhD Candidate in Scientific Computing for Networks University of Amsterdam, Faculty of Science Assistant Professor of Information Processing in Complex Adaptive System University of Amsterdam, Information Institute New Zealand Joint Professorial Chair in Spatial Information PRIORITY! University of Canterbury, College of Science Senior Lecturer in Statistics Massey University, College of Sciences Qatar Two Faculty Positions in Computer Science PRIORITY! School of Computer Science, Carnegie Mellon University (Qatar campus) Two Postdoctoral Positions in Computer Science PRIORITY! School of Computer Science, Carnegie Mellon University (Qatar campus) Saudi Arabia Faculty positions in Computer Science PRIORITY! King Abdullah University of Science and Technology (KAUST) Faculty positions in Electrical Engineering PRIORITY! King Abdullah University of Science and Technology (KAUST) Faculty positions in Statistics PRIORITY! King Abdullah University of Science and Technology (KAUST) Faculty position in Mathematical Biology PRIORITY! King Abdullah University of Science and Technology (KAUST) Professor (all levels) in Data Integration PRIORITY! King Abdullah University of Science and Technology (KAUST) Professor (all levels) in Bioinformatics and Computational Biology PRIORITY! King Abdullah University of Science and Technology (KAUST) Singapore Biostatistics PRIORITY! Nanyang Technological University, Singapore Computational Biomedicine PRIORITY! Nanyang Technological University, Singapore PhD Programme PRIORITY! Singapore University of Technology and Design (SUTD) Sweden Full Professor/Professor in Antenna Systems PRIORITY! Chalmers University of Technology, Department of Signals and Systems Full Professor in Information Systems Chalmers University of Technology, Division of informatics United Arab Emirates Research/Teaching Associate in the field of Electromagnetic Separation PRIORITY! The Petroleum Institute Abu Dhabi, United Arab Emirates United Kingdom PhD Position in Electronic / Biomedical Engineering PRIORITY! Ulster University Lecturer/Senior Lecturer in Spacecraft Dynamics PRIORITY! Surrey University, Department of Electrical and Electronic Engineering Professor of Cyber Security University of Derby, Department of Computing and Maths Lecturer in Nanoelectronics University of Southhampton, Department of Electronics and Computer Science Research Associate in Power Electronics University of Manchester, School of Electrical & Electronic Engineering Assistant Professorship in Cybercrime Tilburg Institute for Law, Technology, and Society Research Fellow in Mathematical Modelling of Excitable Dynamics University of Exeter, College of Engineering, Mathematics and Physical Sciences Senior Lecturer in Computer Programming Worcester Business School Fielden Chair in Pure Mathematics University of Manchester, School of Mathematics United States Assistant Professor of Experimental Fluid Dynamics/Aerodynamics of High-Speed Flows PRIORITY! University of Arizona Assistant Professor/Computer Science PRIORITY! Southern Oregon University, Department of Computer Science Department Chair, Computer Science PRIORITY! Central Washington University Non tenured Teaching Professor in Power Engineering and Advanced Manufacturing PRIORITY! The University of North Carolina at Charlotte Full-time non-tenure track faculty position in Computer Science PRIORITY! The Boston College Computer Science Department Candidates (all ranks) in Energy Transfer PRIORITY! The Department of Mechanical and Aerospace Engineering University of Virginia Candidates (all ranks) in Cyber-Physical Systems PRIORITY! The Department of Mechanical and Aerospace Engineering University of Virginia Assistant Professor (Multiple Positions) in Autonomous Vehicles and Systems PRIORITY! Department of Aerospace and Mechanical Engineering University of Arizona Eight (8) Faculty Positions in Cyber-Physical Systems PRIORITY! The University of Virginia School of Engineering and Applied Science Chair of Web Design Ashford University, College of Liberal Arts Assistant Professor of Computer Science University of Colorado, Department of Computer Science Faculty Position in Developmental Mathematics Austin Community College, Department of Mathematics Chair of Computer Science and Database Technology Ashford University Assistant Professor of Computer Science Xavier University, Department of Computer Science Open Rank Tenure Track Faculty Position in Electrical and Computer Engineering Chicago Computer Science Department, University of Illinois Non-Tenure Track Teaching Faculty in Computer Science Chicago Computer Science Department, University of Illinois Faculty Position in Computer Security Chicago Computer Science Department, University of Illinois Lecturer in Mathematics Department of Mathematics, University of California, Berkeley Lecturer in Department of Mathematics University of California Berkeley Lecturer in Electrical Engineering and Computer Science University of California Berkeley Lecturer in Electrical Engineering University of California Lecturer in Mathematics University of California and many more at Computeroxy.com To learn more about these and other job vacancies, we invite you to visit our website www.computeroxy.com and/or to "register" and/or to "contact us". Want to post a job vacancy? Attract the attention of our academic audience of more than 320.000 professors, lecturers, researchers and academic managers who are at present employed in the highest-ranking schools of computer, electrical and mathematical sciences and engineering worldwide and who receive our specialised newsletters twice a month "post a job vacancy on Computeroxy" and/or to "contact us". Yours faithfully Richard Huber PhD COMPUTEROXY Your Academic Vacancies in Schools of Computer, Electrical and Mathematical Sciences and Engineering Europe - Asia - The Americas - Oceania - The Middle East - Africa computeroxy@computeroxy.com www.computeroxy.comIf you do not wish to receive Computeroxy newsletters or have received it by mistake, you may unsubscribe by replying to Computeroxy with the word "unsubscribe" in the subject line. Thank you very much.