From owner-freebsd-stable@freebsd.org Sun Oct 4 18:31:45 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DCDE3A10CF3; Sun, 4 Oct 2015 18:31:45 +0000 (UTC) (envelope-from kraduk@gmail.com) Received: from mail-wi0-x22c.google.com (mail-wi0-x22c.google.com [IPv6:2a00:1450:400c:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 73420103A; Sun, 4 Oct 2015 18:31:45 +0000 (UTC) (envelope-from kraduk@gmail.com) Received: by wiclk2 with SMTP id lk2so92335818wic.0; Sun, 04 Oct 2015 11:31:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=9v9FoMkJL0TBpnn5//lni8vzaVCNhNX1aBLQRMyLdUU=; b=kSbkgqIEZflfbqFzWjlADJrGYB1AbZSG8ZJISOQ2TBximEPmDUkCXzU7a+DqSHTa/5 2lcIOdeHZBHHRyGJtVu1gV841JEu992HJcPCbHkgFJCfCf3swONLjDGTFg906LzI0hXF PXbIsiFveea41uMEPPf5+IyxSRAWBb/kI2rmB25VINDVMqGXrFcMM2REp3xT8DAuQ0hi joHEWGlnFFEnIy/hML1fLMLtwqegGFNibEpzyEUvXuCG2GbvzTuUxdL5m0Pqqq8cxRXc IUXj9m6mRPiwZptnzI+brUnw8RY9/qp+r8VayGrM3OpIenhGtqW66KTHE5Y44QmH0EeT dsXw== MIME-Version: 1.0 X-Received: by 10.180.206.45 with SMTP id ll13mr7310391wic.6.1443983503792; Sun, 04 Oct 2015 11:31:43 -0700 (PDT) Received: by 10.28.125.18 with HTTP; Sun, 4 Oct 2015 11:31:43 -0700 (PDT) Date: Sun, 4 Oct 2015 19:31:43 +0100 Message-ID: Subject: transparent redirection with pf and squid From: krad To: FreeBSD Questions , freebsd-stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Oct 2015 18:31:46 -0000 Is anyone else having problems with squid core dumping on Freebsd 10-stable when using the transparent caching feature. It started happening recently after I re enabled ipv6 on my network. It may just be coincidence though. It has even caused the odd kernel panic but not every time. FreeBSD xx 10.2-STABLE FreeBSD 10.2-STABLE #6: Wed Sep 9 16:01:15 BST 2015 root@r2:/build/stable/usr/obj/build/stable/usr/src/sys/me amd64 Oct 4 17:13:09 hunters6 kernel: Fatal trap 12: page fault while in kernel mode Oct 4 17:13:09 hunters6 kernel: cpuid = 1; apic id = 02 Oct 4 17:13:09 hunters6 kernel: fault virtual address = 0x28 Oct 4 17:13:09 hunters6 kernel: fault code = supervisor read data, page not present Oct 4 17:13:09 hunters6 kernel: instruction pointer = 0x20:0xffffffff807f27a9 Oct 4 17:13:09 hunters6 kernel: stack pointer = 0x28:0xfffffe011be4a390 Oct 4 17:13:09 hunters6 kernel: frame pointer = 0x28:0xfffffe011be4a3f0 Oct 4 17:13:09 hunters6 kernel: code segment = base 0x0, limit 0xfffff, type 0x1b Oct 4 17:13:09 hunters6 kernel: = DPL 0, pres 1, long 1, def32 0, gran 1 Oct 4 17:13:09 hunters6 kernel: processor eflags = interrupt enabled, resume, IOPL = 0 Oct 4 17:13:09 hunters6 kernel: current process = 10269 (squid) Oct 4 17:13:09 hunters6 kernel: trap number = 12 Oct 4 17:13:09 hunters6 kernel: panic: page fault Oct 4 17:13:09 hunters6 kernel: cpuid = 1 Oct 4 17:13:09 hunters6 kernel: KDB: stack backtrace: Oct 4 17:13:09 hunters6 kernel: #0 0xffffffff8062f920 at kdb_backtrace+0x60 Oct 4 17:13:09 hunters6 kernel: #1 0xffffffff805f48f6 at vpanic+0x126 Oct 4 17:13:09 hunters6 kernel: #2 0xffffffff805f47c3 at panic+0x43 Oct 4 17:13:09 hunters6 kernel: #3 0xffffffff808c5eeb at trap_fatal+0x36b Oct 4 17:13:09 hunters6 kernel: #4 0xffffffff808c61ed at trap_pfault+0x2ed Oct 4 17:13:09 hunters6 kernel: #5 0xffffffff808c588a at trap+0x47a Oct 4 17:13:09 hunters6 kernel: #6 0xffffffff808abb52 at calltrap+0x8 Oct 4 17:13:09 hunters6 kernel: #7 0xffffffff807d3a9f at in6_mapped_peeraddr+0xcf Oct 4 17:13:09 hunters6 kernel: #8 0xffffffff805b0048 at export_fd_to_sb+0x6c8 Oct 4 17:13:09 hunters6 kernel: #9 0xffffffff805af880 at kern_proc_filedesc_out+0x3d0 Oct 4 17:13:09 hunters6 kernel: #10 0xffffffff8059c7bd at note_procstat_files+0xfd Oct 4 17:13:09 hunters6 kernel: #11 0xffffffff8059a3a4 at elf64_coredump+0x314 Oct 4 17:13:09 hunters6 kernel: #12 0xffffffff805f7f4c at sigexit+0xb6c Oct 4 17:13:09 hunters6 kernel: #13 0xffffffff805f85a6 at postsig+0x286 Oct 4 17:13:09 hunters6 kernel: #14 0xffffffff806403f7 at ast+0x427 gdb back trace of core file #0 0x000000080264772a in thr_kill () from /lib/libc.so.7 #1 0x0000000802647716 in raise () from /lib/libc.so.7 #2 0x0000000802647699 in abort () from /lib/libc.so.7 #3 0x00000008026ae021 in __assert () from /lib/libc.so.7 #4 0x0000000000875433 in Ip::Address::getInAddr (this=0x803a13ee4, buf=@0x7fffffffddf8) at Address.cc:1024 #5 0x0000000000875f5c in Ip::Intercept::PfInterception (this=0xf0a190, newConn=@0x7fffffffe340, silent=0) at Intercept.cc:326 #6 0x00000000008767e6 in Ip::Intercept::Lookup (this=0xf0a190, newConn=@0x7fffffffe340, listenConn=@0x803a14310) at Intercept.cc:390 #7 0x000000000095fed9 in Comm::TcpAcceptor::oldAccept (this=0x803a142d8, details=@0x7fffffffe340) at TcpAcceptor.cc:408 #8 0x000000000095e9a7 in Comm::TcpAcceptor::acceptOne (this=0x803a142d8) at TcpAcceptor.cc:268 #9 0x000000000095e939 in Comm::TcpAcceptor::acceptNext (this=0x803a142d8) at TcpAcceptor.cc:298 #10 0x000000000095de44 in Comm::TcpAcceptor::doAccept (fd=28, data=0x803a142d8) at TcpAcceptor.cc:230 #11 0x000000000095b115 in Comm::DoSelect (msec=379) at ModKqueue.cc:278 #12 0x000000000086d064 in CommSelectEngine::checkEvents (this=0x7fffffffe928, timeout=379) at comm.cc:1829 #13 0x00000000006427fa in EventLoop::checkEngine (this=0x7fffffffe940, engine=0x7fffffffe928, primary=true) at EventLoop.cc:35 #14 0x0000000000642e3f in EventLoop::runOnce (this=0x7fffffffe940) at EventLoop.cc:114 #15 0x0000000000642b6f in EventLoop::run (this=0x7fffffffe940) at EventLoop.cc:82 #16 0x00000000006dccae in SquidMain (argc=3, argv=0x7fffffffebd0) at main.cc:1533 #17 0x00000000006db9fa in SquidMainSafe (argc=3, argv=0x7fffffffebd0) at main.cc:1258 #18 0x00000000006db9d2 in main (argc=3, argv=0x7fffffffebd0) at main.cc:1251 rdr pass on private inet proto tcp from ! to ! (private:network) port = http -> 192.168.210.65 port 3127 rdr pass on private inet6 proto tcp from ! to ! (private:network) port = http -> 2001:470:1f09:1c21::65 port 3127 rdr pass on private inet proto tcp from ! to ! (private:network) port = https -> 192.168.210.65 port 3129 rdr pass on private inet6 proto tcp from ! to ! (private:network) port = https -> 2001:470:1f09:1c21::65 port 3129 # squid -v Squid Cache: Version 3.5.9 Service Name: squid configure options: '--with-default-user=squid' '--bindir=/usr/local/sbin' '--sbindir=/usr/local/sbin' '--datadir=/usr/local/etc/squid' '--libexecdir=/usr/local/libexec/squid' '--localstatedir=/var' '--sysconfdir=/usr/local/etc/squid' '--with-logdir=/var/log/squid' '--with-pidfile=/var/run/squid/squid.pid' '--with-swapdir=/var/squid/cache' '--without-gnutls' '--enable-auth' '--enable-build-info' '--enable-loadable-modules' '--enable-removal-policies=lru heap' '--disable-epoll' '--disable-linux-netfilter' '--disable-linux-tproxy' '--disable-translation' '--disable-arch-native' '--disable-eui' '--disable-cache-digests' '--disable-delay-pools' '--disable-ecap' '--disable-esi' '--disable-follow-x-forwarded-for' '--enable-htcp' '--enable-icap-client' '--disable-icmp' '--enable-ident-lookups' '--enable-ipv6' '--enable-kqueue' '--without-large-files' '--disable-http-violations' '--without-nettle' '--enable-snmp' '--enable-ssl' '--enable-ssl-crtd' '--disable-stacktraces' '--disable-ipf-transparent' '--disable-ipfw-transparent' '--enable-pf-transparent' '--with-nat-devpf' '--disable-forw-via-db' '--enable-wccp' '--enable-wccpv2' '--without-heimdal-krb5' '--without-mit-krb5' '--without-gss' '--enable-auth-basic=DB SMB_LM MSNT-multi-domain NCSA PAM POP3 RADIUS fake getpwnam NIS' '--enable-auth-digest=file' '--enable-external-acl-helpers=file_userip time_quota unix_group' '--enable-auth-negotiate=none' '--enable-auth-ntlm=fake smb_lm' '--enable-storeio=ufs aufs diskd' '--enable-disk-io=AIO Blocking IpcIo Mmapped DiskThreads DiskDaemon' '--enable-log-daemon-helpers=file' '--enable-url-rewrite-helpers=fake' '--enable-storeid-rewrite-helpers=file' '--with-openssl=/usr' '--disable-optimizations' '--enable-debug-cbdata' '--prefix=/usr/local' '--mandir=/usr/local/man' '--infodir=/usr/local/info/' '--build=amd64-portbld-freebsd10.2' 'build_alias=amd64-portbld-freebsd10.2' 'CC=cc' 'CFLAGS=-pipe -I/usr/include -g -fstack-protector -fno-strict-aliasing' 'LDFLAGS= -pthread -L/usr/lib -fstack-protector' 'LIBS=' 'CPPFLAGS=' 'CXX=c++' 'CXXFLAGS=-pipe -I/usr/include -g -fstack-protector -fno-strict-aliasing ' 'CPP=cpp' --enable-ltdl-convenience # grep http.*_port /usr/local/etc/squid/squid.conf http_access deny !Safe_ports http_access deny CONNECT !SSL_ports http_port [2001:470:1f09:1c21::65]:3127 intercept http_port 192.168.210.65:3127 intercept http_port [2001:470:1f09:1c21::65]:3128 ssl-bump generate-host-certificates=on dynamic_cert_mem_cache_size=4MB cert=/jails/tproxy/opt/qlproxy/etc/myca.pem http_port 192.168.210.65:3128 ssl-bump generate-host-certificates=on dynamic_cert_mem_cache_size=4MB cert=/jails/tproxy/opt/qlproxy/etc/myca.pem https_port [2001:470:1f09:1c21::65]:3129 intercept ssl-bump generate-host-certificates=on dynamic_cert_mem_cache_size=4MB cert=/jails/tproxy/opt/qlproxy/etc/myca.pem https_port 192.168.210.65:3129 intercept ssl-bump generate-host-certificates=on dynamic_cert_mem_cache_size=4MB cert=/jails/tproxy/opt/qlproxy/etc/myca.pem From owner-freebsd-stable@freebsd.org Sun Oct 4 19:20:04 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 549F5A10737 for ; Sun, 4 Oct 2015 19:20:04 +0000 (UTC) (envelope-from lists@searchy.net) Received: from j006.host001.searchy.nl (j006.host001.searchy.nl [79.143.214.199]) by mx1.freebsd.org (Postfix) with ESMTP id DCF061A05 for ; Sun, 4 Oct 2015 19:20:03 +0000 (UTC) (envelope-from lists@searchy.net) Received: from [192.168.5.21] (5418453B.cm-5-1b.dynamic.ziggo.nl [84.24.69.59]) (Authenticated sender: ppi@j006.host001.searchy.nl) by j006.host001.searchy.nl (Postfix) with ESMTPSA id 9C5831E8C07; Sun, 4 Oct 2015 19:19:55 +0000 (UTC) Message-ID: <56117BD8.10806@searchy.net> Date: Sun, 04 Oct 2015 21:19:52 +0200 From: "Frank de Bot (lists)" User-Agent: Mozilla/5.0 (X11; Linux i686; rv:34.0) Gecko/20100101 Firefox/34.0 SeaMonkey/2.31 MIME-Version: 1.0 To: Jack Vogel CC: FreeBSD Stable Subject: Re: em0 and em1 watchdog timed out References: <560EC0C6.409@searchy.net> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Oct 2015 19:20:04 -0000 FreeBSD 10.2 r286666 . The drivers is Intel(R) PRO/1000 Network Connection 7.4.2 I will start some tests without lagg configured. Regards, Frank de Bot Jack Vogel wrote: > You missed the all-important details: OS version, driver version. > And another question I can think of, do these interfaces watchdog if they > are not configured with lagg? > > Cheers, > > Jack > > > On Fri, Oct 2, 2015 at 10:37 AM, Frank de Bot (lists) > wrote: > >> On a server I have 2 interfaces configured in a lagg. It seemed to be >> running stable until now (about a week), both interfaces repeatable go >> down after a watchdog timeout. >> >> Output from /var/log/messages >> >> Oct 2 10:15:11 nas kernel: em0: Watchdog timeout Queue[0]-- resetting >> Oct 2 10:15:11 nas kernel: Interface is RUNNING and ACTIVE >> Oct 2 10:15:11 nas kernel: em0: TX Queue 0 ------ >> Oct 2 10:15:11 nas kernel: em0: hw tdh = 804, hw tdt = 905 >> Oct 2 10:15:11 nas kernel: em0: Tx Queue Status = -2147483648 >> Oct 2 10:15:11 nas kernel: em0: TX descriptors avail = 915 >> Oct 2 10:15:11 nas kernel: em0: Tx Descriptors avail failure = 0 >> Oct 2 10:15:11 nas kernel: em0: RX Queue 0 ------ >> Oct 2 10:15:11 nas kernel: em0: hw rdh = 912, hw rdt = 911 >> Oct 2 10:15:11 nas kernel: em0: RX discarded packets = 0 >> Oct 2 10:15:11 nas kernel: em0: RX Next to Check = 912 >> Oct 2 10:15:11 nas kernel: em0: RX Next to Refresh = 911 >> Oct 2 10:15:11 nas kernel: em0: link state changed to DOWN >> Oct 2 10:15:13 nas kernel: em0: link state changed to UP >> Oct 2 10:15:13 nas devd: Executing '/etc/rc.d/dhclient quietstart em0' >> Oct 2 10:21:56 nas kernel: em1: Interface stopped DISTRIBUTING, >> possible flapping >> Oct 2 10:21:59 nas kernel: em1: Watchdog timeout Queue[0]-- resetting >> Oct 2 10:21:59 nas kernel: Interface is RUNNING and ACTIVE >> Oct 2 10:21:59 nas kernel: em1: TX Queue 0 ------ >> Oct 2 10:21:59 nas kernel: em1: hw tdh = 686, hw tdt = 806 >> Oct 2 10:21:59 nas kernel: em1: Tx Queue Status = -2147483648 >> Oct 2 10:21:59 nas kernel: em1: TX descriptors avail = 896 >> Oct 2 10:21:59 nas kernel: em1: Tx Descriptors avail failure = 0 >> Oct 2 10:21:59 nas kernel: em1: RX Queue 0 ------ >> Oct 2 10:21:59 nas kernel: em1: hw rdh = 167, hw rdt = 166 >> Oct 2 10:21:59 nas kernel: em1: RX discarded packets = 0 >> Oct 2 10:21:59 nas kernel: em1: RX Next to Check = 167 >> Oct 2 10:21:59 nas kernel: em1: RX Next to Refresh = 166 >> Oct 2 10:21:59 nas kernel: em1: link state changed to DOWN >> Oct 2 10:22:02 nas kernel: em1: link state changed to UP >> Oct 2 10:22:02 nas devd: Executing '/etc/rc.d/dhclient quietstart em1' >> >> it seems to occur when the interface are loaded. On the same server I >> also have a PCI card, the same issue occurs here. em0 and em1 are both >> onboard 80003ES2LAN. the PCI card is 82571EB. >> >> I've found different threads, but I couldn't manage to find a fix for >> this. >> >> What else can be wrong? >> >> Regards, >> >> Frank de Bot >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >> > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Mon Oct 5 05:26:50 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B6DBDA10783 for ; Mon, 5 Oct 2015 05:26:50 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5CF6C1A65; Mon, 5 Oct 2015 05:26:50 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id t955QiPJ087329 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Mon, 5 Oct 2015 08:26:44 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua t955QiPJ087329 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id t955QhSC087328; Mon, 5 Oct 2015 08:26:43 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Mon, 5 Oct 2015 08:26:43 +0300 From: Konstantin Belousov To: krad Cc: freebsd-stable , ae@freebsd.org Subject: Re: transparent redirection with pf and squid Message-ID: <20151005052643.GA2257@kib.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on tom.home X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 05:26:50 -0000 On Sun, Oct 04, 2015 at 07:31:43PM +0100, krad wrote: > Is anyone else having problems with squid core dumping on Freebsd 10-stable > when using the transparent caching feature. It started happening recently > after I re enabled ipv6 on my network. It may just be coincidence though. > It has even caused the odd kernel panic but not every time. > > FreeBSD xx 10.2-STABLE FreeBSD 10.2-STABLE #6: Wed Sep 9 16:01:15 BST 2015 > root@r2:/build/stable/usr/obj/build/stable/usr/src/sys/me amd64 > > > Oct 4 17:13:09 hunters6 kernel: Fatal trap 12: page fault while in kernel > mode > Oct 4 17:13:09 hunters6 kernel: cpuid = 1; apic id = 02 > Oct 4 17:13:09 hunters6 kernel: fault virtual address = 0x28 > Oct 4 17:13:09 hunters6 kernel: fault code = supervisor read > data, page not present > Oct 4 17:13:09 hunters6 kernel: instruction pointer = > 0x20:0xffffffff807f27a9 > Oct 4 17:13:09 hunters6 kernel: stack pointer = > 0x28:0xfffffe011be4a390 > Oct 4 17:13:09 hunters6 kernel: frame pointer = > 0x28:0xfffffe011be4a3f0 > Oct 4 17:13:09 hunters6 kernel: code segment = base 0x0, limit > 0xfffff, type 0x1b > Oct 4 17:13:09 hunters6 kernel: = DPL 0, pres 1, long 1, def32 0, gran 1 > Oct 4 17:13:09 hunters6 kernel: processor eflags = interrupt > enabled, resume, IOPL = 0 > Oct 4 17:13:09 hunters6 kernel: current process = 10269 > (squid) > Oct 4 17:13:09 hunters6 kernel: trap number = 12 > Oct 4 17:13:09 hunters6 kernel: panic: page fault > Oct 4 17:13:09 hunters6 kernel: cpuid = 1 > Oct 4 17:13:09 hunters6 kernel: KDB: stack backtrace: > Oct 4 17:13:09 hunters6 kernel: #0 0xffffffff8062f920 at kdb_backtrace+0x60 > Oct 4 17:13:09 hunters6 kernel: #1 0xffffffff805f48f6 at vpanic+0x126 > Oct 4 17:13:09 hunters6 kernel: #2 0xffffffff805f47c3 at panic+0x43 > Oct 4 17:13:09 hunters6 kernel: #3 0xffffffff808c5eeb at trap_fatal+0x36b > Oct 4 17:13:09 hunters6 kernel: #4 0xffffffff808c61ed at trap_pfault+0x2ed > Oct 4 17:13:09 hunters6 kernel: #5 0xffffffff808c588a at trap+0x47a > Oct 4 17:13:09 hunters6 kernel: #6 0xffffffff808abb52 at calltrap+0x8 > Oct 4 17:13:09 hunters6 kernel: #7 0xffffffff807d3a9f at > in6_mapped_peeraddr+0xcf Please obtain the source file/line number of in6_mapped_peeraddr+0xcf. Do you have core dump for the panic ? > Oct 4 17:13:09 hunters6 kernel: #8 0xffffffff805b0048 at > export_fd_to_sb+0x6c8 > Oct 4 17:13:09 hunters6 kernel: #9 0xffffffff805af880 at > kern_proc_filedesc_out+0x3d0 > Oct 4 17:13:09 hunters6 kernel: #10 0xffffffff8059c7bd at > note_procstat_files+0xfd > Oct 4 17:13:09 hunters6 kernel: #11 0xffffffff8059a3a4 at > elf64_coredump+0x314 > Oct 4 17:13:09 hunters6 kernel: #12 0xffffffff805f7f4c at sigexit+0xb6c > Oct 4 17:13:09 hunters6 kernel: #13 0xffffffff805f85a6 at postsig+0x286 > Oct 4 17:13:09 hunters6 kernel: #14 0xffffffff806403f7 at ast+0x427 > From owner-freebsd-stable@freebsd.org Mon Oct 5 07:05:36 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B23E0A10A48 for ; Mon, 5 Oct 2015 07:05:36 +0000 (UTC) (envelope-from kraduk@gmail.com) Received: from mail-wi0-x230.google.com (mail-wi0-x230.google.com [IPv6:2a00:1450:400c:c05::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4A254F96; Mon, 5 Oct 2015 07:05:36 +0000 (UTC) (envelope-from kraduk@gmail.com) Received: by wicge5 with SMTP id ge5so105956110wic.0; Mon, 05 Oct 2015 00:05:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=7fWJ1XsdsUG0RRU6FJBwsS2e7bjQbcMNY/ghEv5YCHg=; b=hxGxLn4sBsICSfjFbN+FGsg0XWbQsLxmZKcGlDVPvld04JWQwIqYtnBrBxZrQ59rX/ LETX6uP2AWzg78T71jVI5Kow9sKakirDWg4bbCsieLhrievopqawH+NkGgNe+2YiK+PF gsiBPI6/9YofHIDQEvFMC4wUZJ/W7GSQ3NQHNpclumCkY7qkR40Ld7APnNXdoaKt1dsl UQSn0D9FLE3ZpwoEouv3Fm8P8hzAxMhCkURbjidC80DaZKDvvt+Nn7S0qCfV5hGGqznG WDhmYy99JPZ61yYNEtJq/W+vs1X7nPtoD8rAjq4ESA2LksWDl143M0WJVi5TtBkMJ7jZ krqw== MIME-Version: 1.0 X-Received: by 10.194.19.169 with SMTP id g9mr27274471wje.64.1444028734569; Mon, 05 Oct 2015 00:05:34 -0700 (PDT) Received: by 10.28.125.18 with HTTP; Mon, 5 Oct 2015 00:05:34 -0700 (PDT) In-Reply-To: <20151005052643.GA2257@kib.kiev.ua> References: <20151005052643.GA2257@kib.kiev.ua> Date: Mon, 5 Oct 2015 08:05:34 +0100 Message-ID: Subject: Re: transparent redirection with pf and squid From: krad To: Konstantin Belousov Cc: freebsd-stable , ae@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 07:05:36 -0000 I will have to have a look when i get home as the box is down at present. Probably another panic 8( On 5 October 2015 at 06:26, Konstantin Belousov wrote: > On Sun, Oct 04, 2015 at 07:31:43PM +0100, krad wrote: > > Is anyone else having problems with squid core dumping on Freebsd > 10-stable > > when using the transparent caching feature. It started happening recently > > after I re enabled ipv6 on my network. It may just be coincidence though. > > It has even caused the odd kernel panic but not every time. > > > > FreeBSD xx 10.2-STABLE FreeBSD 10.2-STABLE #6: Wed Sep 9 16:01:15 BST > 2015 > > root@r2:/build/stable/usr/obj/build/stable/usr/src/sys/me amd64 > > > > > > Oct 4 17:13:09 hunters6 kernel: Fatal trap 12: page fault while in > kernel > > mode > > Oct 4 17:13:09 hunters6 kernel: cpuid = 1; apic id = 02 > > Oct 4 17:13:09 hunters6 kernel: fault virtual address = 0x28 > > Oct 4 17:13:09 hunters6 kernel: fault code = supervisor read > > data, page not present > > Oct 4 17:13:09 hunters6 kernel: instruction pointer = > > 0x20:0xffffffff807f27a9 > > Oct 4 17:13:09 hunters6 kernel: stack pointer = > > 0x28:0xfffffe011be4a390 > > Oct 4 17:13:09 hunters6 kernel: frame pointer = > > 0x28:0xfffffe011be4a3f0 > > Oct 4 17:13:09 hunters6 kernel: code segment = base 0x0, limit > > 0xfffff, type 0x1b > > Oct 4 17:13:09 hunters6 kernel: = DPL 0, pres 1, long 1, def32 0, gran 1 > > Oct 4 17:13:09 hunters6 kernel: processor eflags = interrupt > > enabled, resume, IOPL = 0 > > Oct 4 17:13:09 hunters6 kernel: current process = 10269 > > (squid) > > Oct 4 17:13:09 hunters6 kernel: trap number = 12 > > Oct 4 17:13:09 hunters6 kernel: panic: page fault > > Oct 4 17:13:09 hunters6 kernel: cpuid = 1 > > Oct 4 17:13:09 hunters6 kernel: KDB: stack backtrace: > > Oct 4 17:13:09 hunters6 kernel: #0 0xffffffff8062f920 at > kdb_backtrace+0x60 > > Oct 4 17:13:09 hunters6 kernel: #1 0xffffffff805f48f6 at vpanic+0x126 > > Oct 4 17:13:09 hunters6 kernel: #2 0xffffffff805f47c3 at panic+0x43 > > Oct 4 17:13:09 hunters6 kernel: #3 0xffffffff808c5eeb at > trap_fatal+0x36b > > Oct 4 17:13:09 hunters6 kernel: #4 0xffffffff808c61ed at > trap_pfault+0x2ed > > Oct 4 17:13:09 hunters6 kernel: #5 0xffffffff808c588a at trap+0x47a > > Oct 4 17:13:09 hunters6 kernel: #6 0xffffffff808abb52 at calltrap+0x8 > > Oct 4 17:13:09 hunters6 kernel: #7 0xffffffff807d3a9f at > > in6_mapped_peeraddr+0xcf > Please obtain the source file/line number of in6_mapped_peeraddr+0xcf. > Do you have core dump for the panic ? > > > Oct 4 17:13:09 hunters6 kernel: #8 0xffffffff805b0048 at > > export_fd_to_sb+0x6c8 > > Oct 4 17:13:09 hunters6 kernel: #9 0xffffffff805af880 at > > kern_proc_filedesc_out+0x3d0 > > Oct 4 17:13:09 hunters6 kernel: #10 0xffffffff8059c7bd at > > note_procstat_files+0xfd > > Oct 4 17:13:09 hunters6 kernel: #11 0xffffffff8059a3a4 at > > elf64_coredump+0x314 > > Oct 4 17:13:09 hunters6 kernel: #12 0xffffffff805f7f4c at sigexit+0xb6c > > Oct 4 17:13:09 hunters6 kernel: #13 0xffffffff805f85a6 at postsig+0x286 > > Oct 4 17:13:09 hunters6 kernel: #14 0xffffffff806403f7 at ast+0x427 > > > From owner-freebsd-stable@freebsd.org Mon Oct 5 10:07:51 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 141329B2252 for ; Mon, 5 Oct 2015 10:07:51 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from mx1.cksoft.de (mx1.cksoft.de [IPv6:2001:67c:24f8:1::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.cksoft.de", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C89F41A1 for ; Mon, 5 Oct 2015 10:07:50 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from m.cksoft.de (m.cksoft.de [212.17.240.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.cksoft.de (Postfix) with ESMTPSA id AD2731E9E6E for ; Mon, 5 Oct 2015 12:07:46 +0200 (CEST) Received: from amavis.cksoft.de (unknown [IPv6:2a01:170:1110:8001::25:a1]) by m.cksoft.de (Postfix) with ESMTP id 76A22631D0 for ; Mon, 5 Oct 2015 12:06:18 +0200 (CEST) X-Virus-Scanned: amavisd-new at cksoft.de Received: from m.cksoft.de ([192.168.64.93]) by amavis.cksoft.de (amavis.cksoft.de [192.168.64.94]) (amavisd-new, port 10041) with ESMTP id pftpdAUuQ0xg for ; Mon, 5 Oct 2015 12:06:17 +0200 (CEST) Received: from noc1.cksoft.de (noc1.cksoft.de [IPv6:2a01:170:1110:8001::53:1]) by m.cksoft.de (Postfix) with ESMTP id E1B8062F88 for ; Mon, 5 Oct 2015 12:06:15 +0200 (CEST) Received: by noc1.cksoft.de (Postfix, from userid 1000) id C30E913ECB; Mon, 5 Oct 2015 12:07:42 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by noc1.cksoft.de (Postfix) with ESMTP id B7B2B13CF9 for ; Mon, 5 Oct 2015 12:07:42 +0200 (CEST) Date: Mon, 5 Oct 2015 12:07:42 +0200 (CEST) From: Christian Kratzer X-X-Sender: ck@noc1.cksoft.de Reply-To: Christian Kratzer To: freebsd-stable@freebsd.org Subject: smbfs crashes since approx. 10.1-RELEASE Message-ID: User-Agent: Alpine 2.20 (BSF 67 2015-01-07) X-Spammer-Kill-Ratio: 75% MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 10:07:51 -0000 Hi, I run a regular rsync job that runs from cron and copies stuff that gets created on a Windows smbfs share. Starting about 10.1-RELEASE the VM has become unstable and started panicing. I have narrowed the issue down to the aforementioned rsync job. When I move the job to a different VM the the other VM starts crashing and the VM without the job becomes stable agin. I have panics and crashinfos stored in /var/crash if anybody is interested: root@noc2:/var/crash # uname -a FreeBSD noc2.cksoft.de 10.2-RELEASE FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 root@noc2:/var/crash # freebsd-version -u 10.2-RELEASE-p5 root@noc2:/var/crash # freebsd-version -k 10.2-RELEASE root@noc2:/var/crash # This is what I have in /var/crash/core.txt.0 Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x20 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80996c7c stack pointer = 0x28:0xfffffe003d6c0ac0 frame pointer = 0x28:0xfffffe003d6c0af0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = resume, IOPL = 0 current process = 1349 (smbiod10) trap number = 12 panic: page fault cpuid = 0 KDB: stack backtrace: #0 0xffffffff80984e30 at kdb_backtrace+0x60 #1 0xffffffff809489e6 at vpanic+0x126 #2 0xffffffff809488b3 at panic+0x43 #3 0xffffffff80d4aadb at trap_fatal+0x36b #4 0xffffffff80d4addd at trap_pfault+0x2ed #5 0xffffffff80d4a47a at trap+0x47a #6 0xffffffff80d307f2 at calltrap+0x8 #7 0xffffffff8092ebe0 at __mtx_unlock_sleep+0x60 #8 0xffffffff8092eb69 at __mtx_unlock_flags+0x69 #9 0xffffffff81a1b724 at smb_iod_thread+0xb4 #10 0xffffffff8091244a at fork_exit+0x9a #11 0xffffffff80d30d2e at fork_trampoline+0xe Uptime: 2h43m55s Dumping 103 out of 999 MB: (CTRL-C to abort) ..16%..31%..47%..62%..78%..93% Reading symbols from /boot/kernel/smbfs.ko.symbols...done. Loaded symbols for /boot/kernel/smbfs.ko.symbols Reading symbols from /boot/kernel/libiconv.ko.symbols...done. Loaded symbols for /boot/kernel/libiconv.ko.symbols Reading symbols from /boot/kernel/libmchain.ko.symbols...done. Loaded symbols for /boot/kernel/libmchain.ko.symbols #0 doadump (textdump=) at pcpu.h:219 219 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=) at pcpu.h:219 #1 0xffffffff80948642 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:451 #2 0xffffffff80948a25 in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:758 #3 0xffffffff809488b3 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:687 #4 0xffffffff80d4aadb in trap_fatal (frame=, eva=) at /usr/src/sys/amd64/amd64/trap.c:851 #5 0xffffffff80d4addd in trap_pfault (frame=0xfffffe003d6c0a10, usermode=) at /usr/src/sys/amd64/amd64/trap.c:674 #6 0xffffffff80d4a47a in trap (frame=0xfffffe003d6c0a10) at /usr/src/sys/amd64/amd64/trap.c:440 #7 0xffffffff80d307f2 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236 #8 0xffffffff80996c7c in turnstile_broadcast (ts=0x0, queue=0) at /usr/src/sys/kern/subr_turnstile.c:838 #9 0xffffffff8092ebe0 in __mtx_unlock_sleep (c=0xfffff80002df0390, opts=, file=0xffffffff81a25801 "%s: Can't handle disordered parameters %d:%d\n", line=1) at /usr/src/sys/kern/kern_mutex.c:791 #10 0xffffffff8092eb69 in __mtx_unlock_flags (c=, opts=, file=0xffffffff81a25801 "%s: Can't handle disordered parameters %d:%d\n", line=1) at /usr/src/sys/kern/kern_mutex.c:254 #11 0xffffffff81a1b724 in smb_iod_thread (arg=0xfffff80002df0300) at /usr/src/sys/modules/smbfs/../../netsmb/smb_iod.c:624 #12 0xffffffff8091244a in fork_exit ( callout=0xffffffff81a1b670 , arg=0xfffff80002df0300, frame=0xfffffe003d6c0c00) at /usr/src/sys/kern/kern_fork.c:1018 #13 0xffffffff80d30d2e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:611 #14 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) Any tips on howto proceeed with this ? I can setup a dedicated VM with a fresh install of whatever in case it helps. Greetings Christian -- Christian Kratzer CK Software GmbH Email: ck@cksoft.de Wildberger Weg 24/2 Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer Web: http://www.cksoft.de/ From owner-freebsd-stable@freebsd.org Mon Oct 5 10:15:44 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A688E9B2B0F; Mon, 5 Oct 2015 10:15:44 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 98BA095E; Mon, 5 Oct 2015 10:15:44 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id E284A15A4; Mon, 5 Oct 2015 10:15:43 +0000 (UTC) Date: Mon, 5 Oct 2015 10:15:39 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: mav@FreeBSD.org, bapt@FreeBSD.org, jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org, freebsd-i386@FreeBSD.org Message-ID: <478778636.163.1444040142838.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: FreeBSD_STABLE_10-i386 - Build #524 - Failure MIME-Version: 1.0 X-Jenkins-Job: FreeBSD_STABLE_10-i386 X-Jenkins-Result: FAILURE Precedence: bulk Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 10:15:44 -0000 FreeBSD_STABLE_10-i386 - Build #524 - Failure: Build information: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/5= 24/ Full change log: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/524= /changes Full build log: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/524/= console Change summaries: 288765 by mav: MFC r287912: Report proper medium error code for VERIFY commands. 288764 by mav: MFC r287875: Fix reading after end of file for file-backed LUNs. If backing file is smaller then the LUN size, we have to explicitly clear the rest of the buffer to not leak some random data from previous I/Os. 288763 by mav: MFC r287868: Make COMPARE AND WRITE report offset of difference. 288762 by mav: MFC r287860: Frontends don't need to set errors themselves. 288761 by mav: MFC r287855: Don't flap the HA link if sysctl is reset to the same value. 288760 by mav: MFC r287823: Add ctl-lun config option for consistency in HA setups. 288759 by mav: MFC r287818: Fix completion/error status reporting. 288758 by mav: MFC r287816: Close potential race between datamove and HA failover. 288757 by mav: MFC r287784: Implement data/status aggregation for secondary HA node. For short read requests this reduces latency by 30%, reporting command completion after two interlink roundtrips instead of full three. 288756 by mav: MFC r287783: Implement data/status aggregation for camsim backend. This is almost pointless for primary HA node, but useful for secondary, where between fe_datamove and fe_done calls goes another link roundtrip. 288755 by mav: MFC r287778: Remove CTL_PRIV_LBA_LEN from HA messages. Previously it was used for statistics, but now just a 16 extra bytes. 288754 by mav: MFC r287774: Implement QUERY TASK, QUERY TASK SET and QUERY ASYNC EVENT. Now we support most of SAM-5 task management. 288753 by mav: MFC r287766: Add negotiation of iSCSIProtocolLevel to 2 (RFC7144). We may need to pass negotiated value to kernel level, but so far it is not necessary, since it does not use any new features without request. 288752 by mav: MFC r287765: Map CLEAR TASK SET and I_T NEXUS RESET for iSCSI. The last should not be called without iSCSIProtocolLevel negotiation. 288751 by mav: MFC r287764: Implement iSCSI TARGET COLD RESET task management function. Implement it as CTL_TASK_TARGET_RESET plus termination of all sessions. 288750 by mav: MFC r287760: Improve read-only support. 288749 by mav: MFC r287758: Reannounce port to HA peer if LUN map changed after online. 288748 by mav: MFC r287757: When updating port, apply only change of LUN map, not whole. 288747 by mav: MFC r287756: Report INQUIRY DATA HAS CHANGED for related LUNs on port on-/offline. 288746 by mav: MFC r287754: Report CTL_UA_LUN_CHANGE on LUN map change. 288745 by mav: MFC r287748: Make TARGET RESET respect LUN mapping. 288744 by mav: MFC r287724: Check for obsolete NUL bin in CSCD descriptor. 288743 by mav: MFC r287721: Add HA support for CTL_TASK_I_T_NEXUS_RESET. 288742 by mav: MFC r287720: Fix false CTL_UA_RES_RELEASE on secondary HA node. 288741 by mav: MFC r287718: Decode WRITE ATOMIC(16) command. 288740 by mav: MFC r287715: Improve XCOPY error reporting. 288739 by mav: MFC r287714: Report that we have no limit on POPULATE TOKEN segment size. 288738 by mav: MFC r287712: Correct RTPG bitmask. 288737 by mav: MFC r287711: Some HA polishing. 288736 by mav: MFC r287707: CTL documentation update, mostly for HA. 288735 by mav: MFC r287671: Make ctld restart on primary HA node less invasive for secondary. 288734 by mav: MFC r287670: Close races between device close and request processing. All requests arriving for processing after OFFLINE flag set are rejected with BUSY status. Races around OFFLINE flag setting are closed by calling taskqueue_drain_all(). 288733 by mav: MFC r287664: Reference/release devices on every I/O, rather on open/close. While this may be slower, it allows device destruction to complete, rather then block waiting for indefinitely long time. 288732 by mav: MFC r287621: Reimplement CTL High Availability. CTL HA functionality was originally implemented by Copan many years ago, but large part of the sources was never published. This change includes clean room implementation of the missing code and fixes for many bugs. This code supports dual-node HA with ALUA in four modes: - Active/Unavailable without interlink between nodes; - Active/Standby with second node handling only basic LUN discovery and reservation, synchronizing with the first node through the interlink; - Active/Active with both nodes processing commands and accessing the backing storage, synchronizing with the first node through the interlink; - Active/Active with second node working as proxy, transfering all commands to the first node for execution through the interlink. Unlike original Copan's implementation, depending on specific hardware, this code uses simple custom TCP-based protocol for interlink. It has no authentication, so it should never be enabled on public interfaces. The code may still need some polishing, but generally it is functional. Relnotes: yes Sponsored by: iXsystems, Inc. 288731 by mav: MFC r287620: Remove unused target and initiator IDs. 288730 by mav: MFC r287618: Disable CTL_IO_DELAY feature. It is too developer-oriented to be enabled by default. 288729 by mav: MFC r287534: Add two new portal group options "tag" and "foreign". They are going to be useful in clustered setups. 288728 by mav: MFC r287500: Allow LUN options modification via CTL_LUNREQ_MODIFY. Not all changes take effect, but that is a different question. 288727 by mav: MFC r287499: Move setting of media parameters inside open routines. This is preparation for possibility to open/close media several times per LUN life cycle. While there, rename variables to reduce confusion. As additional bonus this allows to open read-only media, such as ZFS snapshots. 288726 by mav: MFC r287455, r287458, r287459: Remove some dead code. 288725 by mav: MFC r287433: Small UA cleanup. 288724 by mav: MFC r287372: Make most of port methods optional and remove bunch of dummies. 288723 by mav: MFC r287293: Remove 600 bytes of port_priv from struct ctl_io_hdr. This field used only for camtgt frontend, and once it any way preallocates all requests, let it preallocate this memory too, not bothering core code. 288722 by mav: MFC r287221: Fix type bug introduced at r286811. 288721 by mav: MFC r286811: Polish sizes processing. 288720 by mav: MFC r286807: Move "ioctl" CAM frontend into separate file. It has nothing to share with too huge ctl.c other then device descriptor, but even that may be counted as design error that may be fixed later. At some point we may even want to have several ioctl ports. 288719 by mav: MFC r286806: Drop "internal" CTL frontend. Its idea was to be a simple initiator and execute several commands from kernel level, but FreeBSD never had consumer for that functionality, while its implementation polluted many unrelated places. 288718 by mav: MFC r286406, r286414: Wrap some unused functions with notyet, it is necessary to be able to build the modules/ctl directly. Remove a dead MALLOC_DEFINE. 288717 by mav: MFC r285600: MULTI_ID supported does not mean it is used. 288716 by mav: MFC r285510: Switch initiator IDs in target mode to the same address space as target IDs in initiator mode -- index in port database instead of handlers. This makes initiator IDs persist across role changes and firmware resets, when handlers previously assigned by firmware are lost and reused. 288715 by mav: MFC r285481: Make role sysctl handling from r284727 less strict. 288714 by mav: MFC r285459: Unify port database use for target and initiator roles. Aside from cleaner and more consistent code, this allows ports to be both target and initiator same time, and easily switch from any role to any. 288713 by mav: MFC r285155: Make first step toward supporting target and initiator roles same time. To avoid conflicts between target and initiator devices in CAM, make CTL use target ID reported by HBA as its initiator_id in XPT_PATH_INQ. That target ID is known to never be used for initiator role, so it won't conflict. For Fibre Channel and FireWire HBAs this specific ID choice is irrelevant since all target IDs there are virtual. Same time for SPI HBAs it seems could be even requirement to use same target ID for both initiator and target roles. While there are some more things to polish in isp(4) driver, first tests of using both roles same time on the same port appeared successfull: # camcontrol devlist -v scbus0 on isp0 bus 0: at scbus0 target 1 lun 0 (da20,pass21) <> at scbus0 target 256 lun 0 (ctl0) <> at scbus0 target -1 lun ffffffff (ctl1) 288712 by mav: MFC r285154: Remove extra level of target ID indirection (isp_dev_map). FreeBSD never had limitation on number of target IDs, and there is no any other requirement to allocate them densely. Since slots of port database already populated just sequentially, there is no much need for another indirection to allocate sequentially too. 288711 by mav: MFC r285147: Change comment added in r284540. This appeared to be not card's issue, but driver's, though solution is the same so far. 288710 by bapt: MFC 287473,287485,287493,287494 Add a new sesutil(8) utility This is an utility for managing SCSI Enclosure Services (SES) device. For now only one command is supported "locate" which will change the test o= f the external LED associated to a given disk. Usage if the following: sesutil locate disk [on|off] Disk can be a device name: "da12" or a special keyword: "all". Reviewed by:=09mav Relnotes:=09yes Sponsored by:=09gandi.net 288709 by mav: MFC r285146: Drop discovered targets when initiator role is disabled. 288708 by mav: MFC r273051 (by imp): Use the C99 flexible array construct to denote a variable amount of data rather than the old-school [1] construct. We have required c99 compilers for some time. 288707 by mav: MFC r271731 (by will): Fix a kernel panic when unloading isp(4). In the current implementation, the isp_kthread() threads never exit. The target threads do have an exit mode from isp_attach(), but it is not invoked from isp_detach(). Ensure isp_detach() notifies threads started for each channel, such that they exit before their parent device softc detaches, and thus before the module does. Otherwise, a page fault panic occurs later in: sysctl_kern_proc sysctl_out_proc kern_proc_out fill_kinfo_proc fill_kinfo_thread strlcpy(kp->ki_wmesg, td->td_wmesg, sizeof(kp->ki_wmesg)); For isp_kthread() (and isp(4) target threads), td->td_wmesg references now-unmapped memory after the module has been unloaded. These threads are typically msleep()ing at the time of unload, but they could also attempt to execute now-unmapped code segments. 288706 by mav: MFC r285030: Fix couple panics on forced unmount of backing file. 288704 by mav: MFC r281532 (by delphij): Eliminate unused headers. 288702 by mav: MFC r281531 (by asomers): Initialize async_arg_ptr in xpt_async when called with async_code AC_ADVINFO_CHANGED. Without this change, newly inserted hard disks won't always have their physical path device nodes created. The problem reproduces most readily when attaching a large number of disks at once. 288701 by mav: MFC r280845 (by eadler): Add some additional quirks for various Western Digital Caviar MHDDs The end of the build log: [...truncated 162539 lines...] --- cxgb_mv88e1xxx.o --- ctfconvert -L VERSION -g cxgb_mv88e1xxx.o --- cxgb_xgmac.o --- cc -O2 -pipe -g -DDEFAULT_JUMBO -fno-strict-aliasing -Werror -D_KERNEL -D= KLD_MODULE -nostdinc -I/usr/src/sys/modules/cxgb/cxgb/../../../dev/cxgb -D= HAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global= .h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC = -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-pro= tector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector = -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-pro= totypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -ff= ormat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -Wno-er= ror-tautological-compare -Wno-error-empty-body -Wno-error-parentheses-equa= lity -Wno-error-unused-function -c /usr/src/sys/modules/cxgb/cxgb/../../.= ./dev/cxgb/common/cxgb_xgmac.c -o cxgb_xgmac.o --- all_subdir_ath --- --- if_ath_beacon.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/if_ath_beacon.c -o if_ath_beacon.o --- all_subdir_cxgbe --- ctfconvert -L VERSION -g t4_mp_ring.o --- t4_netmap.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I/usr/src/sys/modules/cxgbe/if_cxgbe/../../../dev/cxgbe -DHAVE_KERNEL_O= PTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I= @/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-aes -mno= -avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -gdwar= f-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector -Wall -Wredun= dant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpoi= nter-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensi= ons -Wmissing-include-dirs -fdiagnostics-show-option -Wno-error-tautologi= cal-compare -Wno-error-empty-body -Wno-error-parentheses-equality -Wno-err= or-unused-function -c /usr/src/sys/modules/cxgbe/if_cxgbe/../../../dev/c= xgbe/t4_netmap.c -o t4_netmap.o ctfconvert -L VERSION -g t4_netmap.o --- t4_hw.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I/usr/src/sys/modules/cxgbe/if_cxgbe/../../../dev/cxgbe -DHAVE_KERNEL_O= PTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I= @/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-aes -mno= -avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -gdwar= f-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector -Wall -Wredun= dant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpoi= nter-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensi= ons -Wmissing-include-dirs -fdiagnostics-show-option -Wno-error-tautologi= cal-compare -Wno-error-empty-body -Wno-error-parentheses-equality -Wno-err= or-unused-function -c /usr/src/sys/modules/cxgbe/if_cxgbe/../../../dev/c= xgbe/common/t4_hw.c -o t4_hw.o --- all_subdir_ath --- ctfconvert -L VERSION -g if_ath_beacon.o --- all_subdir_cxgb --- ctfconvert -L VERSION -g cxgb_xgmac.o --- cxgb_vsc7323.o --- cc -O2 -pipe -g -DDEFAULT_JUMBO -fno-strict-aliasing -Werror -D_KERNEL -D= KLD_MODULE -nostdinc -I/usr/src/sys/modules/cxgb/cxgb/../../../dev/cxgb -D= HAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global= .h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC = -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-pro= tector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector = -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-pro= totypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -ff= ormat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -Wno-er= ror-tautological-compare -Wno-error-empty-body -Wno-error-parentheses-equa= lity -Wno-error-unused-function -c /usr/src/sys/modules/cxgb/cxgb/../../.= ./dev/cxgb/common/cxgb_vsc7323.c -o cxgb_vsc7323.o --- all_subdir_ath --- --- if_ath_rx_edma.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/if_ath_rx_edma.c -o if_ath_rx_edma.o --- all_subdir_cxgb --- ctfconvert -L VERSION -g cxgb_vsc7323.o --- cxgb_t3_hw.o --- cc -O2 -pipe -g -DDEFAULT_JUMBO -fno-strict-aliasing -Werror -D_KERNEL -D= KLD_MODULE -nostdinc -I/usr/src/sys/modules/cxgb/cxgb/../../../dev/cxgb -D= HAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global= .h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC = -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-pro= tector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector = -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-pro= totypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -ff= ormat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -Wno-er= ror-tautological-compare -Wno-error-empty-body -Wno-error-parentheses-equa= lity -Wno-error-unused-function -c /usr/src/sys/modules/cxgb/cxgb/../../.= ./dev/cxgb/common/cxgb_t3_hw.c -o cxgb_t3_hw.o --- all_subdir_ath --- ctfconvert -L VERSION -g if_ath_rx_edma.o --- if_ath_tx_edma.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/if_ath_tx_edma.c -o if_ath_tx_edma.o ctfconvert -L VERSION -g if_ath_tx_edma.o --- if_ath_spectral.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/if_ath_spectral.c -o if_ath_spectral.o --- all_subdir_ctl --- --- ctl.o --- ctfconvert -L VERSION -g ctl.o --- ctl_backend_ramdisk.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_backend_ramdisk.c -o ctl_backend_ramdisk.o --- all_subdir_ath --- ctfconvert -L VERSION -g if_ath_spectral.o --- if_ath_btcoex.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/if_ath_btcoex.c -o if_ath_btcoex.o --- all_subdir_ctl --- ctfconvert -L VERSION -g ctl_backend_ramdisk.o --- ctl_cmd_table.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_cmd_table.c -o ctl_cmd_table.o ctfconvert -L VERSION -g ctl_cmd_table.o --- ctl_frontend.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_frontend.c -o ctl_frontend.o --- all_subdir_ath --- ctfconvert -L VERSION -g if_ath_btcoex.o --- all_subdir_ctl --- ctfconvert -L VERSION -g ctl_frontend.o --- ctl_frontend_ioctl.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_frontend_ioctl.c -o ctl_frontend_ioctl.o --- all_subdir_ath --- --- if_ath_lna_div.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/if_ath_lna_div.c -o if_ath_lna_div.o --- all_subdir_cxgbe --- ctfconvert -L VERSION -g t4_hw.o --- all_subdir_ctl --- ctfconvert -L VERSION -g ctl_frontend_ioctl.o --- ctl_frontend_iscsi.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_frontend_iscsi.c -o ctl_frontend_iscsi.o --- all_subdir_cxgbe --- --- t4_l2t.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I/usr/src/sys/modules/cxgbe/if_cxgbe/../../../dev/cxgbe -DHAVE_KERNEL_O= PTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I= @/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-aes -mno= -avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -gdwar= f-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector -Wall -Wredun= dant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpoi= nter-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensi= ons -Wmissing-include-dirs -fdiagnostics-show-option -Wno-error-tautologi= cal-compare -Wno-error-empty-body -Wno-error-parentheses-equality -Wno-err= or-unused-function -c /usr/src/sys/modules/cxgbe/if_cxgbe/../../../dev/c= xgbe/t4_l2t.c -o t4_l2t.o --- all_subdir_ath --- ctfconvert -L VERSION -g if_ath_lna_div.o --- all_subdir_cxgbe --- ctfconvert -L VERSION -g t4_l2t.o --- t4_main.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I/usr/src/sys/modules/cxgbe/if_cxgbe/../../../dev/cxgbe -DHAVE_KERNEL_O= PTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I= @/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-aes -mno= -avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -gdwar= f-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector -Wall -Wredun= dant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpoi= nter-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensi= ons -Wmissing-include-dirs -fdiagnostics-show-option -Wno-error-tautologi= cal-compare -Wno-error-empty-body -Wno-error-parentheses-equality -Wno-err= or-unused-function -c /usr/src/sys/modules/cxgbe/if_cxgbe/../../../dev/c= xgbe/t4_main.c -o t4_main.o --- all_subdir_ath --- --- ah_osdep.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/ah_osdep.c -o ah_osdep.o ctfconvert -L VERSION -g ah_osdep.o --- all_subdir_cxgb --- ctfconvert -L VERSION -g cxgb_t3_hw.o --- all_subdir_ctl --- ctfconvert -L VERSION -g ctl_frontend_iscsi.o --- all_subdir_ath --- --- sample.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/ath_rate/sample/sample.c -o sample.o --- all_subdir_ctl --- --- ctl_ha.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_ha.c -o ctl_ha.o --- all_subdir_cxgb --- --- cxgb_main.o --- cc -O2 -pipe -g -DDEFAULT_JUMBO -fno-strict-aliasing -Werror -D_KERNEL -D= KLD_MODULE -nostdinc -I/usr/src/sys/modules/cxgb/cxgb/../../../dev/cxgb -D= HAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global= .h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC = -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-pro= tector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector = -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-pro= totypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -ff= ormat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -Wno-er= ror-tautological-compare -Wno-error-empty-body -Wno-error-parentheses-equa= lity -Wno-error-unused-function -c /usr/src/sys/modules/cxgb/cxgb/../../.= ./dev/cxgb/cxgb_main.c -o cxgb_main.o --- all_subdir_ctl --- ctfconvert -L VERSION -g ctl_ha.o --- ctl_scsi_all.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_scsi_all.c -o ctl_scsi_all.o ctfconvert -L VERSION -g ctl_scsi_all.o --- ctl_tpc.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_tpc.c -o ctl_tpc.o --- all_subdir_ath --- ctfconvert -L VERSION -g sample.o --- dfs_null.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -I. -I/usr/src/sys/modules/ath/../../dev/ath -I/usr/src/sys/modules/ath/= ../../dev/ath/ath_hal -I. -I/usr/src/sys/modules/ath/../../contrib/dev/ath/= ath_hal/ -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC= /opt_global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sy= s/GENERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding = -fstack-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack= -protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -W= missing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-point= er-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-opti= on -Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-paren= theses-equality -Wno-error-unused-function -c /usr/src/sys/modules/ath/.= ./../dev/ath/ath_dfs/null/dfs_null.c -o dfs_null.o ctfconvert -L VERSION -g dfs_null.o --- if_ath.kld --- ld -d -warn-common -r -d -o if_ath.kld if_ath.o if_ath_alq.o if_ath_debug.= o if_ath_keycache.o if_ath_sysctl.o if_ath_tx.o if_ath_tx_ht.o if_ath_led.o= if_ath_rx.o if_ath_tdma.o if_ath_beacon.o if_ath_rx_edma.o if_ath_tx_edma.= o if_ath_spectral.o if_ath_btcoex.o if_ath_lna_div.o ah_osdep.o ah.o ah_reg= domain.o ah_eeprom_v3.o ah_eeprom_v1.o ar5210_attach.o ar5210_beacon.o ar52= 10_interrupts.o ar5210_keycache.o ar5210_misc.o ar5210_phy.o ar5210_power.o= ar5210_recv.o ar5210_reset.o ar5210_xmit.o ar5211_attach.o ar5211_beacon.o= ar5211_interrupts.o ar5211_keycache.o ar5211_misc.o ar5211_phy.o ar5211_po= wer.o ar5211_recv.o ar5211_reset.o ar5211_xmit.o ar5212_ani.o ar5212_attach= .o ar5212_beacon.o ar5212_eeprom.o ar5212_gpio.o ar5212_interrupts.o ar5212= _keycache.o ar5212_misc.o ar5212_phy.o ar5212_power.o ar5212_recv.o ar5212_= reset.o ar5212_rfgain.o ar5212_xmit.o ar5111.o ar5112.o ar2413.o ar2425.o a= r5413.o ah_eeprom_v14.o ah_eeprom_v4k.o ar5416_ani.o ar5416_attach.o ar5416= _beacon.o ar5416_btcoex.o ar5416_cal.o ar5416_cal_iq.o ar5416_cal_adcgain.o= ar5416_cal_adcdc.o ar5416_eeprom.o ar5416_gpio.o ar5416_interrupts.o ar541= 6_keycache.o ar5416_misc.o ar5416_phy.o ar5416_power.o ar5416_radar.o ar541= 6_spectral.o ar5416_recv.o ar5416_reset.o ar5416_xmit.o ar2133.o ar9160_att= ach.o ar9130_attach.o ar9130_eeprom.o ar9130_phy.o ar9280.o ar9280_attach.o= ar9280_olc.o ar9285.o ar9285_reset.o ar9285_attach.o ar9285_cal.o ar9285_p= hy.o ar9285_diversity.o ar9285_btcoex.o ah_eeprom_9287.o ar9287.o ar9287_re= set.o ar9287_attach.o ar9287_cal.o ar9287_olc.o ar9300_interrupts.o ar9300_= radar.o ar9300_ani.o ar9300_keycache.o ar9300_radio.o ar9300_xmit.o ar9300_= attach.o ar9300_mci.o ar9300_stub.o ar9300_xmit_ds.o ar9300_beacon.o ar9300= _misc.o ar9300_recv.o ar9300_stub_funcs.o ar9300_eeprom.o ar9300_paprd.o ar= 9300_recv_ds.o ar9300_freebsd.o ar9300_phy.o ar9300_reset.o ar9300_gpio.o a= r9300_power.o ar9300_timer.o sample.o dfs_null.o ctfmerge -L VERSION -g -o if_ath.kld if_ath.o if_ath_alq.o if_ath_debug.o i= f_ath_keycache.o if_ath_sysctl.o if_ath_tx.o if_ath_tx_ht.o if_ath_led.o if= _ath_rx.o if_ath_tdma.o if_ath_beacon.o if_ath_rx_edma.o if_ath_tx_edma.o i= f_ath_spectral.o if_ath_btcoex.o if_ath_lna_div.o ah_osdep.o ah.o ah_regdom= ain.o ah_eeprom_v3.o ah_eeprom_v1.o ar5210_attach.o ar5210_beacon.o ar5210_= interrupts.o ar5210_keycache.o ar5210_misc.o ar5210_phy.o ar5210_power.o ar= 5210_recv.o ar5210_reset.o ar5210_xmit.o ar5211_attach.o ar5211_beacon.o ar= 5211_interrupts.o ar5211_keycache.o ar5211_misc.o ar5211_phy.o ar5211_power= .o ar5211_recv.o ar5211_reset.o ar5211_xmit.o ar5212_ani.o ar5212_attach.o = ar5212_beacon.o ar5212_eeprom.o ar5212_gpio.o ar5212_interrupts.o ar5212_ke= ycache.o ar5212_misc.o ar5212_phy.o ar5212_power.o ar5212_recv.o ar5212_res= et.o ar5212_rfgain.o ar5212_xmit.o ar5111.o ar5112.o ar2413.o ar2425.o ar54= 13.o ah_eeprom_v14.o ah_eeprom_v4k.o ar5416_ani.o ar5416_attach.o ar5416_be= acon.o ar5416_btcoex.o ar5416_cal.o ar5416_cal_iq.o ar5416_cal_adcgain.o ar= 5416_cal_adcdc.o ar5416_eeprom.o ar5416_gpio.o ar5416_interrupts.o ar5416_k= eycache.o ar5416_misc.o ar5416_phy.o ar5416_power.o ar5416_radar.o ar5416_s= pectral.o ar5416_recv.o ar5416_reset.o ar5416_xmit.o ar2133.o ar9160_attach= .o ar9130_attach.o ar9130_eeprom.o ar9130_phy.o ar9280.o ar9280_attach.o ar= 9280_olc.o ar9285.o ar9285_reset.o ar9285_attach.o ar9285_cal.o ar9285_phy.= o ar9285_diversity.o ar9285_btcoex.o ah_eeprom_9287.o ar9287.o ar9287_reset= .o ar9287_attach.o ar9287_cal.o ar9287_olc.o ar9300_interrupts.o ar9300_rad= ar.o ar9300_ani.o ar9300_keycache.o ar9300_radio.o ar9300_xmit.o ar9300_att= ach.o ar9300_mci.o ar9300_stub.o ar9300_xmit_ds.o ar9300_beacon.o ar9300_mi= sc.o ar9300_recv.o ar9300_stub_funcs.o ar9300_eeprom.o ar9300_paprd.o ar930= 0_recv_ds.o ar9300_freebsd.o ar9300_phy.o ar9300_reset.o ar9300_gpio.o ar93= 00_power.o ar9300_timer.o sample.o dfs_null.o --- all_subdir_ctl --- ctfconvert -L VERSION -g ctl_tpc.o --- all_subdir_cxgb --- ctfconvert -L VERSION -g cxgb_main.o --- all_subdir_ctl --- --- ctl_tpc_local.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_tpc_local.c -o ctl_tpc_local.o --- all_subdir_cxgb --- --- cxgb_aq100x.o --- cc -O2 -pipe -g -DDEFAULT_JUMBO -fno-strict-aliasing -Werror -D_KERNEL -D= KLD_MODULE -nostdinc -I/usr/src/sys/modules/cxgb/cxgb/../../../dev/cxgb -D= HAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global= .h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC = -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-pro= tector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector = -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-pro= totypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -ff= ormat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -Wno-er= ror-tautological-compare -Wno-error-empty-body -Wno-error-parentheses-equa= lity -Wno-error-unused-function -c /usr/src/sys/modules/cxgb/cxgb/../../.= ./dev/cxgb/common/cxgb_aq100x.c -o cxgb_aq100x.o --- all_subdir_ctl --- ctfconvert -L VERSION -g ctl_tpc_local.o --- ctl_error.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_error.c -o ctl_error.o --- all_subdir_cxgb --- ctfconvert -L VERSION -g cxgb_aq100x.o --- cxgb_sge.o --- cc -O2 -pipe -g -DDEFAULT_JUMBO -fno-strict-aliasing -Werror -D_KERNEL -D= KLD_MODULE -nostdinc -I/usr/src/sys/modules/cxgb/cxgb/../../../dev/cxgb -D= HAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global= .h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GENERIC = -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-pro= tector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-protector = -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-pro= totypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -ff= ormat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -Wno-er= ror-tautological-compare -Wno-error-empty-body -Wno-error-parentheses-equa= lity -Wno-error-unused-function -c /usr/src/sys/modules/cxgb/cxgb/../../.= ./dev/cxgb/cxgb_sge.c -o cxgb_sge.o --- all_subdir_ctl --- ctfconvert -L VERSION -g ctl_error.o --- ctl_util.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_util.c -o ctl_util.o ctfconvert -L VERSION -g ctl_util.o --- ctl_backend_block.o --- cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdin= c -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_= global.h -I. -I@ -I@/contrib/altq -fno-common -g -I/usr/obj/usr/src/sys/GEN= ERIC -mno-aes -mno-avx -mno-mmx -mno-sse -msoft-float -ffreestanding -fsta= ck-protector -gdwarf-2 -std=3Diso9899:1999 -Qunused-arguments -fstack-prot= ector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissi= ng-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-si= gn -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -= Wno-error-tautological-compare -Wno-error-empty-body -Wno-error-parenthese= s-equality -Wno-error-unused-function -c /usr/src/sys/modules/ctl/../../c= am/ctl/ctl_backend_block.c -o ctl_backend_block.o --- all_subdir_ath --- :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk if_ath.kld export_syms | xargs -J% = objcopy % if_ath.kld --- all_subdir_ctl --- /usr/src/sys/modules/ctl/../../cam/ctl/ctl_backend_block.c:2213:4: error: i= mplicit declaration of function 'asprintf' is invalid in C99 [-Werror,-Wimp= licit-function-declaration] asprintf(&dev_name, M_CTLBLK, "/dev/%s", ^ 1 error generated. *** [ctl_backend_block.o] Error code 1 make[4]: stopped in /usr/src/sys/modules/ctl 1 error make[4]: stopped in /usr/src/sys/modules/ctl *** [all_subdir_ctl] Error code 2 make[3]: stopped in /usr/src/sys/modules --- all_subdir_cxgbe --- ctfconvert -L VERSION -g t4_main.o --- all_subdir_ath --- A failure has been detected in another branch of the parallel make make[4]: stopped in /usr/src/sys/modules/ath *** [all_subdir_ath] Error code 2 make[3]: stopped in /usr/src/sys/modules --- all_subdir_cxgbe --- A failure has been detected in another branch of the parallel make make[5]: stopped in /usr/src/sys/modules/cxgbe/if_cxgbe *** [_sub.all] Error code 2 make[4]: stopped in /usr/src/sys/modules/cxgbe 1 error make[4]: stopped in /usr/src/sys/modules/cxgbe *** [all_subdir_cxgbe] Error code 2 make[3]: stopped in /usr/src/sys/modules --- all_subdir_cxgb --- ctfconvert -L VERSION -g cxgb_sge.o A failure has been detected in another branch of the parallel make make[5]: stopped in /usr/src/sys/modules/cxgb/cxgb *** [_sub.all] Error code 2 make[4]: stopped in /usr/src/sys/modules/cxgb 1 error make[4]: stopped in /usr/src/sys/modules/cxgb *** [all_subdir_cxgb] Error code 2 make[3]: stopped in /usr/src/sys/modules 4 errors make[3]: stopped in /usr/src/sys/modules *** [modules-all] Error code 2 make[2]: stopped in /usr/obj/usr/src/sys/GENERIC 1 error make[2]: stopped in /usr/obj/usr/src/sys/GENERIC *** [buildkernel] Error code 2 make[1]: stopped in /usr/src 1 error make[1]: stopped in /usr/src *** [buildkernel] Error code 2 make: stopped in /usr/src 1 error make: stopped in /usr/src Build step 'Execute shell' marked build as failure [WARNINGS] Skipping publisher since build result is FAILURE [PostBuildScript] - Execution post build scripts. [FreeBSD_STABLE_10-i386] $ /bin/sh -xe /tmp/hudson7773966590849783569.sh + export 'PATH=3D/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/b= in' + export 'jname=3DFreeBSD_STABLE_10-i386' + echo 'clean up jail FreeBSD_STABLE_10-i386' clean up jail FreeBSD_STABLE_10-i386 + sudo jail -r FreeBSD_STABLE_10-i386 + sudo ifconfig igb0 inet6 2610:1c1:1:607c::101:1 -alias + sudo umount FreeBSD_STABLE_10-i386/usr/src + sudo umount FreeBSD_STABLE_10-i386/dev + sudo rm -fr FreeBSD_STABLE_10-i386 rm: FreeBSD_STABLE_10-i386/libexec/ld-elf.so.1: Operation not permitted rm: FreeBSD_STABLE_10-i386/libexec: Directory not empty rm: FreeBSD_STABLE_10-i386/sbin/init: Operation not permitted rm: FreeBSD_STABLE_10-i386/sbin: Directory not empty rm: FreeBSD_STABLE_10-i386/usr/bin/crontab: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/ypchpass: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/passwd: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/ypchfn: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/chsh: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/ypchsh: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/chfn: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/login: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/su: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/chpass: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/opieinfo: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/opiepasswd: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin/yppasswd: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/bin: Directory not empty rm: FreeBSD_STABLE_10-i386/usr/lib/librt.so.1: Operation not permitted rm: FreeBSD_STABLE_10-i386/usr/lib: Directory not empty rm: FreeBSD_STABLE_10-i386/usr: Directory not empty rm: FreeBSD_STABLE_10-i386/lib/libcrypt.so.5: Operation not permitted rm: FreeBSD_STABLE_10-i386/lib/libthr.so.3: Operation not permitted rm: FreeBSD_STABLE_10-i386/lib/libc.so.7: Operation not permitted rm: FreeBSD_STABLE_10-i386/lib: Directory not empty rm: FreeBSD_STABLE_10-i386: Directory not empty + true + sudo chflags -R noschg FreeBSD_STABLE_10-i386 + sudo rm -fr FreeBSD_STABLE_10-i386 Email was triggered for: Failure - Any Sending email for trigger: Failure - Any From owner-freebsd-stable@freebsd.org Mon Oct 5 12:29:42 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 335C099A77F; Mon, 5 Oct 2015 12:29:42 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 17B018B8; Mon, 5 Oct 2015 12:29:42 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id ACED715ED; Mon, 5 Oct 2015 12:29:41 +0000 (UTC) Date: Mon, 5 Oct 2015 12:29:38 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: mav@FreeBSD.org, jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org, freebsd-i386@FreeBSD.org Message-ID: <1095124649.173.1444048180928.JavaMail.jenkins@jenkins-9.freebsd.org> In-Reply-To: <478778636.163.1444040142838.JavaMail.jenkins@jenkins-9.freebsd.org> References: <478778636.163.1444040142838.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: FreeBSD_STABLE_10-i386 - Build #525 - Fixed MIME-Version: 1.0 X-Jenkins-Job: FreeBSD_STABLE_10-i386 X-Jenkins-Result: SUCCESS Precedence: bulk Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 12:29:42 -0000 FreeBSD_STABLE_10-i386 - Build #525 - Fixed: Build information: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/525/ Full change log: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/525/changes Full build log: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_10-i386/525/console Change summaries: 288811 by mav: MFC r288348: Umplement media load/eject support for removable devices. In case of block backend eject really closes the backing store, while load tries to open it back. Failed store open is reported as no media. 288810 by mav: MFC r288310: Add to CTL initial support for CDROMs and removable devices. Relnotes: yes 288809 by mav: MFC r288264: Allow LOG SENSE command on non-disk devices. 288808 by mav: MFC r288262: Remove concept of control device. 288807 by mav: MFC r288261: Move ioctl frontend defines where they belong. 288806 by mav: MFC r288260: Remove few more unused variables. 288805 by mav: MFC r288259: Remove some duplicate, legacy, dead and questionable code. 288804 by mav: MFC r288247: Pass to sobind() copy of the address, not the original. 288803 by mav: MFC r288239: Properly lock LUN in ctl_failover_lun(). 288802 by mav: MFC r288224: Constify ctl_serialize_table. 288801 by mav: MFC r288229: Fix bit masks changed for the wrong commands in r288221. 288800 by mav: MFC r288221: Remove some dead code found by Clang analyzer. 288799 by mav: MFC r288220: Remove stale comments and some excessive empty lines. 288798 by mav: MFC r288215: Switch I/O time accounting from system time to uptime. While there, make num_dmas accounted independently of CTL_TIME_IO. 288797 by mav: MFC r288214: Collect DMA statistics on secondary HA node. 288796 by mav: MFC r288213: Make HA handle datamove and done in a universal way, using port methods. Now from primary node point of view requests transferred from secondary node should look almost normal and always have valid port. 288795 by mav: MFC r288211: Remove some control_softc references. 288794 by mav: MFC r288175: Allow WRITE SAME with NDOB bit set but without UNMAP. This combination was originally forbidden, but allowed at spc4r3. 288793 by mav: MFC r288170: Add new report types to REPORT LUNS command. This is only for completeness, since we have nothing new to report there. 288792 by mav: MFC r288166: Update WRITE ATOMIC(16) support to sbc4r8 draft. This is only a cosmetic change. We still don't support atomic boundary field in the CDB, but at least now we do it formally. 288791 by mav: MFC r288165: Add support for READ BUFFER(16) command. 288790 by mav: MFC r288148: Synchronize mode pages between HA peers. We allow to modify only few fields in mode pages now, but still it is not good if they unexpectedly change during failover. Also this fixes reporting of "Mode parameters changed" UAs on secondary node. 288789 by mav: MFC r288146: Make HA peers announce their parameters on connect. HA protocol requires strict version, parameters and configuration match. Differences there may cause full set of problems up to kernel panic. To avoid that, validate peer parameters on connect, and abort connection immediately if some mismatch detected. 288788 by mav: MFC r288110: Add support for Control extension mode page. 288787 by mav: MFC r288104: Remove duplicate and incomplete code handling LUN modify. Instead reuse code from LUN creation. This allows most of LUN media options to be changed live with modify request without full restart. 288786 by mav: MFC r288067: Log iSCSI session reinstatements. False session reinstatements can be result of misconfiguration, when several initiators use the same initiator name and ISID. 288785 by mav: MFC r288061: Make cltd ignore HA ports. 288784 by mav: MFC r288059: Bunch of improvements to ctlstat. Add -p option to allow filtering by ports. Make -l and -p options work in all modes as filters. Improve output formatting to better fit columns. 288783 by mav: MFC r288043: Output times as normal microseconds, rather then in bintime format. 288782 by mav: MFC r288021: Mark with DMA flag I/Os waiting for iSCSI write data after R2T. Reads and immediate writes are not blocking, so don't bother. 288781 by mav: MFC r288020: Remove couple excess SGLIST I/O flags. Those flags duplicated respective (sg_entries > 0) values. 288779 by mav: MFC r287994: Always execute REPORT LUNS and REQUEST SENSE commands locally. REPORT LUNS command is more related to target rather then specific LUN. This node may be primary for LUNs for some reason unknown to another, and command forwarded to another node won't be able to report them. REQUEST SENSE is related to LUN, but in our implementation it reports only UAs and CAs, that are stored locally rather then on primary node. 288778 by mav: MFC r287993: Split two command flags with different meaning. This is only a cosmetical change. 288777 by mav: MFC r287991: Pack struct ctl_ha_msg_hdr by 8 bytes. 288776 by mav: MFC r287986: Fix memory corruption when >128K transferred through HA link. While there, do some cleaning. 288775 by mav: MFC r287968: Mark I/Os with DMA flag while moving data through the HA link. 288774 by mav: MFC r287967: Relax serseq option operation for reads. Previously, with serseq enabled, next command was unblocked only after previous completed. With this change, for read operations, next command is unblocked as soon as last media read completed. This is important for frontends that actually wait for data move completion (like camtgt), or when data are moved through the HA link, or especially when both. 288773 by mav: MFC r287957: Kill HA link and shutdown the threads on shutdown. 288772 by mav: MFC r287956: Update list of opcodes to 5/26/15. 288771 by mav: MFC r287955: Update list of ASC/ASCQ codes from 5/20/12 to 8/12/15. 288770 by mav: MFC r287940: Replicate initiators WWPNs and names between HA peers. 288769 by mav: MFC r287933: Replicate port->init_devid to HA peer. 288768 by mav: MFC r287921: When reporting TPT UA, report which of thresholds was reached. 288767 by mav: MFC r287913: Report number of failed XCOPY segment. 288766 by mav: MFC r279433 (by rstone): Implement asprintf in libkern From owner-freebsd-stable@freebsd.org Mon Oct 5 13:18:03 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9C77699A3E9 for ; Mon, 5 Oct 2015 13:18:03 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 54E7695E; Mon, 5 Oct 2015 13:18:03 +0000 (UTC) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.15.2/8.15.2) with ESMTP id t95DMl45069618; Mon, 5 Oct 2015 09:22:48 -0400 (EDT) (envelope-from mike@sentex.net) To: Alexander Motin , FreeBSD-STABLE Mailing List From: Mike Tancsa Subject: recent ZFS / CAM updates in RELENG_10? Organization: Sentex Communications Message-ID: <56127857.8080709@sentex.net> Date: Mon, 5 Oct 2015 09:17:11 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 13:18:03 -0000 Hi, I noticed a whole whack of MFCs to RELENG_10 for zfs and cam (thanks for all that!) Just wondering if there is more to come, or is this perhaps a good time to start testing with all these changes on a few non critical boxes ? ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@freebsd.org Mon Oct 5 13:42:03 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43F279B1907 for ; Mon, 5 Oct 2015 13:42:03 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-la0-x229.google.com (mail-la0-x229.google.com [IPv6:2a00:1450:4010:c03::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C85D4D17 for ; Mon, 5 Oct 2015 13:42:02 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by laddr2 with SMTP id dr2so8015209lad.3 for ; Mon, 05 Oct 2015 06:42:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=/r9uVykchctifK1nFq+RceB6/FRSyN5yxDIQkyGZsdE=; b=kWxCkXBAs6L1jI9+tK0o7eL3y53aLOsmtrPVHJHL/nU9dx/nE4fnrKRcAKpPtIVoQ4 74LYqEsth7llVkUPuU+AshfeSLQm1NFzW4Rot00GG0hTLUc9piUM3J5mnTAKGIoBgT7N hW3L1MP7M27QLiK6FHFzY48gpfvkVfIFunYDAS8RmdgaTcX64trGloIxpoZyqiB2MFSd xHX7aQWVNmYUMJIgDx0p971WMqSGLUffgSCnS2V6LRwF7mss68i0taxOVC52ijB21Fi5 9/zjxUQ2dXKKy2pYav0+ejyQLvgrHhHQ5P+FExN8rECXy6BVr+7HgL2vTokGcCx37n0v desw== X-Received: by 10.25.81.3 with SMTP id f3mr7758747lfb.44.1444052520411; Mon, 05 Oct 2015 06:42:00 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([2a01:d0:c0a9:3:c685:8ff:fe11:1aa2]) by smtp.googlemail.com with ESMTPSA id h7sm4197790lbk.8.2015.10.05.06.41.59 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 05 Oct 2015 06:41:59 -0700 (PDT) Sender: Alexander Motin Message-ID: <56127E26.4070609@FreeBSD.org> Date: Mon, 05 Oct 2015 16:41:58 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: Mike Tancsa , FreeBSD-STABLE Mailing List Subject: Re: recent ZFS / CAM updates in RELENG_10? References: <56127857.8080709@sentex.net> In-Reply-To: <56127857.8080709@sentex.net> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 13:42:03 -0000 Hi. On 05.10.2015 16:17, Mike Tancsa wrote: > I noticed a whole whack of MFCs to RELENG_10 for zfs and cam (thanks > for all that!) Just wondering if there is more to come, or is this > perhaps a good time to start testing with all these changes on a few non > critical boxes ? At this point I've merged all I planned. There are few more recent ZFS commits in HEAD that are not merged, but they are not mine, so I leave them to authors. So yes, I think now it is a good time to start testing. -- Alexander Motin From owner-freebsd-stable@freebsd.org Mon Oct 5 17:10:30 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3265E9B59A0 for ; Mon, 5 Oct 2015 17:10:30 +0000 (UTC) (envelope-from lists@searchy.net) Received: from j006.host001.searchy.nl (j006.host001.searchy.nl [79.143.214.199]) by mx1.freebsd.org (Postfix) with ESMTP id B59F115E4 for ; Mon, 5 Oct 2015 17:10:28 +0000 (UTC) (envelope-from lists@searchy.net) Received: from [192.168.5.21] (5418453B.cm-5-1b.dynamic.ziggo.nl [84.24.69.59]) (Authenticated sender: ppi@j006.host001.searchy.nl) by j006.host001.searchy.nl (Postfix) with ESMTPSA id 359B01E8C07; Mon, 5 Oct 2015 17:10:26 +0000 (UTC) Message-ID: <5612AF01.1040806@searchy.net> Date: Mon, 05 Oct 2015 19:10:25 +0200 From: "Frank de Bot (lists)" User-Agent: Mozilla/5.0 (X11; Linux i686; rv:34.0) Gecko/20100101 Firefox/34.0 SeaMonkey/2.31 MIME-Version: 1.0 To: Jack Vogel CC: FreeBSD Stable Subject: Re: em0 and em1 watchdog timed out References: <560EC0C6.409@searchy.net> <56117BD8.10806@searchy.net> In-Reply-To: <56117BD8.10806@searchy.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 17:10:30 -0000 The connection is fine when working without lagg/lacp. As soon I configure it, on load it the network devices will have watchdog timeouts. The switch I use is a HP 1810-24G, PL.1.9 One of the other threads mentioned he used an other router (/switch) and problems didn't occur anymore. Unfortunately I don't have an other switch lying around to test with. Frank Frank de Bot (lists) wrote: > FreeBSD 10.2 r286666 . The drivers is Intel(R) PRO/1000 Network > Connection 7.4.2 I will start some tests without lagg configured. > > > Regards, > > Frank de Bot > > > Jack Vogel wrote: >> You missed the all-important details: OS version, driver version. >> And another question I can think of, do these interfaces watchdog if they >> are not configured with lagg? >> >> Cheers, >> >> Jack >> >> >> On Fri, Oct 2, 2015 at 10:37 AM, Frank de Bot (lists) >> wrote: >> >>> On a server I have 2 interfaces configured in a lagg. It seemed to be >>> running stable until now (about a week), both interfaces repeatable go >>> down after a watchdog timeout. >>> >>> Output from /var/log/messages >>> >>> Oct 2 10:15:11 nas kernel: em0: Watchdog timeout Queue[0]-- resetting >>> Oct 2 10:15:11 nas kernel: Interface is RUNNING and ACTIVE >>> Oct 2 10:15:11 nas kernel: em0: TX Queue 0 ------ >>> Oct 2 10:15:11 nas kernel: em0: hw tdh = 804, hw tdt = 905 >>> Oct 2 10:15:11 nas kernel: em0: Tx Queue Status = -2147483648 >>> Oct 2 10:15:11 nas kernel: em0: TX descriptors avail = 915 >>> Oct 2 10:15:11 nas kernel: em0: Tx Descriptors avail failure = 0 >>> Oct 2 10:15:11 nas kernel: em0: RX Queue 0 ------ >>> Oct 2 10:15:11 nas kernel: em0: hw rdh = 912, hw rdt = 911 >>> Oct 2 10:15:11 nas kernel: em0: RX discarded packets = 0 >>> Oct 2 10:15:11 nas kernel: em0: RX Next to Check = 912 >>> Oct 2 10:15:11 nas kernel: em0: RX Next to Refresh = 911 >>> Oct 2 10:15:11 nas kernel: em0: link state changed to DOWN >>> Oct 2 10:15:13 nas kernel: em0: link state changed to UP >>> Oct 2 10:15:13 nas devd: Executing '/etc/rc.d/dhclient quietstart em0' >>> Oct 2 10:21:56 nas kernel: em1: Interface stopped DISTRIBUTING, >>> possible flapping >>> Oct 2 10:21:59 nas kernel: em1: Watchdog timeout Queue[0]-- resetting >>> Oct 2 10:21:59 nas kernel: Interface is RUNNING and ACTIVE >>> Oct 2 10:21:59 nas kernel: em1: TX Queue 0 ------ >>> Oct 2 10:21:59 nas kernel: em1: hw tdh = 686, hw tdt = 806 >>> Oct 2 10:21:59 nas kernel: em1: Tx Queue Status = -2147483648 >>> Oct 2 10:21:59 nas kernel: em1: TX descriptors avail = 896 >>> Oct 2 10:21:59 nas kernel: em1: Tx Descriptors avail failure = 0 >>> Oct 2 10:21:59 nas kernel: em1: RX Queue 0 ------ >>> Oct 2 10:21:59 nas kernel: em1: hw rdh = 167, hw rdt = 166 >>> Oct 2 10:21:59 nas kernel: em1: RX discarded packets = 0 >>> Oct 2 10:21:59 nas kernel: em1: RX Next to Check = 167 >>> Oct 2 10:21:59 nas kernel: em1: RX Next to Refresh = 166 >>> Oct 2 10:21:59 nas kernel: em1: link state changed to DOWN >>> Oct 2 10:22:02 nas kernel: em1: link state changed to UP >>> Oct 2 10:22:02 nas devd: Executing '/etc/rc.d/dhclient quietstart em1' >>> >>> it seems to occur when the interface are loaded. On the same server I >>> also have a PCI card, the same issue occurs here. em0 and em1 are both >>> onboard 80003ES2LAN. the PCI card is 82571EB. >>> >>> I've found different threads, but I couldn't manage to find a fix for >>> this. >>> >>> What else can be wrong? >>> >>> Regards, >>> >>> Frank de Bot >>> _______________________________________________ >>> freebsd-stable@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >>> >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >> > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Mon Oct 5 22:17:26 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6CFD39C25B1 for ; Mon, 5 Oct 2015 22:17:26 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id 096DE8B2; Mon, 5 Oct 2015 22:17:25 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) IronPort-PHdr: 9a23:MdEqXx9e5I58Yv9uRHKM819IXTAuvvDOBiVQ1KB91OkcTK2v8tzYMVDF4r011RmSDdmdtaMP07uempujcFJDyK7JiGoFfp1IWk1NouQttCtkPvS4D1bmJuXhdS0wEZcKflZk+3amLRodQ56mNBXsq3G/pQQfBg/4fVIsYL+lRsiM3o/vhqibwN76XUZhvHKFe7R8LRG7/036l/I9ps9cEJs30QbDuXBSeu5blitCLFOXmAvgtI/rpMYwuwwZgf8q9tZBXKPmZOx4COUAVHV1e1wysebrrxjYUQqG4DM/SGwKgBdSS1zO7znxXYz2vDe8uucriweAOsijd7E/WnyH5qxoTBLtwHMdMjcy82Xaj+Rti61GrRa5p1p0ytiHM8muKPNic/aFLpshTm1bU5MUDnQZDw== X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2DLAQCs9hJW/61jaINeg3tuBr4OAQ2BWhcKhS9KAoFyFAEBAQEBAQEBgQmCHYIHAQEBAwEBAQEgKyALBQkCAgEIDgoCAg0ZAgIbDAEJGAENAgQIBwQBHASIBQgNqXyUHgEBAQEBAQEDAQEBAQEBAQEBARgEgR6FUYR+hCoLBQIBHDQHgi47EoExBZV+hReFGIQ+SIcUkjECHwEBQoQeIjMBBoZwQoEGAQEB X-IronPort-AV: E=Sophos;i="5.17,640,1437451200"; d="scan'208";a="242874778" Received: from nipigon.cs.uoguelph.ca (HELO zcs1.mail.uoguelph.ca) ([131.104.99.173]) by esa-annu.net.uoguelph.ca with ESMTP; 05 Oct 2015 18:16:55 -0400 Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id A974715F55D; Mon, 5 Oct 2015 18:16:55 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id 85kX8puYo9FS; Mon, 5 Oct 2015 18:16:54 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 84FA315F563; Mon, 5 Oct 2015 18:16:54 -0400 (EDT) X-Virus-Scanned: amavisd-new at zcs1.mail.uoguelph.ca Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id Iy7MQOWFCyAP; Mon, 5 Oct 2015 18:16:54 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca (zcs1.mail.uoguelph.ca [172.17.95.18]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 6B0AC15F55D; Mon, 5 Oct 2015 18:16:54 -0400 (EDT) Date: Mon, 5 Oct 2015 18:16:54 -0400 (EDT) From: Rick Macklem To: Christian Kratzer Cc: freebsd-stable@freebsd.org, John Baldwin Message-ID: <1721669289.24365403.1444083414400.JavaMail.zimbra@uoguelph.ca> In-Reply-To: References: Subject: Re: smbfs crashes since approx. 10.1-RELEASE MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.95.12] X-Mailer: Zimbra 8.0.9_GA_6191 (ZimbraWebClient - FF34 (Win)/8.0.9_GA_6191) Thread-Topic: smbfs crashes since approx. 10.1-RELEASE Thread-Index: 9GB0f/hsrH9dvWLWGo36F6O7ZxK6Aw== X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Oct 2015 22:17:26 -0000 Christian Kratzer wrote: > Hi, > > I run a regular rsync job that runs from cron and copies stuff that gets > created on a Windows smbfs share. > > Starting about 10.1-RELEASE the VM has become unstable and started panicing. > > I have narrowed the issue down to the aforementioned rsync job. > > When I move the job to a different VM the the other VM starts crashing and > the VM without the job becomes stable agin. > > I have panics and crashinfos stored in /var/crash if anybody is interested: > > root@noc2:/var/crash # uname -a > FreeBSD noc2.cksoft.de 10.2-RELEASE FreeBSD 10.2-RELEASE #0 r286666: Wed > Aug 12 15:26:37 UTC 2015 > root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 > root@noc2:/var/crash # freebsd-version -u > 10.2-RELEASE-p5 > root@noc2:/var/crash # freebsd-version -k > 10.2-RELEASE > root@noc2:/var/crash # > > This is what I have in /var/crash/core.txt.0 > > Fatal trap 12: page fault while in kernel mode > cpuid = 0; apic id = 00 > fault virtual address = 0x20 > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff80996c7c > stack pointer = 0x28:0xfffffe003d6c0ac0 > frame pointer = 0x28:0xfffffe003d6c0af0 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = resume, IOPL = 0 > current process = 1349 (smbiod10) > trap number = 12 > panic: page fault > cpuid = 0 > KDB: stack backtrace: > #0 0xffffffff80984e30 at kdb_backtrace+0x60 > #1 0xffffffff809489e6 at vpanic+0x126 > #2 0xffffffff809488b3 at panic+0x43 > #3 0xffffffff80d4aadb at trap_fatal+0x36b > #4 0xffffffff80d4addd at trap_pfault+0x2ed > #5 0xffffffff80d4a47a at trap+0x47a > #6 0xffffffff80d307f2 at calltrap+0x8 > #7 0xffffffff8092ebe0 at __mtx_unlock_sleep+0x60 > #8 0xffffffff8092eb69 at __mtx_unlock_flags+0x69 > #9 0xffffffff81a1b724 at smb_iod_thread+0xb4 > #10 0xffffffff8091244a at fork_exit+0x9a > #11 0xffffffff80d30d2e at fork_trampoline+0xe > Uptime: 2h43m55s > Dumping 103 out of 999 MB: (CTRL-C to abort) > ..16%..31%..47%..62%..78%..93% > This crash is occurring when doing an mtx_unlock(&Giant). Unfortunately, I'm not conversant w.r.t. this code. I've cc'd jhb@ in case he has some insight. If you don't get any responses, I'd suggest reposting to freebsd-current@ with "crashes in mtx_unlock(&Giant)" in the subject line. Btw John, the code does tsleep() in a loop before the mtx_unlock(&Giant). I do remember that was once allowed, but am not sure if it still is (ie a tsleep() call while holding Giant)? Hopefully someone who knows what is special about Giant that might cause this will respond. Good luck with it, rick > Reading symbols from /boot/kernel/smbfs.ko.symbols...done. > Loaded symbols for /boot/kernel/smbfs.ko.symbols > Reading symbols from /boot/kernel/libiconv.ko.symbols...done. > Loaded symbols for /boot/kernel/libiconv.ko.symbols > Reading symbols from /boot/kernel/libmchain.ko.symbols...done. > Loaded symbols for /boot/kernel/libmchain.ko.symbols > #0 doadump (textdump=) at pcpu.h:219 > 219 pcpu.h: No such file or directory. > in pcpu.h > (kgdb) #0 doadump (textdump=) at pcpu.h:219 > #1 0xffffffff80948642 in kern_reboot (howto=260) > at /usr/src/sys/kern/kern_shutdown.c:451 > #2 0xffffffff80948a25 in vpanic (fmt=, > ap=) at /usr/src/sys/kern/kern_shutdown.c:758 > #3 0xffffffff809488b3 in panic (fmt=0x0) > at /usr/src/sys/kern/kern_shutdown.c:687 > #4 0xffffffff80d4aadb in trap_fatal (frame=, > eva=) at /usr/src/sys/amd64/amd64/trap.c:851 > #5 0xffffffff80d4addd in trap_pfault (frame=0xfffffe003d6c0a10, > usermode=) at /usr/src/sys/amd64/amd64/trap.c:674 > #6 0xffffffff80d4a47a in trap (frame=0xfffffe003d6c0a10) > at /usr/src/sys/amd64/amd64/trap.c:440 > #7 0xffffffff80d307f2 in calltrap () > at /usr/src/sys/amd64/amd64/exception.S:236 > #8 0xffffffff80996c7c in turnstile_broadcast (ts=0x0, queue=0) > at /usr/src/sys/kern/subr_turnstile.c:838 > #9 0xffffffff8092ebe0 in __mtx_unlock_sleep (c=0xfffff80002df0390, > opts=, > file=0xffffffff81a25801 "%s: Can't handle disordered parameters %d:%d\n", > line=1) at /usr/src/sys/kern/kern_mutex.c:791 > #10 0xffffffff8092eb69 in __mtx_unlock_flags (c=, > opts=, > file=0xffffffff81a25801 "%s: Can't handle disordered parameters %d:%d\n", > line=1) at /usr/src/sys/kern/kern_mutex.c:254 > #11 0xffffffff81a1b724 in smb_iod_thread (arg=0xfffff80002df0300) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_iod.c:624 > #12 0xffffffff8091244a in fork_exit ( > callout=0xffffffff81a1b670 , arg=0xfffff80002df0300, > frame=0xfffffe003d6c0c00) at /usr/src/sys/kern/kern_fork.c:1018 > #13 0xffffffff80d30d2e in fork_trampoline () > at /usr/src/sys/amd64/amd64/exception.S:611 > #14 0x0000000000000000 in ?? () > Current language: auto; currently minimal > (kgdb) > > > Any tips on howto proceeed with this ? > > I can setup a dedicated VM with a fresh install of whatever in case it helps. > > Greetings > Christian > > -- > Christian Kratzer CK Software GmbH > Email: ck@cksoft.de Wildberger Weg 24/2 > Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden > Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart > Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer > Web: http://www.cksoft.de/ > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Tue Oct 6 00:04:28 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C89FE9B6BA4 for ; Tue, 6 Oct 2015 00:04:28 +0000 (UTC) (envelope-from dweimer@dweimer.net) Received: from webmail.dweimer.net (24-240-198-187.static.stls.mo.charter.com [24.240.198.187]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 70637F5D for ; Tue, 6 Oct 2015 00:04:27 +0000 (UTC) (envelope-from dweimer@dweimer.net) Received: from webmail.dweimer.local (localhost [192.168.5.2]) by webmail.dweimer.net (8.15.2/8.15.2) with ESMTPS id t9600WK3001070 (version=TLSv1.2 cipher=DHE-RSA-CHACHA20-POLY1305 bits=256 verify=NO); Mon, 5 Oct 2015 19:00:32 -0500 (CDT) (envelope-from dweimer@dweimer.net) Received: (from www@localhost) by webmail.dweimer.local (8.15.2/8.15.2/Submit) id t9600V6t001069; Mon, 5 Oct 2015 19:00:31 -0500 (CDT) (envelope-from dweimer@dweimer.net) X-Authentication-Warning: webmail.dweimer.local: www set sender to dweimer@dweimer.net using -f To: Christian Kratzer , freebsd-stable@freebsd.org Subject: Re: smbfs crashes since approx. 10.1-RELEASE X-PHP-Script: www.dweimer.net/webmail/index.php for 192.168.5.1, 192.168.5.3 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Mon, 05 Oct 2015 19:00:31 -0500 From: dweimer Organization: dweimer.net Reply-To: dweimer@dweimer.net Mail-Reply-To: dweimer@dweimer.net In-Reply-To: <1721669289.24365403.1444083414400.JavaMail.zimbra@uoguelph.ca> References: <1721669289.24365403.1444083414400.JavaMail.zimbra@uoguelph.ca> Message-ID: <543b298ddfd6fffaf138c913a650519a@dweimer.net> X-Sender: dweimer@dweimer.net User-Agent: Roundcube Webmail/1.1.3 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 00:04:28 -0000 On 2015-10-05 5:16 pm, Rick Macklem wrote: > Christian Kratzer wrote: >> Hi, >> >> I run a regular rsync job that runs from cron and copies stuff that >> gets >> created on a Windows smbfs share. >> >> Starting about 10.1-RELEASE the VM has become unstable and started >> panicing. >> >> I have narrowed the issue down to the aforementioned rsync job. >> >> When I move the job to a different VM the the other VM starts crashing >> and >> the VM without the job becomes stable agin. >> >> I have panics and crashinfos stored in /var/crash if anybody is >> interested: >> >> root@noc2:/var/crash # uname -a >> FreeBSD noc2.cksoft.de 10.2-RELEASE FreeBSD 10.2-RELEASE #0 >> r286666: Wed >> Aug 12 15:26:37 UTC 2015 >> root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 >> root@noc2:/var/crash # freebsd-version -u >> 10.2-RELEASE-p5 >> root@noc2:/var/crash # freebsd-version -k >> 10.2-RELEASE Shouldn't the kernel version also be 10.2-RELEASE-p5? Perhaps the user land being different than the kernel is causing an issue? root@freebsd:/home/dweimer # uname -a FreeBSD freebsd.dweimer.local 10.2-RELEASE-p5 FreeBSD 10.2-RELEASE-p5 #1 r288512: Fri Oct 2 13:54:14 CDT 2015 dweimer@freebsd.dweimer.local:/jails/devel/ROOT/usr/obj/jails/devel/ROOT/usr/src/sys/GENERIC amd64 root@freebsd:/home/dweimer # freebsd-version -u 10.2-RELEASE-p5 root@freebsd:/home/dweimer # freebsd-version -k 10.2-RELEASE-p5 -- Thanks, Dean E. Weimer http://www.dweimer.net/ From owner-freebsd-stable@freebsd.org Tue Oct 6 03:53:07 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4EF149B6462 for ; Tue, 6 Oct 2015 03:53:07 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-ob0-x231.google.com (mail-ob0-x231.google.com [IPv6:2607:f8b0:4003:c01::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0CFFEBEC for ; Tue, 6 Oct 2015 03:53:07 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by obbzf10 with SMTP id zf10so144811332obb.2 for ; Mon, 05 Oct 2015 20:53:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=ea8tCpHd0fnnOUcJSzRsQ0silX4aLhM+mOT8PAK0lCw=; b=oBnTGHBEiw1gL8Yxs/JaV0E/mVIyRBhgqtmUElcqoGeDD9QznZg40amAaPEY/ny008 P0tMXSmVybJBPd3PD6QnMYn5NdbPJUhKM5nzjSkvzQVm+cwqSPHwYQtJEQ7BPLpAYYuW Z4LMH3dQfnDU2FyRJtVsOblq91B3OxTz9pjqoEuI38LCaccdzP5qGDvGIkJ2aXYX31gC iQ+wqJQz3wAba4bd/pcvJ7dV7Ek3CQJ2Dx8173WqCQxJAS4dPsvy+FA8gGFL3MoIBfC9 zFDD3O1+OZleP17vbkdmFIWSJ0oPuv3R/iXJ9e4hl4d0fUfUIoHFw6M0AAsGiOWUi96C ghfQ== MIME-Version: 1.0 X-Received: by 10.182.104.130 with SMTP id ge2mr18895666obb.79.1444103586224; Mon, 05 Oct 2015 20:53:06 -0700 (PDT) Sender: kob6558@gmail.com Received: by 10.202.102.9 with HTTP; Mon, 5 Oct 2015 20:53:06 -0700 (PDT) In-Reply-To: <543b298ddfd6fffaf138c913a650519a@dweimer.net> References: <1721669289.24365403.1444083414400.JavaMail.zimbra@uoguelph.ca> <543b298ddfd6fffaf138c913a650519a@dweimer.net> Date: Mon, 5 Oct 2015 20:53:06 -0700 X-Google-Sender-Auth: SyNxHAvc5Bo8ijqfIUa5p9CQf2U Message-ID: Subject: Re: smbfs crashes since approx. 10.1-RELEASE From: Kevin Oberman To: dweimer@dweimer.net Cc: Christian Kratzer , FreeBSD-STABLE Mailing List Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 03:53:07 -0000 On Mon, Oct 5, 2015 at 5:00 PM, dweimer wrote: > On 2015-10-05 5:16 pm, Rick Macklem wrote: > >> Christian Kratzer wrote: >> >>> Hi, >>> >>> I run a regular rsync job that runs from cron and copies stuff that gets >>> created on a Windows smbfs share. >>> >>> Starting about 10.1-RELEASE the VM has become unstable and started >>> panicing. >>> >>> I have narrowed the issue down to the aforementioned rsync job. >>> >>> When I move the job to a different VM the the other VM starts crashing >>> and >>> the VM without the job becomes stable agin. >>> >>> I have panics and crashinfos stored in /var/crash if anybody is >>> interested: >>> >>> root@noc2:/var/crash # uname -a >>> FreeBSD noc2.cksoft.de 10.2-RELEASE FreeBSD 10.2-RELEASE #0 >>> r286666: Wed >>> Aug 12 15:26:37 UTC 2015 >>> root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 >>> root@noc2:/var/crash # freebsd-version -u >>> 10.2-RELEASE-p5 >>> root@noc2:/var/crash # freebsd-version -k >>> 10.2-RELEASE >>> >> > Shouldn't the kernel version also be 10.2-RELEASE-p5? Perhaps the user > land being different than the kernel is causing an issue? > > root@freebsd:/home/dweimer # uname -a > FreeBSD freebsd.dweimer.local 10.2-RELEASE-p5 FreeBSD 10.2-RELEASE-p5 #1 > r288512: Fri Oct 2 13:54:14 CDT 2015 dweimer@freebsd.dweimer.local:/jails/devel/ROOT/usr/obj/jails/devel/ROOT/usr/src/sys/GENERIC > amd64 > root@freebsd:/home/dweimer # freebsd-version -u > 10.2-RELEASE-p5 > root@freebsd:/home/dweimer # freebsd-version -k > 10.2-RELEASE-p5 > > -- > Thanks, > Dean E. Weimer > http://www.dweimer.net/ Probably not. If freebsd-update is used and the update does not change the kernel, the kernel is not touched and remains at the prior level. If built from sources, even though the kernel is identical, the kernel version is bumped. I just confirmed that none of the updates to 10.2-RELEASE appear to update the kernel. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 From owner-freebsd-stable@freebsd.org Tue Oct 6 06:15:21 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 561AD99A5B6 for ; Tue, 6 Oct 2015 06:15:21 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from mx1.cksoft.de (mx1.cksoft.de [IPv6:2001:67c:24f8:1::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.cksoft.de", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 044A2C50 for ; Tue, 6 Oct 2015 06:15:21 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from m.cksoft.de (m.cksoft.de [212.17.240.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.cksoft.de (Postfix) with ESMTPSA id ED5041E9EB2; Tue, 6 Oct 2015 08:15:15 +0200 (CEST) Received: from amavis.cksoft.de (unknown [IPv6:2a01:170:1110:8001::25:a1]) by m.cksoft.de (Postfix) with ESMTP id 6181D631D0; Tue, 6 Oct 2015 08:13:47 +0200 (CEST) X-Virus-Scanned: amavisd-new at cksoft.de Received: from m.cksoft.de ([192.168.64.93]) by amavis.cksoft.de (amavis.cksoft.de [192.168.64.94]) (amavisd-new, port 10041) with ESMTP id RZYaegD6XP95; Tue, 6 Oct 2015 08:13:46 +0200 (CEST) Received: from noc1.cksoft.de (noc1.cksoft.de [IPv6:2a01:170:1110:8001::53:1]) by m.cksoft.de (Postfix) with ESMTP id 90D8862F88; Tue, 6 Oct 2015 08:13:46 +0200 (CEST) Received: by noc1.cksoft.de (Postfix, from userid 1000) id 9E45313BCB; Tue, 6 Oct 2015 08:15:14 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by noc1.cksoft.de (Postfix) with ESMTP id 97BA013BCA; Tue, 6 Oct 2015 08:15:14 +0200 (CEST) Date: Tue, 6 Oct 2015 08:15:14 +0200 (CEST) From: Christian Kratzer X-X-Sender: ck@noc1.cksoft.de Reply-To: Christian Kratzer To: dweimer cc: freebsd-stable@freebsd.org Subject: Re: smbfs crashes since approx. 10.1-RELEASE In-Reply-To: <543b298ddfd6fffaf138c913a650519a@dweimer.net> Message-ID: References: <1721669289.24365403.1444083414400.JavaMail.zimbra@uoguelph.ca> <543b298ddfd6fffaf138c913a650519a@dweimer.net> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) X-Spammer-Kill-Ratio: 75% MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 06:15:21 -0000 Hi, On Mon, 5 Oct 2015, dweimer wrote: >>> root@noc2:/var/crash # freebsd-version -u >>> 10.2-RELEASE-p5 >>> root@noc2:/var/crash # freebsd-version -k >>> 10.2-RELEASE > > Shouldn't the kernel version also be 10.2-RELEASE-p5? Perhaps the user land > being different than the kernel is causing an issue? > > root@freebsd:/home/dweimer # uname -a > FreeBSD freebsd.dweimer.local 10.2-RELEASE-p5 FreeBSD 10.2-RELEASE-p5 #1 > r288512: Fri Oct 2 13:54:14 CDT 2015 > dweimer@freebsd.dweimer.local:/jails/devel/ROOT/usr/obj/jails/devel/ROOT/usr/src/sys/GENERIC > amd64 > root@freebsd:/home/dweimer # freebsd-version -u > 10.2-RELEASE-p5 > root@freebsd:/home/dweimer # freebsd-version -k > 10.2-RELEASE-p5 as this system is maintained by freebsd-update and there have been no kernel changes from release to p5 the kernel is still showing 10.2-RELEASE. It is normal for systems updated by freebsd-update that the kernel version lags behind the userland. Greetings Christian -- Christian Kratzer CK Software GmbH Email: ck@cksoft.de Wildberger Weg 24/2 Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer Web: http://www.cksoft.de/ From owner-freebsd-stable@freebsd.org Tue Oct 6 12:38:30 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B15F59B135F for ; Tue, 6 Oct 2015 12:38:30 +0000 (UTC) (envelope-from kraduk@gmail.com) Received: from mail-wi0-x236.google.com (mail-wi0-x236.google.com [IPv6:2a00:1450:400c:c05::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3D4066D2; Tue, 6 Oct 2015 12:38:30 +0000 (UTC) (envelope-from kraduk@gmail.com) Received: by wicfx3 with SMTP id fx3so156734660wic.0; Tue, 06 Oct 2015 05:38:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=oubm2OMG0WSoetqEP6WrMqWjsWDTQn7c9ThGpDwPoHc=; b=XzDaIirrVoaDDUvuTyK61bCAcP8lb3CglTSlwqwOpauEHc3YrmoxrPaeg0vXOSCwzC KfH1A2yi7TgfLYb6PquAg1D8IPjNH94vwiz4g4wQ8dJ5HLzbfBR1GYwlQuckLTr6oCpu 0Hq0dFAajwLGDA2DWPFezMaqHQFQ+zEe3bZzs8b45n2QF0dvIP5qJqrddEpKw4RMyubC 9v/VSxL8M6SIdk9qtSZXebKX23Q2cQmAu8DrQM4M8V1aiLSaI6CKMAv2RaXxiMMxLvUj r8xdliBo9HS7tUGxYRV4lynZabOx2gVDkZ2jaf2Q9LyQjBIBt2tdnzf57ptEm/ytCff+ wREQ== MIME-Version: 1.0 X-Received: by 10.194.171.3 with SMTP id aq3mr36238297wjc.54.1444135108568; Tue, 06 Oct 2015 05:38:28 -0700 (PDT) Received: by 10.28.125.18 with HTTP; Tue, 6 Oct 2015 05:38:28 -0700 (PDT) In-Reply-To: References: <20151005052643.GA2257@kib.kiev.ua> Date: Tue, 6 Oct 2015 13:38:28 +0100 Message-ID: Subject: Re: transparent redirection with pf and squid From: krad To: Konstantin Belousov Cc: freebsd-stable , ae@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 12:38:30 -0000 Sorry but it appears I dont have the core so am not able to match it up. Mostly likely another will happen later today though as ive now fixed dumpdev on the box On 5 October 2015 at 08:05, krad wrote: > I will have to have a look when i get home as the box is down at present. > Probably another panic 8( > > On 5 October 2015 at 06:26, Konstantin Belousov > wrote: > >> On Sun, Oct 04, 2015 at 07:31:43PM +0100, krad wrote: >> > Is anyone else having problems with squid core dumping on Freebsd >> 10-stable >> > when using the transparent caching feature. It started happening >> recently >> > after I re enabled ipv6 on my network. It may just be coincidence >> though. >> > It has even caused the odd kernel panic but not every time. >> > >> > FreeBSD xx 10.2-STABLE FreeBSD 10.2-STABLE #6: Wed Sep 9 16:01:15 BST >> 2015 >> > root@r2:/build/stable/usr/obj/build/stable/usr/src/sys/me amd64 >> > >> > >> > Oct 4 17:13:09 hunters6 kernel: Fatal trap 12: page fault while in >> kernel >> > mode >> > Oct 4 17:13:09 hunters6 kernel: cpuid = 1; apic id = 02 >> > Oct 4 17:13:09 hunters6 kernel: fault virtual address = 0x28 >> > Oct 4 17:13:09 hunters6 kernel: fault code = supervisor >> read >> > data, page not present >> > Oct 4 17:13:09 hunters6 kernel: instruction pointer = >> > 0x20:0xffffffff807f27a9 >> > Oct 4 17:13:09 hunters6 kernel: stack pointer = >> > 0x28:0xfffffe011be4a390 >> > Oct 4 17:13:09 hunters6 kernel: frame pointer = >> > 0x28:0xfffffe011be4a3f0 >> > Oct 4 17:13:09 hunters6 kernel: code segment = base 0x0, >> limit >> > 0xfffff, type 0x1b >> > Oct 4 17:13:09 hunters6 kernel: = DPL 0, pres 1, long 1, def32 0, gran >> 1 >> > Oct 4 17:13:09 hunters6 kernel: processor eflags = interrupt >> > enabled, resume, IOPL = 0 >> > Oct 4 17:13:09 hunters6 kernel: current process = 10269 >> > (squid) >> > Oct 4 17:13:09 hunters6 kernel: trap number = 12 >> > Oct 4 17:13:09 hunters6 kernel: panic: page fault >> > Oct 4 17:13:09 hunters6 kernel: cpuid = 1 >> > Oct 4 17:13:09 hunters6 kernel: KDB: stack backtrace: >> > Oct 4 17:13:09 hunters6 kernel: #0 0xffffffff8062f920 at >> kdb_backtrace+0x60 >> > Oct 4 17:13:09 hunters6 kernel: #1 0xffffffff805f48f6 at vpanic+0x126 >> > Oct 4 17:13:09 hunters6 kernel: #2 0xffffffff805f47c3 at panic+0x43 >> > Oct 4 17:13:09 hunters6 kernel: #3 0xffffffff808c5eeb at >> trap_fatal+0x36b >> > Oct 4 17:13:09 hunters6 kernel: #4 0xffffffff808c61ed at >> trap_pfault+0x2ed >> > Oct 4 17:13:09 hunters6 kernel: #5 0xffffffff808c588a at trap+0x47a >> > Oct 4 17:13:09 hunters6 kernel: #6 0xffffffff808abb52 at calltrap+0x8 >> > Oct 4 17:13:09 hunters6 kernel: #7 0xffffffff807d3a9f at >> > in6_mapped_peeraddr+0xcf >> Please obtain the source file/line number of in6_mapped_peeraddr+0xcf. >> Do you have core dump for the panic ? >> >> > Oct 4 17:13:09 hunters6 kernel: #8 0xffffffff805b0048 at >> > export_fd_to_sb+0x6c8 >> > Oct 4 17:13:09 hunters6 kernel: #9 0xffffffff805af880 at >> > kern_proc_filedesc_out+0x3d0 >> > Oct 4 17:13:09 hunters6 kernel: #10 0xffffffff8059c7bd at >> > note_procstat_files+0xfd >> > Oct 4 17:13:09 hunters6 kernel: #11 0xffffffff8059a3a4 at >> > elf64_coredump+0x314 >> > Oct 4 17:13:09 hunters6 kernel: #12 0xffffffff805f7f4c at sigexit+0xb6c >> > Oct 4 17:13:09 hunters6 kernel: #13 0xffffffff805f85a6 at postsig+0x286 >> > Oct 4 17:13:09 hunters6 kernel: #14 0xffffffff806403f7 at ast+0x427 >> > >> > > From owner-freebsd-stable@freebsd.org Tue Oct 6 14:23:25 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 776579B68B4; Tue, 6 Oct 2015 14:23:25 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 5B8999BA; Tue, 6 Oct 2015 14:23:25 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id C86F218F8; Tue, 6 Oct 2015 14:23:13 +0000 (UTC) Date: Tue, 6 Oct 2015 14:22:50 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: mav@FreeBSD.org, jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org, freebsd-i386@FreeBSD.org Message-ID: <923849599.199.1444141381712.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: FreeBSD_STABLE_9-i386 - Build #179 - Failure MIME-Version: 1.0 X-Jenkins-Job: FreeBSD_STABLE_9-i386 X-Jenkins-Result: FAILURE Precedence: bulk Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 14:23:25 -0000 FreeBSD_STABLE_9-i386 - Build #179 - Failure: Build information: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_9-i386/179/ Full change log: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_9-i386/179/changes Full build log: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_9-i386/179/console Change summaries: 288919 by mav: MFC r287654: Add support for PPP-Max-Payload PPPoE tag (RFC4638). Submitted by: Dmitry Luhtionov The end of the build log: [...truncated 79830 lines...] objcopy --only-keep-debug ng_gif.ko.debug ng_gif.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_gif.ko.symbols ng_gif.ko.debug ng_gif.ko ===> netgraph/gif_demux (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/gif_demux/../../../netgraph/ng_gif_demux.c -o ng_gif_demux.o ctfconvert -L VERSION -g ng_gif_demux.o ld -d -warn-common -r -d -o ng_gif_demux.kld ng_gif_demux.o ctfmerge -L VERSION -g -o ng_gif_demux.kld ng_gif_demux.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_gif_demux.kld export_syms | xargs -J% objcopy % ng_gif_demux.kld ld -Bshareable -d -warn-common -o ng_gif_demux.ko.debug ng_gif_demux.kld objcopy --only-keep-debug ng_gif_demux.ko.debug ng_gif_demux.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_gif_demux.ko.symbols ng_gif_demux.ko.debug ng_gif_demux.ko ===> netgraph/hole (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/hole/../../../netgraph/ng_hole.c -o ng_hole.o ctfconvert -L VERSION -g ng_hole.o ld -d -warn-common -r -d -o ng_hole.kld ng_hole.o ctfmerge -L VERSION -g -o ng_hole.kld ng_hole.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_hole.kld export_syms | xargs -J% objcopy % ng_hole.kld ld -Bshareable -d -warn-common -o ng_hole.ko.debug ng_hole.kld objcopy --only-keep-debug ng_hole.ko.debug ng_hole.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_hole.ko.symbols ng_hole.ko.debug ng_hole.ko ===> netgraph/hub (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/hub/../../../netgraph/ng_hub.c -o ng_hub.o ctfconvert -L VERSION -g ng_hub.o ld -d -warn-common -r -d -o ng_hub.kld ng_hub.o ctfmerge -L VERSION -g -o ng_hub.kld ng_hub.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_hub.kld export_syms | xargs -J% objcopy % ng_hub.kld ld -Bshareable -d -warn-common -o ng_hub.ko.debug ng_hub.kld objcopy --only-keep-debug ng_hub.ko.debug ng_hub.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_hub.ko.symbols ng_hub.ko.debug ng_hub.ko ===> netgraph/iface (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/iface/../../../netgraph/ng_iface.c -o ng_iface.o ctfconvert -L VERSION -g ng_iface.o ld -d -warn-common -r -d -o ng_iface.kld ng_iface.o ctfmerge -L VERSION -g -o ng_iface.kld ng_iface.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_iface.kld export_syms | xargs -J% objcopy % ng_iface.kld ld -Bshareable -d -warn-common -o ng_iface.ko.debug ng_iface.kld objcopy --only-keep-debug ng_iface.ko.debug ng_iface.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_iface.ko.symbols ng_iface.ko.debug ng_iface.ko ===> netgraph/ip_input (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/ip_input/../../../netgraph/ng_ip_input.c -o ng_ip_input.o ctfconvert -L VERSION -g ng_ip_input.o ld -d -warn-common -r -d -o ng_ip_input.kld ng_ip_input.o ctfmerge -L VERSION -g -o ng_ip_input.kld ng_ip_input.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_ip_input.kld export_syms | xargs -J% objcopy % ng_ip_input.kld ld -Bshareable -d -warn-common -o ng_ip_input.ko.debug ng_ip_input.kld objcopy --only-keep-debug ng_ip_input.ko.debug ng_ip_input.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_ip_input.ko.symbols ng_ip_input.ko.debug ng_ip_input.ko ===> netgraph/ipfw (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/ipfw/../../../netgraph/ng_ipfw.c -o ng_ipfw.o ctfconvert -L VERSION -g ng_ipfw.o ld -d -warn-common -r -d -o ng_ipfw.kld ng_ipfw.o ctfmerge -L VERSION -g -o ng_ipfw.kld ng_ipfw.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_ipfw.kld export_syms | xargs -J% objcopy % ng_ipfw.kld ld -Bshareable -d -warn-common -o ng_ipfw.ko.debug ng_ipfw.kld objcopy --only-keep-debug ng_ipfw.ko.debug ng_ipfw.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_ipfw.ko.symbols ng_ipfw.ko.debug ng_ipfw.ko ===> netgraph/ksocket (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/ksocket/../../../netgraph/ng_ksocket.c -o ng_ksocket.o ctfconvert -L VERSION -g ng_ksocket.o ld -d -warn-common -r -d -o ng_ksocket.kld ng_ksocket.o ctfmerge -L VERSION -g -o ng_ksocket.kld ng_ksocket.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_ksocket.kld export_syms | xargs -J% objcopy % ng_ksocket.kld ld -Bshareable -d -warn-common -o ng_ksocket.ko.debug ng_ksocket.kld objcopy --only-keep-debug ng_ksocket.ko.debug ng_ksocket.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_ksocket.ko.symbols ng_ksocket.ko.debug ng_ksocket.ko ===> netgraph/l2tp (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/l2tp/../../../netgraph/ng_l2tp.c -o ng_l2tp.o ctfconvert -L VERSION -g ng_l2tp.o ld -d -warn-common -r -d -o ng_l2tp.kld ng_l2tp.o ctfmerge -L VERSION -g -o ng_l2tp.kld ng_l2tp.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_l2tp.kld export_syms | xargs -J% objcopy % ng_l2tp.kld ld -Bshareable -d -warn-common -o ng_l2tp.ko.debug ng_l2tp.kld objcopy --only-keep-debug ng_l2tp.ko.debug ng_l2tp.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_l2tp.ko.symbols ng_l2tp.ko.debug ng_l2tp.ko ===> netgraph/lmi (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/lmi/../../../netgraph/ng_lmi.c -o ng_lmi.o ctfconvert -L VERSION -g ng_lmi.o ld -d -warn-common -r -d -o ng_lmi.kld ng_lmi.o ctfmerge -L VERSION -g -o ng_lmi.kld ng_lmi.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_lmi.kld export_syms | xargs -J% objcopy % ng_lmi.kld ld -Bshareable -d -warn-common -o ng_lmi.ko.debug ng_lmi.kld objcopy --only-keep-debug ng_lmi.ko.debug ng_lmi.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_lmi.ko.symbols ng_lmi.ko.debug ng_lmi.ko ===> netgraph/mppc (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/mppc/../../../netgraph/ng_mppc.c -o ng_mppc.o cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/mppc/../../../crypto/sha1.c -o sha1.o ctfconvert -L VERSION -g sha1.o ctfconvert -L VERSION -g ng_mppc.o ld -d -warn-common -r -d -o ng_mppc.kld ng_mppc.o sha1.o ctfmerge -L VERSION -g -o ng_mppc.kld ng_mppc.o sha1.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_mppc.kld export_syms | xargs -J% objcopy % ng_mppc.kld ld -Bshareable -d -warn-common -o ng_mppc.ko.debug ng_mppc.kld objcopy --only-keep-debug ng_mppc.ko.debug ng_mppc.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_mppc.ko.symbols ng_mppc.ko.debug ng_mppc.ko ===> netgraph/nat (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/nat/../../../netgraph/ng_nat.c -o ng_nat.o ctfconvert -L VERSION -g ng_nat.o ld -d -warn-common -r -d -o ng_nat.kld ng_nat.o ctfmerge -L VERSION -g -o ng_nat.kld ng_nat.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_nat.kld export_syms | xargs -J% objcopy % ng_nat.kld ld -Bshareable -d -warn-common -o ng_nat.ko.debug ng_nat.kld objcopy --only-keep-debug ng_nat.ko.debug ng_nat.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_nat.ko.symbols ng_nat.ko.debug ng_nat.ko ===> netgraph/netflow (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/netflow/../../../netgraph/netflow/ng_netflow.c -o ng_netflow.o cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/netflow/../../../netgraph/netflow/netflow.c -o netflow.o cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/netflow/../../../netgraph/netflow/netflow_v9.c -o netflow_v9.o ctfconvert -L VERSION -g netflow_v9.o ctfconvert -L VERSION -g ng_netflow.o ctfconvert -L VERSION -g netflow.o ld -d -warn-common -r -d -o ng_netflow.kld ng_netflow.o netflow.o netflow_v9.o ctfmerge -L VERSION -g -o ng_netflow.kld ng_netflow.o netflow.o netflow_v9.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_netflow.kld export_syms | xargs -J% objcopy % ng_netflow.kld ld -Bshareable -d -warn-common -o ng_netflow.ko.debug ng_netflow.kld objcopy --only-keep-debug ng_netflow.ko.debug ng_netflow.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_netflow.ko.symbols ng_netflow.ko.debug ng_netflow.ko ===> netgraph/netgraph (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/netgraph/../../../netgraph/ng_base.c -o ng_base.o cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/netgraph/../../../netgraph/ng_parse.c -o ng_parse.o ctfconvert -L VERSION -g ng_parse.o ctfconvert -L VERSION -g ng_base.o ld -d -warn-common -r -d -o netgraph.kld ng_base.o ng_parse.o ctfmerge -L VERSION -g -o netgraph.kld ng_base.o ng_parse.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk netgraph.kld export_syms | xargs -J% objcopy % netgraph.kld ld -Bshareable -d -warn-common -o netgraph.ko.debug netgraph.kld objcopy --only-keep-debug netgraph.ko.debug netgraph.ko.symbols objcopy --strip-debug --add-gnu-debuglink=netgraph.ko.symbols netgraph.ko.debug netgraph.ko ===> netgraph/one2many (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/one2many/../../../netgraph/ng_one2many.c -o ng_one2many.o ctfconvert -L VERSION -g ng_one2many.o ld -d -warn-common -r -d -o ng_one2many.kld ng_one2many.o ctfmerge -L VERSION -g -o ng_one2many.kld ng_one2many.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_one2many.kld export_syms | xargs -J% objcopy % ng_one2many.kld ld -Bshareable -d -warn-common -o ng_one2many.ko.debug ng_one2many.kld objcopy --only-keep-debug ng_one2many.ko.debug ng_one2many.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_one2many.ko.symbols ng_one2many.ko.debug ng_one2many.ko ===> netgraph/patch (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/patch/../../../netgraph/ng_patch.c -o ng_patch.o ctfconvert -L VERSION -g ng_patch.o ld -d -warn-common -r -d -o ng_patch.kld ng_patch.o ctfmerge -L VERSION -g -o ng_patch.kld ng_patch.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_patch.kld export_syms | xargs -J% objcopy % ng_patch.kld ld -Bshareable -d -warn-common -o ng_patch.ko.debug ng_patch.kld objcopy --only-keep-debug ng_patch.ko.debug ng_patch.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_patch.ko.symbols ng_patch.ko.debug ng_patch.ko ===> netgraph/pipe (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/pipe/../../../netgraph/ng_pipe.c -o ng_pipe.o ctfconvert -L VERSION -g ng_pipe.o ld -d -warn-common -r -d -o ng_pipe.kld ng_pipe.o ctfmerge -L VERSION -g -o ng_pipe.kld ng_pipe.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_pipe.kld export_syms | xargs -J% objcopy % ng_pipe.kld ld -Bshareable -d -warn-common -o ng_pipe.ko.debug ng_pipe.kld objcopy --only-keep-debug ng_pipe.ko.debug ng_pipe.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_pipe.ko.symbols ng_pipe.ko.debug ng_pipe.ko ===> netgraph/ppp (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/ppp/../../../netgraph/ng_ppp.c -o ng_ppp.o ctfconvert -L VERSION -g ng_ppp.o ld -d -warn-common -r -d -o ng_ppp.kld ng_ppp.o ctfmerge -L VERSION -g -o ng_ppp.kld ng_ppp.o :> export_syms awk -f /usr/src/sys/conf/kmod_syms.awk ng_ppp.kld export_syms | xargs -J% objcopy % ng_ppp.kld ld -Bshareable -d -warn-common -o ng_ppp.ko.debug ng_ppp.kld objcopy --only-keep-debug ng_ppp.ko.debug ng_ppp.ko.symbols objcopy --strip-debug --add-gnu-debuglink=ng_ppp.ko.symbols ng_ppp.ko.debug ng_ppp.ko ===> netgraph/pppoe (all) cc -O2 -pipe -fno-strict-aliasing -Werror -D_KERNEL -DKLD_MODULE -nostdinc -DHAVE_KERNEL_OPTION_HEADERS -include /usr/obj/usr/src/sys/GENERIC/opt_global.h -I. -I@ -I@/contrib/altq -finline-limit=8000 --param inline-unit-growth=100 --param large-function-growth=1000 -fno-common -g -I/usr/obj/usr/src/sys/GENERIC -mno-align-long-strings -mpreferred-stack-boundary=2 -mno-mmx -mno-sse -msoft-float -ffreestanding -fstack-protector -std=iso9899:1999 -fstack-protector -Wall -Wredundant-decls -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign -fformat-extensions -Wmissing-include-dirs -fdiagnostics-show-option -c /usr/src/sys/modules/netgraph/pppoe/../../../netgraph/ng_pppoe.c -o ng_pppoe.o /usr/src/sys/modules/netgraph/pppoe/../../../netgraph/ng_pppoe.c: In function 'ng_pppoe_rcvmsg': /usr/src/sys/modules/netgraph/pppoe/../../../netgraph/ng_pppoe.c:1018: error: 'PTT_MAX_PAYL' undeclared (first use in this function) /usr/src/sys/modules/netgraph/pppoe/../../../netgraph/ng_pppoe.c:1018: error: (Each undeclared identifier is reported only once /usr/src/sys/modules/netgraph/pppoe/../../../netgraph/ng_pppoe.c:1018: error: for each function it appears in.) /usr/src/sys/modules/netgraph/pppoe/../../../netgraph/ng_pppoe.c: In function 'ng_pppoe_rcvdata_ether': /usr/src/sys/modules/netgraph/pppoe/../../../netgraph/ng_pppoe.c:1506: error: 'PTT_MAX_PAYL' undeclared (first use in this function) *** [ng_pppoe.o] Error code 1 1 error *** [all] Error code 2 1 error *** [all] Error code 2 1 error *** [modules-all] Error code 2 text data bss dec hex filename 15447106 922776 816968 17186850 1064022 kernel.debug 1 error *** [buildkernel] Error code 2 1 error *** [buildkernel] Error code 2 make: stopped in /usr/src 1 error make: stopped in /usr/src Build step 'Execute shell' marked build as failure [PostBuildScript] - Execution post build scripts. [FreeBSD_STABLE_9-i386] $ /bin/sh -xe /tmp/hudson5974148731876188909.sh + export 'PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbin:/usr/local/bin' + export 'jname=FreeBSD_STABLE_9-i386' + echo 'clean up jail FreeBSD_STABLE_9-i386' clean up jail FreeBSD_STABLE_9-i386 + sudo jail -r FreeBSD_STABLE_9-i386 + sudo ifconfig igb0 inet6 2610:1c1:1:607c::101:1 -alias + sudo umount FreeBSD_STABLE_9-i386/usr/src + sudo umount FreeBSD_STABLE_9-i386/dev + sudo rm -fr FreeBSD_STABLE_9-i386 rm: FreeBSD_STABLE_9-i386/lib/libthr.so.3: Operation not permitted rm: FreeBSD_STABLE_9-i386/lib/libc.so.7: Operation not permitted rm: FreeBSD_STABLE_9-i386/lib/libcrypt.so.5: Operation not permitted rm: FreeBSD_STABLE_9-i386/lib: Directory not empty rm: FreeBSD_STABLE_9-i386/sbin/init: Operation not permitted rm: FreeBSD_STABLE_9-i386/sbin: Directory not empty rm: FreeBSD_STABLE_9-i386/usr/lib/librt.so.1: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/lib: Directory not empty rm: FreeBSD_STABLE_9-i386/usr/bin/ypchpass: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/su: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/opiepasswd: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/chpass: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/passwd: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/crontab: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/ypchsh: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/chsh: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/ypchfn: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/chfn: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/login: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/opieinfo: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin/yppasswd: Operation not permitted rm: FreeBSD_STABLE_9-i386/usr/bin: Directory not empty rm: FreeBSD_STABLE_9-i386/usr: Directory not empty rm: FreeBSD_STABLE_9-i386/libexec/ld-elf.so.1: Operation not permitted rm: FreeBSD_STABLE_9-i386/libexec: Directory not empty rm: FreeBSD_STABLE_9-i386: Directory not empty + true + sudo chflags -R noschg FreeBSD_STABLE_9-i386 + sudo rm -fr FreeBSD_STABLE_9-i386 Email was triggered for: Failure - Any Sending email for trigger: Failure - Any From owner-freebsd-stable@freebsd.org Tue Oct 6 14:58:00 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BBEE09D0F95 for ; Tue, 6 Oct 2015 14:58:00 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F5F620F; Tue, 6 Oct 2015 14:58:00 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id t96Evpqt015440 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Tue, 6 Oct 2015 17:57:51 +0300 (EEST) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua t96Evpqt015440 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id t96EvomM015439; Tue, 6 Oct 2015 17:57:50 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 6 Oct 2015 17:57:50 +0300 From: Konstantin Belousov To: krad Cc: freebsd-stable , ae@freebsd.org Subject: Re: transparent redirection with pf and squid Message-ID: <20151006145750.GF2257@kib.kiev.ua> References: <20151005052643.GA2257@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on tom.home X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 14:58:00 -0000 On Tue, Oct 06, 2015 at 01:38:28PM +0100, krad wrote: > Sorry but it appears I dont have the core so am not able to match it up. > Mostly likely another will happen later today though as ive now fixed > dumpdev on the box You do not need core to get the line number. kgdb kernel.debug list *function+offset From owner-freebsd-stable@freebsd.org Tue Oct 6 15:18:18 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 37DFD9D004C for ; Tue, 6 Oct 2015 15:18:18 +0000 (UTC) (envelope-from smkelly@smkelly.org) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 096FE1383 for ; Tue, 6 Oct 2015 15:18:17 +0000 (UTC) (envelope-from smkelly@smkelly.org) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id B44F9202A5 for ; Tue, 6 Oct 2015 11:18:10 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute1.internal (MEProxy); Tue, 06 Oct 2015 11:18:10 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=smkelly.org; h=cc :content-type:date:from:message-id:mime-version:subject:to :x-sasl-enc:x-sasl-enc; s=mesmtp; bh=/ynJDqQXC2WGnMC3+PlSdXhkQNc =; b=BRqPoWb+SYCXS0RTNSsrWgKOVEKtFkIBZMpzBu/6CmH4tONrDE1BYueVv1M 6Rslx6W4ySBK9g4mTiCwHJuTOfL5HgyFyX5GAvz/g5HckFaqnYuJCOs5dWNrzToU 11AEUMt8RcM5UdxdYvA87j2zttf5BsxBWZiRbByb7dOvPhvs= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:message-id :mime-version:subject:to:x-sasl-enc:x-sasl-enc; s=smtpout; bh=/y nJDqQXC2WGnMC3+PlSdXhkQNc=; b=etX82f4+l39+bHqMJRtUgIjccCNipipci4 Kqr6MpxAs5Y8cIsePsIbOgw+XIEDIXV1m8O943FrMXgRIS5SoWUcjE6MczJ9MnJc 3/vWfv2cjNIit/86x4IN7f2d7KtBlQ/xwN3XQccU6iLkZmoINFFMRqlxEbaeY/G2 v3Ero8KFU= X-Sasl-enc: 0cf9XXQCEhCIS+nODszNdj6KgDCPutR2XdqMugohvx6+ 1444144690 Received: from [172.16.32.220] (unknown [38.100.147.146]) by mail.messagingengine.com (Postfix) with ESMTPA id 612666800C5; Tue, 6 Oct 2015 11:18:10 -0400 (EDT) From: Sean Kelly Subject: Dell NVMe issues Date: Tue, 6 Oct 2015 10:18:11 -0500 Message-Id: Cc: Jim Harris To: FreeBSD-STABLE Mailing List Mime-Version: 1.0 (Mac OS X Mail 9.0 \(3093\)) X-Mailer: Apple Mail (2.3093) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 15:18:18 -0000 Back in May, I posted about issues I was having with a Dell PE R630 with = 4x800GB NVMe SSDs. I would get kernel panics due to the inability to = assign all the interrupts because of = https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199321 = . Jim Harris = helped fix this issue so I bought several more of these servers, = Including ones with 4x1.6TB drives=E2=80=A6 while the new servers with 4x800GB drives still work, the ones with = 4x1.6TB drives do not. When I do a zpool create tank mirror nvd0 nvd1 mirror nvd2 nvd3 the command never returns and the kernel logs: nvme0: resetting controller nvme0: controller ready did not become 0 within 2000 ms I=E2=80=99ve tried several different things trying to understand where = the actual problem is. WORKS: dd if=3D/dev/nvd0 of=3D/dev/null bs=3D1m WORKS: dd if=3D/dev/zero of=3D/dev/nvd0 bs=3D1m WORKS: newfs /dev/nvd0 FAILS: zpool create tank mirror nvd[01] FAILS: gpart add -t freebsd-zfs nvd[01] && zpool create tank mirror = nvd[01]p1 FAILS: gpart add -t freebsd-zfs -s 1400g nvd[01[ && zpool create tank = nvd[01]p1 WORKS: gpart add -t freebsd-zfs -s 800g nvd[01] && zpool create tank = nvd[01]p1 NOTE: The above commands are more about getting the point across, not = validity. I wiped the disk clean between gpart attempts and used GPT. So it seems like zpool works if I don=E2=80=99t cross past ~800GB. But = other things like dd and newfs work. When I get the kernel messages about the controller resetting and then = not responding, the NVMe subsystem hangs entirely. Since my boot disks = are not NVMe, the system continues to work but no more NVMe stuff can be = done. Further, attempting to reboot hangs and I have to do a power = cycle. Any thoughts on what the deal may be here? 10.2-RELEASE-p5 nvme0@pci0:132:0:0: class=3D0x010802 card=3D0x1f971028 = chip=3D0xa820144d rev=3D0x03 hdr=3D0x00 vendor =3D 'Samsung Electronics Co Ltd' class =3D mass storage subclass =3D NVM --=20 Sean Kelly smkelly@smkelly.org http://smkelly.org From owner-freebsd-stable@freebsd.org Tue Oct 6 15:30:04 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 194279D08E8 for ; Tue, 6 Oct 2015 15:30:04 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C56F21DAE for ; Tue, 6 Oct 2015 15:30:03 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1ZjUBf-000Pq9-AJ; Tue, 06 Oct 2015 18:29:55 +0300 Date: Tue, 6 Oct 2015 18:29:55 +0300 From: Slawa Olhovchenkov To: Sean Kelly Cc: FreeBSD-STABLE Mailing List , Jim Harris Subject: Re: Dell NVMe issues Message-ID: <20151006152955.GA16596@zxy.spb.ru> References: MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 15:30:04 -0000 On Tue, Oct 06, 2015 at 10:18:11AM -0500, Sean Kelly wrote: > Back in May, I posted about issues I was having with a Dell PE R630 with 4x800GB NVMe SSDs. I would get kernel panics due to the inability to assign all the interrupts because of https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=199321 . Jim Harris helped fix this issue so I bought several more of these servers, Including ones with 4x1.6TB drives... > > while the new servers with 4x800GB drives still work, the ones with 4x1.6TB drives do not. When I do a > zpool create tank mirror nvd0 nvd1 mirror nvd2 nvd3 > the command never returns and the kernel logs: > nvme0: resetting controller > nvme0: controller ready did not become 0 within 2000 ms > > I've tried several different things trying to understand where the actual problem is. > WORKS: dd if=/dev/nvd0 of=/dev/null bs=1m > WORKS: dd if=/dev/zero of=/dev/nvd0 bs=1m > WORKS: newfs /dev/nvd0 > FAILS: zpool create tank mirror nvd[01] > FAILS: gpart add -t freebsd-zfs nvd[01] && zpool create tank mirror nvd[01]p1 > FAILS: gpart add -t freebsd-zfs -s 1400g nvd[01[ && zpool create tank nvd[01]p1 > WORKS: gpart add -t freebsd-zfs -s 800g nvd[01] && zpool create tank nvd[01]p1 > > NOTE: The above commands are more about getting the point across, not validity. I wiped the disk clean between gpart attempts and used GPT. Just for purity of the experiment: do you try zpool on raw disk, w/o GPT? I.e. zpool create tank mirror nvd0 nvd1 > So it seems like zpool works if I don't cross past ~800GB. But other things like dd and newfs work. > > When I get the kernel messages about the controller resetting and then not responding, the NVMe subsystem hangs entirely. Since my boot disks are not NVMe, the system continues to work but no more NVMe stuff can be done. Further, attempting to reboot hangs and I have to do a power cycle. > > Any thoughts on what the deal may be here? > > 10.2-RELEASE-p5 > > nvme0@pci0:132:0:0: class=0x010802 card=0x1f971028 chip=0xa820144d rev=0x03 hdr=0x00 > vendor = 'Samsung Electronics Co Ltd' > class = mass storage > subclass = NVM > > -- > Sean Kelly > smkelly@smkelly.org > http://smkelly.org > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Tue Oct 6 15:35:58 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B44FB9D0E78 for ; Tue, 6 Oct 2015 15:35:58 +0000 (UTC) (envelope-from smkelly@smkelly.org) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 84D2EB17 for ; Tue, 6 Oct 2015 15:35:58 +0000 (UTC) (envelope-from smkelly@smkelly.org) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id 85079201B3 for ; Tue, 6 Oct 2015 11:35:57 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute3.internal (MEProxy); Tue, 06 Oct 2015 11:35:57 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=smkelly.org; h=cc :content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to:x-sasl-enc:x-sasl-enc; s=mesmtp; bh=iZo89 GZS08jisfWP+7trhzYS4EY=; b=sZpW2M1xB+FxLyqlSdy9fKKPgdGRq3ifjq0I+ vOTRvRhwmrT8XIzgQFMEEakIWpON9pnaR3STCIz4o4pi2fFSEJSBVn0EYYTW8oWj O0y/tkLxmkBf0Jh1jL+xFKggKfq1seL6XCdpY5LckbgTEZ7OkvAJoi7BV02k+mn0 t5SlnY= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-sasl-enc :x-sasl-enc; s=smtpout; bh=iZo89GZS08jisfWP+7trhzYS4EY=; b=j4A/E UiiPXg6KfvO/+Ag93vlv6SsaZxwWDwhM+RlKRW2pUmCYhtJbj65L5xkWakJQ/SoH MYyAalDfVoBDdbpCUPH6zdgwaIb3TRBuhU82FyIkzEzCAebb1kbtiX45h6vZDs76 CcOiJY8tvt3CBc+FqwoBU8uaW76dBPwzq57Bjk= X-Sasl-enc: enRleBgT3gR9ULvzSimM2uDvatv7F3qdoGjWMIJ6HlDA 1444145757 Received: from [172.16.32.220] (unknown [38.100.147.146]) by mail.messagingengine.com (Postfix) with ESMTPA id 171FF68014F; Tue, 6 Oct 2015 11:35:57 -0400 (EDT) Mime-Version: 1.0 (Mac OS X Mail 9.0 \(3093\)) Subject: Re: Dell NVMe issues From: Sean Kelly In-Reply-To: <20151006152955.GA16596@zxy.spb.ru> Date: Tue, 6 Oct 2015 10:35:57 -0500 Cc: FreeBSD-STABLE Mailing List , Jim Harris Message-Id: <27228FE7-5FF9-4F58-9E23-42A66806C374@smkelly.org> References: <20151006152955.GA16596@zxy.spb.ru> To: Slawa Olhovchenkov X-Mailer: Apple Mail (2.3093) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 15:35:58 -0000 > On Oct 6, 2015, at 10:29 AM, Slawa Olhovchenkov = wrote: >=20 > On Tue, Oct 06, 2015 at 10:18:11AM -0500, Sean Kelly wrote: >=20 >> Back in May, I posted about issues I was having with a Dell PE R630 = with 4x800GB NVMe SSDs. I would get kernel panics due to the inability = to assign all the interrupts because of = https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199321 = = >. Jim = Harris helped fix this issue so I bought several more of these servers, = Including ones with 4x1.6TB drives... >>=20 >> while the new servers with 4x800GB drives still work, the ones with = 4x1.6TB drives do not. When I do a >> zpool create tank mirror nvd0 nvd1 mirror nvd2 nvd3 >> the command never returns and the kernel logs: >> nvme0: resetting controller >> nvme0: controller ready did not become 0 within 2000 ms >>=20 >> I've tried several different things trying to understand where the = actual problem is. >> WORKS: dd if=3D/dev/nvd0 of=3D/dev/null bs=3D1m >> WORKS: dd if=3D/dev/zero of=3D/dev/nvd0 bs=3D1m >> WORKS: newfs /dev/nvd0 >> FAILS: zpool create tank mirror nvd[01] >> FAILS: gpart add -t freebsd-zfs nvd[01] && zpool create tank mirror = nvd[01]p1 >> FAILS: gpart add -t freebsd-zfs -s 1400g nvd[01[ && zpool create tank = nvd[01]p1 >> WORKS: gpart add -t freebsd-zfs -s 800g nvd[01] && zpool create tank = nvd[01]p1 >>=20 >> NOTE: The above commands are more about getting the point across, not = validity. I wiped the disk clean between gpart attempts and used GPT. >=20 > Just for purity of the experiment: do you try zpool on raw disk, w/o > GPT? I.e. zpool create tank mirror nvd0 nvd1 >=20 Yes, that was actually what I tried first. I headed down the path of GPT = because it allowed me a way to restrict how much disk zpool touched. = zpool on the bare NVMe disks also triggers the issue. >> So it seems like zpool works if I don't cross past ~800GB. But other = things like dd and newfs work. >>=20 >> When I get the kernel messages about the controller resetting and = then not responding, the NVMe subsystem hangs entirely. Since my boot = disks are not NVMe, the system continues to work but no more NVMe stuff = can be done. Further, attempting to reboot hangs and I have to do a = power cycle. >>=20 >> Any thoughts on what the deal may be here? >>=20 >> 10.2-RELEASE-p5 >>=20 >> nvme0@pci0:132:0:0: class=3D0x010802 card=3D0x1f971028 = chip=3D0xa820144d rev=3D0x03 hdr=3D0x00 >> vendor =3D 'Samsung Electronics Co Ltd' >> class =3D mass storage >> subclass =3D NVM >>=20 >> --=20 >> Sean Kelly >> smkelly@smkelly.org >> http://smkelly.org >>=20 >> _______________________________________________ >> freebsd-stable@freebsd.org = mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-stable = >> To unsubscribe, send any mail to = "freebsd-stable-unsubscribe@freebsd.org = " From owner-freebsd-stable@freebsd.org Tue Oct 6 15:42:49 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6AD839B6385 for ; Tue, 6 Oct 2015 15:42:49 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from zxy.spb.ru (zxy.spb.ru [195.70.199.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2718862 for ; Tue, 6 Oct 2015 15:42:49 +0000 (UTC) (envelope-from slw@zxy.spb.ru) Received: from slw by zxy.spb.ru with local (Exim 4.84 (FreeBSD)) (envelope-from ) id 1ZjUO7-00005k-36; Tue, 06 Oct 2015 18:42:47 +0300 Date: Tue, 6 Oct 2015 18:42:47 +0300 From: Slawa Olhovchenkov To: Sean Kelly Cc: FreeBSD-STABLE Mailing List , Jim Harris Subject: Re: Dell NVMe issues Message-ID: <20151006154246.GC6469@zxy.spb.ru> References: <20151006152955.GA16596@zxy.spb.ru> <27228FE7-5FF9-4F58-9E23-42A66806C374@smkelly.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <27228FE7-5FF9-4F58-9E23-42A66806C374@smkelly.org> User-Agent: Mutt/1.5.23 (2014-03-12) X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: slw@zxy.spb.ru X-SA-Exim-Scanned: No (on zxy.spb.ru); SAEximRunCond expanded to false X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 15:42:49 -0000 On Tue, Oct 06, 2015 at 10:35:57AM -0500, Sean Kelly wrote: > > > > On Oct 6, 2015, at 10:29 AM, Slawa Olhovchenkov wrote: > > > > On Tue, Oct 06, 2015 at 10:18:11AM -0500, Sean Kelly wrote: > > > >> Back in May, I posted about issues I was having with a Dell PE R630 with 4x800GB NVMe SSDs. I would get kernel panics due to the inability to assign all the interrupts because of https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=199321 >. Jim Harris helped fix this issue so I bought several more of these servers, Including ones with 4x1.6TB drives... > >> > >> while the new servers with 4x800GB drives still work, the ones with 4x1.6TB drives do not. When I do a > >> zpool create tank mirror nvd0 nvd1 mirror nvd2 nvd3 > >> the command never returns and the kernel logs: > >> nvme0: resetting controller > >> nvme0: controller ready did not become 0 within 2000 ms > >> > >> I've tried several different things trying to understand where the actual problem is. > >> WORKS: dd if=/dev/nvd0 of=/dev/null bs=1m > >> WORKS: dd if=/dev/zero of=/dev/nvd0 bs=1m > >> WORKS: newfs /dev/nvd0 > >> FAILS: zpool create tank mirror nvd[01] > >> FAILS: gpart add -t freebsd-zfs nvd[01] && zpool create tank mirror nvd[01]p1 > >> FAILS: gpart add -t freebsd-zfs -s 1400g nvd[01[ && zpool create tank nvd[01]p1 > >> WORKS: gpart add -t freebsd-zfs -s 800g nvd[01] && zpool create tank nvd[01]p1 > >> > >> NOTE: The above commands are more about getting the point across, not validity. I wiped the disk clean between gpart attempts and used GPT. > > > > Just for purity of the experiment: do you try zpool on raw disk, w/o > > GPT? I.e. zpool create tank mirror nvd0 nvd1 > > > > Yes, that was actually what I tried first. I headed down the path of > GPT because it allowed me a way to restrict how much disk zpool > touched. zpool on the bare NVMe disks also triggers the issue. Can you snoop disk i/o operation by dtrace at time zpool create? From owner-freebsd-stable@freebsd.org Tue Oct 6 16:06:10 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C01759D0260 for ; Tue, 6 Oct 2015 16:06:10 +0000 (UTC) (envelope-from eric@vangyzen.net) Received: from smtp.vangyzen.net (hotblack.vangyzen.net [199.48.133.146]) by mx1.freebsd.org (Postfix) with ESMTP id A80B1DBB for ; Tue, 6 Oct 2015 16:06:09 +0000 (UTC) (envelope-from eric@vangyzen.net) Received: from marvin.beer.town (unknown [76.164.8.130]) by smtp.vangyzen.net (Postfix) with ESMTPSA id 3363C56483; Tue, 6 Oct 2015 11:06:03 -0500 (CDT) Subject: Re: Dell NVMe issues To: Sean Kelly , FreeBSD-STABLE Mailing List References: Cc: Jim Harris From: Eric van Gyzen X-Enigmail-Draft-Status: N1110 Message-ID: <5613F16A.8010901@vangyzen.net> Date: Tue, 6 Oct 2015 11:06:02 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 16:06:10 -0000 On 10/06/2015 10:18, Sean Kelly wrote: > Back in May, I posted about issues I was having with a Dell PE R630 with 4x800GB NVMe SSDs. I would get kernel panics due to the inability to assign all the interrupts because of https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=199321 . Jim Harris helped fix this issue so I bought several more of these servers, Including ones with 4x1.6TB drives… > > while the new servers with 4x800GB drives still work, the ones with 4x1.6TB drives do not. When I do a > zpool create tank mirror nvd0 nvd1 mirror nvd2 nvd3 > the command never returns and the kernel logs: > nvme0: resetting controller > nvme0: controller ready did not become 0 within 2000 ms > > I’ve tried several different things trying to understand where the actual problem is. > WORKS: dd if=/dev/nvd0 of=/dev/null bs=1m > WORKS: dd if=/dev/zero of=/dev/nvd0 bs=1m > WORKS: newfs /dev/nvd0 > FAILS: zpool create tank mirror nvd[01] > FAILS: gpart add -t freebsd-zfs nvd[01] && zpool create tank mirror nvd[01]p1 > FAILS: gpart add -t freebsd-zfs -s 1400g nvd[01[ && zpool create tank nvd[01]p1 > WORKS: gpart add -t freebsd-zfs -s 800g nvd[01] && zpool create tank nvd[01]p1 > > NOTE: The above commands are more about getting the point across, not validity. I wiped the disk clean between gpart attempts and used GPT. > > So it seems like zpool works if I don’t cross past ~800GB. But other things like dd and newfs work. > > When I get the kernel messages about the controller resetting and then not responding, the NVMe subsystem hangs entirely. Since my boot disks are not NVMe, the system continues to work but no more NVMe stuff can be done. Further, attempting to reboot hangs and I have to do a power cycle. > > Any thoughts on what the deal may be here? > > 10.2-RELEASE-p5 > > nvme0@pci0:132:0:0: class=0x010802 card=0x1f971028 chip=0xa820144d rev=0x03 hdr=0x00 > vendor = 'Samsung Electronics Co Ltd' > class = mass storage > subclass = NVM Try this: sysctl vfs.zfs.vdev.trim_on_init=0 zpool create tank mirror nvd[01] Eric From owner-freebsd-stable@freebsd.org Tue Oct 6 16:10:52 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED03A9D0650 for ; Tue, 6 Oct 2015 16:10:52 +0000 (UTC) (envelope-from smkelly@smkelly.org) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BCED0FF0 for ; Tue, 6 Oct 2015 16:10:52 +0000 (UTC) (envelope-from smkelly@smkelly.org) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 4E299209D9 for ; Tue, 6 Oct 2015 12:10:51 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute4.internal (MEProxy); Tue, 06 Oct 2015 12:10:51 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=smkelly.org; h=cc :content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to:x-sasl-enc:x-sasl-enc; s=mesmtp; bh=QfDrl WU4YGTBSx8bWIEzcSxZiW4=; b=mGDlrxwSG1Bf9xitytUaJ6VbiHNr4Sbdx/NKt TTvseDHLteIyaevoMNEnSqniVkDrNtYufgb/4g+XRfp8YE10PLzUl0PIEp3nQdCm tDrF9TWHv9b8/Nn7u04QHmC8T8s8v+zXnBk+5hZfhRU3n3plM3JP+6m6X8xDL0d8 5EbLDU= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-sasl-enc :x-sasl-enc; s=smtpout; bh=QfDrlWU4YGTBSx8bWIEzcSxZiW4=; b=bo3QN +JgW8Gm8qD0qsXd4912tZw8RtPUpFTbpA4y8NNnIElRi1x4rUDqKtmpogBlO/X0h jSR6E8A+HPxofiAXwW2WNxH6wRyfrRGt0mpgBsb1sz0bftshLeKlD+UhtVjqlCQF H2FHETTpmxY2+ebUkdCJtDlvc/ALSsQCOYuDeQ= X-Sasl-enc: 1Etn3qZc8fxr5zemEaXT+HTMs/UImk8pF65jT401vP/q 1444147851 Received: from [172.16.32.220] (unknown [38.100.147.146]) by mail.messagingengine.com (Postfix) with ESMTPA id EE14C6800D1; Tue, 6 Oct 2015 12:10:50 -0400 (EDT) Mime-Version: 1.0 (Mac OS X Mail 9.0 \(3093\)) Subject: Re: Dell NVMe issues From: Sean Kelly In-Reply-To: <5613F16A.8010901@vangyzen.net> Date: Tue, 6 Oct 2015 11:10:51 -0500 Cc: FreeBSD-STABLE Mailing List , Jim Harris Message-Id: <757558E4-BC93-457A-99AA-F5F434825F1B@smkelly.org> References: <5613F16A.8010901@vangyzen.net> To: Eric van Gyzen X-Mailer: Apple Mail (2.3093) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 16:10:53 -0000 > On Oct 6, 2015, at 11:06 AM, Eric van Gyzen wrote: >=20 > Try this: >=20 > sysctl vfs.zfs.vdev.trim_on_init=3D0 > zpool create tank mirror nvd[01] >=20 That worked. So my guess is the controller/FreeBSD is timing out while = zpool asks the drive to TRIM all 1.6TB?= From owner-freebsd-stable@freebsd.org Tue Oct 6 16:15:41 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AC8D89D0930 for ; Tue, 6 Oct 2015 16:15:41 +0000 (UTC) (envelope-from eric@vangyzen.net) Received: from smtp.vangyzen.net (hotblack.vangyzen.net [IPv6:2607:fc50:1000:7400:216:3eff:fe72:314f]) by mx1.freebsd.org (Postfix) with ESMTP id 91F4B61B for ; Tue, 6 Oct 2015 16:15:41 +0000 (UTC) (envelope-from eric@vangyzen.net) Received: from marvin.beer.town (unknown [76.164.8.130]) by smtp.vangyzen.net (Postfix) with ESMTPSA id 5B17F56483; Tue, 6 Oct 2015 11:15:40 -0500 (CDT) Subject: Re: Dell NVMe issues To: Sean Kelly References: <5613F16A.8010901@vangyzen.net> <757558E4-BC93-457A-99AA-F5F434825F1B@smkelly.org> Cc: FreeBSD-STABLE Mailing List , Jim Harris From: Eric van Gyzen Message-ID: <5613F3AB.5080903@vangyzen.net> Date: Tue, 6 Oct 2015 11:15:39 -0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <757558E4-BC93-457A-99AA-F5F434825F1B@smkelly.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 16:15:41 -0000 On 10/06/2015 11:10, Sean Kelly wrote: > >> On Oct 6, 2015, at 11:06 AM, Eric van Gyzen > wrote: >> >> Try this: >> >> sysctl vfs.zfs.vdev.trim_on_init=0 >> zpool create tank mirror nvd[01] >> > > That worked. So my guess is the controller/FreeBSD is timing out while zpool asks the drive to TRIM all 1.6TB? That would be my guess, yes, but I'll let the experts take it from here. Eric From owner-freebsd-stable@freebsd.org Tue Oct 6 16:25:01 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 107039D0F93; Tue, 6 Oct 2015 16:25:01 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 0150ED3C; Tue, 6 Oct 2015 16:25:01 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id 35D7B191D; Tue, 6 Oct 2015 16:24:59 +0000 (UTC) Date: Tue, 6 Oct 2015 16:24:53 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: amdmi3@FreeBSD.org, mav@FreeBSD.org, jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org, freebsd-i386@FreeBSD.org Message-ID: <70398947.201.1444148697676.JavaMail.jenkins@jenkins-9.freebsd.org> In-Reply-To: <923849599.199.1444141381712.JavaMail.jenkins@jenkins-9.freebsd.org> References: <923849599.199.1444141381712.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: FreeBSD_STABLE_9-i386 - Build #180 - Fixed MIME-Version: 1.0 X-Jenkins-Job: FreeBSD_STABLE_9-i386 X-Jenkins-Result: SUCCESS Precedence: bulk Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 16:25:01 -0000 FreeBSD_STABLE_9-i386 - Build #180 - Fixed: Build information: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_9-i386/180/ Full change log: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_9-i386/180/changes Full build log: https://jenkins.FreeBSD.org/job/FreeBSD_STABLE_9-i386/180/console Change summaries: 288925 by amdmi3: MFC r288120: Fix crash on parsing some inf files 288922 by mav: MFC r253564 (by glebius): Add constant for PPP-Max-PayLoad tag. Submitted by: Dmitry Luhtionov 288921 by mav: MFC r287821: Document NGM_PPPOE_SETMAXP. Submitted by: Dmitry Luhtionov From owner-freebsd-stable@freebsd.org Tue Oct 6 16:31:52 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 84B719B674C for ; Tue, 6 Oct 2015 16:31:52 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wi0-f169.google.com (mail-wi0-f169.google.com [209.85.212.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 25C326BE for ; Tue, 6 Oct 2015 16:31:51 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by wiclk2 with SMTP id lk2so167509303wic.1 for ; Tue, 06 Oct 2015 09:31:44 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-type :content-transfer-encoding; bh=q+jBLZsxubFysVEU7+LqWXsnYqJC9l61JSh0+IEl63k=; b=J53JKU4m88w3gwxV85+2UEhQ+ykfjAHsmdQqgXADa8SBbjhW/i1k7E5DU7DQZC4yuH HSsmRzBPFmNm8Oh1WUWml4K9HF74LXH7hlW15J7NIqzL9IHJrMji+ePA9o3RisroqY+p 1cTgeTOKv34rApUovH0KGKlcqgzDN+Mw85vGdhFI8waSKI5dcnrviEpdlOeMy47+9bNV G475+FZ54YpS7rhMAppmpibxBAtfMUuttTo9PnvilEhs1BELjP1sdcrrdRHyhECYRIdQ KWR8wEc8wBUbEf1KhBYnIZxrHPqtKeAZ2dksWtD1/YHVJR8PICVzynBqTOROtL5SfsoR 5tew== X-Gm-Message-State: ALoCoQmPt46F+vZuJ8/VXnf7Y//N/8IGjskWGfvqERV57piV+rtcATXVzyx6JDF2Ze+2WNlPjqKQ X-Received: by 10.194.81.169 with SMTP id b9mr37558563wjy.3.1444149103887; Tue, 06 Oct 2015 09:31:43 -0700 (PDT) Received: from [10.10.1.68] (82-69-141-170.dsl.in-addr.zen.co.uk. [82.69.141.170]) by smtp.gmail.com with ESMTPSA id s1sm20466764wik.16.2015.10.06.09.31.42 for (version=TLSv1/SSLv3 cipher=OTHER); Tue, 06 Oct 2015 09:31:42 -0700 (PDT) Subject: Re: Dell NVMe issues To: freebsd-stable@freebsd.org References: From: Steven Hartland Message-ID: <5613F76A.3030302@multiplay.co.uk> Date: Tue, 6 Oct 2015 17:31:38 +0100 User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 16:31:52 -0000 As a guess you're timing out the full disk TRIM request. Try: sysctl vfs.zfs.vdev.trim_on_init=0 and then re-run the create. On 06/10/2015 16:18, Sean Kelly wrote: > Back in May, I posted about issues I was having with a Dell PE R630 with 4x800GB NVMe SSDs. I would get kernel panics due to the inability to assign all the interrupts because of https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=199321 . Jim Harris helped fix this issue so I bought several more of these servers, Including ones with 4x1.6TB drives… > > while the new servers with 4x800GB drives still work, the ones with 4x1.6TB drives do not. When I do a > zpool create tank mirror nvd0 nvd1 mirror nvd2 nvd3 > the command never returns and the kernel logs: > nvme0: resetting controller > nvme0: controller ready did not become 0 within 2000 ms > > I’ve tried several different things trying to understand where the actual problem is. > WORKS: dd if=/dev/nvd0 of=/dev/null bs=1m > WORKS: dd if=/dev/zero of=/dev/nvd0 bs=1m > WORKS: newfs /dev/nvd0 > FAILS: zpool create tank mirror nvd[01] > FAILS: gpart add -t freebsd-zfs nvd[01] && zpool create tank mirror nvd[01]p1 > FAILS: gpart add -t freebsd-zfs -s 1400g nvd[01[ && zpool create tank nvd[01]p1 > WORKS: gpart add -t freebsd-zfs -s 800g nvd[01] && zpool create tank nvd[01]p1 > > NOTE: The above commands are more about getting the point across, not validity. I wiped the disk clean between gpart attempts and used GPT. > > So it seems like zpool works if I don’t cross past ~800GB. But other things like dd and newfs work. > > When I get the kernel messages about the controller resetting and then not responding, the NVMe subsystem hangs entirely. Since my boot disks are not NVMe, the system continues to work but no more NVMe stuff can be done. Further, attempting to reboot hangs and I have to do a power cycle. > > Any thoughts on what the deal may be here? > > 10.2-RELEASE-p5 > > nvme0@pci0:132:0:0: class=0x010802 card=0x1f971028 chip=0xa820144d rev=0x03 hdr=0x00 > vendor = 'Samsung Electronics Co Ltd' > class = mass storage > subclass = NVM > From owner-freebsd-stable@freebsd.org Tue Oct 6 16:42:50 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 639B69B6EF3 for ; Tue, 6 Oct 2015 16:42:50 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wi0-f174.google.com (mail-wi0-f174.google.com [209.85.212.174]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 05842DEB for ; Tue, 6 Oct 2015 16:42:49 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by wicfx3 with SMTP id fx3so167535815wic.0 for ; Tue, 06 Oct 2015 09:42:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-type :content-transfer-encoding; bh=WGWsEBmtTPKP43xW92ARyKz6mjA341rkZSA3r5Da+vI=; b=bD3wME4tDk9VQ7TU6gydgKrfdL2cvPYuM/SJFR/ujfc0CDMFsqEMKnWnMDK4E0d2pD 4zYN+GnjMLbG5398WgAttRiEbuT3Qo8H7de6zkXxFd49Jgg3lpIqmQRzQLgbSA4icewB G36i970O2yA6OL3VQLfbzlCu0Asw0Foi3zKmY3ZNjN9lkt8cq00255/qe8bNMbv9wn0G t/qWIqtPrGfQ8OE5UpPqjPr6q3gGjAmDCYsBzWcqyMHLc2YnWHAH10ffqIdwkaJkTUds riUsY6Hyz+N2TWCH9tPrczECAiPFmf05DfMcfTByqyTLdLad7lIYH8yGh6v3ATRzAY2U RNaA== X-Gm-Message-State: ALoCoQmHHmcO5rjzhh6Xc5Ofqszk05bmHZDIRUidVAlsyXSK7gO4p8JCrcXYp63g50e0a6MKCf4n X-Received: by 10.194.75.169 with SMTP id d9mr36549345wjw.7.1444149767982; Tue, 06 Oct 2015 09:42:47 -0700 (PDT) Received: from [10.10.1.68] (82-69-141-170.dsl.in-addr.zen.co.uk. [82.69.141.170]) by smtp.gmail.com with ESMTPSA id 12sm2779512wjw.15.2015.10.06.09.42.46 for (version=TLSv1/SSLv3 cipher=OTHER); Tue, 06 Oct 2015 09:42:47 -0700 (PDT) Subject: Re: Dell NVMe issues To: freebsd-stable@freebsd.org References: From: Steven Hartland Message-ID: <5613FA02.2080205@multiplay.co.uk> Date: Tue, 6 Oct 2015 17:42:42 +0100 User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 16:42:50 -0000 Also looks like nvme exposes a timeout_period sysctl you could try increasing that as it could be too small for a full disk TRIM. Under CAM SCSI da support we have a delete_max which limits the max single request size for a delete it may be we need something similar for nvme as well to prevent this as it should still be chunking the deletes to ensure this sort of thing doesn't happen. On 06/10/2015 16:18, Sean Kelly wrote: > Back in May, I posted about issues I was having with a Dell PE R630 with 4x800GB NVMe SSDs. I would get kernel panics due to the inability to assign all the interrupts because of https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=199321 . Jim Harris helped fix this issue so I bought several more of these servers, Including ones with 4x1.6TB drives… > > while the new servers with 4x800GB drives still work, the ones with 4x1.6TB drives do not. When I do a > zpool create tank mirror nvd0 nvd1 mirror nvd2 nvd3 > the command never returns and the kernel logs: > nvme0: resetting controller > nvme0: controller ready did not become 0 within 2000 ms > > I’ve tried several different things trying to understand where the actual problem is. > WORKS: dd if=/dev/nvd0 of=/dev/null bs=1m > WORKS: dd if=/dev/zero of=/dev/nvd0 bs=1m > WORKS: newfs /dev/nvd0 > FAILS: zpool create tank mirror nvd[01] > FAILS: gpart add -t freebsd-zfs nvd[01] && zpool create tank mirror nvd[01]p1 > FAILS: gpart add -t freebsd-zfs -s 1400g nvd[01[ && zpool create tank nvd[01]p1 > WORKS: gpart add -t freebsd-zfs -s 800g nvd[01] && zpool create tank nvd[01]p1 > > NOTE: The above commands are more about getting the point across, not validity. I wiped the disk clean between gpart attempts and used GPT. > > So it seems like zpool works if I don’t cross past ~800GB. But other things like dd and newfs work. > > When I get the kernel messages about the controller resetting and then not responding, the NVMe subsystem hangs entirely. Since my boot disks are not NVMe, the system continues to work but no more NVMe stuff can be done. Further, attempting to reboot hangs and I have to do a power cycle. > > Any thoughts on what the deal may be here? > > 10.2-RELEASE-p5 > > nvme0@pci0:132:0:0: class=0x010802 card=0x1f971028 chip=0xa820144d rev=0x03 hdr=0x00 > vendor = 'Samsung Electronics Co Ltd' > class = mass storage > subclass = NVM > From owner-freebsd-stable@freebsd.org Tue Oct 6 18:03:44 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D2B49B6FD2 for ; Tue, 6 Oct 2015 18:03:44 +0000 (UTC) (envelope-from jim.harris@gmail.com) Received: from mail-ob0-x22a.google.com (mail-ob0-x22a.google.com [IPv6:2607:f8b0:4003:c01::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1FDE7D98 for ; Tue, 6 Oct 2015 18:03:44 +0000 (UTC) (envelope-from jim.harris@gmail.com) Received: by obcgx8 with SMTP id gx8so160435961obc.3 for ; Tue, 06 Oct 2015 11:03:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=g8WUl/vEMOLU6FgeGsQn2s9EExvZ/rftfFX2dYfY/tU=; b=njX2FogJcOIElNYCnVWNkd8n9Vo/nd97KBmvIqZtyiziQPZZoyAgvm9AKXgMpUjKxx LKb49YL5uWa7LpdQavTbYjtYNUXLAr++gNt979CfUNPD+n+J+e3klki4BrcMk6hspzPt hfg3tjCuSnE+6wquz58XRv6IRCkhQ9587ZFkxxByWNUJo0w6m+73LrdeduNb46+Cegnz 6T6nwjJKVCB3JlMvmnWxWfyLmnmZyHBiiykXVF1ivGPsqLzXxr663saJj6y334JvLYPO 3zhSD9wbdsVLW4r4GivnhTwlieypRbkoz6AR1LRrhWBZdfRwjxxElFmQErNJ8VQxeGcj QdMg== MIME-Version: 1.0 X-Received: by 10.60.176.36 with SMTP id cf4mr7563921oec.9.1444154623299; Tue, 06 Oct 2015 11:03:43 -0700 (PDT) Sender: jim.harris@gmail.com Received: by 10.202.212.201 with HTTP; Tue, 6 Oct 2015 11:03:43 -0700 (PDT) In-Reply-To: <5613FA02.2080205@multiplay.co.uk> References: <5613FA02.2080205@multiplay.co.uk> Date: Tue, 6 Oct 2015 11:03:43 -0700 X-Google-Sender-Auth: eoV5p-4Z9iJFQ4yxYVfmFzzxHCk Message-ID: Subject: Re: Dell NVMe issues From: Jim Harris To: Steven Hartland , Sean Kelly Cc: FreeBSD-STABLE Mailing List Content-Type: multipart/mixed; boundary=089e0115f3c453352f05217373e9 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 18:03:44 -0000 --089e0115f3c453352f05217373e9 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Tue, Oct 6, 2015 at 9:42 AM, Steven Hartland wrote: > Also looks like nvme exposes a timeout_period sysctl you could try > increasing that as it could be too small for a full disk TRIM. > > Under CAM SCSI da support we have a delete_max which limits the max singl= e > request size for a delete it may be we need something similar for nvme as > well to prevent this as it should still be chunking the deletes to ensure > this sort of thing doesn't happen. See attached. Sean - can you try this patch with TRIM re-enabled in ZFS? I would be curious if TRIM passes without this patch if you increase the timeout_period as suggested. -Jim > > > On 06/10/2015 16:18, Sean Kelly wrote: > >> Back in May, I posted about issues I was having with a Dell PE R630 with >> 4x800GB NVMe SSDs. I would get kernel panics due to the inability to ass= ign >> all the interrupts because of >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199321 < >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D199321>. Jim Harris >> helped fix this issue so I bought several more of these servers, Includi= ng >> ones with 4x1.6TB drives=E2=80=A6 >> >> while the new servers with 4x800GB drives still work, the ones with >> 4x1.6TB drives do not. When I do a >> zpool create tank mirror nvd0 nvd1 mirror nvd2 nvd3 >> the command never returns and the kernel logs: >> nvme0: resetting controller >> nvme0: controller ready did not become 0 within 2000 ms >> >> I=E2=80=99ve tried several different things trying to understand where t= he actual >> problem is. >> WORKS: dd if=3D/dev/nvd0 of=3D/dev/null bs=3D1m >> WORKS: dd if=3D/dev/zero of=3D/dev/nvd0 bs=3D1m >> WORKS: newfs /dev/nvd0 >> FAILS: zpool create tank mirror nvd[01] >> FAILS: gpart add -t freebsd-zfs nvd[01] && zpool create tank mirror >> nvd[01]p1 >> FAILS: gpart add -t freebsd-zfs -s 1400g nvd[01[ && zpool create tank >> nvd[01]p1 >> WORKS: gpart add -t freebsd-zfs -s 800g nvd[01] && zpool create tank >> nvd[01]p1 >> >> NOTE: The above commands are more about getting the point across, not >> validity. I wiped the disk clean between gpart attempts and used GPT. >> >> So it seems like zpool works if I don=E2=80=99t cross past ~800GB. But o= ther >> things like dd and newfs work. >> >> When I get the kernel messages about the controller resetting and then >> not responding, the NVMe subsystem hangs entirely. Since my boot disks a= re >> not NVMe, the system continues to work but no more NVMe stuff can be don= e. >> Further, attempting to reboot hangs and I have to do a power cycle. >> >> Any thoughts on what the deal may be here? >> >> 10.2-RELEASE-p5 >> >> nvme0@pci0:132:0:0: class=3D0x010802 card=3D0x1f971028 chip=3D0xa820= 144d >> rev=3D0x03 hdr=3D0x00 >> vendor =3D 'Samsung Electronics Co Ltd' >> class =3D mass storage >> subclass =3D NVM >> >> > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > --089e0115f3c453352f05217373e9 Content-Type: application/octet-stream; name="nvd.patch" Content-Disposition: attachment; filename="nvd.patch" Content-Transfer-Encoding: base64 X-Attachment-Id: f_iffo6nt30 ZGlmZiAtLWdpdCBhL3N5cy9kZXYvbnZkL252ZC5jIGIvc3lzL2Rldi9udmQvbnZkLmMKaW5kZXgg ZDc1MjgzMi4uMzAxNWUzOSAxMDA2NDQKLS0tIGEvc3lzL2Rldi9udmQvbnZkLmMKKysrIGIvc3lz L2Rldi9udmQvbnZkLmMKQEAgLTMyLDYgKzMyLDcgQEAgX19GQlNESUQoIiRGcmVlQlNEOiByZWxl bmcvMTAuMi9zeXMvZGV2L252ZC9udmQuYyAyODU5MTkgMjAxNS0wNy0yNyAxNzo1MDowNVogamkK ICNpbmNsdWRlIDxzeXMva2VybmVsLmg+CiAjaW5jbHVkZSA8c3lzL21hbGxvYy5oPgogI2luY2x1 ZGUgPHN5cy9tb2R1bGUuaD4KKyNpbmNsdWRlIDxzeXMvc3lzY3RsLmg+CiAjaW5jbHVkZSA8c3lz L3N5c3RtLmg+CiAjaW5jbHVkZSA8c3lzL3Rhc2txdWV1ZS5oPgogCkBAIC04NSw2ICs4NiwxMSBA QCBzdHJ1Y3QgbnZkX2NvbnRyb2xsZXIgewogc3RhdGljIFRBSUxRX0hFQUQoLCBudmRfY29udHJv bGxlcikJY3RybHJfaGVhZDsKIHN0YXRpYyBUQUlMUV9IRUFEKGRpc2tfbGlzdCwgbnZkX2Rpc2sp CWRpc2tfaGVhZDsKIAorc3RhdGljIFNZU0NUTF9OT0RFKF9odywgT0lEX0FVVE8sIG52ZCwgQ1RM RkxBR19SRCwgMCwgIm52ZCBkcml2ZXIgcGFyYW1ldGVycyIpOworc3RhdGljIHVpbnQ2NF90IG52 ZF9kZWxldGVfbWF4ID0gKDQgKiAxMDI0ICogMTAyNCAqIDEwMjQpOyAgLyogNEdCICovCitTWVND VExfVVFVQUQoX2h3X252ZCwgT0lEX0FVVE8sIGRlbGV0ZV9tYXgsIENUTEZMQUdfUldUVU4sICZu dmRfZGVsZXRlX21heCwgMCwKKwkgICAgICJudmQgbWF4aW11bSBCSU9fREVMRVRFIHNpemUiKTsK Kwogc3RhdGljIGludCBudmRfbW9kZXZlbnQobW9kdWxlX3QgbW9kLCBpbnQgdHlwZSwgdm9pZCAq YXJnKQogewogCWludCBlcnJvciA9IDA7CkBAIC0yNzksNiArMjg1LDggQEAgbnZkX25ld19kaXNr KHN0cnVjdCBudm1lX25hbWVzcGFjZSAqbnMsIHZvaWQgKmN0cmxyX2FyZykKIAlkaXNrLT5kX3Nl Y3RvcnNpemUgPSBudm1lX25zX2dldF9zZWN0b3Jfc2l6ZShucyk7CiAJZGlzay0+ZF9tZWRpYXNp emUgPSAob2ZmX3QpbnZtZV9uc19nZXRfc2l6ZShucyk7CiAJZGlzay0+ZF9kZWxtYXhzaXplID0g KG9mZl90KW52bWVfbnNfZ2V0X3NpemUobnMpOworCWlmIChkaXNrLT5kX2RlbG1heHNpemUgPiBu dmRfZGVsZXRlX21heCkKKwkJZGlzay0+ZF9kZWxtYXhzaXplID0gbnZkX2RlbGV0ZV9tYXg7CiAK IAlpZiAoVEFJTFFfRU1QVFkoJmRpc2tfaGVhZCkpCiAJCWRpc2stPmRfdW5pdCA9IDA7Cg== --089e0115f3c453352f05217373e9-- From owner-freebsd-stable@freebsd.org Tue Oct 6 18:46:34 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 565609B6E1F for ; Tue, 6 Oct 2015 18:46:34 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E95C8985 for ; Tue, 6 Oct 2015 18:46:33 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by wicfx3 with SMTP id fx3so171989392wic.0 for ; Tue, 06 Oct 2015 11:46:26 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-type; bh=WZAVmaU2RuKosy2hwvIWETMY7IAdm0vUJzwdf2reg7A=; b=RbzDflTLCt61DpCmMgpya49iheX+NORJo1NswvkibFnYzMPFA0xC2jpah26lYEcXKG /LpPJDzYb04iNHX3jRLxColkSCCp2hiYTAOPJSOjFt2toQt+o790zaS3hvQUp0KCsBUn FrFqTEcOXb14lY+BHBXFuD+3S/CIX7+f6YWkbXJJM0gWFk0749HB1ZS7VG0S3na2UVbi DljCXcwi7X7x3bcQBAqWEAEelOTglYfT767kyCgw5hdLSMjh1KovenHMocfxTUhxLm3g MEj4YmK2hKDfdrxFMgp8PvkgTZp/mj/t6TOw00wM0KtStOshY3FzwLUKyHlw+mgq6lQO oEhA== X-Gm-Message-State: ALoCoQnGflROUGcLUT+vev1GyK9Rc52km8YduCA8RW+wJ9mykVRUfWIGFoh28T5FoZZvnZVmwjOb X-Received: by 10.194.184.20 with SMTP id eq20mr8996251wjc.22.1444157186056; Tue, 06 Oct 2015 11:46:26 -0700 (PDT) Received: from [10.10.1.68] (82-69-141-170.dsl.in-addr.zen.co.uk. [82.69.141.170]) by smtp.gmail.com with ESMTPSA id jj8sm20963674wid.2.2015.10.06.11.46.24 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 06 Oct 2015 11:46:24 -0700 (PDT) Subject: Re: Dell NVMe issues To: Jim Harris , Sean Kelly References: <5613FA02.2080205@multiplay.co.uk> Cc: FreeBSD-STABLE Mailing List From: Steven Hartland Message-ID: <561416FB.1050802@multiplay.co.uk> Date: Tue, 6 Oct 2015 19:46:19 +0100 User-Agent: Mozilla/5.0 (Windows NT 5.1; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 18:46:34 -0000 On 06/10/2015 19:03, Jim Harris wrote: > > > On Tue, Oct 6, 2015 at 9:42 AM, Steven Hartland > > wrote: > > Also looks like nvme exposes a timeout_period sysctl you could try > increasing that as it could be too small for a full disk TRIM. > > > Under CAM SCSI da support we have a delete_max which limits the > max single request size for a delete it may be we need something > similar for nvme as well to prevent this as it should still be > chunking the deletes to ensure this sort of thing doesn't happen. > > > See attached. Sean - can you try this patch with TRIM re-enabled in ZFS? > > I would be curious if TRIM passes without this patch if you increase > the timeout_period as suggested. > > -Jim > > Interesting does the nvme spec not provide information from the device as to what its optimal / max deallocate request size should be like the ATA spec exposes? Regards Steve From owner-freebsd-stable@freebsd.org Tue Oct 6 19:37:38 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CABFE9B638C for ; Tue, 6 Oct 2015 19:37:38 +0000 (UTC) (envelope-from jim.harris@gmail.com) Received: from mail-ob0-x235.google.com (mail-ob0-x235.google.com [IPv6:2607:f8b0:4003:c01::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9856013A4 for ; Tue, 6 Oct 2015 19:37:38 +0000 (UTC) (envelope-from jim.harris@gmail.com) Received: by obbda8 with SMTP id da8so162840643obb.1 for ; Tue, 06 Oct 2015 12:37:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=MC1HmZ4wVjzT27XnXkvLICs2kTU9OYjhTV8Zi/5I0aE=; b=x+MzI9abiSTgS9AQhpOXCcn4Gjop7pgkq7nq2zEQLQjA32b4Z8dnnwS4rUaeEuKhF0 saysV8vqmLIdPYQTjiF1Sdx62YqTd6Jxzlql4hw9Z9Oyy6WX8JhhxaY9x2EMBsKFkmZz J2OvM1lmXJ+Shh2dH+h52GbD2z1k473Ws6K0NTJlyIZpKvUrf/pSVE6/KoKpnCD4fW3H vqXIThyNd+IP2lOfcbw5PfHphuEvWXobwQo6wNcbYgY6vnkyOD5itdl6VGaJ3z1BLCRc 1zc0auJZzRByKr6yIsEewWwVRGLfkTJ80INGGanjvoHtVg0qS7C0m5UOlP17Q411jTu5 yb1w== MIME-Version: 1.0 X-Received: by 10.60.41.9 with SMTP id b9mr21673715oel.37.1444160258011; Tue, 06 Oct 2015 12:37:38 -0700 (PDT) Received: by 10.202.212.201 with HTTP; Tue, 6 Oct 2015 12:37:37 -0700 (PDT) In-Reply-To: <561416FB.1050802@multiplay.co.uk> References: <5613FA02.2080205@multiplay.co.uk> <561416FB.1050802@multiplay.co.uk> Date: Tue, 6 Oct 2015 12:37:37 -0700 Message-ID: Subject: Re: Dell NVMe issues From: Jim Harris To: Steven Hartland Cc: Sean Kelly , FreeBSD-STABLE Mailing List Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Oct 2015 19:37:39 -0000 On Tue, Oct 6, 2015 at 11:46 AM, Steven Hartland wrote: > On 06/10/2015 19:03, Jim Harris wrote: > > > > On Tue, Oct 6, 2015 at 9:42 AM, Steven Hartland < > killing@multiplay.co.uk> wrote: > >> Also looks like nvme exposes a timeout_period sysctl you could try >> increasing that as it could be too small for a full disk TRIM. >> > >> Under CAM SCSI da support we have a delete_max which limits the max >> single request size for a delete it may be we need something similar for >> nvme as well to prevent this as it should still be chunking the deletes to >> ensure this sort of thing doesn't happen. > > > See attached. Sean - can you try this patch with TRIM re-enabled in ZFS? > > I would be curious if TRIM passes without this patch if you increase the > timeout_period as suggested. > > -Jim > > > Interesting does the nvme spec not provide information from the device as > to what its optimal / max deallocate request size should be like the ATA > spec exposes? > Correct - there is no way for devices to specify a max/optimal deallocate size in NVMe. There is an implicit limit from the 32-bit LBA length in the DSM Range data structure defined by the spec. So this patch is needed anyways to make sure we don't overflow the 32-bit LBA length. Sean's drives are 1.6TB which fits in an unsigned 32-bit value on a 512-byte sector formatted controller, so I don't think that is the problem in Sean's case. -Jim > Regards > Steve > From owner-freebsd-stable@freebsd.org Wed Oct 7 00:09:13 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0B0809D00B6 for ; Wed, 7 Oct 2015 00:09:13 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D96BD6BF for ; Wed, 7 Oct 2015 00:09:12 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from ralph.baldwin.cx (c-73-231-226-104.hsd1.ca.comcast.net [73.231.226.104]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 90795B918; Tue, 6 Oct 2015 20:09:11 -0400 (EDT) From: John Baldwin To: Rick Macklem Cc: Christian Kratzer , freebsd-stable@freebsd.org Subject: Re: smbfs crashes since approx. 10.1-RELEASE Date: Tue, 06 Oct 2015 17:08:54 -0700 Message-ID: <2148690.gx9M0ZzrG1@ralph.baldwin.cx> User-Agent: KMail/4.14.3 (FreeBSD/10.2-PRERELEASE; KDE/4.14.3; amd64; ; ) In-Reply-To: <1721669289.24365403.1444083414400.JavaMail.zimbra@uoguelph.ca> References: <1721669289.24365403.1444083414400.JavaMail.zimbra@uoguelph.ca> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Tue, 06 Oct 2015 20:09:11 -0400 (EDT) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Oct 2015 00:09:13 -0000 On Monday, October 05, 2015 06:16:54 PM Rick Macklem wrote: > Christian Kratzer wrote: > > Hi, > > > > I run a regular rsync job that runs from cron and copies stuff that gets > > created on a Windows smbfs share. > > > > Starting about 10.1-RELEASE the VM has become unstable and started panicing. > > > > I have narrowed the issue down to the aforementioned rsync job. > > > > When I move the job to a different VM the the other VM starts crashing and > > the VM without the job becomes stable agin. > > > > I have panics and crashinfos stored in /var/crash if anybody is interested: > > > > root@noc2:/var/crash # uname -a > > FreeBSD noc2.cksoft.de 10.2-RELEASE FreeBSD 10.2-RELEASE #0 r286666: Wed > > Aug 12 15:26:37 UTC 2015 > > root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 > > root@noc2:/var/crash # freebsd-version -u > > 10.2-RELEASE-p5 > > root@noc2:/var/crash # freebsd-version -k > > 10.2-RELEASE > > root@noc2:/var/crash # > > > > This is what I have in /var/crash/core.txt.0 > > > > Fatal trap 12: page fault while in kernel mode > > cpuid = 0; apic id = 00 > > fault virtual address = 0x20 > > fault code = supervisor read data, page not present > > instruction pointer = 0x20:0xffffffff80996c7c > > stack pointer = 0x28:0xfffffe003d6c0ac0 > > frame pointer = 0x28:0xfffffe003d6c0af0 > > code segment = base 0x0, limit 0xfffff, type 0x1b > > = DPL 0, pres 1, long 1, def32 0, gran 1 > > processor eflags = resume, IOPL = 0 > > current process = 1349 (smbiod10) > > trap number = 12 > > panic: page fault > > cpuid = 0 > > KDB: stack backtrace: > > #0 0xffffffff80984e30 at kdb_backtrace+0x60 > > #1 0xffffffff809489e6 at vpanic+0x126 > > #2 0xffffffff809488b3 at panic+0x43 > > #3 0xffffffff80d4aadb at trap_fatal+0x36b > > #4 0xffffffff80d4addd at trap_pfault+0x2ed > > #5 0xffffffff80d4a47a at trap+0x47a > > #6 0xffffffff80d307f2 at calltrap+0x8 > > #7 0xffffffff8092ebe0 at __mtx_unlock_sleep+0x60 > > #8 0xffffffff8092eb69 at __mtx_unlock_flags+0x69 > > #9 0xffffffff81a1b724 at smb_iod_thread+0xb4 > > #10 0xffffffff8091244a at fork_exit+0x9a > > #11 0xffffffff80d30d2e at fork_trampoline+0xe > > Uptime: 2h43m55s > > Dumping 103 out of 999 MB: (CTRL-C to abort) > > ..16%..31%..47%..62%..78%..93% > > > This crash is occurring when doing an mtx_unlock(&Giant). Unfortunately, I'm not > conversant w.r.t. this code. I've cc'd jhb@ in case he has some insight. > If you don't get any responses, I'd suggest reposting to freebsd-current@ with > "crashes in mtx_unlock(&Giant)" in the subject line. > > Btw John, the code does tsleep() in a loop before the mtx_unlock(&Giant). I do > remember that was once allowed, but am not sure if it still is (ie a tsleep() call > while holding Giant)? > > Hopefully someone who knows what is special about Giant that might cause this will > respond. > > Good luck with it, rick tsleep() with Giant is still allowed. However, this sort of panic usually means you unlocked a mutex you didn't hold (but without INVARIANTS enabled or you'd get an assertion failure earlier). I don't see anything obviously wrong in smb_iod_thread() however. If you have the crashdump, can you please run this in kgdb: frame 9 p (struct mtx *)c p *(struct mtx *)c -- John Baldwin From owner-freebsd-stable@freebsd.org Wed Oct 7 06:52:37 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 783ED9D0E50 for ; Wed, 7 Oct 2015 06:52:37 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from mx1.cksoft.de (mx1.cksoft.de [IPv6:2001:67c:24f8:1::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.cksoft.de", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 3699FE60; Wed, 7 Oct 2015 06:52:37 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from m.cksoft.de (unknown [IPv6:2a01:170:1110:8001::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.cksoft.de (Postfix) with ESMTPSA id 3CE391E9E6E; Wed, 7 Oct 2015 08:52:33 +0200 (CEST) Received: from amavis.cksoft.de (unknown [IPv6:2a01:170:1110:8001::25:a1]) by m.cksoft.de (Postfix) with ESMTP id 1496962FA4; Wed, 7 Oct 2015 08:51:04 +0200 (CEST) X-Virus-Scanned: amavisd-new at cksoft.de Received: from m.cksoft.de ([IPv6:2a01:170:1110:8001::25:1]) by amavis.cksoft.de (amavis.cksoft.de [IPv6:2a01:170:1110:8001::25:a1]) (amavisd-new, port 10041) with ESMTP id eLvvzjJzvzmV; Wed, 7 Oct 2015 08:51:02 +0200 (CEST) Received: from noc1.cksoft.de (noc1.cksoft.de [IPv6:2a01:170:1110:8001::53:1]) by m.cksoft.de (Postfix) with ESMTP id 1EA7F62F88; Wed, 7 Oct 2015 08:51:02 +0200 (CEST) Received: by noc1.cksoft.de (Postfix, from userid 1000) id C0FB113BCA; Wed, 7 Oct 2015 08:52:30 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by noc1.cksoft.de (Postfix) with ESMTP id B9ACC13BC0; Wed, 7 Oct 2015 08:52:30 +0200 (CEST) Date: Wed, 7 Oct 2015 08:52:30 +0200 (CEST) From: Christian Kratzer X-X-Sender: ck@noc1.cksoft.de Reply-To: Christian Kratzer To: John Baldwin cc: Rick Macklem , freebsd-stable@freebsd.org Subject: Re: smbfs crashes since approx. 10.1-RELEASE In-Reply-To: <2148690.gx9M0ZzrG1@ralph.baldwin.cx> Message-ID: References: <1721669289.24365403.1444083414400.JavaMail.zimbra@uoguelph.ca> <2148690.gx9M0ZzrG1@ralph.baldwin.cx> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) X-Spammer-Kill-Ratio: 75% MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Oct 2015 06:52:37 -0000 Hi, On Tue, 6 Oct 2015, John Baldwin wrote: >> This crash is occurring when doing an mtx_unlock(&Giant). Unfortunately, I'm not >> conversant w.r.t. this code. I've cc'd jhb@ in case he has some insight. >> If you don't get any responses, I'd suggest reposting to freebsd-current@ with >> "crashes in mtx_unlock(&Giant)" in the subject line. >> >> Btw John, the code does tsleep() in a loop before the mtx_unlock(&Giant). I do >> remember that was once allowed, but am not sure if it still is (ie a tsleep() call >> while holding Giant)? >> >> Hopefully someone who knows what is special about Giant that might cause this will >> respond. >> >> Good luck with it, rick > > tsleep() with Giant is still allowed. However, this sort of panic usually means > you unlocked a mutex you didn't hold (but without INVARIANTS enabled or you'd get > an assertion failure earlier). > > I don't see anything obviously wrong in smb_iod_thread() however. > > If you have the crashdump, can you please run this in kgdb: > > frame 9 > p (struct mtx *)c > p *(struct mtx *)c yes I have. Here we go: --snipp-- Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x20 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80996c7c stack pointer = 0x28:0xfffffe004e79bac0 frame pointer = 0x28:0xfffffe004e79baf0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = resume, IOPL = 0 current process = 12235 (smbiod172) trap number = 12 panic: page fault cpuid = 0 KDB: stack backtrace: #0 0xffffffff80984e30 at kdb_backtrace+0x60 #1 0xffffffff809489e6 at vpanic+0x126 #2 0xffffffff809488b3 at panic+0x43 #3 0xffffffff80d4aadb at trap_fatal+0x36b #4 0xffffffff80d4addd at trap_pfault+0x2ed #5 0xffffffff80d4a47a at trap+0x47a #6 0xffffffff80d307f2 at calltrap+0x8 #7 0xffffffff8092ebe0 at __mtx_unlock_sleep+0x60 #8 0xffffffff8092eb69 at __mtx_unlock_flags+0x69 #9 0xffffffff81a1b724 at smb_iod_thread+0xb4 #10 0xffffffff8091244a at fork_exit+0x9a #11 0xffffffff80d30d2e at fork_trampoline+0xe Uptime: 1d18h34m4s Dumping 161 out of 999 MB:..10%..20%..30%..40%..50%..60%..70%..80%..90%..100% Reading symbols from /boot/kernel/smbfs.ko.symbols...done. Loaded symbols for /boot/kernel/smbfs.ko.symbols Reading symbols from /boot/kernel/libiconv.ko.symbols...done. Loaded symbols for /boot/kernel/libiconv.ko.symbols Reading symbols from /boot/kernel/libmchain.ko.symbols...done. Loaded symbols for /boot/kernel/libmchain.ko.symbols #0 doadump (textdump=) at pcpu.h:219 219 pcpu.h: No such file or directory. in pcpu.h (kgdb) frame 9 #9 0xffffffff8092ebe0 in __mtx_unlock_sleep (c=0xfffff8002f531790, opts=, file=0xffffffff81a25801 "%s: Can't handle disordered parameters %d:%d\n", line=1) at /usr/src/sys/kern/kern_mutex.c:791 791 /usr/src/sys/kern/kern_mutex.c: No such file or directory. in /usr/src/sys/kern/kern_mutex.c Current language: auto; currently minimal (kgdb) p (struct mtx *)c $1 = (struct mtx *) 0xfffff8002f531790 (kgdb) p *(struct mtx *)c $2 = {lock_object = {lo_name = 0x6
, lo_flags = 0, lo_data = 0, lo_witness = 0xfffff8002f531798}, mtx_lock = 1444181401} (kgdb) --snipp-- I can build a GENERIC kernel with INVARIANTS enabled on the box to see if we get a better assertions next time this happens. That is in case it happens at all with a debug build. Greetings Christian -- Christian Kratzer CK Software GmbH Email: ck@cksoft.de Wildberger Weg 24/2 Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer Web: http://www.cksoft.de/ From owner-freebsd-stable@freebsd.org Wed Oct 7 14:15:37 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8512A9D0EE7 for ; Wed, 7 Oct 2015 14:15:37 +0000 (UTC) (envelope-from marko.cupac@mimar.rs) Received: from smtp.mimar.rs (smtp.mimar.rs [193.53.106.135]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3A6EB8C4 for ; Wed, 7 Oct 2015 14:15:36 +0000 (UTC) (envelope-from marko.cupac@mimar.rs) Received: from vscan.mimar.rs (vscan.mimar.rs [193.53.106.134]) by smtp.mimar.rs (Postfix) with ESMTP id 8C8CE89AB8 for ; Wed, 7 Oct 2015 16:15:27 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=mimar.rs; h= content-transfer-encoding:content-type:content-type:mime-version :x-mailer:organization:message-id:subject:subject:from:from:date :date:received:received; s=mimar-0901; t=1444227326; x= 1446041727; bh=7hTXvpsax588B1k6BYLBrg01V6rNoMBjGZEFWqiIiZ8=; b=C sbXjS7t9jJwrXQLoz8+cqcJZTou6h0OMmc8uMz7tTVUGJogEJyaaa6KkK6HtaLCG b9/IN29xYRqOFhEKXp18z2pfVHPEoDs6ikLQ4wTzdCiP+3Tu4Mc4e6QF73xecyfp 6bKu0CW+ICtaNAYLFfaanJLYbsuHFrEN91cqBxubqA= X-Virus-Scanned: amavisd-new at mimar.rs Received: from smtp.mimar.rs ([193.53.106.135]) by vscan.mimar.rs (vscan.mimar.rs [193.53.106.134]) (amavisd-new, port 10026) with ESMTP id xBTLbcrsV-ZX for ; Wed, 7 Oct 2015 16:15:26 +0200 (CEST) Received: from efreet.kappastar.com (nat-nat.kappastar.com [193.53.106.34]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: marko.cupac@mimar.rs) by smtp.mimar.rs (Postfix) with ESMTPSA id 74271898D7 for ; Wed, 7 Oct 2015 16:15:26 +0200 (CEST) Date: Wed, 7 Oct 2015 16:15:25 +0200 From: Marko =?UTF-8?B?Q3VwYcSH?= To: freebsd-stable@freebsd.org Subject: bind host service to jail ip? Message-ID: <20151007161525.1beca1eb@efreet.kappastar.com> Organization: mimar X-Mailer: Claws Mail 3.9.3 (GTK+ 2.24.23; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Oct 2015 14:15:37 -0000 Hi, I am moving some hosts from physical to jail environment. I have dozens of hosts on local lan syncing time with two ntp servers which also happen to be dns servers. Changing IPs of those hosts would be major PITA. If I run openntpd in jail, I get messages such as: Oct 7 16:05:37 ns1 ntpd[43188]: adjtime failed: Operation not permitted Oct 7 16:05:37 ns1 ntpd[43188]: ntp_adjtime (3) failed: Operation not perm= itted I know jails sync time with host, and are not allowed to adjust time. However, I'd like to serve ntp clients from these addresses. So my 2 questions are: - Does openntpd serve (correct) local time from jail even though it can't adjust local time? - If I ran openntpd in host and bound it to jails' ip addresses, would clients be able to sync? If so, are there any negative implications to this? Thank you in advance, --=20 Before enlightenment - chop wood, draw water. After enlightenment - chop wood, draw water. Marko Cupa=C4=87 https://www.mimar.rs/ From owner-freebsd-stable@freebsd.org Wed Oct 7 15:42:41 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 19C4B9D0877 for ; Wed, 7 Oct 2015 15:42:41 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CD588D68 for ; Wed, 7 Oct 2015 15:42:40 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id B00E628433; Wed, 7 Oct 2015 17:42:30 +0200 (CEST) Received: from illbsd.quip.test (ip-89-177-49-111.net.upcbroadband.cz [89.177.49.111]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id C557628417; Wed, 7 Oct 2015 17:42:26 +0200 (CEST) Message-ID: <56153D62.8070601@quip.cz> Date: Wed, 07 Oct 2015 17:42:26 +0200 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:35.0) Gecko/20100101 Firefox/35.0 SeaMonkey/2.32 MIME-Version: 1.0 To: =?UTF-8?Q?Marko_Cupa=c4=87?= , freebsd-stable@freebsd.org Subject: Re: bind host service to jail ip? References: <20151007161525.1beca1eb@efreet.kappastar.com> In-Reply-To: <20151007161525.1beca1eb@efreet.kappastar.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Oct 2015 15:42:41 -0000 Marko Cupać wrote on 10/07/2015 16:15: [...] > - If I ran openntpd in host and bound it to jails' ip addresses, would > clients be able to sync? If so, are there any negative implications > to this? I don't know if somethng has been changed over time, but if you run some service in host on IP assigned to jail on port not used in jail, there will be no conflict and service will be available to public e.g: ntpd on host listening on all available IP addresses # sockstat -4l | grep 123 root ntpd 1186 20 udp4 *:123 *:* root ntpd 1186 22 udp4 192.168.22.56:123 *:* root ntpd 1186 23 udp4 192.168.23.43:123 *:* root ntpd 1186 24 udp4 xxx.yyy.zz.27:123 *:* root ntpd 1186 25 udp4 xxx.yyy.zz.28:123 *:* root ntpd 1186 26 udp4 xxx.yyy.zz.29:123 *:* root ntpd 1186 27 udp4 xxx.yyy.zz.30:123 *:* root ntpd 1186 28 udp4 xxx.yyy.zz.31:123 *:* root ntpd 1186 29 udp4 xxx.yyy.zz.32:123 *:* root ntpd 1186 30 udp4 xxx.yyy.zz.33:123 *:* root ntpd 1186 31 udp4 xxx.yyy.zz.34:123 *:* root ntpd 1186 32 udp4 xxx.yyy.zz.35:123 *:* root ntpd 1186 33 udp4 xxx.yyy.zz.119:123 *:* root ntpd 1186 36 udp4 127.0.0.1:123 *:* root ntpd 1186 38 udp4 10.13.26.1:123 *:* root ntpd 1186 39 udp4 10.13.25.1:123 There are 7 jails, each with one or more IP addresses. No problem. Miroslav Lachman From owner-freebsd-stable@freebsd.org Wed Oct 7 17:44:18 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 125629D1090 for ; Wed, 7 Oct 2015 17:44:18 +0000 (UTC) (envelope-from jan-mailinglists@demter.de) Received: from mout.kundenserver.de (mout.kundenserver.de [212.227.126.187]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mout.kundenserver.de", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 973247A3 for ; Wed, 7 Oct 2015 17:44:17 +0000 (UTC) (envelope-from jan-mailinglists@demter.de) Received: from wolpertinger.fritz.box ([88.217.181.46]) by mrelayeu.kundenserver.de (mreue002) with ESMTPSA (Nemesis) id 0LrVgT-1akOrT0l0n-013QDV; Wed, 07 Oct 2015 19:44:14 +0200 Subject: Re: bind host service to jail ip? To: freebsd-stable@freebsd.org, marko.cupac@mimar.rs References: <20151007161525.1beca1eb@efreet.kappastar.com> <56153D62.8070601@quip.cz> From: Jan Demter Message-ID: <561559ED.4060105@demter.de> Date: Wed, 7 Oct 2015 19:44:13 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:38.0) Gecko/20100101 Thunderbird/38.3.0 MIME-Version: 1.0 In-Reply-To: <56153D62.8070601@quip.cz> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Provags-ID: V03:K0:FkPup/RBSAV08NQqxjB7g2SbSR2QkJyfM77I20zL0lXw7WJi5GI fwFQd4m3ebLBjPUPZde67Ihun3fQNp0ha4jwuj3IGGsznXWr7qbauESrKrbCCatQIBlDdgl aFnrDpzAiQ19BJT4VBTlgOCqx5wvR5Vix7jQNmQ5I5FBKDrlsbAv2stTnytVIxJg6AIOaez q0YJ8/Xuxo7otGV7Riy0w== X-UI-Out-Filterresults: notjunk:1;V01:K0:vknfwi4xoFs=:xv3H4279qjrW2pyg64yr28 YXwOj4NbiYj/Rm/ITnlanBz9KGuhPXW+O2DDIlt47Ew5xAZSzcZOc28QI/JtIBGVz4XbzJsTC 8q8ecURtOVqbWA7g3ichPL/QID0wwD905izV+TEeGtWxfRtHQsw2imh5++iCgmUGHSXMXPS8S rRTCE3MCzX7gbuAAurxznXGk34WFDlpae1B1TJYR2HawKeVWO4NLwA8Lzr6BCPnnjzaqXlqBt 4APLikvo1MSPouya2SnDZkkhxOKhYgmxqfgOVUX1tMXe3Eu0osn4EsDpySNFzw+CQtb7zpfnK +b5gAEmvXAmGTXnMbkt4iiNCf/3bAJmk1MP91smhEwOiBPoUCfgFsdXCUhpmn22S9ylS/BpVT wn6MAFWDTJTLyTPQDa6MkFuMQcva4pIbb4SCMdaVIGgF2Nc/MRhN34/KyG4kNizIVbgtRgeqw eyaE8uBtAqIUzFibN1Up1zAP2ReW4+j5/Tze0+emp8CWmoTNzQJWjpzQdO3nbnPkkYsIG8Z6C 5j1RJHodGwRbK3SG6nfMCyHzimY19tgJOV/bmd1HkRQT5m/5+gmVvAUsMeG2h4bZitBJu5CYA c+nAvFm4WNUCbqoczrGMc0ZxbjXlrMWCqdC5hX+VnwOlpBQrS35qTF/j0AvA3aEoeMtedkRKG wifNDBSVrHC6+LVm7ffpDlHL/w7a643azYc07huR0jer+G31F4e74f8Qhf6ykSp7UMz4dsqF1 MBFY1dPsh5ShD6cI X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Oct 2015 17:44:18 -0000 On 07/10/15 17:42, Miroslav Lachman wrote: > Marko Cupać wrote on 10/07/2015 16:15: > > [...] > >> - If I ran openntpd in host and bound it to jails' ip addresses, would >> clients be able to sync? If so, are there any negative implications >> to this? > > I don't know if somethng has been changed over time, but if you run some > service in host on IP assigned to jail on port not used in jail, there > will be no conflict and service will be available to public A thing to keep in mind here is that anything running inside the jail can override the host (without any noticeable conflict), as a bind to an address from inside a jail will take precedent over the hosts listening sockets. So if you are going to run any less trusted code in the jails, it will be able to manipulate time for the clients using the jails address. Greetings Jan From owner-freebsd-stable@freebsd.org Wed Oct 7 18:42:04 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1A5479D1955 for ; Wed, 7 Oct 2015 18:42:04 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E77B61EE for ; Wed, 7 Oct 2015 18:42:03 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from ralph.baldwin.cx (c-73-231-226-104.hsd1.ca.comcast.net [73.231.226.104]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id BE8E8B939; Wed, 7 Oct 2015 14:42:02 -0400 (EDT) From: John Baldwin To: Christian Kratzer Cc: Rick Macklem , freebsd-stable@freebsd.org Subject: Re: smbfs crashes since approx. 10.1-RELEASE Date: Wed, 07 Oct 2015 10:42:52 -0700 Message-ID: <3563189.eDHDcCgW5L@ralph.baldwin.cx> User-Agent: KMail/4.14.3 (FreeBSD/10.2-PRERELEASE; KDE/4.14.3; amd64; ; ) In-Reply-To: References: <2148690.gx9M0ZzrG1@ralph.baldwin.cx> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 07 Oct 2015 14:42:02 -0400 (EDT) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Oct 2015 18:42:04 -0000 On Wednesday, October 07, 2015 08:52:30 AM Christian Kratzer wrote: > Hi, > > On Tue, 6 Oct 2015, John Baldwin wrote: > > >> This crash is occurring when doing an mtx_unlock(&Giant). Unfortunately, I'm not > >> conversant w.r.t. this code. I've cc'd jhb@ in case he has some insight. > >> If you don't get any responses, I'd suggest reposting to freebsd-current@ with > >> "crashes in mtx_unlock(&Giant)" in the subject line. > >> > >> Btw John, the code does tsleep() in a loop before the mtx_unlock(&Giant). I do > >> remember that was once allowed, but am not sure if it still is (ie a tsleep() call > >> while holding Giant)? > >> > >> Hopefully someone who knows what is special about Giant that might cause this will > >> respond. > >> > >> Good luck with it, rick > > > > tsleep() with Giant is still allowed. However, this sort of panic usually means > > you unlocked a mutex you didn't hold (but without INVARIANTS enabled or you'd get > > an assertion failure earlier). > > > > I don't see anything obviously wrong in smb_iod_thread() however. > > > > If you have the crashdump, can you please run this in kgdb: > > > > frame 9 > > p (struct mtx *)c > > p *(struct mtx *)c > > yes I have. Here we go: > > --snipp-- > Fatal trap 12: page fault while in kernel mode > cpuid = 0; apic id = 00 > fault virtual address = 0x20 > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff80996c7c > stack pointer = 0x28:0xfffffe004e79bac0 > frame pointer = 0x28:0xfffffe004e79baf0 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = resume, IOPL = 0 > current process = 12235 (smbiod172) > trap number = 12 > panic: page fault > cpuid = 0 > KDB: stack backtrace: > #0 0xffffffff80984e30 at kdb_backtrace+0x60 > #1 0xffffffff809489e6 at vpanic+0x126 > #2 0xffffffff809488b3 at panic+0x43 > #3 0xffffffff80d4aadb at trap_fatal+0x36b > #4 0xffffffff80d4addd at trap_pfault+0x2ed > #5 0xffffffff80d4a47a at trap+0x47a > #6 0xffffffff80d307f2 at calltrap+0x8 > #7 0xffffffff8092ebe0 at __mtx_unlock_sleep+0x60 > #8 0xffffffff8092eb69 at __mtx_unlock_flags+0x69 > #9 0xffffffff81a1b724 at smb_iod_thread+0xb4 > #10 0xffffffff8091244a at fork_exit+0x9a > #11 0xffffffff80d30d2e at fork_trampoline+0xe > Uptime: 1d18h34m4s > Dumping 161 out of 999 MB:..10%..20%..30%..40%..50%..60%..70%..80%..90%..100% > > Reading symbols from /boot/kernel/smbfs.ko.symbols...done. > Loaded symbols for /boot/kernel/smbfs.ko.symbols > Reading symbols from /boot/kernel/libiconv.ko.symbols...done. > Loaded symbols for /boot/kernel/libiconv.ko.symbols > Reading symbols from /boot/kernel/libmchain.ko.symbols...done. > Loaded symbols for /boot/kernel/libmchain.ko.symbols > #0 doadump (textdump=) at pcpu.h:219 > 219 pcpu.h: No such file or directory. > in pcpu.h > (kgdb) frame 9 > #9 0xffffffff8092ebe0 in __mtx_unlock_sleep (c=0xfffff8002f531790, opts=, > file=0xffffffff81a25801 "%s: Can't handle disordered parameters %d:%d\n", line=1) at /usr/src/sys/kern/kern_mutex.c:791 > 791 /usr/src/sys/kern/kern_mutex.c: No such file or directory. > in /usr/src/sys/kern/kern_mutex.c > Current language: auto; currently minimal > (kgdb) p (struct mtx *)c > $1 = (struct mtx *) 0xfffff8002f531790 > (kgdb) p *(struct mtx *)c > $2 = {lock_object = {lo_name = 0x6
, lo_flags = 0, lo_data = 0, lo_witness = 0xfffff8002f531798}, > mtx_lock = 1444181401} Ok, so that is a destroyed mutex. This means it is probably not Giant, and it might be some mutex in smb_iod_main() that shows up in smb_iod_thread() due to inlining. Actually, we know this from your earlier mail: if (evp->ev_type & SMBIOD_EV_SYNC) { SMB_IOD_EVLOCK(iod); wakeup(evp); SMB_IOD_EVUNLOCK(iod); Line 624 is that SMB_IOD_EVUNLOCK(). Hmm, does 'p *evp' work at frame 10? If not, can you try building the devel/gdb port from a recent ports tree with the 'KGDB' option enabled and use 'kgdb710' instead of 'kgdb' to see if you can print out '*evp'? > (kgdb) > --snipp-- > > I can build a GENERIC kernel with INVARIANTS enabled on the box to see if we get a better assertions next time this happens. That would be great, but please keep the existing core and kernel. We might be able to figure this out from that still. Also, go ahead and put this patch in and let me know if you ever see the printf logged. If you do, that could explain this panic (and we might need a more involved fix to avoid memory leaks). Index: smb_iod.c =================================================================== --- smb_iod.c (revision 288952) +++ smb_iod.c (working copy) @@ -624,6 +624,13 @@ SMB_IOD_EVUNLOCK(iod); } else free(evp, M_SMBIOD); + if (iod->iod_flags & SMBIOD_SHUTDOWN) { + if (!STAILQ_EMPTY(&iod->iod_evlist)) + printf("%s: shutdown with pending events\n", + __func__); + } + return; + } } #if 0 if (iod->iod_state == SMBIOD_ST_VCACTIVE) { -- John Baldwin From owner-freebsd-stable@freebsd.org Wed Oct 7 21:05:18 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E55669D1610 for ; Wed, 7 Oct 2015 21:05:17 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from mx1.cksoft.de (mx1.cksoft.de [IPv6:2001:67c:24f8:1::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.cksoft.de", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7A15F64C; Wed, 7 Oct 2015 21:05:17 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from m.cksoft.de (m.cksoft.de [212.17.240.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.cksoft.de (Postfix) with ESMTPSA id B0E1B1E9EB4; Wed, 7 Oct 2015 23:05:13 +0200 (CEST) Received: from amavis.cksoft.de (unknown [IPv6:2a01:170:1110:8001::25:a1]) by m.cksoft.de (Postfix) with ESMTP id 10162631D0; Wed, 7 Oct 2015 23:03:44 +0200 (CEST) X-Virus-Scanned: amavisd-new at cksoft.de Received: from m.cksoft.de ([IPv6:2a01:170:1110:8001::25:1]) by amavis.cksoft.de (amavis.cksoft.de [IPv6:2a01:170:1110:8001::25:a1]) (amavisd-new, port 10041) with ESMTP id C9HoUN21u1at; Wed, 7 Oct 2015 23:03:43 +0200 (CEST) Received: from noc1.cksoft.de (noc1.cksoft.de [IPv6:2a01:170:1110:8001::53:1]) by m.cksoft.de (Postfix) with ESMTP id 0349362F88; Wed, 7 Oct 2015 23:03:42 +0200 (CEST) Received: by noc1.cksoft.de (Postfix, from userid 1000) id E3C9113BCB; Wed, 7 Oct 2015 23:05:11 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by noc1.cksoft.de (Postfix) with ESMTP id DA3EB13B4B; Wed, 7 Oct 2015 23:05:11 +0200 (CEST) Date: Wed, 7 Oct 2015 23:05:11 +0200 (CEST) From: Christian Kratzer X-X-Sender: ck@noc1.cksoft.de Reply-To: Christian Kratzer To: John Baldwin cc: Rick Macklem , freebsd-stable@freebsd.org Subject: Re: smbfs crashes since approx. 10.1-RELEASE In-Reply-To: <3563189.eDHDcCgW5L@ralph.baldwin.cx> Message-ID: References: <2148690.gx9M0ZzrG1@ralph.baldwin.cx> <3563189.eDHDcCgW5L@ralph.baldwin.cx> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) X-Spammer-Kill-Ratio: 75% MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Oct 2015 21:05:18 -0000 Hi John, On Wed, 7 Oct 2015, John Baldwin wrote: >> mtx_lock = 1444181401} > > Ok, so that is a destroyed mutex. This means it is probably not Giant, and > it might be some mutex in smb_iod_main() that shows up in smb_iod_thread() due > to inlining. > > Actually, we know this from your earlier mail: > > if (evp->ev_type & SMBIOD_EV_SYNC) { > SMB_IOD_EVLOCK(iod); > wakeup(evp); > SMB_IOD_EVUNLOCK(iod); > > Line 624 is that SMB_IOD_EVUNLOCK(). > > Hmm, does 'p *evp' work at frame 10? If not, can you try building the > devel/gdb port from a recent ports tree with the 'KGDB' option enabled and > use 'kgdb710' instead of 'kgdb' to see if you can print out '*evp'? kgdb hangs when chaning to frame10. I will build the port later (svn ports checkout in progress) I have cloned the VM so that I have this isolated from my production network. >> (kgdb) >> --snipp-- >> >> I can build a GENERIC kernel with INVARIANTS enabled on the box to see if we get a better assertions next time this happens. > > That would be great, but please keep the existing core and kernel. We might > be able to figure this out from that still. > > Also, go ahead and put this patch in and let me know if you ever see the > printf logged. If you do, that could explain this panic (and we might need > a more involved fix to avoid memory leaks). > > Index: smb_iod.c > =================================================================== > --- smb_iod.c (revision 288952) > +++ smb_iod.c (working copy) > @@ -624,6 +624,13 @@ > SMB_IOD_EVUNLOCK(iod); > } else > free(evp, M_SMBIOD); > + if (iod->iod_flags & SMBIOD_SHUTDOWN) { > + if (!STAILQ_EMPTY(&iod->iod_evlist)) > + printf("%s: shutdown with pending events\n", > + __func__); > + } > + return; > + } > } > #if 0 > if (iod->iod_state == SMBIOD_ST_VCACTIVE) { The vm is now runnning lates 10-stable kernel with above patch and invariants enabled. Give it about 2 days to produce the next crash. Greetings Christian -- Christian Kratzer CK Software GmbH Email: ck@cksoft.de Wildberger Weg 24/2 Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer Web: http://www.cksoft.de/ From owner-freebsd-stable@freebsd.org Thu Oct 8 09:32:42 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA15E9D1892; Thu, 8 Oct 2015 09:32:42 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (heidi.turbocat.net [88.198.202.214]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8A477BC5; Thu, 8 Oct 2015 09:32:41 +0000 (UTC) (envelope-from hps@selasky.org) Received: from laptop015.home.selasky.org (cm-176.74.213.204.customer.telag.net [176.74.213.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id E51F81FE022; Thu, 8 Oct 2015 11:32:31 +0200 (CEST) Subject: Re: ix(intel) vs mlxen(mellanox) 10Gb performance To: Daniel Braniss , Rick Macklem References: <1D52028A-B39F-4F9B-BD38-CB1D73BF5D56@cs.huji.ac.il> <1153838447.28656490.1440193567940.JavaMail.zimbra@uoguelph.ca> <15D19823-08F7-4E55-BBD0-CE230F67D26E@cs.huji.ac.il> <818666007.28930310.1440244756872.JavaMail.zimbra@uoguelph.ca> <49173B1F-7B5E-4D59-8651-63D97B0CB5AC@cs.huji.ac.il> <1815942485.29539597.1440370972998.JavaMail.zimbra@uoguelph.ca> <55DAC623.60006@selasky.org> <62C7B1A3-CC6B-41A1-B254-6399F19F8FF7@cs.huji.ac.il> <2112273205.29795512.1440419111720.JavaMail.zimbra@uoguelph.ca> <1E679659-BA50-42C3-B569-03579E322685@cs.huji.ac.il> Cc: pyunyh@gmail.com, FreeBSD stable , FreeBSD Net From: Hans Petter Selasky Message-ID: <56163896.3020907@selasky.org> Date: Thu, 8 Oct 2015 11:34:14 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:38.0) Gecko/20100101 Thunderbird/38.2.0 MIME-Version: 1.0 In-Reply-To: <1E679659-BA50-42C3-B569-03579E322685@cs.huji.ac.il> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Oct 2015 09:32:42 -0000 Hi, I've now MFC'ed r287775 to 10-stable and 9-stable. I hope this will resolve the issues with m_defrag() being called on too long mbuf chains due to an off-by-one in the driver TSO parameters and that it will be easier to maintain these parameters in the future. Some comments were made that we might want to have an option to select if the IP-header should be counted or not. Certain network drivers require copying of the whole ETH/TCP/IP-header into separate memory areas, and can then handle one more data payload mbuf for TSO. Others required DMA-ing of the whole mbuf TSO chain. I think it is acceptable to have one TX-DMA segment slot free, in case of 2K mbuf clusters being used for TSO. From my experience the limitation typically kicks in when 2K mbuf clusters are used for TSO instead of 4K mbuf clusters. 65536 / 4096 = 16, whereas 65536 / 2048 = 32. If an ethernet hardware driver has a limitation of 24 data segments (mlxen), and assuming that each mbuf represent a single segment, then iff the majority of mbufs being transmitted are 2K clusters we may have a small, 1/24 = 4.2%, loss of TX capability per TSO packet. From what I've seen using iperf, which in turn calls m_uiotombuf() which in turn calls m_getm2(), MJUMPPAGESIZE'ed mbuf clusters are preferred for large data transfers, so this issue might only happen in case of NODELAY being used on the socket and if the writes are small from the application point of view. If an application is writing small amounts of data per send() system call, it is expected to degrade the system performance. Please file a PR if it becomes an issue. Someone asked me to MFC r287775 to 10.X release aswell. Is this still required? --HPS From owner-freebsd-stable@freebsd.org Thu Oct 8 12:32:36 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 819889D16D5; Thu, 8 Oct 2015 12:32:36 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id 269401EDC; Thu, 8 Oct 2015 12:32:35 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) IronPort-PHdr: 9a23:CZe7jhEZjK1HvBSkyYJXlZ1GYnF86YWxBRYc798ds5kLTJ75oMSwAkXT6L1XgUPTWs2DsrQf27aQ7P2rBDZIyK3CmU5BWaQEbwUCh8QSkl5oK+++Imq/EsTXaTcnFt9JTl5v8iLzG0FUHMHjew+a+SXqvnYsExnyfTB4Ov7yUtaLyZ/ni6btptaOOU1hv3mUX/BbFF2OtwLft80b08NJC50a7V/3mEZOYPlc3mhyJFiezF7W78a0+4N/oWwL46pyv+YJa6jxfrw5QLpEF3xmdjltvIy4/SXEGCuG4GBUamgKjhdSSzPI6BjhXYa55ivircJm1S2TJs7nC7cuVmLxwb1sTUrSiSwEfxsw+2LTh8k42LheqRmioxF665PTb5yYMOJ+OKjUK4BJDVFdV9pcAnQSSri3aJECWq9YZb5V X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2CyAgCNYRZW/61jaINeg3tuBr1AAQ2BWhcKgnKCCjVKAoF+FAEBAQEBAQEBgQmCH4IHAQEBAwEBAQEgKyALBQsCAQgYAgINGQICJwEJJgIECAIFBAEcBIgFCA2uTJQwAQEBAQEBAQEBAQEBAQEBAQEBFgSBIoVRhH6EOwEBHDQHgmmBRQWWCIUYhRiEPoQ5lWYCHwEBQoIRHYFwIjMHhiU6gQYBAQE X-IronPort-AV: E=Sophos;i="5.17,654,1437451200"; d="scan'208";a="243370407" Received: from nipigon.cs.uoguelph.ca (HELO zcs1.mail.uoguelph.ca) ([131.104.99.173]) by esa-annu.net.uoguelph.ca with ESMTP; 08 Oct 2015 08:32:28 -0400 Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 803BE15F565; Thu, 8 Oct 2015 08:32:28 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id vosyeExQTXCM; Thu, 8 Oct 2015 08:32:27 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id CC86C15F56D; Thu, 8 Oct 2015 08:32:27 -0400 (EDT) X-Virus-Scanned: amavisd-new at zcs1.mail.uoguelph.ca Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id zY5zWHc1e1gS; Thu, 8 Oct 2015 08:32:27 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca (zcs1.mail.uoguelph.ca [172.17.95.18]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 9DC8315F565; Thu, 8 Oct 2015 08:32:27 -0400 (EDT) Date: Thu, 8 Oct 2015 08:32:27 -0400 (EDT) From: Rick Macklem To: Hans Petter Selasky Cc: Daniel Braniss , pyunyh@gmail.com, FreeBSD Net , FreeBSD stable Message-ID: <855415533.28142431.1444307547414.JavaMail.zimbra@uoguelph.ca> In-Reply-To: <56163896.3020907@selasky.org> References: <1D52028A-B39F-4F9B-BD38-CB1D73BF5D56@cs.huji.ac.il> <49173B1F-7B5E-4D59-8651-63D97B0CB5AC@cs.huji.ac.il> <1815942485.29539597.1440370972998.JavaMail.zimbra@uoguelph.ca> <55DAC623.60006@selasky.org> <62C7B1A3-CC6B-41A1-B254-6399F19F8FF7@cs.huji.ac.il> <2112273205.29795512.1440419111720.JavaMail.zimbra@uoguelph.ca> <1E679659-BA50-42C3-B569-03579E322685@cs.huji.ac.il> <56163896.3020907@selasky.org> Subject: Re: ix(intel) vs mlxen(mellanox) 10Gb performance MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.95.11] X-Mailer: Zimbra 8.0.9_GA_6191 (ZimbraWebClient - FF34 (Win)/8.0.9_GA_6191) Thread-Topic: ix(intel) vs mlxen(mellanox) 10Gb performance Thread-Index: eT4NUGq9p4YEyXbCx7sOzdsvj3/VsQ== X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Oct 2015 12:32:36 -0000 Hans Petter Selasky wrote: > Hi, > > I've now MFC'ed r287775 to 10-stable and 9-stable. I hope this will > resolve the issues with m_defrag() being called on too long mbuf chains > due to an off-by-one in the driver TSO parameters and that it will be > easier to maintain these parameters in the future. > > Some comments were made that we might want to have an option to select > if the IP-header should be counted or not. Certain network drivers > require copying of the whole ETH/TCP/IP-header into separate memory > areas, and can then handle one more data payload mbuf for TSO. Others > required DMA-ing of the whole mbuf TSO chain. I think it is acceptable > to have one TX-DMA segment slot free, in case of 2K mbuf clusters being > used for TSO. From my experience the limitation typically kicks in when > 2K mbuf clusters are used for TSO instead of 4K mbuf clusters. 65536 / > 4096 = 16, whereas 65536 / 2048 = 32. If an ethernet hardware driver has > a limitation of 24 data segments (mlxen), and assuming that each mbuf > represent a single segment, then iff the majority of mbufs being > transmitted are 2K clusters we may have a small, 1/24 = 4.2%, loss of TX > capability per TSO packet. From what I've seen using iperf, which in > turn calls m_uiotombuf() which in turn calls m_getm2(), MJUMPPAGESIZE'ed > mbuf clusters are preferred for large data transfers, so this issue > might only happen in case of NODELAY being used on the socket and if the > writes are small from the application point of view. If an application > is writing small amounts of data per send() system call, it is expected > to degrade the system performance. > Btw, last year I did some testing with NFS generating chains of 4K (page size) clusters instead of 2K (MCLBYTES). Although not easily reproduced, I was able to fragment the KVM used for the cluster enough that allocations would fail. (I could only get it to happen when the code used 4K clusters for large NFS requests/replies and 2K clusters otherwise, resulting in a mix of allocations of both sizes.) As such, I never committed the changes to head. Any kernel change that does 4K cluster allocations needs to be carefully tested carefully (a small i386 like I have), imho. > Please file a PR if it becomes an issue. > > Someone asked me to MFC r287775 to 10.X release aswell. Is this still > required? > > --HPS Thanks for doing this, rick > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Thu Oct 8 20:30:00 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ABEE99D14AD for ; Thu, 8 Oct 2015 20:30:00 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 98B74DBF; Thu, 8 Oct 2015 20:30:00 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id C4E221EFB; Thu, 8 Oct 2015 20:30:00 +0000 (UTC) Date: Thu, 8 Oct 2015 20:29:59 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: bdrewery@FreeBSD.org, cperciva@FreeBSD.org, jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org Message-ID: <1458249758.247.1444336200751.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: FreeBSD_stable_10 - Build #1749 - Failure MIME-Version: 1.0 X-Jenkins-Job: FreeBSD_stable_10 X-Jenkins-Result: FAILURE Precedence: bulk Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Oct 2015 20:30:00 -0000 FreeBSD_stable_10 - Build #1749 - Failure: Build information: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1749/ Full change log: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1749/changes Full build log: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1749/console Change summaries: 289053 by bdrewery: MFC r288201: Don't recurse with cleanobj. 289052 by bdrewery: MFC r288160: Document bsd.progs.mk and add more variables overrides. 289051 by bdrewery: MFC r288158: Fix most cases of bsd.progs.mk running duplicate or missing commands. 289050 by bdrewery: Direct commit to fix usage with fmake. fmake does not have :tW, so use some clever :Q tricks to achieve the same result. This won't work if PATH actually contains spaces, but it's better than not working at all. 289049 by bdrewery: Direct commit to fix warnings with fmake when building from top-level. The top-level Makefile.inc1 uses 'make -C release -V' to lookup revision information, which causes Makefile.vm and Makefile.vagrant to be included. fmake has 2 issues here: 1. It doesn't like the empty result of .if ${VAR:Mfoo} 2. It doesn't like .if ${loop_item} == 289047 by bdrewery: MFC r288238: MFV c3ccd112: Correct off-by-ones in free_exception of emergency buffer 289045 by bdrewery: MFC r288271: Document bus_get_resource(9). 289043 by bdrewery: MFC r284408: Ensure TESTSDIR is defined before bsd.test.mk is .include'd 289042 by bdrewery: MFC r288198,r288200: r288198: Remove unneeded dependency line. r288200: Remove unneeded dependency of '.o: .h' that bsd.prog.mk already handles. 289040 by bdrewery: MFC r288179: Fix running make in src directories without a Makefile giving confusing errors. 289032 by cperciva: MFC r288446: Disable suspend during shutdown. The end of the build log: [...truncated 3635 lines...] --- cleandepend --- rm -f .depend.atan_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=cbrt_test DEPENDFILE=.depend.cbrt_test .MAKE.DEPENDFILE=.depend.cbrt_test cleandir) --- clean --- rm -f cbrt_test t_cbrt.o --- cleandepend --- rm -f .depend.cbrt_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=ceil_test DEPENDFILE=.depend.ceil_test .MAKE.DEPENDFILE=.depend.ceil_test cleandir) --- clean --- rm -f ceil_test t_ceil.o --- cleandepend --- rm -f .depend.ceil_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=cos_test DEPENDFILE=.depend.cos_test .MAKE.DEPENDFILE=.depend.cos_test cleandir) --- clean --- rm -f cos_test t_cos.o --- cleandepend --- rm -f .depend.cos_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=cosh_test DEPENDFILE=.depend.cosh_test .MAKE.DEPENDFILE=.depend.cosh_test cleandir) --- bin.cleandir__D --- --- cleanobj --- --- cleandir_subdir_sh --- ===> bin/sh (cleandir) --- lib.cleandir__D --- --- clean --- rm -f cosh_test t_cosh.o --- cleandepend --- rm -f .depend.cosh_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=erf_test DEPENDFILE=.depend.erf_test .MAKE.DEPENDFILE=.depend.erf_test cleandir) --- clean --- rm -f erf_test t_erf.o --- gnu.cleandir__D --- --- cleanobj --- --- lib.cleandir__D --- --- cleandepend --- rm -f .depend.erf_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- --- gnu.cleandir__D --- ===> gnu/lib/libgcc (cleandir) --- lib.cleandir__D --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=exp_test DEPENDFILE=.depend.exp_test .MAKE.DEPENDFILE=.depend.exp_test cleandir) --- clean --- rm -f exp_test t_exp.o --- cleandepend --- rm -f .depend.exp_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=fmod_test DEPENDFILE=.depend.fmod_test .MAKE.DEPENDFILE=.depend.fmod_test cleandir) --- gnu.cleandir__D --- --- cleanobj --- --- lib.cleandir__D --- --- clean --- rm -f fmod_test t_fmod.o --- cleandepend --- rm -f .depend.fmod_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=infinity_test DEPENDFILE=.depend.infinity_test .MAKE.DEPENDFILE=.depend.infinity_test cleandir) --- clean --- rm -f infinity_test t_infinity.o --- cleandepend --- rm -f .depend.infinity_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=ldexp_test DEPENDFILE=.depend.ldexp_test .MAKE.DEPENDFILE=.depend.ldexp_test cleandir) --- cddl.cleandir__D --- --- cleanobj --- --- lib.cleandir__D --- --- clean --- rm -f ldexp_test t_ldexp.o --- cleandepend --- rm -f .depend.ldexp_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=log_test DEPENDFILE=.depend.log_test .MAKE.DEPENDFILE=.depend.log_test cleandir) --- clean --- rm -f log_test t_log.o --- cleandepend --- rm -f .depend.log_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=pow_test DEPENDFILE=.depend.pow_test .MAKE.DEPENDFILE=.depend.pow_test cleandir) --- clean --- rm -f pow_test t_pow.o --- cleandepend --- rm -f .depend.pow_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=precision_test DEPENDFILE=.depend.precision_test .MAKE.DEPENDFILE=.depend.precision_test cleandir) --- clean --- rm -f precision_test t_precision.o --- cleandepend --- rm -f .depend.precision_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=round_test DEPENDFILE=.depend.round_test .MAKE.DEPENDFILE=.depend.round_test cleandir) --- clean --- rm -f round_test t_round.o --- cleandepend --- rm -f .depend.round_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=scalbn_test DEPENDFILE=.depend.scalbn_test .MAKE.DEPENDFILE=.depend.scalbn_test cleandir) --- gnu.cleandir__D --- ===> gnu/lib/libgcov (cleandir) --- lib.cleandir__D --- --- clean --- rm -f scalbn_test t_scalbn.o --- cleandepend --- rm -f .depend.scalbn_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=sin_test DEPENDFILE=.depend.sin_test .MAKE.DEPENDFILE=.depend.sin_test cleandir) --- clean --- rm -f sin_test t_sin.o --- cleandepend --- rm -f .depend.sin_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- --- bin.cleandir__D --- --- cleanobj --- --- lib.cleandir__D --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=sinh_test DEPENDFILE=.depend.sinh_test .MAKE.DEPENDFILE=.depend.sinh_test cleandir) --- clean --- rm -f sinh_test t_sinh.o --- cleandepend --- rm -f .depend.sinh_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- --- gnu.cleandir__D --- --- cleanobj --- --- lib.cleandir__D --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=sqrt_test DEPENDFILE=.depend.sqrt_test .MAKE.DEPENDFILE=.depend.sqrt_test cleandir) --- gnu.cleandir__D --- ===> gnu/lib/libdialog (cleandir) --- lib.cleandir__D --- --- clean --- rm -f sqrt_test t_sqrt.o --- cleandepend --- rm -f .depend.sqrt_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=tan_test DEPENDFILE=.depend.tan_test .MAKE.DEPENDFILE=.depend.tan_test cleandir) --- clean --- rm -f tan_test t_tan.o --- cleandepend --- rm -f .depend.tan_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- (cd /builds/FreeBSD_stable_10/lib/msun/tests && make -f Makefile _RECURSING_PROGS= SUBDIR= PROG=tanh_test DEPENDFILE=.depend.tanh_test .MAKE.DEPENDFILE=.depend.tanh_test cleandir) --- clean --- rm -f tanh_test t_tanh.o --- cleandepend --- rm -f .depend.tanh_test GPATH GRTAGS GSYMS GTAGS --- cleanobj --- rm -f Kyuafile.auto Kyuafile.auto.tmp --- cleandir_subdir_libc --- ===> lib/libc (cleandir) --- bin.cleandir__D --- --- _sub.cleandir --- ===> bin/sh/tests (cleandir) --- _sub.clean --- ===> bin/sh/tests/builtins (clean) --- gnu.cleandir__D --- --- cleanobj --- --- bin.cleandir__D --- make[6]: "/builds/FreeBSD_stable_10/share/mk/bsd.test.mk" line 14: "Please define TESTSDIR when including bsd.test.mk" *** [_sub.clean] Error code 1 make[5]: stopped in /builds/FreeBSD_stable_10/bin/sh/tests 1 error make[5]: stopped in /builds/FreeBSD_stable_10/bin/sh/tests *** [_sub.cleandir] Error code 2 make[4]: stopped in /builds/FreeBSD_stable_10/bin/sh 1 error make[4]: stopped in /builds/FreeBSD_stable_10/bin/sh *** [cleandir_subdir_sh] Error code 2 make[3]: stopped in /builds/FreeBSD_stable_10/bin 1 error make[3]: stopped in /builds/FreeBSD_stable_10/bin *** [bin.cleandir__D] Error code 2 make[2]: stopped in /builds/FreeBSD_stable_10 --- gnu.cleandir__D --- A failure has been detected in another branch of the parallel make make[5]: stopped in /builds/FreeBSD_stable_10/gnu/lib/libdialog *** [_sub.cleandir] Error code 2 make[4]: stopped in /builds/FreeBSD_stable_10/gnu/lib 1 error make[4]: stopped in /builds/FreeBSD_stable_10/gnu/lib *** [_sub.cleandir] Error code 2 make[3]: stopped in /builds/FreeBSD_stable_10/gnu 1 error make[3]: stopped in /builds/FreeBSD_stable_10/gnu *** [gnu.cleandir__D] Error code 2 make[2]: stopped in /builds/FreeBSD_stable_10 --- cddl.cleandir__D --- A failure has been detected in another branch of the parallel make make[5]: stopped in /builds/FreeBSD_stable_10/cddl/lib/libzpool *** [_sub.cleandir] Error code 2 make[4]: stopped in /builds/FreeBSD_stable_10/cddl/lib 1 error make[4]: stopped in /builds/FreeBSD_stable_10/cddl/lib *** [_sub.cleandir] Error code 2 make[3]: stopped in /builds/FreeBSD_stable_10/cddl 1 error make[3]: stopped in /builds/FreeBSD_stable_10/cddl *** [cddl.cleandir__D] Error code 2 make[2]: stopped in /builds/FreeBSD_stable_10 --- lib.cleandir__D --- A failure has been detected in another branch of the parallel make make[4]: stopped in /builds/FreeBSD_stable_10/lib/libc *** [cleandir_subdir_libc] Error code 2 make[3]: stopped in /builds/FreeBSD_stable_10/lib 1 error make[3]: stopped in /builds/FreeBSD_stable_10/lib *** [lib.cleandir__D] Error code 2 make[2]: stopped in /builds/FreeBSD_stable_10 4 errors make[2]: stopped in /builds/FreeBSD_stable_10 *** [_cleanobj] Error code 2 make[1]: stopped in /builds/FreeBSD_stable_10 1 error make[1]: stopped in /builds/FreeBSD_stable_10 *** [buildworld] Error code 2 make: stopped in /builds/FreeBSD_stable_10 1 error make: stopped in /builds/FreeBSD_stable_10 Build step 'Execute shell' marked build as failure [WARNINGS] Skipping publisher since build result is FAILURE Email was triggered for: Failure - Any Sending email for trigger: Failure - Any From owner-freebsd-stable@freebsd.org Thu Oct 8 23:02:21 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 270C29D1E56 for ; Thu, 8 Oct 2015 23:02:21 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 18E42918; Thu, 8 Oct 2015 23:02:21 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id 419051F50; Thu, 8 Oct 2015 23:02:21 +0000 (UTC) Date: Thu, 8 Oct 2015 23:02:19 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: bdrewery@FreeBSD.org, jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org Message-ID: <780188007.253.1444345341157.JavaMail.jenkins@jenkins-9.freebsd.org> In-Reply-To: <1458249758.247.1444336200751.JavaMail.jenkins@jenkins-9.freebsd.org> References: <1458249758.247.1444336200751.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: FreeBSD_stable_10 - Build #1750 - Fixed MIME-Version: 1.0 X-Jenkins-Job: FreeBSD_stable_10 X-Jenkins-Result: SUCCESS Precedence: bulk Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Oct 2015 23:02:21 -0000 FreeBSD_stable_10 - Build #1750 - Fixed: Build information: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1750/ Full change log: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1750/changes Full build log: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1750/console Change summaries: 289054 by bdrewery: Revert r289043. r284408 was marked for MFC but is not safe for stable/10 yet due to failing in bin/sh/tests. From owner-freebsd-stable@freebsd.org Fri Oct 9 09:11:32 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E74969D2D89 for ; Fri, 9 Oct 2015 09:11:31 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from mx1.cksoft.de (mx1.cksoft.de [IPv6:2001:67c:24f8:1::25:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.cksoft.de", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 78C06ABF; Fri, 9 Oct 2015 09:11:31 +0000 (UTC) (envelope-from ck-lists@cksoft.de) Received: from m.cksoft.de (m.cksoft.de [212.17.240.75]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.cksoft.de (Postfix) with ESMTPSA id 5FF1D1E9EB2; Fri, 9 Oct 2015 11:11:26 +0200 (CEST) Received: from amavis.cksoft.de (unknown [IPv6:2a01:170:1110:8001::25:a1]) by m.cksoft.de (Postfix) with ESMTP id DC594631D7; Fri, 9 Oct 2015 11:09:55 +0200 (CEST) X-Virus-Scanned: amavisd-new at cksoft.de Received: from m.cksoft.de ([IPv6:2a01:170:1110:8001::25:1]) by amavis.cksoft.de (amavis.cksoft.de [IPv6:2a01:170:1110:8001::25:a1]) (amavisd-new, port 10041) with ESMTP id vZgH5qj5fe-f; Fri, 9 Oct 2015 11:09:55 +0200 (CEST) Received: from noc1.cksoft.de (noc1.cksoft.de [IPv6:2a01:170:1110:8001::53:1]) by m.cksoft.de (Postfix) with ESMTP id 6A382631D0; Fri, 9 Oct 2015 11:09:54 +0200 (CEST) Received: by noc1.cksoft.de (Postfix, from userid 1000) id 44C2713BD3; Fri, 9 Oct 2015 11:11:24 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by noc1.cksoft.de (Postfix) with ESMTP id 3BAF313B4B; Fri, 9 Oct 2015 11:11:24 +0200 (CEST) Date: Fri, 9 Oct 2015 11:11:24 +0200 (CEST) From: Christian Kratzer X-X-Sender: ck@noc1.cksoft.de Reply-To: Christian Kratzer To: John Baldwin cc: Rick Macklem , freebsd-stable@freebsd.org Subject: Re: smbfs crashes since approx. 10.1-RELEASE In-Reply-To: <3563189.eDHDcCgW5L@ralph.baldwin.cx> Message-ID: References: <2148690.gx9M0ZzrG1@ralph.baldwin.cx> <3563189.eDHDcCgW5L@ralph.baldwin.cx> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) X-Spammer-Kill-Ratio: 75% MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Oct 2015 09:11:32 -0000 Hi John, the box crashed again running a 10-stable kernel with following patch of yours: On Wed, 7 Oct 2015, John Baldwin wrote: > Index: smb_iod.c > =================================================================== > --- smb_iod.c (revision 288952) > +++ smb_iod.c (working copy) > @@ -624,6 +624,13 @@ > SMB_IOD_EVUNLOCK(iod); > } else > free(evp, M_SMBIOD); > + if (iod->iod_flags & SMBIOD_SHUTDOWN) { > + if (!STAILQ_EMPTY(&iod->iod_evlist)) > + printf("%s: shutdown with pending events\n", > + __func__); > + } > + return; > + } > } > #if 0 > if (iod->iod_state == SMBIOD_ST_VCACTIVE) { > here is what I got on the kvm console: login: panic: Assertion mtx_unowned(m) failed at /usr/src/sys/kern/kern_mutex.c:955^M cpuid = 1^M KDB: stack backtrace:^M #0 0xffffffff80975bb0 at kdb_backtrace+0x60^M #1 0xffffffff8093baa6 at vpanic+0x126^M #2 0xffffffff8093b979 at kassert_panic+0x139^M #3 0xffffffff80921c47 at _mtx_destroy+0x77^M #4 0xffffffff81a1c114 at smb_iod_destroy+0xc4^M #5 0xffffffff81a12eea at smb_vc_free+0x1a^M #6 0xffffffff81a13e24 at sdp_trydestroy+0xb4^M #7 0xffffffff81a1cb36 at smbfs_unmount+0xd6^M #8 0xffffffff809d9e84 at dounmount+0x524^M #9 0xffffffff809d9936 at sys_unmount+0x3c6^M #10 0xffffffff80d42235 at amd64_syscall+0x265^M #11 0xffffffff80d25cfb at Xfast_syscall+0xfb^M Uptime: 19h48m28s^M Dumping 179 out of 999 MB:..9%..18%..27%..36%..45%..54%..63%..72%..81%..98%^M Dump complete^M Automatic reboot in 15 seconds - press a key on the console to abort^M heres the crashinfo: panic: Assertion mtx_unowned(m) failed at /usr/src/sys/kern/kern_mutex.c:955 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: panic: Assertion mtx_unowned(m) failed at /usr/src/sys/kern/kern_mutex.c:955 cpuid = 1 KDB: stack backtrace: #0 0xffffffff80975bb0 at kdb_backtrace+0x60 #1 0xffffffff8093baa6 at vpanic+0x126 #2 0xffffffff8093b979 at kassert_panic+0x139 #3 0xffffffff80921c47 at _mtx_destroy+0x77 #4 0xffffffff81a1c114 at smb_iod_destroy+0xc4 #5 0xffffffff81a12eea at smb_vc_free+0x1a #6 0xffffffff81a13e24 at sdp_trydestroy+0xb4 #7 0xffffffff81a1cb36 at smbfs_unmount+0xd6 #8 0xffffffff809d9e84 at dounmount+0x524 #9 0xffffffff809d9936 at sys_unmount+0x3c6 #10 0xffffffff80d42235 at amd64_syscall+0x265 #11 0xffffffff80d25cfb at Xfast_syscall+0xfb Uptime: 19h48m28s Dumping 179 out of 999 MB:..9%..18%..27%..36%..45%..54%..63%..72%..81%..98% Reading symbols from /boot/kernel/smbfs.ko.symbols...done. Loaded symbols for /boot/kernel/smbfs.ko.symbols Reading symbols from /boot/kernel/libiconv.ko.symbols...done. Loaded symbols for /boot/kernel/libiconv.ko.symbols Reading symbols from /boot/kernel/libmchain.ko.symbols...done. Loaded symbols for /boot/kernel/libmchain.ko.symbols #0 doadump (textdump=) at pcpu.h:219 219 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=) at pcpu.h:219 #1 0xffffffff8093b5f2 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:451 #2 0xffffffff8093bae5 in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:758 #3 0xffffffff8093b979 in kassert_panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:646 #4 0xffffffff80921c47 in _mtx_destroy (c=0xfffff80009284690) at /usr/src/sys/kern/kern_mutex.c:955 #5 0xffffffff81a1c114 in smb_iod_destroy (iod=0xfffff80009284600) at /usr/src/sys/modules/smbfs/../../netsmb/smb_iod.c:706 #6 0xffffffff81a12eea in smb_vc_free (cp=0xfffff8003a602a00) at /usr/src/sys/modules/smbfs/../../netsmb/smb_conn.c:499 #7 0xffffffff81a13e24 in sdp_trydestroy (sdp=0xfffff8000a7cbc80) at /usr/src/sys/modules/smbfs/../../netsmb/smb_dev.c:166 #8 0xffffffff81a1cb36 in smbfs_unmount (mp=0xfffff80039f88330, mntflags=) at /usr/src/sys/modules/smbfs/../../fs/smbfs/smbfs_vfsops.c:297 #9 0xffffffff809d9e84 in dounmount (mp=0xfffff80039f88330, flags=134217728, td=0xfffff8000f2b0000) at /usr/src/sys/kern/vfs_mount.c:1313 #10 0xffffffff809d9936 in sys_unmount (td=0xfffff8000f2b0000, uap=0xfffffe003d67fb80) at /usr/src/sys/kern/vfs_mount.c:1205 #11 0xffffffff80d42235 in amd64_syscall (td=0xfffff8000f2b0000, traced=0) at subr_syscall.c:134 #12 0xffffffff80d25cfb in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 #13 0x000000080089190a in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) I have kgdb710 from ports setup in case you need me to check something. Greetings Christian -- Christian Kratzer CK Software GmbH Email: ck@cksoft.de Wildberger Weg 24/2 Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer Web: http://www.cksoft.de/ From owner-freebsd-stable@freebsd.org Sat Oct 10 04:30:46 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 35F2B9D2465 for ; Sat, 10 Oct 2015 04:30:46 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 1C1ACC1E; Sat, 10 Oct 2015 04:30:46 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id 1D85E63A; Sat, 10 Oct 2015 04:30:46 +0000 (UTC) Date: Sat, 10 Oct 2015 04:30:38 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: delphij@FreeBSD.org, jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org Message-ID: <1737373977.285.1444451446017.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: FreeBSD_stable_10 - Build #1752 - Failure MIME-Version: 1.0 X-Jenkins-Job: FreeBSD_stable_10 X-Jenkins-Result: FAILURE Precedence: bulk Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Oct 2015 04:30:46 -0000 FreeBSD_stable_10 - Build #1752 - Failure: Build information: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1752/ Full change log: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1752/cha= nges Full build log: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1752/cons= ole Change summaries: 289100 by delphij: MFC r288204: MFV r288063: make dataset property de-registration operation O(1) The end of the build log: [...truncated 56864 lines...] --- usr.sbin.includes__D --- =3D=3D=3D> usr.sbin/watchdogd (installincludes) --- lib.includes__D --- --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libsdp/sdp.h /builds/FreeBSD_stable_10/obj/bui= lds/FreeBSD_stable_10/tmp/usr/include --- usr.sbin.includes__D --- =3D=3D=3D> usr.sbin/wlandebug (installincludes) =3D=3D=3D> usr.sbin/wpa (installincludes) --- _sub.installincludes --- =3D=3D=3D> usr.sbin/wpa/wpa_supplicant (installincludes) =3D=3D=3D> usr.sbin/wpa/wpa_cli (installincludes) =3D=3D=3D> usr.sbin/wpa/wpa_passphrase (installincludes) =3D=3D=3D> usr.sbin/wpa/hostapd (installincludes) =3D=3D=3D> usr.sbin/wpa/hostapd_cli (installincludes) =3D=3D=3D> usr.sbin/wpa/ndis_events (installincludes) =3D=3D=3D> usr.sbin/yp_mkdb (installincludes) =3D=3D=3D> usr.sbin/ypbind (installincludes) =3D=3D=3D> usr.sbin/yppoll (installincludes) --- lib.includes__D --- =3D=3D=3D> lib/libsm (installincludes) --- usr.sbin.includes__D --- =3D=3D=3D> usr.sbin/yppush (installincludes) --- lib.includes__D --- =3D=3D=3D> lib/libsmb (installincludes) --- usr.sbin.includes__D --- =3D=3D=3D> usr.sbin/ypserv (installincludes) --- lib.includes__D --- =3D=3D=3D> lib/libsmdb (installincludes) --- usr.sbin.includes__D --- =3D=3D=3D> usr.sbin/ypset (installincludes) --- lib.includes__D --- =3D=3D=3D> lib/libsmutil (installincludes) --- usr.sbin.includes__D --- =3D=3D=3D> usr.sbin/zic (installincludes) --- lib.includes__D --- =3D=3D=3D> lib/libstand (installincludes) --- usr.sbin.includes__D --- --- _sub.installincludes --- =3D=3D=3D> usr.sbin/zic/zic (installincludes) --- lib.includes__D --- --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libstand/stand.h /builds/FreeBSD_stable_10/obj= /builds/FreeBSD_stable_10/tmp/usr/include --- usr.sbin.includes__D --- =3D=3D=3D> usr.sbin/zic/zdump (installincludes) =3D=3D=3D> usr.sbin/zzz (installincludes) --- lib.includes__D --- =3D=3D=3D> lib/libstdbuf (installincludes) =3D=3D=3D> lib/libstdthreads (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libstdthreads/threads.h /builds/FreeBSD_stable= _10/obj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libtacplus (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libtacplus/taclib.h /builds/FreeBSD_stable_10/= obj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libtelnet (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libtelnet/../../contrib/telnet/arpa/telnet.h /= builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tmp/usr/include/arpa =3D=3D=3D> lib/libthr (installincludes) --- _sub.installincludes --- =3D=3D=3D> lib/libthr/tests (installincludes) =3D=3D=3D> lib/libthr/tests/dlopen (installincludes) =3D=3D=3D> lib/libthr/tests/dlopen/dso (installincludes) =3D=3D=3D> lib/libthread_db (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libthread_db/thread_db.h /builds/FreeBSD_stabl= e_10/obj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libucl (installincludes) =3D=3D=3D> lib/libufs (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libufs/libufs.h /builds/FreeBSD_stable_10/obj/= builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libugidfw (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libugidfw/ugidfw.h /builds/FreeBSD_stable_10/o= bj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libulog (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libulog/ulog.h /builds/FreeBSD_stable_10/lib/l= ibulog/utempter.h /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tm= p/usr/include =3D=3D=3D> lib/libunbound (installincludes) =3D=3D=3D> lib/libusbhid (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libusbhid/usbhid.h /builds/FreeBSD_stable_10/o= bj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libusb (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libusb/libusb20.h /builds/FreeBSD_stable_10/li= b/libusb/libusb20_desc.h /builds/FreeBSD_stable_10/lib/libusb/usb.h /builds= /FreeBSD_stable_10/lib/libusb/libusb.h /builds/FreeBSD_stable_10/obj/builds= /FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libutil (installincludes) --- _sub.installincludes --- --- _INCSINS --- --- _sub.installincludes --- =3D=3D=3D> lib/libutil/tests (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libutil/libutil.h /builds/FreeBSD_stable_10/li= b/libutil/login_cap.h /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_1= 0/tmp/usr/include =3D=3D=3D> lib/libvgl (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libvgl/vgl.h /builds/FreeBSD_stable_10/obj/bui= lds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libvmmapi (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libvmmapi/vmmapi.h /builds/FreeBSD_stable_10/o= bj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libwrap (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libwrap/../../contrib/tcp_wrappers/tcpd.h /bui= lds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/liby (installincludes) =3D=3D=3D> lib/libypclnt (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libypclnt/ypclnt.h /builds/FreeBSD_stable_10/o= bj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/libyaml (installincludes) =3D=3D=3D> lib/libz (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/libz/zconf.h /builds/FreeBSD_stable_10/lib/lib= z/zlib.h /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tmp/usr/inc= lude =3D=3D=3D> lib/ncurses (installincludes) --- _sub.installincludes --- =3D=3D=3D> lib/ncurses/ncurses (installincludes) =3D=3D=3D> lib/ncurses/form (installincludes) =3D=3D=3D> lib/ncurses/menu (installincludes) =3D=3D=3D> lib/ncurses/panel (installincludes) =3D=3D=3D> lib/ncurses/ncursesw (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 c= urses.h term.h termcap.h unctrl.h /builds/FreeBSD_stable_10/lib/ncurses/ncu= rsesw/../../../contrib/ncurses/include/ncurses_dll.h /builds/FreeBSD_stable= _10/obj/builds/FreeBSD_stable_10/tmp/usr/include --- installincludes --- /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tmp/usr/include/ncur= ses.h -> curses.h =3D=3D=3D> lib/ncurses/formw (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/ncurses/formw/../../../contrib/ncurses/form/fo= rm.h /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tmp/usr/include =3D=3D=3D> lib/ncurses/menuw (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/ncurses/menuw/../../../contrib/ncurses/menu/me= nu.h /builds/FreeBSD_stable_10/lib/ncurses/menuw/../../../contrib/ncurses/m= enu/eti.h /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tmp/usr/in= clude =3D=3D=3D> lib/ncurses/panelw (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/ncurses/panelw/../../../contrib/ncurses/panel/= panel.h /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tmp/usr/incl= ude =3D=3D=3D> lib/atf (installincludes) --- _sub.installincludes --- =3D=3D=3D> lib/atf/libatf-c (installincludes) --- _sub.installincludes --- --- _INCSINS_atf-c.h --- --- _INCSINS --- --- _sub.installincludes --- =3D=3D=3D> lib/atf/libatf-c/tests (installincludes) --- _INCSINS_atf-c.h --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 = /builds/FreeBSD_stable_10/contrib/atf/atf-c.h /builds/FreeBSD_stable_10/ob= j/builds/FreeBSD_stable_10/tmp/usr/include/atf-c.h --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/contrib/atf/atf-c/build.h /builds/FreeBSD_stable_1= 0/contrib/atf/atf-c/check.h /builds/FreeBSD_stable_10/contrib/atf/atf-c/def= s.h /builds/FreeBSD_stable_10/contrib/atf/atf-c/error.h /builds/FreeBSD_sta= ble_10/contrib/atf/atf-c/error_fwd.h /builds/FreeBSD_stable_10/contrib/atf/= atf-c/macros.h /builds/FreeBSD_stable_10/contrib/atf/atf-c/tc.h /builds/Fre= eBSD_stable_10/contrib/atf/atf-c/tp.h /builds/FreeBSD_stable_10/contrib/atf= /atf-c/utils.h /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10/tmp/u= sr/include/atf-c --- _sub.installincludes --- =3D=3D=3D> lib/atf/libatf-c/tests/detail (installincludes) =3D=3D=3D> lib/atf/libatf-c++ (installincludes) --- _sub.installincludes --- --- _INCSINS_atf-c++.hpp --- --- _INCSINS --- --- _sub.installincludes --- =3D=3D=3D> lib/atf/libatf-c++/tests (installincludes) --- _INCSINS_atf-c++.hpp --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 = /builds/FreeBSD_stable_10/contrib/atf/atf-c++.hpp /builds/FreeBSD_stable_1= 0/obj/builds/FreeBSD_stable_10/tmp/usr/include/atf-c++.hpp --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/contrib/atf/atf-c++/build.hpp /builds/FreeBSD_stab= le_10/contrib/atf/atf-c++/check.hpp /builds/FreeBSD_stable_10/contrib/atf/a= tf-c++/macros.hpp /builds/FreeBSD_stable_10/contrib/atf/atf-c++/tests.hpp /= builds/FreeBSD_stable_10/contrib/atf/atf-c++/utils.hpp /builds/FreeBSD_stab= le_10/obj/builds/FreeBSD_stable_10/tmp/usr/include/atf-c++ --- _sub.installincludes --- =3D=3D=3D> lib/atf/libatf-c++/tests/detail (installincludes) =3D=3D=3D> lib/atf/tests (installincludes) --- _sub.installincludes --- =3D=3D=3D> lib/atf/tests/test-programs (installincludes) =3D=3D=3D> lib/clang (installincludes) --- _sub.installincludes --- =3D=3D=3D> lib/clang/libclanganalysis (installincludes) =3D=3D=3D> lib/clang/libclangarcmigrate (installincludes) =3D=3D=3D> lib/clang/libclangast (installincludes) =3D=3D=3D> lib/clang/libclangbasic (installincludes) =3D=3D=3D> lib/clang/libclangcodegen (installincludes) =3D=3D=3D> lib/clang/libclangdriver (installincludes) =3D=3D=3D> lib/clang/libclangedit (installincludes) =3D=3D=3D> lib/clang/libclangfrontend (installincludes) =3D=3D=3D> lib/clang/libclangfrontendtool (installincludes) =3D=3D=3D> lib/clang/libclanglex (installincludes) =3D=3D=3D> lib/clang/libclangparse (installincludes) =3D=3D=3D> lib/clang/libclangrewritecore (installincludes) =3D=3D=3D> lib/clang/libclangrewritefrontend (installincludes) =3D=3D=3D> lib/clang/libclangsema (installincludes) =3D=3D=3D> lib/clang/libclangserialization (installincludes) =3D=3D=3D> lib/clang/libclangstaticanalyzercheckers (installincludes) =3D=3D=3D> lib/clang/libclangstaticanalyzercore (installincludes) =3D=3D=3D> lib/clang/libclangstaticanalyzerfrontend (installincludes) =3D=3D=3D> lib/clang/libllvmanalysis (installincludes) =3D=3D=3D> lib/clang/libllvmasmparser (installincludes) =3D=3D=3D> lib/clang/libllvmasmprinter (installincludes) =3D=3D=3D> lib/clang/libllvmbitreader (installincludes) =3D=3D=3D> lib/clang/libllvmbitwriter (installincludes) =3D=3D=3D> lib/clang/libllvmcodegen (installincludes) =3D=3D=3D> lib/clang/libllvmcore (installincludes) =3D=3D=3D> lib/clang/libllvminstcombine (installincludes) =3D=3D=3D> lib/clang/libllvminstrumentation (installincludes) =3D=3D=3D> lib/clang/libllvmipa (installincludes) =3D=3D=3D> lib/clang/libllvmipo (installincludes) =3D=3D=3D> lib/clang/libllvmirreader (installincludes) =3D=3D=3D> lib/clang/libllvmlinker (installincludes) =3D=3D=3D> lib/clang/libllvmmc (installincludes) =3D=3D=3D> lib/clang/libllvmmcparser (installincludes) =3D=3D=3D> lib/clang/libllvmobjcarcopts (installincludes) =3D=3D=3D> lib/clang/libllvmobject (installincludes) =3D=3D=3D> lib/clang/libllvmoption (installincludes) =3D=3D=3D> lib/clang/libllvmscalaropts (installincludes) =3D=3D=3D> lib/clang/libllvmselectiondag (installincludes) =3D=3D=3D> lib/clang/libllvmsupport (installincludes) =3D=3D=3D> lib/clang/libllvmtablegen (installincludes) =3D=3D=3D> lib/clang/libllvmtarget (installincludes) =3D=3D=3D> lib/clang/libllvmtransformutils (installincludes) =3D=3D=3D> lib/clang/libllvmvectorize (installincludes) =3D=3D=3D> lib/clang/libllvmarmasmparser (installincludes) =3D=3D=3D> lib/clang/libllvmarmcodegen (installincludes) =3D=3D=3D> lib/clang/libllvmarmdesc (installincludes) =3D=3D=3D> lib/clang/libllvmarmdisassembler (installincludes) =3D=3D=3D> lib/clang/libllvmarminfo (installincludes) =3D=3D=3D> lib/clang/libllvmarminstprinter (installincludes) =3D=3D=3D> lib/clang/libllvmmipsasmparser (installincludes) =3D=3D=3D> lib/clang/libllvmmipscodegen (installincludes) =3D=3D=3D> lib/clang/libllvmmipsdesc (installincludes) =3D=3D=3D> lib/clang/libllvmmipsdisassembler (installincludes) =3D=3D=3D> lib/clang/libllvmmipsinfo (installincludes) =3D=3D=3D> lib/clang/libllvmmipsinstprinter (installincludes) =3D=3D=3D> lib/clang/libllvmpowerpcasmparser (installincludes) =3D=3D=3D> lib/clang/libllvmpowerpccodegen (installincludes) =3D=3D=3D> lib/clang/libllvmpowerpcdesc (installincludes) =3D=3D=3D> lib/clang/libllvmpowerpcinfo (installincludes) =3D=3D=3D> lib/clang/libllvmpowerpcinstprinter (installincludes) =3D=3D=3D> lib/clang/libllvmsparcasmparser (installincludes) =3D=3D=3D> lib/clang/libllvmsparccodegen (installincludes) =3D=3D=3D> lib/clang/libllvmsparcdesc (installincludes) =3D=3D=3D> lib/clang/libllvmsparcdisassembler (installincludes) =3D=3D=3D> lib/clang/libllvmsparcinfo (installincludes) =3D=3D=3D> lib/clang/libllvmsparcinstprinter (installincludes) =3D=3D=3D> lib/clang/libllvmx86asmparser (installincludes) =3D=3D=3D> lib/clang/libllvmx86codegen (installincludes) =3D=3D=3D> lib/clang/libllvmx86desc (installincludes) =3D=3D=3D> lib/clang/libllvmx86disassembler (installincludes) =3D=3D=3D> lib/clang/libllvmx86info (installincludes) =3D=3D=3D> lib/clang/libllvmx86instprinter (installincludes) =3D=3D=3D> lib/clang/libllvmx86utils (installincludes) =3D=3D=3D> lib/clang/include (installincludes) --- _INCSINS --- sh /builds/FreeBSD_stable_10/tools/install.sh -C -o root -g wheel -m 444 /= builds/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tools/clan= g/lib/Headers/__wmmintrin_aes.h /builds/FreeBSD_stable_10/lib/clang/include= /../../../contrib/llvm/tools/clang/lib/Headers/__wmmintrin_pclmul.h /builds= /FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tools/clang/lib/= Headers/altivec.h /builds/FreeBSD_stable_10/lib/clang/include/../../../cont= rib/llvm/tools/clang/lib/Headers/ammintrin.h /builds/FreeBSD_stable_10/lib/= clang/include/../../../contrib/llvm/tools/clang/lib/Headers/avx2intrin.h /b= uilds/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tools/clang= /lib/Headers/avxintrin.h /builds/FreeBSD_stable_10/lib/clang/include/../../= ../contrib/llvm/tools/clang/lib/Headers/bmi2intrin.h /builds/FreeBSD_stable= _10/lib/clang/include/../../../contrib/llvm/tools/clang/lib/Headers/bmiintr= in.h /builds/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tool= s/clang/lib/Headers/cpuid.h /builds/FreeBSD_stable_10/lib/clang/include/../= ../../contrib/llvm/tools/clang/lib/Headers/emmintrin.h /builds/FreeBSD_stab= le_10/lib/clang/include/../../../contrib/llvm/tools/clang/lib/Headers/f16ci= ntrin.h /builds/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/t= ools/clang/lib/Headers/fma4intrin.h /builds/FreeBSD_stable_10/lib/clang/inc= lude/../../../contrib/llvm/tools/clang/lib/Headers/fmaintrin.h /builds/Free= BSD_stable_10/lib/clang/include/../../../contrib/llvm/tools/clang/lib/Heade= rs/immintrin.h /builds/FreeBSD_stable_10/lib/clang/include/../../../contrib= /llvm/tools/clang/lib/Headers/lzcntintrin.h /builds/FreeBSD_stable_10/lib/c= lang/include/../../../contrib/llvm/tools/clang/lib/Headers/mm3dnow.h /build= s/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tools/clang/lib= /Headers/mm_malloc.h /builds/FreeBSD_stable_10/lib/clang/include/../../../c= ontrib/llvm/tools/clang/lib/Headers/mmintrin.h /builds/FreeBSD_stable_10/li= b/clang/include/../../../contrib/llvm/tools/clang/lib/Headers/module.map /b= uilds/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tools/clang= /lib/Headers/nmmintrin.h /builds/FreeBSD_stable_10/lib/clang/include/../../= ../contrib/llvm/tools/clang/lib/Headers/pmmintrin.h /builds/FreeBSD_stable_= 10/lib/clang/include/../../../contrib/llvm/tools/clang/lib/Headers/popcntin= trin.h /builds/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/to= ols/clang/lib/Headers/prfchwintrin.h /builds/FreeBSD_stable_10/lib/clang/in= clude/../../../contrib/llvm/tools/clang/lib/Headers/rdseedintrin.h /builds/= FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tools/clang/lib/H= eaders/rtmintrin.h /builds/FreeBSD_stable_10/lib/clang/include/../../../con= trib/llvm/tools/clang/lib/Headers/shaintrin.h /builds/FreeBSD_stable_10/lib= /clang/include/../../../contrib/llvm/tools/clang/lib/Headers/smmintrin.h /b= uilds/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tools/clang= /lib/Headers/tbmintrin.h /builds/FreeBSD_stable_10/lib/clang/include/../../= ../contrib/llvm/tools/clang/lib/Headers/tmmintrin.h /builds/FreeBSD_stable_= 10/lib/clang/include/../../../contrib/llvm/tools/clang/lib/Headers/wmmintri= n.h /builds/FreeBSD_stable_10/lib/clang/include/../../../contrib/llvm/tools= /clang/lib/Headers/x86intrin.h /builds/FreeBSD_stable_10/lib/clang/include/= ../../../contrib/llvm/tools/clang/lib/Headers/xmmintrin.h /builds/FreeBSD_s= table_10/lib/clang/include/../../../contrib/llvm/tools/clang/lib/Headers/xo= pintrin.h arm_neon.h /builds/FreeBSD_stable_10/obj/builds/FreeBSD_stable_10= /tmp/usr/include/clang/3.4.1 =3D=3D=3D> lib/tests (installincludes) Slave went offline during the build ERROR: Connection was broken: java.io.IOException: Unexpected termination o= f the channel =09at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(Synchron= ousCommandTransport.java:50) Caused by: java.io.EOFException =09at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream= .java:2328) =09at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputS= tream.java:2797) =09at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:802= ) =09at java.io.ObjectInputStream.(ObjectInputStream.java:299) =09at hudson.remoting.ObjectInputStreamEx.(ObjectInputStreamEx.java:4= 0) =09at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(Abs= tractSynchronousByteArrayCommandTransport.java:34) =09at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(Synchron= ousCommandTransport.java:48) Build step 'Execute shell' marked build as failure [WARNINGS] Skipping publisher since build result is FAILURE Email was triggered for: Failure - Any Sending email for trigger: Failure - Any From owner-freebsd-stable@freebsd.org Sat Oct 10 09:07:50 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1492AA0F312 for ; Sat, 10 Oct 2015 09:07:50 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 06519FBB; Sat, 10 Oct 2015 09:07:50 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id 706C073D; Sat, 10 Oct 2015 09:07:46 +0000 (UTC) Date: Sat, 10 Oct 2015 09:07:34 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: kib@FreeBSD.org, jenkins-admin@FreeBSD.org, freebsd-stable@FreeBSD.org Message-ID: <2019510296.289.1444468065686.JavaMail.jenkins@jenkins-9.freebsd.org> In-Reply-To: <1737373977.285.1444451446017.JavaMail.jenkins@jenkins-9.freebsd.org> References: <1737373977.285.1444451446017.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: FreeBSD_stable_10 - Build #1753 - Fixed MIME-Version: 1.0 X-Jenkins-Job: FreeBSD_stable_10 X-Jenkins-Result: SUCCESS Precedence: bulk Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Oct 2015 09:07:50 -0000 FreeBSD_stable_10 - Build #1753 - Fixed: Build information: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1753/ Full change log: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1753/changes Full build log: https://jenkins.FreeBSD.org/job/FreeBSD_stable_10/1753/console Change summaries: 289107 by kib: MFC r288258: Make the __bitcount*() functions unconditionally available. From owner-freebsd-stable@freebsd.org Sat Oct 10 13:01:11 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 769EDA108D0 for ; Sat, 10 Oct 2015 13:01:11 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id D5439CA1; Sat, 10 Oct 2015 13:01:10 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) IronPort-PHdr: 9a23:h/oaEBLAcsvXkP2In9mcpTZWNBhigK39O0sv0rFitYgULf/xwZ3uMQTl6Ol3ixeRBMOAu64C1Lud7/+ocFdDyKjCmUhKSIZLWR4BhJdetC0bK+nBN3fGKuX3ZTcxBsVIWQwt1Xi6NU9IBJS2PAWK8TWM5DIfUi/yKRBybrysXNWC04LohqvupNX6WEZhunmUWftKNhK4rAHc5IE9oLBJDeIP8CbPuWZCYO9MxGlldhq5lhf44dqsrtY4q3wD89pozcNLUL37cqIkVvQYSW1+ayFmrPHs4DLDVwqU+noVVC01iBNUEQXfpEXxXb/6sTD9uPY71CTMbuPsSrVhYzWp7O9OQRTrjCoCf2oj9Wjcich9iYpGpx28qhhnw8jfadfGZ7JFYqrBcIZCFiJ6VcFLWnkEW9vkYg== X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AYAgCfCxlW/61jaINeg3puBr1jAQ2BWhcKgnKCCjVKAoFYFAEBAQEBAQEBgQmCH4IHAQEBAwEBAQEgBCcgCw4CAgEIDgoCAg0FARMCAhsMAQkmAgQIBwQBHASIBQgNr16UAQEBAQEBAQEDAQEBAQEBAQEaBIEehVGEfoQqEAIBHAEzBxMBglWBRQWHOYcFhxVAhRmFGSOeRgIfAQFChB4iMweGHAcXI4EGAQEB X-IronPort-AV: E=Sophos;i="5.17,663,1437451200"; d="scan'208";a="243803344" Received: from nipigon.cs.uoguelph.ca (HELO zcs1.mail.uoguelph.ca) ([131.104.99.173]) by esa-annu.net.uoguelph.ca with ESMTP; 10 Oct 2015 09:00:39 -0400 Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id A95D215F55D; Sat, 10 Oct 2015 09:00:39 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id ZO7cE7Q77ryy; Sat, 10 Oct 2015 09:00:38 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 83D2715F565; Sat, 10 Oct 2015 09:00:38 -0400 (EDT) X-Virus-Scanned: amavisd-new at zcs1.mail.uoguelph.ca Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id 5GyN_pwzeeVO; Sat, 10 Oct 2015 09:00:38 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca (zcs1.mail.uoguelph.ca [172.17.95.18]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 6277715F55D; Sat, 10 Oct 2015 09:00:38 -0400 (EDT) Date: Sat, 10 Oct 2015 09:00:38 -0400 (EDT) From: Rick Macklem To: Christian Kratzer Cc: John Baldwin , freebsd-stable@freebsd.org Message-ID: <1727351276.30946695.1444482038191.JavaMail.zimbra@uoguelph.ca> In-Reply-To: References: <2148690.gx9M0ZzrG1@ralph.baldwin.cx> <3563189.eDHDcCgW5L@ralph.baldwin.cx> Subject: Re: smbfs crashes since approx. 10.1-RELEASE MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [172.17.95.11] X-Mailer: Zimbra 8.0.9_GA_6191 (ZimbraWebClient - FF34 (Win)/8.0.9_GA_6191) Thread-Topic: smbfs crashes since approx. 10.1-RELEASE Thread-Index: 03t6XopBcaj09yipE+xewm4PdaykLA== X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Oct 2015 13:01:11 -0000 Christian Kratzer wrote: > Hi John, > > the box crashed again running a 10-stable kernel with following patch of > yours: > > On Wed, 7 Oct 2015, John Baldwin wrote: > > Index: smb_iod.c > > =================================================================== > > --- smb_iod.c (revision 288952) > > +++ smb_iod.c (working copy) > > @@ -624,6 +624,13 @@ > > SMB_IOD_EVUNLOCK(iod); > > } else > > free(evp, M_SMBIOD); > > + if (iod->iod_flags & SMBIOD_SHUTDOWN) { > > + if (!STAILQ_EMPTY(&iod->iod_evlist)) > > + printf("%s: shutdown with pending > > events\n", > > + __func__); > > + } > > + return; > > + } > > } > > #if 0 > > if (iod->iod_state == SMBIOD_ST_VCACTIVE) { > > Ok, I think John has found the race. As soon as smb_iod_main() does the wakeup() just before the patch (line#623), smb_iod_destroy() can go ahead and destroy the mtuexes. I think the above patch failed because the smb_iod_sendall(iod) and smb_iod_recvall(iod) need to be done before smb_iod_main() returns. I'll email a patch for testing later to-day (I've gotta run and do something else now), rick > > here is what I got on the kvm console: > > login: panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955^M > cpuid = 1^M > KDB: stack backtrace:^M > #0 0xffffffff80975bb0 at kdb_backtrace+0x60^M > #1 0xffffffff8093baa6 at vpanic+0x126^M > #2 0xffffffff8093b979 at kassert_panic+0x139^M > #3 0xffffffff80921c47 at _mtx_destroy+0x77^M > #4 0xffffffff81a1c114 at smb_iod_destroy+0xc4^M > #5 0xffffffff81a12eea at smb_vc_free+0x1a^M > #6 0xffffffff81a13e24 at sdp_trydestroy+0xb4^M > #7 0xffffffff81a1cb36 at smbfs_unmount+0xd6^M > #8 0xffffffff809d9e84 at dounmount+0x524^M > #9 0xffffffff809d9936 at sys_unmount+0x3c6^M > #10 0xffffffff80d42235 at amd64_syscall+0x265^M > #11 0xffffffff80d25cfb at Xfast_syscall+0xfb^M > Uptime: 19h48m28s^M > Dumping 179 out of 999 > MB:..9%..18%..27%..36%..45%..54%..63%..72%..81%..98%^M > Dump complete^M > Automatic reboot in 15 seconds - press a key on the console to abort^M > > heres the crashinfo: > > panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955 > > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you > are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for > details. > This GDB was configured as "amd64-marcel-freebsd"... > > Unread portion of the kernel message buffer: > panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955 > cpuid = 1 > KDB: stack backtrace: > #0 0xffffffff80975bb0 at kdb_backtrace+0x60 > #1 0xffffffff8093baa6 at vpanic+0x126 > #2 0xffffffff8093b979 at kassert_panic+0x139 > #3 0xffffffff80921c47 at _mtx_destroy+0x77 > #4 0xffffffff81a1c114 at smb_iod_destroy+0xc4 > #5 0xffffffff81a12eea at smb_vc_free+0x1a > #6 0xffffffff81a13e24 at sdp_trydestroy+0xb4 > #7 0xffffffff81a1cb36 at smbfs_unmount+0xd6 > #8 0xffffffff809d9e84 at dounmount+0x524 > #9 0xffffffff809d9936 at sys_unmount+0x3c6 > #10 0xffffffff80d42235 at amd64_syscall+0x265 > #11 0xffffffff80d25cfb at Xfast_syscall+0xfb > Uptime: 19h48m28s > Dumping 179 out of 999 > MB:..9%..18%..27%..36%..45%..54%..63%..72%..81%..98% > > Reading symbols from /boot/kernel/smbfs.ko.symbols...done. > Loaded symbols for /boot/kernel/smbfs.ko.symbols > Reading symbols from /boot/kernel/libiconv.ko.symbols...done. > Loaded symbols for /boot/kernel/libiconv.ko.symbols > Reading symbols from /boot/kernel/libmchain.ko.symbols...done. > Loaded symbols for /boot/kernel/libmchain.ko.symbols > #0 doadump (textdump=) at pcpu.h:219 > 219 pcpu.h: No such file or directory. > in pcpu.h > (kgdb) #0 doadump (textdump=) at pcpu.h:219 > #1 0xffffffff8093b5f2 in kern_reboot (howto=260) > at /usr/src/sys/kern/kern_shutdown.c:451 > #2 0xffffffff8093bae5 in vpanic (fmt=, > ap=) at /usr/src/sys/kern/kern_shutdown.c:758 > #3 0xffffffff8093b979 in kassert_panic (fmt=) > at /usr/src/sys/kern/kern_shutdown.c:646 > #4 0xffffffff80921c47 in _mtx_destroy (c=0xfffff80009284690) > at /usr/src/sys/kern/kern_mutex.c:955 > #5 0xffffffff81a1c114 in smb_iod_destroy (iod=0xfffff80009284600) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_iod.c:706 > #6 0xffffffff81a12eea in smb_vc_free (cp=0xfffff8003a602a00) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_conn.c:499 > #7 0xffffffff81a13e24 in sdp_trydestroy (sdp=0xfffff8000a7cbc80) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_dev.c:166 > #8 0xffffffff81a1cb36 in smbfs_unmount (mp=0xfffff80039f88330, > mntflags=) > at /usr/src/sys/modules/smbfs/../../fs/smbfs/smbfs_vfsops.c:297 > #9 0xffffffff809d9e84 in dounmount (mp=0xfffff80039f88330, > flags=134217728, > td=0xfffff8000f2b0000) at /usr/src/sys/kern/vfs_mount.c:1313 > #10 0xffffffff809d9936 in sys_unmount (td=0xfffff8000f2b0000, > uap=0xfffffe003d67fb80) at /usr/src/sys/kern/vfs_mount.c:1205 > #11 0xffffffff80d42235 in amd64_syscall (td=0xfffff8000f2b0000, > traced=0) > at subr_syscall.c:134 > #12 0xffffffff80d25cfb in Xfast_syscall () > at /usr/src/sys/amd64/amd64/exception.S:396 > #13 0x000000080089190a in ?? () > Previous frame inner to this frame (corrupt stack?) > Current language: auto; currently minimal > (kgdb) > > > I have kgdb710 from ports setup in case you need me to check something. > > Greetings > Christian > > -- > Christian Kratzer CK Software GmbH > Email: ck@cksoft.de Wildberger Weg 24/2 > Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden > Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart > Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer > Web: http://www.cksoft.de/ > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Sat Oct 10 22:30:04 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 189C89D34A1 for ; Sat, 10 Oct 2015 22:30:04 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-jnhn.mail.uoguelph.ca (esa-jnhn.mail.uoguelph.ca [131.104.91.44]) by mx1.freebsd.org (Postfix) with ESMTP id 9F0411C45; Sat, 10 Oct 2015 22:30:03 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) IronPort-PHdr: 9a23:948vhRSTI6W+wrj2q/Yb019hi9psv+yvbD5Q0YIujvd0So/mwa64YxGN2/xhgRfzUJnB7Loc0qyN4/ymBj1LuMna+Fk5M7VyFDY9wf0MmAIhBMPXQWbaF9XNKxIAIcJZSVV+9Gu6O0UGUOz3ZlnVv2HgpWVKQka3CwN5K6zPF5LIiIzvjqbpq8GVPFQD3WXmKZpJbzyI7izp/vEMhoVjLqtjgjDomVBvP9ps+GVzOFiIlAz97MrjtLRq8iBXpu5zv5UYCfayV+0CQLdZFDUrNXwurI2u7EGbDFjH2nxJeWUMkwFUAgHDpDLgV4vjvzGy4uF+8CKZJsr4UfY4VGLxwb1sTUrSiSwEfxsw+2LTh8k42LheqRmioxF665PTb5yYMOJ+OKjUK4BJDVFdV9pcAnQSSri3aJECWq9YZb5V X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2A0AwBXkBlW/61jaINeg3puBr1jDoFaFwqCcoIKNUoCgVgUAQEBAQEBAQGBCYIfggcBAQEEAQEBIAQnIAsMAgICAQgOChEFARMCAgIZDAEJJgIECAcEARwEiA0Nr2KTXAEBAQEBAQEBAQEBAQEBAQEBAQEZBIZvhH6EKhACARsBGRsHEwGCVYFFBYc5hwWHFUCCToJLhRkjnkYCHwFDhB4iMweGHAcXI4EGAQEB X-IronPort-AV: E=Sophos;i="5.17,664,1437451200"; d="scan'208";a="241903268" Received: from nipigon.cs.uoguelph.ca (HELO zcs1.mail.uoguelph.ca) ([131.104.99.173]) by esa-jnhn.mail.uoguelph.ca with ESMTP; 10 Oct 2015 18:28:54 -0400 Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 0481B15F55D; Sat, 10 Oct 2015 18:28:55 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id mXPMc4swIqJP; Sat, 10 Oct 2015 18:28:53 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id D8F2D15F565; Sat, 10 Oct 2015 18:28:53 -0400 (EDT) X-Virus-Scanned: amavisd-new at zcs1.mail.uoguelph.ca Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id qv9OmwQEVUZ6; Sat, 10 Oct 2015 18:28:53 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca (zcs1.mail.uoguelph.ca [172.17.95.18]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 9CCAD15F55D; Sat, 10 Oct 2015 18:28:53 -0400 (EDT) Date: Sat, 10 Oct 2015 18:28:53 -0400 (EDT) From: Rick Macklem To: Christian Kratzer Cc: John Baldwin , freebsd-stable@freebsd.org Message-ID: <690801562.31292960.1444516133472.JavaMail.zimbra@uoguelph.ca> In-Reply-To: References: <2148690.gx9M0ZzrG1@ralph.baldwin.cx> <3563189.eDHDcCgW5L@ralph.baldwin.cx> Subject: Re: smbfs crashes since approx. 10.1-RELEASE MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_31292958_1714276920.1444516133470" X-Originating-IP: [172.17.95.12] X-Mailer: Zimbra 8.0.9_GA_6191 (ZimbraWebClient - FF34 (Win)/8.0.9_GA_6191) Thread-Topic: smbfs crashes since approx. 10.1-RELEASE Thread-Index: w6qT4R+Lj5vIOXrtw5ATCVMAsSmSTQ== X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Oct 2015 22:30:04 -0000 ------=_Part_31292958_1714276920.1444516133470 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi, Maybe you could try the attached patch instead of the one below? (Completely untested. I haven't even tried to compile it.) rick ----- Original Message ----- > Hi John, > > the box crashed again running a 10-stable kernel with following patch of > yours: > > On Wed, 7 Oct 2015, John Baldwin wrote: > > Index: smb_iod.c > > =================================================================== > > --- smb_iod.c (revision 288952) > > +++ smb_iod.c (working copy) > > @@ -624,6 +624,13 @@ > > SMB_IOD_EVUNLOCK(iod); > > } else > > free(evp, M_SMBIOD); > > + if (iod->iod_flags & SMBIOD_SHUTDOWN) { > > + if (!STAILQ_EMPTY(&iod->iod_evlist)) > > + printf("%s: shutdown with pending > > events\n", > > + __func__); > > + } > > + return; > > + } > > } > > #if 0 > > if (iod->iod_state == SMBIOD_ST_VCACTIVE) { > > > > here is what I got on the kvm console: > > login: panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955^M > cpuid = 1^M > KDB: stack backtrace:^M > #0 0xffffffff80975bb0 at kdb_backtrace+0x60^M > #1 0xffffffff8093baa6 at vpanic+0x126^M > #2 0xffffffff8093b979 at kassert_panic+0x139^M > #3 0xffffffff80921c47 at _mtx_destroy+0x77^M > #4 0xffffffff81a1c114 at smb_iod_destroy+0xc4^M > #5 0xffffffff81a12eea at smb_vc_free+0x1a^M > #6 0xffffffff81a13e24 at sdp_trydestroy+0xb4^M > #7 0xffffffff81a1cb36 at smbfs_unmount+0xd6^M > #8 0xffffffff809d9e84 at dounmount+0x524^M > #9 0xffffffff809d9936 at sys_unmount+0x3c6^M > #10 0xffffffff80d42235 at amd64_syscall+0x265^M > #11 0xffffffff80d25cfb at Xfast_syscall+0xfb^M > Uptime: 19h48m28s^M > Dumping 179 out of 999 > MB:..9%..18%..27%..36%..45%..54%..63%..72%..81%..98%^M > Dump complete^M > Automatic reboot in 15 seconds - press a key on the console to abort^M > > heres the crashinfo: > > panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955 > > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you > are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for > details. > This GDB was configured as "amd64-marcel-freebsd"... > > Unread portion of the kernel message buffer: > panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955 > cpuid = 1 > KDB: stack backtrace: > #0 0xffffffff80975bb0 at kdb_backtrace+0x60 > #1 0xffffffff8093baa6 at vpanic+0x126 > #2 0xffffffff8093b979 at kassert_panic+0x139 > #3 0xffffffff80921c47 at _mtx_destroy+0x77 > #4 0xffffffff81a1c114 at smb_iod_destroy+0xc4 > #5 0xffffffff81a12eea at smb_vc_free+0x1a > #6 0xffffffff81a13e24 at sdp_trydestroy+0xb4 > #7 0xffffffff81a1cb36 at smbfs_unmount+0xd6 > #8 0xffffffff809d9e84 at dounmount+0x524 > #9 0xffffffff809d9936 at sys_unmount+0x3c6 > #10 0xffffffff80d42235 at amd64_syscall+0x265 > #11 0xffffffff80d25cfb at Xfast_syscall+0xfb > Uptime: 19h48m28s > Dumping 179 out of 999 > MB:..9%..18%..27%..36%..45%..54%..63%..72%..81%..98% > > Reading symbols from /boot/kernel/smbfs.ko.symbols...done. > Loaded symbols for /boot/kernel/smbfs.ko.symbols > Reading symbols from /boot/kernel/libiconv.ko.symbols...done. > Loaded symbols for /boot/kernel/libiconv.ko.symbols > Reading symbols from /boot/kernel/libmchain.ko.symbols...done. > Loaded symbols for /boot/kernel/libmchain.ko.symbols > #0 doadump (textdump=) at pcpu.h:219 > 219 pcpu.h: No such file or directory. > in pcpu.h > (kgdb) #0 doadump (textdump=) at pcpu.h:219 > #1 0xffffffff8093b5f2 in kern_reboot (howto=260) > at /usr/src/sys/kern/kern_shutdown.c:451 > #2 0xffffffff8093bae5 in vpanic (fmt=, > ap=) at /usr/src/sys/kern/kern_shutdown.c:758 > #3 0xffffffff8093b979 in kassert_panic (fmt=) > at /usr/src/sys/kern/kern_shutdown.c:646 > #4 0xffffffff80921c47 in _mtx_destroy (c=0xfffff80009284690) > at /usr/src/sys/kern/kern_mutex.c:955 > #5 0xffffffff81a1c114 in smb_iod_destroy (iod=0xfffff80009284600) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_iod.c:706 > #6 0xffffffff81a12eea in smb_vc_free (cp=0xfffff8003a602a00) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_conn.c:499 > #7 0xffffffff81a13e24 in sdp_trydestroy (sdp=0xfffff8000a7cbc80) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_dev.c:166 > #8 0xffffffff81a1cb36 in smbfs_unmount (mp=0xfffff80039f88330, > mntflags=) > at /usr/src/sys/modules/smbfs/../../fs/smbfs/smbfs_vfsops.c:297 > #9 0xffffffff809d9e84 in dounmount (mp=0xfffff80039f88330, > flags=134217728, > td=0xfffff8000f2b0000) at /usr/src/sys/kern/vfs_mount.c:1313 > #10 0xffffffff809d9936 in sys_unmount (td=0xfffff8000f2b0000, > uap=0xfffffe003d67fb80) at /usr/src/sys/kern/vfs_mount.c:1205 > #11 0xffffffff80d42235 in amd64_syscall (td=0xfffff8000f2b0000, > traced=0) > at subr_syscall.c:134 > #12 0xffffffff80d25cfb in Xfast_syscall () > at /usr/src/sys/amd64/amd64/exception.S:396 > #13 0x000000080089190a in ?? () > Previous frame inner to this frame (corrupt stack?) > Current language: auto; currently minimal > (kgdb) > > > I have kgdb710 from ports setup in case you need me to check something. > > Greetings > Christian > > -- > Christian Kratzer CK Software GmbH > Email: ck@cksoft.de Wildberger Weg 24/2 > Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden > Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart > Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer > Web: http://www.cksoft.de/ > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > ------=_Part_31292958_1714276920.1444516133470 Content-Type: text/x-patch; name=smbiod.patch Content-Disposition: attachment; filename=smbiod.patch Content-Transfer-Encoding: base64 LS0tIHNtYl9pb2QuYy5zYXYJMjAxNS0xMC0xMCAwODo0Mzo0NS4wMDAwMDAwMDAgLTA0MDAKKysr IHNtYl9pb2QuYwkyMDE1LTEwLTEwIDE4OjE0OjExLjAwMDAwMDAwMCAtMDQwMApAQCAtNjE5LDcg KzYxOSwzNCBAQCBzbWJfaW9kX21haW4oc3RydWN0IHNtYmlvZCAqaW9kKQogCQkJYnJlYWs7CiAJ CX0KIAkJaWYgKGV2cC0+ZXZfdHlwZSAmIFNNQklPRF9FVl9TWU5DKSB7CisJCQlpZiAoZXZwLT5l dl90eXBlICYgU01CSU9EX0VWX1NIVVRET1dOKSB7CisJCQkJc21iX2lvZF9zZW5kYWxsKGlvZCk7 CisJCQkJc21iX2lvZF9yZWN2YWxsKGlvZCk7CisJCQl9CiAJCQlTTUJfSU9EX0VWTE9DSyhpb2Qp OworCQkJaWYgKChldnAtPmV2X3R5cGUgJiBTTUJJT0RfRVZfU0hVVERPV04pICE9IDAgJiYKKwkJ CSAgICAgIVNUQUlMUV9FTVBUWSgmaW9kLT5pb2RfZXZsaXN0KSkgeworCQkJCS8qCisJCQkJICog SWYgdGhpcyBwcmludGYgb2NjdXJzLCB0aGUgY29kZSBoZXJlIHNob3VsZAorCQkJCSAqIGJlIG1v ZGlmaWVkIHRvIGEgbG9vcCBmcmVlKClpbmcgYWxsIHRoZQorCQkJCSAqIGVudHJpZXMgc3RpbGwg aW4gdGhlIFNUQUlMUS4KKwkJCQkgKi8KKwkJCQlwcmludGYoIiVzOiBzaHV0ZG93biB3aXRoIHBl bmRpbmcgZXZlbnRzXG4iLAorCQkJCSAgICBfX2Z1bmNfXyk7CisJCQl9CisJCQlpZiAoZXZwLT5l dl90eXBlICYgU01CSU9EX0VWX1NIVVRET1dOKSB7CisJCQkJLyoKKwkJCQkgKiBGb3IgdGhlIFNN QklPRF9FVl9TSFVURE9XTiBjYXNlLCBldmVyeXRoaW5nCisJCQkJICogZWxzZSBzaG91bGQgYmUg cGVyZm9ybWVkIGJlZm9yZSB0aGlzIHBvaW50LAorCQkJCSAqIHNpbmNlIHNtYl9pb2RfZGVzdHJv eSgpIGlzIGFibGUgdG8gcHJvY2VlZCB0bworCQkJCSAqIGRlc3Ryb3kgdGhlIG11dGV4ZXMgYW5k IHRoZSAqZXZwIHN0cnVjdHVyZQorCQkJCSAqIG9uY2UgdGhlIHdha2V1cCgpL1NNQl9JT0RfRVZV TkxPQ0soKSBpcworCQkJCSAqIHBlcmZvcm1lZC4KKwkJCQkgKi8KKwkJCQl3YWtldXAoZXZwKTsK KwkJCQlTTUJfSU9EX0VWVU5MT0NLKGlvZCk7CisJCQkJcmV0dXJuOworCQkJfQogCQkJd2FrZXVw KGV2cCk7CiAJCQlTTUJfSU9EX0VWVU5MT0NLKGlvZCk7CiAJCX0gZWxzZQo= ------=_Part_31292958_1714276920.1444516133470-- From owner-freebsd-stable@freebsd.org Sat Oct 10 23:06:10 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E0DFA9D3ABF for ; Sat, 10 Oct 2015 23:06:10 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from esa-annu.net.uoguelph.ca (esa-annu.mail.uoguelph.ca [131.104.91.36]) by mx1.freebsd.org (Postfix) with ESMTP id 6C7D91078; Sat, 10 Oct 2015 23:06:09 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) IronPort-PHdr: 9a23:n4j1QxFYUeNhSKf1/0/xlJ1GYnF86YWxBRYc798ds5kLTJ75oMmwAkXT6L1XgUPTWs2DsrQf27aQ7PGrADxaqb+681k8M7V0HycfjssXmwFySOWkMmbcaMDQUiohAc5ZX0Vk9XzoeWJcGcL5ekGA6ibqtW1aJBzzOEJPK/jvHcaK1oLsh7z0pMyYOlUSzBOGIppMbzyO5T3LsccXhYYwYo0Q8TDu5kVyRuJN2GlzLkiSlRuvru25/Zpk7jgC86l5r50IeezAcq85Vb1VCig9eyBwvZWz9EqLcQzazXsGU34KkxNOSyvf5Q3oU4255iD5nuF+wy6UIYv6QOZndy6l6vJRSRTrwAIOPD09/WSf3tZ1halYpB+kjwF4zJPZZJmVcvF3KPCONegGTHZMC54CHxdKBZmxOs5WV7IM X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: A2AZBADMmBlW/61jaINeg3puBr1jDoFaFwqCcoIKNUoCgVgUAQEBAQEBAQGBCYIfggcBAQEEAQEBIAQnIAsMAgICAQgOChEFARMCAgIZDAEJJgIECAcEARwEiA0Nr1mTVAEBAQEBAQEBAQEBAQEBAQEBAQEZBIZvhH6EKhACARsBGRsHEwGCVYFFBYc5hwWHFUCCToJLhRkjhB2EOpVvAh8BQ4QeIjMHhhwHFyOBBgEBAQ X-IronPort-AV: E=Sophos;i="5.17,664,1437451200"; d="scan'208";a="243853833" Received: from nipigon.cs.uoguelph.ca (HELO zcs1.mail.uoguelph.ca) ([131.104.99.173]) by esa-annu.net.uoguelph.ca with ESMTP; 10 Oct 2015 19:06:08 -0400 Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 6631515F55D; Sat, 10 Oct 2015 19:06:08 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id ILhuYZMgDP9E; Sat, 10 Oct 2015 19:06:07 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 38DE715F565; Sat, 10 Oct 2015 19:06:07 -0400 (EDT) X-Virus-Scanned: amavisd-new at zcs1.mail.uoguelph.ca Received: from zcs1.mail.uoguelph.ca ([127.0.0.1]) by localhost (zcs1.mail.uoguelph.ca [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id IGlg2QpszD6q; Sat, 10 Oct 2015 19:06:07 -0400 (EDT) Received: from zcs1.mail.uoguelph.ca (zcs1.mail.uoguelph.ca [172.17.95.18]) by zcs1.mail.uoguelph.ca (Postfix) with ESMTP id 11FC215F55D; Sat, 10 Oct 2015 19:06:07 -0400 (EDT) Date: Sat, 10 Oct 2015 19:06:07 -0400 (EDT) From: Rick Macklem To: Christian Kratzer Cc: John Baldwin , freebsd-stable@freebsd.org Message-ID: <358885214.31305796.1444518367048.JavaMail.zimbra@uoguelph.ca> In-Reply-To: References: <2148690.gx9M0ZzrG1@ralph.baldwin.cx> <3563189.eDHDcCgW5L@ralph.baldwin.cx> Subject: Re: smbfs crashes since approx. 10.1-RELEASE MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_31305794_187348850.1444518367047" X-Originating-IP: [172.17.95.11] X-Mailer: Zimbra 8.0.9_GA_6191 (ZimbraWebClient - FF34 (Win)/8.0.9_GA_6191) Thread-Topic: smbfs crashes since approx. 10.1-RELEASE Thread-Index: E17LEg2StfZ66fwYBxYaIwpMzHpZQA== X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Oct 2015 23:06:11 -0000 ------=_Part_31305794_187348850.1444518367047 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Hi again, Attached is a semantically equivalent patch to the one I posted a few minutes ago, but I think this one is more readable. Please let me know if you get it tested, rick ----- Original Message ----- > Hi John, > > the box crashed again running a 10-stable kernel with following patch of > yours: > > On Wed, 7 Oct 2015, John Baldwin wrote: > > Index: smb_iod.c > > =================================================================== > > --- smb_iod.c (revision 288952) > > +++ smb_iod.c (working copy) > > @@ -624,6 +624,13 @@ > > SMB_IOD_EVUNLOCK(iod); > > } else > > free(evp, M_SMBIOD); > > + if (iod->iod_flags & SMBIOD_SHUTDOWN) { > > + if (!STAILQ_EMPTY(&iod->iod_evlist)) > > + printf("%s: shutdown with pending > > events\n", > > + __func__); > > + } > > + return; > > + } > > } > > #if 0 > > if (iod->iod_state == SMBIOD_ST_VCACTIVE) { > > > > here is what I got on the kvm console: > > login: panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955^M > cpuid = 1^M > KDB: stack backtrace:^M > #0 0xffffffff80975bb0 at kdb_backtrace+0x60^M > #1 0xffffffff8093baa6 at vpanic+0x126^M > #2 0xffffffff8093b979 at kassert_panic+0x139^M > #3 0xffffffff80921c47 at _mtx_destroy+0x77^M > #4 0xffffffff81a1c114 at smb_iod_destroy+0xc4^M > #5 0xffffffff81a12eea at smb_vc_free+0x1a^M > #6 0xffffffff81a13e24 at sdp_trydestroy+0xb4^M > #7 0xffffffff81a1cb36 at smbfs_unmount+0xd6^M > #8 0xffffffff809d9e84 at dounmount+0x524^M > #9 0xffffffff809d9936 at sys_unmount+0x3c6^M > #10 0xffffffff80d42235 at amd64_syscall+0x265^M > #11 0xffffffff80d25cfb at Xfast_syscall+0xfb^M > Uptime: 19h48m28s^M > Dumping 179 out of 999 > MB:..9%..18%..27%..36%..45%..54%..63%..72%..81%..98%^M > Dump complete^M > Automatic reboot in 15 seconds - press a key on the console to abort^M > > heres the crashinfo: > > panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955 > > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you > are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for > details. > This GDB was configured as "amd64-marcel-freebsd"... > > Unread portion of the kernel message buffer: > panic: Assertion mtx_unowned(m) failed at > /usr/src/sys/kern/kern_mutex.c:955 > cpuid = 1 > KDB: stack backtrace: > #0 0xffffffff80975bb0 at kdb_backtrace+0x60 > #1 0xffffffff8093baa6 at vpanic+0x126 > #2 0xffffffff8093b979 at kassert_panic+0x139 > #3 0xffffffff80921c47 at _mtx_destroy+0x77 > #4 0xffffffff81a1c114 at smb_iod_destroy+0xc4 > #5 0xffffffff81a12eea at smb_vc_free+0x1a > #6 0xffffffff81a13e24 at sdp_trydestroy+0xb4 > #7 0xffffffff81a1cb36 at smbfs_unmount+0xd6 > #8 0xffffffff809d9e84 at dounmount+0x524 > #9 0xffffffff809d9936 at sys_unmount+0x3c6 > #10 0xffffffff80d42235 at amd64_syscall+0x265 > #11 0xffffffff80d25cfb at Xfast_syscall+0xfb > Uptime: 19h48m28s > Dumping 179 out of 999 > MB:..9%..18%..27%..36%..45%..54%..63%..72%..81%..98% > > Reading symbols from /boot/kernel/smbfs.ko.symbols...done. > Loaded symbols for /boot/kernel/smbfs.ko.symbols > Reading symbols from /boot/kernel/libiconv.ko.symbols...done. > Loaded symbols for /boot/kernel/libiconv.ko.symbols > Reading symbols from /boot/kernel/libmchain.ko.symbols...done. > Loaded symbols for /boot/kernel/libmchain.ko.symbols > #0 doadump (textdump=) at pcpu.h:219 > 219 pcpu.h: No such file or directory. > in pcpu.h > (kgdb) #0 doadump (textdump=) at pcpu.h:219 > #1 0xffffffff8093b5f2 in kern_reboot (howto=260) > at /usr/src/sys/kern/kern_shutdown.c:451 > #2 0xffffffff8093bae5 in vpanic (fmt=, > ap=) at /usr/src/sys/kern/kern_shutdown.c:758 > #3 0xffffffff8093b979 in kassert_panic (fmt=) > at /usr/src/sys/kern/kern_shutdown.c:646 > #4 0xffffffff80921c47 in _mtx_destroy (c=0xfffff80009284690) > at /usr/src/sys/kern/kern_mutex.c:955 > #5 0xffffffff81a1c114 in smb_iod_destroy (iod=0xfffff80009284600) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_iod.c:706 > #6 0xffffffff81a12eea in smb_vc_free (cp=0xfffff8003a602a00) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_conn.c:499 > #7 0xffffffff81a13e24 in sdp_trydestroy (sdp=0xfffff8000a7cbc80) > at /usr/src/sys/modules/smbfs/../../netsmb/smb_dev.c:166 > #8 0xffffffff81a1cb36 in smbfs_unmount (mp=0xfffff80039f88330, > mntflags=) > at /usr/src/sys/modules/smbfs/../../fs/smbfs/smbfs_vfsops.c:297 > #9 0xffffffff809d9e84 in dounmount (mp=0xfffff80039f88330, > flags=134217728, > td=0xfffff8000f2b0000) at /usr/src/sys/kern/vfs_mount.c:1313 > #10 0xffffffff809d9936 in sys_unmount (td=0xfffff8000f2b0000, > uap=0xfffffe003d67fb80) at /usr/src/sys/kern/vfs_mount.c:1205 > #11 0xffffffff80d42235 in amd64_syscall (td=0xfffff8000f2b0000, > traced=0) > at subr_syscall.c:134 > #12 0xffffffff80d25cfb in Xfast_syscall () > at /usr/src/sys/amd64/amd64/exception.S:396 > #13 0x000000080089190a in ?? () > Previous frame inner to this frame (corrupt stack?) > Current language: auto; currently minimal > (kgdb) > > > I have kgdb710 from ports setup in case you need me to check something. > > Greetings > Christian > > -- > Christian Kratzer CK Software GmbH > Email: ck@cksoft.de Wildberger Weg 24/2 > Phone: +49 7032 893 997 - 0 D-71126 Gaeufelden > Fax: +49 7032 893 997 - 9 HRB 245288, Amtsgericht Stuttgart > Mobile: +49 171 1947 843 Geschaeftsfuehrer: Christian Kratzer > Web: http://www.cksoft.de/ > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > ------=_Part_31305794_187348850.1444518367047 Content-Type: text/x-patch; name=smbiod.patch Content-Disposition: attachment; filename=smbiod.patch Content-Transfer-Encoding: base64 LS0tIHNtYl9pb2QuYy5vcmlnCTIwMTUtMTAtMTAgMTg6NTM6MzQuMDAwMDAwMDAwIC0wNDAwCisr KyBzbWJfaW9kLmMJMjAxNS0xMC0xMCAxODo1ODo1NC4wMDAwMDAwMDAgLTA0MDAKQEAgLTYxOSw2 ICs2MTksMzIgQEAgc21iX2lvZF9tYWluKHN0cnVjdCBzbWJpb2QgKmlvZCkKIAkJCWJyZWFrOwog CQl9CiAJCWlmIChldnAtPmV2X3R5cGUgJiBTTUJJT0RfRVZfU1lOQykgeworCQkJaWYgKGV2cC0+ ZXZfdHlwZSAmIFNNQklPRF9FVl9TSFVURE9XTikgeworCQkJCXNtYl9pb2Rfc2VuZGFsbChpb2Qp OworCQkJCXNtYl9pb2RfcmVjdmFsbChpb2QpOworCQkJCVNNQl9JT0RfRVZMT0NLKGlvZCk7CisJ CQkJaWYgKCFTVEFJTFFfRU1QVFkoJmlvZC0+aW9kX2V2bGlzdCkpIHsKKwkJCQkJLyoKKwkJCQkJ ICogSWYgdGhpcyBwcmludGYgb2NjdXJzLCB0aGUgY29kZSBoZXJlCisJCQkJCSAqIHNob3VsZCBi ZSBtb2RpZmllZCB0byBkbyBhIGxvb3AKKwkJCQkJICogZnJlZSgpaW5nIGFsbCB0aGUgZW50cmll cyBzdGlsbAorCQkJCQkgKiBpbiB0aGUgU1RBSUxRLgorCQkJCQkgKi8KKwkJCQkJcHJpbnRmKCIl czogc2h1dGRvd24gd2l0aCBwZW5kaW5nIgorCQkJCQkgICAgIiBldmVudHNcbiIsIF9fZnVuY19f KTsKKwkJCQl9CisJCQkJLyoKKwkJCQkgKiBGb3IgdGhlIFNNQklPRF9FVl9TSFVURE9XTiBjYXNl LCBldmVyeXRoaW5nCisJCQkJICogZWxzZSBzaG91bGQgYmUgcGVyZm9ybWVkIGJlZm9yZSB0aGlz IHBvaW50LAorCQkJCSAqIHNpbmNlIHNtYl9pb2RfZGVzdHJveSgpIGlzIGFibGUgdG8gcHJvY2Vl ZCB0bworCQkJCSAqIGRlc3Ryb3kgdGhlIG11dGV4ZXMgYW5kIHRoZSAqZXZwIHN0cnVjdHVyZQor CQkJCSAqIG9uY2UgdGhlIHdha2V1cCgpL1NNQl9JT0RfRVZVTkxPQ0soKSBpcworCQkJCSAqIHBl cmZvcm1lZC4KKwkJCQkgKi8KKwkJCQl3YWtldXAoZXZwKTsKKwkJCQlTTUJfSU9EX0VWVU5MT0NL KGlvZCk7CisJCQkJcmV0dXJuOworCQkJfQogCQkJU01CX0lPRF9FVkxPQ0soaW9kKTsKIAkJCXdh a2V1cChldnApOwogCQkJU01CX0lPRF9FVlVOTE9DSyhpb2QpOwo= ------=_Part_31305794_187348850.1444518367047--