From owner-freebsd-stable@freebsd.org Sun Nov 18 09:38:43 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B00FA1132268 for ; Sun, 18 Nov 2018 09:38:43 +0000 (UTC) (envelope-from No-reply@itc.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 2FF0E73D24 for ; Sun, 18 Nov 2018 09:38:43 +0000 (UTC) (envelope-from No-reply@itc.com) Received: by mailman.ysv.freebsd.org (Postfix) id DF57F1132265; Sun, 18 Nov 2018 09:38:42 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CCF5E1132263 for ; Sun, 18 Nov 2018 09:38:42 +0000 (UTC) (envelope-from No-reply@itc.com) Received: from sky.extra.co.jp (sky.extra.co.jp [49.212.206.141]) by mx1.freebsd.org (Postfix) with SMTP id DBA5C73D20 for ; Sun, 18 Nov 2018 09:38:41 +0000 (UTC) (envelope-from No-reply@itc.com) Received: (qmail 23069 invoked from network); 17 Nov 2018 01:27:18 -0000 Received: from ip113.ip-192-99-85.net (HELO itc.com) (ishikawa@192.99.85.113) by sky.extra.co.jp with SMTP; 17 Nov 2018 01:27:18 -0000 From: FreeBSD.org To: stable@FreeBSD.org Subject: Urgent Server Warning! Email Exceeded Storage Limit Date: 16 Nov 2018 17:26:39 -0800 Message-ID: <20181116172639.995541E3931BBD2B@itc.com> X-Rspamd-Queue-Id: 2FF0E73D24 X-Spamd-Result: default: False [11.85 / 15.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; MX_INVALID(0.50)[cached]; FORWARDED(0.00)[stable@mailman.ysv.freebsd.org]; TO_DN_NONE(0.00)[]; SUBJECT_HAS_EXCLAIM(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; NEURAL_HAM_SHORT(-0.05)[-0.049,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-3.70)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.81), asn: 10310(-3.74), country: US(-0.10)]; R_DKIM_NA(0.00)[]; DATE_IN_PAST(1.00)[]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FORGED_RECIPIENTS(0.00)[stable@FreeBSD.org,freebsd-stable@freebsd.org]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; SPAM_FLAG(5.00)[]; RCVD_COUNT_FIVE(0.00)[6]; FROM_HAS_DN(0.00)[]; DBL_ABUSE_PHISH(7.50)[mcmpovos.com.dbl.spamhaus.org]; DMARC_NA(0.00)[itc.com]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_HTML_ONLY(0.20)[]; R_SPF_NA(0.00)[]; GREYLIST(0.00)[pass,body] X-Rspamd-Server: mx1.freebsd.org X-Spam: Yes MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Nov 2018 09:38:43 -0000 From owner-freebsd-stable@freebsd.org Sun Nov 18 21:00:43 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D3A2D11217FE for ; Sun, 18 Nov 2018 21:00:42 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 6719570189 for ; Sun, 18 Nov 2018 21:00:42 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id 2323611217FB; Sun, 18 Nov 2018 21:00:42 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 10ECF11217FA for ; Sun, 18 Nov 2018 21:00:42 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A41E07017E for ; Sun, 18 Nov 2018 21:00:41 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id C136324F8B for ; Sun, 18 Nov 2018 21:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAIL0eRL033882 for ; Sun, 18 Nov 2018 21:00:40 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAIL0e7E033873 for stable@FreeBSD.org; Sun, 18 Nov 2018 21:00:40 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201811182100.wAIL0e7E033873@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: stable@FreeBSD.org Subject: Problem reports for stable@FreeBSD.org that need special attention Date: Sun, 18 Nov 2018 21:00:40 +0000 MIME-Version: 1.0 X-Rspamd-Queue-Id: 6719570189 X-Spamd-Result: default: False [0.41 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_SPAM_MEDIUM(0.29)[0.292,0]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; NEURAL_SPAM_SHORT(0.12)[0.118,0] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Nov 2018 21:00:43 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 230620 | "install -d" issue Open | 227213 | FreeBSD 10.4 kernel deadlocks on sysctlmemlock 2 problems total for which you should take action. From owner-freebsd-stable@freebsd.org Mon Nov 19 01:24:44 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CE3BE112E6A9 for ; Mon, 19 Nov 2018 01:24:44 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (tunnel82308-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 66DBA7A300 for ; Mon, 19 Nov 2018 01:24:41 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.15.2/8.15.2) with ESMTP id wAJ1Oe90097833 for ; Sun, 18 Nov 2018 20:24:40 -0500 (EST) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.15.2/8.14.4/Submit) id wAJ1Oe4B097832; Sun, 18 Nov 2018 20:24:40 -0500 (EST) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <23538.4310.710700.401331@hergotha.csail.mit.edu> Date: Sun, 18 Nov 2018 20:24:38 -0500 From: Garrett Wollman To: freebsd-stable@freebsd.org Subject: Trap 12 in vm_page_alloc_after() X-Mailer: VM 8.2.0b under 26.1 (amd64-portbld-freebsd11.2) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (hergotha.csail.mit.edu [127.0.0.1]); Sun, 18 Nov 2018 20:24:40 -0500 (EST) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED, HEADER_FROM_DIFFERENT_DOMAINS autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hergotha.csail.mit.edu X-Rspamd-Queue-Id: 66DBA7A300 X-Spamd-Result: default: False [-3.18 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.983,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-1.65)[ipnet: 2001:470::/32(-4.55), asn: 6939(-3.58), country: US(-0.09)]; R_SPF_PERMFAIL(0.00)[]; MX_GOOD(-0.01)[hergotha.bimajority.org]; NEURAL_HAM_SHORT(-0.84)[-0.839,0]; FORGED_SENDER(0.30)[wollman@bimajority.org,wollman@hergotha.csail.mit.edu]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[wollman@bimajority.org,wollman@hergotha.csail.mit.edu]; DMARC_POLICY_SOFTFAIL(0.10)[bimajority.org : No valid SPF, No valid DKIM, none] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 01:24:45 -0000 Has anyone seen this before? It's on a busy NFS server, but hasn't been observed on any of our other NFS servers. ------------------------------------------------------------------------ Fatal trap 12: page fault while in kernel mode cpuid = 35; apic id = 35 fault virtual address = 0x5a fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff809a903d stack pointer = 0x28:0xfffffe17eb8d0710 frame pointer = 0x28:0xfffffe17eb8d0750 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 878 (nfsd: service) trap number = 12 panic: page fault cpuid = 35 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe17eb8d03c0 vpanic() at vpanic+0x177/frame 0xfffffe17eb8d0420 panic() at panic+0x43/frame 0xfffffe17eb8d0480 trap_fatal() at trap_fatal+0x35f/frame 0xfffffe17eb8d04d0 trap_pfault() at trap_pfault+0x49/frame 0xfffffe17eb8d0530 trap() at trap+0x2c7/frame 0xfffffe17eb8d0640 calltrap() at calltrap+0x8/frame 0xfffffe17eb8d0640 --- trap 0xc, rip = 0xffffffff809a903d, rsp = 0xfffffe17eb8d0710, rbp = 0xfffffe17eb8d0750 --- vm_page_alloc_after() at vm_page_alloc_after+0x15d/frame 0xfffffe17eb8d0750 kmem_back() at kmem_back+0xf2/frame 0xfffffe17eb8d07c0 kmem_malloc() at kmem_malloc+0x60/frame 0xfffffe17eb8d07f0 keg_alloc_slab() at keg_alloc_slab+0xe2/frame 0xfffffe17eb8d0860 keg_fetch_slab() at keg_fetch_slab+0x14e/frame 0xfffffe17eb8d08b0 zone_fetch_slab() at zone_fetch_slab+0x64/frame 0xfffffe17eb8d08e0 zone_import() at zone_import+0x3f/frame 0xfffffe17eb8d0930 uma_zalloc_arg() at uma_zalloc_arg+0x3d9/frame 0xfffffe17eb8d09a0 zil_alloc_lwb() at zil_alloc_lwb+0x9c/frame 0xfffffe17eb8d09e0 zil_lwb_write_issue() at zil_lwb_write_issue+0x2f8/frame 0xfffffe17eb8d0a40 zil_commit_impl() at zil_commit_impl+0x95f/frame 0xfffffe17eb8d0b80 zfs_freebsd_fsync() at zfs_freebsd_fsync+0xa7/frame 0xfffffe17eb8d0bb0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0x82/frame 0xfffffe17eb8d0be0 nfsvno_fsync() at nfsvno_fsync+0xe0/frame 0xfffffe17eb8d0c50 nfsrvd_commit() at nfsrvd_commit+0xe8/frame 0xfffffe17eb8d0e20 nfsrvd_dorpc() at nfsrvd_dorpc+0x621/frame 0xfffffe17eb8d0ff0 nfssvc_program() at nfssvc_program+0x557/frame 0xfffffe17eb8d11a0 svc_run_internal() at svc_run_internal+0xe09/frame 0xfffffe17eb8d12e0 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe17eb8d12f0 fork_exit() at fork_exit+0x83/frame 0xfffffe17eb8d1330 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe17eb8d1330 --- trap 0xc, rip = 0x80087101a, rsp = 0x7fffffffe688, rbp = 0x7fffffffe930 --- ------------------------------------------------------------------------ At this point the system was frozen: it did not attempt to reboot automatically and was not in the debugger. I had to do a remote reset via the BMC. The kernel is 11.2 r336644 (so no errata applied), but none of the SAs and ENs release so far look like they touch this region of code. -GAWollman From owner-freebsd-stable@freebsd.org Mon Nov 19 05:10:05 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EAFFF113437C for ; Mon, 19 Nov 2018 05:10:04 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 431CF81945 for ; Mon, 19 Nov 2018 05:10:04 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id wAJ59ish080444 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 19 Nov 2018 07:09:47 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua wAJ59ish080444 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id wAJ59iYX080443; Mon, 19 Nov 2018 07:09:44 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Mon, 19 Nov 2018 07:09:44 +0200 From: Konstantin Belousov To: Garrett Wollman Cc: freebsd-stable@freebsd.org Subject: Re: Trap 12 in vm_page_alloc_after() Message-ID: <20181119050944.GW2378@kib.kiev.ua> References: <23538.4310.710700.401331@hergotha.csail.mit.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <23538.4310.710700.401331@hergotha.csail.mit.edu> User-Agent: Mutt/1.10.1 (2018-07-13) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-Rspamd-Queue-Id: 431CF81945 X-Spamd-Result: default: False [-4.14 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.97)[-0.969,0]; IP_SCORE(-2.17)[ip: (-2.61), ipnet: 2001:470::/32(-4.55), asn: 6939(-3.58), country: US(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; RCVD_TLS_LAST(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : No valid SPF, No valid DKIM,none] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 05:10:05 -0000 On Sun, Nov 18, 2018 at 08:24:38PM -0500, Garrett Wollman wrote: > Has anyone seen this before? It's on a busy NFS server, but hasn't > been observed on any of our other NFS servers. > > ------------------------------------------------------------------------ > Fatal trap 12: page fault while in kernel mode > cpuid = 35; apic id = 35 > fault virtual address = 0x5a > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff809a903d > stack pointer = 0x28:0xfffffe17eb8d0710 > frame pointer = 0x28:0xfffffe17eb8d0750 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 878 (nfsd: service) > trap number = 12 > panic: page fault > cpuid = 35 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe17eb8d03c0 > vpanic() at vpanic+0x177/frame 0xfffffe17eb8d0420 > panic() at panic+0x43/frame 0xfffffe17eb8d0480 > trap_fatal() at trap_fatal+0x35f/frame 0xfffffe17eb8d04d0 > trap_pfault() at trap_pfault+0x49/frame 0xfffffe17eb8d0530 > trap() at trap+0x2c7/frame 0xfffffe17eb8d0640 > calltrap() at calltrap+0x8/frame 0xfffffe17eb8d0640 > --- trap 0xc, rip = 0xffffffff809a903d, rsp = 0xfffffe17eb8d0710, rbp = 0xfffffe17eb8d0750 --- > vm_page_alloc_after() at vm_page_alloc_after+0x15d/frame 0xfffffe17eb8d0750 > kmem_back() at kmem_back+0xf2/frame 0xfffffe17eb8d07c0 > kmem_malloc() at kmem_malloc+0x60/frame 0xfffffe17eb8d07f0 > keg_alloc_slab() at keg_alloc_slab+0xe2/frame 0xfffffe17eb8d0860 > keg_fetch_slab() at keg_fetch_slab+0x14e/frame 0xfffffe17eb8d08b0 > zone_fetch_slab() at zone_fetch_slab+0x64/frame 0xfffffe17eb8d08e0 > zone_import() at zone_import+0x3f/frame 0xfffffe17eb8d0930 > uma_zalloc_arg() at uma_zalloc_arg+0x3d9/frame 0xfffffe17eb8d09a0 > zil_alloc_lwb() at zil_alloc_lwb+0x9c/frame 0xfffffe17eb8d09e0 > zil_lwb_write_issue() at zil_lwb_write_issue+0x2f8/frame 0xfffffe17eb8d0a40 > zil_commit_impl() at zil_commit_impl+0x95f/frame 0xfffffe17eb8d0b80 > zfs_freebsd_fsync() at zfs_freebsd_fsync+0xa7/frame 0xfffffe17eb8d0bb0 > VOP_FSYNC_APV() at VOP_FSYNC_APV+0x82/frame 0xfffffe17eb8d0be0 > nfsvno_fsync() at nfsvno_fsync+0xe0/frame 0xfffffe17eb8d0c50 > nfsrvd_commit() at nfsrvd_commit+0xe8/frame 0xfffffe17eb8d0e20 > nfsrvd_dorpc() at nfsrvd_dorpc+0x621/frame 0xfffffe17eb8d0ff0 > nfssvc_program() at nfssvc_program+0x557/frame 0xfffffe17eb8d11a0 > svc_run_internal() at svc_run_internal+0xe09/frame 0xfffffe17eb8d12e0 > svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe17eb8d12f0 > fork_exit() at fork_exit+0x83/frame 0xfffffe17eb8d1330 > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe17eb8d1330 > --- trap 0xc, rip = 0x80087101a, rsp = 0x7fffffffe688, rbp = 0x7fffffffe930 --- > ------------------------------------------------------------------------ > > At this point the system was frozen: it did not attempt to reboot > automatically and was not in the debugger. I had to do a remote reset > via the BMC. The kernel is 11.2 r336644 (so no errata applied), but > none of the SAs and ENs release so far look like they touch this > region of code. What is the line number for vm_page_alloc_after+0x15d ? Do you have NUMA enabled on 11 ? From owner-freebsd-stable@freebsd.org Mon Nov 19 08:03:53 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1A50611382C9 for ; Mon, 19 Nov 2018 08:03:53 +0000 (UTC) (envelope-from bounce-5348-23316020-656-248@emlher.tk) Received: from gpos.emlher.tk (gpos.emlher.tk [173.230.140.131]) by mx1.freebsd.org (Postfix) with ESMTP id 21BDF6A6FF for ; Mon, 19 Nov 2018 08:03:50 +0000 (UTC) (envelope-from bounce-5348-23316020-656-248@emlher.tk) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; s=emlhertk; d=emlher.tk; h=Date:To:From:Reply-to:Subject:Message-ID:List-Unsubscribe:MIME-Version:Content-Type; i=newsletter@emlher.tk; bh=O6ZSW7D9aofiC7IM/LtsGa0+2VA=; b=Pfi9jmBJnln38LtkP6VI17q4Kid/fuepvWlQ+HSLbkYDJ80TntjbbikcSXbVYUCfSAGefydgSzhl W+r5cTpZ3mRMFHHQ8KA2fmh2UneowGKvNlcPiyyt3bGjul2lg8YuouJlS2hvpJrpMHEb+lnqgqQN myNPAj9vo3mG8OoY2j4= DomainKey-Signature: a=rsa-sha1; c=nofws; q=dns; s=emlhertk; d=emlher.tk; b=Y77F0ukBqTNglyS7tFXVpiC8apziVDDYhonQaJjGbjlF3faojJwz/P+ahqKS1TbcMJ++LmtS+yoX pgoAyqUZpL0HR+x2uE+EvZNSR/UOuKh1X/HuffaJNZ87Wa9YPFSPMIsxJop5QkfzUMY1edmlGHCf u1qS3fPQGeXc+8bsv7U=; Received: by gpos.emlher.tk id hu9n6e0e97cl for ; Mon, 19 Nov 2018 08:03:13 +0000 (envelope-from ) Date: Mon, 19 Nov 2018 01:06:41 +0100 To: "freebsd-stable@freebsd.org" From: Moncler Store Reply-to: Moncler Store Subject: Today's Best Deals! - Moncler Coats 70% OFF! Message-ID: X-Priority: 3 X-Mailer: Email Sending System X-Complaints-To: anzhelanebjtc@go2.pl X-MessageID: MjZ8fHx8MTE0Mjk0fHx8fGZyZWVic2Qtc3RhYmxlQGZyZWVic2Qub3JnfHx8fDN8fHx8MXx8fHww X-Report-Abuse: MIME-Version: 1.0 X-Rspamd-Queue-Id: 21BDF6A6FF X-Spamd-Result: default: False [3.47 / 15.00]; HAS_REPLYTO(0.00)[newsletter@emlher.tk]; XM_UA_NO_VERSION(0.01)[]; MX_INVALID(0.50)[greylisted]; R_SPF_ALLOW(-0.20)[+ptr]; DKIM_TRACE(0.00)[emlher.tk:+]; DMARC_POLICY_ALLOW(-0.50)[emlher.tk,none]; HAS_X_PRIO_THREE(0.00)[3]; SUBJECT_ENDS_EXCLAIM(0.00)[]; FORGED_SENDER(0.30)[newsletter@emlher.tk,bounce-5348-23316020-656-248@emlher.tk]; RCVD_NO_TLS_LAST(0.10)[]; AUTOGEN_PHP_SPAMMY(1.00)[]; IP_SCORE(-0.37)[asn: 63949(-1.73), country: US(-0.09)]; ASN(0.00)[asn:63949, ipnet:173.230.128.0/20, country:US]; FROM_NEQ_ENVFROM(0.00)[newsletter@emlher.tk,bounce-5348-23316020-656-248@emlher.tk]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.10)[-0.099,0]; R_DKIM_ALLOW(-0.20)[emlher.tk]; spamhaus_xbl(0.00)[131.140.230.173.g4jphcdwjq2eyvr5ppcbhhxyzq.zen.dq.spamhaus.net]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HTML_SHORT_LINK_IMG_1(2.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; HAS_PHPMAILER_SIG(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; HAS_LIST_UNSUB(-0.01)[]; RCPT_COUNT_ONE(0.00)[1]; REPLYTO_EQ_FROM(0.00)[]; MANY_INVISIBLE_PARTS(0.00)[2]; NEURAL_SPAM_SHORT(0.54)[0.536,0]; TO_DN_EQ_ADDR_ALL(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset = "utf-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 08:03:53 -0000 Today's Best Deals! - Moncler Coats 70% OFF! Your email client cannot read this email. To view it online, please go here: http://gpos.emlher.tk/edmo/wb.php?p=3Dsi= /sg/rs/2gym/rv/rs To stop receiving these emails:http://gpos.emlher.tk/edmo/u.php?p=3Dsi/rs/2= gym/rv/sg/rs From owner-freebsd-stable@freebsd.org Mon Nov 19 08:11:47 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E95F11138534 for ; Mon, 19 Nov 2018 08:11:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 821836AA2B for ; Mon, 19 Nov 2018 08:11:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 457051138531; Mon, 19 Nov 2018 08:11:46 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 31F2E1138530 for ; Mon, 19 Nov 2018 08:11:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C17AC6AA25 for ; Mon, 19 Nov 2018 08:11:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id DBBBD2E3A for ; Mon, 19 Nov 2018 08:11:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAJ8BiWn099236 for ; Mon, 19 Nov 2018 08:11:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAJ8BiEj099235 for stable@FreeBSD.org; Mon, 19 Nov 2018 08:11:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 233006] bsdtar aborts creation of archive on ENOENT Date: Mon, 19 Nov 2018 08:11:45 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: patch, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mm@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? mfc-stable12? X-Bugzilla-Changed-Fields: short_desc see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 821836AA2B X-Spamd-Result: default: False [1.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_SPAM_MEDIUM(0.28)[0.285,0]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; NEURAL_SPAM_SHORT(0.71)[0.713,0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 08:11:47 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233006 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|[regression] [patch] bsdtar |bsdtar aborts creation of |aborts creation of archive |archive on ENOENT |on ENOENT | See Also| |https://github.com/libarchi | |ve/libarchive/issues/1082 --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Mon Nov 19 12:57:05 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 247DF1102F78 for ; Mon, 19 Nov 2018 12:57:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id AAD7574864 for ; Mon, 19 Nov 2018 12:57:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 683E61102F77; Mon, 19 Nov 2018 12:57:04 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 566171102F76 for ; Mon, 19 Nov 2018 12:57:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E601074860 for ; Mon, 19 Nov 2018 12:57:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 25CDD57CB for ; Mon, 19 Nov 2018 12:57:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wAJCv31i060405 for ; Mon, 19 Nov 2018 12:57:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wAJCv37i060404 for stable@FreeBSD.org; Mon, 19 Nov 2018 12:57:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 233006] [regression] [patch] bsdtar aborts creation of archive on ENOENT Date: Mon, 19 Nov 2018 12:57:03 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.2-STABLE X-Bugzilla-Keywords: patch, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: eugen@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: mm@FreeBSD.org X-Bugzilla-Flags: mfc-stable11? mfc-stable12? X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: AAD7574864 X-Spamd-Result: default: False [1.11 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_SPAM_MEDIUM(0.28)[0.285,0]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; NEURAL_SPAM_SHORT(0.82)[0.822,0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 12:57:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D233006 Eugene Grosbein changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|bsdtar aborts creation of |[regression] [patch] bsdtar |archive on ENOENT |aborts creation of archive | |on ENOENT --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-stable@freebsd.org Mon Nov 19 13:10:05 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D38A0110346E for ; Mon, 19 Nov 2018 13:10:04 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher DHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A075874D93 for ; Mon, 19 Nov 2018 13:10:03 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate1.intern.punkt.de with ESMTP id wAJDA016036898 for ; Mon, 19 Nov 2018 14:10:01 +0100 (CET) Received: from [217.29.46.123] ([217.29.46.123]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id wAJDA0aJ029527 for ; Mon, 19 Nov 2018 14:10:00 +0100 (CET) (envelope-from hausen@punkt.de) From: "Patrick M. Hausen" Content-Type: multipart/mixed; boundary="Apple-Mail=_63BFE956-FF55-4FD2-BDD5-6D81722ABCA4" Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Memory error logged in /var/log/messages Message-Id: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> Date: Mon, 19 Nov 2018 14:10:00 +0100 To: freebsd-stable@freebsd.org X-Mailer: Apple Mail (2.3445.9.1) X-Rspamd-Queue-Id: A075874D93 X-Spamd-Result: default: False [1.14 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.63)[-0.626,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:217.29.32.0/20]; MV_CASE(0.50)[]; HAS_ATTACHMENT(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[punkt.de]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mailin.pluspunkthosting.de]; CTYPE_MIXED_BOGUS(1.00)[]; RCVD_IN_DNSWL_NONE(0.00)[131.33.29.217.list.dnswl.org : 127.0.10.0]; NEURAL_SPAM_SHORT(0.58)[0.579,0]; IP_SCORE(-0.00)[country: DE(-0.01)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16188, ipnet:217.29.32.0/20, country:DE]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 13:10:05 -0000 --Apple-Mail=_63BFE956-FF55-4FD2-BDD5-6D81722ABCA4 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hi all, one of our production servers, 11.2p3 is logging this every couple of = minutes: Nov 19 11:48:06 ph002 kernel: MCA: CPU 0 COR (5) OVER MS channel 3 = memory error Nov 19 11:48:06 ph002 kernel: MCA: Address 0x1f709a48c0 Nov 19 11:48:06 ph002 kernel: MCA: Misc 0x90010000040188c Nov 19 11:48:06 ph002 kernel: MCA: Bank 12, Status 0xcc00010c000800c3 Nov 19 11:48:06 ph002 kernel: MCA: Global Cap 0x0000000007000c16, Status = 0x0000000000000000 Nov 19 11:48:06 ph002 kernel: MCA: Vendor "GenuineIntel", ID 0x406f1, = APIC ID 0 Address and core varies but it is always bank 12. It seems like applications are unaffected, we use, of course ECC memory. Is the OS able to work around these errors and just notifies us or is = in-memory data already getting corrupted? I=E2=80=99m at a bit of a loss identifying which DIMM might be the cause = so I contacted Supermicro support. They answered: > We can't really answer this, we do not know how various OS's map the = memory slots. > Our advise is always to look at IPMI, but if that doesn't log any = issues then we're not sure you're looking at a hardware issue. >=20 > But assuming the OS looks at the ranks of a module as a bank and you = use dual rank memory then it should logically point at DIMMC2. They are right on the IPMI (I told them when opening the case) - = there=E2=80=99s nothing at all in the event log. Can they be correct that it might not even be a hardware issue? If not how can I be sure which DIMM is to blame? Spare parts are ready = but I=E2=80=99d like to have a rather short maintenance break outside regular business hours. I=E2=80=99ll attach a dmesg.boot. HW is a X10DRW-NT mainboard, = SYS-1028R-WTNRT server platform. Thanks for any hints, Patrick --=20 punkt.de GmbH Internet - Dienstleistungen - Beratung Kaiserallee 13a Tel.: 0721 9109-0 Fax: -100 76133 Karlsruhe info@punkt.de http://punkt.de AG Mannheim 108285 Gf: Juergen Egeling --Apple-Mail=_63BFE956-FF55-4FD2-BDD5-6D81722ABCA4 Content-Disposition: attachment; filename=dmesg-boot.txt Content-Type: text/plain; x-unix-mode=0644; name="dmesg-boot.txt" Content-Transfer-Encoding: quoted-printable Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights = reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-RELEASE-p3 #4 r338821: Thu Sep 20 12:26:41 CEST 2018 root@backupr05.karlsruhe.punkt.de:/usr/obj/usr/src/sys/VIMAGE amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on = LLVM 6.0.0) VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2630L v4 @ 1.80GHz (1800.04-MHz K8-class = CPU) Origin=3D"GenuineIntel" Id=3D0x406f1 Family=3D0x6 Model=3D0x4f = Stepping=3D1 = Features=3D0xbfebfbff = Features2=3D0x7ffefbff AMD Features=3D0x2c100800 AMD Features2=3D0x121 Structured Extended = Features=3D0x21cbfbb XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory =3D 274873712640 (262140 MB) avail memory =3D 267225935872 (254846 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 40 CPUs FreeBSD/SMP: 2 package(s) x 10 core(s) x 2 hardware threads WARNING: VIMAGE (virtualized network stack) is a highly experimental = feature. ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard ioapic2 irqs 48-71 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #29 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #35 Launched! SMP: AP CPU #17 Launched! SMP: AP CPU #24 Launched! SMP: AP CPU #14 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #19 Launched! SMP: AP CPU #11 Launched! SMP: AP CPU #33 Launched! SMP: AP CPU #12 Launched! SMP: AP CPU #26 Launched! SMP: AP CPU #25 Launched! SMP: AP CPU #18 Launched! SMP: AP CPU #23 Launched! SMP: AP CPU #21 Launched! SMP: AP CPU #34 Launched! SMP: AP CPU #39 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #30 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #37 Launched! SMP: AP CPU #13 Launched! SMP: AP CPU #27 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #36 Launched! SMP: AP CPU #28 Launched! SMP: AP CPU #38 Launched! SMP: AP CPU #22 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #15 Launched! SMP: AP CPU #20 Launched! SMP: AP CPU #32 Launched! SMP: AP CPU #16 Launched! SMP: AP CPU #31 Launched! SMP: AP CPU #10 Launched! SMP: AP CPU #9 Launched! SMP: AP CPU #8 Launched! Timecounter "TSC" frequency 1800041380 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff8102d580, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: <> on motherboard acpi0: Power Button (fixed) cpu0: numa-domain 0 on acpi0 cpu1: numa-domain 0 on acpi0 cpu2: numa-domain 0 on acpi0 cpu3: numa-domain 0 on acpi0 cpu4: numa-domain 0 on acpi0 cpu5: numa-domain 0 on acpi0 cpu6: numa-domain 0 on acpi0 cpu7: numa-domain 0 on acpi0 cpu8: numa-domain 0 on acpi0 cpu9: numa-domain 0 on acpi0 cpu10: numa-domain 0 on acpi0 cpu11: numa-domain 0 on acpi0 cpu12: numa-domain 0 on acpi0 cpu13: numa-domain 0 on acpi0 cpu14: numa-domain 0 on acpi0 cpu15: numa-domain 0 on acpi0 cpu16: numa-domain 0 on acpi0 cpu17: numa-domain 0 on acpi0 cpu18: numa-domain 0 on acpi0 cpu19: numa-domain 0 on acpi0 cpu20: numa-domain 1 on acpi0 cpu21: numa-domain 1 on acpi0 cpu22: numa-domain 1 on acpi0 cpu23: numa-domain 1 on acpi0 cpu24: numa-domain 1 on acpi0 cpu25: numa-domain 1 on acpi0 cpu26: numa-domain 1 on acpi0 cpu27: numa-domain 1 on acpi0 cpu28: numa-domain 1 on acpi0 cpu29: numa-domain 1 on acpi0 cpu30: numa-domain 1 on acpi0 cpu31: numa-domain 1 on acpi0 cpu32: numa-domain 1 on acpi0 cpu33: numa-domain 1 on acpi0 cpu34: numa-domain 1 on acpi0 cpu35: numa-domain 1 on acpi0 cpu36: numa-domain 1 on acpi0 cpu37: numa-domain 1 on acpi0 cpu38: numa-domain 1 on acpi0 cpu39: numa-domain 1 on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pcib0: _OSC returned error 0x10 pci0: on pcib0 pci0: at device 8.2 (no driver attached) pci0: at device 9.2 (no driver attached) pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) pcib1: on acpi0 pcib1: _OSC returned error 0x10 pci1: on pcib1 pci1: at device 8.2 (no driver attached) pci1: at device 9.2 (no driver attached) pci1: at device 11.1 (no driver attached) pci1: at device 11.2 (no driver attached) pci1: at device 16.1 (no driver attached) pci1: at device 16.6 (no driver attached) pci1: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 pcib2: port 0xcf8-0xcff numa-domain 0 on acpi0 pcib2: _OSC returned error 0x10 pci2: numa-domain 0 on pcib2 pcib3: irq 26 at device 1.0 numa-domain 0 on pci2 pci3: numa-domain 0 on pcib3 ix0: = port 0x6020-0x603f mem 0xc7c00000-0xc7dfffff,0xc7e04000-0xc7e07fff irq = 26 at device 0.0 numa-domain 0 on pci3 ix0: Using MSI-X interrupts with 9 vectors ix0: Ethernet address: 0c:c4:7a:34:ec:ba ix0: PCI Express Bus: Speed 5.0GT/s Width x8 ix0: netmap queues/slots: TX 8/2048, RX 8/2048 ix1: = port 0x6000-0x601f mem 0xc7a00000-0xc7bfffff,0xc7e00000-0xc7e03fff irq = 28 at device 0.1 numa-domain 0 on pci3 ix1: Using MSI-X interrupts with 9 vectors ix1: Ethernet address: 0c:c4:7a:34:ec:bb ix1: PCI Express Bus: Speed 5.0GT/s Width x8 ix1: netmap queues/slots: TX 8/2048, RX 8/2048 pcib4: irq 32 at device 2.0 numa-domain 0 on pci2 pcib4: [GIANT-LOCKED] pcib5: irq 32 at device 2.1 numa-domain 0 on pci2 pcib5: [GIANT-LOCKED] pcib6: irq 40 at device 3.0 numa-domain 0 on pci2 pci4: numa-domain 0 on pcib6 pcib7: at device 0.0 numa-domain 0 on pci4 pci5: numa-domain 0 on pcib7 pcib8: at device 2.0 numa-domain 0 on pci5 pci6: numa-domain 0 on pcib8 igb0: port = 0x4020-0x403f mem 0xc7220000-0xc723ffff,0xc7244000-0xc7247fff irq 45 at = device 0.0 numa-domain 0 on pci6 igb0: Using MSIX interrupts with 9 vectors igb0: Ethernet address: 90:e2:ba:ed:87:bc igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 igb0: Bound queue 2 to cpu 2 igb0: Bound queue 3 to cpu 3 igb0: Bound queue 4 to cpu 4 igb0: Bound queue 5 to cpu 5 igb0: Bound queue 6 to cpu 6 igb0: Bound queue 7 to cpu 7 igb0: netmap queues/slots: TX 8/1024, RX 8/1024 igb1: port = 0x4000-0x401f mem 0xc7200000-0xc721ffff,0xc7240000-0xc7243fff irq 46 at = device 0.1 numa-domain 0 on pci6 igb1: Using MSIX interrupts with 9 vectors igb1: Ethernet address: 90:e2:ba:ed:87:bd igb1: Bound queue 0 to cpu 8 igb1: Bound queue 1 to cpu 9 igb1: Bound queue 2 to cpu 10 igb1: Bound queue 3 to cpu 11 igb1: Bound queue 4 to cpu 12 igb1: Bound queue 5 to cpu 13 igb1: Bound queue 6 to cpu 14 igb1: Bound queue 7 to cpu 15 igb1: netmap queues/slots: TX 8/1024, RX 8/1024 pcib9: at device 4.0 numa-domain 0 on pci5 pci7: numa-domain 0 on pcib9 igb2: port = 0x3020-0x303f mem 0xc7120000-0xc713ffff,0xc7144000-0xc7147fff irq 40 at = device 0.0 numa-domain 0 on pci7 igb2: Using MSIX interrupts with 9 vectors igb2: Ethernet address: 90:e2:ba:ed:87:be igb2: Bound queue 0 to cpu 16 igb2: Bound queue 1 to cpu 17 igb2: Bound queue 2 to cpu 18 igb2: Bound queue 3 to cpu 19 igb2: Bound queue 4 to cpu 20 igb2: Bound queue 5 to cpu 21 igb2: Bound queue 6 to cpu 22 igb2: Bound queue 7 to cpu 23 igb2: netmap queues/slots: TX 8/1024, RX 8/1024 igb3: port = 0x3000-0x301f mem 0xc7100000-0xc711ffff,0xc7140000-0xc7143fff irq 44 at = device 0.1 numa-domain 0 on pci7 igb3: Using MSIX interrupts with 9 vectors igb3: Ethernet address: 90:e2:ba:ed:87:bf igb3: Bound queue 0 to cpu 24 igb3: Bound queue 1 to cpu 25 igb3: Bound queue 2 to cpu 26 igb3: Bound queue 3 to cpu 27 igb3: Bound queue 4 to cpu 28 igb3: Bound queue 5 to cpu 29 igb3: Bound queue 6 to cpu 30 igb3: Bound queue 7 to cpu 31 igb3: netmap queues/slots: TX 8/1024, RX 8/1024 pci2: at device 17.0 (no driver attached) ahci0: port = 0x7110-0x7117,0x7100-0x7103,0x70f0-0x70f7,0x70e0-0x70e3,0x7020-0x703f = mem 0xc7338000-0xc73387ff irq 16 at device 17.4 numa-domain 0 on pci2 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xc7300000-0xc730ffff = irq 19 at device 20.0 numa-domain 0 on pci2 xhci0: 32 bytes context size, 64-bit DMA usbus0 numa-domain 0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci2: at device 22.0 (no driver attached) pci2: at device 22.1 (no driver attached) ehci0: mem 0xc7334000-0xc73343ff = irq 18 at device 26.0 numa-domain 0 on pci2 usbus1: EHCI version 1.0 usbus1 numa-domain 0 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib10: irq 16 at device 28.0 numa-domain 0 on = pci2 pci8: numa-domain 0 on pcib10 pcib11: irq 16 at device 28.4 numa-domain 0 on = pci2 pci9: numa-domain 0 on pcib11 pcib12: at device 0.0 numa-domain 0 on pci9 pci10: numa-domain 0 on pcib12 vgapci0: port 0x5000-0x507f mem = 0xc6000000-0xc6ffffff,0xc7000000-0xc701ffff irq 16 at device 0.0 = numa-domain 0 on pci10 vgapci0: Boot video device ehci1: mem 0xc7333000-0xc73333ff = irq 18 at device 29.0 numa-domain 0 on pci2 usbus2: EHCI version 1.0 usbus2 numa-domain 0 on ehci1 usbus2: 480Mbps High Speed USB v2.0 isab0: at device 31.0 numa-domain 0 on pci2 isa0: numa-domain 0 on isab0 ahci1: port = 0x7070-0x7077,0x7060-0x7063,0x7050-0x7057,0x7040-0x7043,0x7000-0x701f = mem 0xc7332000-0xc73327ff irq 16 at device 31.2 numa-domain 0 on pci2 ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich4: at channel 0 on ahci1 ahcich5: at channel 1 on ahci1 ahcich6: at channel 2 on ahci1 ahcich7: at channel 3 on ahci1 ahcich8: at channel 4 on ahci1 ahcich9: at channel 5 on ahci1 ahciem1: on ahci1 pcib13: numa-domain 1 on acpi0 pcib13: _OSC returned error 0x10 pci11: numa-domain 1 on pcib13 acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 ipmi0: port 0xca2,0xca3 on acpi0 ipmi0: KCS mode found at io 0xca2 on acpi orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0 ppc0: cannot reserve I/O port range est0: numa-domain 0 on cpu0 est1: numa-domain 0 on cpu1 est2: numa-domain 0 on cpu2 est3: numa-domain 0 on cpu3 est4: numa-domain 0 on cpu4 est5: numa-domain 0 on cpu5 est6: numa-domain 0 on cpu6 est7: numa-domain 0 on cpu7 est8: numa-domain 0 on cpu8 est9: numa-domain 0 on cpu9 est10: numa-domain 0 on cpu10 est11: numa-domain 0 on cpu11 est12: numa-domain 0 on cpu12 est13: numa-domain 0 on cpu13 est14: numa-domain 0 on cpu14 est15: numa-domain 0 on cpu15 est16: numa-domain 0 on cpu16 est17: numa-domain 0 on cpu17 est18: numa-domain 0 on cpu18 est19: numa-domain 0 on cpu19 est20: numa-domain 1 on cpu20 est21: numa-domain 1 on cpu21 est22: numa-domain 1 on cpu22 est23: numa-domain 1 on cpu23 est24: numa-domain 1 on cpu24 est25: numa-domain 1 on cpu25 est26: numa-domain 1 on cpu26 est27: numa-domain 1 on cpu27 est28: numa-domain 1 on cpu28 est29: numa-domain 1 on cpu29 est30: numa-domain 1 on cpu30 est31: numa-domain 1 on cpu31 est32: numa-domain 1 on cpu32 est33: numa-domain 1 on cpu33 est34: numa-domain 1 on cpu34 est35: numa-domain 1 on cpu35 est36: numa-domain 1 on cpu36 est37: numa-domain 1 on cpu37 est38: numa-domain 1 on cpu38 est39: numa-domain 1 on cpu39 random: unblocking device. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to = accept, logging disabled ipmi0: IPMI device rev. 1, firmware rev. 3.45, version 2.0 ipmi0: Number of channels 2 ipmi0: Attached watchdog ugen1.1: at usbus1 ugen2.1: at usbus2 ugen0.1: <0x8086 XHCI root HUB> at usbus0 uhub0: on usbus1 ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 uhub1: ses0: SEMB S-E-S 2.00 device <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 ses0: SEMB SES Device ses1 at ahciem1 bus 0 scbus11 target 0 lun 0 uhub2: ses1: SEMB S-E-S 2.00 device ses1: SEMB SES Device ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 on usbus2 ada0: ACS-2 ATA SATA 3.x device ada0: Serial Number 164011801552 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada0: Command Queueing enabled ada0: 488386MB (1000215216 512 byte sectors) ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ACS-2 ATA SATA 3.x device ada1: Serial Number 164011801547 ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada1: Command Queueing enabled ada1: 488386MB (1000215216 512 byte sectors) ada2 at ahcich2 bus 0 scbus2 target 0 lun 0 ada2: ACS-2 ATA SATA 3.x device GEOM_MIRRORada2: Serial Number 164006805582 ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada2: Command Queueing enabled ada2: 976762MB (2000409264 512 byte sectors) ada3 at ahcich3 bus 0 scbus3 target 0 lun 0 : Device mirror/swap launched (2/2). ada3: ACS-2 ATA SATA 3.x device ada3: Serial Number 164103805747 ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada3: Command Queueing enabled ada3: 976762MB (2000409264 512 byte sectors) ada4 at ahcich4 bus 0 scbus5 target 0 lun 0 ada4: ACS-2 ATA SATA 3.x device ada4: Serial Number S252NX0H807418W ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada4: Command Queueing enabled ada4: 976762MB (2000409264 512 byte sectors) ada4: quirks=3D0x3<4K,NCQ_TRIM_BROKEN> ada5 at ahcich5 bus 0 scbus6 target 0 lun 0 ada5: ACS-2 ATA SATA 3.x device ada5: Serial Number 164103802112 ada5: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada5: Command Queueing enabled ada5: 976762MB (2000409264 512 byte sectors) ada6 at ahcich6 bus 0 scbus7 target 0 lun 0 ada6: ACS-2 ATA SATA 3.x device ada6: Serial Number 164006805318 ada6: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada6: Command Queueing enabled ada6: 976762MB (2000409264 512 byte sectors) ada7 at ahcich7 bus 0 scbus8 target 0 lun 0 ada7: ACS-2 ATA SATA 3.x device ada7: Serial Number S252NX0H807428B ada7: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes) ada7: Command Queueing enabled ada7: 976762MB (2000409264 512 byte sectors) ada7: quirks=3D0x3<4K,NCQ_TRIM_BROKEN> Trying to mount root from zfs:zroot/ROOT/default []... Root mount waiting for: usbus2 usbus1 usbus0 uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub1: 21 ports with 21 removable, self powered Root mount waiting for: usbus2 usbus1 usbus0 ugen0.2: at usbus0 uhub3 numa-domain 0 on uhub1 uhub3: = on usbus0 ugen1.2: at usbus1 uhub4 numa-domain 0 on uhub0 uhub4: = on usbus1 ugen2.2: at usbus2 uhub5 numa-domain 0 on uhub2 uhub5: = on usbus2 uhub3: 4 ports with 3 removable, self powered uhub4: 6 ports with 6 removable, self powered uhub5: 8 ports with 8 removable, self powered ugen0.3: at usbus0 ukbd0 numa-domain 0 on uhub3 ukbd0: = on usbus0 kbd2 at ukbd0 bridge0: Ethernet address: 02:50:51:fe:cc:00 bridge1: Ethernet address: 02:50:51:fe:cc:01 bridge0: changing name to 'inet0' bridge1: changing name to 'mgmt0' igb0: promiscuous mode enabled inet0: link state changed to UP igb1: promiscuous mode enabled mgmt0: link state changed to UP igb0: link state changed to UP igb1: link state changed to UP ums0 numa-domain 0 on uhub3 ums0: = on usbus0 ums0: 3 buttons and [Z] coordinates ID=3D0 CPU: Intel(R) Xeon(R) CPU E5-2630L v4 @ 1.80GHz (1800.04-MHz K8-class = CPU) Origin=3D"GenuineIntel" Id=3D0x406f1 Family=3D0x6 Model=3D0x4f = Stepping=3D1 = Features=3D0xbfebfbff = Features2=3D0x7ffefbff AMD Features=3D0x2c100800 AMD Features2=3D0x121 Structured Extended = Features=3D0x21cbfbb XSAVE Features=3D0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics --Apple-Mail=_63BFE956-FF55-4FD2-BDD5-6D81722ABCA4-- From owner-freebsd-stable@freebsd.org Mon Nov 19 13:38:26 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 15EE411040D3 for ; Mon, 19 Nov 2018 13:38:26 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 0D8F475C4A for ; Mon, 19 Nov 2018 13:38:14 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id wAJDc7Je070167 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Mon, 19 Nov 2018 14:38:08 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: hausen@punkt.de Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id wAJDc57B023003 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Mon, 19 Nov 2018 20:38:06 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: Memory error logged in /var/log/messages To: "Patrick M. Hausen" , freebsd-stable@freebsd.org References: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> From: Eugene Grosbein Message-ID: <045b0969-2dbc-be3b-0688-246fe1e14f92@grosbein.net> Date: Mon, 19 Nov 2018 20:38:02 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 0D8F475C4A X-Spamd-Result: default: False [-4.13 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; MX_INVALID(0.50)[greylisted]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.96)[-0.964,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-2.57)[ip: (-6.95), ipnet: 2a01:4f8::/29(-3.07), asn: 24940(-2.82), country: DE(-0.01)]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 13:38:26 -0000 19.11.2018 20:10, Patrick M. Hausen wrote: > Hi all, > > one of our production servers, 11.2p3 is logging this every couple of minutes: > > Nov 19 11:48:06 ph002 kernel: MCA: CPU 0 COR (5) OVER MS channel 3 memory error > Nov 19 11:48:06 ph002 kernel: MCA: Address 0x1f709a48c0 > Nov 19 11:48:06 ph002 kernel: MCA: Misc 0x90010000040188c > Nov 19 11:48:06 ph002 kernel: MCA: Bank 12, Status 0xcc00010c000800c3 > Nov 19 11:48:06 ph002 kernel: MCA: Global Cap 0x0000000007000c16, Status 0x0000000000000000 > Nov 19 11:48:06 ph002 kernel: MCA: Vendor "GenuineIntel", ID 0x406f1, APIC ID 0 > > Address and core varies but it is always bank 12. > > It seems like applications are unaffected, we use, of course ECC memory. > > Is the OS able to work around these errors and just notifies us or is in-memory > data already getting corrupted? > > I’m at a bit of a loss identifying which DIMM might be the cause so I contacted Supermicro > support. They answered: > >> We can't really answer this, we do not know how various OS's map the memory slots. >> Our advise is always to look at IPMI, but if that doesn't log any issues then we're not sure you're looking at a hardware issue. >> >> But assuming the OS looks at the ranks of a module as a bank and you use dual rank memory then it should logically point at DIMMC2. > > They are right on the IPMI (I told them when opening the case) - there’s nothing at all > in the event log. > > Can they be correct that it might not even be a hardware issue? Use sysutils/mcelog port (or package) to decode such MCA logs with "mcelog --no-dmi --ascii" command. For your logs, it reports: > Hardware event. This is not a software error. > CPU 0 BANK 12 > MISC 0 ADDR 0 > MCG status: > MemCtrl: Corrected patrol scrub error > STATUS cc00010c000800c3 MCGSTATUS 0 > MCGCAP 7000c16 APICID 0 SOCKETID 0 > CPUID Vendor Intel Family 6 Model 79 > (Fields were incomplete) Seems like hardware memory error corrected with ECC, so no data corruption (yet). You better replace a module in BANK 12 of CPU 0. From owner-freebsd-stable@freebsd.org Mon Nov 19 18:03:52 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9FF711212E0 for ; Mon, 19 Nov 2018 18:03:51 +0000 (UTC) (envelope-from rtomek@tau1.ceti.pl) Received: from mailout4.ceti.pl (mailout4.ceti.pl [62.121.128.44]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6B0308337F for ; Mon, 19 Nov 2018 18:03:51 +0000 (UTC) (envelope-from rtomek@tau1.ceti.pl) Received: from localhost (localhost [127.0.0.1]) by mailout4.ceti.pl (Postfix) with ESMTP id 657E2C0552F28 for ; Mon, 19 Nov 2018 19:03:50 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at mailout1.ceti.pl Received: from mailout4.ceti.pl ([62.121.128.44]) by localhost (mailout1.ceti.pl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id KJpZaxtpuUIK for ; Mon, 19 Nov 2018 19:03:46 +0100 (CET) Received: from tau1.ceti.pl (tau.ceti.pl [62.121.128.11]) by mailout4.ceti.pl (Postfix) with ESMTP id 40C62C0552F25 for ; Mon, 19 Nov 2018 19:03:46 +0100 (CET) Received: by tau1.ceti.pl (Postfix, from userid 3727) id 35F4596096E; Mon, 19 Nov 2018 19:03:46 +0100 (CET) Date: Mon, 19 Nov 2018 19:03:46 +0100 From: Tomasz Rola To: freebsd-stable@freebsd.org Subject: Re: Memory error logged in /var/log/messages Message-ID: <20181119180346.GB32527@tau1.ceti.pl> References: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> <20181119175858.GA32527@tau1.ceti.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20181119175858.GA32527@tau1.ceti.pl> User-Agent: Mutt/1.5.21 (2010-09-15) X-Rspamd-Queue-Id: 6B0308337F X-Spamd-Result: default: False [1.49 / 15.00]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.44)[0.437,0]; DMARC_NA(0.00)[ceti.pl]; MX_GOOD(-0.01)[cached: tau1.ceti.pl]; NEURAL_HAM_SHORT(-0.14)[-0.137,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[rtomek@ceti.pl,rtomek@tau1.ceti.pl]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15541, ipnet:62.121.128.0/20, country:PL]; FROM_NEQ_ENVFROM(0.00)[rtomek@ceti.pl,rtomek@tau1.ceti.pl]; IP_SCORE(0.00)[country: PL(0.02)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 18:03:52 -0000 On Mon, Nov 19, 2018 at 06:58:59PM +0100, Tomasz Rola wrote: > From what I understood so far about those things, it is alway good to > start investigation from checking one's power supply. Have a > multimeter and plug it into molex PATA power supply while the box is > working. I have no idea where to plug it in case there is no PATA > cables in your power supply, though. Ugh, I mean, measure voltages and how much they differ from the expected +3v, +5v and +12v. Up to 10% might be ok, more than this, might be not ok. Voltages might slip when the box is loaded, drives are working etc. In case your power supply is modular one, it might be possible to plug multimeter into supply's unused sockets. -- Regards, Tomasz Rola -- ** A C programmer asked whether computer had Buddha's nature. ** ** As the answer, master did "rm -rif" on the programmer's home ** ** directory. And then the C programmer became enlightened... ** ** ** ** Tomasz Rola mailto:tomasz_rola@bigfoot.com ** From owner-freebsd-stable@freebsd.org Mon Nov 19 18:09:12 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5866F1121623 for ; Mon, 19 Nov 2018 18:09:12 +0000 (UTC) (envelope-from rtomek@tau1.ceti.pl) Received: from mailout4.ceti.pl (mailout4.ceti.pl [62.121.128.44]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D1E6E837EB for ; Mon, 19 Nov 2018 18:09:11 +0000 (UTC) (envelope-from rtomek@tau1.ceti.pl) Received: from localhost (localhost [127.0.0.1]) by mailout4.ceti.pl (Postfix) with ESMTP id 81102C0552EEC for ; Mon, 19 Nov 2018 18:59:04 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at mailout1.ceti.pl Received: from mailout4.ceti.pl ([62.121.128.44]) by localhost (mailout1.ceti.pl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HLCi22Bp31hE for ; Mon, 19 Nov 2018 18:58:59 +0100 (CET) Received: from tau1.ceti.pl (tau.ceti.pl [62.121.128.11]) by mailout4.ceti.pl (Postfix) with ESMTP id 338E3C0552E39 for ; Mon, 19 Nov 2018 18:58:59 +0100 (CET) Received: by tau1.ceti.pl (Postfix, from userid 3727) id 1AC6D96096E; Mon, 19 Nov 2018 18:58:59 +0100 (CET) Date: Mon, 19 Nov 2018 18:58:59 +0100 From: Tomasz Rola To: freebsd-stable@freebsd.org Subject: Re: Memory error logged in /var/log/messages Message-ID: <20181119175858.GA32527@tau1.ceti.pl> References: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-Rspamd-Queue-Id: D1E6E837EB X-Spamd-Result: default: False [1.48 / 15.00]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.43)[0.427,0]; DMARC_NA(0.00)[ceti.pl]; MX_GOOD(-0.01)[cached: tau1.ceti.pl]; NEURAL_HAM_SHORT(-0.14)[-0.143,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[rtomek@ceti.pl,rtomek@tau1.ceti.pl]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15541, ipnet:62.121.128.0/20, country:PL]; FROM_NEQ_ENVFROM(0.00)[rtomek@ceti.pl,rtomek@tau1.ceti.pl]; IP_SCORE(0.00)[country: PL(0.02)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2018 18:09:12 -0000 On Mon, Nov 19, 2018 at 02:10:00PM +0100, Patrick M. Hausen wrote: > Hi all, > > one of our production servers, 11.2p3 is logging this every couple of minutes: > > Nov 19 11:48:06 ph002 kernel: MCA: CPU 0 COR (5) OVER MS channel 3 memory error > Nov 19 11:48:06 ph002 kernel: MCA: Address 0x1f709a48c0 > Nov 19 11:48:06 ph002 kernel: MCA: Misc 0x90010000040188c > Nov 19 11:48:06 ph002 kernel: MCA: Bank 12, Status 0xcc00010c000800c3 > Nov 19 11:48:06 ph002 kernel: MCA: Global Cap 0x0000000007000c16, Status 0x0000000000000000 > Nov 19 11:48:06 ph002 kernel: MCA: Vendor "GenuineIntel", ID 0x406f1, APIC ID 0 [...] >From what I understood so far about those things, it is alway good to start investigation from checking one's power supply. Have a multimeter and plug it into molex PATA power supply while the box is working. I have no idea where to plug it in case there is no PATA cables in your power supply, though. HTH -- Regards, Tomasz Rola -- ** A C programmer asked whether computer had Buddha's nature. ** ** As the answer, master did "rm -rif" on the programmer's home ** ** directory. And then the C programmer became enlightened... ** ** ** ** Tomasz Rola mailto:tomasz_rola@bigfoot.com ** From owner-freebsd-stable@freebsd.org Tue Nov 20 09:08:59 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2D4ED110699F for ; Tue, 20 Nov 2018 09:08:59 +0000 (UTC) (envelope-from bartsch@dssgmbh.de) Received: from dss.incore.de (dss.incore.de [195.145.1.138]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4250F8138F for ; Tue, 20 Nov 2018 09:08:58 +0000 (UTC) (envelope-from bartsch@dssgmbh.de) Received: from inetmail.dmz (inetmail.dmz [10.3.0.3]) by dss.incore.de (Postfix) with ESMTP id AEA1327DFD; Tue, 20 Nov 2018 10:08:50 +0100 (CET) X-Virus-Scanned: amavisd-new at incore.de Received: from dss.incore.de ([10.3.0.3]) by inetmail.dmz (inetmail.dmz [10.3.0.3]) (amavisd-new, port 10024) with LMTP id dD99HFHyoc51; Tue, 20 Nov 2018 10:08:49 +0100 (CET) Received: from mail.local.incore (fwintern.dmz [10.0.0.253]) by dss.incore.de (Postfix) with ESMTP id E0829281FC; Tue, 20 Nov 2018 10:08:40 +0100 (CET) Received: from pcadmin2.incore (pcadmin2.incore [192.168.0.149]) by mail.local.incore (Postfix) with ESMTPSA id DA01210E0; Tue, 20 Nov 2018 10:08:40 +0100 (CET) Subject: Re: Memory error logged in /var/log/messages To: "Patrick M. Hausen" , freebsd-stable@freebsd.org References: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> From: Alfred Bartsch Openpgp: preference=signencrypt Autocrypt: addr=bartsch@dssgmbh.de; prefer-encrypt=mutual; keydata= xsDiBD9Ua94RBACtlucQQWjRxFQVFiZAuVuaiWTLK9hErLP/zQrSqZabPrZ9fOWWscQPOzqd v9wpyvtWhLN/ol5rMaFIg7wvQkZR5Xfa1y893oVOCIQBNNrPT2DQzbXmx9LaySfaZf9Qj/1K TSvLk9TY4Q+vMk8JfmTXZJVu6EEjzl/oz5YuWQSkQwCgwBIH5MDS6L5A05uV/Vu3U4UjHWUD /2hohj2C+3D0s6J6K4ZFfeEq/6oNmpt0sssu7QCK6vwBirmRrfkhljCiQgD5kTVRecNTvdqI ZRwBCq+xupI/0aDZ5p9JnBG/aM1zvU6Fzldm7v948DM6ygkxgvHjV8YJWQLNeoYge7iiwK8/ Y/HlCwOb7V/ItftEzzD7jV6BFsZ0A/92RELB+86oTBgop1RcsCFsTPKqMUoIYkbgfiw/ZvTU aQybKJxZCo4clnzRmV3UBRNhML13KIxRN7upMWJCOwzLLwEdJhcLdOP3XdIENiBle83pC3dc IXILetIbywUbbr0BIYhzL1xViW+9SVL+/v4ZN/ViqUP9i8CQAzpHaKH4wM0uQWxmcmVkIEJh cnRzY2ggKERTUyBHbWJIKSA8YmFydHNjaEBkc3NnbWJoLmRlPsJbBBMRAgAbBQI/VGveBgsJ CAcDAgMVAgMDFgIBAh4BAheAAAoJEOUBntiXVX94Bi4AoKVSCb8jlvduDNah4/3i/gxix62O AKCRfe86AF7awxe9WK3yw9O/NcZbsM7ATQQ/VGvfEAQAggEwHSuszgCjwNgImzdw4ZNr17mO lWipGi7+qWUBNPpu4oOn+pDVQR9c0H/Gx+KutgD6CQRkYQahdxTPCQSWHHjyCAZ4Hb/6yrbP qtvyg3olfb8okRgx1gAKfmF5pQM6lY8q4T7vYr7oCypGYI3KjUhgAKNB5OB4GqTyfzbaLq8A AwUD/15/xwG9JH4bAPQOaOR54jM3yDwrlS7y81cT/99S/eBLWwQTToiwuQri3ueG778Ls7YS h+vTs0ZnrO88q9XOef8tF/vquZYraOVn3+um4s/MVb5pvlBeEcV9vjOmbJzxSLUUCxg3tw1F tjgUFEYk70m7SQO+Kqvx37R9WIE88R1GwkYEGBECAAYFAj9Ua98ACgkQ5QGe2JdVf3jAiQCf cgVLcWC9AHGTxmdyoQPIaTySE0oAni4XcktpKPAmU/tnL8Nd5FeEt1EL Message-ID: <5f345b71-fe30-6b7a-0581-30d0041ff065@dssgmbh.de> Date: Tue, 20 Nov 2018 10:08:40 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: <04F0C04D-7DD7-4079-8D2E-9824B69573D3@punkt.de> Content-Type: text/plain; charset=utf-8 Content-Language: de-DE Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4250F8138F X-Spamd-Result: default: False [1.25 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.64)[0.641,0]; NEURAL_HAM_LONG(-0.22)[-0.216,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[dssgmbh.de]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.01)[0.014,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[dss.incore.de]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[138.1.145.195.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:3320, ipnet:195.145.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-0.08)[asn: 3320(-0.38), country: DE(-0.01)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 09:08:59 -0000 Am 19.11.18 um 14:10 schrieb Patrick M. Hausen: > Hi all, > > one of our production servers, 11.2p3 is logging this every couple of minutes: > > Nov 19 11:48:06 ph002 kernel: MCA: CPU 0 COR (5) OVER MS channel 3 memory error > Nov 19 11:48:06 ph002 kernel: MCA: Address 0x1f709a48c0 > Nov 19 11:48:06 ph002 kernel: MCA: Misc 0x90010000040188c > Nov 19 11:48:06 ph002 kernel: MCA: Bank 12, Status 0xcc00010c000800c3 > Nov 19 11:48:06 ph002 kernel: MCA: Global Cap 0x0000000007000c16, Status 0x0000000000000000 > Nov 19 11:48:06 ph002 kernel: MCA: Vendor "GenuineIntel", ID 0x406f1, APIC ID 0 > > Address and core varies but it is always bank 12. > > It seems like applications are unaffected, we use, of course ECC memory. > > Is the OS able to work around these errors and just notifies us or is in-memory > data already getting corrupted? > > I’m at a bit of a loss identifying which DIMM might be the cause so I contacted Supermicro > support. They answered: > >> We can't really answer this, we do not know how various OS's map the memory slots. >> Our advise is always to look at IPMI, but if that doesn't log any issues then we're not sure you're looking at a hardware issue. >> >> But assuming the OS looks at the ranks of a module as a bank and you use dual rank memory then it should logically point at DIMMC2. > > They are right on the IPMI (I told them when opening the case) - there’s nothing at all > in the event log. > > Can they be correct that it might not even be a hardware issue? > If not how can I be sure which DIMM is to blame? Spare parts are ready but I’d like to > have a rather short maintenance break outside regular business hours. > > I’ll attach a dmesg.boot. HW is a X10DRW-NT mainboard, SYS-1028R-WTNRT server platform. > > Thanks for any hints, > Patrick > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > Hi Patrick, we had a similar experience with one of our servers (HP DL380 G7): Tons of MCA errors concerning a single memory bank. This bank number did not correspond to a special memory slot (HP numbers them from A to I for each cpu). iLO and mcelog output was not of any help for me. We did not notice any data loss, but to get rid of these annoying messages, I did the following: After taking the server out of production, I removed pairs of memory modules until the MCA messages stopped. Then the last removed pair contained the problematic module. Re-adding one of these last modules left a 50-percent chance to identify the defective module. After replacing this module, the server did no longer complain about memory problems. There should definitely be a more sophisticated method to identify problematic memory modules. Perhaps there is someone on the list who is able to shed some light on this kind of errors. -- Sincerely Alfred Bartsch Data-Service GmbH Beethovenstr. 2A 23617 Stockelsdorf fon: +49 451 490010 fax: +49 451 4900123 Amtsgericht Lübeck, HRB 318 BS Geschäftsführer: Wilfried Paepcke, Dr. Andreas Longwitz, Dr. Hans-Martin Rasch, Dr. Uwe Szyszka From owner-freebsd-stable@freebsd.org Tue Nov 20 09:54:02 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A93D1108174 for ; Tue, 20 Nov 2018 09:54:02 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 1C6ED83791 for ; Tue, 20 Nov 2018 09:53:53 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from bsdrookie.norma.com. (asterisk.enaza.ru [91.237.76.254] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id wAK9riKh042764 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Tue, 20 Nov 2018 14:53:45 +0500 (+05) (envelope-from eugene@zhegan.in) To: freebsd-stable@freebsd.org From: "Eugene M. Zheganin" Subject: plenty of memory, but system us intensively swapping Message-ID: <1ddb53ff-23a8-b364-0213-d8df3c7dcd3c@zhegan.in> Date: Tue, 20 Nov 2018 14:53:44 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.1.1 MIME-Version: 1.0 Content-Language: en-US X-Rspamd-Scan-Time: 0.46 X-Rspamd-Queue-Id: 1C6ED83791 X-Spamd-Result: default: False [1.01 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_SPAM_MEDIUM(0.16)[0.163,0]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[zhegan.in]; NEURAL_SPAM_SHORT(0.57)[0.566,0]; MX_GOOD(-0.01)[mail-backup.zhegan.in,mx.zhegan.in]; NEURAL_SPAM_LONG(0.59)[0.590,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(0.00)[country: RU(0.01)]; ASN(0.00)[asn:57401, ipnet:2a00:7540:1::/48, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset=koi8-r; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 09:54:02 -0000 Hello, I have a recent FreeBSD 11-STABLE which is mainly used as an iSCSI target. The system has 64G of RAM but is swapping intensively. Yup, about of half of the memory is used as ZFS ARC (isn't capped in loader.conf), and another half is eaten by the kernel, but it oly uses only about half of it (thus 25% of the total amount). Could this be tweaked by some sysctl oids (I suppose not, but worth asking). top, vmstat 1 snapshots and zfs-stats -a are listed below. Thanks. [root@san01:nginx/vhost.d]# vmstat 1 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr da0 da1 in sy cs us sy id 0 0 38 23G 609M 1544 68 118 64 895 839 0 0 3644 2678 649 0 13 87 0 0 53 23G 601M 1507 185 742 315 1780 33523 651 664 56438 785 476583 0 28 72 0 0 53 23G 548M 1727 330 809 380 2377 33256 758 763 55555 1273 468545 0 26 73 0 0 53 23G 528M 1702 239 660 305 1347 32335 611 631 59962 1025 490365 0 22 78 0 0 52 23G 854M 2409 309 693 203 97943 16944 525 515 64309 1570 540533 0 29 71 3 0 54 23G 1.1G 2756 639 641 149 124049 19531 542 538 64777 1576 553946 0 35 65 0 0 53 23G 982M 1694 236 680 282 2754 35602 597 603 66540 1385 583687 0 28 72 0 0 41 23G 867M 1882 223 767 307 1162 34936 682 638 67284 780 568818 0 33 67 0 0 39 23G 769M 1542 167 673 336 1187 35123 646 610 65925 1176 551623 0 23 77 2 0 41 23G 700M 3602 535 688 327 2192 37109 622 594 65862 4256 518934 0 33 67 0 0 54 23G 650M 2957 219 726 464 4838 36464 852 868 65384 4110 558132 1 37 62 0 0 54 23G 641M 1576 245 730 344 1139 33681 740 679 67216 970 560379 0 31 69 [root@san01:nginx/vhost.d]# top last pid: 55190; load averages: 11.32, 12.15, 10.76 up 10+16:05:14 14:38:58 101 processes: 1 running, 100 sleeping CPU: 0.2% user, 0.0% nice, 28.9% system, 1.6% interrupt, 69.3% idle Mem: 85M Active, 1528K Inact, 12K Laundry, 62G Wired, 540M Free ARC: 31G Total, 19G MFU, 6935M MRU, 2979M Anon, 556M Header, 1046M Other 25G Compressed, 34G Uncompressed, 1.39:1 Ratio Swap: 32G Total, 1186M Used, 31G Free, 3% Inuse, 7920K In, 3752K Out PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 40132 root 131 52 0 3152M 75876K uwait 14 36:59 6.10% java 55142 root 1 20 0 7904K 2728K CPU20 20 0:00 0.72% top 20026 root 1 20 0 106M 5676K nanslp 28 1:23 0.60% gstat 53642 root 1 20 0 7904K 2896K select 14 0:03 0.58% top 977 zfsreplica 1 20 0 30300K 3568K kqread 21 4:00 0.42% uwsgi 968 zfsreplica 1 20 0 30300K 2224K swread 11 2:03 0.21% uwsgi 973 zfsreplica 1 20 0 30300K 2264K swread 13 12:26 0.13% uwsgi 53000 www 1 20 0 23376K 1372K kqread 24 0:00 0.05% nginx 1292 root 1 20 0 6584K 2040K select 29 0:23 0.04% blacklistd 776 zabbix 1 20 0 12408K 4236K nanslp 26 4:42 0.03% zabbix_agentd 1289 root 1 20 0 67760K 5148K select 13 9:50 0.03% bsnmpd 777 zabbix 1 20 0 12408K 1408K select 25 5:06 0.03% zabbix_agentd 785 zfsreplica 1 20 0 27688K 3960K kqread 28 2:04 0.02% uwsgi 975 zfsreplica 1 20 0 30300K 464K kqread 18 2:33 0.02% uwsgi 974 zfsreplica 1 20 0 30300K 480K kqread 30 3:39 0.02% uwsgi 965 zfsreplica 1 20 0 30300K 464K kqread 4 3:23 0.02% uwsgi 976 zfsreplica 1 20 0 30300K 464K kqread 14 2:59 0.01% uwsgi 972 zfsreplica 1 20 0 30300K 464K kqread 10 2:57 0.01% uwsgi 963 zfsreplica 1 20 0 30300K 460K kqread 3 2:45 0.01% uwsgi 971 zfsreplica 1 20 0 30300K 464K kqread 13 3:16 0.01% uwsgi 69644 emz 1 20 0 13148K 4596K select 24 0:05 0.01% sshd 18203 vryabov 1 20 0 13148K 4624K select 9 0:02 0.01% sshd 636 root 1 20 0 6412K 1884K select 17 4:10 0.01% syslogd 51266 emz 1 20 0 13148K 4576K select 5 0:00 0.01% sshd 964 zfsreplica 1 20 0 30300K 460K kqread 18 11:02 0.01% uwsgi 962 zfsreplica 1 20 0 30300K 460K kqread 28 6:56 0.01% uwsgi 969 zfsreplica 1 20 0 30300K 464K kqread 12 2:07 0.01% uwsgi 967 zfsreplica 1 20 0 30300K 464K kqread 27 5:18 0.01% uwsgi 970 zfsreplica 1 20 0 30300K 464K kqread 0 4:25 0.01% uwsgi 966 zfsreplica 1 22 0 30300K 468K kqread 14 4:29 0.01% uwsgi 53001 www 1 20 0 23376K 1256K kqread 10 0:00 0.01% nginx 791 zfsreplica 1 20 0 27664K 4244K kqread 17 1:34 0.01% uwsgi 52431 root 1 20 0 17132K 4492K select 21 0:00 0.01% mc 70013 root 1 20 0 17132K 4492K select 4 0:03 0.01% mc 870 root 1 20 0 12448K 12544K select 19 0:51 0.01% ntpd [root@san01:nginx/vhost.d]# zfs-stats -a ------------------------------------------------------------------------ ZFS Subsystem Report Tue Nov 20 14:39:05 2018 ------------------------------------------------------------------------ System Information: Kernel Version: 1102503 (osreldate) Hardware Platform: amd64 Processor Architecture: amd64 ZFS Storage pool Version: 5000 ZFS Filesystem Version: 5 FreeBSD 11.2-STABLE #0 r340287M: Fri Nov 9 22:23:22 +05 2018 emz 14:39 up 10 days, 16:05, 5 users, load averages: 10,96 12,05 10,74 ------------------------------------------------------------------------ System Memory: 0.14% 90.20 MiB Active, 0.01% 8.62 MiB Inact 98.97% 61.57 GiB Wired, 0.00% 0 Cache 0.88% 560.02 MiB Free, -0.00% -184320 Bytes Gap Real Installed: 64.00 GiB Real Available: 99.77% 63.85 GiB Real Managed: 97.43% 62.21 GiB Logical Total: 64.00 GiB Logical Used: 99.13% 63.44 GiB Logical Free: 0.87% 568.64 MiB Kernel Memory: 22.77 GiB Data: 99.84% 22.73 GiB Text: 0.16% 36.52 MiB Kernel Memory Map: 62.21 GiB Size: 46.85% 29.15 GiB Free: 53.15% 33.06 GiB ------------------------------------------------------------------------ ARC Summary: (HEALTHY) Memory Throttle Count: 0 ARC Misc: Deleted: 5.61b Recycle Misses: 0 Mutex Misses: 64.25m Evict Skips: 98.33m ARC Size: 50.02% 30.62 GiB Target Size: (Adaptive) 50.02% 30.62 GiB Min Size (Hard Limit): 12.50% 7.65 GiB Max Size (High Water): 8:1 61.21 GiB ARC Size Breakdown: Recently Used Cache Size: 50.69% 15.52 GiB Frequently Used Cache Size: 49.31% 15.10 GiB ARC Hash Breakdown: Elements Max: 8.35m Elements Current: 30.08% 2.51m Collisions: 2.18b Chain Max: 10 Chains: 308.03k ------------------------------------------------------------------------ ARC Efficiency: 48.52b Cache Hit Ratio: 84.49% 40.99b Cache Miss Ratio: 15.51% 7.53b Actual Hit Ratio: 84.19% 40.85b Data Demand Efficiency: 83.84% 13.06b Data Prefetch Efficiency: 40.66% 1.42b CACHE HITS BY CACHE LIST: Most Recently Used: 15.11% 6.19b Most Frequently Used: 84.54% 34.66b Most Recently Used Ghost: 0.97% 396.23m Most Frequently Used Ghost: 0.18% 75.49m CACHE HITS BY DATA TYPE: Demand Data: 26.70% 10.95b Prefetch Data: 1.41% 576.89m Demand Metadata: 70.83% 29.04b Prefetch Metadata: 1.06% 434.19m CACHE MISSES BY DATA TYPE: Demand Data: 28.04% 2.11b Prefetch Data: 11.18% 841.81m Demand Metadata: 60.37% 4.54b Prefetch Metadata: 0.40% 30.27m ------------------------------------------------------------------------ L2ARC is disabled ------------------------------------------------------------------------ File-Level Prefetch: (HEALTHY) DMU Efficiency: 9.20b Hit Ratio: 5.80% 533.41m Miss Ratio: 94.20% 8.66b Colinear: 0 Hit Ratio: 100.00% 0 Miss Ratio: 100.00% 0 Stride: 0 Hit Ratio: 100.00% 0 Miss Ratio: 100.00% 0 DMU Misc: Reclaim: 0 Successes: 100.00% 0 Failures: 100.00% 0 Streams: 0 +Resets: 100.00% 0 -Resets: 100.00% 0 Bogus: 0 ------------------------------------------------------------------------ VDEV cache is disabled ------------------------------------------------------------------------ ZFS Tunables (sysctl): kern.maxusers 4422 vm.kmem_size 66799345664 vm.kmem_size_scale 1 vm.kmem_size_min 0 vm.kmem_size_max 1319413950874 vfs.zfs.trim.max_interval 1 vfs.zfs.trim.timeout 30 vfs.zfs.trim.txg_delay 32 vfs.zfs.trim.enabled 0 vfs.zfs.vol.immediate_write_sz 131072 vfs.zfs.vol.unmap_sync_enabled 0 vfs.zfs.vol.unmap_enabled 1 vfs.zfs.vol.recursive 0 vfs.zfs.vol.mode 1 vfs.zfs.version.zpl 5 vfs.zfs.version.spa 5000 vfs.zfs.version.acl 1 vfs.zfs.version.ioctl 7 vfs.zfs.debug 0 vfs.zfs.super_owner 0 vfs.zfs.immediate_write_sz 32768 vfs.zfs.sync_pass_rewrite 2 vfs.zfs.sync_pass_dont_compress 5 vfs.zfs.sync_pass_deferred_free 2 vfs.zfs.zio.dva_throttle_enabled 1 vfs.zfs.zio.exclude_metadata 0 vfs.zfs.zio.use_uma 1 vfs.zfs.zil_slog_bulk 786432 vfs.zfs.cache_flush_disable 0 vfs.zfs.zil_replay_disable 0 vfs.zfs.standard_sm_blksz 131072 vfs.zfs.dtl_sm_blksz 4096 vfs.zfs.min_auto_ashift 9 vfs.zfs.max_auto_ashift 13 vfs.zfs.vdev.trim_max_pending 10000 vfs.zfs.vdev.bio_delete_disable 0 vfs.zfs.vdev.bio_flush_disable 0 vfs.zfs.vdev.def_queue_depth 32 vfs.zfs.vdev.queue_depth_pct 1000 vfs.zfs.vdev.write_gap_limit 4096 vfs.zfs.vdev.read_gap_limit 32768 vfs.zfs.vdev.aggregation_limit 1048576 vfs.zfs.vdev.trim_max_active 64 vfs.zfs.vdev.trim_min_active 1 vfs.zfs.vdev.scrub_max_active 2 vfs.zfs.vdev.scrub_min_active 1 vfs.zfs.vdev.async_write_max_active 10 vfs.zfs.vdev.async_write_min_active 1 vfs.zfs.vdev.async_read_max_active 3 vfs.zfs.vdev.async_read_min_active 1 vfs.zfs.vdev.sync_write_max_active 10 vfs.zfs.vdev.sync_write_min_active 10 vfs.zfs.vdev.sync_read_max_active 10 vfs.zfs.vdev.sync_read_min_active 10 vfs.zfs.vdev.max_active 1000 vfs.zfs.vdev.async_write_active_max_dirty_percent60 vfs.zfs.vdev.async_write_active_min_dirty_percent30 vfs.zfs.vdev.mirror.non_rotating_seek_inc1 vfs.zfs.vdev.mirror.non_rotating_inc 0 vfs.zfs.vdev.mirror.rotating_seek_offset1048576 vfs.zfs.vdev.mirror.rotating_seek_inc 5 vfs.zfs.vdev.mirror.rotating_inc 0 vfs.zfs.vdev.trim_on_init 1 vfs.zfs.vdev.cache.bshift 16 vfs.zfs.vdev.cache.size 0 vfs.zfs.vdev.cache.max 16384 vfs.zfs.vdev.default_ms_shift 29 vfs.zfs.vdev.min_ms_count 16 vfs.zfs.vdev.max_ms_count 200 vfs.zfs.txg.timeout 5 vfs.zfs.space_map_ibs 14 vfs.zfs.spa_allocators 4 vfs.zfs.spa_min_slop 134217728 vfs.zfs.spa_slop_shift 5 vfs.zfs.spa_asize_inflation 24 vfs.zfs.deadman_enabled 1 vfs.zfs.deadman_checktime_ms 5000 vfs.zfs.deadman_synctime_ms 1000000 vfs.zfs.debug_flags 0 vfs.zfs.debugflags 0 vfs.zfs.recover 0 vfs.zfs.spa_load_verify_data 1 vfs.zfs.spa_load_verify_metadata 1 vfs.zfs.spa_load_verify_maxinflight 10000 vfs.zfs.max_missing_tvds_scan 0 vfs.zfs.max_missing_tvds_cachefile 2 vfs.zfs.max_missing_tvds 0 vfs.zfs.spa_load_print_vdev_tree 0 vfs.zfs.ccw_retry_interval 300 vfs.zfs.check_hostid 1 vfs.zfs.mg_fragmentation_threshold 85 vfs.zfs.mg_noalloc_threshold 0 vfs.zfs.condense_pct 200 vfs.zfs.metaslab_sm_blksz 4096 vfs.zfs.metaslab.bias_enabled 1 vfs.zfs.metaslab.lba_weighting_enabled 1 vfs.zfs.metaslab.fragmentation_factor_enabled1 vfs.zfs.metaslab.preload_enabled 1 vfs.zfs.metaslab.preload_limit 3 vfs.zfs.metaslab.unload_delay 8 vfs.zfs.metaslab.load_pct 50 vfs.zfs.metaslab.min_alloc_size 33554432 vfs.zfs.metaslab.df_free_pct 4 vfs.zfs.metaslab.df_alloc_threshold 131072 vfs.zfs.metaslab.debug_unload 0 vfs.zfs.metaslab.debug_load 0 vfs.zfs.metaslab.fragmentation_threshold70 vfs.zfs.metaslab.force_ganging 16777217 vfs.zfs.free_bpobj_enabled 1 vfs.zfs.free_max_blocks -1 vfs.zfs.zfs_scan_checkpoint_interval 7200 vfs.zfs.zfs_scan_legacy 0 vfs.zfs.no_scrub_prefetch 0 vfs.zfs.no_scrub_io 0 vfs.zfs.resilver_min_time_ms 3000 vfs.zfs.free_min_time_ms 1000 vfs.zfs.scan_min_time_ms 1000 vfs.zfs.scan_idle 50 vfs.zfs.scrub_delay 4 vfs.zfs.resilver_delay 2 vfs.zfs.top_maxinflight 32 vfs.zfs.zfetch.array_rd_sz 1048576 vfs.zfs.zfetch.max_idistance 67108864 vfs.zfs.zfetch.max_distance 8388608 vfs.zfs.zfetch.min_sec_reap 2 vfs.zfs.zfetch.max_streams 8 vfs.zfs.prefetch_disable 0 vfs.zfs.delay_scale 500000 vfs.zfs.delay_min_dirty_percent 60 vfs.zfs.dirty_data_sync 67108864 vfs.zfs.dirty_data_max_percent 10 vfs.zfs.dirty_data_max_max 4294967296 vfs.zfs.dirty_data_max 4294967296 vfs.zfs.max_recordsize 1048576 vfs.zfs.default_ibs 17 vfs.zfs.default_bs 9 vfs.zfs.send_holes_without_birth_time 1 vfs.zfs.mdcomp_disable 0 vfs.zfs.per_txg_dirty_frees_percent 30 vfs.zfs.nopwrite_enabled 1 vfs.zfs.dedup.prefetch 1 vfs.zfs.dbuf_cache_lowater_pct 10 vfs.zfs.dbuf_cache_hiwater_pct 10 vfs.zfs.dbuf_metadata_cache_overflow 0 vfs.zfs.dbuf_metadata_cache_shift 6 vfs.zfs.dbuf_cache_shift 5 vfs.zfs.dbuf_metadata_cache_max_bytes 1026962560 vfs.zfs.dbuf_cache_max_bytes 2053925120 vfs.zfs.arc_min_prescient_prefetch_ms 6 vfs.zfs.arc_min_prefetch_ms 1 vfs.zfs.l2c_only_size 0 vfs.zfs.mfu_ghost_data_esize 1910587392 vfs.zfs.mfu_ghost_metadata_esize 5158840832 vfs.zfs.mfu_ghost_size 7069428224 vfs.zfs.mfu_data_esize 17620227072 vfs.zfs.mfu_metadata_esize 950300160 vfs.zfs.mfu_size 20773338624 vfs.zfs.mru_ghost_data_esize 6989578240 vfs.zfs.mru_ghost_metadata_esize 18479132160 vfs.zfs.mru_ghost_size 25468710400 vfs.zfs.mru_data_esize 4455460352 vfs.zfs.mru_metadata_esize 70236672 vfs.zfs.mru_size 7413314560 vfs.zfs.anon_data_esize 0 vfs.zfs.anon_metadata_esize 0 vfs.zfs.anon_size 3040037888 vfs.zfs.l2arc_norw 1 vfs.zfs.l2arc_feed_again 1 vfs.zfs.l2arc_noprefetch 1 vfs.zfs.l2arc_feed_min_ms 200 vfs.zfs.l2arc_feed_secs 1 vfs.zfs.l2arc_headroom 2 vfs.zfs.l2arc_write_boost 8388608 vfs.zfs.l2arc_write_max 8388608 vfs.zfs.arc_meta_limit 16431400960 vfs.zfs.arc_free_target 113124 vfs.zfs.arc_kmem_cache_reap_retry_ms 0 vfs.zfs.compressed_arc_enabled 1 vfs.zfs.arc_grow_retry 60 vfs.zfs.arc_shrink_shift 7 vfs.zfs.arc_average_blocksize 8192 vfs.zfs.arc_no_grow_shift 5 vfs.zfs.arc_min 8215700480 vfs.zfs.arc_max 65725603840 vfs.zfs.abd_chunk_size 4096 vfs.zfs.abd_scatter_enabled 1 ------------------------------------------------------------------------ From owner-freebsd-stable@freebsd.org Tue Nov 20 10:12:50 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7A6371109423 for ; Tue, 20 Nov 2018 10:12:50 +0000 (UTC) (envelope-from trond@fagskolen.gjovik.no) Received: from smtp.fagskolen.gjovik.no (smtp.fagskolen.gjovik.no [IPv6:2001:700:1100:1:200:ff:fe00:b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.fagskolen.gjovik.no", Issuer "Fagskolen i Gj??vik" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 12366846A8 for ; Tue, 20 Nov 2018 10:12:43 +0000 (UTC) (envelope-from trond@fagskolen.gjovik.no) Received: from mail.fig.ol.no (localhost [127.0.0.1]) by mail.fig.ol.no (8.15.2/8.15.2) with ESMTPS id wAKACa5Y049499 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Tue, 20 Nov 2018 11:12:36 +0100 (CET) (envelope-from trond@fagskolen.gjovik.no) Received: from localhost (trond@localhost) by mail.fig.ol.no (8.15.2/8.15.2/Submit) with ESMTP id wAKACa9E049496 for ; Tue, 20 Nov 2018 11:12:36 +0100 (CET) (envelope-from trond@fagskolen.gjovik.no) X-Authentication-Warning: mail.fig.ol.no: trond owned process doing -bs Date: Tue, 20 Nov 2018 11:12:36 +0100 (CET) From: =?ISO-8859-1?Q?Trond_Endrest=F8l?= Sender: Trond.Endrestol@fagskolen.gjovik.no To: FreeBSD stable Subject: Re: plenty of memory, but system us intensively swapping In-Reply-To: <1ddb53ff-23a8-b364-0213-d8df3c7dcd3c@zhegan.in> Message-ID: References: <1ddb53ff-23a8-b364-0213-d8df3c7dcd3c@zhegan.in> User-Agent: Alpine 2.21.9999 (BSF 287 2018-06-16) Organization: Fagskolen Innlandet OpenPGP: url=http://fig.ol.no/~trond/trond.key MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on mail.fig.ol.no X-Rspamd-Queue-Id: 12366846A8 X-Spamd-Result: default: False [0.11 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.21)[-0.207,0]; NEURAL_HAM_LONG(-0.23)[-0.229,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[fagskolen.gjovik.no]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[smtp.fagskolen.gjovik.no]; NEURAL_SPAM_SHORT(0.59)[0.592,0]; IP_SCORE(-0.03)[ipnet: 2001:700::/32(-0.01), asn: 224(-0.14), country: NO(-0.01)]; FORGED_SENDER(0.30)[Trond.Endrestol@fagskolen.gjovik.no,trond@fagskolen.gjovik.no]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:224, ipnet:2001:700::/32, country:NO]; FROM_NEQ_ENVFROM(0.00)[Trond.Endrestol@fagskolen.gjovik.no, trond@fagskolen.gjovik.no] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 10:12:50 -0000 On Tue, 20 Nov 2018 14:53+0500, Eugene M. Zheganin wrote: > Hello, > > > I have a recent FreeBSD 11-STABLE which is mainly used as an iSCSI target. The > system has 64G of RAM but is swapping intensively. Yup, about of half of the > memory is used as ZFS ARC (isn't capped in loader.conf), and another half is > eaten by the kernel, but it oly uses only about half of it (thus 25% of the > total amount). > > Could this be tweaked by some sysctl oids (I suppose not, but worth asking). On freebsd-hackers the other day, https://lists.freebsd.org/pipermail/freebsd-hackers/2018-November/053575.html, it was suggested to set vm.pageout_update_period=0. This sysctl is at 600 initially. ZFS' ARC needs to be capped, otherwise it will eat most, if not all, of your memory. > top, vmstat 1 snapshots and zfs-stats -a are listed below. > > > Thanks. > > > [root@san01:nginx/vhost.d]# vmstat 1 > procs memory page disks faults cpu > r b w avm fre flt re pi po fr sr da0 da1 in sy cs us sy id > 0 0 38 23G 609M 1544 68 118 64 895 839 0 0 3644 2678 649 0 13 > 87 > 0 0 53 23G 601M 1507 185 742 315 1780 33523 651 664 56438 785 476583 0 28 > 72 > 0 0 53 23G 548M 1727 330 809 380 2377 33256 758 763 55555 1273 468545 0 > 26 73 > 0 0 53 23G 528M 1702 239 660 305 1347 32335 611 631 59962 1025 490365 0 > 22 78 > 0 0 52 23G 854M 2409 309 693 203 97943 16944 525 515 64309 1570 540533 0 > 29 71 > 3 0 54 23G 1.1G 2756 639 641 149 124049 19531 542 538 64777 1576 553946 0 > 35 65 > 0 0 53 23G 982M 1694 236 680 282 2754 35602 597 603 66540 1385 583687 0 > 28 72 > 0 0 41 23G 867M 1882 223 767 307 1162 34936 682 638 67284 780 568818 0 33 > 67 > 0 0 39 23G 769M 1542 167 673 336 1187 35123 646 610 65925 1176 551623 0 > 23 77 > 2 0 41 23G 700M 3602 535 688 327 2192 37109 622 594 65862 4256 518934 0 > 33 67 > 0 0 54 23G 650M 2957 219 726 464 4838 36464 852 868 65384 4110 558132 1 > 37 62 > 0 0 54 23G 641M 1576 245 730 344 1139 33681 740 679 67216 970 560379 0 31 > 69 > > > [root@san01:nginx/vhost.d]# top > last pid: 55190; load averages: 11.32, 12.15, 10.76 > up 10+16:05:14 14:38:58 > 101 processes: 1 running, 100 sleeping > CPU: 0.2% user, 0.0% nice, 28.9% system, 1.6% interrupt, 69.3% idle > Mem: 85M Active, 1528K Inact, 12K Laundry, 62G Wired, 540M Free > ARC: 31G Total, 19G MFU, 6935M MRU, 2979M Anon, 556M Header, 1046M Other > 25G Compressed, 34G Uncompressed, 1.39:1 Ratio > Swap: 32G Total, 1186M Used, 31G Free, 3% Inuse, 7920K In, 3752K Out > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 40132 root 131 52 0 3152M 75876K uwait 14 36:59 6.10% java > 55142 root 1 20 0 7904K 2728K CPU20 20 0:00 0.72% top > 20026 root 1 20 0 106M 5676K nanslp 28 1:23 0.60% gstat > 53642 root 1 20 0 7904K 2896K select 14 0:03 0.58% top > 977 zfsreplica 1 20 0 30300K 3568K kqread 21 4:00 0.42% uwsgi > 968 zfsreplica 1 20 0 30300K 2224K swread 11 2:03 0.21% uwsgi > 973 zfsreplica 1 20 0 30300K 2264K swread 13 12:26 0.13% uwsgi > 53000 www 1 20 0 23376K 1372K kqread 24 0:00 0.05% nginx > 1292 root 1 20 0 6584K 2040K select 29 0:23 0.04% > blacklistd > 776 zabbix 1 20 0 12408K 4236K nanslp 26 4:42 0.03% > zabbix_agentd > 1289 root 1 20 0 67760K 5148K select 13 9:50 0.03% bsnmpd > 777 zabbix 1 20 0 12408K 1408K select 25 5:06 0.03% > zabbix_agentd > 785 zfsreplica 1 20 0 27688K 3960K kqread 28 2:04 0.02% uwsgi > 975 zfsreplica 1 20 0 30300K 464K kqread 18 2:33 0.02% uwsgi > 974 zfsreplica 1 20 0 30300K 480K kqread 30 3:39 0.02% uwsgi > 965 zfsreplica 1 20 0 30300K 464K kqread 4 3:23 0.02% uwsgi > 976 zfsreplica 1 20 0 30300K 464K kqread 14 2:59 0.01% uwsgi > 972 zfsreplica 1 20 0 30300K 464K kqread 10 2:57 0.01% uwsgi > 963 zfsreplica 1 20 0 30300K 460K kqread 3 2:45 0.01% uwsgi > 971 zfsreplica 1 20 0 30300K 464K kqread 13 3:16 0.01% uwsgi > 69644 emz 1 20 0 13148K 4596K select 24 0:05 0.01% sshd > 18203 vryabov 1 20 0 13148K 4624K select 9 0:02 0.01% sshd > 636 root 1 20 0 6412K 1884K select 17 4:10 0.01% syslogd > 51266 emz 1 20 0 13148K 4576K select 5 0:00 0.01% sshd > 964 zfsreplica 1 20 0 30300K 460K kqread 18 11:02 0.01% uwsgi > 962 zfsreplica 1 20 0 30300K 460K kqread 28 6:56 0.01% uwsgi > 969 zfsreplica 1 20 0 30300K 464K kqread 12 2:07 0.01% uwsgi > 967 zfsreplica 1 20 0 30300K 464K kqread 27 5:18 0.01% uwsgi > 970 zfsreplica 1 20 0 30300K 464K kqread 0 4:25 0.01% uwsgi > 966 zfsreplica 1 22 0 30300K 468K kqread 14 4:29 0.01% uwsgi > 53001 www 1 20 0 23376K 1256K kqread 10 0:00 0.01% nginx > 791 zfsreplica 1 20 0 27664K 4244K kqread 17 1:34 0.01% uwsgi > 52431 root 1 20 0 17132K 4492K select 21 0:00 0.01% mc > 70013 root 1 20 0 17132K 4492K select 4 0:03 0.01% mc > 870 root 1 20 0 12448K 12544K select 19 0:51 0.01% ntpd > [root@san01:nginx/vhost.d]# zfs-stats -a > ------------------------------------------------------------------------ > ZFS Subsystem Report Tue Nov 20 14:39:05 2018 > ------------------------------------------------------------------------ > System Information: > Kernel Version: 1102503 (osreldate) > Hardware Platform: amd64 > Processor Architecture: amd64 > ZFS Storage pool Version: 5000 > ZFS Filesystem Version: 5 > FreeBSD 11.2-STABLE #0 r340287M: Fri Nov 9 22:23:22 +05 2018 emz > 14:39 up 10 days, 16:05, 5 users, load averages: 10,96 12,05 10,74 > ------------------------------------------------------------------------ > System Memory: > 0.14% 90.20 MiB Active, 0.01% 8.62 MiB Inact > 98.97% 61.57 GiB Wired, 0.00% 0 Cache > 0.88% 560.02 MiB Free, -0.00% -184320 Bytes Gap > Real Installed: 64.00 GiB > Real Available: 99.77% 63.85 GiB > Real Managed: 97.43% 62.21 GiB > Logical Total: 64.00 GiB > Logical Used: 99.13% 63.44 GiB > Logical Free: 0.87% 568.64 MiB > Kernel Memory: 22.77 GiB > Data: 99.84% 22.73 GiB > Text: 0.16% 36.52 MiB > Kernel Memory Map: 62.21 GiB > Size: 46.85% 29.15 GiB > Free: 53.15% 33.06 GiB > ------------------------------------------------------------------------ > ARC Summary: (HEALTHY) > Memory Throttle Count: 0 > ARC Misc: > Deleted: 5.61b > Recycle Misses: 0 > Mutex Misses: 64.25m > Evict Skips: 98.33m > ARC Size: 50.02% 30.62 GiB > Target Size: (Adaptive) 50.02% 30.62 GiB > Min Size (Hard Limit): 12.50% 7.65 GiB > Max Size (High Water): 8:1 61.21 GiB > ARC Size Breakdown: > Recently Used Cache Size: 50.69% 15.52 GiB > Frequently Used Cache Size: 49.31% 15.10 GiB > ARC Hash Breakdown: > Elements Max: 8.35m > Elements Current: 30.08% 2.51m > Collisions: 2.18b > Chain Max: 10 > Chains: 308.03k > ------------------------------------------------------------------------ > ARC Efficiency: 48.52b > Cache Hit Ratio: 84.49% 40.99b > Cache Miss Ratio: 15.51% 7.53b > Actual Hit Ratio: 84.19% 40.85b > Data Demand Efficiency: 83.84% 13.06b > Data Prefetch Efficiency: 40.66% 1.42b > CACHE HITS BY CACHE LIST: > Most Recently Used: 15.11% 6.19b > Most Frequently Used: 84.54% 34.66b > Most Recently Used Ghost: 0.97% 396.23m > Most Frequently Used Ghost: 0.18% 75.49m > CACHE HITS BY DATA TYPE: > Demand Data: 26.70% 10.95b > Prefetch Data: 1.41% 576.89m > Demand Metadata: 70.83% 29.04b > Prefetch Metadata: 1.06% 434.19m > CACHE MISSES BY DATA TYPE: > Demand Data: 28.04% 2.11b > Prefetch Data: 11.18% 841.81m > Demand Metadata: 60.37% 4.54b > Prefetch Metadata: 0.40% 30.27m > ------------------------------------------------------------------------ > L2ARC is disabled > ------------------------------------------------------------------------ > File-Level Prefetch: (HEALTHY) > DMU Efficiency: 9.20b > Hit Ratio: 5.80% 533.41m > Miss Ratio: 94.20% 8.66b > Colinear: 0 > Hit Ratio: 100.00% 0 > Miss Ratio: 100.00% 0 > Stride: 0 > Hit Ratio: 100.00% 0 > Miss Ratio: 100.00% 0 > DMU Misc: > Reclaim: 0 > Successes: 100.00% 0 > Failures: 100.00% 0 > Streams: 0 > +Resets: 100.00% 0 > -Resets: 100.00% 0 > Bogus: 0 > ------------------------------------------------------------------------ > VDEV cache is disabled > ------------------------------------------------------------------------ > ZFS Tunables (sysctl): > kern.maxusers 4422 > vm.kmem_size 66799345664 > vm.kmem_size_scale 1 > vm.kmem_size_min 0 > vm.kmem_size_max 1319413950874 > vfs.zfs.trim.max_interval 1 > vfs.zfs.trim.timeout 30 > vfs.zfs.trim.txg_delay 32 > vfs.zfs.trim.enabled 0 > vfs.zfs.vol.immediate_write_sz 131072 > vfs.zfs.vol.unmap_sync_enabled 0 > vfs.zfs.vol.unmap_enabled 1 > vfs.zfs.vol.recursive 0 > vfs.zfs.vol.mode 1 > vfs.zfs.version.zpl 5 > vfs.zfs.version.spa 5000 > vfs.zfs.version.acl 1 > vfs.zfs.version.ioctl 7 > vfs.zfs.debug 0 > vfs.zfs.super_owner 0 > vfs.zfs.immediate_write_sz 32768 > vfs.zfs.sync_pass_rewrite 2 > vfs.zfs.sync_pass_dont_compress 5 > vfs.zfs.sync_pass_deferred_free 2 > vfs.zfs.zio.dva_throttle_enabled 1 > vfs.zfs.zio.exclude_metadata 0 > vfs.zfs.zio.use_uma 1 > vfs.zfs.zil_slog_bulk 786432 > vfs.zfs.cache_flush_disable 0 > vfs.zfs.zil_replay_disable 0 > vfs.zfs.standard_sm_blksz 131072 > vfs.zfs.dtl_sm_blksz 4096 > vfs.zfs.min_auto_ashift 9 > vfs.zfs.max_auto_ashift 13 > vfs.zfs.vdev.trim_max_pending 10000 > vfs.zfs.vdev.bio_delete_disable 0 > vfs.zfs.vdev.bio_flush_disable 0 > vfs.zfs.vdev.def_queue_depth 32 > vfs.zfs.vdev.queue_depth_pct 1000 > vfs.zfs.vdev.write_gap_limit 4096 > vfs.zfs.vdev.read_gap_limit 32768 > vfs.zfs.vdev.aggregation_limit 1048576 > vfs.zfs.vdev.trim_max_active 64 > vfs.zfs.vdev.trim_min_active 1 > vfs.zfs.vdev.scrub_max_active 2 > vfs.zfs.vdev.scrub_min_active 1 > vfs.zfs.vdev.async_write_max_active 10 > vfs.zfs.vdev.async_write_min_active 1 > vfs.zfs.vdev.async_read_max_active 3 > vfs.zfs.vdev.async_read_min_active 1 > vfs.zfs.vdev.sync_write_max_active 10 > vfs.zfs.vdev.sync_write_min_active 10 > vfs.zfs.vdev.sync_read_max_active 10 > vfs.zfs.vdev.sync_read_min_active 10 > vfs.zfs.vdev.max_active 1000 > vfs.zfs.vdev.async_write_active_max_dirty_percent60 > vfs.zfs.vdev.async_write_active_min_dirty_percent30 > vfs.zfs.vdev.mirror.non_rotating_seek_inc1 > vfs.zfs.vdev.mirror.non_rotating_inc 0 > vfs.zfs.vdev.mirror.rotating_seek_offset1048576 > vfs.zfs.vdev.mirror.rotating_seek_inc 5 > vfs.zfs.vdev.mirror.rotating_inc 0 > vfs.zfs.vdev.trim_on_init 1 > vfs.zfs.vdev.cache.bshift 16 > vfs.zfs.vdev.cache.size 0 > vfs.zfs.vdev.cache.max 16384 > vfs.zfs.vdev.default_ms_shift 29 > vfs.zfs.vdev.min_ms_count 16 > vfs.zfs.vdev.max_ms_count 200 > vfs.zfs.txg.timeout 5 > vfs.zfs.space_map_ibs 14 > vfs.zfs.spa_allocators 4 > vfs.zfs.spa_min_slop 134217728 > vfs.zfs.spa_slop_shift 5 > vfs.zfs.spa_asize_inflation 24 > vfs.zfs.deadman_enabled 1 > vfs.zfs.deadman_checktime_ms 5000 > vfs.zfs.deadman_synctime_ms 1000000 > vfs.zfs.debug_flags 0 > vfs.zfs.debugflags 0 > vfs.zfs.recover 0 > vfs.zfs.spa_load_verify_data 1 > vfs.zfs.spa_load_verify_metadata 1 > vfs.zfs.spa_load_verify_maxinflight 10000 > vfs.zfs.max_missing_tvds_scan 0 > vfs.zfs.max_missing_tvds_cachefile 2 > vfs.zfs.max_missing_tvds 0 > vfs.zfs.spa_load_print_vdev_tree 0 > vfs.zfs.ccw_retry_interval 300 > vfs.zfs.check_hostid 1 > vfs.zfs.mg_fragmentation_threshold 85 > vfs.zfs.mg_noalloc_threshold 0 > vfs.zfs.condense_pct 200 > vfs.zfs.metaslab_sm_blksz 4096 > vfs.zfs.metaslab.bias_enabled 1 > vfs.zfs.metaslab.lba_weighting_enabled 1 > vfs.zfs.metaslab.fragmentation_factor_enabled1 > vfs.zfs.metaslab.preload_enabled 1 > vfs.zfs.metaslab.preload_limit 3 > vfs.zfs.metaslab.unload_delay 8 > vfs.zfs.metaslab.load_pct 50 > vfs.zfs.metaslab.min_alloc_size 33554432 > vfs.zfs.metaslab.df_free_pct 4 > vfs.zfs.metaslab.df_alloc_threshold 131072 > vfs.zfs.metaslab.debug_unload 0 > vfs.zfs.metaslab.debug_load 0 > vfs.zfs.metaslab.fragmentation_threshold70 > vfs.zfs.metaslab.force_ganging 16777217 > vfs.zfs.free_bpobj_enabled 1 > vfs.zfs.free_max_blocks -1 > vfs.zfs.zfs_scan_checkpoint_interval 7200 > vfs.zfs.zfs_scan_legacy 0 > vfs.zfs.no_scrub_prefetch 0 > vfs.zfs.no_scrub_io 0 > vfs.zfs.resilver_min_time_ms 3000 > vfs.zfs.free_min_time_ms 1000 > vfs.zfs.scan_min_time_ms 1000 > vfs.zfs.scan_idle 50 > vfs.zfs.scrub_delay 4 > vfs.zfs.resilver_delay 2 > vfs.zfs.top_maxinflight 32 > vfs.zfs.zfetch.array_rd_sz 1048576 > vfs.zfs.zfetch.max_idistance 67108864 > vfs.zfs.zfetch.max_distance 8388608 > vfs.zfs.zfetch.min_sec_reap 2 > vfs.zfs.zfetch.max_streams 8 > vfs.zfs.prefetch_disable 0 > vfs.zfs.delay_scale 500000 > vfs.zfs.delay_min_dirty_percent 60 > vfs.zfs.dirty_data_sync 67108864 > vfs.zfs.dirty_data_max_percent 10 > vfs.zfs.dirty_data_max_max 4294967296 > vfs.zfs.dirty_data_max 4294967296 > vfs.zfs.max_recordsize 1048576 > vfs.zfs.default_ibs 17 > vfs.zfs.default_bs 9 > vfs.zfs.send_holes_without_birth_time 1 > vfs.zfs.mdcomp_disable 0 > vfs.zfs.per_txg_dirty_frees_percent 30 > vfs.zfs.nopwrite_enabled 1 > vfs.zfs.dedup.prefetch 1 > vfs.zfs.dbuf_cache_lowater_pct 10 > vfs.zfs.dbuf_cache_hiwater_pct 10 > vfs.zfs.dbuf_metadata_cache_overflow 0 > vfs.zfs.dbuf_metadata_cache_shift 6 > vfs.zfs.dbuf_cache_shift 5 > vfs.zfs.dbuf_metadata_cache_max_bytes 1026962560 > vfs.zfs.dbuf_cache_max_bytes 2053925120 > vfs.zfs.arc_min_prescient_prefetch_ms 6 > vfs.zfs.arc_min_prefetch_ms 1 > vfs.zfs.l2c_only_size 0 > vfs.zfs.mfu_ghost_data_esize 1910587392 > vfs.zfs.mfu_ghost_metadata_esize 5158840832 > vfs.zfs.mfu_ghost_size 7069428224 > vfs.zfs.mfu_data_esize 17620227072 > vfs.zfs.mfu_metadata_esize 950300160 > vfs.zfs.mfu_size 20773338624 > vfs.zfs.mru_ghost_data_esize 6989578240 > vfs.zfs.mru_ghost_metadata_esize 18479132160 > vfs.zfs.mru_ghost_size 25468710400 > vfs.zfs.mru_data_esize 4455460352 > vfs.zfs.mru_metadata_esize 70236672 > vfs.zfs.mru_size 7413314560 > vfs.zfs.anon_data_esize 0 > vfs.zfs.anon_metadata_esize 0 > vfs.zfs.anon_size 3040037888 > vfs.zfs.l2arc_norw 1 > vfs.zfs.l2arc_feed_again 1 > vfs.zfs.l2arc_noprefetch 1 > vfs.zfs.l2arc_feed_min_ms 200 > vfs.zfs.l2arc_feed_secs 1 > vfs.zfs.l2arc_headroom 2 > vfs.zfs.l2arc_write_boost 8388608 > vfs.zfs.l2arc_write_max 8388608 > vfs.zfs.arc_meta_limit 16431400960 > vfs.zfs.arc_free_target 113124 > vfs.zfs.arc_kmem_cache_reap_retry_ms 0 > vfs.zfs.compressed_arc_enabled 1 > vfs.zfs.arc_grow_retry 60 > vfs.zfs.arc_shrink_shift 7 > vfs.zfs.arc_average_blocksize 8192 > vfs.zfs.arc_no_grow_shift 5 > vfs.zfs.arc_min 8215700480 > vfs.zfs.arc_max 65725603840 > vfs.zfs.abd_chunk_size 4096 > vfs.zfs.abd_scatter_enabled 1 > ------------------------------------------------------------------------ -- Trond. From owner-freebsd-stable@freebsd.org Tue Nov 20 10:22:11 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9431C1109957 for ; Tue, 20 Nov 2018 10:22:11 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id DB0F684E2A for ; Tue, 20 Nov 2018 10:22:10 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from bsdrookie.norma.com. (asterisk.enaza.ru [91.237.76.254] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id wAKAM7cB043886 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Tue, 20 Nov 2018 15:22:08 +0500 (+05) (envelope-from eugene@zhegan.in) Subject: Re: plenty of memory, but system us intensively swapping To: freebsd-stable@freebsd.org References: <1ddb53ff-23a8-b364-0213-d8df3c7dcd3c@zhegan.in> From: "Eugene M. Zheganin" Message-ID: <192ecadf-4e66-297c-576f-f09e41ad7e29@zhegan.in> Date: Tue, 20 Nov 2018 15:22:07 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.1.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Scan-Time: 0.55 X-Rspamd-Queue-Id: DB0F684E2A X-Spamd-Result: default: False [1.68 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_SPAM_MEDIUM(0.43)[0.435,0]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[zhegan.in]; NEURAL_SPAM_SHORT(0.84)[0.842,0]; MX_GOOD(-0.01)[cached: mail-backup.zhegan.in]; NEURAL_SPAM_LONG(0.71)[0.710,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(0.00)[country: RU(0.01)]; ASN(0.00)[asn:57401, ipnet:2a00:7540:1::/48, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 10:22:11 -0000 Hello, On 20.11.2018 15:12, Trond Endrestøl wrote: > On freebsd-hackers the other day, > https://lists.freebsd.org/pipermail/freebsd-hackers/2018-November/053575.html, > it was suggested to set vm.pageout_update_period=0. This sysctl is at > 600 initially. > > ZFS' ARC needs to be capped, otherwise it will eat most, if not all, > of your memory. Well, as you can see, ARC ate only half, and the other half is eaten by the kernel. So far I suppose that if I will cap the ARC, the kernel will simply eat the rest. Eugene. From owner-freebsd-stable@freebsd.org Tue Nov 20 11:22:36 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 49F7C1121B53 for ; Tue, 20 Nov 2018 11:22:36 +0000 (UTC) (envelope-from trond@fagskolen.gjovik.no) Received: from smtp.fagskolen.gjovik.no (smtp.fagskolen.gjovik.no [IPv6:2001:700:1100:1:200:ff:fe00:b]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.fagskolen.gjovik.no", Issuer "Fagskolen i Gj??vik" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 48DE687550 for ; Tue, 20 Nov 2018 11:22:35 +0000 (UTC) (envelope-from trond@fagskolen.gjovik.no) Received: from mail.fig.ol.no (localhost [127.0.0.1]) by mail.fig.ol.no (8.15.2/8.15.2) with ESMTPS id wAKBMVil049909 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Tue, 20 Nov 2018 12:22:31 +0100 (CET) (envelope-from trond@fagskolen.gjovik.no) Received: from localhost (trond@localhost) by mail.fig.ol.no (8.15.2/8.15.2/Submit) with ESMTP id wAKBMVBs049906 for ; Tue, 20 Nov 2018 12:22:31 +0100 (CET) (envelope-from trond@fagskolen.gjovik.no) X-Authentication-Warning: mail.fig.ol.no: trond owned process doing -bs Date: Tue, 20 Nov 2018 12:22:31 +0100 (CET) From: =?ISO-8859-1?Q?Trond_Endrest=F8l?= Sender: Trond.Endrestol@fagskolen.gjovik.no To: FreeBSD stable Subject: Re: plenty of memory, but system us intensively swapping In-Reply-To: <192ecadf-4e66-297c-576f-f09e41ad7e29@zhegan.in> Message-ID: References: <1ddb53ff-23a8-b364-0213-d8df3c7dcd3c@zhegan.in> <192ecadf-4e66-297c-576f-f09e41ad7e29@zhegan.in> User-Agent: Alpine 2.21.9999 (BSF 287 2018-06-16) Organization: Fagskolen Innlandet OpenPGP: url=http://fig.ol.no/~trond/trond.key MIME-Version: 1.0 X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on mail.fig.ol.no X-Rspamd-Queue-Id: 48DE687550 X-Spamd-Result: default: False [1.32 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; HAS_XAW(0.00)[]; NEURAL_SPAM_MEDIUM(0.15)[0.149,0]; RCPT_COUNT_ONE(0.00)[1]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[fagskolen.gjovik.no]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: smtp.fagskolen.gjovik.no]; CTYPE_MIXED_BOGUS(1.00)[]; NEURAL_SPAM_LONG(0.16)[0.155,0]; NEURAL_SPAM_SHORT(0.06)[0.056,0]; IP_SCORE(-0.03)[ipnet: 2001:700::/32(-0.01), asn: 224(-0.14), country: NO(-0.01)]; FORGED_SENDER(0.30)[Trond.Endrestol@fagskolen.gjovik.no,trond@fagskolen.gjovik.no]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:224, ipnet:2001:700::/32, country:NO]; FROM_NEQ_ENVFROM(0.00)[Trond.Endrestol@fagskolen.gjovik.no, trond@fagskolen.gjovik.no] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8BIT X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 11:22:36 -0000 On Tue, 20 Nov 2018 15:22+0500, Eugene M. Zheganin wrote: > Hello, > > On 20.11.2018 15:12, Trond Endrestøl wrote: > > On freebsd-hackers the other day, > > https://lists.freebsd.org/pipermail/freebsd-hackers/2018-November/053575.html, > > it was suggested to set vm.pageout_update_period=0. This sysctl is at > > 600 initially. > > > > ZFS' ARC needs to be capped, otherwise it will eat most, if not all, > > of your memory. > Well, as you can see, ARC ate only half, and the other half is eaten by the > kernel. So far I suppose that if I will cap the ARC, the kernel will simply > eat the rest. I know others have created a daemon that observe the ARC and the amount of wired and free memory, and when these values exceed some threshold, the daemon will allocate a number of gigabytes, writing zero to the first byte or word of every page, and then freeing the allocated memory before going back to sleep. The ARC will release most of its allocations and the kernel will also release some but not all of its wired memory, and some user pages are likely to be thrown onto the swap device, turning the user experience to a mild nightmare while waiting for applications to be paged back into memory. ZFS seems to be the common factor in most, if not all, of these cases. I created my own and not so sophisticated C program that I run every now and then: #include #include #include int main(int argc, char **argv) { const size_t pagesize = (size_t)getpagesize(); const size_t gigabyte = 1024ULL * 1024ULL * 1024ULL; size_t amount, n = 1ULL; char *p, *offset; if (argc > 1) { sscanf(argv[1], "%zu", &n); } amount = n * gigabyte; if (amount > 0ULL) { if ( (p = malloc(amount)) != NULL) { for (offset = p; offset < p + amount; offset += pagesize) { *offset = '\0'; } free(p); } else { fprintf(stderr, "%s:%s:%d: unable to allocate %zu gigabyte%s\n", argv[0], __FILE__, __LINE__, n, (n == 1ULL) ? "" : "s"); return 2; } } else { return 1; } return 0; } // main() // allocate_gigabytes.c -- Trond. From owner-freebsd-stable@freebsd.org Tue Nov 20 11:38:54 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 31C0B1122433 for ; Tue, 20 Nov 2018 11:38:54 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 48AE46A08E for ; Tue, 20 Nov 2018 11:38:53 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from bsdrookie.norma.com. (asterisk.enaza.ru [91.237.76.254] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id wAKBckOD046799 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Tue, 20 Nov 2018 16:38:47 +0500 (+05) (envelope-from eugene@zhegan.in) Subject: Re: plenty of memory, but system us intensively swapping To: freebsd-stable@freebsd.org References: <1ddb53ff-23a8-b364-0213-d8df3c7dcd3c@zhegan.in> <192ecadf-4e66-297c-576f-f09e41ad7e29@zhegan.in> From: "Eugene M. Zheganin" Message-ID: <3efa0dd1-11d6-d424-9e37-a96cf7a6cf47@zhegan.in> Date: Tue, 20 Nov 2018 16:38:46 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.1.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Scan-Time: 0.64 X-Rspamd-Queue-Id: 48AE46A08E X-Spamd-Result: default: False [0.64 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.14)[-0.143,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[zhegan.in]; NEURAL_SPAM_SHORT(0.46)[0.456,0]; MX_GOOD(-0.01)[cached: mail-backup.zhegan.in]; NEURAL_SPAM_LONG(0.64)[0.641,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(0.00)[country: RU(0.01)]; ASN(0.00)[asn:57401, ipnet:2a00:7540:1::/48, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 11:38:54 -0000 Hello, On 20.11.2018 16:22, Trond Endrestøl wrote: > > I know others have created a daemon that observe the ARC and the > amount of wired and free memory, and when these values exceed some > threshold, the daemon will allocate a number of gigabytes, writing > zero to the first byte or word of every page, and then freeing the > allocated memory before going back to sleep. > > The ARC will release most of its allocations and the kernel will also > release some but not all of its wired memory, and some user pages are > likely to be thrown onto the swap device, turning the user experience > to a mild nightmare while waiting for applications to be paged back > into memory. > > ZFS seems to be the common factor in most, if not all, of these cases. > > I created my own and not so sophisticated C program that I run every > now and then: > > #include > #include > #include > > int main(int argc, char **argv) > { > const size_t pagesize = (size_t)getpagesize(); > const size_t gigabyte = 1024ULL * 1024ULL * 1024ULL; > > size_t amount, n = 1ULL; > char *p, *offset; > > if (argc > 1) { > sscanf(argv[1], "%zu", &n); > } > > amount = n * gigabyte; > > if (amount > 0ULL) { > if ( (p = malloc(amount)) != NULL) { > for (offset = p; offset < p + amount; offset += pagesize) { > *offset = '\0'; > } > > free(p); > } > else { > fprintf(stderr, > "%s:%s:%d: unable to allocate %zu gigabyte%s\n", > argv[0], __FILE__, __LINE__, > n, (n == 1ULL) ? "" : "s"); > return 2; > } > } > else { > return 1; > } > > return 0; > } // main() > > // allocate_gigabytes.c > Jeez, thanks a lot, this stuff is working. Now the system has 8 Gigs of free memory and stopped swapping. Well, the next question is addressed to the core team which I suppose reads this ML eventually - why we don't have something similar as a watchdog in the base system ? I understand that this solution is architecturally ugly, but it's now worse not to have any, and it still works. At least I'm about to run this periodically. Trond, thanks again. Eugene. From owner-freebsd-stable@freebsd.org Tue Nov 20 12:42:36 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C766C1127E25; Tue, 20 Nov 2018 12:42:35 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 3C2CF6C308; Tue, 20 Nov 2018 12:42:35 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 8B29817C6; Tue, 20 Nov 2018 15:42:33 +0300 (MSK) To: FreeBSD stable , FreeBSD FS Reply-To: lev@FreeBSD.org From: Lev Serebryakov Subject: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. Openpgp: preference=signencrypt Autocrypt: addr=lev@FreeBSD.org; prefer-encrypt=mutual; keydata= xsFNBFKbGksBEADeguVs+XyJc3mL3iiOBqDd16wSk97YTJYOi4VsHsINzJr09oFvNDiaDBIi fLn2p8XcJvehcsF2GSgrfXfw+uK4O1jyNIKJmiYA0EtE+ZbRtvDrrE0w6Q8+SDeKA21SWh3Y vSQ0DJUontbgW55ER2CbEiIUTIn34uQ0kmESAaw/v5p/9ue8yPTmURvv130FqPFz8VPzltqL NxyGt54TxPfKAzAHEIwxlEZ63JOwzloKh1UDBExcsf9nJO08/TAVgR5UZ5njFBPzaaquhRoP qPJLEQQDqxPIlvMNtHKf7iIebE4BHeqgCdJA0BoiR6gpa0wlsZtdrTPK3n4wYSphLvGbhfOZ YW/hbcu7HYS/FImkVxB3iY17kcC1UTnx4ZaYeASPBGOOPbXky1lLfmDGWIFT//70yx+G17qD OZzF1SvJJhGvh6ilFYaWMX7T+nIp6Mcafc4D7AakXM+XdubNXOMlCJhzPcZ0skgAEnYV587w V7em5fDVwQccwvtfezzqKeJAU5TGiywBHSR5Svzk2FwRNf6M//hWkpq0SRR63iOhkHGOAEBi 69GfEIwH2/w24rLxP0E+Hqq8n+EWNkPatw1Mhcl5PKkdvGCjJUaGNMkpBffjyYo254JXRscR eEnwdIkJt4ErDvjb2/UrOFq31wWMOiLzJeVchAgvTHBMRfP9aQARAQABzShMZXYgU2VyZWJy eWFrb3YgPGxldkBzZXJlYnJ5YWtvdi5zcGIucnU+wsGCBBMBCAAsAhsDBwsJCAcDAgEGFQgC CQoLBBYCAwECHgECF4ACGQEFAlKbP8wFCQlmJwEACgkQ6rA8WL/cR4/6VBAAjRMyyX3PBFx/ HxyiIZ698EfwlWUua8Ft4crtrdK52m0qNkbBB9BH8xQgBHG32A1CwyzQnzxHgZuoOWMjh+Qq WJv7dmpM/q/c1GCJHhlPgewXrciTwpAamZILN071u+1GCPWwGRPzfQ/U+k63KJWx9ozf4doM WTTom6Cqcssi4J1u5kkt52a5ZRhsCK9pEVGilk36XTP9BakGrnMSIxF/NK4xeZVX2q+Nuqvf RchyofKXVgLEDLwb1cd/baLtBpDzy0PTN2Zl2lX4kOA6jwTKsqRya9A1Vui1KXwPh2XViTQ1 7Y3l5qg/M+sR73DohezP6bO6huOnLhty17jAqHPNlD6RonDo+j8uIlEg4iMSTN3MhzkBAu0Q pe3ucQ0o1767JiXN3fsNvRzSFhLVNDqPLce4uKlMogsbreXWvdgHGTN1ybOHGbybZnP77yHz uNBacbmG3vL/OLXMqwLdL2JXoiec4DmXjjCdhTBl5xLV9Hz/6VWKqElteg8QFVvHB3tHWzJ4 /rpiVEixytCIII6DS33BXZ0h2EOkK/6AYA2SJxy1vgOH4SZBtDBHoezmHV2nFnq5O0c7AuAB 7WPWgQG0sEwHQPZmg/baRGitRJnaxf/Gvf1DeD1x1VrcoVke2vwBcgDM3kugP8L9hsqic2D3 dI+gP76haeuvNNZr3y9L9zvOwU0EUpsaSwEQALRr3B+OjY/cnJPstz5CVsVWyEZtJtrNviZr tBgbkhlkPm98sEWR4+gbpyeufdYJengDjeGzMDKcLB7h5fICS/j6A8XdlJ40TlbPfNgb6OHa ebaIYKTJpXKR9sD7ZyGivYMofm0em40wGUX7BIkdkomaWj+wUiS0CdXU0FWDj9wv73+Eim+X zZyXeFgIPv97v+pET7DfwKkADOfrkW9s4OfvGVjd+wm35wc8EngQEz0qdPBxx74X7vZFAxlA SXu8gDBJGYt2Bkc3QwULnfeXrZJWgqNPR5o44gGu96yaiOFaN/C6CJtev5ZEX+0ZxbvsHHB7 Z5AtsRURKpZ4w5HFHGhzHtDtoAKgeZ/gbhTVXPHvNQR818eN+Nl5BV8BRF/8yhR6VlJb8GYw h8oKDeVGVYC34+raHZQAM9WoBnN7jlt4T9zzPwtmw5mIahGFgvw1KDr7OItN2ZgtZ20UYC5m Go602nmHq0aPbU6SwGi1xohrliNsKaaciYiMaVIGRQq8iGr9Fe2HlvaA3BpB275i/gCVlUdG y5XLAv+yQMUvn5Z7XVsMroxDk/O+ae1ElyBvKiKyfWGJXTg5XUukkkyQmfWPxWUGoNA1P/P4 GMHSu7/Rqe/7m4uPu/RyTTqsSjjKJdP9kBwEzvqPtXsVoZuShtrptRQJDYflhgE4qmKSMKen ABEBAAHCwWUEGAECAA8FAlKbGksCGwwFCRLMAwAACgkQ6rA8WL/cR48RkA//SNzeW3CI8KHx rA0aeHW6Nb5ieoqVRBGLyjBM06RX6vHB9v4dJL6Z+yV2jGN2s+XZX2HILbuTOwcTxGkI3xTT e0cDXVaF5K8R/liigUjtwuC2v/sWgoWyUmK1Cy9CPYdcXmFq6nESfkUe8DYiGOUULdHq5w63 F53yOZ72iXRBQBZgkhPtRFu4lPYIzOsMag9DIJ9CthR1r0ziqU/keb94Qt3l+aXK7CwGdY7X T4zUIMHNYsuAuyX+NJIXfsN68TT6m7QmlUwxPs13nxmoVQzm4ruV+hlQKh1MtbsjWRkNgPxF IPiqoAEhy8QoddlSvRTwL5Z7zFQiwMdiXU7toL8pfzj/zJR1jELXKMipijrt5MLrV8XX3OPN yZZvh95VIl8mv+iAqwSZUufd2EJnvj5TObB0eH+a+34NWf/XqA3fPjE6KHzmdnw9PZjPEjlx JCPECSs+6gse1+GaEfKYuXzB/ENe2ctlcfx5iQJXFc+/+zG/uU/JX/pXJHA12CUfB5g7lH6X BZIHvRo3VTCDjXgbF5xxDAe5V4exf8d4oSNjQIFLYxxN7zkvH89EN6RPfRgsWN7bYArCwfS9 MOgs9pFeCOewR6qieK150aoqNENGfKFXJup+5VVl6I0mU+j0rgVDZDht2/QgP/Tb4lGBe+ai pOGaK/GYNR+Ad6bUmokKsx4= Organization: FreeBSD Message-ID: Date: Tue, 20 Nov 2018 15:42:24 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="2FzxMLVeuKZ3OUl5Xq0tbApZLtaLIJHCu" X-Rspamd-Queue-Id: 3C2CF6C308 X-Spamd-Result: default: False [0.35 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_SPAM_SHORT(0.54)[0.535,0]; NEURAL_HAM_LONG(-0.22)[-0.218,0]; NEURAL_SPAM_MEDIUM(0.03)[0.028,0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 12:42:36 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --2FzxMLVeuKZ3OUl5Xq0tbApZLtaLIJHCu Content-Type: multipart/mixed; boundary="3NXEgeGscIkTvx5g8diqcZbnH3iAg3lgP"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: FreeBSD stable , FreeBSD FS Message-ID: Subject: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. --3NXEgeGscIkTvx5g8diqcZbnH3iAg3lgP Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable I have server which is mostly torrent box. It uses ZFS and equipped with 16GiB of physical memory. It is running 11-STABLE (r339914 now). I've updated it to r339914 from some 11.1-STABLE revision 3 weeks ago. I was used to see 13-14GiB of memory in ZFS ARC and it was Ok. Sometimes it "locks" under heavy disk load due to ARC memory pressure, but it was bearable, and as ZFS is main reason this server exists, I didn't limit ARC. But new revision (r339914) shows very strange behaivor: ARC is no more than 4GiB, but kernel has 15GiB wired: Mem: 22M Active, 656M Inact, 62M Laundry, 15G Wired, 237M Free ARC: 4252M Total, 2680M MFU, 907M MRU, 3680K Anon, 15M Header, 634M Other= 2789M Compressed, 3126M Uncompressed, 1.12:1 Ratio It is typical numbers for last week: 15G wired, 237M Free, but only 4252M ARC! Where is other 11G of memory?! I've checked USED and FREE in "vmstat -z" output and got this: $ vmstat -z | tr : , | awk -F , '1{print $2*$4,$2*$5,$1}' | sort -n | tail -20 23001088 9171456 MAP ENTRY 29680800 8404320 VM OBJECT 34417408 10813952 256 36377964 2665656 S VFS Cache 50377392 53856 sa_cache 50593792 622985216 zio_buf_131072 68913152 976896 mbuf_cluster 73543680 7225344 mbuf_jumbo_page 92358552 67848 zfs_znode_cache 95731712 51761152 4096 126962880 159581760 dmu_buf_impl_t 150958080 233920512 mbuf_jumbo_9k 165164600 92040 VNODE 192701120 30350880 UMA Slabs 205520896 291504128 zio_data_buf_1048576 222822400 529530880 zio_data_buf_524288 259143168 293476864 zio_buf_512 352485376 377061376 zio_buf_16384 376109552 346474128 dnode_t 2943016960 5761941504 abd_chunk $ And total USED/FREE numbers is very strange for me: $ vmstat -z | tr : , | awk -F , '1{u+=3D$2*$4; f+=3D$2*$5} END{print u,f}= ' 5717965420 9328951088 $ So, only ~5.7G is used and 9.3G is free! But why this memory is not used by ARC anymore and why is it wired and not free? --=20 // Lev Serebryakov --3NXEgeGscIkTvx5g8diqcZbnH3iAg3lgP-- --2FzxMLVeuKZ3OUl5Xq0tbApZLtaLIJHCu Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlv0AThfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R48fbg//RdXbTqLsT62Wmp+HSbl8JMu2TYAyXJ10elr7nhm8wptE+xNoczvvXq9W 2iy8tFBB8vcpdUaMf4MKlioI3c/+IK8aFw7QhoPJi+C1TQ4OaDfMZ6nuwRS4uHF1 /j8x6HYxBEpO4TCacOM7tjzcKVkXdFnsKWyhbqJ2y6iycQTAGzqc+xbAiaHId62x wIo1s0Y4lGpLZigWGKz90Z4IytwmUQYlQeTx14PTH8v9xf6ftpERKvzptirTRsyd MeLL67VzOEKBPOg8RVpNAr9Ti/atc7ZmmbgVfo8MsisKgn9uJEAQSrS7GGebAx19 9Ss4aNbo4EYFlsPR3tULR/pO8mnN+3pMsVqUSEbML9Mu20QTsjHhQ2AP5MWzSDGA 471WHJIPJczOh7qwyx6K0ujQMrD+t/0PDWx8G5ulX0IJxRenNfFWRqfg4gU49jB5 NjyvfOzpcqRniZ+g/M0lJpHk6ZiDXTRSqT8gULPPx+ZJitFvhJHaD6pKr1Qcwu49 TMRTtcysnLxUuV3kXBhYCllGOc0Jxg3HkWkGj7HL7v7PJABGEUyD/FyF/Qjj0Bed 7DkVkGKCb/FqcYSLP3AI8St/KJgM06t7KiTXwIZZvfEdtjVuVWIDy6yU+a6ek99h j2hn9EhsED8y2or5dGhV/jQOdoiuQcSAe+F3Q7yunjOXm4zHDv4= =QkSG -----END PGP SIGNATURE----- --2FzxMLVeuKZ3OUl5Xq0tbApZLtaLIJHCu-- From owner-freebsd-stable@freebsd.org Tue Nov 20 19:30:40 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 517AD113B2BA; Tue, 20 Nov 2018 19:30:40 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D99097E42E; Tue, 20 Nov 2018 19:30:33 +0000 (UTC) (envelope-from emz@norma.perm.ru) Received: from [192.168.243.12] ([192.168.243.12]) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTP id wAKJUTL6064413; Wed, 21 Nov 2018 00:30:30 +0500 (+05) (envelope-from emz@norma.perm.ru) Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. To: freebsd-fs@freebsd.org References: From: "Eugene M. Zheganin" Cc: freebsd-stable@freebsd.org Message-ID: <29d0ab29-c967-ba5e-785e-5cb1ae670c8e@norma.perm.ru> Date: Tue, 20 Nov 2018 22:30:27 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: ru X-Rspamd-Queue-Id: D99097E42E X-Spamd-Result: default: False [-0.46 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.12)[-0.124,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[perm.ru]; IP_SCORE(0.00)[country: RU(0.01)]; MX_GOOD(-0.01)[mail-backup.norma.perm.ru,mail.norma.perm.ru]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.19)[0.186,0]; NEURAL_HAM_SHORT(-0.21)[-0.212,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:57401, ipnet:2a00:7540:1::/48, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 19:30:40 -0000 Hello, 20.11.2018 15:42, Lev Serebryakov пишет: > I have server which is mostly torrent box. It uses ZFS and equipped > with 16GiB of physical memory. It is running 11-STABLE (r339914 now). > > I've updated it to r339914 from some 11.1-STABLE revision 3 weeks ago. > > I was used to see 13-14GiB of memory in ZFS ARC and it was Ok. > Sometimes it "locks" under heavy disk load due to ARC memory pressure, > but it was bearable, and as ZFS is main reason this server exists, I > didn't limit ARC. > > But new revision (r339914) shows very strange behaivor: ARC is no more > than 4GiB, but kernel has 15GiB wired: > > Mem: 22M Active, 656M Inact, 62M Laundry, 15G Wired, 237M Free > ARC: 4252M Total, 2680M MFU, 907M MRU, 3680K Anon, 15M Header, 634M Other > 2789M Compressed, 3126M Uncompressed, 1.12:1 Ratio > > It is typical numbers for last week: 15G wired, 237M Free, but only > 4252M ARC! > > Where is other 11G of memory?! > > [...] > And total USED/FREE numbers is very strange for me: > > $ vmstat -z | tr : , | awk -F , '1{u+=$2*$4; f+=$2*$5} END{print u,f}' > 5717965420 9328951088 > $ > > So, only ~5.7G is used and 9.3G is free! But why this memory is not > used by ARC anymore and why is it wired and not free? I'm getting pretty much same story on recent 11-STABLE from 9th November. Previous versions didn't have that much questions about memory usage (and I run several 11-STABLEs). Eugene. From owner-freebsd-stable@freebsd.org Tue Nov 20 20:45:42 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2D3A6113D56C; Tue, 20 Nov 2018 20:45:42 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-it1-x135.google.com (mail-it1-x135.google.com [IPv6:2607:f8b0:4864:20::135]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6FE9E82D2A; Tue, 20 Nov 2018 20:45:41 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-it1-x135.google.com with SMTP id g85so5489123ita.3; Tue, 20 Nov 2018 12:45:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=eMbHUZxy8M2nGi8S2ZDf+v6rUFOgqm9t31QXsREIh1c=; b=r9jmaEsqh5w2t+TevMnsWRijLiWUIYicnqEs+KhvLMMs7ll+5BzAQz7DCMmOXRWs8f Yyate8KMkqpkd7jtKOndVMlY62JvrCL40Veuza+LFXJVO28lR5pzx6WMJAWRfO+QSEq4 qMAE7j6jWzmBN7WjNQQPMAIuxaUOLjLeV5DIz7XaWqwBahlklMuedldNw7X+lcx/F6kh Lyxv54phSIFc6OeuCSDKnx7RTkoTAlW1801Sx47bs6ImuSf0Ao6I4BHA8CiP33kX5gnD yFk5BJ/B01L3nplyJ/vLGOhXtRl/PK5BfmLsHGQqbsrCowQf/DAhxbsw573K/hWZsQIZ 3/lg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=eMbHUZxy8M2nGi8S2ZDf+v6rUFOgqm9t31QXsREIh1c=; b=mkup9hgjesgi9YXveFGcnMBs228rT3PJuwL+zKRZLd/JyEQ15VA1lqbeO6nqOjfaAy QfSTPMjcgbTvLYQTv2TVynjn+RFsxo+KswCJLqilmLlRChvhMyb3HvMJ5LNBikFGO+W2 /xykFDEXW9NEhPEq3Alg2SBdvgZ6k2V8l7yFzF9gcfezs/dxNSRbQ//JeGzKzkflFXpt 2/+2BdFLObI0ck5HXhydFDe0aHKG1U9GtGL+rtkJkoiCWb0X3TCK/WGr05irUyZFGeAs syHKtEiTH4Yjwr9yhazHG5K/+qm8yya2uIyHDiQmalxsacj1XAdFVUsVXMdPTHR4IAoJ WCrg== X-Gm-Message-State: AA+aEWYClrO4dZGM69G95t6122Uh/tEjCx5XdhkXbJ/H9AOoF6JkfM6a twiLxXQx1rrI28pWQYsfkbs24nYhTcM= X-Google-Smtp-Source: AJdET5dyc5Fzqbdi6w8yYkly9lrgQsl+0gdYwvmYMWujVXZeTzMubVZGDGwg5FGU7b1pezw+sAkljA== X-Received: by 2002:a02:9911:: with SMTP id r17-v6mr3222502jaj.132.1542746740209; Tue, 20 Nov 2018 12:45:40 -0800 (PST) Received: from raichu (toroon0560w-lp130-07-64-229-95-98.dsl.bell.ca. [64.229.95.98]) by smtp.gmail.com with ESMTPSA id v74sm13885641ita.27.2018.11.20.12.45.38 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Tue, 20 Nov 2018 12:45:39 -0800 (PST) Sender: Mark Johnston Date: Tue, 20 Nov 2018 15:45:37 -0500 From: Mark Johnston To: Lev Serebryakov Cc: FreeBSD stable , FreeBSD FS Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. Message-ID: <20181120204537.GB2630@raichu> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: 6FE9E82D2A X-Spamd-Result: default: False [-4.85 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[freebsd.org]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; RCVD_COUNT_THREE(0.00)[3]; IP_SCORE(-2.16)[ip: (-6.71), ipnet: 2607:f8b0::/32(-2.37), asn: 15169(-1.60), country: US(-0.09)]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_IN_DNSWL_NONE(0.00)[5.3.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.98)[-0.981,0]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MID_RHS_NOT_FQDN(0.50)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; SUBJECT_HAS_QUESTION(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Nov 2018 20:45:42 -0000 On Tue, Nov 20, 2018 at 03:42:24PM +0300, Lev Serebryakov wrote: > > I have server which is mostly torrent box. It uses ZFS and equipped > with 16GiB of physical memory. It is running 11-STABLE (r339914 now). > > I've updated it to r339914 from some 11.1-STABLE revision 3 weeks ago. > > I was used to see 13-14GiB of memory in ZFS ARC and it was Ok. > Sometimes it "locks" under heavy disk load due to ARC memory pressure, > but it was bearable, and as ZFS is main reason this server exists, I > didn't limit ARC. > > But new revision (r339914) shows very strange behaivor: ARC is no more > than 4GiB, but kernel has 15GiB wired: > > Mem: 22M Active, 656M Inact, 62M Laundry, 15G Wired, 237M Free > ARC: 4252M Total, 2680M MFU, 907M MRU, 3680K Anon, 15M Header, 634M Other > 2789M Compressed, 3126M Uncompressed, 1.12:1 Ratio > > It is typical numbers for last week: 15G wired, 237M Free, but only > 4252M ARC! > > Where is other 11G of memory?! > > I've checked USED and FREE in "vmstat -z" output and got this: > > $ vmstat -z | tr : , | awk -F , '1{print $2*$4,$2*$5,$1}' | sort -n | > tail -20 > 23001088 9171456 MAP ENTRY > 29680800 8404320 VM OBJECT > 34417408 10813952 256 > 36377964 2665656 S VFS Cache > 50377392 53856 sa_cache > 50593792 622985216 zio_buf_131072 > 68913152 976896 mbuf_cluster > 73543680 7225344 mbuf_jumbo_page > 92358552 67848 zfs_znode_cache > 95731712 51761152 4096 > 126962880 159581760 dmu_buf_impl_t > 150958080 233920512 mbuf_jumbo_9k > 165164600 92040 VNODE > 192701120 30350880 UMA Slabs > 205520896 291504128 zio_data_buf_1048576 > 222822400 529530880 zio_data_buf_524288 > 259143168 293476864 zio_buf_512 > 352485376 377061376 zio_buf_16384 > 376109552 346474128 dnode_t > 2943016960 5761941504 abd_chunk > $ > > And total USED/FREE numbers is very strange for me: > > $ vmstat -z | tr : , | awk -F , '1{u+=$2*$4; f+=$2*$5} END{print u,f}' > 5717965420 9328951088 > $ > > So, only ~5.7G is used and 9.3G is free! But why this memory is not > used by ARC anymore and why is it wired and not free? Could you show the output of "vmstat -s" when in this state? From owner-freebsd-stable@freebsd.org Wed Nov 21 04:33:46 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 77B061103C25 for ; Wed, 21 Nov 2018 04:33:46 +0000 (UTC) (envelope-from info@help22.servicodeentrega.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D9C226DD72 for ; Wed, 21 Nov 2018 04:33:45 +0000 (UTC) (envelope-from info@help22.servicodeentrega.org) Received: by mailman.ysv.freebsd.org (Postfix) id 9CEAE1103C24; Wed, 21 Nov 2018 04:33:45 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3E18D1103C22 for ; Wed, 21 Nov 2018 04:33:45 +0000 (UTC) (envelope-from info@help22.servicodeentrega.org) Received: from help22.servicodeentrega.org (help22.servicodeentrega.org [13.58.82.9]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B6D5B6DD71 for ; Wed, 21 Nov 2018 04:33:44 +0000 (UTC) (envelope-from info@help22.servicodeentrega.org) Received: from ip-172-31-25-210 (localhost [127.0.0.1]) by help22.servicodeentrega.org (Postfix) with SMTP id B7DC8446AF for ; Wed, 21 Nov 2018 04:26:53 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=help22.servicodeentrega.org; s=mail; t=1542774413; bh=h/gOHv+2wQkxRGbqAnXF20k+fZ20Ay3e7/uMNF8fWAQ=; h=From:To:Date:Subject:From; b=Vg7bZzf4cXLqBcD8rhvPbUVk6RSy3bpZgsW8eqhvCq3ql9fv2U/YYhhAfF69ir55O CKNkd2p2t9L7EO0j7+H/M/KfdgypzdAaKrJiZYsB7iDjnK4SDOWndap+jxfpgdIqbM 0DMu51DFsXdSs8oKDNhjVNvd5v3M9eDPxW+lOp8A= From: Netflix To: stable@freebsd.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Date: Wed, 21 Nov 2018 04:33:46 -0000 X-List-Received-Date: Wed, 21 Nov 2018 04:33:46 -0000 > Date: Wed, 21 Nov 2018 04:26:53 +0000 Subject: Aviso de bloqueio temporário - Conta ID: 04265321112018 Content-Type: text/html; charset=UTF-8 Message-Id: <20181121042653.B7DC8446AF@help22.servicodeentrega.org> X-Rspamd-Queue-Id: D9C226DD72 X-Spamd-Result: default: False [1.23 / 15.00]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; FORWARDED(0.00)[stable@mailman.ysv.freebsd.org]; R_DKIM_REJECT(1.00)[help22.servicodeentrega.org]; ZERO_FONT(0.20)[2]; SPF_FAIL_FORWARDING(0.00)[]; DKIM_TRACE(0.00)[help22.servicodeentrega.org:-]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; MX_GOOD(-0.01)[cached: help22.servicodeentrega.org]; MIME_HEADER_CTYPE_ONLY(2.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.979,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-3.68)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.77), asn: 10310(-3.67), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[stable@freebsd.org,freebsd-stable@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_SPF_FAIL(0.00)[-all]; RCVD_COUNT_FIVE(0.00)[5]; NEURAL_HAM_MEDIUM(-0.97)[-0.969,0]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.98)[-0.984,0]; R_BAD_CTE_7BIT(1.05)[7bit,utf8]; SUBJECT_NEEDS_ENCODING(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; MANY_INVISIBLE_PARTS(0.20)[3]; TO_DN_EQ_ADDR_ALL(0.00)[]; MIME_HTML_ONLY(0.20)[]; HFILTER_URL_ONLY(2.20)[1]; GREYLIST(0.00)[pass,body]; DMARC_POLICY_SOFTFAIL(0.10)[help22.servicodeentrega.org : No valid SPF,none] X-Rspamd-Server: mx1.freebsd.org
Sua conta está suspensa.
Há um problema com os dados de pagamento informados em sua conta.
Recomendamos que você atualize essas informações imediatamente.
ATUALIZE AQUI
ASSISTA AGORA
 
_
Vingadores: Era de Ultron
Vingadores: Era de Ultron Volte e curta hoje mesmo
_
La casa de papel: Parte 2
La casa de papel: Parte 2 Volte e curta hoje mesmo
Dúvidas? Ligue 0800-887-0201
O valor da mensalidade será cobrado. Requer aparelho compatível com a Netflix (fabricado e vendido separadamente) e internet banda larga. Para consultar os termos e condições, leia os Termos de uso.
Estamos enviando esse email porque você é ex-assinante Netflix. Se preferir não receber estes emails, clique aqui para cancelar o recebimento. Não responda a este email, pois esta caixa de entrada não é monitorada. Se precisar de ajuda ou quiser entrar em contato conosco, visite o Centro de ajuda.
Esta mensagem foi enviada para [stable@freebsd.org ] pela Netflix.
SRC: 04265321112018_pt-BR_BR
A utilização do serviços e site Netflix está sujeita aos Termos de uso e à Declaração de privacidade.
Netflix Entretenimento Brasil, Ltda.
 
                                                           
From owner-freebsd-stable@freebsd.org Wed Nov 21 10:41:23 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 338221133326 for ; Wed, 21 Nov 2018 10:41:23 +0000 (UTC) (envelope-from pch-b9D3CB0F5@u-1.phicoh.com) Received: from stereo.hq.phicoh.net (stereo6-tun.hq.phicoh.net [IPv6:2001:888:1044:10:2a0:c9ff:fe9f:17a9]) (using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E27DB7951D for ; Wed, 21 Nov 2018 10:41:21 +0000 (UTC) (envelope-from pch-b9D3CB0F5@u-1.phicoh.com) Received: from stereo.hq.phicoh.net (localhost [::ffff:127.0.0.1]) by stereo.hq.phicoh.net with esmtp (TLS version=TLSv1.2 cipher=ECDHE-RSA-CHACHA20-POLY1305) (Smail #157) id m1gPPwb-0000IMC; Wed, 21 Nov 2018 11:41:17 +0100 Message-Id: To: freebsd-stable@freebsd.org Subject: loss of network connectivity 12.0-RC1 / re0 From: Philip Homburg Sender: pch-b9D3CB0F5@u-1.phicoh.com Date: Wed, 21 Nov 2018 11:41:17 +0100 X-Rspamd-Queue-Id: E27DB7951D X-Spamd-Result: default: False [2.45 / 15.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.00)[0.003,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[phicoh.com]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.51)[0.514,0]; IP_SCORE(0.00)[asn: 3265(0.00), country: NL(0.01)]; MX_GOOD(-0.01)[backup-mail.hq.phicoh.net,stereo46.hq.phicoh.net]; NEURAL_SPAM_LONG(0.74)[0.737,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[pch-fbsd-1@u-1.phicoh.com,pch-b9D3CB0F5@u-1.phicoh.com]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:3265, ipnet:2001:888::/32, country:NL]; FROM_NEQ_ENVFROM(0.00)[pch-fbsd-1@u-1.phicoh.com,pch-b9D3CB0F5@u-1.phicoh.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 10:41:23 -0000 Hi, Since installing one of the first betas of 12.0 and yesterday with RC1 I notice network connectivity failures every now and then. I have to see if I can find the time to find a reliable trigger. 11.2 is fine on the same hardware. Yesterday it was during a run of poudriere that I lost access. Running tcpdump on the console showed that the machine received packets but just didn't respond. A reboot solved the issue. If I can find a way to trigger this issue, then I can try other hardware as well. From owner-freebsd-stable@freebsd.org Wed Nov 21 10:56:21 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4AA641133C85; Wed, 21 Nov 2018 10:56:21 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id BDD687A004; Wed, 21 Nov 2018 10:56:20 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:310b:1d84:68df:8590]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 326A61A12; Wed, 21 Nov 2018 13:56:19 +0300 (MSK) Date: Wed, 21 Nov 2018 13:56:18 +0300 From: Lev Serebryakov Reply-To: Lev Serebryakov Organization: FreeBSD Message-ID: <1999292077.20181121135618@serebryakov.spb.ru> To: Mark Johnston CC: FreeBSD stable , FreeBSD FS Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. In-Reply-To: <20181120204537.GB2630@raichu> References: <20181120204537.GB2630@raichu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: BDD687A004 X-Spamd-Result: default: False [0.52 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_SPAM_SHORT(0.26)[0.259,0]; NEURAL_HAM_LONG(-0.19)[-0.194,0]; NEURAL_SPAM_MEDIUM(0.46)[0.458,0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 10:56:21 -0000 Hello Mark, Tuesday, November 20, 2018, 11:45:37 PM, you wrote: > Could you show the output of "vmstat -s" when in this state? Now ARC is 1.9GB (!!!) and 15G is still Wired: % vmstat -s 1311134466 cpu context switches 2126950424 device interrupts 45414140 software interrupts 103215017 traps 2910067754 system calls 25 kernel threads created 108756 fork() calls 50914 vfork() calls 111 rfork() calls 0 swap pager pageins 0 swap pager pages paged in 0 swap pager pageouts 0 swap pager pages paged out 4201 vnode pager pageins 51719 vnode pager pages paged in 31597 vnode pager pageouts 63028 vnode pager pages paged out 7 page daemon wakeups 1212387275 pages examined by the page daemon 0 clean page reclamation shortfalls 0 pages reactivated by the page daemon 8281789 copy-on-write faults 7909 copy-on-write optimized faults 44440180 zero fill pages zeroed 24762 zero fill pages prezeroed 2 intransit blocking page faults 63838217 total VM faults taken 3816 page faults requiring I/O 0 pages affected by kernel thread creation 3996512 pages affected by fork() 1842784 pages affected by vfork() 5499 pages affected by rfork() 88771375 pages freed 0 pages freed by daemon 21591789 pages freed by exiting processes 4936 pages active 161234 pages inactive 16674 pages in the laundry queue 3848989 pages wired down 39951 pages free 4096 bytes per page 612681203 total name lookups cache hits (95% pos + 0% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% % -- Best regards, Lev mailto:lev@FreeBSD.org From owner-freebsd-stable@freebsd.org Wed Nov 21 11:11:02 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F2CFC11343B7 for ; Wed, 21 Nov 2018 11:11:01 +0000 (UTC) (envelope-from jacques@foucry.net) Received: from tamanoir.foucry.net (boulangerie.foucry.net [62.210.131.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3A7A37A6F8 for ; Wed, 21 Nov 2018 11:10:58 +0000 (UTC) (envelope-from jacques@foucry.net) Received: from tamanoir.foucry.net (localhost [127.0.0.1]) by tamanoir.foucry.net (Postfix) with ESMTP id 4FD6654DEF; Wed, 21 Nov 2018 12:10:51 +0100 (CET) X-Virus-Scanned: amavisd-new at foucry.net Received: from tamanoir.foucry.net ([127.0.0.1]) by tamanoir.foucry.net (mail.foucry.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id z4R4-RHKQ935; Wed, 21 Nov 2018 12:10:50 +0100 (CET) Received: by tamanoir.foucry.net (Postfix, from userid 58) id 1084554DEE; Wed, 21 Nov 2018 12:10:50 +0100 (CET) Received: from mithril (dontpanic.foucry.net [80.67.176.134]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tamanoir.foucry.net (Postfix) with ESMTPSA id 692C954DEC; Wed, 21 Nov 2018 12:10:49 +0100 (CET) Date: Wed, 21 Nov 2018 12:10:48 +0100 From: Jacques Foucry To: freebsd-stable@freebsd.org, freebsd-harware@freebsd.org Subject: TouchPad Synaptic on ThinkPad x280 Message-ID: <20181121111047.GB53645@mithril> Mail-Followup-To: freebsd-stable@freebsd.org, freebsd-harware@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Queue-Id: 3A7A37A6F8 X-Spamd-Result: default: False [1.28 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; NEURAL_HAM_MEDIUM(-0.40)[-0.404,0]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.81)[0.811,0]; IP_SCORE(0.19)[ipnet: 62.210.0.0/16(0.95), asn: 12876(0.03), country: FR(-0.02)]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[mail.foucry.net]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.20)[0.197,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:12876, ipnet:62.210.0.0/16, country:FR]; TAGGED_FROM(0.00)[FreeBSD]; RCVD_TLS_LAST(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[foucry.net : No valid SPF, No valid DKIM,none] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 11:11:02 -0000 Hello, After my little presentation, it's time for me to ask you some question. 1/ I run FreeBSD 11.2-Release P4 on a ThinkPd lenovo X280 # uname -rms FreeBSD 11.2-RELEASE-p4 amd64 2/ The touchpad run well with synaptic driver # dmesg | grep -i touchpad psm0: model Synaptics Touchpad, device ID 0 The only thing very annoying is that I can't find the right way to disable the touchpad since I use the keyboard. Here is my 70-synaptic.conf file Section "InputClass" Identifier "touchpad catchall" Driver "synaptics" MatchIsTouchpad "on" # This option is recommend on all Linux systems using evdev, but cannot be # enabled by default. See the following link for details: # http://who-t.blogspot.com/2010/11/how-to-ignore-configuration-errors.html # MatchDevicePath "/dev/input/event*" EndSection Section "InputClass" Identifier "touchpad ignore duplicates" MatchIsTouchpad "on" MatchOS "Linux" MatchDevicePath "/dev/input/mouse*" Option "Ignore" "on" EndSection #Section "InputClass" # Identifier "touchpad" # Driver "Synaptics" # Option "PalmDetect" "1" #EndSection # This option enables the bottom right corner to be a right button on clickpads # and the right and middle top areas to be right / middle buttons on clickpads # with a top button area. # This option is only interpreted by clickpads. Section "InputClass" Identifier "Default clickpad buttons" MatchDriver "synaptics" Option "SoftButtonAreas" "50% 0 82% 0 0 0 0 0" Option "SecondarySoftButtonAreas" "58% 0 0 15% 42% 58% 0 15%" EndSection # This option disables software buttons on Apple touchpads. # This option is only interpreted by clickpads. Section "InputClass" Identifier "Disable clickpad buttons on Apple touchpads" MatchProduct "Apple|bcm5974" MatchDriver "synaptics" Option "SoftButtonAreas" "0 0 0 0 0 0 0 0" EndSection Section "InputDevice" Identifier "Mouse0" Driver "mouse" Option "Protocol" "auto" Option "Device" "/dev/sysmouse" Option "ZAxisMapping" "4 5 6 7" EndSection Is it a no-feature on synaptic driver? Disclamer: I posted on both stable and hardware ml, because I not sure where the problem is. May be between the keyboard and the chair. Thanks in advance for your help. -- Jacques From owner-freebsd-stable@freebsd.org Wed Nov 21 11:34:49 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E00531135142; Wed, 21 Nov 2018 11:34:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id 6A5A87B88E; Wed, 21 Nov 2018 11:34:48 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:310b:1d84:68df:8590]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 58A901A33; Wed, 21 Nov 2018 14:34:46 +0300 (MSK) Date: Wed, 21 Nov 2018 14:34:45 +0300 From: Lev Serebryakov Reply-To: lev@FreeBSD.org Organization: FreeBSD Message-ID: <123493949.20181121143445@serebryakov.spb.ru> To: Mark Johnston CC: FreeBSD FS , FreeBSD stable Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. In-Reply-To: <1999292077.20181121135618@serebryakov.spb.ru> References: <20181120204537.GB2630@raichu> <1999292077.20181121135618@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 6A5A87B88E X-Spamd-Result: default: False [0.52 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_SPAM_SHORT(0.26)[0.259,0]; NEURAL_HAM_LONG(-0.19)[-0.194,0]; NEURAL_SPAM_MEDIUM(0.46)[0.458,0]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 11:34:49 -0000 Hello Lev, Wednesday, November 21, 2018, 1:56:18 PM, you wrote: >> Could you show the output of "vmstat -s" when in this state? > Now ARC is 1.9GB (!!!) and 15G is still Wired: > % vmstat -s > 1311134466 cpu context switches > 2126950424 device interrupts > 45414140 software interrupts > 103215017 traps > 2910067754 system calls > 25 kernel threads created > 108756 fork() calls > 50914 vfork() calls > 111 rfork() calls > 0 swap pager pageins > 0 swap pager pages paged in > 0 swap pager pageouts > 0 swap pager pages paged out > 4201 vnode pager pageins > 51719 vnode pager pages paged in > 31597 vnode pager pageouts > 63028 vnode pager pages paged out > 7 page daemon wakeups > 1212387275 pages examined by the page daemon > 0 clean page reclamation shortfalls > 0 pages reactivated by the page daemon > 8281789 copy-on-write faults > 7909 copy-on-write optimized faults > 44440180 zero fill pages zeroed > 24762 zero fill pages prezeroed > 2 intransit blocking page faults > 63838217 total VM faults taken > 3816 page faults requiring I/O > 0 pages affected by kernel thread creation > 3996512 pages affected by fork() > 1842784 pages affected by vfork() > 5499 pages affected by rfork() > 88771375 pages freed > 0 pages freed by daemon > 21591789 pages freed by exiting processes > 4936 pages active > 161234 pages inactive > 16674 pages in the laundry queue > 3848989 pages wired down > 39951 pages free > 4096 bytes per page > 612681203 total name lookups > cache hits (95% pos + 0% neg) system 0% per-directory > deletions 0%, falsehits 0%, toolong 0% > % And here top consumers. I don't like that most of te memory is in FREE abd_chunks - 8GB! USED (b) FREE (b) NAME 28785840 9299280 VM OBJECT 33817600 11413760 256 36598392 2486808 S VFS Cache 38157856 246224 arc_buf_hdr_t_l2only 44302336 629276672 zio_buf_131072 50377824 53424 sa_cache 72323072 85626880 mbuf_jumbo_page 74094592 55296 mbuf_cluster 90320896 63102976 4096 92359344 67056 zfs_znode_cache 126912480 159632160 dmu_buf_impl_t 150967296 233911296 mbuf_jumbo_9k 165164600 92040 VNODE 199124480 23927520 UMA Slabs 209715200 8388608 zio_data_buf_1048576 218103808 48758784 zio_data_buf_524288 259242496 293377536 zio_buf_512 346030080 383516672 zio_buf_16384 375592672 346991008 dnode_t 531902464 8392536064 abd_chunk -- Best regards, Lev mailto:lev@FreeBSD.org From owner-freebsd-stable@freebsd.org Wed Nov 21 13:23:56 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 093F41138D32; Wed, 21 Nov 2018 13:23:56 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D6D927FA62; Wed, 21 Nov 2018 13:23:44 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id wALDNaYb093490 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 21 Nov 2018 14:23:37 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: lev@FreeBSD.org Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id wALDNZVR050417 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Wed, 21 Nov 2018 20:23:35 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. To: lev@FreeBSD.org, Mark Johnston References: <20181120204537.GB2630@raichu> <1999292077.20181121135618@serebryakov.spb.ru> <123493949.20181121143445@serebryakov.spb.ru> Cc: FreeBSD FS , FreeBSD stable From: Eugene Grosbein Message-ID: Date: Wed, 21 Nov 2018 20:23:29 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <123493949.20181121143445@serebryakov.spb.ru> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: D6D927FA62 X-Spamd-Result: default: False [-5.17 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MX_INVALID(0.50)[greylisted]; RCVD_COUNT_THREE(0.00)[3]; R_SPF_PERMFAIL(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.984,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-2.59)[ip: (-6.73), ipnet: 2a01:4f8::/29(-3.34), asn: 24940(-2.88), country: DE(-0.01)]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 13:23:56 -0000 21.11.2018 18:34, Lev Serebryakov wrote: > And here top consumers. I don't like that most of te memory is in FREE > abd_chunks - 8GB! > > USED (b) FREE (b) NAME > 531902464 8392536064 abd_chunk This may be a leak. Can you monitor this value for longer run? From owner-freebsd-stable@freebsd.org Wed Nov 21 14:03:28 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 904501139E61; Wed, 21 Nov 2018 14:03:28 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id 1A498816CA; Wed, 21 Nov 2018 14:03:28 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:310b:1d84:68df:8590]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 5E7D21A8C; Wed, 21 Nov 2018 17:03:26 +0300 (MSK) Date: Wed, 21 Nov 2018 17:03:25 +0300 From: Lev Serebryakov Reply-To: Lev Serebryakov Organization: FreeBSD Message-ID: <228548325.20181121170325@serebryakov.spb.ru> To: Eugene Grosbein , Mark Johnston CC: FreeBSD FS , FreeBSD stable Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. In-Reply-To: References: <20181120204537.GB2630@raichu> <1999292077.20181121135618@serebryakov.spb.ru> <123493949.20181121143445@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 1A498816CA X-Spamd-Result: default: False [0.43 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE]; NEURAL_SPAM_SHORT(0.23)[0.231,0]; NEURAL_HAM_LONG(-0.23)[-0.233,0]; NEURAL_SPAM_MEDIUM(0.43)[0.433,0] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 14:03:28 -0000 Hello Eugene, Wednesday, November 21, 2018, 4:23:29 PM, you wrote: >> And here top consumers. I don't like that most of te memory is in FREE >> abd_chunks - 8GB! >> >> USED (b) FREE (b) NAME >> 531902464 8392536064 abd_chunk > This may be a leak. Can you monitor this value for longer run? No problem. But I don't think it is "true" leak, when memory is NEVER freed, as uptime of this box is 11 days already, and sometimes ARC is much larger than 2GiB. For example, now it is inflated to 8GiB. Ok, and now it is: USED (b) FREE (b) NAME 35445924 3639276 S VFS Cache 37336376 1067704 arc_buf_hdr_t_l2only 47760912 2670336 sa_cache 51531120 55440 VM OBJECT 55574528 30408704 zio_data_buf_1048576 56183040 21365760 256 61734912 50331648 zio_buf_131072 70467584 2375680 mbuf_cluster 72028160 3895296 mbuf_jumbo_page 87561672 4856808 zfs_znode_cache 110448640 32768 4096 124137120 158133600 dmu_buf_impl_t 150976512 7188480 mbuf_jumbo_9k 156588360 8539896 VNODE 208290960 1040 UMA Slabs 247484416 280662016 zio_buf_512 275775488 96993280 zio_data_buf_524288 361406864 314169856 dnode_t 417366016 1015808 zio_buf_16384 7307493376 2383060992 abd_chunk It is more likely that there is a bug in "priority" for memory distribution: abd FREE memory has higher priority than ARC somehow. -- Best regards, Lev mailto:lev@FreeBSD.org From owner-freebsd-stable@freebsd.org Wed Nov 21 14:19:47 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89992113A4AE; Wed, 21 Nov 2018 14:19:47 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id BBED7825D1; Wed, 21 Nov 2018 14:19:46 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id wALEJcBN093894 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 21 Nov 2018 15:19:39 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: lev@FreeBSD.org Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id wALEJcja052043 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Wed, 21 Nov 2018 21:19:38 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. To: Lev Serebryakov , Mark Johnston References: <20181120204537.GB2630@raichu> <1999292077.20181121135618@serebryakov.spb.ru> <123493949.20181121143445@serebryakov.spb.ru> <228548325.20181121170325@serebryakov.spb.ru> Cc: FreeBSD FS , FreeBSD stable From: Eugene Grosbein Message-ID: <92e3ea2e-b7ed-ec26-c56b-2d2acbf41772@grosbein.net> Date: Wed, 21 Nov 2018 21:19:32 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <228548325.20181121170325@serebryakov.spb.ru> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: BBED7825D1 X-Spamd-Result: default: False [-5.14 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; MX_INVALID(0.50)[cached]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; R_SPF_PERMFAIL(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.992,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-2.55)[ip: (-6.51), ipnet: 2a01:4f8::/29(-3.35), asn: 24940(-2.88), country: DE(-0.01)]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 14:19:47 -0000 21.11.2018 21:03, Lev Serebryakov wrote: >>> And here top consumers. I don't like that most of te memory is in FREE >>> abd_chunks - 8GB! >>> >>> USED (b) FREE (b) NAME >>> 531902464 8392536064 abd_chunk >> This may be a leak. Can you monitor this value for longer run? > No problem. > > But I don't think it is "true" leak, when memory is NEVER > freed, as uptime of this box is 11 days already, and sometimes ARC is much > larger than 2GiB. For example, now it is inflated to 8GiB. > > Ok, and now it is: > > USED (b) FREE (b) NAME > 7307493376 2383060992 abd_chunk > > It is more likely that there is a bug in "priority" for memory > distribution: abd FREE memory has higher priority than ARC somehow. OTOH, if "abd_chunks" part of ZFS ARC is not released to the UMA from which it was allocated (to be reused by other parts of the kernel) but is reused by ZFS itself, then top(1) should report it as part of ZFS ARC and not as other "Wired" memory. From owner-freebsd-stable@freebsd.org Wed Nov 21 14:53:15 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E8F69113B4EC; Wed, 21 Nov 2018 14:53:14 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [148.251.9.81]) by mx1.freebsd.org (Postfix) with ESMTP id 7241483BB0; Wed, 21 Nov 2018 14:53:14 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:310b:1d84:68df:8590]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 9E2821ABC; Wed, 21 Nov 2018 17:53:06 +0300 (MSK) Date: Wed, 21 Nov 2018 17:53:06 +0300 From: Lev Serebryakov Reply-To: Lev Serebryakov Organization: FreeBSD Message-ID: <807023120.20181121175306@serebryakov.spb.ru> To: Eugene Grosbein , Mark Johnston CC: FreeBSD FS , FreeBSD stable Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. In-Reply-To: <92e3ea2e-b7ed-ec26-c56b-2d2acbf41772@grosbein.net> References: <20181120204537.GB2630@raichu> <1999292077.20181121135618@serebryakov.spb.ru> <123493949.20181121143445@serebryakov.spb.ru> <228548325.20181121170325@serebryakov.spb.ru> <92e3ea2e-b7ed-ec26-c56b-2d2acbf41772@grosbein.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 7241483BB0 X-Spamd-Result: default: False [0.27 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_SPAM_SHORT(0.08)[0.084,0]; NEURAL_HAM_LONG(-0.23)[-0.235,0]; NEURAL_SPAM_MEDIUM(0.42)[0.416,0]; ASN(0.00)[asn:24940, ipnet:148.251.0.0/16, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 14:53:15 -0000 Hello Eugene, Wednesday, November 21, 2018, 5:19:32 PM, you wrote: >> It is more likely that there is a bug in "priority" for memory >> distribution: abd FREE memory has higher priority than ARC somehow. > OTOH, if "abd_chunks" part of ZFS ARC is not released to the UMA > from which it was allocated (to be reused by other parts of the kernel) > but is reused by ZFS itself, then top(1) should report it as part of ZFS ARC > and not as other "Wired" memory. It will be better to system use this memory for ARC and not as "Free" chunks for future usage :-) -- Best regards, Lev mailto:lev@FreeBSD.org From owner-freebsd-stable@freebsd.org Wed Nov 21 17:00:52 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2B42A113E60D for ; Wed, 21 Nov 2018 17:00:52 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-oi1-x235.google.com (mail-oi1-x235.google.com [IPv6:2607:f8b0:4864:20::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 77C126A986 for ; Wed, 21 Nov 2018 17:00:51 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-oi1-x235.google.com with SMTP id v6so5121677oif.2; Wed, 21 Nov 2018 09:00:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=Sdigb5A7/rtAqB8qk0kC1h/if5bRT8/8IyQSeVA6lFc=; b=dSBNSHAGYzoaCApNTtVzxlaeiPGK84C8dtHY12ZE8PAlu7lmQIsjIKTvliR/CYmaZE 6YMqdbSib9d8ol795957L5adje8O4q7PcxMLUj4VW62/P1e6ucSLHc9YB3IpHZHyS5fh 2+EyCsH7WWULnNK6whSVusym0JTA0lq+ANjasHhKWyUlK8gVx8vCN0XS/REj00xHsGll 7oF0Ne/NpusOctsJJmo5qtrFL4wpw++wGfibbUGYQFuBHGPSg/fs2o58Ourot4yl4JEv 3qWlCy5b4aVVYLRm8faRnHfPJ0gVk2gB8Wuk2Ipi5xE9iM+wm654eEAKELTSkbIHBsgj HONw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=Sdigb5A7/rtAqB8qk0kC1h/if5bRT8/8IyQSeVA6lFc=; b=dWWu3vt2B7jePpVZB2zXh41OIajmmSLOzN8bUzNQI3oegfpSsl5OKG6dzvx7X0CVJC iKii8xFLaLUmK8OIsADjpSLA+fBmBLasIjVP12UjGGZ3Z7e43UxGbdIfqucV1Xwb53yR 7RNgmJotN0qWDW98pwkkg4v8E0SyT7JRnXIqdQgitzY+kuxwtS1iApXcOtc/w9E5llcD 8GzMUol2ZdMZTjfq0OQWw4jTPXS7YD7PmF2FiwbTwbu5brWEwDyBRI4ser/+XTvc19T+ QMAnRFQPa8ncJUvUhYkWP79QtqBvIGGE2TBbQ2d3YkcmgyZ6IWQ9CmINa0Wk5ruXESzq pmmg== X-Gm-Message-State: AGRZ1gItAsLkdsoLZf6Yx0AI6gnPbZSFMv84dtS3GdGEnUjSCchwoY7d O2inAhwjhYzRpMwCw58CMEnh0BqQQjMklzrOxC/aklBZ X-Google-Smtp-Source: AJdET5fttmP2yt1EDstzIQlmxjiZDLqLamLExJYNULtKBwr3i0649QYQhdlIbqCnsPg/YCtcPMT+9n4DJkFDxTgW8yc= X-Received: by 2002:aca:6bc6:: with SMTP id g189mr3849251oic.96.1542819650125; Wed, 21 Nov 2018 09:00:50 -0800 (PST) MIME-Version: 1.0 References: <20181121111047.GB53645@mithril> In-Reply-To: <20181121111047.GB53645@mithril> From: Kevin Oberman Date: Wed, 21 Nov 2018 09:00:33 -0800 Message-ID: Subject: Re: TouchPad Synaptic on ThinkPad x280 To: FreeBSD-STABLE Mailing List , freebsd-harware@freebsd.org X-Rspamd-Queue-Id: 77C126A986 X-Spamd-Result: default: False [-4.44 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; IP_SCORE(-0.80)[ipnet: 2607:f8b0::/32(-2.35), asn: 15169(-1.56), country: US(-0.09)]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; NEURAL_HAM_SHORT(-0.93)[-0.935,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[5.3.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FORGED_SENDER(0.30)[rkoberman@gmail.com,kob6558@gmail.com]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[rkoberman@gmail.com,kob6558@gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 17:00:52 -0000 On Wed, Nov 21, 2018 at 3:12 AM Jacques Foucry wrote: > Hello, > > After my little presentation, it's time for me to ask you some question. > > 1/ I run FreeBSD 11.2-Release P4 on a ThinkPd lenovo X280 > > # uname -rms > FreeBSD 11.2-RELEASE-p4 amd64 > > 2/ The touchpad run well with synaptic driver > > # dmesg | grep -i touchpad > psm0: model Synaptics Touchpad, device ID 0 > > The only thing very annoying is that I can't find the right way to > disable the touchpad since I use the keyboard. > > [...] > Is it a no-feature on synaptic driver? > # sysctl hw.psm.synaptics.touchpad_off=1 -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 From owner-freebsd-stable@freebsd.org Wed Nov 21 18:18:44 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 630C61140D60 for ; Wed, 21 Nov 2018 18:18:44 +0000 (UTC) (envelope-from don@zavitz.ca) Received: from mail.zavitz.ca (mail.zavitz.ca [165.227.44.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "zavitz.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E08C46EA24 for ; Wed, 21 Nov 2018 18:18:43 +0000 (UTC) (envelope-from don@zavitz.ca) Received: from [192.168.1.100] (137.186.55.16 [137.186.55.16]) by mail.zavitz.ca (OpenSMTPD) with ESMTPSA id 28757432 TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO for ; Wed, 21 Nov 2018 18:12:02 +0000 (UTC) Subject: Re: loss of network connectivity 12.0-RC1 / re0 To: freebsd-stable@freebsd.org References: From: Don Zavitz Message-ID: <33ddab7c-4e13-ab85-e065-0408bc476e25@zavitz.ca> Date: Wed, 21 Nov 2018 11:12:01 -0700 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Rspamd-Queue-Id: E08C46EA24 X-Spamd-Result: default: False [4.55 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.99)[0.993,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.98)[0.984,0]; DMARC_NA(0.00)[zavitz.ca]; MX_GOOD(-0.01)[cached: zavitz.ca]; NEURAL_SPAM_LONG(0.98)[0.982,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(0.70)[asn: 14061(3.59), country: US(-0.09)]; ASN(0.00)[asn:14061, ipnet:165.227.32.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 18:18:44 -0000 i had some weird issues to while upgrading to 12-BETA4 but thought it was digitalocean, maybe i should have looked further before destroying and creating a new droplet On 2018-11-21 3:41 a.m., Philip Homburg wrote: > Hi, > > Since installing one of the first betas of 12.0 and yesterday with RC1 I > notice network connectivity failures every now and then. I have to > see if I can find the time to find a reliable trigger. > > 11.2 is fine on the same hardware. > > Yesterday it was during a run of poudriere that I lost access. Running > tcpdump on the console showed that the machine received packets but just > didn't respond. > > A reboot solved the issue. > > If I can find a way to trigger this issue, then I can try other hardware as > well. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Wed Nov 21 18:18:53 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 15FB61140D8E for ; Wed, 21 Nov 2018 18:18:53 +0000 (UTC) (envelope-from don@zavitz.ca) Received: from mail.zavitz.ca (mail.zavitz.ca [165.227.44.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "zavitz.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 8C1ED6EA3E for ; Wed, 21 Nov 2018 18:18:52 +0000 (UTC) (envelope-from don@zavitz.ca) Received: from [192.168.1.100] (137.186.55.16 [137.186.55.16]) by mail.zavitz.ca (OpenSMTPD) with ESMTPSA id 7b44c63b TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO for ; Wed, 21 Nov 2018 17:18:51 +0000 (UTC) Subject: Re: Reset Your Adobe ID Password To: freebsd-stable@freebsd.org References: <01000165e59b844f-76de686f-4d74-4d13-bf5b-617a9379e28d-000000@email.amazonses.com> From: Don Zavitz Message-ID: Date: Wed, 21 Nov 2018 10:18:51 -0700 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.0 MIME-Version: 1.0 In-Reply-To: <01000165e59b844f-76de686f-4d74-4d13-bf5b-617a9379e28d-000000@email.amazonses.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 8C1ED6EA3E X-Spamd-Result: default: False [4.55 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.99)[0.992,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.98)[0.984,0]; DMARC_NA(0.00)[zavitz.ca]; MX_GOOD(-0.01)[cached: zavitz.ca]; NEURAL_SPAM_LONG(0.98)[0.980,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(0.70)[asn: 14061(3.59), country: US(-0.09)]; ASN(0.00)[asn:14061, ipnet:165.227.32.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 18:18:53 -0000 thanks On 2018-09-16 9:38 p.m., Adobe Systems Incorporated via freebsd-stable wrote: > Dear 本公å¸å¯¹å¤–å¹µå‘缥，先æ供验 ，低点数需è¦ï¼Œè¯·åŠ æœ¬+Q 2096405039 Tel：134-0090-1513 张先生, > > Click this link to reset your password. > > https://adobeid.services.adobe.com/reset/en_GB/5PSZY0JJ4Q0VQYACSCP33RZ574 > > For security purposes, this link will expire 72 hours from the time it was sent. If you continue to have issues with your password, see Adobe ID FAQ for help. > > Thank you, > The Adobe Team > > Adobe and the Adobe logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States and/or other countries. All other trademarks are the property of their respective owners. > > © 2018 Adobe Systems Incorporated. All rights reserved. > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Wed Nov 21 21:04:18 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA8B911466D6 for ; Wed, 21 Nov 2018 21:04:18 +0000 (UTC) (envelope-from pch-b9D3CB0F5@u-1.phicoh.com) Received: from stereo.hq.phicoh.net (stereo6-tun.hq.phicoh.net [IPv6:2001:888:1044:10:2a0:c9ff:fe9f:17a9]) (using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D970976BCD for ; Wed, 21 Nov 2018 21:04:17 +0000 (UTC) (envelope-from pch-b9D3CB0F5@u-1.phicoh.com) Received: from stereo.hq.phicoh.net (localhost [::ffff:127.0.0.1]) by stereo.hq.phicoh.net with esmtp (TLS version=TLSv1.2 cipher=ECDHE-RSA-CHACHA20-POLY1305) (Smail #157) id m1gPZfS-0000FkC; Wed, 21 Nov 2018 22:04:14 +0100 Message-Id: To: freebsd-stable@freebsd.org Subject: Re: loss of network connectivity 12.0-RC1 / re0 From: Philip Homburg Sender: pch-b9D3CB0F5@u-1.phicoh.com In-reply-to: Your message of "Wed, 21 Nov 2018 11:41:17 +0100 ." Date: Wed, 21 Nov 2018 22:04:14 +0100 X-Rspamd-Queue-Id: D970976BCD X-Spamd-Result: default: False [3.27 / 15.00]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.32)[0.317,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[phicoh.com]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_MEDIUM(0.53)[0.530,0]; IP_SCORE(0.00)[asn: 3265(0.00), country: NL(0.01)]; MX_GOOD(-0.01)[cached: backup-mail.hq.phicoh.net]; NEURAL_SPAM_LONG(0.73)[0.733,0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[pch-fbsd-1@u-1.phicoh.com,pch-b9D3CB0F5@u-1.phicoh.com]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:3265, ipnet:2001:888::/32, country:NL]; FROM_NEQ_ENVFROM(0.00)[pch-fbsd-1@u-1.phicoh.com,pch-b9D3CB0F5@u-1.phicoh.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 21:04:19 -0000 >Since installing one of the first betas of 12.0 and yesterday with RC1 I >notice network connectivity failures every now and then. I have to >see if I can find the time to find a reliable trigger. On a diffrent machine, this time with em0, starting tcpdump made IPv6 work again. Two more networking related issues: - dhclient complains on the console about option 0x52. - wlan0 connects to a wifi SSID that is not listed in /etc/wpa_supplicant.conf From owner-freebsd-stable@freebsd.org Wed Nov 21 23:34:18 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 456D11103128 for ; Wed, 21 Nov 2018 23:34:18 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E360F7C7B7 for ; Wed, 21 Nov 2018 23:34:03 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id wALNXs6V098134 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 22 Nov 2018 00:33:55 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: pch-fbsd-1@u-1.phicoh.com Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id wALNXrib058666 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Thu, 22 Nov 2018 06:33:53 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: loss of network connectivity 12.0-RC1 / re0 To: Philip Homburg , freebsd-stable@freebsd.org References: From: Eugene Grosbein Message-ID: Date: Thu, 22 Nov 2018 06:33:47 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: E360F7C7B7 X-Spamd-Result: default: False [-5.10 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; MX_INVALID(0.50)[greylisted]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.97)[-0.972,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-2.53)[ip: (-6.30), ipnet: 2a01:4f8::/29(-3.41), asn: 24940(-2.91), country: DE(-0.01)]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 23:34:18 -0000 22.11.2018 4:04, Philip Homburg wrote: >> Since installing one of the first betas of 12.0 and yesterday with RC1 I >> notice network connectivity failures every now and then. I have to >> see if I can find the time to find a reliable trigger. > > On a diffrent machine, this time with em0, starting tcpdump made IPv6 work > again. If you start tcpdump without "-p" option, this switches interface into promiscuous mode and sometimes that resets something inside the chip or driver and acts as "poor man's interface reset". From owner-freebsd-stable@freebsd.org Thu Nov 22 10:00:54 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7D0B31143A2F for ; Thu, 22 Nov 2018 10:00:54 +0000 (UTC) (envelope-from 3VH72Ww4JDhEDDrC11KOOJNHKPx3rz2.t53w8vvs9u-9Ars2vw8vvs9u.58x@trix.bounces.google.com) Received: from mail-it1-x145.google.com (mail-it1-x145.google.com [IPv6:2607:f8b0:4864:20::145]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49DE66F67F for ; Thu, 22 Nov 2018 10:00:53 +0000 (UTC) (envelope-from 3VH72Ww4JDhEDDrC11KOOJNHKPx3rz2.t53w8vvs9u-9Ars2vw8vvs9u.58x@trix.bounces.google.com) Received: by mail-it1-x145.google.com with SMTP id c73so10531518itd.1 for ; Thu, 22 Nov 2018 02:00:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:message-id:date:subject:from:to; bh=ncJaTGoVaNflJWnapstWRHUVyW1sB1jpxnx/oZrgORg=; b=XHv5OOZsKvOEutizcmedELlL79xKL0M0AsF82GCBPqrehKDn1fIuuHHaGac07wFXSW f10EEhNv44cOhs38uPpreBmhQingFuZ4469t2VlzRD+28RmtEJG5LZwfzFPgH3iuorv0 vc44naMlyv8/A7Bowhtanf1lY+y1/AALwYM8wy4NRJ4n/xDrnhNCypd0FsU75I44mAAD i7YhvlFAqBPm7c6NVT17m2BGCZg5UzawrXGl7pg59myS7fTOpXFD3ZMBC2BvsMGcXgI0 lBWnz/BAL3ZrIonkaQDgrAnCDkZTsHn6MdZPd4xxx+2RojueWzoA2ahgZXFhd1KKS8mZ 2VFw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:message-id:date:subject :from:to; bh=ncJaTGoVaNflJWnapstWRHUVyW1sB1jpxnx/oZrgORg=; b=m52XbgwvvsucfjXYlFCSbStKniHPvCSMKHzt2zNVK2qeK/ypmZa5BqQXbhS8MtVVBO sN2ZQvUcPlAhMkzVWztTll8M25KCbN+oSsa63RJccZP0HSf7uWaKZqdLZH/BxsbghfyY ZCHw5fgvOsOHIkMLzV/QSJ4wGuHFsH9claeKSA+ztnndOjdmbMys9NyRHmzzGCiXqAPC QxDJSg8XnZyRsBSJKiqO8wvwIzfZHjsyr7EXhd8KRwVDV4nJ53mZmZtlHT8gYZnasDBb Tlnzj95DPmteqOfMMCtrFVcZE5DE4q+ouRzylMjKDYVo+rjiYBCNTtApjAKWnXSDQTes Y3Xw== X-Gm-Message-State: AGRZ1gLzYGUIu66kD/5bnTadCoLWmgB6MrYNvQZCCMYzZ/tj6LFG9/O4 dU3/z4qyOGw9Hc4X41iZZbIOyrNliVboTdVGmNY8 MIME-Version: 1.0 X-Received: by 2002:a24:3a8a:: with SMTP id m132-v6mt11003032itm.32.1542880852597; Thu, 22 Nov 2018 02:00:52 -0800 (PST) Reply-To: wwavkk37726038@gmail.com X-No-Auto-Attachment: 1 Message-ID: <000000000000266c0b057b3df181@google.com> Date: Thu, 22 Nov 2018 10:00:52 +0000 Subject: =?UTF-8?B?5Zue5aSN77ya5p2l6Ieq5aSW6LS45bCP5bmz55qE55yf6K+a6Zeu5YCZ?= From: wwavkk37726038@gmail.com To: freebsd-stable@freebsd.org X-Rspamd-Queue-Id: 49DE66F67F X-Spamd-Result: default: False [-3.89 / 15.00]; HAS_REPLYTO(0.00)[wwavkk37726038@gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_NONE(0.00)[]; MX_GOOD(-0.01)[gmr-smtp-in.l.google.com,alt1.gmr-smtp-in.l.google.com,alt2.gmr-smtp-in.l.google.com]; DKIM_TRACE(0.00)[gmail.com:+]; MIME_BASE64_TEXT(0.10)[]; NEURAL_HAM_SHORT(-0.49)[-0.494,0]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FORGED_SENDER(0.30)[wwavkk37726038@gmail.com,3VH72Ww4JDhEDDrC11KOOJNHKPx3rz2.t53w8vvs9u-9Ars2vw8vvs9u.58x@trix.bounces.google.com]; IP_SCORE(-0.79)[ipnet: 2607:f8b0::/32(-2.28), asn: 15169(-1.57), country: US(-0.09)]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[wwavkk37726038@gmail.com,3VH72Ww4JDhEDDrC11KOOJNHKPx3rz2.t53w8vvs9u-9Ars2vw8vvs9u.58x@trix.bounces.google.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; R_DKIM_ALLOW(-0.20)[gmail.com]; REPLYTO_EQ_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.997,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; FREEMAIL_REPLYTO(0.00)[gmail.com]; RCPT_COUNT_ONE(0.00)[1]; FROM_NO_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[5.4.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8"; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Nov 2018 10:00:54 -0000 SSd2ZSBpbnZpdGVkIHlvdSB0byBmaWxsIG91dCB0aGUgZm9sbG93aW5nIGZvcm06DQrkvZPpqozm lYjmnpzliqBR77yaMjA0NzU1NDI2OCDlvq7kv6HvvJpkb3VoYXBpbmcNCg0KVG8gZmlsbCBpdCBv dXQsIHZpc2l0Og0KaHR0cHM6Ly9kb2NzLmdvb2dsZS5jb20vZm9ybXMvZC9lLzFGQUlwUUxTZE5H dU1meXVqRmJUR0QzeVVDTDRlY09pVjlzN3dkZHoxdTVHejZ5azhic3p2Z1l3L3ZpZXdmb3JtP3Zj PTAmYW1wO2M9MCZhbXA7dz0xJmFtcDt1c3A9bWFpbF9mb3JtX2xpbmsNCg0KSSYjMzk7dmUgaW52 aXRlZCB5b3UgdG8gZmlsbCBvdXQgYSBmb3JtOg0KDQpHb29nbGUgRm9ybXM6IENyZWF0ZSBhbmQg YW5hbHl6ZSBzdXJ2ZXlzLg0K From owner-freebsd-stable@freebsd.org Thu Nov 22 10:49:51 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 67B411144EF5 for ; Thu, 22 Nov 2018 10:49:51 +0000 (UTC) (envelope-from rb@gid.co.uk) Received: from mx0.gid.co.uk (mx0.gid.co.uk [194.32.164.250]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A68B77136D for ; Thu, 22 Nov 2018 10:49:40 +0000 (UTC) (envelope-from rb@gid.co.uk) Received: from [194.32.164.27] ([194.32.164.27]) by mx0.gid.co.uk (8.14.2/8.14.2) with ESMTP id wAMAircr053381; Thu, 22 Nov 2018 10:44:53 GMT (envelope-from rb@gid.co.uk) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: loss of network connectivity 12.0-RC1 / re0 From: Bob Bishop In-Reply-To: Date: Thu, 22 Nov 2018 10:44:49 +0000 Cc: freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Philip Homburg X-Mailer: Apple Mail (2.3273) X-Rspamd-Queue-Id: A68B77136D X-Spamd-Result: default: False [0.83 / 15.00]; ARC_NA(0.00)[]; MX_INVALID(0.50)[greylisted]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[gid.co.uk]; NEURAL_SPAM_MEDIUM(0.45)[0.450,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.33)[-0.328,0]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[250.164.32.194.list.dnswl.org : 127.0.10.0]; NEURAL_SPAM_LONG(0.03)[0.030,0]; IP_SCORE(-0.02)[country: GB(-0.10)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:42831, ipnet:194.32.164.0/24, country:GB]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Nov 2018 10:49:51 -0000 > On 21 Nov 2018, at 21:04, Philip Homburg = wrote: >=20 >> Since installing one of the first betas of 12.0 and yesterday with = RC1 I=20 >> notice network connectivity failures every now and then. I have to >> see if I can find the time to find a reliable trigger. >=20 > On a diffrent machine, this time with em0, starting tcpdump made IPv6 = work=20 > again. [etc] An effect of promiscuous mode is to disable any hardware filtering = particularly of MAC addresses. If something in that area is awry then = running tcpdump may well =E2=80=98fix=E2=80=99 it. -- Bob Bishop rb@gid.co.uk From owner-freebsd-stable@freebsd.org Thu Nov 22 12:13:32 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 989771147203 for ; Thu, 22 Nov 2018 12:13:32 +0000 (UTC) (envelope-from arab4585+noreply@googlegroups.com) Received: from mail-oi1-x247.google.com (mail-oi1-x247.google.com [IPv6:2607:f8b0:4864:20::247]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id ECE7974221 for ; Thu, 22 Nov 2018 12:13:31 +0000 (UTC) (envelope-from arab4585+noreply@googlegroups.com) Received: by mail-oi1-x247.google.com with SMTP id n196so3939793oig.15 for ; Thu, 22 Nov 2018 04:13:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20161025; h=mime-version:date:auto-submitted:message-id:subject:from:to; bh=zAUtcZ/yLbhCGvoxJ3QQivdg+jsgb0UnKYn+sHYGMvE=; b=tlD4pYV+83/YQPQIXOxBmAO4CtnmpCfWw8RGey35bwr/4vBhRFqYY0Iwan06r5t/ja iCAvWmfv21i4N79PxJISfMhqb1OYMf1t71oTWHpfRbNQHIqFWYnlyUJHNdj3CtLuq62v 5rCR8hqrX4Vv4Z6TPxtRKbuWsBPlHzbVkrIsCCidFvQtE+I9WFQVIYhE5sNI8mPDayJ2 0lVPZdhFa4vlKXoFxdDF25Pfm+FVcxkDc9STFmCRVHQLZQvP0bsTQpSE/PxFTSMeV3WK x5do8GqKBzUYXw8/GVWl0KxQLe2eUsvXCfGRk9dfzxRm3YU1AV58PiaU8TJn5g1Or/mq U5xw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:date:auto-submitted:message-id :subject:from:to; bh=zAUtcZ/yLbhCGvoxJ3QQivdg+jsgb0UnKYn+sHYGMvE=; b=cuLG9/alVM0tbIHBUhcLQW/uEA+4FTFM8jYqQeco23rQXGNNug+bP+PToxh9fz+q6R 7JAhR/nLJRjWd1LTQlHzCFR6uBOqVKvg+LavnQ4CTF7i31NYK32NBu2pdt/Pqnl4go+z KEDqh7cr20xB+TwqCKEf7RoZykHdGeet5QRcTg7pAkH5Vn2mnbYUpZ+osCURQa/pV4Xy i4CEwg4EXdbBXoeHt79HSlpkw7TUACn9ywSGixCd+BW6g4soQNGYxPjqr1KQDg+/8AfO YJCubycluHEoF/e3wiG9tWeZyVmLLBfoXrKMj1dsAXvD+rtkM74pAKgkqqvGA2cewWAn 5c2Q== X-Gm-Message-State: AA+aEWYOcgYJ4fySaGNIbjikw2v/akxu0Xrz1i+V1BoTJbKD1ncQzyfY RlTn3LWHhs2F/9nKoyBzrd6r401NSM1IeUCyxA/ysy6xn3Y= X-Google-Smtp-Source: AFSGD/XfFDWBnqz1f96RA7S4/+Wr6NS1OgzzFD/r35mxWuB8GVgy6SsBx9fJvRE8lfjkdSiECFG7bCBTUyApFlLAfTUA75Fvieg= MIME-Version: 1.0 X-Received: by 2002:a9d:3d88:: with SMTP id l8mr6867001otc.20.1542888811385; Thu, 22 Nov 2018 04:13:31 -0800 (PST) Date: Thu, 22 Nov 2018 04:13:31 -0800 Auto-Submitted: auto-generated X-Notifications: 55f603bc29000000 Message-ID: Subject: =?UTF-8?B?WW91IGhhdmUgYmVlbiBhZGRlZCB0byDYp9iu2KjYp9ixINin2YTYr9in2LEg2KfZhNi5?= =?UTF-8?B?2LHYqNmK2Kkg2YTZhNiq2YbZhdmK2Kkg2KfZhNin2K/Yp9ix2YrYqQ==?= From: =?UTF-8?B?2KfYrtio2KfYsSDYp9mE2K/Yp9ixINin2YTYudix2KjZitipINmE2YTYqtmG2YXZitipINin?= =?UTF-8?B?2YTYp9iv2KfYsdmK2Kk=?= To: freebsd-stable@freebsd.org X-Rspamd-Queue-Id: ECE7974221 X-Spamd-Result: default: False [-3.11 / 15.00]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_NONE(0.00)[]; URI_COUNT_ODD(1.00)[19]; DKIM_TRACE(0.00)[googlegroups.com:+]; MIME_BASE64_TEXT(0.10)[]; DMARC_POLICY_ALLOW(-0.50)[googlegroups.com,none]; MX_GOOD(-0.01)[cached: gmr-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.86)[-0.858,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-1.34)[ip: (-2.91), ipnet: 2607:f8b0::/32(-2.18), asn: 15169(-1.53), country: US(-0.09)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[noreply]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[googlegroups.com]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; HTML_SHORT_LINK_IMG_2(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[7.4.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="UTF-8"; format=flowed; delsp=yes Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Nov 2018 12:13:32 -0000 SGkgZnJlZWJzZC1zdGFibGVAZnJlZWJzZC5vcmcsDQpiYXNtYWVsZ2FtYWlsMjI1QGdtYWlsLmNv bSBhZGRlZCB5b3UgdG8gdGhlINin2K7YqNin2LEg2KfZhNiv2KfYsSDYp9mE2LnYsdio2YrYqSDZ hNmE2KrZhtmF2YrYqSAgDQrYp9mE2KfYr9in2LHZitipIGdyb3VwLg0KaHR0cHM6Ly9ncm91cHMu Z29vZ2xlLmNvbS9kL2ZvcnVtL2FyYWI0NTg1DQoNCk1lc3NhZ2UgZnJvbSBiYXNtYWVsZ2FtYWls MjI1QGdtYWlsLmNvbToNCjIzINiv2YrYs9mF2KjYsSAgMjAxONmFINin2YTZgtin2YfYsdipICgg 2KfZhNmF2KTYqtmF2LEg2KfZhNi52LHYqNmJINin2YTYs9in2KjYuSApINin2YTYqti32YjZitix INin2YTYp9iv2KfYsdmKINmB2YogIA0K2KfZhNmF2KTYs9iz2KfYqiDYp9mE2K3Zg9mI2YXZitip INio2K3YttmI2LEg2KfZhNij2LPYqtin2LDYqSDYp9mE2K/Zg9iq2YjYsdipIC8g2YTZitmE2Yog 2YTYt9mB2YogINix2KbZitizINij2YPYp9iv2YrZhdmK2Kkg2KfZhNiz2KfYr9in2KoNCg0KQWJv dXQgdGhpcyBncm91cDoNCtiq2K3Zitin2KrZiSAvINiz2KfYsdipINi52KjYryDYp9mE2KzZiNin 2K8NCtis2YjYp9mEIC8gMDAyMDEwOTY4NDE2MjYNCjAwMjAxMTEyNjk0NjA4DQrYqNix2KzYp9ih INin2YTYudmE2YUg2KjYp9mE2KXYs9iq2YTYp9mFDQoNCkdvb2dsZSBHcm91cHMgYWxsb3dzIHlv dSB0byBjcmVhdGUgYW5kIHBhcnRpY2lwYXRlIGluIG9ubGluZSBmb3J1bXMgYW5kDQplbWFpbC1i YXNlZCBncm91cHMgd2l0aCBhIHJpY2ggY29tbXVuaXR5IGV4cGVyaWVuY2UuIFlvdSBjYW4gYWxz byB1c2UNCnlvdXIgR3JvdXAgdG8gc2hhcmUgZG9jdW1lbnRzLCBwaWN0dXJlcywgY2FsZW5kYXJz LCBpbnZpdGF0aW9ucywgYW5kIG90aGVyICANCnJlc291cmNlcy4NCg0KSWYgeW91IGRvIG5vdCB3 aXNoIHRvIGJlIGEgbWVtYmVyIG9mIHRoaXMgZ3JvdXAgb3IgYmVsaWV2ZSB0aGlzIGdyb3VwIG1h eSAgDQpjb250YWluIHNwYW06DQoqIFlvdSBjYW4gdW5zdWJzY3JpYmUgZnJvbSB0aGlzIGdyb3Vw IGF0ICANCmh0dHBzOi8vZ3JvdXBzLmdvb2dsZS5jb20vZC9mb3J1bS9hcmFiNDU4NS91bnN1YnNj cmliZS9BSFo3S1ZQTjlxRzRjcG40MlMtZlFpYVlfcWh0bGVxMlV2YkY3ZG5TaEZud3prZVdBN2x1 bnIzTm9mTnkyaXZ5YXFVUl9nakxrWG5IVXBnWktnb3g4dkVmOFNESU1Vd0szZyAgDQpvciBieSBz ZW5kaW5nIGVtYWlsIHRvIGFyYWI0NTg1K3Vuc3Vic2NyaWJlQGdvb2dsZWdyb3Vwcy5jb20NCiog WW91IGNhbiByZXBvcnQgdGhpcyBncm91cCBmb3IgYWJ1c2UgYXQgIA0KaHR0cHM6Ly9ncm91cHMu Z29vZ2xlLmNvbS9kL2FidXNlL1lRQUFBSlp3cllEZUFBQUFvTm1RSWdnQUFBRGtfZ080ZHdTQnd4 bEc1Z3c3X0ZodTRLcXhURTQNCiogWW91IGNhbiBvcHQgb3V0IG9mIGFsbCBmdXR1cmUgR29vZ2xl IEdyb3VwcyBhY3Rpdml0eSBhdCAgDQpodHRwczovL2dyb3Vwcy5nb29nbGUuY29tL2Qvb3B0b3V0 DQoNClZpZXcgdGhpcyBncm91cCBhdDogaHR0cHM6Ly9ncm91cHMuZ29vZ2xlLmNvbS9kL2ZvcnVt L2FyYWI0NTg1DQoNClN0YXJ0IHlvdXIgb3duIGdyb3VwIGF0IGh0dHBzOi8vZ3JvdXBzLmdvb2ds ZS5jb20vZC9jcmVhdGVncm91cC4NClZpc2l0IEdvb2dsZSBHcm91cHMgSGVscCBDZW50ZXIgYXQg IA0KaHR0cDovL3N1cHBvcnQuZ29vZ2xlLmNvbS9ncm91cHMvYmluL2Fuc3dlci5weT9hbnN3ZXI9 NDY2MDEuDQo= From owner-freebsd-stable@freebsd.org Thu Nov 22 13:33:34 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 451781148E72; Thu, 22 Nov 2018 13:33:34 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.not-for.work (onlyone.not-for.work [IPv6:2a01:4f8:201:6350::2]) by mx1.freebsd.org (Postfix) with ESMTP id 768FF76FD4; Thu, 22 Nov 2018 13:33:33 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from [192.168.23.186] (unknown [89.113.128.32]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.not-for.work (Postfix) with ESMTPSA id 039851D06; Thu, 22 Nov 2018 16:33:31 +0300 (MSK) Reply-To: lev@FreeBSD.org Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. To: Mark Johnston Cc: FreeBSD FS , FreeBSD stable References: <20181120204537.GB2630@raichu> From: Lev Serebryakov Openpgp: preference=signencrypt Autocrypt: addr=lev@FreeBSD.org; prefer-encrypt=mutual; keydata= xsFNBFKbGksBEADeguVs+XyJc3mL3iiOBqDd16wSk97YTJYOi4VsHsINzJr09oFvNDiaDBIi fLn2p8XcJvehcsF2GSgrfXfw+uK4O1jyNIKJmiYA0EtE+ZbRtvDrrE0w6Q8+SDeKA21SWh3Y vSQ0DJUontbgW55ER2CbEiIUTIn34uQ0kmESAaw/v5p/9ue8yPTmURvv130FqPFz8VPzltqL NxyGt54TxPfKAzAHEIwxlEZ63JOwzloKh1UDBExcsf9nJO08/TAVgR5UZ5njFBPzaaquhRoP qPJLEQQDqxPIlvMNtHKf7iIebE4BHeqgCdJA0BoiR6gpa0wlsZtdrTPK3n4wYSphLvGbhfOZ YW/hbcu7HYS/FImkVxB3iY17kcC1UTnx4ZaYeASPBGOOPbXky1lLfmDGWIFT//70yx+G17qD OZzF1SvJJhGvh6ilFYaWMX7T+nIp6Mcafc4D7AakXM+XdubNXOMlCJhzPcZ0skgAEnYV587w V7em5fDVwQccwvtfezzqKeJAU5TGiywBHSR5Svzk2FwRNf6M//hWkpq0SRR63iOhkHGOAEBi 69GfEIwH2/w24rLxP0E+Hqq8n+EWNkPatw1Mhcl5PKkdvGCjJUaGNMkpBffjyYo254JXRscR eEnwdIkJt4ErDvjb2/UrOFq31wWMOiLzJeVchAgvTHBMRfP9aQARAQABzShMZXYgU2VyZWJy eWFrb3YgPGxldkBzZXJlYnJ5YWtvdi5zcGIucnU+wsGCBBMBCAAsAhsDBwsJCAcDAgEGFQgC CQoLBBYCAwECHgECF4ACGQEFAlKbP8wFCQlmJwEACgkQ6rA8WL/cR4/6VBAAjRMyyX3PBFx/ HxyiIZ698EfwlWUua8Ft4crtrdK52m0qNkbBB9BH8xQgBHG32A1CwyzQnzxHgZuoOWMjh+Qq WJv7dmpM/q/c1GCJHhlPgewXrciTwpAamZILN071u+1GCPWwGRPzfQ/U+k63KJWx9ozf4doM WTTom6Cqcssi4J1u5kkt52a5ZRhsCK9pEVGilk36XTP9BakGrnMSIxF/NK4xeZVX2q+Nuqvf RchyofKXVgLEDLwb1cd/baLtBpDzy0PTN2Zl2lX4kOA6jwTKsqRya9A1Vui1KXwPh2XViTQ1 7Y3l5qg/M+sR73DohezP6bO6huOnLhty17jAqHPNlD6RonDo+j8uIlEg4iMSTN3MhzkBAu0Q pe3ucQ0o1767JiXN3fsNvRzSFhLVNDqPLce4uKlMogsbreXWvdgHGTN1ybOHGbybZnP77yHz uNBacbmG3vL/OLXMqwLdL2JXoiec4DmXjjCdhTBl5xLV9Hz/6VWKqElteg8QFVvHB3tHWzJ4 /rpiVEixytCIII6DS33BXZ0h2EOkK/6AYA2SJxy1vgOH4SZBtDBHoezmHV2nFnq5O0c7AuAB 7WPWgQG0sEwHQPZmg/baRGitRJnaxf/Gvf1DeD1x1VrcoVke2vwBcgDM3kugP8L9hsqic2D3 dI+gP76haeuvNNZr3y9L9zvOwU0EUpsaSwEQALRr3B+OjY/cnJPstz5CVsVWyEZtJtrNviZr tBgbkhlkPm98sEWR4+gbpyeufdYJengDjeGzMDKcLB7h5fICS/j6A8XdlJ40TlbPfNgb6OHa ebaIYKTJpXKR9sD7ZyGivYMofm0em40wGUX7BIkdkomaWj+wUiS0CdXU0FWDj9wv73+Eim+X zZyXeFgIPv97v+pET7DfwKkADOfrkW9s4OfvGVjd+wm35wc8EngQEz0qdPBxx74X7vZFAxlA SXu8gDBJGYt2Bkc3QwULnfeXrZJWgqNPR5o44gGu96yaiOFaN/C6CJtev5ZEX+0ZxbvsHHB7 Z5AtsRURKpZ4w5HFHGhzHtDtoAKgeZ/gbhTVXPHvNQR818eN+Nl5BV8BRF/8yhR6VlJb8GYw h8oKDeVGVYC34+raHZQAM9WoBnN7jlt4T9zzPwtmw5mIahGFgvw1KDr7OItN2ZgtZ20UYC5m Go602nmHq0aPbU6SwGi1xohrliNsKaaciYiMaVIGRQq8iGr9Fe2HlvaA3BpB275i/gCVlUdG y5XLAv+yQMUvn5Z7XVsMroxDk/O+ae1ElyBvKiKyfWGJXTg5XUukkkyQmfWPxWUGoNA1P/P4 GMHSu7/Rqe/7m4uPu/RyTTqsSjjKJdP9kBwEzvqPtXsVoZuShtrptRQJDYflhgE4qmKSMKen ABEBAAHCwWUEGAECAA8FAlKbGksCGwwFCRLMAwAACgkQ6rA8WL/cR48RkA//SNzeW3CI8KHx rA0aeHW6Nb5ieoqVRBGLyjBM06RX6vHB9v4dJL6Z+yV2jGN2s+XZX2HILbuTOwcTxGkI3xTT e0cDXVaF5K8R/liigUjtwuC2v/sWgoWyUmK1Cy9CPYdcXmFq6nESfkUe8DYiGOUULdHq5w63 F53yOZ72iXRBQBZgkhPtRFu4lPYIzOsMag9DIJ9CthR1r0ziqU/keb94Qt3l+aXK7CwGdY7X T4zUIMHNYsuAuyX+NJIXfsN68TT6m7QmlUwxPs13nxmoVQzm4ruV+hlQKh1MtbsjWRkNgPxF IPiqoAEhy8QoddlSvRTwL5Z7zFQiwMdiXU7toL8pfzj/zJR1jELXKMipijrt5MLrV8XX3OPN yZZvh95VIl8mv+iAqwSZUufd2EJnvj5TObB0eH+a+34NWf/XqA3fPjE6KHzmdnw9PZjPEjlx JCPECSs+6gse1+GaEfKYuXzB/ENe2ctlcfx5iQJXFc+/+zG/uU/JX/pXJHA12CUfB5g7lH6X BZIHvRo3VTCDjXgbF5xxDAe5V4exf8d4oSNjQIFLYxxN7zkvH89EN6RPfRgsWN7bYArCwfS9 MOgs9pFeCOewR6qieK150aoqNENGfKFXJup+5VVl6I0mU+j0rgVDZDht2/QgP/Tb4lGBe+ai pOGaK/GYNR+Ad6bUmokKsx4= Organization: FreeBSD Message-ID: <6c41605a-81b4-c436-6114-98f1c802fbd3@FreeBSD.org> Date: Thu, 22 Nov 2018 16:33:26 +0300 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: <20181120204537.GB2630@raichu> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="nqLE7tjI1KuD3G9rbxMAvS8uhOHDiUvcO" X-Rspamd-Queue-Id: 768FF76FD4 X-Spamd-Result: default: False [1.48 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_SPAM_LONG(0.48)[0.482,0]; NEURAL_SPAM_SHORT(0.34)[0.338,0]; NEURAL_SPAM_MEDIUM(0.66)[0.664,0]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Nov 2018 13:33:34 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --nqLE7tjI1KuD3G9rbxMAvS8uhOHDiUvcO Content-Type: multipart/mixed; boundary="sMcdeZmo5JPzFDejptSBbyacLa6uXWwKb"; protected-headers="v1" From: Lev Serebryakov Reply-To: lev@FreeBSD.org To: Mark Johnston Cc: FreeBSD FS , FreeBSD stable Message-ID: <6c41605a-81b4-c436-6114-98f1c802fbd3@FreeBSD.org> Subject: Re: Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore. References: <20181120204537.GB2630@raichu> In-Reply-To: <20181120204537.GB2630@raichu> --sMcdeZmo5JPzFDejptSBbyacLa6uXWwKb Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 20.11.2018 23:45, Mark Johnston wrote: >> Where is other 11G of memory?! >> >> I've checked USED and FREE in "vmstat -z" output and got this: >> >> $ vmstat -z | tr : , | awk -F , '1{print $2*$4,$2*$5,$1}' | sort -n | >> tail -20 >> 23001088 9171456 MAP ENTRY >> 29680800 8404320 VM OBJECT >> 34417408 10813952 256 >> 36377964 2665656 S VFS Cache >> 50377392 53856 sa_cache >> 50593792 622985216 zio_buf_131072 >> 68913152 976896 mbuf_cluster >> 73543680 7225344 mbuf_jumbo_page >> 92358552 67848 zfs_znode_cache >> 95731712 51761152 4096 >> 126962880 159581760 dmu_buf_impl_t >> 150958080 233920512 mbuf_jumbo_9k >> 165164600 92040 VNODE >> 192701120 30350880 UMA Slabs >> 205520896 291504128 zio_data_buf_1048576 >> 222822400 529530880 zio_data_buf_524288 >> 259143168 293476864 zio_buf_512 >> 352485376 377061376 zio_buf_16384 >> 376109552 346474128 dnode_t >> 2943016960 5761941504 abd_chunk >> $ >> >> And total USED/FREE numbers is very strange for me: >> >> $ vmstat -z | tr : , | awk -F , '1{u+=3D$2*$4; f+=3D$2*$5} END{print u= ,f}' >> 5717965420 9328951088 >> $ One more datapoint: I needed to reboot system and right after reboot= ARC becomes 14GiB (what was expected) and now it slows defalate, though I didn't get more "Free" memory. So, ARC becomes smaller and smaller after first fill-up, but all memory is "Wired". --=20 // Lev Serebryakov --sMcdeZmo5JPzFDejptSBbyacLa6uXWwKb-- --nqLE7tjI1KuD3G9rbxMAvS8uhOHDiUvcO Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE+W0coLX0MYtnSzMK6rA8WL/cR48FAlv2sCZfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEY5 NkQxQ0EwQjVGNDMxOEI2NzRCMzMwQUVBQjAzQzU4QkZEQzQ3OEYACgkQ6rA8WL/c R49uzQ/+OaCSQrUCF1+3crHJJqygHkvy3vdAplEpZJG3QfXOniLnX/9n3J95gGGm CXS1n2zTLy+KzEXTR3slNRqZsuK6rXYHfN6+7J4N2xmsMaYrEDudieAc10uhu2/8 fsjw19I5fPCEzVhu3cL6td2yvY/KndRCrUrCp1llTZ8WSumWty2oxG+e4YBsWLKb GWNP4sTb7ut4PthPm5ZGRnuFBIOjp7dGfSPp6BrN8+k0OVtLJqHt3F88ZHcaQ8nz s7KR0F7UzKcF2bI39NCfOW6zH8dOcUQzTt+oJ6C3G8YCgHKxZt77rclfZzfpQQLp arOGbHAcWq85+7kgyeBNKLUUO2PFnSXKTsO2rwH3ibUbCjmFZF0Cv5DlrUW/BLCd MZgohUewgPYU9j5TCx7XsCS1DwRPY9dDIUpavBgZRXfMDYq7KEsVlFpZT6c7bt/C NR6M1LIRCcq81XnlM2ur3fUlAOh2SUgHAWXwwgR7iI/tN+ZHJL3SXVpGYgTiZzpB JBnYkKaXbktK617HwmZKV2/OXDX4bwIHqhjMcxM/oWpdHRxDwKYuMEuZnwxVAxqX OVk3mhdOeTFVEvMYn/S2mr5S+m8jLwilh2qFDbtHsnMPAoETM6q73jIiVDfpkPzb T9AEiUrc7CKnXT3oXJEFLZZdhmdfePArn69X6IRPSpcHZ2LdHG4= =C1fk -----END PGP SIGNATURE----- --nqLE7tjI1KuD3G9rbxMAvS8uhOHDiUvcO-- From owner-freebsd-stable@freebsd.org Thu Nov 22 20:39:54 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 84C421106E04 for ; Thu, 22 Nov 2018 20:39:54 +0000 (UTC) (envelope-from jclarke@marcuscom.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id DD38F86009 for ; Thu, 22 Nov 2018 20:39:53 +0000 (UTC) (envelope-from jclarke@marcuscom.com) Received: by mailman.ysv.freebsd.org (Postfix) id 9D2CA1106E00; Thu, 22 Nov 2018 20:39:53 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4740A1106DFF for ; Thu, 22 Nov 2018 20:39:53 +0000 (UTC) (envelope-from jclarke@marcuscom.com) Received: from alln-iport-6.cisco.com (alln-iport-6.cisco.com [173.37.142.93]) (using TLSv1.2 with cipher DHE-RSA-SEED-SHA (128/128 bits)) (Client CN "iport.cisco.com", Issuer "HydrantID SSL ICA G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6CDFC85FF8; Thu, 22 Nov 2018 20:39:52 +0000 (UTC) (envelope-from jclarke@marcuscom.com) X-Files: Screen Shot 2018-11-22 at 15.20.38.png : 33688 X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0DSAAD6Evdb/5NdJa1iHAEBAQQBAQc?= =?us-ascii?q?EAQGBUwUBAQsBgVopZgNMMyeDeZQYgwCWR4F6CAEEH4RNhBIiNgcNAQMBAQI?= =?us-ascii?q?BAQJtHAyFSB5WOAEBIwIEFQFSCAEBgx0BggGoWYEvig4PjAkXgUA/gTiCPYM?= =?us-ascii?q?wIg6BP1qCN4JXAolRhj+JIIZSCYFkgj2BdYsTHolhhyeQD4ghgU0HKoFVTSM?= =?us-ascii?q?VgycJgzQBAoJIinAhAzABixCCSwEB?= X-IronPort-AV: E=Sophos;i="5.56,266,1539648000"; d="png'150?scan'150,208,150";a="202424763" Received: from rcdn-core-11.cisco.com ([173.37.93.147]) by alln-iport-6.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 22 Nov 2018 20:39:50 +0000 Received: from [192.168.10.244] (rtp-jclarke-nitro4.cisco.com [10.118.87.85]) by rcdn-core-11.cisco.com (8.15.2/8.15.2) with ESMTP id wAMKdoZR009135; Thu, 22 Nov 2018 20:39:50 GMT To: stable@freebsd.org From: Joe Clarke Openpgp: preference=signencrypt Autocrypt: addr=jclarke@marcuscom.com; prefer-encrypt=mutual; keydata= xsDiBDo1cJ0RBADSZSmbmzdRr1CoRWWKmAyu0eaQimaLV1TsZEML/ksLyg6faXrKIA/MWc7M w4FmKkDjaZdFzobzabnKp2QwVadLqi1gYY2WsApKC0rSoqsPx5E847AmwNWXgjXiXORXmnZL mf5PZ2ECOEJC27sji5Nrh9GSw7OPp6c+EE20gMNVrwCgu3iK5vyGQfy0/wX/jcIvP0nHznUD /RvijiKomyaf6F5pibmouFNeuCDHc8lwx2giA/MCZl/nSkI2/UX27sULGNgvKNkVPu/AukXu zW3fIthsJgjQZUoi/BTe9kUP+RL3+RALXXuLv7b3xGRHJ8A1Rpy9H43fkjHZ945YNPrUvJlG LP5PNGBD1xC21X3EGAyywVynDskcA/4qgbJFkVzmPjFJUjq+RW1zw3UIb3bbkskl/wk5qd+M w2EhiSPTbEhJQAQUvqSGFWEGp2ANic7iYLdPXV/O6I1/guRRaY0eK77YkkCjz1snaKYnGSeI GHGwmHb6D+ZHzTqZqr6IssgEIUHjXfgOUTARQbL15nJTVRzDGUiT/65R3c0eSm9lIENsYXJr ZSA8amNsYXJrZUBjaXNjby5jb20+wl8EExECABcFAjyDqGQFCwcKAwQDFQMCAxYCAQIXgAAS CRDN7TXCWm4C3wdlR1BHAAEB5KkAn0kBda/9+uF6RfnDSFS7RExUU9DqAJ4knRckYiSASteC K03QVtEiXblL287ATQQ6NXCeEAQAhIURlK17jmIMdMIuScFU6xK+jkKgVVFrjlRH5vLV2spp jH/uQ57MMGuOcs7PckXCnPjBV8Tm32Tuw+fCyrbc2gt0ouiT/5WWj0EMeAfWew1zBXX2okGf LqS6gucVDS6tcEFN6PmJEmX+tWDcmiqx/xXiSfMVYiLMdlK+YDkMDDsAAwUD/3BWOyfdnBGH Kv28zx+5wq/2vhYnUYCAdVD2ZWCJizQTMbkcxEIKAwtAj6yqKq9ah82nt4VHl5ZejVe47jvR 2nXwJ5VQ9eITuTjTLDw+3qr9lN077VZ32hyb5ULJcW756j9Z3YB2FTANw6KHgChaSVVx9kYJ FlAggraU7mi39/wvwk4EGBECAAYFAjo1cJ4AEgkQze01wlpuAt8HZUdQRwABAQbdAJ9R8SzU Mluu9r93BMv6fAW9j6qTZgCfYcEAqOMJv+3Z+YxLiDtWcCY4Sfo= Cc: jhb@freebsd.org Subject: Panic on 11-STABLE with Xen guest Message-ID: <00d6d9ae-d5d8-ed88-34ee-2e67c0ca8904@marcuscom.com> Date: Thu, 22 Nov 2018 15:39:47 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 Content-Language: en-US X-Outbound-SMTP-Client: 10.118.87.85, rtp-jclarke-nitro4.cisco.com X-Outbound-Node: rcdn-core-11.cisco.com X-Rspamd-Queue-Id: DD38F86009 X-Spamd-Result: default: False [-5.86 / 15.00]; ARC_NA(0.00)[]; FORGED_RECIPIENTS_FORWARDING(0.00)[]; RCVD_COUNT_FIVE(0.00)[6]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; FORWARDED(0.00)[stable@mailman.ysv.freebsd.org]; NEURAL_HAM_LONG(-1.00)[-0.995,0]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; TO_DN_NONE(0.00)[]; AUTH_NA(1.00)[]; DMARC_NA(0.00)[marcuscom.com]; RCVD_IN_DNSWL_MED(-0.20)[5.0.0.0.0.5.0.0.0.0.0.0.0.0.0.0.a.6.0.2.4.5.2.2.0.0.9.1.1.0.0.2.list.dnswl.org : 127.0.9.2]; RCPT_COUNT_TWO(0.00)[2]; MX_GOOD(-0.01)[cached: creme-brulee.marcuscom.com]; R_SPF_NA(0.00)[]; NEURAL_HAM_SHORT(-0.98)[-0.982,0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.67)[ip: (-9.87), ipnet: 2001:1900:2254::/48(-4.75), asn: 10310(-3.64), country: US(-0.09)]; ASN(0.00)[asn:10310, ipnet:2001:1900:2254::/48, country:US]; FORGED_RECIPIENTS(0.00)[stable@freebsd.org ..,freebsd-stable@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Nov 2018 20:39:55 -0000 I believe after the commit 340016 for the dynamic IRQ layout, my Xen VM started to panic. I just upgraded the kernel today and saw this: xen: unable to map IRQ#2 panic: Unable to register interrupt override cpuid = 0 KDB: stack backtrace: #0 0xffffffff8060a4e7 at kdb_backtrace+0x67 #1 0xffffffff805c3787 at vpanic+0x177 #2 0xffffffff805c3603 at panic+0x43 #3 0xffffffff8093a766 at madt_parse_ints+0x96 #4 0xffffffff803353f9 at acpi_walk_subtables+0x29 #5 0xffffffff8093a5e6 at xenpv_register_pirqs+0x56 #6 0xffffffff80928296 at intr_init_sources+0x116 #7 0xffffffff8055eba8 at mi_startup+0x118 #8 0xffffffff8029902c at btext+0x2c The following kernel works: @(#)FreeBSD 11.2-STABLE #4: Thu Nov 1 02:24:07 EDT 2018 FreeBSD 11.2-STABLE #4: Thu Nov 1 02:24:07 EDT 2018 root@creme-brulee:/usr/obj/usr/src/sys/CREME-BRULEE The following kernel produces the panic above immediately on boot: @(#)FreeBSD 11.2-STABLE #5: Wed Nov 21 11:08:38 EST 2018 FreeBSD 11.2-STABLE #5: Wed Nov 21 11:08:38 EST 2018 root@creme-brulee:/usr/obj/usr/src/sys/CREME-BRULEE Attached is a screen grab of the console of the panic. Joe -- PGP Key : http://www.marcuscom.com/pgp.asc From owner-freebsd-stable@freebsd.org Fri Nov 23 10:28:14 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D087911424B5 for ; Fri, 23 Nov 2018 10:28:13 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from elf.hq.norma.perm.ru (mail.norma.perm.ru [IPv6:2a00:7540:1::5]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.norma.perm.ru", Issuer "Vivat-Trade UNIX Root CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 06AE6827CA for ; Fri, 23 Nov 2018 10:28:12 +0000 (UTC) (envelope-from eugene@zhegan.in) Received: from bsdrookie.norma.com. (asterisk.enaza.ru [91.237.76.254] (may be forged)) by elf.hq.norma.perm.ru (8.15.2/8.15.2) with ESMTPS id wANAS7v0023455 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO) for ; Fri, 23 Nov 2018 15:28:08 +0500 (+05) (envelope-from eugene@zhegan.in) To: freebsd-stable@freebsd.org From: "Eugene M. Zheganin" Subject: 11-STABLE, gstat and swap: uneven mirror disk usage Message-ID: Date: Fri, 23 Nov 2018 15:28:07 +0500 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.1.1 MIME-Version: 1.0 Content-Type: text/plain; charset=koi8-r; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Rspamd-Scan-Time: 0.55 X-Rspamd-Queue-Id: 06AE6827CA X-Spamd-Result: default: False [-6.87 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.997,0]; DMARC_NA(0.00)[zhegan.in]; MX_GOOD(-0.01)[cached: mail-backup.zhegan.in]; NEURAL_HAM_SHORT(-0.94)[-0.940,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-3.62)[ip: (-9.53), ipnet: 2a00:7540:1::/48(-4.77), asn: 57401(-3.81), country: RU(0.01)]; ASN(0.00)[asn:57401, ipnet:2a00:7540:1::/48, country:RU]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 23 Nov 2018 10:28:14 -0000 Hello, Am I right concluding that there's something wrong in either how freebsd works with swap partition, or with how gstat reports its activity ? Because on the consistently woring mirror the situation when only one disk member is used and the other is not for both reads and writes just cannot happen: last pid: 24590; load averages: 6.54, 8.61, 9.86 up 16+04:11:06 15:22:24 79 processes: 1 running, 78 sleeping CPU: 0.2% user, 0.0% nice, 15.0% system, 1.8% interrupt, 83.0% idle Mem: 55M Active, 1092K Inact, 2136K Laundry, 61G Wired, 1111M Free ARC: 33G Total, 1799M MFU, 26G MRU, 3808M Anon, 408M Header, 1032M Other 26G Compressed, 31G Uncompressed, 1.18:1 Ratio Swap: 32G Total, 1665M Used, 30G Free, 5% Inuse, 5620K In, 2276K Out # gstat -do dT: 1.004s w: 1.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w d/s kBps ms/d o/s ms/o %busy Name 0 19 19 137 1.0 0 0 0.0 0 0 0.0 0 0.0 2.0| da0 16 342 342 2774 38.5 0 0 0.0 0 0 0.0 0 0.0 100.0| da1 2 5517 4192 38629 0.6 1189 25531 0.3 0 0 0.0 135 0.8 67.3| da2 2 5408 4139 39203 0.6 1134 25332 0.4 0 0 0.0 135 0.9 69.5| da3 0 5534 4193 37472 0.6 1205 25562 0.4 0 0 0.0 135 0.9 69.3| da4 1 5501 4170 37238 0.6 1196 25404 0.3 0 0 0.0 135 0.9 66.8| da5 0 5979 4485 42487 0.6 1366 28570 0.3 0 0 0.0 128 0.7 71.0| da6 0 5897 4521 41109 0.6 1247 28578 0.3 0 0 0.0 128 0.9 70.1| da7 0 5922 4491 41663 0.5 1302 28815 0.3 0 0 0.0 128 0.8 69.1| da8 0 6071 4611 40399 0.5 1332 28291 0.3 0 0 0.0 128 0.8 68.6| da9 2 5681 4267 41476 0.5 1286 24951 0.3 0 0 0.0 127 0.7 66.4| da10 2 5515 4147 40652 0.6 1241 24752 0.3 0 0 0.0 127 1.0 66.6| da11 2 5768 4284 41432 0.5 1357 24896 0.3 0 0 0.0 127 0.8 64.8| da12 0 5608 4209 39565 0.5 1271 24752 0.3 0 0 0.0 127 0.8 64.6| da13 0 5217 3747 37203 0.5 1333 25908 0.2 0 0 0.0 137 0.6 60.6| da14 0 5151 3725 38226 0.5 1288 25753 0.2 0 0 0.0 137 0.6 61.0| da15 0 5157 3722 36736 0.5 1297 25908 0.3 0 0 0.0 137 0.7 63.4| da16 0 4948 3645 36375 0.7 1165 25655 0.4 0 0 0.0 137 0.8 67.0| da17 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| da18 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| da0p1 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| da0p2 0 17 17 133 0.7 0 0 0.0 0 0 0.0 0 0.0 1.2| da0p3 0 2 2 4 4.0 0 0 0.0 0 0 0.0 0 0.0 0.8| da0p4 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| gpt/boot0 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| gptid/2cdc4b9e-c5c6-11 e5-a23b-0cc47ad2b886 0 17 17 133 0.7 0 0 0.0 0 0 0.0 0 0.0 1.2| gpt/zroot0 0 2 2 4 4.0 0 0 0.0 0 0 0.0 0 0.0 0.8| gpt/userdata0 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| da1p1 15 336 336 2263 35.5 0 0 0.0 0 0 0.0 0 0.0 100.0| da1p2 1 4 4 510 187.7 0 0 0.0 0 0 0.0 0 0.0 74.8| da1p3 0 2 2 1 243.0 0 0 0.0 0 0 0.0 0 0.0 48.4| da1p4 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| diskid/DISK-761S1047TB 4V 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| gpt/boot1 0 0 0 0 0.0 0 0 0.0 0 0 0.0 0 0.0 0.0| gptid/2ce52799-c5c6-11 e5-a23b-0cc47ad2b886 15 336 336 2263 35.5 0 0 0.0 0 0 0.0 0 0.0 100.0| mirror/swap 1 4 4 510 187.7 0 0 0.0 0 0 0.0 0 0.0 74.8| gpt/zroot1 0 2 2 1 243.0 0 0 0.0 0 0 0.0 0 0.0 48.4| gpt/userdata1 # gmirror status Name Status Components mirror/swap COMPLETE da0p2 (ACTIVE) da1p2 (ACTIVE) Thanks. Eugene. From owner-freebsd-stable@freebsd.org Sat Nov 24 08:47:18 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 98D3D11471FF for ; Sat, 24 Nov 2018 08:47:18 +0000 (UTC) (envelope-from shoesoft@gmx.net) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "mout.gmx.net", Issuer "TeleSec ServerPass DE-2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7F0FF6ED8B for ; Sat, 24 Nov 2018 08:47:17 +0000 (UTC) (envelope-from shoesoft@gmx.net) Received: from walrus.pepperland ([81.217.71.61]) by mail.gmx.com (mrgmx003 [212.227.17.190]) with ESMTPSA (Nemesis) id 0MgL1q-1g6Bac2OfO-00Nm9m for ; Sat, 24 Nov 2018 09:47:08 +0100 To: freebsd-stable@freebsd.org From: Stefan Ehmann Subject: bsdtar: xz threads support disabled Openpgp: preference=signencrypt Autocrypt: addr=shoesoft@gmx.net; prefer-encrypt=mutual; keydata= xsFNBFNRNzIBEADwWLAIn6EMLsbclDmzGQXSRu2dZYaLwW/dPVOmjm3aBOiiOlSi9ece0Pb5 rxTmPKXq0QeNtFPEAYPCNnHbFA95O1IsGuVVMGON7d1p2XIx68KBEngSCPopHB9EDDKo2NX3 rEkd/JQ7aAfogVeJIu2S3CoHq3Qwndb1b2rVhoBJSbr1wb3ipRrw9S3mW0l6libghi6j04iY idKi65RCI6T21IuPNL8b1cq9TQTD5Pcu5jC0yFrTaEjAqW2YOr+A/QsfLSA697Nhnq/l0JUv QUX70q6m39rFKRWWvSgGAnud9yppUa/sTNCYSuf9XdFtY09fsfFvx8LPiT0xP7+d7HOmzVvf 2J60U7CEkQVPh76LHIVVODY1NBmbpGtrow/DV3wtOPKJ1swp4IJ7xinduVMSnFpCxqyBbww6 6BpNQ8W5wHXRLQkG7gRWa10T9EMSchNM5DcxslU3TFjOINuaaEYAoq3i43hPKcWIT1mNg6M9 BzqOagRC0WThKgv4WyuZ7gQkA370Fl7SgG08LbgNavY1KO2U0CDONvK+Mz9YlY6dfg4qdQ+F 1cRseAWzKefQb72peUmO1h9TjT1LaQgl2XJCV4fh2je/tYb70Eb0ea3foBaUTbNThN9uIevN EANnrakwmzsGhB+OXOql1Occ4DyplS0IsVKPHE8+K/VoJUk7GQARAQABzSdTdGVmYW4gRWht YW5uIDxzdGVmYW4uZWhtYW5uQGdtYWlsLmNvbT7CwX4EEwECACgFAlNRNzICGwMFCQlmAYAG CwkIBwMCBhUIAgkKCwQWAgMBAh4BAheAAAoJECL7xb7kT8Vbim4QALDHbVEayN66yoQa2O2S lcS6ikNQPn/ixQazQKjXozxoTUC7RbzlwadJeOQc2h/xHytjMFV1NwZSR5GGyBvGWdWUiDlw +Oniz34n6eQn10JR/RWlFv7f23QhGCVwobqjySBRbGLTQnpGKi94TzmO/2uoSqgzxfj9nFEN KyRK+5uouWFLC7lPkmAgpuvQZTJiXAw/pj3nVrJC87BLUh74mBQTQwFnPRxuyU50Ikh63y9N LgNPaRO7wfa7GXYD8H/EgD8Ya/N24HYZG8SwLwYSzecUvyfPtnqVN9RcxAYUdXaoEDqw+Ye+ vWtxXvGEY6CUIkhwiHE++Qd99aRiK0JEFBRifaF6TXUWOwdM2MkcOrV3Ld09Mcl2j4/JTWqS 0su0jM4gB9rQfp8Vf3ExrhmpneZplwT4loRpM5HBlxVE4e9FDvyx5ug+V6xQbcXKpRQW4BjW 1Jviykv+YQqUvbBsidqM7cd7GdXrcN5hL2JRYLHdhYTTkpbkoyoNroMFSAknNVv+HTgqRYTd DRqT29iXy108Of99zRUOJVN49fOmdduO/PERyRUaKcjFWFX8a6ssdZpyr4fZP3vPdHi9AUNX kgZqykpM1uRHofegRV5bpOcAAPHrx9D0ttgeBTxVCLWJ5/BKYGZk6Zygx/HKruEvdF0lMdIA L6r1bbmSHJk2tF3ZzsFNBFNRNzIBEADF60SMu41IyKv+UrqddR6jOZ43VNAKpiyxSuUGuolt +64YioAIoSFjI0YYhyUNQGR5E3W35nT0uZs3VJwDMHdIupGxKtJ0FgQGRdkKKfvQQMdsJMuB sbPWU2KNy0/Ev69p9rtut31WBi8NVeRWd7Y5ViCe5JWw6Mz/4Cw5rm8EDf7e5UH8N/EckkU7 fKM26jvO8Zm4R70l/3e2KWVn7Dk+7Qqw4FlNn6XKJxvkotZ1fXESozFY6bFvFb/Gix/XQOdl 1bd7WFo+HuzStZ2PMsvuS+7hRfp/OpdP2hLc/+EG/9TcX+/1NkcwL2PQJkAj+DyUdO9xx7nu M50bzjcIawnEkQXyen61iIoH5KfiClI8hfVswUFy3N/QC5QayAi88RaaZmJTOm4c3fcOUdiO ezYF1CcBoIwzqCf5C6uygkeeyHY73iQUuKDZ8Dw21hzHEdaUOVJxzALYC0cwON84/d3a5L7r WIAJPDHTo3XNFM1vWJPLvymg1tlrBcooRQLNORTABeN16JylZ88GDMPAc7HkQ/HOR1uNoUtu yDGhGJSHbi0yTCs7XxOx5Ess10d+hpGN/FRrobi2Gg3Wo0b/Auwjk2TzQ44eP5ivS3pDiGMR qVImui+6wwlF9ZyVj8MZa9ejGOSrQ37JvE/Mx+S01LoX0037rlBxyFqYEpw8MJOImwARAQAB wsFlBBgBAgAPBQJTUTcyAhsMBQkJZgGAAAoJECL7xb7kT8VbA8IP/iJgD5Hvyebc8UHD2Jzk rAO2nhvik9fWeJM0eYF9X/w0MQdg5GanDfy79Z25l/HpvdTpXxfNBbrWkX4WWr0XMDM/qBpk EkyCZfTggmi0y7TMtq5tKSNOo8CJ99hTorE9mM1AY2G+hVTwIie9l+WIuHwZkUiue+5UlJCI AcJd7piJiqQ7dHFMITv+1TbJ2tzx3T+slPS7crCZi2P+3YBrD6hTcHODhCfo/llcLHSYVXYP C+IQIMFDdXBfqDCH6V0UAQ57gBhUv9dGp3IzxZCDplt3hIu6QhUk0j8q5e06YV08CEKC2JIw VFBfIQ1Ey+Ugo8ZCqxr/2jOIrtu0bUoxXyCh86zCigX4+HByRDA5YOCXhFqjJKqqVp76+Y+R 80SHYG1dmnGJ3Viy7Q4/ZyjEWrIsLspVMf5ASWvkFgsVYUAwsaCf+Ka5q7en/Stu8Vw4D+UJ xBEcc17fq1GlkBKfJ5p7GlZb21VKMkzRdJiaYkYkzYm38H7lo9dog4OIzA1SMNpAjwDbL7yR cR9KFkzegy71xH89NvfF1O0sKLrZd4YqD3dziQTB5pM2h9JNh7zwksT9jNxJ8L/bv9hvEJcF L0hw+1p9oarb20dowgIFEBqgmoDqRfcByssG4Uy8Yael4rsr04fsuGKUnUsxfZQ6GbnY474u MoQmdBQjEl36fxrH Message-ID: Date: Sat, 24 Nov 2018 09:47:07 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-Provags-ID: V03:K1:g3/2ezx7RlGDLHfSVk94drUxYdw7cUPtfVe2o41AgT85qgIIn9b WXecRaNpHay3vjAe8QjgTqHb6fMU1FCHvxShOdfZVVlQFoFxBnhvBRk36TBFqeuKK5fk6QT n1dpYpS0O7vZluefK7Fj2E4GoMUBFjD2TedMj34zeuMgMFw12HdckhBa4Lu5YHgbUr14UVB r2sxWYdzBoCxp7Z2aBI5g== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:hRbX02NUVKs=:30XaPMM+SQnj1XaSY/OAag 4BXfmsAYaEp2Qir76OED0iQIQv1ZhiP72cb0OyrHS0jeRTjxxdynZjLFStP7EmVmmnlnPt8Lg L2y1VOt5dbukqkQIWmnA0cuzv8fIbCc3AzVWuAZqxN0MPjojWnrWb5k6tdOKlc32s4FCBk1cp F649n4pv1StID/H1/8UXVx9z+uvLyYXWzNXE9+IuZN8TF/SyWumhRcGJvEmLF/b3VXvgq9SEW qU+Kiz3MxeQAz8LldmArYiycDeOLNIzt6Gbjb7weqlPQZBBzXwXeWSQzfM77GMxO/e1VvIHxi olVOPimT+6jiT+6wZDu57pGuzRsGutU7DRbp1fAQDfXYxsrS5LikzDyt4BPvgHtYvy3p97140 rFB2OQKRVSH4D1rC+rsFi/li0Mln7uzIG/3paer/FY1vLpulO01Zj1YNYdLeXOtYv/5hPapj5 KPEAuSg92RQWPpAJ1jaQknyOevqgdNq3o8kgWl+g2jHVqwq7nC6wG2B83pQZmWyt3LNw16ni3 hpR9OpVfG3AObCpeN9PaLiFSHKQBBsxCEcgreMB+4Jky4KgVDGOxYAfHuGikdiyFae/dRKKeZ mj65cMHUdB3LWOPQoG7Um7zGmVS7MIDkgrXpXJE2uLlwXaQM85ngi52jKBoacfpAZd0ixd3rq PQyefzQ0QNQWWNLgV3em8+wcjkzAQHBQ8sNW8UIXxmIAfBlhkJnq5O1ScnVZxJPJp5TB2RAKE omeKDM7b416kY6eZbm6OCkqOBZID2qdfqBxGmDOT59CH8SRZiSnAW/JU1b5Qz8828KVqovnrS VAssKIfftJkVeSZhRnRds++OLs118iNt8w0TWT9qXlfyLx/y91/DNXThC70OBXHt9hknp9I8L t8E6+B/SFM9Uv9F0LVS/eJJ+Q5SL2x3FmFDKV7s8Fgm0119ZP/Tpg+TMGhAJRj X-Rspamd-Queue-Id: 7F0FF6ED8B X-Spamd-Result: default: False [-3.78 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/25]; FREEMAIL_FROM(0.00)[gmx.net]; TO_DN_NONE(0.00)[]; MX_GOOD(-0.01)[mx00.emig.gmx.net,mx01.emig.gmx.net]; NEURAL_HAM_SHORT(-0.55)[-0.545,0]; RECEIVED_SPAMHAUS_PBL(0.00)[61.71.217.81.zen.spamhaus.org : 127.0.0.11]; RCVD_IN_DNSWL_LOW(-0.10)[19.15.227.212.list.dnswl.org : 127.0.3.1]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmx.net]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[gmx.net]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(-0.83)[ip: (-3.89), ipnet: 212.227.0.0/16(-0.36), asn: 8560(0.11), country: DE(-0.02)]; RWL_MAILSPIKE_POSSIBLE(0.00)[19.15.227.212.rep.mailspike.net : 127.0.0.17]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Nov 2018 08:47:18 -0000 Is there any reason why bsdtar is built without XZ multi-threading support? It's not documented in the man page, so maybe it's an experimental feature. Can be tested with this command: tar -Jcf /dev/null --options xz:threads=4 $HOME After setting HAVE_LZMA_STREAM_ENCODER_MT, it works as expected: Index: lib/libarchive/Makefile =================================================================== --- lib/libarchive/Makefile (revision 340812) +++ lib/libarchive/Makefile (working copy) @@ -7,7 +7,7 @@ LIB= archive LIBADD= z bz2 lzma bsdxml -CFLAGS+= -DHAVE_BZLIB_H=1 -DHAVE_LIBLZMA=1 -DHAVE_LZMA_H=1 +CFLAGS+= -DHAVE_BZLIB_H=1 -DHAVE_LIBLZMA=1 -DHAVE_LZMA_H=1 -DHAVE_LZMA_STREAM_ENCODER_MT=1 # FreeBSD SHLIB_MAJOR value is managed as part of the FreeBSD system. # It has no real relation to the libarchive version number. From owner-freebsd-stable@freebsd.org Sat Nov 24 11:53:51 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 29370114C2C5 for ; Sat, 24 Nov 2018 11:53:51 +0000 (UTC) (envelope-from jakub_lach@mailplus.pl) Received: from n6.nabble.com (n6.nabble.com [162.255.23.37]) by mx1.freebsd.org (Postfix) with ESMTP id DD05E75904 for ; Sat, 24 Nov 2018 11:53:49 +0000 (UTC) (envelope-from jakub_lach@mailplus.pl) Received: from n6.nabble.com (localhost [127.0.0.1]) by n6.nabble.com (Postfix) with ESMTP id 5D0ABAAC7D60 for ; Sat, 24 Nov 2018 04:53:42 -0700 (MST) Date: Sat, 24 Nov 2018 04:53:42 -0700 (MST) From: Jakub Lach To: freebsd-stable@freebsd.org Message-ID: <1543060422379-0.post@n6.nabble.com> Subject: 12-STABLE uname -a misses timestamp of the build MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: DD05E75904 X-Spamd-Result: default: False [1.88 / 15.00]; ARC_NA(0.00)[]; R_SPF_FAIL(1.00)[-all]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.66)[0.656,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_SPAM_MEDIUM(0.20)[0.204,0]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[mailplus.pl]; MX_GOOD(-0.01)[mx.tlen.pl]; NEURAL_SPAM_LONG(0.04)[0.043,0]; RCVD_IN_DNSWL_NONE(0.00)[37.23.255.162.list.dnswl.org : 127.0.10.0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-0.02)[asn: 21624(0.02), country: US(-0.09)]; ASN(0.00)[asn:21624, ipnet:162.255.20.0/22, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Nov 2018 11:53:51 -0000 Is there a way to restore it? I liked the old behaviour better, it was useful info for me. -- Sent from: http://freebsd.1045724.x6.nabble.com/freebsd-stable-f3932046.html From owner-freebsd-stable@freebsd.org Sat Nov 24 12:13:37 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9C5CF114D3B7 for ; Sat, 24 Nov 2018 12:13:37 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 67A0C76806 for ; Sat, 24 Nov 2018 12:13:35 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.west.internal (Postfix) with ESMTP id 6149614A8; Sat, 24 Nov 2018 07:13:27 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Sat, 24 Nov 2018 07:13:27 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yuripv.net; h= subject:to:references:from:message-id:date:mime-version :in-reply-to:content-type; s=fm3; bh=ICShRBT14aMhhiYdZYniGxS0iuA 1C2mTf8kZ7sJUcXk=; b=BUdrOSliUdKfu78XLHO5xsMkzAIW3t8lFAyddcrZ7/j b31/KPnFTivQTVzu5uDiBm/TSK1p+gTzRXV/afZqReCtAgBS3KUubViBB6nV+Tt4 +eVwM7HA8Si9KcD/xWkz+i8WcJ2X8cXeuhJPTIFMZ9eTnO/AOXf8BDe4SU3oP2nd 2W9v25/M7v4WdSssMXxKOueRlOHBIRRorJMuM6AE26wtwHJaECNIppSBTDjopKkv O7+zvk2i2S1g55o1KsmgRSvq6fNS9+zl+QloRxODY+cZqwjLQjFgGMmCTO14Dh+a PiUHrjQL3Lv/PD8GN6Z/mQkrCpj42viL6/Qyrsz1vGQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=ICShRB T14aMhhiYdZYniGxS0iuA1C2mTf8kZ7sJUcXk=; b=aEQ8xJOImXV4eQoff6FWR6 QeAvjq1T+MUEahG1oLStlX1JSZl5OnAviyjzc65uGhrRqqDhQDQXSw2CYkL5Nx3I uSNLW7WmMfjeIpZXWUnNjfw8YrTk2gy/wMI1bWsSxenTKY9q7IBncxg+zwdlpDi6 EoVpbvVFRZBi/rNxWPWlumSX2Y88Nc91vQQj9jYAddzCBT9PkH/kglxQ/Qz0DSsx Qpi5nYzXlt4sf1mDZcfKhGYums3JDxhy5PsIYLFywfxGXObyShiZPC3+ZLKwwD49 fFyObNhp14t294OQg4Wb5kXbHqopL/tiDRW3wWWk88EpWeXTP73OX8FaOoY6Wy+A == X-ME-Sender: X-ME-Proxy: Received: from thor.yuripv.net (unknown [92.50.223.252]) by mail.messagingengine.com (Postfix) with ESMTPA id C9EF5102A0; Sat, 24 Nov 2018 07:13:25 -0500 (EST) Subject: Re: 12-STABLE uname -a misses timestamp of the build To: Jakub Lach , freebsd-stable@freebsd.org References: <1543060422379-0.post@n6.nabble.com> From: Yuri Pankov Openpgp: preference=signencrypt Autocrypt: addr=yuripv@yuripv.net; keydata= xsBNBFu8u6IBCADB11gP0QwnorrHjqAtKLHKHNHskhy0s7jqJKfx0YqXgVBKGLJ9/mjLAz0F CBNvemHSDDTs0mEZ9cBKKi6cmsav6+UQgr//yai6hvXLBJqKchSFO4MhmdvBtsGFq1yKz5Zi uhjmimKyIpgBgvMdbgGbGq6cnSB2uEPmZuJr419SVRODOkXukU+F5WHgaHzDdHAIu1asCt2B +6msxqIqlFWcXyZyTGicTGGvC/PFIsVRUtD1dIJANTC876g7DTb7LZXWiWwJpSJ4GKMXMHVX Ct9BoQ4i3nhKbOxb6Io1wsy+NFyWsTJ9KYrxKKPJP3oG8BWb/cqlFqnE4eNSsiq2q7krABEB AAHNIFl1cmkgUGFua292IDx5dXJpcHZARnJlZUJTRC5vcmc+wsCUBBMBCgA+FiEE+Gq3PsPe LT4tL/9wk4vgf7Eq4WwFAlu9Cn0CGwMFCQWjmoAFCwkIBwMFFQoJCAsFFgMCAQACHgECF4AA CgkQk4vgf7Eq4WxuPQf9HccaDyusO1J+wDQNlp9/uU0cnIfjHAeG80xrAfN9Vnf1wO9T2/WI iYlIdK+KVnhSa/DeBuHq/asfpUbrOleTF0hzG39os+95DzuT9a/j5XeQGuBgNbpVB+10zR3I 5AagSQetHilcZtz65g9GTUuIxb+xDaBehFBjyYXApfNE6yY5IlzDZpM7MOOLLFm2mQwQ8yjS eZ4jA6qW6/QMXRTkmpC9EXIeWDuNgWBwszaFGR6oUIpl0mGmwdJkEKwUazt6OuoDilMNZefZ 0pVFZBhnE46vK+6FDDFZE3BkeHVnqvy2QGL/6uKhSHc0lChCEPHnhqz6v23MwcQ6ktVWzvBJ oM7ATQRbvLuiAQgAyood0Pd96wzY+GQPBYQUNkZZgYL8Di3AzyC94dFe4d/Mt/h4rIBUnFwA g7Ha05WGdW0V5A/RRxDcpwXL9Jf97hiQ5PI2hiAxNEz/DkAUafiGlPfwR5wKqysUyRiKJQ2o ctpvssdsoXXOgeLo1jA6ghda1jg/spjlsPlS5ZTpKx3GWuTybV/VDhmwKWZfGUzPBJeAgDTf BdW4PTFs1IvvC2KBlhnPgcLBUtTlAdXOEj4DLuXw+Fn7K/ckZdOn3aRANmE+wf4+f+UUgtLB NmbP7ZifyUX5RyddsnI+fZmtsUDHxCReNIWQ6TBUJmb21aoBIN6HEHJbY28ZSCmf5owuMwAR AQABwsB8BBgBCgAmFiEE+Gq3PsPeLT4tL/9wk4vgf7Eq4WwFAlu8u6ICGwwFCQWjmoAACgkQ k4vgf7Eq4WyA3AgAqgGTHKMVAS2WuNGuW9uI+YtY6ZbwmGG94fkOZbefgRSfO5Am+HSblA95 IdotvQa8VkFmvVjbnvaM8XmJG5H17m0GF3sVaJUbJ4euDnRrBPCr6KwRQQd83Svxkbdicvo7 J031FrkJZW8zD9DH4QgzJNTKPFrwx9v3DhD/8iyn9tGvnHepy7O24nY5hl6PacrgSgLVeir/ lUbueAC/gP1AWLv3gdw7b83J7rftWauimj/vpFMD8CDSyJNODgQ8DdM0TU4qjABWGMs9r2Rw QehNbYf5f/2QuW/Q5NGaRSNW2HS/cpp62XtTKmxj5wwk6EMbtNE/6WQpumfdmK2UGLjcJQ== Message-ID: <183252d3-7080-8747-4534-da0e8b0480ff@yuripv.net> Date: Sat, 24 Nov 2018 15:13:15 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: <1543060422379-0.post@n6.nabble.com> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="k34reS1HEIt2j8pDilxVSIB9uLlSVlGFo" X-Rspamd-Queue-Id: 67A0C76806 X-Spamd-Result: default: False [-5.58 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(0.00)[+ip4:64.147.123.25]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[yuripv.net:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; MX_GOOD(-0.01)[in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com,in2-smtp.messagingengine.com,in1-smtp.messagingengine.com]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_SHORT(-0.97)[-0.974,0]; RCVD_IN_DNSWL_LOW(-0.10)[25.123.147.64.list.dnswl.org : 127.0.5.1]; RECEIVED_SPAMHAUS_PBL(0.00)[252.223.50.92.zen.spamhaus.org : 127.0.0.11]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(3.00)[252.223.50.92.zen.spamhaus.org : 127.0.0.4]; R_DKIM_ALLOW(0.00)[yuripv.net,messagingengine.com]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; DMARC_NA(0.00)[yuripv.net]; BAD_REP_POLICIES(0.10)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(-3.39)[ip: (-8.66), ipnet: 64.147.123.0/24(-4.33), asn: 11403(-3.89), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Nov 2018 12:13:37 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --k34reS1HEIt2j8pDilxVSIB9uLlSVlGFo Content-Type: multipart/mixed; boundary="hO1oYSpcMBmwa6GlL3W4JPHohQjsSEsMI"; protected-headers="v1" From: Yuri Pankov To: Jakub Lach , freebsd-stable@freebsd.org Message-ID: <183252d3-7080-8747-4534-da0e8b0480ff@yuripv.net> Subject: Re: 12-STABLE uname -a misses timestamp of the build References: <1543060422379-0.post@n6.nabble.com> In-Reply-To: <1543060422379-0.post@n6.nabble.com> --hO1oYSpcMBmwa6GlL3W4JPHohQjsSEsMI Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable Jakub Lach wrote: > Is there a way to restore it? I liked the old behaviour better, it was = useful > info for me. See 20180913 in UPDATING and WITHOUT_REPRODUCIBLE_BUILD in src.conf(5). --hO1oYSpcMBmwa6GlL3W4JPHohQjsSEsMI-- --k34reS1HEIt2j8pDilxVSIB9uLlSVlGFo Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEE+Gq3PsPeLT4tL/9wk4vgf7Eq4WwFAlv5QGMACgkQk4vgf7Eq 4WxoSAf/QhwZwWTZw80DBZf9Epv75VYjjDM5fOn7vhaztXgvb3qYTAcZmLRt4uDG xRkvMzhvINWRDYs+nYy3UXvg5dP+pkpcLGTjbyY5FQG9Fk7skFoFsS5nykvZTFwF i2p7nH2Ywo4U5vG8HeT2Pw5Ss36HQVLHd4ARMayyMnUlKhRD0Pm1m0ce7F+knZTm 8ahTnFeflCfFnMBFHDGdw1Zbcj0972cKpHh9qKpRdXheJ7nD7kGOQNxa5EvqJIbk p4Hwnb5DZ1Y14NCOiq3FBLxDLZGoGCbzcXKB8X8uBDIi1eZZ1FvowkorjJAwfANz S9tiBF9UqXhz6qPZQkjxE28HDt/HLA== =3Vw4 -----END PGP SIGNATURE----- --k34reS1HEIt2j8pDilxVSIB9uLlSVlGFo-- From owner-freebsd-stable@freebsd.org Sat Nov 24 12:18:06 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CB056114D527 for ; Sat, 24 Nov 2018 12:18:06 +0000 (UTC) (envelope-from jakub_lach@mailplus.pl) Received: from n6.nabble.com (n6.nabble.com [162.255.23.37]) by mx1.freebsd.org (Postfix) with ESMTP id 21B94769A1 for ; Sat, 24 Nov 2018 12:18:05 +0000 (UTC) (envelope-from jakub_lach@mailplus.pl) Received: from n6.nabble.com (localhost [127.0.0.1]) by n6.nabble.com (Postfix) with ESMTP id 3A205AAC8EAC for ; Sat, 24 Nov 2018 05:18:05 -0700 (MST) Date: Sat, 24 Nov 2018 05:18:05 -0700 (MST) From: Jakub Lach To: freebsd-stable@freebsd.org Message-ID: <1543061885192-0.post@n6.nabble.com> In-Reply-To: <183252d3-7080-8747-4534-da0e8b0480ff@yuripv.net> References: <1543060422379-0.post@n6.nabble.com> <183252d3-7080-8747-4534-da0e8b0480ff@yuripv.net> Subject: Re: 12-STABLE uname -a misses timestamp of the build MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 21B94769A1 X-Spamd-Result: default: False [1.96 / 15.00]; ARC_NA(0.00)[]; R_SPF_FAIL(1.00)[-all]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.66)[0.664,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_SPAM_MEDIUM(0.24)[0.241,0]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[mailplus.pl]; MX_GOOD(-0.01)[cached: mx.tlen.pl]; NEURAL_SPAM_LONG(0.08)[0.077,0]; RCVD_IN_DNSWL_NONE(0.00)[37.23.255.162.list.dnswl.org : 127.0.10.0]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-0.02)[asn: 21624(0.02), country: US(-0.09)]; ASN(0.00)[asn:21624, ipnet:162.255.20.0/22, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Nov 2018 12:18:07 -0000 That was very helpful, thank you very much :) -- Sent from: http://freebsd.1045724.x6.nabble.com/freebsd-stable-f3932046.html From owner-freebsd-stable@freebsd.org Sat Nov 24 13:30:51 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5A4DE114EE7A for ; Sat, 24 Nov 2018 13:30:51 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from dec.sakura.ne.jp (dec.sakura.ne.jp [210.188.226.8]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CB4967883E for ; Sat, 24 Nov 2018 13:30:49 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from fortune.joker.local (123-48-17-11.dz.commufa.jp [123.48.17.11]) (authenticated bits=0) by dec.sakura.ne.jp (8.15.2/8.15.2/[SAKURA-WEB]/20080708) with ESMTPA id wAOCbbxC088484 for ; Sat, 24 Nov 2018 21:37:37 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Sat, 24 Nov 2018 21:37:37 +0900 From: Tomoaki AOKI To: freebsd-stable@freebsd.org Subject: Re: 12-STABLE uname -a misses timestamp of the build Message-Id: <20181124213737.d8128e30920e8de5fcca1b3b@dec.sakura.ne.jp> In-Reply-To: <183252d3-7080-8747-4534-da0e8b0480ff@yuripv.net> References: <1543060422379-0.post@n6.nabble.com> <183252d3-7080-8747-4534-da0e8b0480ff@yuripv.net> Reply-To: junchoon@dec.sakura.ne.jp Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; amd64-portbld-freebsd12.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: CB4967883E X-Spamd-Result: default: False [4.57 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[junchoon@dec.sakura.ne.jp]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; HAS_ORG_HEADER(0.00)[]; MX_GOOD(-0.01)[dec.sakura.ne.jp]; RECEIVED_SPAMHAUS_PBL(0.00)[11.17.48.123.zen.spamhaus.org : 127.0.0.10]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:9370, ipnet:210.188.224.0/19, country:JP]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.81)[0.806,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.99)[0.987,0]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[sakura.ne.jp]; NEURAL_SPAM_LONG(0.99)[0.986,0]; R_SPF_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(0.40)[asn: 9370(2.10), country: JP(-0.10)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Nov 2018 13:30:51 -0000 WITHOUT_REPRODUCIBLE_BUILD should be default for now on stable/12, as releng/12.0 already branched. As I already proposed on -current ML, REPRODUCIBLE_BUILD should be enabled only for release/* and releng/*. https://lists.freebsd.org/pipermail/freebsd-current/2018-September/071151.html I didn't noticed as I have WITHOUT_REPRODUCIBLE_BUILD=yes in src.conf. On Sat, 24 Nov 2018 15:13:15 +0300 Yuri Pankov wrote: > Jakub Lach wrote: > > Is there a way to restore it? I liked the old behaviour better, it was useful > > info for me. > > See 20180913 in UPDATING and WITHOUT_REPRODUCIBLE_BUILD in src.conf(5). > -- Tomoaki AOKI From owner-freebsd-stable@freebsd.org Sat Nov 24 14:17:31 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3888F114FE9B for ; Sat, 24 Nov 2018 14:17:31 +0000 (UTC) (envelope-from freebsd-lists@gromit.dlib.vt.edu) Received: from gromit.dlib.vt.edu (gromit.dlib.vt.edu [128.173.49.70]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "gromit.dlib.vt.edu", Issuer "Chumby Certificate Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 9C6947A349 for ; Sat, 24 Nov 2018 14:17:30 +0000 (UTC) (envelope-from freebsd-lists@gromit.dlib.vt.edu) Received: from mather.gromit23.net (c-98-244-101-97.hsd1.va.comcast.net [98.244.101.97]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by gromit.dlib.vt.edu (Postfix) with ESMTPSA id 4DFFF771 for ; Sat, 24 Nov 2018 09:17:24 -0500 (EST) From: Paul Mather Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.1 \(3445.101.1\)) Subject: "sockstat: struct xinpgen size mismatch" in 11.2-p4 jail on 12-STABLE host Message-Id: Date: Sat, 24 Nov 2018 09:17:23 -0500 To: FreeBSD Stable X-Mailer: Apple Mail (2.3445.101.1) X-Rspamd-Queue-Id: 9C6947A349 X-Spamd-Result: default: False [1.22 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[vt.edu : No valid SPF, No valid DKIM,none]; RECEIVED_SPAMHAUS_PBL(0.00)[97.101.244.98.zen.spamhaus.org : 127.0.0.10]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; NEURAL_SPAM_MEDIUM(0.43)[0.431,0]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[chumby.dlib.vt.edu,gromit.dlib.vt.edu]; NEURAL_SPAM_LONG(0.08)[0.084,0]; NEURAL_SPAM_SHORT(0.23)[0.234,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(-0.02)[country: US(-0.09)]; ASN(0.00)[asn:1312, ipnet:128.173.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Nov 2018 14:17:31 -0000 I updated a system yesterday to the latest 12-STABLE as part of the = upcoming 12-RELEASE cycle. I've installed several BETA and at least one = RC of 12 since updating from 11-STABLE as part of the 12 cycle and have = had no problems up to now. Currently, I am at FreeBSD 12.0-PRERELEASE = r340834 GENERIC amd64. Since the most recent update, I have been getting this error when I = invoke "sockstat" in any of the jails running on the system: sockstat: struct xinpgen size mismatch The jails are managed via iocage and all are running 11.2-RELEASE-p4, = which is the most up-to-date version of 11.2-RELEASE. Has anyone encountered this error? Unfortunately, it means that it = breaks Salt, which is what I use to help manage the jails. Sockstat = works fine on the host, just not in the jails. I am using a GENERIC kernel which includes "options COMPAT_FREEBSD11". = I assumed this would allow FreeBSD 11 binaries to work on a FreeBSD 12 = kernel, which it has done up to now. Cheers, Paul.= From owner-freebsd-stable@freebsd.org Sat Nov 24 15:52:53 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 70AFB1152624; Sat, 24 Nov 2018 15:52:53 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 89FF27E276; Sat, 24 Nov 2018 15:52:52 +0000 (UTC) (envelope-from yuripv@yuripv.net) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.west.internal (Postfix) with ESMTP id E953DE89; Sat, 24 Nov 2018 10:52:50 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute5.internal (MEProxy); Sat, 24 Nov 2018 10:52:51 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yuripv.net; h= subject:to:references:from:message-id:date:mime-version :in-reply-to:content-type; s=fm3; bh=KRNFGonERZN4otIv9MqqxPZ5mAW KwzCh8gKdfVo1qwc=; b=FZNHhCoW7Ksn4uOujnp1zntxqfgcdY6wKVXjVwkd9ML WngVyt17ksObaeetbSCqflGm2qAf1SNxiarUFzOq3BqeDg47iKng+tDiLB242qSL pU32SRqQSIOIAEHPAXQNwd4dZkE/eV40KLQXYNUsOeQYZsz4RxaPfUcVrvx2PIY3 s8Aaa2+ePX4Yltu/8dtGrSld58X6dKWggDiqKCLVNLwYFfn86Axm0AwlznltZMUL YcKxXaIpZRvS5w7Trx2/yn+TYyKX7J4RvnOeqm7Z/9wZl1oyzcJ+uCdwfD/a/qsK E0ODpkGTr5AYFkYmhnlf8PU9sIHG2XKndxBR8a0Z8yw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=KRNFGo nERZN4otIv9MqqxPZ5mAWKwzCh8gKdfVo1qwc=; b=DX7bwV8/VUaASl1R1YBk07 DHEE2Ar9pLKi2FCM4oLB5RRyDfFycicby27dqb1o7gU0N6a+94XFMn9v9XV+xQHd jPtq4O4uKVsY9+7/zS/yV8gzkppUgwb/+Knx6fVYeQ39d+JLpdFog9Yi8AuqwZgJ bYRvOm6dVsFSkdRDCdhV6R8PUJd+K1D6nvCobNGqjk6RlQmftvpkUlTXqXZP/fHV JxkwmsuiVbwX5w/Rrtp8440NMbXMlE7DVWdHt9ZR14J2D3Pi07gQ3whWesUsSKi+ cwzqwze16d0kLUAwQfbjzO2IRu4tlZUvqWX1jj/9VxdN+TEQhvVVyMKQnESKgsgQ == X-ME-Sender: X-ME-Proxy: Received: from thor.yuripv.net (unknown [62.183.125.179]) by mail.messagingengine.com (Postfix) with ESMTPA id 8E74C102DD; Sat, 24 Nov 2018 10:52:49 -0500 (EST) Subject: Re: SCSI and dmesg To: Warner Losh , FreeBSD-STABLE Mailing List , FreeBSD Current References: From: Yuri Pankov Openpgp: preference=signencrypt Autocrypt: addr=yuripv@yuripv.net; keydata= xsBNBFu8u6IBCADB11gP0QwnorrHjqAtKLHKHNHskhy0s7jqJKfx0YqXgVBKGLJ9/mjLAz0F CBNvemHSDDTs0mEZ9cBKKi6cmsav6+UQgr//yai6hvXLBJqKchSFO4MhmdvBtsGFq1yKz5Zi uhjmimKyIpgBgvMdbgGbGq6cnSB2uEPmZuJr419SVRODOkXukU+F5WHgaHzDdHAIu1asCt2B +6msxqIqlFWcXyZyTGicTGGvC/PFIsVRUtD1dIJANTC876g7DTb7LZXWiWwJpSJ4GKMXMHVX Ct9BoQ4i3nhKbOxb6Io1wsy+NFyWsTJ9KYrxKKPJP3oG8BWb/cqlFqnE4eNSsiq2q7krABEB AAHNIFl1cmkgUGFua292IDx5dXJpcHZARnJlZUJTRC5vcmc+wsCUBBMBCgA+FiEE+Gq3PsPe LT4tL/9wk4vgf7Eq4WwFAlu9Cn0CGwMFCQWjmoAFCwkIBwMFFQoJCAsFFgMCAQACHgECF4AA CgkQk4vgf7Eq4WxuPQf9HccaDyusO1J+wDQNlp9/uU0cnIfjHAeG80xrAfN9Vnf1wO9T2/WI iYlIdK+KVnhSa/DeBuHq/asfpUbrOleTF0hzG39os+95DzuT9a/j5XeQGuBgNbpVB+10zR3I 5AagSQetHilcZtz65g9GTUuIxb+xDaBehFBjyYXApfNE6yY5IlzDZpM7MOOLLFm2mQwQ8yjS eZ4jA6qW6/QMXRTkmpC9EXIeWDuNgWBwszaFGR6oUIpl0mGmwdJkEKwUazt6OuoDilMNZefZ 0pVFZBhnE46vK+6FDDFZE3BkeHVnqvy2QGL/6uKhSHc0lChCEPHnhqz6v23MwcQ6ktVWzvBJ oM7ATQRbvLuiAQgAyood0Pd96wzY+GQPBYQUNkZZgYL8Di3AzyC94dFe4d/Mt/h4rIBUnFwA g7Ha05WGdW0V5A/RRxDcpwXL9Jf97hiQ5PI2hiAxNEz/DkAUafiGlPfwR5wKqysUyRiKJQ2o ctpvssdsoXXOgeLo1jA6ghda1jg/spjlsPlS5ZTpKx3GWuTybV/VDhmwKWZfGUzPBJeAgDTf BdW4PTFs1IvvC2KBlhnPgcLBUtTlAdXOEj4DLuXw+Fn7K/ckZdOn3aRANmE+wf4+f+UUgtLB NmbP7ZifyUX5RyddsnI+fZmtsUDHxCReNIWQ6TBUJmb21aoBIN6HEHJbY28ZSCmf5owuMwAR AQABwsB8BBgBCgAmFiEE+Gq3PsPeLT4tL/9wk4vgf7Eq4WwFAlu8u6ICGwwFCQWjmoAACgkQ k4vgf7Eq4WyA3AgAqgGTHKMVAS2WuNGuW9uI+YtY6ZbwmGG94fkOZbefgRSfO5Am+HSblA95 IdotvQa8VkFmvVjbnvaM8XmJG5H17m0GF3sVaJUbJ4euDnRrBPCr6KwRQQd83Svxkbdicvo7 J031FrkJZW8zD9DH4QgzJNTKPFrwx9v3DhD/8iyn9tGvnHepy7O24nY5hl6PacrgSgLVeir/ lUbueAC/gP1AWLv3gdw7b83J7rftWauimj/vpFMD8CDSyJNODgQ8DdM0TU4qjABWGMs9r2Rw QehNbYf5f/2QuW/Q5NGaRSNW2HS/cpp62XtTKmxj5wwk6EMbtNE/6WQpumfdmK2UGLjcJQ== Message-ID: Date: Sat, 24 Nov 2018 18:52:40 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.3.1 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="DbFjZOkuRkfaECy93Kvj5n0tuUUxKVlC8" X-Rspamd-Queue-Id: 89FF27E276 X-Spamd-Result: default: False [-9.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.25]; HAS_ATTACHMENT(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: in2-smtp.messagingengine.com]; DKIM_TRACE(0.00)[yuripv.net:+,messagingengine.com:+]; MIME_BASE64_TEXT(0.10)[]; NEURAL_HAM_SHORT(-0.96)[-0.964,0]; SIGNED_PGP(-2.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[25.123.147.64.list.dnswl.org : 127.0.5.1]; RECEIVED_SPAMHAUS_PBL(0.00)[179.125.183.62.zen.spamhaus.org : 127.0.0.11]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[yuripv.net,messagingengine.com]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; DMARC_NA(0.00)[yuripv.net]; TO_MATCH_ENVRCPT_SOME(0.00)[]; IP_SCORE(-3.42)[ip: (-8.75), ipnet: 64.147.123.0/24(-4.38), asn: 11403(-3.89), country: US(-0.09)] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Nov 2018 15:52:53 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --DbFjZOkuRkfaECy93Kvj5n0tuUUxKVlC8 Content-Type: multipart/mixed; boundary="2ljJmoCEltKDURbdV8N3vD9OiKnlJo9i1"; protected-headers="v1" From: Yuri Pankov To: Warner Losh , FreeBSD-STABLE Mailing List , FreeBSD Current Message-ID: Subject: Re: SCSI and dmesg References: In-Reply-To: --2ljJmoCEltKDURbdV8N3vD9OiKnlJo9i1 Content-Type: multipart/mixed; boundary="------------BE4546B77CA26C921AAFAE87" Content-Language: en-US This is a multi-part message in MIME format. --------------BE4546B77CA26C921AAFAE87 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Warner Losh wrote: > Greetings >=20 > a few weeks ago I pointed people to the nycbug dmesg service. I said I = was > looking at data to drive SCSI retirement. I've gatherd some preliminary= > data, which I've uploaded to > https://github.com/bsdimp/device-data/blob/master/cam.md along with som= e > preliminary notions of disposition for the hardware. I'm still working = out > the kinks in the dmesg parsing, but this is interesting data. >=20 > If you've not recently submitted, please consider doing so. We'll be > finalizing the scsi SIMs that I'm going to propose retiring in 13 here = in a > few weeks, and I'm going to base much of what list I come up with based= on > what is submitted. The glitches with FreeBSD dmesgs have been cleared u= p as > well. >=20 > http://dmesgd.nycbug.org/index.cgi >=20 > or >=20 > curl -v -d "nickname=3D$USER" -d "email=3D$USER@$(hostname)" -d > "description=3DFreeBSD/$(uname -m) on $(kenv smbios.system.maker) $(ken= v > smbios.system.product)" -d "do=3Daddd" --data-urlencode 'dmesg@ > /var/run/dmesg.boot' http://dmesgd.nycbug.org/index.cgi Got another system to submit, but continuously getting "500 Internal Server Error" using the curl one-liner. dmesg.boot attached in case it's the source of the problem. --------------BE4546B77CA26C921AAFAE87 Content-Type: text/plain; charset=UTF-8; name="dmesg.boot" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="dmesg.boot" LS0tPDxCT09UPj4tLS0KQ29weXJpZ2h0IChjKSAxOTkyLTIwMTggVGhlIEZyZWVCU0QgUHJv amVjdC4KQ29weXJpZ2h0IChjKSAxOTc5LCAxOTgwLCAxOTgzLCAxOTg2LCAxOTg4LCAxOTg5 LCAxOTkxLCAxOTkyLCAxOTkzLCAxOTk0CglUaGUgUmVnZW50cyBvZiB0aGUgVW5pdmVyc2l0 eSBvZiBDYWxpZm9ybmlhLiBBbGwgcmlnaHRzIHJlc2VydmVkLgpGcmVlQlNEIGlzIGEgcmVn aXN0ZXJlZCB0cmFkZW1hcmsgb2YgVGhlIEZyZWVCU0QgRm91bmRhdGlvbi4KRnJlZUJTRCAx My4wLUNVUlJFTlQgcjM0MDc0NCBHRU5FUklDLU5PREVCVUcgYW1kNjQKRnJlZUJTRCBjbGFu ZyB2ZXJzaW9uIDYuMC4xICh0YWdzL1JFTEVBU0VfNjAxL2ZpbmFsIDMzNTU0MCkgKGJhc2Vk IG9uIExMVk0gNi4wLjEpClZUKGVmaWZiKTogcmVzb2x1dGlvbiAzNDQweDE0NDAKQ1BVOiBJ bnRlbChSKSBDb3JlKFRNKSBpNy03NTY3VSBDUFUgQCAzLjUwR0h6ICgzNTA0LjE0LU1IeiBL OC1jbGFzcyBDUFUpCiAgT3JpZ2luPSJHZW51aW5lSW50ZWwiICBJZD0weDgwNmU5ICBGYW1p bHk9MHg2ICBNb2RlbD0weDhlICBTdGVwcGluZz05CiAgRmVhdHVyZXM9MHhiZmViZmJmZjxG UFUsVk1FLERFLFBTRSxUU0MsTVNSLFBBRSxNQ0UsQ1g4LEFQSUMsU0VQLE1UUlIsUEdFLE1D QSxDTU9WLFBBVCxQU0UzNixDTEZMVVNILERUUyxBQ1BJLE1NWCxGWFNSLFNTRSxTU0UyLFNT LEhUVCxUTSxQQkU+CiAgRmVhdHVyZXMyPTB4N2ZmYWZiYmY8U1NFMyxQQ0xNVUxRRFEsRFRF UzY0LE1PTixEU19DUEwsVk1YLEVTVCxUTTIsU1NTRTMsU0RCRyxGTUEsQ1gxNix4VFBSLFBE Q00sUENJRCxTU0U0LjEsU1NFNC4yLHgyQVBJQyxNT1ZCRSxQT1BDTlQsVFNDRExULEFFU05J LFhTQVZFLE9TWFNBVkUsQVZYLEYxNkMsUkRSQU5EPgogIEFNRCBGZWF0dXJlcz0weDJjMTAw ODAwPFNZU0NBTEwsTlgsUGFnZTFHQixSRFRTQ1AsTE0+CiAgQU1EIEZlYXR1cmVzMj0weDEy MTxMQUhGLEFCTSxQcmVmZXRjaD4KICBTdHJ1Y3R1cmVkIEV4dGVuZGVkIEZlYXR1cmVzPTB4 MjljNjdhZjxGU0dTQkFTRSxUU0NBREosU0dYLEJNSTEsQVZYMixTTUVQLEJNSTIsRVJNUyxJ TlZQQ0lELE5GUFVTRyxNUFgsUkRTRUVELEFEWCxTTUFQLENMRkxVU0hPUFQsUFJPQ1RSQUNF PgogIFN0cnVjdHVyZWQgRXh0ZW5kZWQgRmVhdHVyZXMzPTB4OWMwMDAwMDA8SUJQQixTVElC UCxMMURGTCxTU0JEPgogIFhTQVZFIEZlYXR1cmVzPTB4ZjxYU0FWRU9QVCxYU0FWRUMsWElO VVNFLFhTQVZFUz4KICBWVC14OiBQQVQsSExULE1URixQQVVTRSxFUFQsVUcsVlBJRAogIFRT QzogUC1zdGF0ZSBpbnZhcmlhbnQsIHBlcmZvcm1hbmNlIHN0YXRpc3RpY3MKcmVhbCBtZW1v cnkgID0gMTcxNzk4NjkxODQgKDE2Mzg0IE1CKQphdmFpbCBtZW1vcnkgPSAxNjQ3MjUyMjc1 MiAoMTU3MDkgTUIpCkV2ZW50IHRpbWVyICJMQVBJQyIgcXVhbGl0eSA2MDAKQUNQSSBBUElD IFRhYmxlOiA8SU5URUwgIE5VQzdpN0JOPgpGcmVlQlNEL1NNUDogTXVsdGlwcm9jZXNzb3Ig U3lzdGVtIERldGVjdGVkOiA0IENQVXMKRnJlZUJTRC9TTVA6IDEgcGFja2FnZShzKSB4IDIg Y29yZShzKSB4IDIgaGFyZHdhcmUgdGhyZWFkcwpyYW5kb206IHVuYmxvY2tpbmcgZGV2aWNl Lgppb2FwaWMwIDxWZXJzaW9uIDIuMD4gaXJxcyAwLTExOSBvbiBtb3RoZXJib2FyZApMYXVu Y2hpbmcgQVBzOiAxIDMgMgpUaW1lY291bnRlciAiVFNDLWxvdyIgZnJlcXVlbmN5IDE3NTIw NzIwNTAgSHogcXVhbGl0eSAxMDAwCnJhbmRvbTogZW50cm9weSBkZXZpY2UgZXh0ZXJuYWwg aW50ZXJmYWNlClthdGhfaGFsXSBsb2FkZWQKbW9kdWxlX3JlZ2lzdGVyX2luaXQ6IE1PRF9M T0FEICh2ZXNhLCAweGZmZmZmZmZmODExM2YxNTAsIDApIGVycm9yIDE5CmtiZDAgYXQga2Jk bXV4MApyYW5kb206IHJlZ2lzdGVyaW5nIGZhc3Qgc291cmNlIEludGVsIFNlY3VyZSBLZXkg Uk5HCnJhbmRvbTogZmFzdCBwcm92aWRlcjogIkludGVsIFNlY3VyZSBLZXkgUk5HIgpuZXRt YXA6IGxvYWRlZCBtb2R1bGUKbmV4dXMwCmVmaXJ0YzA6IDxFRkkgUmVhbHRpbWUgQ2xvY2s+ IG9uIG1vdGhlcmJvYXJkCmVmaXJ0YzA6IHJlZ2lzdGVyZWQgYXMgYSB0aW1lLW9mLWRheSBj bG9jaywgcmVzb2x1dGlvbiAxLjAwMDAwMHMKY3J5cHRvc29mdDA6IDxzb2Z0d2FyZSBjcnlw dG8+IG9uIG1vdGhlcmJvYXJkCmFjcGkwOiA8SU5URUwgTlVDN2k3Qk4+IG9uIG1vdGhlcmJv YXJkCmFjcGkwOiBQb3dlciBCdXR0b24gKGZpeGVkKQpjcHUwOiA8QUNQSSBDUFU+IG9uIGFj cGkwCmhwZXQwOiA8SGlnaCBQcmVjaXNpb24gRXZlbnQgVGltZXI+IGlvbWVtIDB4ZmVkMDAw MDAtMHhmZWQwMDNmZiBvbiBhY3BpMApUaW1lY291bnRlciAiSFBFVCIgZnJlcXVlbmN5IDI0 MDAwMDAwIEh6IHF1YWxpdHkgOTUwCkV2ZW50IHRpbWVyICJIUEVUIiBmcmVxdWVuY3kgMjQw MDAwMDAgSHogcXVhbGl0eSA1NTAKRXZlbnQgdGltZXIgIkhQRVQxIiBmcmVxdWVuY3kgMjQw MDAwMDAgSHogcXVhbGl0eSA0NDAKRXZlbnQgdGltZXIgIkhQRVQyIiBmcmVxdWVuY3kgMjQw MDAwMDAgSHogcXVhbGl0eSA0NDAKRXZlbnQgdGltZXIgIkhQRVQzIiBmcmVxdWVuY3kgMjQw MDAwMDAgSHogcXVhbGl0eSA0NDAKRXZlbnQgdGltZXIgIkhQRVQ0IiBmcmVxdWVuY3kgMjQw MDAwMDAgSHogcXVhbGl0eSA0NDAKYXRydGMwOiA8QVQgcmVhbHRpbWUgY2xvY2s+IHBvcnQg MHg3MC0weDc3IGlycSA4IG9uIGFjcGkwCmF0cnRjMDogV2FybmluZzogQ291bGRuJ3QgbWFw IEkvTy4KYXRydGMwOiByZWdpc3RlcmVkIGFzIGEgdGltZS1vZi1kYXkgY2xvY2ssIHJlc29s dXRpb24gMS4wMDAwMDBzCkV2ZW50IHRpbWVyICJSVEMiIGZyZXF1ZW5jeSAzMjc2OCBIeiBx dWFsaXR5IDAKYXR0aW1lcjA6IDxBVCB0aW1lcj4gcG9ydCAweDQwLTB4NDMsMHg1MC0weDUz IGlycSAwIG9uIGFjcGkwClRpbWVjb3VudGVyICJpODI1NCIgZnJlcXVlbmN5IDExOTMxODIg SHogcXVhbGl0eSAwCkV2ZW50IHRpbWVyICJpODI1NCIgZnJlcXVlbmN5IDExOTMxODIgSHog cXVhbGl0eSAxMDAKVGltZWNvdW50ZXIgIkFDUEktZmFzdCIgZnJlcXVlbmN5IDM1Nzk1NDUg SHogcXVhbGl0eSA5MDAKYWNwaV90aW1lcjA6IDwyNC1iaXQgdGltZXIgYXQgMy41Nzk1NDVN SHo+IHBvcnQgMHgxODA4LTB4MTgwYiBvbiBhY3BpMAphY3BpX2VjMDogPEVtYmVkZGVkIENv bnRyb2xsZXI6IEdQRSAweDE0LCBFQ0RUPiBwb3J0IDB4NjIsMHg2NiBvbiBhY3BpMApwY2li MDogPEFDUEkgSG9zdC1QQ0kgYnJpZGdlPiBwb3J0IDB4Y2Y4LTB4Y2ZmIG9uIGFjcGkwCnBj aTA6IDxBQ1BJIFBDSSBidXM+IG9uIHBjaWIwCnZnYXBjaTA6IDxWR0EtY29tcGF0aWJsZSBk aXNwbGF5PiBwb3J0IDB4ZjAwMC0weGYwM2YgbWVtIDB4MmZmZTAwMDAwMC0weDJmZmVmZmZm ZmYsMHgyZjAwMDAwMDAwLTB4MmY3ZmZmZmZmZiBhdCBkZXZpY2UgMi4wIG9uIHBjaTAKdmdh cGNpMDogQm9vdCB2aWRlbyBkZXZpY2UKeGhjaTA6IDxJbnRlbCBTdW5yaXNlIFBvaW50LUxQ IFVTQiAzLjAgY29udHJvbGxlcj4gbWVtIDB4MmZmZjAxMDAwMC0weDJmZmYwMWZmZmYgYXQg ZGV2aWNlIDIwLjAgb24gcGNpMAp4aGNpMDogMzIgYnl0ZXMgY29udGV4dCBzaXplLCA2NC1i aXQgRE1BCnVzYnVzMCBvbiB4aGNpMAp1c2J1czA6IDUuMEdicHMgU3VwZXIgU3BlZWQgVVNC IHYzLjAKcGNpMDogPHNpbXBsZSBjb21tcz4gYXQgZGV2aWNlIDIyLjAgKG5vIGRyaXZlciBh dHRhY2hlZCkKYWhjaTA6IDxJbnRlbCBTdW5yaXNlIFBvaW50LUxQIEFIQ0kgU0FUQSBjb250 cm9sbGVyPiBwb3J0IDB4ZjA5MC0weGYwOTcsMHhmMDgwLTB4ZjA4MywweGYwNjAtMHhmMDdm IG1lbSAweGRlNDI0MDAwLTB4ZGU0MjVmZmYsMHhkZTQyNzAwMC0weGRlNDI3MGZmLDB4ZGU0 MjYwMDAtMHhkZTQyNjdmZiBhdCBkZXZpY2UgMjMuMCBvbiBwY2kwCmFoY2kwOiBBSENJIHYx LjMxIHdpdGggMSA2R2JwcyBwb3J0cywgUG9ydCBNdWx0aXBsaWVyIG5vdCBzdXBwb3J0ZWQK YWhjaWNoMDogPEFIQ0kgY2hhbm5lbD4gYXQgY2hhbm5lbCAwIG9uIGFoY2kwCnBjaWIxOiA8 QUNQSSBQQ0ktUENJIGJyaWRnZT4gYXQgZGV2aWNlIDI4LjAgb24gcGNpMApwY2liMTogW0dJ QU5ULUxPQ0tFRF0KcGNpYjI6IDxBQ1BJIFBDSS1QQ0kgYnJpZGdlPiBhdCBkZXZpY2UgMjgu NSBvbiBwY2kwCnBjaTE6IDxBQ1BJIFBDSSBidXM+IG9uIHBjaWIyCnBjaTE6IDxuZXR3b3Jr PiBhdCBkZXZpY2UgMC4wIChubyBkcml2ZXIgYXR0YWNoZWQpCnBjaWIzOiA8QUNQSSBQQ0kt UENJIGJyaWRnZT4gYXQgZGV2aWNlIDI4Ljcgb24gcGNpMApwY2kyOiA8QUNQSSBQQ0kgYnVz PiBvbiBwY2liMwpwY2kyOiA8dW5rbm93bj4gYXQgZGV2aWNlIDAuMCAobm8gZHJpdmVyIGF0 dGFjaGVkKQpwY2liNDogPEFDUEkgUENJLVBDSSBicmlkZ2U+IGF0IGRldmljZSAyOS4wIG9u IHBjaTAKcGNpMzogPEFDUEkgUENJIGJ1cz4gb24gcGNpYjQKbnZtZTA6IDxHZW5lcmljIE5W TWUgRGV2aWNlPiBtZW0gMHhkZTEwMDAwMC0weGRlMTAzZmZmIGF0IGRldmljZSAwLjAgb24g cGNpMwppc2FiMDogPFBDSS1JU0EgYnJpZGdlPiBhdCBkZXZpY2UgMzEuMCBvbiBwY2kwCmlz YTA6IDxJU0EgYnVzPiBvbiBpc2FiMApwY2kwOiA8bWVtb3J5PiBhdCBkZXZpY2UgMzEuMiAo bm8gZHJpdmVyIGF0dGFjaGVkKQpoZGFjMDogPEludGVsIEthYnlsYWtlLUxQIEhEQSBDb250 cm9sbGVyPiBtZW0gMHgyZmZmMDIwMDAwLTB4MmZmZjAyM2ZmZiwweDJmZmYwMDAwMDAtMHgy ZmZmMDBmZmZmIGF0IGRldmljZSAzMS4zIG9uIHBjaTAKZW0wOiA8SW50ZWwoUikgUFJPLzEw MDAgTmV0d29yayBDb25uZWN0aW9uPiBtZW0gMHhkZTQwMDAwMC0weGRlNDFmZmZmIGF0IGRl dmljZSAzMS42IG9uIHBjaTAKZW0wOiBhdHRhY2hfcHJlIGNhcHBpbmcgcXVldWVzIGF0IDEK ZW0wOiB1c2luZyAxMDI0IHR4IGRlc2NyaXB0b3JzIGFuZCAxMDI0IHJ4IGRlc2NyaXB0b3Jz CmVtMDogbXNpeF9pbml0IHFzZXRzIGNhcHBlZCBhdCAxCmVtMDogVW5hYmxlIHRvIG1hcCBN U0lYIHRhYmxlIAplbTA6IFVzaW5nIGFuIE1TSSBpbnRlcnJ1cHQKZW0wOiBhbGxvY2F0ZWQg Zm9yIDEgdHhfcXVldWVzCmVtMDogYWxsb2NhdGVkIGZvciAxIHJ4X3F1ZXVlcwplbTA6IEV0 aGVybmV0IGFkZHJlc3M6IDk0OmM2OjkxOjFjOjgwOjE2CmVtMDogbmV0bWFwIHF1ZXVlcy9z bG90czogVFggMS8xMDI0LCBSWCAxLzEwMjQKYWNwaV9idXR0b24wOiA8U2xlZXAgQnV0dG9u PiBvbiBhY3BpMAphY3BpX2J1dHRvbjE6IDxQb3dlciBCdXR0b24+IG9uIGFjcGkwCmFjcGlf dHowOiA8VGhlcm1hbCBab25lPiBvbiBhY3BpMAphY3BpX3R6MDogX0hPVCB2YWx1ZSBpcyBh YnN1cmQsIGlnbm9yZWQgKC03My4xQykKdWFydDA6IDxOb24tc3RhbmRhcmQgbnM4MjUwIGNs YXNzIFVBUlQgd2l0aCBGSUZPcz4gYXQgcG9ydCAweDNmOCBpcnEgNCBmbGFncyAweDEwIG9u IGlzYTAKY29yZXRlbXAwOiA8Q1BVIE9uLURpZSBUaGVybWFsIFNlbnNvcnM+IG9uIGNwdTAK ZXN0MDogPEVuaGFuY2VkIFNwZWVkU3RlcCBGcmVxdWVuY3kgQ29udHJvbD4gb24gY3B1MApa RlMgZmlsZXN5c3RlbSB2ZXJzaW9uOiA1ClpGUyBzdG9yYWdlIHBvb2wgdmVyc2lvbjogZmVh dHVyZXMgc3VwcG9ydCAoNTAwMCkKVGltZWNvdW50ZXJzIHRpY2sgZXZlcnkgMS4wMDAgbXNl YwphY3BpX3R6MDogX1RNUCB2YWx1ZSBpcyBhYnN1cmQsIGlnbm9yZWQgKC0yNjMuMUMpCm5k YTAgYXQgbnZtZTAgYnVzIDAgc2NidXMxIHRhcmdldCAwIGx1biAxCmhkYWNjMDogbmRhMDog PFJlYWx0ZWsgQUxDMjgzIEhEQSBDT0RFQz4gYXQgY2FkIDAgb24gaGRhYzAKPElOVEVMIFNT RFBFS0tXMTI4RzggMDA0QyBCVEhIODIzMTBVNlQxMjhBPgpoZGFhMDogPFJlYWx0ZWsgQUxD MjgzIEF1ZGlvIEZ1bmN0aW9uIEdyb3VwPm5kYTA6IG52bWUgdmVyc2lvbiAxLjMgeDQgKG1h eCB4NCkgbGFuZXMgUENJZSBHZW4zIChtYXggR2VuMykgbGluayBhdCBuaWQgMSBvbiBoZGFj YzAKCm5kYTA6IDEyMjEwNE1CICgyNTAwNjk2ODAgNTEyIGJ5dGUgc2VjdG9ycykKcGNtMDog PFJlYWx0ZWsgQUxDMjgzIChBbmFsb2cpPiBhdCBuaWQgMzMgYW5kIDE4IG9uIGhkYWEwCmhk YWNjMTogPEludGVsIEthYnlsYWtlIEhEQSBDT0RFQz4gYXQgY2FkIDIgb24gaGRhYzAKaGRh YTE6IDxJbnRlbCBLYWJ5bGFrZSBBdWRpbyBGdW5jdGlvbiBHcm91cD4gYXQgbmlkIDEgb24g aGRhY2MxCnBjbTE6IDxJbnRlbCBLYWJ5bGFrZSAoSERNSS9EUCA4Y2gpPiBhdCBuaWQgMyBv biBoZGFhMQp1Z2VuMC4xOiA8MHg4MDg2IFhIQ0kgcm9vdCBIVUI+IGF0IHVzYnVzMApUcnlp bmcgdG8gbW91bnQgcm9vdCBmcm9tIHpmczp6cm9vdC9ST09UL2RlZmF1bHQgW10uLi4KUm9v dCBtb3VudCB3YWl0aW5nIGZvcjogdXNidXMwCnVodWIwOiA8MHg4MDg2IFhIQ0kgcm9vdCBI VUIsIGNsYXNzIDkvMCwgcmV2IDMuMDAvMS4wMCwgYWRkciAxPiBvbiB1c2J1czAKdWh1YjA6 IDE4IHBvcnRzIHdpdGggMTggcmVtb3ZhYmxlLCBzZWxmIHBvd2VyZWQKUm9vdCBtb3VudCB3 YWl0aW5nIGZvcjogdXNidXMwCnVnZW4wLjI6IDxNaWNyb2NoaXAgVGVjaCBVU0IyNzM0PiBh dCB1c2J1czAKdWh1YjEgb24gdWh1YjAKdWh1YjE6IDxNaWNyb2NoaXAgVGVjaCBVU0IyNzM0 LCBjbGFzcyA5LzAsIHJldiAyLjEwLzEuMjgsIGFkZHIgMT4gb24gdXNidXMwCnVodWIxOiBN VFQgZW5hYmxlZApSb290IG1vdW50IHdhaXRpbmcgZm9yOiB1c2J1czAKUm9vdCBtb3VudCB3 YWl0aW5nIGZvcjogdXNidXMwClJvb3QgbW91bnQgd2FpdGluZyBmb3I6IHVzYnVzMAp1aHVi MTogNSBwb3J0cyB3aXRoIDQgcmVtb3ZhYmxlLCBzZWxmIHBvd2VyZWQKUm9vdCBtb3VudCB3 YWl0aW5nIGZvcjogdXNidXMwCnVnZW4wLjM6IDxMb2dpdGVjaCBVU0IgUmVjZWl2ZXI+IGF0 IHVzYnVzMAp1a2JkMCBvbiB1aHViMQp1a2JkMDogPExvZ2l0ZWNoIFVTQiBSZWNlaXZlciwg Y2xhc3MgMC8wLCByZXYgMi4wMC8yNC4wNywgYWRkciAyPiBvbiB1c2J1czAKa2JkMSBhdCB1 a2JkMAp1Z2VuMC40OiA8TG9naXRlY2ggVVNCIFJlY2VpdmVyPiBhdCB1c2J1czAKdWtiZDEg b24gdWh1YjEKdWtiZDE6IDxMb2dpdGVjaCBVU0IgUmVjZWl2ZXIsIGNsYXNzIDAvMCwgcmV2 IDIuMDAvMzkuMDQsIGFkZHIgMz4gb24gdXNidXMwCmtiZDIgYXQgdWtiZDEKUm9vdCBtb3Vu dCB3YWl0aW5nIGZvcjogdXNidXMwCnVnZW4wLjU6IDxNaWNyb2NoaXAgVGVjaCBIdWIgQ29u dHJvbGxlcj4gYXQgdXNidXMwClJvb3QgbW91bnQgd2FpdGluZyBmb3I6IHVzYnVzMAp1Z2Vu MC42OiA8TWljcm9jaGlwIFRlY2ggVVNCNTczND4gYXQgdXNidXMwCnVodWIyIG9uIHVodWIw CnVodWIyOiA8TWljcm9jaGlwIFRlY2ggVVNCNTczNCwgY2xhc3MgOS8wLCByZXYgMy4xMC8x LjI4LCBhZGRyIDU+IG9uIHVzYnVzMApSb290IG1vdW50IHdhaXRpbmcgZm9yOiB1c2J1czAK Um9vdCBtb3VudCB3YWl0aW5nIGZvcjogdXNidXMwCnVodWIyOiA1IHBvcnRzIHdpdGggNCBy ZW1vdmFibGUsIHNlbGYgcG93ZXJlZApsbzA6IGxpbmsgc3RhdGUgY2hhbmdlZCB0byBVUApl bTA6IGxpbmsgc3RhdGUgY2hhbmdlZCB0byBVUAppd20wOiA8SW50ZWwoUikgRHVhbCBCYW5k IFdpcmVsZXNzIEFDIDgyNjU+IG1lbSAweGRlMzAwMDAwLTB4ZGUzMDFmZmYgYXQgZGV2aWNl IDAuMCBvbiBwY2kxCml3bTA6IGh3IHJldiAweDIzMCwgZncgdmVyIDIyLjM2MTQ3Ni4wLCBh ZGRyZXNzIDY4OmVjOmM1OjY0OmVhOmQ4CnVtczAgb24gdWh1YjEKdW1zMDogPExvZ2l0ZWNo IFVTQiBSZWNlaXZlciwgY2xhc3MgMC8wLCByZXYgMi4wMC8yNC4wNywgYWRkciAyPiBvbiB1 c2J1czAKdW1zMDogMTYgYnV0dG9ucyBhbmQgW1hZWlRdIGNvb3JkaW5hdGVzIElEPTIKdWhp ZDAgb24gdWh1YjEKdWhpZDA6IDxMb2dpdGVjaCBVU0IgUmVjZWl2ZXIsIGNsYXNzIDAvMCwg cmV2IDIuMDAvMjQuMDcsIGFkZHIgMj4gb24gdXNidXMwCnVtczEgb24gdWh1YjEKdW1zMTog PExvZ2l0ZWNoIFVTQiBSZWNlaXZlciwgY2xhc3MgMC8wLCByZXYgMi4wMC8zOS4wNCwgYWRk ciAzPiBvbiB1c2J1czAKdW1zMTogMTYgYnV0dG9ucyBhbmQgW1hZWlRdIGNvb3JkaW5hdGVz IElEPTIKdWhpZDEgb24gdWh1YjEKdWhpZDE6IDxMb2dpdGVjaCBVU0IgUmVjZWl2ZXIsIGNs YXNzIDAvMCwgcmV2IDIuMDAvMzkuMDQsIGFkZHIgMz4gb24gdXNidXMwCnVoaWQyIG9uIHVo dWIxCnVoaWQyOiA8SElESTJDQnJpZGdlPiBvbiB1c2J1czAK --------------BE4546B77CA26C921AAFAE87-- --2ljJmoCEltKDURbdV8N3vD9OiKnlJo9i1-- --DbFjZOkuRkfaECy93Kvj5n0tuUUxKVlC8 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEE+Gq3PsPeLT4tL/9wk4vgf7Eq4WwFAlv5c88ACgkQk4vgf7Eq 4Wz9Fwf8D6vOdwNV0L+FvXsb7cnQVbYubRf/MimpSx8ZryOWF80kzpEjgmveq2wJ h3LaHhVSQ7WlelRnXANK5hrmSHYCo4IoLelr4bojEwR5E8+NUdze3HU67RmXM5PH ITC2diuT+1jiPKARz+j7udV2bp25/elh48pdNMc63txFeCv7VGJ1VyQybXFArRc/ xtH69iqJ4lmgPiUmUbXdnSD540qxE/XEPubPtkXilfL59DhTpxdlKCGPPdKtIEMj F7NojeicPRGHUzYAp3rwl9EMsOwpdl4rCWKtjC6wFKC8pTxuh9RALfPBO4J2GVWD 0ha6UNHHhE9DW4vaPzNI2P9e9Syd/Q== =ZaoO -----END PGP SIGNATURE----- --DbFjZOkuRkfaECy93Kvj5n0tuUUxKVlC8--