From owner-freebsd-stable@freebsd.org Fri May 6 00:40:15 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 54F17B2FE36 for ; Fri, 6 May 2016 00:40:15 +0000 (UTC) (envelope-from prvs=09343dec96=rblayzor.bulk@inoc.net) Received: from mta2.alb.inoc.net (mta2.alb.inoc.net [IPv6:2607:f058:110:2::1:2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 221F413C3 for ; Fri, 6 May 2016 00:40:15 +0000 (UTC) (envelope-from prvs=09343dec96=rblayzor.bulk@inoc.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=inoc.net; s=201501; h=Mime-Version:To:Date:Message-Id:Subject: Content-Transfer-Encoding:Content-Type:From:Sender:Reply-To:Cc:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=MTU5pa42ezYhgDSeQ+ycronM1T6Ew4FOilzkBrwNTyY=; b=WEZHD1eaKA0UOVdZV7mDlObuT9 h0NDiPCo8C5qdD2P/upiBvTzlNwKXbSD31uB7lbb5Dg9bBDjI9IfAlzg2JTguc5kSY4yq42civmvH 4wQEl3+SU/WJagl/QWfADM45Z2PjV1BGXuxCKsmTrE+jalGiN7oKryaKWixkXrfQBwYQjYPQpDnoo EgDuLcYk7ZNkJYkEDn5t1P/2IIA6r6x2tXIg8jKGFH8TQtIN399ZLwI5fMAz3OHKIyJZZ7pFWHTn8 EFLjW3PvXVgnbGULAvIEoKtfO/h3QrU/Ba479zce+QlzYftUKwoflnVYVmpXj6acITlmMT72c/E8j Pb7E1UPg==; Received: from pool-96-236-44-9.albyny.fios.verizon.net ([96.236.44.9] helo=[10.99.1.110]) by mail.inoc.net with ESMTPA (Exim 4.87) (envelope-from ) id 1ayToT-0008eQ-RU by authid for freebsd-stable@freebsd.org; Fri, 06 May 2016 00:40:13 +0000 From: Robert Blayzor Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: FreeBSD STABLE_10 (10.3) - lots of IPv6 connections in CLOSED state Message-Id: <7FCD74A2-7212-4DED-AFBF-92828DA9E9F0@inoc.net> Date: Thu, 5 May 2016 20:40:11 -0400 To: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) X-Mailer: Apple Mail (2.3124) X-Auth-Info: cmJsYXl6b3JAaW5vYy5uZXQ= X-Virus-Scanned: ClamAV 0.99.1/21515/Wed May 4 16:39:26 2016 X-Origin-Country: US X-Anti-Abuse: Please report to abuse@inoc.net X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 May 2016 00:40:15 -0000 Started seeing a ton of these in dmesg: sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (41 occurrences) sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (45 occurrences) sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (41 occurrences) sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (39 occurrences) sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (42 occurrences) sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (40 occurrences) sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (44 occurrences) sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (43 occurrences) sonewconn: pcb 0xfffff8001570f188: Listen queue overflow: 301 already in = queue awaiting acceptance (38 occurrences) The process normally listening, the service stopped working. = (manage-sieve, TCP port 4190)=E2=80=A6 After looking at netstat I see 300+ connections on this service in a = =E2=80=9CCLOSED=E2=80=9D state=E2=80=A6 All of the connections are via = IPv6. Sockstat shows all of these connections not related to a user, command, = pid, etc=E2=80=A6. If I restart the process, all of the connections are = freed and things work as expected for a while. sockstat USER COMMAND PID FD PROTO LOCAL ADDRESS FOREIGN = ADDRESS ? ? ? ? tcp6 dead:beef:110:2::1:0:25 = dead:beef:110:2::f:0:24162 ? ? ? ? tcp6 dead:beef:110:2::1:0:110 = dead:beef:110:2::f:0:1566 ? ? ? ? tcp6 dead:beef:110:2::1:0:25 = dead:beef:110:2::f:1:30064 ? ? ? ? tcp6 dead:beef:110:2::1:0:143 = dead:beef:110:2::f:0:7199 ? ? ? ? tcp6 dead:beef:110:2::1:0:110 = dead:beef:110:2::f:1:48062 ? ? ? ? tcp6 dead:beef:110:2::1:0:143 = dead:beef:110:2::f:1:54271 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:36446 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:57291 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:48429 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:56473 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:61870 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:5971 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:64942 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:46824 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:14230 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:34070 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:24494 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:43982 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:38576 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:13346 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:46491 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:57936 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:3863 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:52049 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:45212 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:43416 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:56373 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:51448 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:51996 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:52523 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:19061 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:41591 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:52222 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:47299 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:18115 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:64664 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:31583 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:24094 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:45457 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:51491 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:47910 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:26928 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:45476 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:63046 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:58335 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:18465 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:4543 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:49344 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:44587 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:50919 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:6113 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:37735 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:16079 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:6577 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:14321 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:18007 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:59905 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:43224 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:38200 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:46691 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:4639 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:25019 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:29059 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:27098 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:18482 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:48661 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:43056 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:45675 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:13694 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:65270 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:24727 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:33191 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:65497 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:61110 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:25091 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:24267 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:2629 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:27831 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:18562 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:46241 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:9761 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:10111 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:48462 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:3343 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:61423 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:57491 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:45411 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:51383 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:26383 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:21739 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:4026 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:23671 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:53683 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:46756 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:30714 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:44122 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:4850 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:32784 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:8775 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:38583 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:5123 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:1475 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:11930 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:22326 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:16479 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:40217 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:44723 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:58170 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:56677 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:61037 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:21891 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:14223 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:48263 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:6851 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:47644 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:36237 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:11922 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:1:36168 ? ? ? ? tcp6 dead:beef:110:2::1:0:4190 = dead:beef:110:2::f:0:57985 -- Robert inoc.net!rblayzor XMPP: rblayzor.AT.inoc.net PGP Key: 78BEDCE1 @ pgp.mit.edu