From owner-freebsd-current@FreeBSD.ORG Tue Sep 10 12:33:12 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id AEFF864C; Tue, 10 Sep 2013 12:33:12 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id F238525F3; Tue, 10 Sep 2013 12:33:11 +0000 (UTC) Received: from vhoffman.lon.namesco.net (lon.namesco.net [195.7.254.102]) (authenticated bits=0) by unsane.co.uk (8.14.7/8.14.6) with ESMTP id r8ACX8ma093042 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Tue, 10 Sep 2013 13:33:08 +0100 (BST) (envelope-from vince@unsane.co.uk) Message-ID: <522F1184.2010107@unsane.co.uk> Date: Tue, 10 Sep 2013 13:33:08 +0100 From: Vincent Hoffman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: Gavin Atkinson Subject: Re: Panic/Freeze with IPSEC on r254532 References: <5213939C.8050609@unsane.co.uk> In-Reply-To: X-Enigmail-Version: 1.5.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "freebsd-current@freebsd.org" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Sep 2013 12:33:12 -0000 On 10/09/2013 09:18, Gavin Atkinson wrote: > On Tue, 20 Aug 2013, Vincent Hoffman wrote: > >> I thought I'd have a play with ipsec since its been a while since I last >> set it up, and was setting up a transport mode connection between my >> poudiere/repo server (the -curent server) and another box (8.2-RELEASE) >> 3 pings later the -CURRENT box froze, its zfs on root so no kernel dump >> I'm afraid, it does have an ipmi so I repeated with a serial over lan >> connection to test but got nothing it just froze. Any suggestions? >> The only unusual thing about this machine is that i am running a bhyve >> vm on it. not sure how relevant that is. > FWIW, I posted on what is likely to be the same issue yesterday on > freebsd-net@ - > http://docs.FreeBSD.org/cgi/mid.cgi?1378750330.11656.44.camel > > Can you test the workaround I'm currently using? Basically, just > "ifconfig enc0 create" before using the tunnel should be sufficient. Hi Gavin, I have tried your suggestion and am not getting the freezes any more, thanks for this. Another thing I have noticed is that racoon isnt creating a control socket for racoonctl, probably not related but I thought it worth mentioning root@bsdpkgbuild:~ # racoonctl show-sa ipsec send: Bad file descriptor l I did try stating racoon under truss and using racoon -F -d -d -d but didnt see it even try to open /var/db/racoon/racoon.sock while on the other end (8.4-RELEASE) I see 2013-09-10 13:24:19: DEBUG: open /var/db/racoon/racoon.sock as racoon management. in the output from racoon -F -d -d -d Thanks for finding a work around to the crash for now. Vince > > Gavin > > >> Log output >> 1st occurance >> Aug 20 13:24:51 bsdpkgbuild kernel: Kernel page fault with the following >> non-sleepable locks held: >> Aug 20 13:24:51 bsdpkgbuild kernel: shared rw ipsec request (ipsec >> request) r = 0 (0xfffff80020fe2f60) locked @ >> /usr/src/sys/netipsec/ipsec_output.c:436 >> Aug 20 13:24:51 bsdpkgbuild kernel: shared rw rawinp (rawinp) r = 0 >> (0xfffff800587afda8) locked @ /usr/src/sys/netinet/raw_ip.c:446 >> Aug 20 13:24:51 bsdpkgbuild kernel: KDB: stack backtrace: >> Aug 20 13:24:51 bsdpkgbuild kernel: db_trace_self_wrapper() at >> db_trace_self_wrapper+0x2b/frame 0xfffffe0238af91e0 >> Aug 20 13:24:51 bsdpkgbuild kernel: kdb_backtrace() at >> kdb_backtrace+0x39/frame 0xfffffe0238af9290 >> Aug 20 13:24:51 bsdpkgbuild kernel: witness_warn() at >> witness_warn+0x4a8/frame 0xfffffe0238af9350 >> Aug 20 13:24:51 bsdpkgbuild kernel: trap_pfault() at >> trap_pfault+0x5a/frame 0xfffffe0238af9400 >> Aug 20 13:24:51 bsdpkgbuild kernel: trap() at trap+0x670/frame >> 0xfffffe0238af9620 >> Aug 20 13:24:51 bsdpkgbuild kernel: calltrap() at calltrap+0x8/frame >> 0xfffffe0238af9620 >> Aug 20 13:24:51 bsdpkgbuild kernel: --- trap 0xc, rip = >> 0xffffffff80aa6a53, rsp = 0xfffffe0238af96e0, rbp = 0xfffffe0238af9770 --- >> Aug 20 13:24:51 bsdpkgbuild kernel: ipsec4_process_packet() at >> ipsec4_process_packet+0x73/frame 0xfffffe0238af9770 >> Aug 20 13:24:51 bsdpkgbuild kernel: ip_ipsec_output() at >> ip_ipsec_output+0x197/frame 0xfffffe0238af97b0 >> Aug 20 13:24:51 bsdpkgbuild kernel: ip_output() at ip_output+0x8a3/frame >> 0xfffffe0238af98a0 >> Aug 20 13:24:51 bsdpkgbuild kernel: rip_output() at >> rip_output+0x2fa/frame 0xfffffe0238af98f0 >> Aug 20 13:24:51 bsdpkgbuild kernel: sosend_generic() at >> sosend_generic+0x3dc/frame 0xfffffe0238af99a0 >> Aug 20 13:24:51 bsdpkgbuild kernel: kern_sendit() at >> kern_sendit+0x1e4/frame 0xfffffe0238af9a40 >> Aug 20 13:24:51 bsdpkgbuild kernel: sendit() at sendit+0xf8/frame >> 0xfffffe0238af9a90 >> Aug 20 13:24:51 bsdpkgbuild kernel: sys_sendto() at >> sys_sendto+0x4d/frame 0xfffffe0238af9ae0 >> Aug 20 13:24:51 bsdpkgbuild kernel: amd64_syscall() at >> amd64_syscall+0x265/frame 0xfffffe0238af9bf0 >> Aug 20 13:24:51 bsdpkgbuild kernel: Xfast_syscall() at >> Xfast_syscall+0xfb/frame 0xfffffe0238af9bf0 >> Aug 20 13:24:51 bsdpkgbuild kernel: --- syscall (133, FreeBSD ELF64, >> sys_sendto), rip = 0x800d5ccea, rsp = 0x7ffffffed578, rbp = >> 0x7ffffffed5b0 --- >> Aug 20 13:24:51 bsdpkgbuild kernel: >> Aug 20 13:24:51 bsdpkgbuild kernel: >> Aug 20 13:24:51 bsdpkgbuild kernel: Fatal trap 12: page fault while in >> kernel mode >> Aug 20 13:24:51 bsdpkgbuild kernel: cpuid = 5; apic id = 02 >> Aug 20 13:24:51 bsdpkgbuild kernel: fault virtual address = 0xd0 >> Aug 20 13:24:51 bsdpkgbuild kernel: fault code = supervisor >> write data, page not present >> Aug 20 13:24:51 bsdpkgbuild kernel: instruction pointer = >> 0x20:0xffffffff80aa6a53 >> Aug 20 13:24:51 bsdpkgbuild kernel: stack pointer = >> 0x28:0xfffffe0238af96e0 >> Aug 20 13:24:51 bsdpkgbuild kernel: frame pointer = >> 0x28:0xfffffe0238af9770 >> Aug 20 13:24:51 bsdpkgbuild kernel: code segment = base >> 0x0, limit 0xfffff, type 0x1b >> Aug 20 13:24:51 bsdpkgbuild kernel: = DPL 0, pres 1, long 1, def32 0, gran 1 >> Aug 20 13:24:51 bsdpkgbuild kernel: processor eflags = interrupt >> enabled, >> === >> repeated occurrence >> Aug 20 14:16:21 bsdpkgbuild kernel: Kernel page fault with the following >> non-sleepable locks held: >> Aug 20 14:16:21 bsdpkgbuild kernel: shared rw ipsec request (ipsec >> request) r = 0 (0xfffff8001a9820e0) locked @ >> /usr/src/sys/netipsec/ipsec_output.c:436 >> Aug 20 14:16:21 bsdpkgbuild kernel: shared rw rawinp (rawinp) r = 0 >> (0xfffff801db519da8) locked @ /usr/src/sys/netinet/raw_ip.c:446 >> Aug 20 14:16:21 bsdpkgbuild kernel: KDB: stack backtrace: >> Aug 20 14:16:21 bsdpkgbuild kernel: db_trace_self_wrapper() at >> db_trace_self_wrapper+0x2b/frame 0xfffffe0238b081e0 >> Aug 20 14:16:21 bsdpkgbuild kernel: kdb_backtrace() at >> kdb_backtrace+0x39/frame 0xfffffe0238b08290 >> Aug 20 14:16:21 bsdpkgbuild kernel: witness_warn() at >> witness_warn+0x4a8/frame 0xfffffe0238b08350 >> Aug 20 14:16:21 bsdpkgbuild kernel: trap_pfault() at >> trap_pfault+0x5a/frame 0xfffffe0238b08400 >> Aug 20 14:16:21 bsdpkgbuild kernel: trap() at trap+0x670/frame >> 0xfffffe0238b08620 >> Aug 20 14:16:21 bsdpkgbuild kernel: calltrap() at calltrap+0x8/frame >> 0xfffffe0238b08620 >> Aug 20 14:16:21 bsdpkgbuild kernel: --- trap 0xc, rip = >> 0xffffffff80aa6a53, rsp = 0xfffffe0238b086e0, rbp = 0xfffffe0238b08770 --- >> Aug 20 14:16:21 bsdpkgbuild kernel: ipsec4_process_packet() at >> ipsec4_process_packet+0x73/frame 0xfffffe0238b08770 >> Aug 20 14:16:21 bsdpkgbuild kernel: ip_ipsec_output() at >> ip_ipsec_output+0x197/frame 0xfffffe0238b087b0 >> Aug 20 14:16:21 bsdpkgbuild kernel: ip_output() at ip_output+0x8a3/frame >> 0xfffffe0238b088a0 >> Aug 20 14:16:21 bsdpkgbuild kernel: rip_output() at >> rip_output+0x2fa/frame 0xfffffe0238b088f0 >> Aug 20 14:16:21 bsdpkgbuild kernel: sosend_generic() at >> sosend_generic+0x3dc/frame 0xfffffe0238b089a0 >> Aug 20 14:16:21 bsdpkgbuild kernel: kern_sendit() at >> kern_sendit+0x1e4/frame 0xfffffe0238b08a40 >> Aug 20 14:16:21 bsdpkgbuild kernel: sendit() at sendit+0xf8/fra >> Aug 20 14:16:21 bsdpkgbuild kernel: m >> Aug 20 14:16:21 bsdpkgbuild kernel: e 0xfffffe >> Aug 20 14:16:21 bsdpkgbuild kernel: 0 >> Aug 20 14:16:21 bsdpkgbuild kernel: 23 >> Aug 20 14:16:21 bsdpkgbuild kernel: 8 >> Aug 20 14:16:21 bsdpkgbuild kernel: b >> Aug 20 14:16:21 bsdpkgbuild kernel: 08a9 >> Aug 20 14:16:21 bsdpkgbuild kernel: 0 >> >> >> Cheers, >> Vince >> >> _______________________________________________ >> freebsd-current@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-current >> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" >>