Date: Wed, 20 Jul 2016 09:32:11 -0500 From: Karl Denninger <karl@denninger.net> To: freebsd-stable@freebsd.org Subject: Re: Panic on BETA1 in the ZFS subsystem Message-ID: <6be60e94-cce7-6e97-0392-5b08d13d7945@denninger.net> In-Reply-To: <8f44bc09-1237-44d0-fe7a-7eb9cf4fe85b@denninger.net> References: <8f44bc09-1237-44d0-fe7a-7eb9cf4fe85b@denninger.net>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format. --------------ms060000060006040505000103 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable The panic occurred during a zfs send/receive operation for system backup..... I've seen this one before, unfortunately, and it appears that it's still there -- may be related to https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D207464 On 7/20/2016 09:26, Karl Denninger wrote: > Came out of the ZFS system; this machine is running *unpatched* (none o= f > my changes are in the kernel); I have a good core dump if further trace= > information will help. > > Dump header from device: /dev/gpt/dump > Architecture: amd64 > Architecture Version: 2 > Dump Length: 9582022656 > Blocksize: 512 > Dumptime: Wed Jul 20 09:10:31 2016 > Hostname: NewFS.denninger.net > Magic: FreeBSD Kernel Dump > Version String: FreeBSD 11.0-BETA1 #0 r302489: Sat Jul 9 10:15:24 CD= T > 2016 > karl@NewFS.denninger.net:/usr/obj/usr/src/sys/KSD-SMP > Panic String: double fault > Dump Parity: 445173880 > Bounds: 4 > Dump Status: good > > NewFS.denninger.net dumped core - see /var/crash/vmcore.4 > > Wed Jul 20 09:18:15 CDT 2016 > > FreeBSD NewFS.denninger.net 11.0-BETA1 FreeBSD 11.0-BETA1 #0 r302489: > Sat Jul 9 10:15:24 CDT 2016 =20 > karl@NewFS.denninger.net:/usr/obj/usr/src/sys/KSD-SMP amd64 > > panic: double fault > > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and yo= u are > welcome to change it and/or distribute copies of it under certain > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for deta= ils. > This GDB was configured as "amd64-marcel-freebsd"... > > Unread portion of the kernel message buffer: > > Fatal double fault > rip =3D 0xffffffff8220bc92 > rsp =3D 0xfffffe0667f0ef30 > rbp =3D 0xfffffe0667f0f3c0 > cpuid =3D 14; apic id =3D 34 > panic: double fault > cpuid =3D 14 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffffe0649db8e30 > vpanic() at vpanic+0x182/frame 0xfffffe0649db8eb0 > panic() at panic+0x43/frame 0xfffffe0649db8f10 > dblfault_handler() at dblfault_handler+0xa2/frame 0xfffffe0649db8f30 > Xdblfault() at Xdblfault+0xac/frame 0xfffffe0649db8f30 > --- trap 0x17, rip =3D 0xffffffff8220bc92, rsp =3D 0xfffffe0667f0ef30, = rbp =3D > 0xfffffe0667f0f3c0 --- > vdev_queue_io_to_issue() at vdev_queue_io_to_issue+0x22/frame > 0xfffffe0667f0f3c0 > vdev_queue_io_done() at vdev_queue_io_done+0x83/frame 0xfffffe0667f0f40= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0f430 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0f480 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f0f4e0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0f530 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f0f57= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0f5a0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0f5f0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f0f650= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0f6a0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f0f6e= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0f710 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0f760 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f0f7c0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0f810 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f0f85= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0f880 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0f8d0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f0f930= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0f980 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f0f9c= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0f9f0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0fa40 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f0faa0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0faf0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f0fb3= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0fb60 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0fbb0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f0fc10= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0fc60 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f0fca= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0fcd0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0fd20 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f0fd80= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0fdd0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f0fe1= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0fe40 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0fe90 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f0fef0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f0ff40 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f0ff8= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f0ffb0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10000 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10060= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f100b0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f100f= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10120 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10170 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f101d0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10220 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1026= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10290 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f102e0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10340= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10390 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f103d= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10400 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10450 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f104b0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10500 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1054= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10570 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f105c0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10620= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10670 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f106b= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f106e0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10730 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10790= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f107e0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1082= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10850 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f108a0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10900= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10950 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1099= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f109c0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10a10 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10a70= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10ac0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f10b0= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10b30 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10b80 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10be0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10c30 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f10c7= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10ca0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10cf0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10d50= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10da0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f10de= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10e10 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10e60 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f10ec0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10f10 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f10f5= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f10f80 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f10fd0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f11030= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11080 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f110c= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f110f0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11140 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f111a0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f111f0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1123= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f11260 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f112b0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f11310= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11360 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f113a= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f113d0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11420 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f11480= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f114d0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1151= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f11540 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11590 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f115f0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11640 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1168= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f116b0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11700 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f11760= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f117b0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f117f= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f11820 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11870 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f118d0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11920 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1196= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f11990 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f119e0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f11a40= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11a90 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f11ad= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f11b00 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11b50 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f11bb0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11c00 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f11c4= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f11c70 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11cc0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f11d20= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11d70 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f11db= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f11de0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11e30 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f11e90= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11ee0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f11f2= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f11f50 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f11fa0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f12000= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12050 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1209= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f120c0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12110 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f12170= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f121c0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1220= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f12230 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12280 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f122e0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12330 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1237= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f123a0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f123f0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f12450= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f124a0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f124e= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f12510 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12560 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f125c0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12610 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1265= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f12680 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f126d0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f12730= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12780 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f127c= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f127f0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12840 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f128a0= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f128f0 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f1293= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f12960 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f129b0 > zio_vdev_io_start() at zio_vdev_io_start+0x34d/frame 0xfffffe0667f12a10= > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12a60 > vdev_queue_io_done() at vdev_queue_io_done+0xcd/frame 0xfffffe0667f12aa= 0 > zio_vdev_io_done() at zio_vdev_io_done+0xd9/frame 0xfffffe0667f12ad0 > zio_execute() at zio_execute+0x236/frame 0xfffffe0667f12b20 > taskqueue_run_locked() at taskqueue_run_locked+0x14a/frame > 0xfffffe0667f12b80 > taskqueue_thread_loop() at taskqueue_thread_loop+0xe8/frame > 0xfffffe0667f12bb0 > fork_exit() at fork_exit+0x85/frame 0xfffffe0667f12bf0 > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0667f12bf0 > --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- > Uptime: 10d21h36m8s > Dumping 9138 out of 24531 > MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% > > Reading symbols from /boot/kernel/zfs.ko...Reading symbols from > /usr/lib/debug//boot/kernel/zfs.ko.debug...done. > done. > Loaded symbols for /boot/kernel/zfs.ko > Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from= > /usr/lib/debug//boot/kernel/opensolaris.ko.debug...done. > done. > Loaded symbols for /boot/kernel/opensolaris.ko > Reading symbols from /boot/kernel/geom_eli.ko...Reading symbols from > /usr/lib/debug//boot/kernel/geom_eli.ko.debug...done. > done. > Loaded symbols for /boot/kernel/geom_eli.ko > Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from= > /usr/lib/debug//boot/kernel/geom_mirror.ko.debug...done. > done. > Loaded symbols for /boot/kernel/geom_mirror.ko > Reading symbols from /boot/kernel/aesni.ko...Reading symbols from > /usr/lib/debug//boot/kernel/aesni.ko.debug...done. > done. > Loaded symbols for /boot/kernel/aesni.ko > Reading symbols from /boot/kernel/uhid.ko...Reading symbols from > /usr/lib/debug//boot/kernel/uhid.ko.debug...done. > done. > Loaded symbols for /boot/kernel/uhid.ko > Reading symbols from /boot/kernel/ums.ko...Reading symbols from > /usr/lib/debug//boot/kernel/ums.ko.debug...done. > done. > Loaded symbols for /boot/kernel/ums.ko > Reading symbols from /boot/kernel/ipfw.ko...Reading symbols from > /usr/lib/debug//boot/kernel/ipfw.ko.debug...done. > done. > Loaded symbols for /boot/kernel/ipfw.ko > Reading symbols from /boot/kernel/ipfw_nat.ko...Reading symbols from > /usr/lib/debug//boot/kernel/ipfw_nat.ko.debug...done. > done. > Loaded symbols for /boot/kernel/ipfw_nat.ko > Reading symbols from /boot/kernel/libalias.ko...Reading symbols from > /usr/lib/debug//boot/kernel/libalias.ko.debug...done. > done. > Loaded symbols for /boot/kernel/libalias.ko > Reading symbols from /boot/kernel/daemon_saver.ko...Reading symbols fro= m > /usr/lib/debug//boot/kernel/daemon_saver.ko.debug...done. > done. > Loaded symbols for /boot/kernel/daemon_saver.ko > #0 doadump (textdump=3D1) at pcpu.h:221 > 221 pcpu.h: No such file or directory. > in pcpu.h > (kgdb) #0 doadump (textdump=3D1) at pcpu.h:221 > #1 0xffffffff80ae548e in kern_reboot (howto=3D260) > at /usr/src/sys/kern/kern_shutdown.c:366 > #2 0xffffffff80ae5a5b in vpanic (fmt=3D<value optimized out>, > ap=3D<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:75= 9 > #3 0xffffffff80ae5893 in panic (fmt=3D0x0) > at /usr/src/sys/kern/kern_shutdown.c:690 > #4 0xffffffff80fc9692 in dblfault_handler (frame=3D<value optimized ou= t>) > at /usr/src/sys/amd64/amd64/trap.c:868 > #5 0xffffffff80fac15c in Xdblfault () > at /usr/src/sys/amd64/amd64/exception.S:292 > #6 0xffffffff8220bc92 in vdev_queue_io_to_issue (vq=3D0xfffff804d86833= e0) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:58= 5 > #7 0xffffffff8220c6e3 in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 1 > #8 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8018859c000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #9 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #10 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8018859c000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #11 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #12 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #13 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff801df1f43b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #14 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #15 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff801df1f43b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #16 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #17 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #18 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8024583e770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #19 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #20 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8024583e770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #21 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #22 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #23 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff802e12df770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #24 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #25 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff802e12df770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #26 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #27 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #28 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8004f81f3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #29 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #30 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8004f81f3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #31 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #32 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #33 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8021bdf7b28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #34 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #35 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8021bdf7b28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #36 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #37 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #38 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff80165851770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #39 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #40 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff80165851770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #41 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #42 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #43 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8060de643b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #44 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #45 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8060de643b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #46 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #47 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #48 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff800793c0770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #49 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #50 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff800793c0770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #51 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #52 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #53 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8026917cb28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #54 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #55 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8026917cb28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #56 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #57 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #58 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8012408d3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #59 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #60 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8012408d3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #61 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #62 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #63 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff802bfc9ab28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #64 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #65 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff802bfc9ab28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #66 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #67 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #68 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff802dda5db28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #69 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #70 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff802dda5db28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #71 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #72 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #73 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff800ae13d000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #74 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #75 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff800ae13d000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #76 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #77 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #78 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff804a70efb28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #79 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #80 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff804a70efb28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #81 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #82 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #83 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff80485f5f000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #84 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #85 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff80485f5f000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #86 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #87 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #88 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff800666fc3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #89 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #90 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff800666fc3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #91 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #92 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #93 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8010da3ab28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #94 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #95 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8010da3ab28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #96 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #97 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized ou= t>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #98 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff80315f73770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #99 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #100 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff80315f73770)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #101 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #102 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #103 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff806011703b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #104 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #105 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff806011703b8)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #106 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #107 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #108 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff805964f1770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #109 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #110 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff805964f1770)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #111 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #112 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #113 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8023902f770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #114 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #115 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8023902f770)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #116 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #117 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #118 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff803bc7e2b28) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #119 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #120 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff803bc7e2b28)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #121 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #122 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #123 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff804dfbf43b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #124 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #125 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff804dfbf43b8)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #126 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #127 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #128 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8005be4a3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #129 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #130 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8005be4a3b8)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #131 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #132 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #133 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8004ff79000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #134 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #135 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8004ff79000)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #136 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #137 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #138 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff801aa2a2000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #139 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #140 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff801aa2a2000)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #141 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #142 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #143 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff800592003b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #144 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #145 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff800592003b8)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #146 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #147 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #148 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff80202d11770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #149 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #150 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff80202d11770)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #151 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #152 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #153 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff80392d3c3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #154 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #155 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff80392d3c3b8)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #156 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #157 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #158 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff80550fdd000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #159 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #160 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff80550fdd000)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #161 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #162 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #163 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8055fd15770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #164 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #165 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8055fd15770)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #166 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #167 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #168 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff80576f99770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #169 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #170 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff80576f99770)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #171 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #172 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #173 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff802269bf000) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #174 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #175 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff802269bf000)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #176 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #177 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #178 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff8003d7973b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #179 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #180 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff8003d7973b8)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #181 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #182 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #183 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff80108754770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #184 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #185 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff80108754770)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #186 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #187 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #188 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff804cfdf7770) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #189 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #190 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff804cfdf7770)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #191 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #192 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #193 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff801469a13b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #194 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #195 0xffffffff8222955d in zio_vdev_io_start (zio=3D0xfffff801469a13b8)= > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 70 > #196 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #197 0xffffffff8220c72d in vdev_queue_io_done (zio=3D<value optimized o= ut>) > at > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/vdev_queue.c:88= 7 > #198 0xffffffff82229719 in zio_vdev_io_done (zio=3D0xfffff805dcd9d3b8) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:28= 95 > #199 0xffffffff82225d96 in zio_execute (zio=3D<value optimized out>) > at /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:15= 56 > #200 0xffffffff80b415aa in taskqueue_run_locked (queue=3D<value optimiz= ed > out>) > at /usr/src/sys/kern/subr_taskqueue.c:465 > #201 0xffffffff80b424b8 in taskqueue_thread_loop (arg=3D<value optimize= d out>) > at /usr/src/sys/kern/subr_taskqueue.c:719 > #202 0xffffffff80a9ad85 in fork_exit ( > callout=3D0xffffffff80b423d0 <taskqueue_thread_loop>, > arg=3D0xfffff8037db02580, frame=3D0xfffffe0667f12c00) > at /usr/src/sys/kern/kern_fork.c:1038 > #203 0xffffffff80fac59e in fork_trampoline () > at /usr/src/sys/amd64/amd64/exception.S:611 > #204 0x0000000000000000 in ?? () > Current language: auto; currently minimal > (kgdb) > --=20 Karl Denninger karl@denninger.net <mailto:karl@denninger.net> /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms060000060006040505000103 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC Bl8wggZbMIIEQ6ADAgECAgEpMA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND dWRhIFN5c3RlbXMgTExDIENBMB4XDTE1MDQyMTAyMjE1OVoXDTIwMDQxOTAyMjE1OVowWjEL MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM TEMxHjAcBgNVBAMTFUthcmwgRGVubmluZ2VyIChPQ1NQKTCCAiIwDQYJKoZIhvcNAQEBBQAD ggIPADCCAgoCggIBALmEWPhAdphrWd4K5VTvE5pxL3blRQPyGF3ApjUjgtavqU1Y8pbI3Byg XDj2/Uz9Si8XVj/kNbKEjkRh5SsNvx3Fc0oQ1uVjyCq7zC/kctF7yLzQbvWnU4grAPZ3IuAp 3/fFxIVaXpxEdKmyZAVDhk9az+IgHH43rdJRIMzxJ5vqQMb+n2EjadVqiGPbtG9aZEImlq7f IYDTnKyToi23PAnkPwwT+q1IkI2DTvf2jzWrhLR5DTX0fUYC0nxlHWbjgpiapyJWtR7K2YQO aevQb/3vN9gSojT2h+cBem7QIj6U69rEYcEDvPyCMXEV9VcXdcmW42LSRsPvZcBHFkWAJqMZ Myiz4kumaP+s+cIDaXitR/szoqDKGSHM4CPAZV9Yh8asvxQL5uDxz5wvLPgS5yS8K/o7zDR5 vNkMCyfYQuR6PAJxVOk5Arqvj9lfP3JSVapwbr01CoWDBkpuJlKfpQIEeC/pcCBKknllbMYq yHBO2TipLyO5Ocd1nhN/nOsO+C+j31lQHfOMRZaPQykXVPWG5BbhWT7ttX4vy5hOW6yJgeT/ o3apynlp1cEavkQRS8uJHoQszF6KIrQMID/JfySWvVQ4ksnfzwB2lRomrdrwnQ4eG/HBS+0l eozwOJNDIBlAP+hLe8A5oWZgooIIK/SulUAsfI6Sgd8dTZTTYmlhAgMBAAGjgfQwgfEwNwYI KwYBBQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgw CQYDVR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIB DQQfFh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUxRyULenJaFwX RtT79aNmIB/u5VkwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYw FIESa2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBPf3cYtmKowmGIYsm6 eBinJu7QVWvxi1vqnBz3KE+HapqoIZS8/PolB/hwiY0UAE1RsjBJ7yEjihVRwummSBvkoOyf G30uPn4yg4vbJkR9lTz8d21fPshWETa6DBh2jx2Qf13LZpr3Pj2fTtlu6xMYKzg7cSDgd2bO sJGH/rcvva9Spkx5Vfq0RyOrYph9boshRN3D4tbWgBAcX9POdXCVfJONDxhfBuPHsJ6vEmPb An+XL5Yl26XYFPiODQ+Qbk44Ot1kt9s7oS3dVUrh92Qv0G3J3DF+Vt6C15nED+f+bk4gScu+ JHT7RjEmfa18GT8DcT//D1zEke1Ymhb41JH+GyZchDRWtjxsS5OBFMzrju7d264zJUFtX7iJ 3xvpKN7VcZKNtB6dLShj3v/XDsQVQWXmR/1YKWZ93C3LpRs2Y5nYdn6gEOpL/WfQFThtfnat HNc7fNs5vjotaYpBl5H8+VCautKbGOs219uQbhGZLYTv6okuKcY8W+4EJEtK0xB08vqr9Jd0 FS9MGjQE++GWo+5eQxFt6nUENHbVYnsr6bYPQsZH0CRNycgTG9MwY/UIXOf4W034UpR82TBG 1LiMsYfb8ahQJhs3wdf1nzipIjRwoZKT1vGXh/cj3gwSr64GfenURBxaFZA5O1acOZUjPrRT n3ci4McYW/0WVVA3lDGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMH RmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExD MRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5 c3RlbXMgTExDIENBAgEpMA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZI hvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNjA3MjAxNDMyMTFaME8GCSqGSIb3DQEJBDFCBED8 NToNoVOfI7f5nOu0SiI/0RJrVT4lE31jJ8jr0ztfAOKhBAymNWs0uReedOVz6pUe30jzIYNp YOXxUMmRsyUlMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAK BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI KoZIhvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNV BAgTB0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1z IExMQzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3Vk YSBTeXN0ZW1zIExMQyBDQQIBKTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYT AlVTMRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1 ZGEgU3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG 9w0BCQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECASkwDQYJKoZIhvcNAQEBBQAEggIAM6fT6oGP EVACGmGx/6gVgjv4aO3WzUvbAHPkrpJ6s9Vt8JUmXscynQnVZtqil+/wAggvSc6yyZe7ssi5 q9rQk3rDUKAPLj9N+KMqwnjQAP6lwf5KlCQ/HuMHR9ReQeO8P6hdfI2AvA/ghmK/LKe7rLTb BOegyP3pa8EaYhTrmbrq1Ug6m+DeYIRscnfO2xCNQQ7/9on44pUCRucQc8z5cHQhEsjJrJd0 F3NWPu2bp1QR5o1+w5fGwe0jz2YqU1unxys8bVRGVEsjpNFuAy/L7OSc9papcj4NuC0W0q48 zEoS1lyFY0lcu+L3lqdSIoTW40WTqBXPMRR4CjSt0m0gzxhNCT66ispdGQVczTnoteykw/f9 q42h6geTLaag29R+ihbA24s6L8B9AFTiLFVwuzN+1qThJ7dVreWYWsPE5TK1ou6HFo8ZsJU5 QBWDLJ5teJ8m8WWhuICygTpRgyBcm+VxHJ2bMFxLGXU+pinqroY9Elx4s9lpyyIY1XlN/Yw6 9yHSGH+yg3NCRdfaiULHpC85DiSW30tVI0VHFcJyFgBEDV05fSQsXe1OwA3KlwGxLX+IPEgn HAzux8Ax6DrsG3UsUWMbyvVscxMf1FVPPbrWX2+PZi25m2Z+zLJEM4d2EcEq4vHxcg/GmA0H Pfv0s/bHLF0FmnOT6urUAZKZqlwAAAAAAAA= --------------ms060000060006040505000103--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?6be60e94-cce7-6e97-0392-5b08d13d7945>