From owner-freebsd-fs@freebsd.org Sun Mar 13 21:02:55 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7DE75ACD7D0 for ; Sun, 13 Mar 2016 21:02:55 +0000 (UTC) (envelope-from demis@yandex.ru) Received: from forward16o.cmail.yandex.net (forward16o.cmail.yandex.net [IPv6:2a02:6b8:0:1a72::1e6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "forwards.mail.yandex.net", Issuer "Yandex CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DA9C2D71 for ; Sun, 13 Mar 2016 21:02:54 +0000 (UTC) (envelope-from demis@yandex.ru) Received: from web8o.yandex.ru (web8o.yandex.ru [IPv6:2a02:6b8:0:1a2d::5:108]) by forward16o.cmail.yandex.net (Yandex) with ESMTP id AC06621964; Mon, 14 Mar 2016 00:02:42 +0300 (MSK) Received: from web8o.yandex.ru (localhost [127.0.0.1]) by web8o.yandex.ru (Yandex) with ESMTP id 1FD125D810D4; Mon, 14 Mar 2016 00:02:42 +0300 (MSK) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.ru; s=mail; t=1457902962; bh=0EbdIfNxP0m3g5H0kybQ2BKWx73Tv79iF0NOpsEYW8U=; h=From:To:In-Reply-To:References:Subject:Date; b=rEWUnkYkmZcyXlUG9aueVTdLmbkJVcoZmx9LYr0V1/N1PeNRD1kOWzakS8OtjmL7b pQa8/H7meEdpntt64dUY3meEWAn04tlT53trd5rKuF+0BnajFxTZT/Rp6u0xxkpNga AmJXkJpcgQwgnIhSNHqwqVAgWqMlYJ53atjrkcbw= Received: by web8o.yandex.ru with HTTP; Mon, 14 Mar 2016 00:02:40 +0300 From: DemIS To: Steven Hartland , "freebsd-fs@freebsd.org" In-Reply-To: <56C2E7A6.9090004@multiplay.co.uk> References: <1061671455578760@web3g.yandex.ru> <56C2655F.9010809@multiplay.co.uk> <1076701455583595@web2g.yandex.ru> <56C2782E.2010404@multiplay.co.uk> <2311371455610101@web11j.yandex.ru> <56C2E7A6.9090004@multiplay.co.uk> Subject: Re: Kernel panic zio.c, line: 270 FreeBSD 10.2 (or 10.3) MIME-Version: 1.0 Message-Id: <4332271457902960@web8o.yandex.ru> X-Mailer: Yamail [ http://yandex.ru ] 5.0 Date: Mon, 14 Mar 2016 00:02:40 +0300 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=koi8-r X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Mar 2016 21:02:55 -0000 Hi Steven , Finally I was able to get the data that you have requested. The following quote from the dump to setfacl -b -m /hdd/usr/wf/some/long/path kgdb /usr/obj/usr/src/sys/TEO/kernel.debug /usr/crash/vmcore.last GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: panic: solaris assert: c < (1ULL << 24) >> 9 (0x7fffffffffffff < 0x8000), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c, line: 270 cpuid = 2 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2e/frame 0xfffffe0677ebfbe0 kdb_backtrace() at kdb_backtrace+0x58/frame 0xfffffe0677ebfc90 vpanic() at vpanic+0x1df/frame 0xfffffe0677ebfd00 vpanic() at vpanic/frame 0xfffffe0677ebfd60 zfs_kmem_alloc() at zfs_kmem_alloc/frame 0xfffffe0677ebfdb0 zio_buf_alloc() at zio_buf_alloc+0x84/frame 0xfffffe0677ebfdf0 arc_get_data_buf() at arc_get_data_buf+0x7a/frame 0xfffffe0677ebfe60 arc_buf_alloc() at arc_buf_alloc+0xe0/frame 0xfffffe0677ebfeb0 arc_read() at arc_read+0x65d/frame 0xfffffe0677ec0040 dbuf_read_impl() at dbuf_read_impl+0x4af/frame 0xfffffe0677ec00e0 dbuf_read() at dbuf_read+0x33b/frame 0xfffffe0677ec0190 dmu_spill_hold_by_dnode() at dmu_spill_hold_by_dnode+0xf7/frame 0xfffffe0677ec01e0 dmu_spill_hold_existing() at dmu_spill_hold_existing+0x16b/frame 0xfffffe0677ec0240 sa_get_spill() at sa_get_spill+0x3c/frame 0xfffffe0677ec0260 sa_modify_attrs() at sa_modify_attrs+0x118/frame 0xfffffe0677ec0330 sa_attr_op() at sa_attr_op+0x9db/frame 0xfffffe0677ec03a0 sa_bulk_update_impl() at sa_bulk_update_impl+0x74/frame 0xfffffe0677ec03f0 sa_bulk_update() at sa_bulk_update+0x45/frame 0xfffffe0677ec0430 zfs_aclset_common() at zfs_aclset_common+0x95f/frame 0xfffffe0677ec0620 zfs_setacl() at zfs_setacl+0x451/frame 0xfffffe0677ec06c0 zfs_setsecattr() at zfs_setsecattr+0x10d/frame 0xfffffe0677ec0720 zfs_freebsd_setacl() at zfs_freebsd_setacl+0x15c/frame 0xfffffe0677ec0790 VOP_SETACL_APV() at VOP_SETACL_APV+0x174/frame 0xfffffe0677ec07f0 VOP_SETACL() at VOP_SETACL+0x5a/frame 0xfffffe0677ec0860 vacl_set_acl() at vacl_set_acl+0xf1/frame 0xfffffe0677ec08c0 sys___acl_set_file() at sys___acl_set_file+0x91/frame 0xfffffe0677ec09d0 syscallenter() at syscallenter+0x754/frame 0xfffffe0677ec0af0 amd64_syscall() at amd64_syscall+0x1f/frame 0xfffffe0677ec0bf0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0677ec0bf0 --- syscall (348, FreeBSD ELF64, sys___acl_set_file), rip = 0x80092a17a, rsp = 0x7fffffffe2e8, rbp = 0x7fffffffe7c0 --- Uptime: 2d11h24m58s Dumping 5431 out of 24533 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Reading symbols from /boot/kernel/if_lagg.ko.symbols...done. Loaded symbols for /boot/kernel/if_lagg.ko.symbols Reading symbols from /boot/kernel/aio.ko.symbols...done. Loaded symbols for /boot/kernel/aio.ko.symbols Reading symbols from /boot/kernel/ichsmb.ko.symbols...done. Loaded symbols for /boot/kernel/ichsmb.ko.symbols Reading symbols from /boot/kernel/ipmi.ko.symbols...done. Loaded symbols for /boot/kernel/ipmi.ko.symbols Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols Reading symbols from /boot/kernel/smbfs.ko.symbols...done. Loaded symbols for /boot/kernel/smbfs.ko.symbols Reading symbols from /boot/kernel/libiconv.ko.symbols...done. Loaded symbols for /boot/kernel/libiconv.ko.symbols Reading symbols from /boot/kernel/libmchain.ko.symbols...done. Loaded symbols for /boot/kernel/libmchain.ko.symbols #0 doadump (textdump=1) at /usr/src/sys/kern/kern_shutdown.c:263 263 dumptid = curthread->td_tid; (kgdb) bt full #0 doadump (textdump=1) at /usr/src/sys/kern/kern_shutdown.c:263 coredump = 1 #1 0xffffffff80e21a6a in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:451 first_buf_printf = 1 #2 0xffffffff80e2240c in vpanic (fmt=0xffffffff8268f154 "solaris assert: %s (0x%jx %s 0x%jx), file: %s, line: %d", ap=0xfffffe0677ebfd40) at /usr/src/sys/kern/kern_shutdown.c:758 buf = "solaris assert: c < (1ULL << 24) >> 9 (0x7", 'f' , " < 0x8000), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c, line: 270", '\0' other_cpus = {__bits = {65531}} td = (struct thread *) 0xfffff800713124a0 bootopt = 260 newpanic = 1 #3 0xffffffff80e221d0 in panic (fmt=0xffffffff8268f154 "solaris assert: %s (0x%jx %s 0x%jx), file: %s, line: %d") at /usr/src/sys/kern/kern_shutdown.c:687 ap = {{gp_offset = 48, fp_offset = 48, overflow_arg_area = 0xfffffe0677ebfd78, reg_save_area = 0xfffffe0677ebfd10}} #4 0xffffffff8268e470 in assfail3 (a=0xffffffff825cbcb9 "c < (1ULL << 24) >> 9", lv=36028797018963967, op=0xffffffff825cbccf "<", rv=32768, f=0xffffffff825cbcd1 "/usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c", l=270) at /usr/src/sys/modules/opensolaris/../../cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:91 No locals. #5 0xffffffff8250e414 in zio_buf_alloc (size=0) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:270 __left = 36028797018963967 __right = 32768 c = 36028797018963967 flags = 0 #6 0xffffffff8243dc1a in arc_get_data_buf (buf=0xfffff804795ddc18) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:2898 state = (arc_state_t *) 0xffffffff825e8700 size = 0 type = ARC_BUFC_METADATA #7 0xffffffff8243db60 in arc_buf_alloc (spa=0xfffff800719d1000, size=0, tag=0xfffff803b1e8de00, type=ARC_BUFC_METADATA) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1551 hdr = (arc_buf_hdr_t *) 0xfffff8025cc22288 buf = (arc_buf_t *) 0xfffff804795ddc18 #8 0xffffffff824419bd in arc_read (pio=0xfffff80071def398, spa=0xfffff800719d1000, bp=0xfffffe001589e180, done=0xffffffff82455380 , private=0xfffff803b1e8de00, priority=ZIO_PRIORITY_SYNC_READ, zio_flags=128, arc_flags=0xfffffe0677ec0094, zb=0xfffffe0677ec0098) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:3389 exists = (arc_buf_hdr_t *) 0x0 type = ARC_BUFC_METADATA vd = (vdev_t *) 0x0 devw = 0 b_asize = 0 size = 0 acb = (arc_callback_t *) 0xfffff800713124a0 addr = 0 b_compress = ZIO_COMPRESS_OFF sdt_sdt___arc__hit = {{version = 1287817688, prov = 0x30c48348fffff834, probe_entry = {tqe_next = 0x2e6666666666c35d, tqe_prev = 0x841f0f}, argtype_list = {tqh_first = 0x20ec8348e5894855, tqh_last = 0xf0758948f87d8948}, mod = 0xf87d8b48e8558948
, func = 0xe8558b48f0758b48
, name = 0x12b8c189c031
, id = 5531134888965130240, n_args = -387955317, sdtp_lf = 0x9066c35d20c48348}} __set_sdt_probes_set_sym_sdt_sdt___arc__hit = (const void * const) 0x58f0f000000 sdta_sdt___arc__hit0 = {{ndx = -443987883, type = 0x4c984d894c000001
, xtype = 0x48884d8948904589
, argtype_entry = {tqe_next = 0xb8d04d8d48805589, tqe_prev = 0xba4100000001}, probe = 0x7589f87d89480000}} ---Type to continue, or q to quit--- __set_sdt_argtypes_set_sym_sdta_sdt___arc__hit0 = (const void * const) 0x1518e0f000000 sdt_sdt___arc__miss = {{version = -193623052, prov = 0xfe810000, probe_entry = {tqe_next = 0x41db8445c3950f41, tqe_prev = 0x45c7c44589c2440f}, argtype_list = {tqh_first = 0x958d4800000000c0, tqh_last = 0x10518948ffffff70}, mod = 0x851894810558d48
, func = 0xc7000000300441c7
, name = 0x8100b00000001001
, id = -8824803469832437635, n_args = -145, sdtp_lf = 0x4d8bd0458d480000}} __set_sdt_probes_set_sym_sdt_sdt___arc__miss = (const void * const) 0x2b800000174e900 sdta_sdt___arc__miss0 = {{ndx = 687440336, type = 0x8d89ffffff608589
, xtype = 0x2b870fffffff5c
, argtype_entry = {tqe_next = 0xffff60858b480000, tqe_prev = 0x5c958b10488b48ff}, probe = 0x148f26348ffffff}} __set_sdt_argtypes_set_sym_sdta_sdt___arc__miss0 = (const void * const) 0x8be04589e4458b00 sdta_sdt___arc__miss1 = {{ndx = 146964977, type = 0xffffff508d894810
, xtype = 0x858b4800000020e9
, argtype_entry = {tqe_next = 0x8488b48ffffff60, tqe_prev = 0x8c18148ca8948}, probe = 0x8948084889480000}} __set_sdt_argtypes_set_sym_sdta_sdt___arc__miss1 = (const void * const) 0x1f8d0ff4453be045 sdta_sdt___arc__miss2 = {{ndx = -44907, type = 0x48008b48ffffff50
, xtype = 0x3d48c84589
, argtype_entry = {tqe_next = 0xff6f8d88c1950f00, tqe_prev = 0xffffff6f858affff}, probe = 0x5850f01a8}} __set_sdt_argtypes_set_sym_sdta_sdt___arc__miss2 = (const void * const) 0x452be0458b000001 sdta_sdt___arc__miss3 = {{ndx = 186601, type = 0x28f981d04d8bd0
, xtype = 0xffff488589480000
, argtype_entry = {tqe_next = 0xfffffff448d89ff, tqe_prev = 0x858b480000002b87}, probe = 0x10488b48ffffff48}} __set_sdt_argtypes_set_sym_sdta_sdt___arc__miss3 = (const void * const) 0xdc7d81dc4589e4 sdt_sdt___l2arc__hit = {{version = -12282485, prov = 0x8c281f10148f2, probe_entry = {tqe_next = 0x388d894810890000, tqe_prev = 0x20e9ffffff}, argtype_list = {tqh_first = 0x48ffffff48858b48, tqh_last = 0x8148ca894808488b}, mod = 0x48894800000008c1
, func = 0xffffff3895894808
, name = 0x8bffffff38858b48
, id = 5587026407265569032, n_args = -1982953028, sdtp_lf = 0x89ffffff309589ff}} __set_sdt_probes_set_sym_sdt_sdt___l2arc__hit = (const void * const) 0x4589f44d8b000000 sdta_sdt___l2arc__hit0 = {{ndx = -54091, type = 0xec03fcb8000002
, xtype = 0xa30fffffff348d8b
, argtype_entry = {tqe_next = 0xb800000058820fc8, tqe_prev = 0xff348d8b0713fc00}, probe = 0xdb820fc8a30fffff}} __set_sdt_argtypes_set_sym_sdta_sdt___l2arc__hit0 = (const void * const) 0xf48c0f000000 sdt_sdt___l2arc__read = {{version = -1962934272, prov = 0xff28858901e883ff, probe_entry = {tqe_next = 0x5840fffff, tqe_prev = 0x7d8b48000001d3e9}, argtype_list = {tqh_first = 0xbc558bc8758b48f8, tqh_last = 0x208d8948c189c031}, mod = 0xff20858b4cffffff
, func = 0x89fffff5c1e8ffff
, name = 0x48000001b0e9c045
, id = -467863854793079411, n_args = 40, sdtp_lf = 0xffff148d89ffffff}} __set_sdt_probes_set_sym_sdt_sdt___l2arc__read = (const void * const) 0xf7c04d8b99c889c0 sdta_sdt___l2arc__read0 = {{ndx = 730271743, type = 0x8b48ffffff18858b
, xtype = 0xffffff14958b1048
, argtype_entry = {tqe_next = 0xc281f10148f26348, tqe_prev = 0x8948108900000008}, probe = 0x20e9ffffff088d}} __set_sdt_argtypes_set_sym_sdta_sdt___l2arc__read0 = (const void * const) 0x4d8b48e8458b4800 sdta_sdt___l2arc__read1 = {{ndx = -1958215680, type = 0xca894808488b48ff
, xtype = 0x4800000008c18148
, argtype_entry = {tqe_next = 0xff08958948084889, tqe_prev = 0xffff08858b48ffff}, probe = 0xb0458948008b48ff}} __set_sdt_argtypes_set_sym_sdta_sdt___l2arc__read1 = (const void * const) 0xf055af0fdc558bf8 sdt_sdt___l2arc__miss = {{version = -125990072, prov = 0x31b0458b4cbc558b, probe_entry = {tqe_next = 0x4589fffff52ae8c9, tqe_prev = 0x8d4800000119e9c0}, argtype_list = {tqh_first = 0x28f981d04d8bd045, tqh_last = 0xff00858948000000}, mod = 0xfffffefc8d89ffff
, func = 0x8b480000002b870f
, name = 0x488b48ffffff0085
, id = 5260204360416463632, n_args = 21557859, sdtp_lf = 0x8d89481089000000}} __set_sdt_probes_set_sym_sdt_sdt___l2arc__miss = (const void * const) 0xe47d81e44589f9 sdta_sdt___l2arc__miss0 = {{ndx = -272, type = 0xffffff00858b4800
, xtype = 0x48ca894808488b48
, argtype_entry = {tqe_next = 0x894800000008c181, tqe_prev = 0xfffef09589480848}, probe = 0xfffffef0858b48ff}} __set_sdt_argtypes_set_sym_sdta_sdt___l2arc__miss0 = (const void * const) 0x8b48f10148f26348 ---Type to continue, or q to quit--- sdt_sdt___l2arc__miss = {{version = -800223928, prov = 0xfa81d0558bb04589, probe_entry = {tqe_next = 0xe88d894800000028, tqe_prev = 0xfffee49589fffffe}, argtype_list = {tqh_first = 0x480000002b870fff, tqh_last = 0x8b48fffffee8858b}, mod = 0xfffffee4958b1048
, func = 0xc281f10148f26348
, name = 0x8948108900000008
, id = 9264484975564941, n_args = -1958215680, sdtp_lf = 0xca894808488b48ff}} __set_sdt_probes_set_sym_sdt_sdt___l2arc__miss = (const void * const) 0x1518e0f000000 sdta_sdt___l2arc__miss0 = {{ndx = 146899272, type = 0xfed8958948084889
, xtype = 0xfffed8858b48ffff
, argtype_entry = {tqe_next = 0xa8458948008b48ff, tqe_prev = 0xc8758b48f87d8b48}, probe = 0x4ca84d8b48bc558b}} __set_sdt_argtypes_set_sym_sdta_sdt___l2arc__miss0 = (const void * const) 0xe45503dc558bf875 hdr = (arc_buf_hdr_t *) 0x0 buf = (arc_buf_t *) 0x0 hash_lock = (kmutex_t *) 0x0 rzio = (zio_t *) 0xfffffe0677ebfff0 guid = 18385013180861733512 #9 0xffffffff8244f7df in dbuf_read_impl (db=0xfffff803b1e8de00, zio=0xfffff80071def398, flags=0xfffffe0677ec0174) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:573 dn = (dnode_t *) 0xfffff805c8be5000 zb = {zb_objset = 44, zb_object = 7962880, zb_level = 0, zb_blkid = 18446744073709551614} aflags = 100 #10 0xffffffff8244ef8b in dbuf_read (db=0xfffff803b1e8de00, zio=0xfffff80071def398, flags=6) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:621 spa = (spa_t *) 0xfffff800719d1000 sdt_sdt___blocked__read = {{version = 549749576, prov = 0x841f0f, probe_entry = {tqe_next = 0x20ec8348e5894855, tqe_prev = 0xf0758948f87d8948}, argtype_list = {tqh_first = 0xf0758b48f87d8b48, tqh_last = 0x6b8c289c031}, mod = 0x48c689e875894800
, func = 0xfffffc60e8e84d8b
, name = 0x2e66c35d20c48348
, id = 8658703, n_args = -443987883, sdtp_lf = 0xf0758948f87d8948}} __set_sdt_probes_set_sym_sdt_sdt___blocked__read = (const void * const) 0xd089b44589f0558b sdta_sdt___blocked__read0 = {{ndx = -125990072, type = 0x7b8c289c031
, xtype = 0x48c689e875894800
, argtype_entry = {tqe_next = 0xfffffc20e8e84d8b, tqe_prev = 0x2e66c35d20c48348}, probe = 0x841f0f}} __set_sdt_argtypes_set_sym_sdta_sdt___blocked__read0 = (const void * const) 0x4c28148c28948 sdta_sdt___blocked__read1 = {{ndx = -443987883, type = 0xf0758948f87d8948
, xtype = 0xf0758b48f87d8b48
, argtype_entry = {tqe_next = 0x8b8c289c031, tqe_prev = 0x48c689e875894800}, probe = 0xfffffbe0e8e84d8b}} __set_sdt_argtypes_set_sym_sdta_sdt___blocked__read1 = (const void * const) 0x889c85589480000 err = 0 havepzio = 0 prefetch = 1 dn = (dnode_t *) 0xfffff805c8be5000 #11 0xffffffff8245a777 in dmu_spill_hold_by_dnode (dn=0xfffff805c8be5000, flags=6, tag=0x0, dbp=0xfffff802f48dfa28) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:333 db = (dmu_buf_impl_t *) 0xfffff803b1e8de00 err = -512 #12 0xffffffff8245a91b in dmu_spill_hold_existing (bonus=0xfffff80052609620, tag=0x0, dbp=0xfffff802f48dfa28) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:359 db = (dmu_buf_impl_t *) 0xfffff80052609620 dn = (dnode_t *) 0xfffff805c8be5000 err = 1 #13 0xffffffff824b140c in sa_get_spill (hdl=0xfffff802f48dfa00) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:310 rc = 0 #14 0xffffffff824b1658 in sa_modify_attrs (hdl=0xfffff802f48dfa00, newattr=19, action=SA_REPLACE, locator=0xffffffff82520d50 , datastart=0xfffffe0677ec05c8, buflen=152, tx=0xfffff8034ef07800) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1681 ---Type to continue, or q to quit--- sa = (sa_os_t *) 0xfffff80071e5da00 db = (dmu_buf_impl_t *) 0xfffff80052609620 dn = (dnode_t *) 0xfffff805c8be5000 attr_desc = (sa_bulk_attr_t *) 0xfffff803c1d2a000 old_data = {0xfffff80122383800, 0xfffff8034ef07800} bonus_attr_count = 14 bonus_data_size = 320 spill_data_size = 0 spill_attr_count = 0 error = -2045 length = 49618 i = 0 j = 0 k = 2 length_idx = 16691240 hdr = (sa_hdr_phys_t *) 0xfffff80052600200 idx_tab = (sa_idx_tab_t *) 0xffffffff825bb2ea attr_count = 0 count = -1367343104 #15 0xffffffff824b12fb in sa_attr_op (hdl=0xfffff802f48dfa00, bulk=0xfffffe0677ec04f0, count=5, data_op=SA_UPDATE, tx=0xfffff8034ef07800) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:392 sa = (sa_os_t *) 0xfffff80071e5da00 i = 3 error = 0 buftypes = SA_BONUS #16 0xffffffff824b5a04 in sa_bulk_update_impl (hdl=0xfffff802f48dfa00, bulk=0xfffffe0677ec04f0, count=5, tx=0xfffff8034ef07800) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1790 error = 1888 sa = (sa_os_t *) 0xfffff80071e5da00 bonustype = DMU_OT_SA #17 0xffffffff824b5ca5 in sa_bulk_update (hdl=0xfffff802f48dfa00, attrs=0xfffffe0677ec04f0, count=5, tx=0xfffff8034ef07800) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1889 error = 1 #18 0xffffffff82521b5f in zfs_aclset_common (zp=0xfffff803b27e85c0, aclp=0xfffff8001ebcfa00, cr=0xfffff804455e6e00, tx=0xfffff8034ef07800) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_acl.c:1329 error = -2045 zfsvfs = (zfsvfs_t *) 0xfffff80086ee2000 otype = DMU_OT_ACL locate = {cb_aclp = 0xfffff8001ebcfa00, cb_acl_node = 0x0} mode = 16893 bulk = {{sa_data = 0xfffffe0677ec05c0, sa_data_func = 0, sa_length = 8, sa_attr = 5, sa_addr = 0xfffff80052600208, sa_buftype = 1, sa_size = 8}, {sa_data = 0xfffff803b27e86c8, sa_data_func = 0, sa_length = 8, sa_attr = 11, sa_addr = 0xfffff80052600238, sa_buftype = 1, sa_size = 8}, {sa_data = 0xfffffe0677ec04e0, sa_data_func = 0, sa_length = 16, sa_attr = 2, sa_addr = 0xfffff80052600260, sa_buftype = 1, sa_size = 16}, {sa_data = 0xfffffe0677ec05c8, sa_data_func = 0xffffffff82520d50 , sa_length = 152, sa_attr = 19, sa_addr = 0xfffff80052600290, sa_buftype = 1, sa_size = 160}, {sa_data = 0xfffff8001ebcfa00, sa_data_func = 0, sa_length = 8, sa_attr = 16, sa_addr = 0xfffffe0008161250, sa_buftype = 0, sa_size = 48}} ctime = {1457872316, 787888506} count = 5 #19 0xffffffff82524391 in zfs_setacl (zp=0xfffff803b27e85c0, vsecp=0xfffffe0677ec0748, skipaclchk=0, cr=0xfffff804455e6e00) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_acl.c:2010 zfsvfs = (zfsvfs_t *) 0xfffff80086ee2000 zilog = (zilog_t *) 0xfffff80086ebd000 mask = 16 ---Type to continue, or q to quit--- tx = (dmu_tx_t *) 0xfffff8034ef07800 error = 0 aclp = (zfs_acl_t *) 0xfffff8001ebcfa00 fuidp = (zfs_fuid_info_t *) 0x0 fuid_dirtied = 0 acl_obj = 0 #20 0xffffffff8254e33d in zfs_setsecattr (vp=0xfffff8034dbfa000, vsecp=0xfffffe0677ec0748, flag=0, cr=0xfffff804455e6e00, ct=0x0) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:5332 zp = (znode_t *) 0xfffff803b27e85c0 zfsvfs = (zfsvfs_t *) 0xfffff80086ee2000 error = 2 skipaclchk = 0 zilog = (zilog_t *) 0xfffff80086ebd000 #21 0xffffffff8254ff5c in zfs_freebsd_setacl (ap=0xfffffe0677ec0808) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:7076 error = 0 vsecattr = {vsa_mask = 16, vsa_aclcnt = 11, vsa_aclentp = 0xfffff804bd725e00, vsa_dfaclcnt = 2011957208, vsa_dfaclentp = 0xfffffe0677ec07c0, vsa_aclentsz = 132, vsa_aclflags = 2} aclbsize = 132 aaclp = (aclent_t *) 0xfffff804bd725e00 #22 0xffffffff816db594 in VOP_SETACL_APV (vop=0xffffffff825de1a0, a=0xfffffe0677ec0808) at vnode_if.c:2993 mp__ = (struct mount *) 0xfffff80086df5cc0 _enable_stops = 0 rc = -1 #23 0xffffffff80f0ba5a in VOP_SETACL (vp=0xfffff8034dbfa000, type=4, aclp=0xfffff800612a1000, cred=0xfffff804455e6e00, td=0xfffff800713124a0) at vnode_if.h:1253 a = {a_gen = {a_desc = 0xffffffff81d77eb8}, a_vp = 0xfffff8034dbfa000, a_type = 4, a_aclp = 0xfffff800612a1000, a_cred = 0xfffff804455e6e00, a_td = 0xfffff800713124a0} #24 0xffffffff80f0aea1 in vacl_set_acl (td=0xfffff800713124a0, vp=0xfffff8034dbfa000, type=4, aclp=0x80100a000) at /usr/src/sys/kern/vfs_acl.c:232 inkernelacl = (struct acl *) 0xfffff800612a1000 mp = (struct mount *) 0xfffff80086df5cc0 error = 0 #25 0xffffffff80f0ad81 in sys___acl_set_file (td=0xfffff800713124a0, uap=0xfffffe0677ec0b98) at /usr/src/sys/kern/vfs_acl.c:375 nd = {ni_dirp = 0x7fffffffecd2
, ni_segflg = UIO_USERSPACE, ni_rightsneeded = {cr_rights = { 144115188075855872, 288230376151711744}}, ni_startdir = 0x0, ni_rootdir = 0xfffff800714cfb10, ni_topdir = 0x0, ni_dirfd = -100, ni_strictrelative = 0, ni_filecaps = {fc_rights = {cr_rights = {0, 0}}, fc_ioctls = 0x0, fc_nioctls = -1, fc_fcntls = 0}, ni_vp = 0xfffff8034dbfa000, ni_dvp = 0xfffff805c678d000, ni_pathlen = 1, ni_next = 0xfffff80086ddcc65 "", ni_loopcnt = 0, ni_cnd = {cn_nameiop = 0, cn_flags = 49216, cn_thread = 0xfffff800713124a0, cn_cred = 0xfffff804455e6e00, cn_lkflags = 2097152, cn_pnbuf = 0xfffff80086ddcc00 "/hdd/usr/wf/_σ-\202-\203ΔΙ-\217_-\223-\237/-\234-\236_-\236-\202-\200ΑΔΞΕΞ-\201ΛΟΕ -\223-\237/04--\223-\237-\234-\236_-\237-\230-02/07--\224-\200-\203ΗΟΕ", cn_nameptr = 0xfffff80086ddcc56 "07--\224-\200-\203ΗΟΕ", cn_namelen = 15, cn_consume = 0}} error = 0 #26 0xffffffff814e32f4 in syscallenter (td=0xfffff800713124a0, sa=0xfffffe0677ec0b88) at subr_syscall.c:134 p = (struct proc *) 0xfffff80071317000 error = 0 traced = 0 #27 0xffffffff814e2a8f in amd64_syscall (td=0xfffff800713124a0, traced=0) at /usr/src/sys/amd64/amd64/trap.c:952 sa = {code = 348, callp = 0xffffffff81d026d0, args = {140737488350418, 4, 34376556544, 2, 140737488345344, 34376515680, 0, 34376896576}, narg = 3} error = 0 ksi = {ksi_link = {tqe_next = 0x202, tqe_prev = 0x202}, ksi_info = {si_signo = 2011958080, si_errno = -506, si_code = -2125728811, si_pid = -1, si_uid = 4294960432, si_status = 32767, si_addr = 0x202, si_value = {sival_int = 1392864896, sival_ptr = 0xfffffe0653056e80, sigval_int = 1392864896, sigval_ptr = 0xfffffe0653056e80}, _reason = {_fault = {_trapno = 1392864896}, _timer = {_timerid = 1392864896, _overrun = -506}, _mesgq = {_mqd = 1392864896}, _poll = {_band = -2171860586880}, __spare__ = {__spare1__ = -2171860586880, __spare2__ = { ---Type to continue, or q to quit--- 1392864896, -506, 0, -2048, -723702400, -507, 1899046048}}}}, ksi_flags = 2011958160, ksi_sigq = 0xffffffff80e3028d} #28 0xffffffff814b9ddb in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 No locals. #29 0x000000080092a17a in ?? () No symbol table info available. Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb)q 16.02.2016, 12:10, "Steven Hartland" : > I need the values of the vars specified, so you'll need to: > print bp > If it reports just an address try: > print *bp > etc. > > On 16/02/2016 08:08, DemIS wrote: >> šframe 8 >> š#8 0xffffffff81c3669c in dbuf_read (db=0xfffff8013ca46380, zio=0x0, flags=6) >> ššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:573 >> š573 (void) arc_read(zio, db->db_objset->os_spa, db->db_blkptr, >> šCurrent language: auto; currently minimal >> >> šframe 6 >> š#6 0xffffffff81c2b9f8 in arc_get_data_buf (buf=) >> ššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:2898 >> š2898 buf->b_data = zio_buf_alloc(size); >> >> š16.02.2016, 04:15, "Steven Hartland" : >>> šYou don't need the system live just the kernel and the crash dump to get >>> šthose values. >>> >>> šOn 16/02/2016 00:46, DemIS wrote: >>>> šššToday I fell back to version 10.2 . Users work on the server . To reinstall 10.3 I need 4:00 . >>>> šššTherefore, it is possible only on weekends . But this has the same effect on the version 10.2 >>>> >>>> ššš16.02.2016, 02:55, "Steven Hartland" : >>>>> šššThat sounds like you have some pool data corruption, from the 10.3 >>>>> šššversion dump can you print out the following: >>>>> ššš1. frame 8: bp and size >>>>> ššš2. frame 6: buf->b_hdr >>>>> >>>>> šššOn 15/02/2016 23:26, DemIS wrote: >>>>>> šššššAny one knows about problem? >>>>>> šššššServer: SuperMicro Model:SYS-6026T-6RF+, MB:X8DTU-6F+, RAM 24ηΒ DDR3, two XEON >>>>>> šššššRAM: KVR1333D3E9S/4G - DDR3, 1333MHz, ECC, CL9, X8, 1.5V, Unbuffered, DIMM >>>>>> šššššVersion:uname -a >>>>>> >>>>>> šššššFreeBSD teo.some.loc 10.2-RELEASE-p12 FreeBSD 10.2-RELEASE-p12 #0: Sat Feb 13 18:04:04 MSK 2016 demis@teo.some.loc:/usr/obj/usr/src/sys/TEO amd64 >>>>>> ššššš(on GENERIC or custom kernel config persist too !!!) >>>>>> >>>>>> šššššMemtest86+ v.4.40 (ECC mode) test - OK. >>>>>> šššššEvery disk checked too (physically - mhdd, logically - zpool scrub, and additional checkit in external company recovery disk). No errors. >>>>>> >>>>>> šššššPart of df -H >>>>>> šššššFilesystem Size Used Avail Capacity Mounted on >>>>>> šššššhdd/usr/wf 6,6T 4,1T 2,5T 62% /hdd/usr/wf >>>>>> >>>>>> šššššzpool status hdd >>>>>> ššššššššpool: hdd >>>>>> šššššššstate: ONLINE >>>>>> šššššstatus: Some supported features are not enabled on the pool. The pool can >>>>>> ššššššššstill be used, but some features are unavailable. >>>>>> šššššaction: Enable all features using 'zpool upgrade'. Once this is done, >>>>>> ššššššššthe pool may no longer be accessible by software that does not support >>>>>> ššššššššthe features. See zpool-features(7) for details. >>>>>> ššššššššscan: scrub repaired 0 in 14h57m with 0 errors on Thu Feb 11 03:35:43 2016 >>>>>> šššššconfig: >>>>>> >>>>>> ššššššššNAME STATE READ WRITE CKSUM >>>>>> ššššššššhdd ONLINE 0 0 0 >>>>>> ššššššššraidz2-0 ONLINE 0 0 0 >>>>>> ššššššššmfid1p1 ONLINE 0 0 0 >>>>>> ššššššššmfid2p1 ONLINE 0 0 0 >>>>>> ššššššššmfid3p1 ONLINE 0 0 0 >>>>>> ššššššššmfid4p1 ONLINE 0 0 0 >>>>>> ššššššššmfid5p1 ONLINE 0 0 0 >>>>>> >>>>>> šššššerrors: No known data errors >>>>>> >>>>>> šššššhdd - is My zfs volume. >>>>>> šššššWhen I run command like: >>>>>> šššššrm /hdd/usr/some/path/to/file >>>>>> šššššššor >>>>>> šššššrm /hdd/usr/some/path/to/folder >>>>>> šššššššor >>>>>> šššššchown root:wheel /hdd/usr/some/path/to/file >>>>>> šššššššor >>>>>> šššššchown root:wheel /hdd/usr/some/path/to/folder >>>>>> šššššššor >>>>>> šššššsetfacl ... to /hdd/usr/some/path/to/file >>>>>> >>>>>> šššššššI'm get kernel panic: >>>>>> šššššGNU gdb 6.1.1 [FreeBSD] >>>>>> šššššCopyright 2004 Free Software Foundation, Inc. >>>>>> šššššGDB is free software, covered by the GNU General Public License, and you are >>>>>> šššššwelcome to change it and/or distribute copies of it under certain conditions. >>>>>> šššššType "show copying" to see the conditions. >>>>>> šššššThere is absolutely no warranty for GDB. Type "show warranty" for details. >>>>>> šššššThis GDB was configured as "amd64-marcel-freebsd"... >>>>>> >>>>>> šššššUnread portion of the kernel message buffer: >>>>>> šššššpanic: solaris assert: c < (1ULL << 24) >> 9 (0x7fffffffffffff < 0x8000), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c, line: 270 >>>>>> šššššcpuid = 9 >>>>>> šššššKDB: stack backtrace: >>>>>> ššššš#0 0xffffffff80984ef0 at kdb_backtrace+0x60 >>>>>> ššššš#1 0xffffffff80948aa6 at vpanic+0x126 >>>>>> ššššš#2 0xffffffff80948973 at panic+0x43 >>>>>> ššššš#3 0xffffffff81c0222f at assfail3+0x2f >>>>>> ššššš#4 0xffffffff81aa9d40 at zio_buf_alloc+0x50 >>>>>> ššššš#5 0xffffffff81a2b9f8 at arc_get_data_buf+0x358 >>>>>> ššššš#6 0xffffffff81a2e20a at arc_read+0x1ea >>>>>> ššššš#7 0xffffffff81a3669c at dbuf_read+0x6ac >>>>>> ššššš#8 0xffffffff81a3d8bf at dmu_spill_hold_existing+0xbf >>>>>> ššššš#9 0xffffffff81a70dd7 at sa_attr_op+0x167 >>>>>> ššššš#10 0xffffffff81a72ffb at sa_lookup+0x4b >>>>>> ššššš#11 0xffffffff81abc82a at zfs_rmnode+0x2ba >>>>>> ššššš#12 0xffffffff81ada58e at zfs_freebsd_reclaim+0x4e >>>>>> ššššš#13 0xffffffff80e73537 at VOP_RECLAIM_APV+0xa7 >>>>>> ššššš#14 0xffffffff809ec5b4 at vgonel+0x1b4 >>>>>> ššššš#15 0xffffffff809eca49 at vrecycle+0x59 >>>>>> ššššš#16 0xffffffff81ada52d at zfs_freebsd_inactive+0xd >>>>>> ššššš#17 0xffffffff80e73427 at VOP_INACTIVE_APV+0xa7 >>>>>> šššššUptime: 9m31s >>>>>> šššššDumping 1286 out of 24543 MB:..2%..12%..22%..32%..42%..51%..61%..71% (CTRL-C to abort) ..81%..91% >>>>>> >>>>>> šššššReading symbols from /boot/kernel/zfs.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/zfs.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/opensolaris.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/opensolaris.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/if_lagg.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/if_lagg.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/ums.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/ums.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/ipfw.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/ipfw.ko.symbols >>>>>> ššššš#0 doadump (textdump=) at pcpu.h:219 >>>>>> ššššš219 pcpu.h: No such file or directory. >>>>>> ššššššššin pcpu.h >>>>>> ššššš(kgdb) bt >>>>>> ššššš#0 doadump (textdump=) at pcpu.h:219 >>>>>> ššššš#1 0xffffffff80948702 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:451 >>>>>> ššššš#2 0xffffffff80948ae5 in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:758 >>>>>> ššššš#3 0xffffffff80948973 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:687 >>>>>> ššššš#4 0xffffffff81c0222f in assfail3 (a=, lv=, op=, rv=, >>>>>> ššššššššf=, l=) at /usr/src/sys/modules/opensolaris/../../cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:91 >>>>>> ššššš#5 0xffffffff81aa9d40 in zio_buf_alloc (size=0) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:270 >>>>>> ššššš#6 0xffffffff81a2b9f8 in arc_get_data_buf (buf=) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:2898 >>>>>> ššššš#7 0xffffffff81a2e20a in arc_read (pio=0xfffff80011791730, spa=0xfffff80011579000, bp=0xfffffe000aee7980, done=0xffffffff81a3a2d0 , >>>>>> ššššššššprivate=0xfffff8002244b000, priority=ZIO_PRIORITY_SYNC_READ, zio_flags=-528866606, arc_flags=0xfffffe06727fb3c4, zb=0xffffffff81a3a2d0) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:1551 >>>>>> ššššš#8 0xffffffff81a3669c in dbuf_read (db=0xfffff8002244b000, zio=0x0, flags=6) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:573 >>>>>> ššššš#9 0xffffffff81a3d8bf in dmu_spill_hold_existing (bonus=0xfffff800223bed20, tag=0x0, dbp=0xfffff800919966b8) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:333 >>>>>> ššššš#10 0xffffffff81a70dd7 in sa_attr_op (hdl=0xfffff80091996690, bulk=0xfffffe06727fb528, count=1, data_op=SA_LOOKUP, tx=0x0) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:310 >>>>>> ššššš#11 0xffffffff81a72ffb in sa_lookup (hdl=0xfffff80091996690, attr=, buf=, buflen=) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1441 >>>>>> ššššš#12 0xffffffff81abc82a in zfs_rmnode (zp=0xfffff80091993730) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:633 >>>>>> ššššš#13 0xffffffff81ada58e in zfs_freebsd_reclaim (ap=) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:6569 >>>>>> ššššš#14 0xffffffff80e73537 in VOP_RECLAIM_APV (vop=, a=) at vnode_if.c:2019 >>>>>> ššššš#15 0xffffffff809ec5b4 in vgonel (vp=0xfffff800111733b0) at vnode_if.h:830 >>>>>> ššššš#16 0xffffffff809eca49 in vrecycle (vp=0xfffff800111733b0) at /usr/src/sys/kern/vfs_subr.c:2703 >>>>>> ššššš#17 0xffffffff81ada52d in zfs_freebsd_inactive (ap=) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:6540 >>>>>> ššššš#18 0xffffffff80e73427 in VOP_INACTIVE_APV (vop=, a=) at vnode_if.c:1953 >>>>>> ššššš#19 0xffffffff809eb382 in vinactive (vp=0xfffff800111733b0, td=0xfffff800113d8000) at vnode_if.h:807 >>>>>> ššššš#20 0xffffffff809eb772 in vputx (vp=0xfffff800111733b0, func=2) at /usr/src/sys/kern/vfs_subr.c:2306 >>>>>> ššššš#21 0xffffffff809f401e in kern_rmdirat (td=, fd=, path=, pathseg=) >>>>>> ššššššššat /usr/src/sys/kern/vfs_syscalls.c:3842 >>>>>> ššššš#22 0xffffffff80d4b3e7 in amd64_syscall (td=0xfffff800113d8000, traced=0) at subr_syscall.c:134 >>>>>> ššššš#23 0xffffffff80d30acb in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 >>>>>> ššššš#24 0x00000008008914ea in ?? () >>>>>> šššššPrevious frame inner to this frame (corrupt stack?) >>>>>> šššššCurrent language: auto; currently minimal >>>>>> >>>>>> šššššIf setup FreeBSD 10.3 BETA (on GENERIC or custom kernel config): >>>>>> šššššCopyright 2004 Free Software Foundation, Inc. >>>>>> šššššGDB is free software, covered by the GNU General Public License, and you are >>>>>> šššššwelcome to change it and/or distribute copies of it under certain conditions. >>>>>> šššššType "show copying" to see the conditions. >>>>>> šššššThere is absolutely no warranty for GDB. Type "show warranty" for details. >>>>>> šššššThis GDB was configured as "amd64-marcel-freebsd"... >>>>>> >>>>>> šššššUnread portion of the kernel message buffer: >>>>>> šššššpanic: solaris assert: c < (1ULL << 24) >> 9 (0x7fffffffffffff < 0x8000), file: /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c, line: 273 >>>>>> šššššcpuid = 13 >>>>>> šššššKDB: stack backtrace: >>>>>> ššššš#0 0xffffffff8098f000 at kdb_backtrace+0x60 >>>>>> ššššš#1 0xffffffff80951d06 at vpanic+0x126 >>>>>> ššššš#2 0xffffffff80951bd3 at panic+0x43 >>>>>> ššššš#3 0xffffffff81e0022f at assfail3+0x2f >>>>>> ššššš#4 0xffffffff81cacc70 at zio_buf_alloc+0x50 >>>>>> ššššš#5 0xffffffff81c2b8f2 at arc_get_data_buf+0x262 >>>>>> ššššš#6 0xffffffff81c2b657 at arc_buf_alloc+0xc7 >>>>>> ššššš#7 0xffffffff81c2d601 at arc_read+0x1c1 >>>>>> ššššš#8 0xffffffff81c36ce9 at dbuf_read+0x6b9 >>>>>> ššššš#9 0xffffffff81c3e415 at dmu_spill_hold_existing+0xc5 >>>>>> ššššš#10 0xffffffff81c73707 at sa_attr_op+0x167 >>>>>> ššššš#11 0xffffffff81c75972 at sa_lookup+0x52 >>>>>> ššššš#12 0xffffffff81cbf8da at zfs_rmnode+0x2ba >>>>>> ššššš#13 0xffffffff81cdd75e at zfs_freebsd_reclaim+0x4e >>>>>> ššššš#14 0xffffffff80e81c27 at VOP_RECLAIM_APV+0xa7 >>>>>> ššššš#15 0xffffffff809f9581 at vgonel+0x221 >>>>>> ššššš#16 0xffffffff809f9a19 at vrecycle+0x59 >>>>>> ššššš#17 0xffffffff81cdd6fd at zfs_freebsd_inactive+0xd >>>>>> šššššUptime: 11m11s >>>>>> šššššDumping 1368 out of 24542 MB:..2%..11%..22%..31%..41%..51%..61%..71%..81%..91% >>>>>> >>>>>> šššššReading symbols from /boot/kernel/if_lagg.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/if_lagg.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/aio.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/aio.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/ichsmb.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/ichsmb.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/smbus.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/smbus.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/ipmi.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/ipmi.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/zfs.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/zfs.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/opensolaris.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/opensolaris.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/ums.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/ums.ko.symbols >>>>>> šššššReading symbols from /boot/kernel/ipfw.ko.symbols...done. >>>>>> šššššLoaded symbols for /boot/kernel/ipfw.ko.symbols >>>>>> ššššš#0 doadump (textdump=) at pcpu.h:219 >>>>>> ššššš219 pcpu.h: No such file or directory. >>>>>> ššššššššin pcpu.h >>>>>> ššššš(kgdb) backtrace >>>>>> ššššš#0 doadump (textdump=) at pcpu.h:219 >>>>>> ššššš#1 0xffffffff80951962 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:486 >>>>>> ššššš#2 0xffffffff80951d45 in vpanic (fmt=, ap=) at /usr/src/sys/kern/kern_shutdown.c:889 >>>>>> ššššš#3 0xffffffff80951bd3 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:818 >>>>>> ššššš#4 0xffffffff81e0022f in assfail3 (a=, lv=, op=, rv=, f=, >>>>>> ššššššššl=) at /usr/src/sys/modules/opensolaris/../../cddl/compat/opensolaris/kern/opensolaris_cmn_err.c:91 >>>>>> ššššš#5 0xffffffff81cacc70 in zio_buf_alloc (size=0) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zio.c:273 >>>>>> ššššš#6 0xffffffff81c2b8f2 in arc_get_data_buf (buf=) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:3880 >>>>>> ššššš#7 0xffffffff81c2b657 in arc_buf_alloc (spa=, size=, tag=0x0, type=) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:2057 >>>>>> ššššš#8 0xffffffff81c2d601 in arc_read (pio=0xfffff8000fad03b0, spa=0xfffff8000f63d000, bp=0xfffffe000e509980, done=0xffffffff81c3aed0 , private=0xfffff8000fdd6360, >>>>>> ššššššššpriority=ZIO_PRIORITY_SYNC_READ, zio_flags=-2117882160, arc_flags=0xfffffe02925483c4, zb=0xfffff8000fdd6360) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c:4397 >>>>>> ššššš#9 0xffffffff81c36ce9 in dbuf_read (db=0xfffff8000fdd6360, zio=0x0, flags=) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dbuf.c:682 >>>>>> ššššš#10 0xffffffff81c3e415 in dmu_spill_hold_existing (bonus=0xfffff8001f312438, tag=0x0, dbp=0xfffff80062d4e7d0) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/dmu.c:333 >>>>>> ššššš#11 0xffffffff81c73707 in sa_attr_op (hdl=0xfffff80062d4e770, bulk=0xfffffe0292548528, count=1, data_op=SA_LOOKUP, tx=0x0) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:305 >>>>>> ššššš#12 0xffffffff81c75972 in sa_lookup (hdl=0xfffff80062d4e770, attr=, buf=, buflen=) >>>>>> ššššššššat /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/sa.c:1443 >>>>>> ššššš#13 0xffffffff81cbf8da in zfs_rmnode (zp=0xfffff80062d4c8a0) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_dir.c:633 >>>>>> ššššš#14 0xffffffff81cdd75e in zfs_freebsd_reclaim (ap=) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:6619 >>>>>> ššššš#15 0xffffffff80e81c27 in VOP_RECLAIM_APV (vop=, a=) at vnode_if.c:2019 >>>>>> ššššš#16 0xffffffff809f9581 in vgonel (vp=0xfffff8000f1beb10) at vnode_if.h:830 >>>>>> ššššš#17 0xffffffff809f9a19 in vrecycle (vp=0xfffff8000f1beb10) at /usr/src/sys/kern/vfs_subr.c:2951 >>>>>> ššššš#18 0xffffffff81cdd6fd in zfs_freebsd_inactive (ap=) at /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vnops.c:6590 >>>>>> ššššš#19 0xffffffff80e81b17 in VOP_INACTIVE_APV (vop=, a=) at vnode_if.c:1953 >>>>>> ššššš#20 0xffffffff809f8322 in vinactive (vp=0xfffff8000f1beb10, td=0xfffff8000f9f34b0) at vnode_if.h:807 >>>>>> ššššš#21 0xffffffff809f8712 in vputx (vp=0xfffff8000f1beb10, func=2) at /usr/src/sys/kern/vfs_subr.c:2547 >>>>>> ššššš#22 0xffffffff80a0137e in kern_rmdirat (td=, fd=, path=, pathseg=) >>>>>> ššššššššat /usr/src/sys/kern/vfs_syscalls.c:3964 >>>>>> ššššš#23 0xffffffff80d574bf in amd64_syscall (td=0xfffff8000f9f34b0, traced=0) at subr_syscall.c:141 >>>>>> ššššš#24 0xffffffff80d3c72b in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:396 >>>>>> ššššš#25 0x000000080089458a in ?? () >>>>>> šššššPrevious frame inner to this frame (corrupt stack?) >>>>>> šššššCurrent language: auto; currently minimal >>>>>> >>>>>> šššššCrash folder (or file) have strange rights: >>>>>> šššššd---------+ 3 anna domain users 3 10 ΔΕΛ 10:32 01-Projcts >>>>>> šššššd---------+ 2 anna domain users 2 8 ΖΕΧ 21:46 02-Text >>>>>> >>>>>> šššššHow correct kernel panic? >>>>>> >>>>>> ššššš_______________________________________________ >>>>>> šššššfreebsd-fs@freebsd.org mailing list >>>>>> šššššhttps://lists.freebsd.org/mailman/listinfo/freebsd-fs >>>>>> šššššTo unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >>>>> ššš_______________________________________________ >>>>> šššfreebsd-fs@freebsd.org mailing list >>>>> šššhttps://lists.freebsd.org/mailman/listinfo/freebsd-fs >>>>> šššTo unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"