Date: Wed, 24 Feb 2016 14:26:19 +1000 From: Paul Koch <paul.koch@akips.com> To: stable@freebsd.org Subject: 10.2 - Process stuck in unkillable sleep Message-ID: <20160224142619.6710b6c1@akips.com>
next in thread | raw e-mail | index | archive | help
Occasionally we see a process get stuck in an unkillable state and the only solution is a hard reboot. Occasionally =3D=3D once every two weeks across 60+ servers, which are spre= ad across the globe in customer sites. We have no remote access to these boxe= s. The process that most often that gets stuck, but not limited to, is a large scale Ping/SNMP poller. It is a fairly simplistic C program that just fires out lots of ping (raw ICMP socket) and SNMP (UDP socket) requests asynchronously. We've managed to trap the problem a few times on a test server running in VirtualBox, but it also occurs on customer sites who run VMware, Hyper-V, QEMU and on bare metal. We raise this PR https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D204081 but suspect it is a similar/same issue as https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D200992 This is the info we've gathered from the most recent time it has occurred: # uname -a FreeBSD shed153.akips.com 10.2-RELEASE-p12 FreeBSD 10.2-RELEASE-p12 #0 r295= 070: Sat Jan 30 20:03:44 UTC 2016 root@shed21.akips.com:/usr/obj/usr/src/sys/GE= NERIC amd64 The nm-poller has no state in top for some reason ?? last pid: 1847; load averages: 0.62, 1.20, 1.33 up 13+16:06:04 13:= 36:46 103 processes: 1 running, 102 sleeping CPU: 1.0% user, 0.0% nice, 4.3% system, 0.0% interrupt, 94.7% idle Mem: 650M Active, 541M Inact, 2527M Wired, 16M Cache, 417M Buf, 217M Free ARC: 2087M Total, 102M MFU, 1968M MRU, 18K Anon, 9409K Header, 9088K Other Swap: 4096M Total, 256M Used, 3840M Free, 6% Inuse PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMA= ND 1013 akips 1 20 0 74076K 5544K select 1 195:41 0.59% nm-ht= tpd 1003 akips 1 20 0 164M 54328K select 0 236:18 0.49% nm-fl= ow-collector 888 root 1 20 0 101M 14920K select 0 163:56 0.39% nm-jo= atd 885 akips 1 20 0 74004K 3092K nanslp 1 116:52 0.29% nm-ti= med 1014 akips 1 4 0 851M 104M 0 18.0H 0.00% nm-po= ller 1086 akips 1 20 0 21940K 2680K nanslp 0 66:25 0.00% top 1015 akips 1 20 0 819M 256M nanslp 1 56:45 0.00% nm-po= ller-db 1023 akips 1 20 0 114M 44760K select 0 55:00 0.00% nm-fl= ow-meter 1005 akips 1 20 0 159M 4172K select 0 51:00 0.00% nm-ms= gd 1025 akips 1 20 0 114M 45644K select 0 44:22 0.00% nm-fl= ow-meter 1012 akips 1 20 0 60360K 5132K piperd 1 20:08 0.00% perl 1027 akips 1 20 0 110M 34564K select 1 18:58 0.00% nm-fl= ow-meter 997 akips 1 20 0 819M 27600K select 0 12:59 0.00% nm-sn= mp-trapd 991 akips 1 20 0 78104K 5384K select 1 10:53 0.00% nm-fi= fo-tee 989 akips 1 20 0 78104K 5764K select 1 10:34 0.00% nm-fi= fo-tee 990 akips 1 20 0 78104K 5496K select 0 10:31 0.00% nm-fi= fo-tee 1047 akips 1 20 0 102M 29108K select 0 10:25 0.00% nm-fl= ow-meter 1111 akips 1 20 0 102M 36000K select 0 9:18 0.00% nm-fl= ow-meter 1231 akips 1 20 0 102M 35952K select 1 9:17 0.00% nm-fl= ow-meter 1239 akips 1 20 0 102M 33132K select 0 8:51 0.00% nm-fl= ow-meter 1240 akips 1 20 0 102M 33132K select 1 8:51 0.00% nm-fl= ow-meter 1002 akips 1 20 0 74016K 3480K select 1 8:50 0.00% nm-sy= slogd 1234 akips 1 20 0 102M 35920K select 1 8:49 0.00% nm-fl= ow-meter 1243 akips 1 20 0 102M 33148K select 0 8:46 0.00% nm-fl= ow-meter 1039 akips 1 20 0 820M 31388K select 0 8:46 0.00% nm-db 1233 akips 1 20 0 102M 31256K select 0 8:43 0.00% nm-fl= ow-meter 1237 akips 1 20 0 102M 33168K select 0 8:43 0.00% nm-fl= ow-meter 1235 akips 1 20 0 102M 29040K select 1 8:41 0.00% nm-fl= ow-meter 1259 akips 1 20 0 102M 29096K select 0 8:40 0.00% nm-fl= ow-meter 1255 akips 1 20 0 102M 31756K select 1 8:40 0.00% nm-fl= ow-meter 1232 akips 1 20 0 102M 31780K select 1 8:39 0.00% nm-fl= ow-meter 1041 akips 1 20 0 820M 45284K select 0 8:34 0.00% nm-db 1044 akips 1 20 0 820M 26172K select 1 8:28 0.00% nm-db 1060 akips 1 20 0 74008K 3380K select 1 8:22 0.00% nm-sy= slog 1077 akips 1 20 0 820M 26076K select 1 8:22 0.00% nm-db 1048 akips 1 20 0 820M 26076K select 1 8:16 0.00% nm-db 1045 akips 1 20 0 820M 27056K select 1 8:16 0.00% nm-db 1046 akips 1 20 0 820M 26156K select 1 8:16 0.00% nm-db 22541 akips 1 20 0 820M 26092K select 1 8:16 0.00% nm-db 1049 root 1 20 0 820M 26076K select 0 8:15 0.00% nm-db 1043 akips 1 20 0 820M 26076K select 0 8:15 0.00% nm-db 1006 akips 1 20 0 74004K 3364K nanslp 1 8:04 0.00% nm-ti= med-watcher 62906 akips 1 20 0 102M 33488K select 0 7:50 0.00% nm-fl= ow-meter 89368 akips 1 20 0 96556K 28228K select 0 5:57 0.00% nm-fl= ow-meter 9528 akips 1 20 0 96556K 27828K select 1 5:35 0.00% nm-fl= ow-meter 56009 akips 1 20 0 96556K 26120K select 0 5:03 0.00% nm-fl= ow-meter 985 akips 1 20 0 68684K 5248K nanslp 1 3:52 0.00% perl 986 akips 1 20 0 50112K 5596K nanslp 1 3:04 0.00% perl 22909 akips 1 20 0 88364K 19352K select 0 2:34 0.00% nm-fl= ow-meter 993 akips 1 20 0 68684K 5036K nanslp 0 2:10 0.00% perl 55564 akips 1 20 0 88364K 17916K select 0 2:05 0.00% nm-fl= ow-meter 995 akips 1 20 0 68684K 4904K nanslp 0 2:04 0.00% perl 561 root 1 20 0 21880K 13788K select 0 1:24 0.00% ntpd 994 akips 1 20 0 68684K 4552K piperd 1 0:24 0.00% perl 999 akips 1 20 0 68684K 7888K piperd 1 0:10 0.00% perl 996 akips 1 20 0 68684K 7720K piperd 1 0:09 0.00% perl 648 root 1 20 0 30336K 840K kqread 1 0:08 0.00% master 90631 akips 1 20 0 80172K 12048K select 0 0:07 0.00% nm-fl= ow-meter 920 root 1 20 0 16612K 684K nanslp 1 0:05 0.00% cron 945 akips 1 20 0 21940K 3008K select 0 0:04 0.00% top 412 root 1 20 0 14512K 1644K select 1 0:03 0.00% syslo= gd 998 akips 1 20 0 68684K 4160K piperd 1 0:02 0.00% perl 98732 akips 1 20 0 820M 28780K select 1 0:02 0.00% nm-db 98844 akips 1 20 0 820M 28780K select 1 0:02 0.00% nm-db 650 postfix 1 20 0 30460K 796K kqread 1 0:01 0.00% qmgr 323 root 1 20 0 13624K 540K select 0 0:01 0.00% devd 368 root 1 20 0 14456K 1560K select 1 0:01 0.00% rtsold 1037 akips 1 20 0 86492K 6444K select 1 0:00 0.00% sshd 928 akips 1 20 0 86492K 6408K select 1 0:00 0.00% sshd 1058 akips 1 52 0 58304K 3688K piperd 0 0:00 0.00% perl 22538 akips 1 52 0 58304K 3688K piperd 0 0:00 0.00% perl 98843 akips 1 48 0 58304K 16864K piperd 1 0:00 0.00% perl 98731 akips 1 48 0 58304K 16864K piperd 0 0:00 0.00% perl 1570 root 1 20 0 35756K 12644K ttyin 1 0:00 0.00% vi 1506 akips 1 20 0 86492K 6552K select 1 0:00 0.00% sshd 1803 root 1 20 0 21940K 3132K CPU0 0 0:00 0.00% top 1096 root 1 20 0 17088K 2676K wait 1 0:00 0.00% sh 926 root 1 25 0 86492K 6352K select 0 0:00 0.00% sshd 1503 root 1 22 0 86492K 6552K select 0 0:00 0.00% sshd 1258 root 1 24 0 86492K 6452K select 0 0:00 0.00% sshd 1034 root 1 23 0 86492K 6456K select 0 0:00 0.00% sshd 1261 akips 1 20 0 86492K 6452K select 0 0:00 0.00% sshd 965 root 1 52 0 14508K 1680K ttyin 1 0:00 0.00% getty 1038 akips 1 20 0 17088K 0K wait 1 0:00 0.00% <sh> 1527 akips 1 26 0 47732K 2684K wait 0 0:00 0.00% su 1095 akips 1 21 0 47728K 0K wait 0 0:00 0.00% <su> 1278 akips 1 39 0 47728K 0K wait 1 0:00 0.00% <su> 929 akips 1 20 0 17088K 0K wait 1 0:00 0.00% <sh> 916 root 1 20 0 61224K 4300K select 0 0:00 0.00% sshd 1507 akips 1 37 0 17088K 2636K wait 1 0:00 0.00% sh 964 root 1 52 0 14508K 1680K ttyin 1 0:00 0.00% getty 1439 postfix 1 20 0 30404K 3848K kqread 1 0:00 0.00% pickup # ps auxww | grep nm-poller akips 1014 0.0 2.6 871820 106540 - Ds 10Feb16 1078:59.06 nm-poll= er # procstat -k 1014=20 PID TID COMM TDNAME KSTACK =20 1014 100365 nm-poller - mi_switch sleepq_timedwait_sig _cv_timedwa= it_sig_sbt seltdwait kern_select sys_select amd64_syscall Xfast_syscall=20 # ps axHS -o pid,lwp,paddr,tdaddr 1014 PID LWP PADDR TDADDR 1014 100365 fffff800bb819000 fffff800bb963940 (kgdb) set print pretty on (kgdb) p *(struct proc *)0xfffff800bb819000 $4 =3D { p_list =3D { le_next =3D 0xfffff800bb6829d0,=20 le_prev =3D 0xfffff800bb8199d0 },=20 p_threads =3D { tqh_first =3D 0xfffff800bb963940,=20 tqh_last =3D 0xfffff800bb963950 },=20 p_slock =3D { lock_object =3D { lo_name =3D 0xffffffff80fc8245 "process slock",=20 lo_flags =3D 720896,=20 lo_data =3D 0,=20 lo_witness =3D 0x0 },=20 mtx_lock =3D 4 },=20 p_ucred =3D 0xfffff800bb55f200,=20 p_fd =3D 0xfffff800bb840000,=20 p_fdtol =3D 0x0,=20 p_stats =3D 0xfffff800bb408600,=20 p_limit =3D 0xfffff8001339c900,=20 p_limco =3D { c_links =3D { le =3D { le_next =3D 0x0,=20 le_prev =3D 0x0 },=20 sle =3D { sle_next =3D 0x0 },=20 tqe =3D { tqe_next =3D 0x0,=20 tqe_prev =3D 0x0 } },=20 c_time =3D 0,=20 c_precision =3D 0,=20 c_arg =3D 0x0,=20 c_func =3D 0,=20 c_lock =3D 0xfffff800bb819100,=20 c_flags =3D 0,=20 c_iflags =3D 0,=20 c_cpu =3D 0 },=20 p_sigacts =3D 0xfffff800bba1b000,=20 p_flag =3D 268435712,=20 p_flag2 =3D 0,=20 p_state =3D PRS_NORMAL,=20 p_pid =3D 1014,=20 p_hash =3D { le_next =3D 0x0,=20 le_prev =3D 0xfffffe00006effb0 },=20 p_pglist =3D { le_next =3D 0x0,=20 le_prev =3D 0xfffff800bb2c6290 },=20 p_pptr =3D 0xfffff800029724e8,=20 p_sibling =3D { le_next =3D 0xfffff800bb458000,=20 le_prev =3D 0xfffff800bb819ab8 },=20 p_children =3D { lh_first =3D 0x0 },=20 p_mtx =3D { lock_object =3D { lo_name =3D 0xffffffff80fc8238 "process lock",=20 lo_flags =3D 21168128,=20 lo_data =3D 0,=20 lo_witness =3D 0x0 },=20 mtx_lock =3D 4 },=20 p_ksi =3D 0xfffff800133020e0,=20 p_sigqueue =3D { sq_signals =3D { __bits =3D {0, 0, 0, 0} },=20 sq_kill =3D { __bits =3D {0, 0, 0, 0} },=20 sq_list =3D { tqh_first =3D 0x0,=20 tqh_last =3D 0xfffff800bb819148 },=20 sq_proc =3D 0xfffff800bb819000,=20 sq_flags =3D 1 },=20 p_oppid =3D 0,=20 p_vmspace =3D 0xfffff800bb9668c0,=20 p_swtick =3D 24753,=20 p_realtimer =3D { it_interval =3D { tv_sec =3D 0,=20 tv_usec =3D 0 },=20 it_value =3D { tv_sec =3D 0,=20 tv_usec =3D 0 } },=20 p_ru =3D { ru_utime =3D { tv_sec =3D 0,=20 tv_usec =3D 0 },=20 ru_stime =3D { tv_sec =3D 0,=20 tv_usec =3D 0 },=20 ru_maxrss =3D 0,=20 ru_ixrss =3D 0,=20 ru_idrss =3D 0,=20 ru_isrss =3D 0,=20 ru_minflt =3D 0,=20 ru_majflt =3D 0,=20 ru_nswap =3D 0,=20 ru_inblock =3D 0,=20 ru_oublock =3D 0,=20 ru_msgsnd =3D 0,=20 ru_msgrcv =3D 0,=20 ru_nsignals =3D 0,=20 ru_nvcsw =3D 0,=20 ru_nivcsw =3D 0 },=20 p_rux =3D { rux_runtime =3D 109968287043644,=20 rux_uticks =3D 1450275,=20 rux_sticks =3D 6625562,=20 rux_iticks =3D 0,=20 rux_uu =3D 11625969653,=20 rux_su =3D 53113087346,=20 rux_tu =3D 64739057000 },=20 p_crux =3D { rux_runtime =3D 0,=20 rux_uticks =3D 0,=20 rux_sticks =3D 0,=20 rux_iticks =3D 0,=20 rux_uu =3D 0,=20 rux_su =3D 0,=20 rux_tu =3D 0 },=20 p_profthreads =3D 0,=20 p_exitthreads =3D 0,=20 p_traceflag =3D 0,=20 p_tracevp =3D 0x0,=20 p_tracecred =3D 0x0,=20 p_textvp =3D 0xfffff800bb42b3b0,=20 p_lock =3D 0,=20 p_sigiolst =3D { slh_first =3D 0x0 },=20 p_sigparent =3D 20,=20 p_sig =3D 0,=20 p_code =3D 0,=20 p_stops =3D 0,=20 p_stype =3D 0,=20 p_step =3D 0 '\0',=20 p_pfsflags =3D 0 '\0',=20 p_nlminfo =3D 0x0,=20 p_aioinfo =3D 0x0,=20 p_singlethread =3D 0x0,=20 p_suspcount =3D 0,=20 p_xthread =3D 0x0,=20 p_boundary_count =3D 0,=20 p_pendingcnt =3D 0,=20 p_itimers =3D 0x0,=20 p_procdesc =3D 0x0,=20 p_magic =3D 3203398350,=20 p_osrel =3D 1002000,=20 p_comm =3D "nm-poller\000\000\000\000\000\000\000\000\000\000",=20 p_pgrp =3D 0xfffff800bb2c6280,=20 p_sysent =3D 0xffffffff814d4388,=20 p_args =3D 0xfffff800133796c0,=20 p_cpulimit =3D 9223372036854775807,=20 p_nice =3D 0 '\0',=20 p_fibnum =3D 0,=20 p_xstat =3D 0,=20 p_klist =3D { kl_list =3D { slh_first =3D 0x0 },=20 kl_lock =3D 0xffffffff80907dc0 <knlist_mtx_lock>,=20 kl_unlock =3D 0xffffffff80907e00 <knlist_mtx_unlock>,=20 kl_assert_locked =3D 0xffffffff80907e40 <knlist_mtx_assert_locked>,=20 kl_assert_unlocked =3D 0xffffffff80907e50 <knlist_mtx_assert_unlocked>,= =20 kl_lockarg =3D 0xfffff800bb819100 },=20 p_numthreads =3D 1,=20 p_md =3D { md_ldt =3D 0x0,=20 md_ldt_sd =3D { sd_lolimit =3D 0,=20 sd_lobase =3D 0,=20 sd_type =3D 0,=20 sd_dpl =3D 0,=20 sd_p =3D 0,=20 sd_hilimit =3D 0,=20 sd_xx0 =3D 0,=20 sd_gran =3D 0,=20 sd_hibase =3D 0,=20 sd_xx1 =3D 0,=20 sd_mbz =3D 0,=20 sd_xx2 =3D 0 } },=20 p_itcallout =3D { c_links =3D { le =3D { le_next =3D 0x0,=20 le_prev =3D 0x0 },=20 sle =3D { sle_next =3D 0x0 },=20 tqe =3D { tqe_next =3D 0x0,=20 tqe_prev =3D 0x0 } },=20 c_time =3D 0,=20 c_precision =3D 0,=20 c_arg =3D 0x0,=20 c_func =3D 0,=20 c_lock =3D 0xfffff800bb819100,=20 c_flags =3D 0,=20 c_iflags =3D 0,=20 c_cpu =3D 0 },=20 p_acflag =3D 1,=20 p_peers =3D 0x0,=20 p_leader =3D 0xfffff800bb819000,=20 p_emuldata =3D 0x0,=20 p_label =3D 0x0,=20 p_sched =3D 0xfffff800bb8194e8,=20 p_ktr =3D { stqh_first =3D 0x0,=20 stqh_last =3D 0xfffff800bb819448 },=20 p_mqnotifier =3D { lh_first =3D 0x0 },=20 p_dtrace =3D 0xfffff800bb502a40,=20 p_pwait =3D { cv_description =3D 0xffffffff80fc8c39 "ppwait",=20 cv_waiters =3D 0 },=20 p_dbgwait =3D { cv_description =3D 0xffffffff80fc8c40 "dbgwait",=20 cv_waiters =3D 0 },=20 p_prev_runtime =3D 0,=20 p_racct =3D 0x0,=20 p_throttled =3D 0 '\0',=20 p_orphan =3D { le_next =3D 0x0,=20 le_prev =3D 0x0 },=20 p_orphans =3D { lh_first =3D 0x0 },=20 p_treeflag =3D 0,=20 p_reaper =3D 0xfffff800029724e8,=20 p_reaplist =3D { lh_first =3D 0x0 },=20 p_reapsibling =3D { le_next =3D 0xfffff800bb6829d0,=20 le_prev =3D 0xfffff800bb819ea0 },=20 p_reapsubtree =3D 16 } (kgdb) p *(struct thread *)0xfffff800bb963940 $6 =3D { td_lock =3D 0xffffffff815cb380,=20 td_proc =3D 0xfffff800bb819000,=20 td_plist =3D { tqe_next =3D 0x0,=20 tqe_prev =3D 0xfffff800bb819010 },=20 td_runq =3D { tqe_next =3D 0x0,=20 tqe_prev =3D 0xffffffff815cb5c8 },=20 td_slpq =3D { tqe_next =3D 0x0,=20 tqe_prev =3D 0xfffff800027d0a00 },=20 td_lockq =3D { tqe_next =3D 0x0,=20 tqe_prev =3D 0xfffffe0122ba3428 },=20 td_hash =3D { le_next =3D 0x0,=20 le_prev =3D 0xfffffe0000866068 },=20 td_cpuset =3D 0xfffff8000296c3a8,=20 td_sel =3D 0xfffff80013530f00,=20 td_sleepqueue =3D 0xfffff800027d0a00,=20 td_turnstile =3D 0xfffff800bbbbdc00,=20 td_rlqe =3D 0xfffff800134bad20,=20 td_umtxq =3D 0xfffff800bb2c6480,=20 td_tid =3D 100365,=20 td_sigqueue =3D { sq_signals =3D { __bits =3D {0, 0, 0, 0} },=20 sq_kill =3D { __bits =3D {0, 0, 0, 0} },=20 sq_list =3D { tqh_first =3D 0x0,=20 tqh_last =3D 0xfffff800bb9639f8 },=20 sq_proc =3D 0xfffff800bb819000,=20 sq_flags =3D 1 },=20 td_lend_user_pri =3D 255 '=C3=BF',=20 td_flags =3D 20,=20 td_inhibitors =3D 2,=20 td_pflags =3D 0,=20 td_dupfd =3D 0,=20 td_sqqueue =3D 0,=20 td_wchan =3D 0x0,=20 td_wmesg =3D 0x0,=20 td_lastcpu =3D 0 '\0',=20 td_oncpu =3D 255 '=C3=BF',=20 td_owepreempt =3D 0 '\0',=20 td_tsqueue =3D 0 '\0',=20 td_locks =3D 29149,=20 td_rw_rlocks =3D 0,=20 td_lk_slocks =3D 0,=20 td_stopsched =3D 0,=20 td_blocked =3D 0x0,=20 td_lockname =3D 0x0,=20 td_contested =3D { lh_first =3D 0x0 },=20 td_sleeplocks =3D 0x0,=20 td_intr_nesting_level =3D 0,=20 td_pinned =3D 0,=20 td_ucred =3D 0xfffff800bb55f200,=20 td_estcpu =3D 0,=20 td_slptick =3D 0,=20 td_blktick =3D 0,=20 td_swvoltick =3D 1092393710,=20 td_cow =3D 0,=20 td_ru =3D { ru_utime =3D { tv_sec =3D 0,=20 tv_usec =3D 0 },=20 ru_stime =3D { tv_sec =3D 0,=20 tv_usec =3D 0 },=20 ru_maxrss =3D 218024,=20 ru_ixrss =3D 4102525196,=20 ru_idrss =3D 256714706556,=20 ru_isrss =3D 1033707136,=20 ru_minflt =3D 768721,=20 ru_majflt =3D 3262,=20 ru_nswap =3D 0,=20 ru_inblock =3D 573,=20 ru_oublock =3D 1,=20 ru_msgsnd =3D 395465017,=20 ru_msgrcv =3D 178667178,=20 ru_nsignals =3D 0,=20 ru_nvcsw =3D 213744212,=20 ru_nivcsw =3D 56200635 },=20 td_rux =3D { rux_runtime =3D 109968287043644,=20 rux_uticks =3D 1450275,=20 rux_sticks =3D 6625562,=20 rux_iticks =3D 0,=20 rux_uu =3D 11625969653,=20 rux_su =3D 53113087346,=20 rux_tu =3D 64739057000 },=20 td_incruntime =3D 0,=20 td_runtime =3D 109968287043644,=20 td_pticks =3D 0,=20 td_sticks =3D 0,=20 td_iticks =3D 0,=20 td_uticks =3D 0,=20 td_intrval =3D 0,=20 td_oldsigmask =3D { __bits =3D {0, 0, 0, 0} },=20 td_generation =3D 269944847,=20 td_sigstk =3D { ss_sp =3D 0x0,=20 ss_size =3D 0,=20 ss_flags =3D 4 },=20 td_xsig =3D 0,=20 td_profil_addr =3D 0,=20 td_profil_ticks =3D 0,=20 td_name =3D "nm-poller\000\000\000\000\000\000\000\000\000\000",=20 td_fpop =3D 0x0,=20 td_dbgflags =3D 0,=20 td_dbgksi =3D { ksi_link =3D { tqe_next =3D 0x0,=20 tqe_prev =3D 0x0 },=20 ksi_info =3D { si_signo =3D 0,=20 si_errno =3D 0,=20 si_code =3D 0,=20 si_pid =3D 0,=20 si_uid =3D 0,=20 si_status =3D 0,=20 si_addr =3D 0x0,=20 si_value =3D { sival_int =3D 0,=20 sival_ptr =3D 0x0,=20 sigval_int =3D 0,=20 sigval_ptr =3D 0x0 },=20 _reason =3D { _fault =3D { _trapno =3D 0 },=20 _timer =3D { _timerid =3D 0,=20 _overrun =3D 0 },=20 _mesgq =3D { _mqd =3D 0 },=20 _poll =3D { _band =3D 0 },=20 __spare__ =3D { __spare1__ =3D 0,=20 __spare2__ =3D {0, 0, 0, 0, 0, 0, 0} } } },=20 ksi_flags =3D 0,=20 ksi_sigq =3D 0x0 },=20 td_ng_outbound =3D 0,=20 td_osd =3D { osd_nslots =3D 0,=20 osd_slots =3D 0x0,=20 osd_next =3D { le_next =3D 0x0,=20 le_prev =3D 0x0 } },=20 td_map_def_user =3D 0x0,=20 td_dbg_forked =3D 0,=20 td_vp_reserv =3D 0,=20 td_no_sleeping =3D 0,=20 td_dom_rr_idx =3D 0,=20 td_sigmask =3D { __bits =3D {1611157507, 0, 0, 0} },=20 td_rqindex =3D 26 '\032',=20 td_base_pri =3D 104 'h',=20 td_priority =3D 104 'h',=20 td_pri_class =3D 3 '\003',=20 td_user_pri =3D 124 '|',=20 td_base_user_pri =3D 124 '|',=20 td_pcb =3D 0xfffffe0122abdcc0,=20 td_state =3D TDS_INHIBITED,=20 td_retval =3D {0, 0},=20 td_slpcallout =3D { c_links =3D { le =3D { le_next =3D 0x0,=20 le_prev =3D 0xfffffe000087d5b8 },=20 sle =3D { sle_next =3D 0x0 },=20 tqe =3D { tqe_next =3D 0x0,=20 tqe_prev =3D 0xfffffe000087d5b8 } },=20 c_time =3D 4691782411130129,=20 c_precision =3D 407753,=20 c_arg =3D 0xfffff800bb963940,=20 c_func =3D 0xffffffff809902b0 <sleepq_timeout>,=20 c_lock =3D 0x0,=20 c_flags =3D 0,=20 c_iflags =3D 272,=20 c_cpu =3D 1 },=20 td_frame =3D 0xfffffe0122abdc00,=20 td_kstack_obj =3D 0xfffff800bb837700,=20 td_kstack =3D 18446741879562936320,=20 td_kstack_pages =3D 4,=20 td_critnest =3D 1,=20 td_md =3D { md_spinlock_count =3D 1,=20 md_saved_flags =3D 582,=20 md_spurflt_addr =3D 0 },=20 td_sched =3D 0xfffff800bb963db0,=20 td_ar =3D 0x0,=20 td_lprof =3D {{ lh_first =3D 0x0 }, { lh_first =3D 0x0 }},=20 td_dtrace =3D 0xfffff80013b46700,=20 td_errno =3D 0,=20 td_vnet =3D 0x0,=20 td_vnet_lpush =3D 0x0,=20 td_intr_frame =3D 0x0,=20 td_rfppwait_p =3D 0x0,=20 td_ma =3D 0x0,=20 td_ma_cnt =3D 0,=20 td_su =3D 0x0 } Paul. --=20 Paul Koch | Founder, CEO AKIPS Network Monitor | akips.com Brisbane, Australia
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20160224142619.6710b6c1>