Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 7 May 2012 09:53:29 -0400
From:      Ryan Stone <rysto32@gmail.com>
To:        "Bjoern A. Zeeb" <bz@freebsd.org>
Cc:        svn-src-head@freebsd.org, svn-src-all@freebsd.org, Brooks Davis <brooks@freebsd.org>, src-committers@freebsd.org
Subject:   Re: svn commit: r234504 - in head/sys: amd64/conf i386/conf
Message-ID:  <CAFMmRNyYZcN50U8mdvZGHjC2nh%2Bmj4aeiDr7x2A8fY3NryHZRw@mail.gmail.com>
In-Reply-To: <3D17FEF6-8CC5-4BBB-B098-BEA7D28F377D@FreeBSD.org>
References:  <201204202137.q3KLbhNj056524@svn.freebsd.org> <CAFMmRNy6Ew_A1%2BCAq5Off%2BNxYxEMBHs8ZgfyG7pvVbbR9sCk7Q@mail.gmail.com> <20120421171128.GA6732@lor.one-eyed-alien.net> <3D17FEF6-8CC5-4BBB-B098-BEA7D28F377D@FreeBSD.org>

next in thread | previous in thread | raw e-mail | index | archive | help

On Sun, May 6, 2012 at 2:03 PM, Bjoern A. Zeeb <bz@freebsd.org> wrote:
> root@bz1:/home/bz # procstat -k 34611
>  PID    TID COMM             TDNAME           KSTACK
> 34611 100228 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 34611 100452 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 34611 100453 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 34611 100454 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 34611 100455 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 34611 100456 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> root@bz1:/home/bz # procstat -k 39282
>  PID    TID COMM             TDNAME           KSTACK
> 39282 100348 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep do_wait __umtx_op_wait_uint_private amd64_syscall Xfast_syscall
> 39282 100457 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 39282 100458 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 39282 100459 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 39282 100460 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
> 39282 100461 ctfmerge         -                mi_switch sleepq_catch_signals sleepq_wait_sig _sleep _do_lock_umutex do_lock_umutex __umtx_op_wait_umutex amd64_syscall Xfast_syscall
>
>
> root@bz1:/home/bz # procstat -t 34611
>  PID    TID COMM             TDNAME           CPU  PRI STATE   WCHAN
> 34611 100228 ctfmerge         -                  7  152 sleep   umtxn
> 34611 100452 ctfmerge         -                  1  152 sleep   umtxn
> 34611 100453 ctfmerge         -                  1  152 sleep   umtxn
> 34611 100454 ctfmerge         -                  4  152 sleep   umtxn
> 34611 100455 ctfmerge         -                  0  152 sleep   umtxn
> 34611 100456 ctfmerge         -                  5  152 sleep   umtxn
> root@bz1:/home/bz # procstat -t 39282
>  PID    TID COMM             TDNAME           CPU  PRI STATE   WCHAN
> 39282 100348 ctfmerge         -                  7  152 sleep   uwait
> 39282 100457 ctfmerge         -                  2  152 sleep   umtxn
> 39282 100458 ctfmerge         -                  4  152 sleep   umtxn
> 39282 100459 ctfmerge         -                  1  152 sleep   umtxn
> 39282 100460 ctfmerge         -                  5  152 sleep   umtxn
> 39282 100461 ctfmerge         -                  0  152 sleep   umtxn
>
>
> root@bz1:/home/bz # procstat -i 34611 | grep -v -- '---$'
>  PID COMM             SIG     FLAGS
> 34611 ctfmerge         INT      --C
> 34611 ctfmerge         QUIT     --C
> 34611 ctfmerge         TERM     --C
> 34611 ctfmerge         URG      -I-
> 34611 ctfmerge         TSTP     -I-
> 34611 ctfmerge         CHLD     -I-
> 34611 ctfmerge         TTIN     -I-
> 34611 ctfmerge         TTOU     -I-
> 34611 ctfmerge         IO       -I-
> 34611 ctfmerge         WINCH    -I-
> 34611 ctfmerge         INFO     -I-
> 34611 ctfmerge         32       --C
> root@bz1:/home/bz # procstat -i 39282 | grep -v -- '---$'
>  PID COMM             SIG     FLAGS
> 39282 ctfmerge         INT      --C
> 39282 ctfmerge         QUIT     --C
> 39282 ctfmerge         TERM     --C
> 39282 ctfmerge         URG      -I-
> 39282 ctfmerge         TSTP     -I-
> 39282 ctfmerge         CHLD     -I-
> 39282 ctfmerge         TTIN     -I-
> 39282 ctfmerge         TTOU     -I-
> 39282 ctfmerge         IO       -I-
> 39282 ctfmerge         WINCH    -I-
> 39282 ctfmerge         INFO     -I-
> 39282 ctfmerge         32       --C
>
>
>
> root@bz1:/home/bz # procstat -j 34611 | grep -v -- '--$'
>  PID    TID COMM             SIG     FLAGS
> 34611 100452 ctfmerge         INT      -B
> 34611 100452 ctfmerge         QUIT     -B
> 34611 100452 ctfmerge         TERM     -B
> 34611 100453 ctfmerge         INT      -B
> 34611 100453 ctfmerge         QUIT     -B
> 34611 100453 ctfmerge         TERM     -B
> 34611 100454 ctfmerge         INT      -B
> 34611 100454 ctfmerge         QUIT     -B
> 34611 100454 ctfmerge         TERM     -B
> 34611 100455 ctfmerge         INT      -B
> 34611 100455 ctfmerge         QUIT     -B
> 34611 100455 ctfmerge         TERM     -B
> 34611 100456 ctfmerge         INT      -B
> 34611 100456 ctfmerge         QUIT     -B
> 34611 100456 ctfmerge         TERM     -B
> root@bz1:/home/bz # procstat -j 39282 | grep -v -- '--$'
>  PID    TID COMM             SIG     FLAGS
> 39282 100457 ctfmerge         INT      -B
> 39282 100457 ctfmerge         QUIT     -B
> 39282 100457 ctfmerge         TERM     -B
> 39282 100458 ctfmerge         INT      -B
> 39282 100458 ctfmerge         QUIT     -B
> 39282 100458 ctfmerge         TERM     -B
> 39282 100459 ctfmerge         INT      -B
> 39282 100459 ctfmerge         QUIT     -B
> 39282 100459 ctfmerge         TERM     -B
> 39282 100460 ctfmerge         INT      -B
> 39282 100460 ctfmerge         QUIT     -B
> 39282 100460 ctfmerge         TERM     -B
> 39282 100461 ctfmerge         INT      -B
> 39282 100461 ctfmerge         QUIT     -B
> 39282 100461 ctfmerge         TERM     -B
>
>
>
> So given I have been upset I started to investigate some more.
>
> make -C /usr/src    buildworld  did not work either (no -j<n>).
>
> So I started and limited the build to 1 core:
>
> cpuset -l 1 make -C /usr/src buildkernel   did not work either.
>
>
> So added the nomakeoptions WITH_CTF  and
>
> make -C /usr/src -j8 buildkernel  completes.
>
> So removed the makeoptions WITH_CTF from GENRIC and the nomakeoptions from my kernel including GENERIC and added it to the command line:
>
> make -C /usr/src -j8 buildkernel WITH_CTF=
>
> and that doesn't seem to work at all anymore?
>
> "/usr/src/share/mk/bsd.own.mk", line 482: WITH_CTF and WITHOUT_CTF can't both be set.
>
>
> So I did:
> echo WITH_CTF= >> /etc/src.conf
> make -C /usr/src -j8 buildkernel
>
> and of course it did not work again.
>
>
>
> Given all this and given it has reliably worked in the past, my conclusions is that it must be something related to ctfmerge or libraries?
> /usr/bin/ctfmerge:
>        libctf.so.2 => /lib/libctf.so.2 (0x800829000)
>        libdwarf.so.3 => /usr/lib/libdwarf.so.3 (0x800a36000)
>        libelf.so.1 => /usr/lib/libelf.so.1 (0x800c3f000)
>        libz.so.6 => /lib/libz.so.6 (0x800e58000)
>        libthr.so.3 => /lib/libthr.so.3 (0x80106e000)
>        libc.so.7 => /lib/libc.so.7 (0x801293000)
>
> What has changed the last 3ish months?
>
> /bz
>
> --
> Bjoern A. Zeeb                                 You have to have visions!
>   It does not matter how good you are. It matters what good you do!
>

A libthr fix went in on the 5th in r235068.  I think that it was
pthreads locking related.  Do you have that revision?  If you do, does
backing up r234947 fix your problems?



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFMmRNyYZcN50U8mdvZGHjC2nh%2Bmj4aeiDr7x2A8fY3NryHZRw>