From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 02:16:51 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 47F4476E; Sun, 23 Dec 2012 02:16:51 +0000 (UTC) (envelope-from jbeich@tormail.org) Received: from outgoing.tormail.org (outgoing.tormail.org [82.221.96.22]) by mx1.freebsd.org (Postfix) with ESMTP id E9D8B8FC0A; Sun, 23 Dec 2012 02:16:50 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=internal.tormail.org) by outgoing.tormail.org with esmtp (Exim 4.72) (envelope-from ) id 1Tmb7K-0003qf-4R; Sun, 23 Dec 2012 05:16:42 +0300 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=tormail.org; s=tm; h=Message-Id:X-TorMail-User:Content-Type:MIME-Version:References:Date:In-Reply-To:Subject:Cc:To:From; bh=ujnpPemVe13rlc+LZBiRniPc11hh48h4eG+2sqGcp4M=; b=WBqJjjtfXb9nWlWBnnLTrN+6X1hSRbNu2BbsKro3YSYv532tiYV2rP0m9GF6ThEUQjjeQKQQ9LvZo01Xg/HteaBWknQo2aY9gquRdKnJGWwj3eL6LrJEeJfUl9u29ncx+XlSCw6w3+0otLsOJTh1HFbyJoTGpkmJL2xjmXOPuRc=; Received: from jbeich by internal.tormail.org with local (Exim 4.63) (envelope-from ) id 1Tmb5f-000Jy5-CT; Sun, 23 Dec 2012 02:15:00 +0000 From: Jan Beich To: Ed Maste Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files In-Reply-To: <20121222164602.GB32022@sandvine.com> (Ed Maste's message of "Sat, 22 Dec 2012 16:46:02 +0000") Date: Sat, 22 Dec 2012 19:14:42 -0700 References: <20121222164602.GB32022@sandvine.com> MIME-Version: 1.0 Content-Type: text/plain X-TorMail-User: jbeich Message-Id: <1Tmb5f-000Jy5-CT@internal.tormail.org> X-Mailman-Approved-At: Sun, 23 Dec 2012 02:34:57 +0000 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 02:16:51 -0000 Ed Maste writes: > When this knob is set standalone debug files for shared objects are > built and installed in /usr/lib/debug/.debug. GDB > searches this path for debug data. [...] > - Change GDB's standalone debug file path to the default /usr/lib/debug. [...] > diff --git a/etc/mtree/BSD.usr.dist b/etc/mtree/BSD.usr.dist > index 336d055..7b428d5 100644 > --- a/etc/mtree/BSD.usr.dist > +++ b/etc/mtree/BSD.usr.dist > @@ -18,6 +18,22 @@ > aout > .. > .. > + debug > + boot > + .. > + lib > + geom > + .. > + .. > + usr > + lib > + engines > + .. > + .. > + lib32 > + .. > + .. > + .. > dtrace > .. > engines What about ports? They are not allowed to install outside of PREFIX. $ cd multimedia/cuse4bsd-kmod $ make install PREFIX=/tmp/aaa PKG_DBDIR=/tmp/pkg WITH_DEBUG= [...] install -C -o root -g wheel -m 444 libcuse4bsd.a /tmp/aaa/lib install -s -o root -g wheel -m 444 libcuse4bsd.so.1 /tmp/aaa/lib install -o root -g wheel -m 444 libcuse4bsd.so.1.debug /usr/lib/debug/tmp/aaa/lib install: /usr/lib/debug/tmp/aaa/lib: No such file or directory *** [_libinstall] Error code 71 From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 04:13:15 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 768941D1; Sun, 23 Dec 2012 04:13:15 +0000 (UTC) (envelope-from bright@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 424408FC0A; Sun, 23 Dec 2012 04:13:15 +0000 (UTC) Received: from Alfreds-MacBook-Pro-9.local (c-67-180-208-218.hsd1.ca.comcast.net [67.180.208.218]) by elvis.mu.org (Postfix) with ESMTPSA id 903B51A3C2B; Sat, 22 Dec 2012 20:13:09 -0800 (PST) Message-ID: <50D684D7.8050906@mu.org> Date: Sat, 22 Dec 2012 20:13:11 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Jan Beich Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> In-Reply-To: <1Tmb5f-000Jy5-CT@internal.tormail.org> Content-Type: multipart/mixed; boundary="------------000201080901080207010808" Cc: freebsd-hackers@freebsd.org, Ed Maste X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 04:13:15 -0000 This is a multi-part message in MIME format. --------------000201080901080207010808 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 12/22/12 6:14 PM, Jan Beich wrote: > Ed Maste writes: > >> When this knob is set standalone debug files for shared objects are >> built and installed in /usr/lib/debug/.debug. GDB >> searches this path for debug data. > [...] > What about ports? They are not allowed to install outside of PREFIX. > > $ cd multimedia/cuse4bsd-kmod > $ make install PREFIX=/tmp/aaa PKG_DBDIR=/tmp/pkg WITH_DEBUG= > [...] > install -C -o root -g wheel -m 444 libcuse4bsd.a /tmp/aaa/lib > install -s -o root -g wheel -m 444 libcuse4bsd.so.1 /tmp/aaa/lib > install -o root -g wheel -m 444 libcuse4bsd.so.1.debug /usr/lib/debug/tmp/aaa/lib > install: /usr/lib/debug/tmp/aaa/lib: No such file or directory > *** [_libinstall] Error code 71 I have a patch for this. I am building world to see what happens, if you want to try it, or comment on it, please let me know. Changes are: base DEBUGDIR on LIBDIR for ports create intermediate directories for debug objs. -Alfred --------------000201080901080207010808 Content-Type: text/plain; charset=UTF-8; x-mac-type="0"; x-mac-creator="0"; name="debug_lib2.diff" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="debug_lib2.diff" diff --git a/etc/mtree/BSD.usr.dist b/etc/mtree/BSD.usr.dist index 336d055..7b428d5 100644 --- a/etc/mtree/BSD.usr.dist +++ b/etc/mtree/BSD.usr.dist @@ -18,6 +18,22 @@ aout .. .. + debug + boot + .. + lib + geom + .. + .. + usr + lib + engines + .. + .. + lib32 + .. + .. + .. dtrace .. engines diff --git a/gnu/usr.bin/gdb/arch/amd64/config.h b/gnu/usr.bin/gdb/arch/amd64/config.h index ac81c54..ae3e104 100644 --- a/gnu/usr.bin/gdb/arch/amd64/config.h +++ b/gnu/usr.bin/gdb/arch/amd64/config.h @@ -440,7 +440,7 @@ #define PACKAGE "gdb" /* Global directory for separate debug files. */ -#define DEBUGDIR "/usr/local/lib/debug" +#define DEBUGDIR "/usr/lib/debug" /* Define to BFD's default architecture. */ #define DEFAULT_BFD_ARCH bfd_i386_arch diff --git a/gnu/usr.bin/gdb/arch/arm/config.h b/gnu/usr.bin/gdb/arch/arm/config.h index e1b128c..26b1891 100644 --- a/gnu/usr.bin/gdb/arch/arm/config.h +++ b/gnu/usr.bin/gdb/arch/arm/config.h @@ -452,7 +452,7 @@ #define PACKAGE "gdb" /* Global directory for separate debug files. */ -#define DEBUGDIR "/usr/local/lib/debug" +#define DEBUGDIR "/usr/lib/debug" /* Define to BFD's default architecture. */ #define DEFAULT_BFD_ARCH bfd_arm_arch diff --git a/gnu/usr.bin/gdb/arch/i386/config.h b/gnu/usr.bin/gdb/arch/i386/config.h index f21da4c..30e75c3 100644 --- a/gnu/usr.bin/gdb/arch/i386/config.h +++ b/gnu/usr.bin/gdb/arch/i386/config.h @@ -440,7 +440,7 @@ #define PACKAGE "gdb" /* Global directory for separate debug files. */ -#define DEBUGDIR "/usr/local/lib/debug" +#define DEBUGDIR "/usr/lib/debug" /* Define to BFD's default architecture. */ #define DEFAULT_BFD_ARCH bfd_i386_arch diff --git a/gnu/usr.bin/gdb/arch/ia64/config.h b/gnu/usr.bin/gdb/arch/ia64/config.h index 5faa96b..f8c84ab 100644 --- a/gnu/usr.bin/gdb/arch/ia64/config.h +++ b/gnu/usr.bin/gdb/arch/ia64/config.h @@ -440,7 +440,7 @@ #define PACKAGE "gdb" /* Global directory for separate debug files. */ -#define DEBUGDIR "/usr/local/lib/debug" +#define DEBUGDIR "/usr/lib/debug" /* Define to BFD's default architecture. */ #define DEFAULT_BFD_ARCH bfd_ia64_arch diff --git a/gnu/usr.bin/gdb/arch/mips/config.h b/gnu/usr.bin/gdb/arch/mips/config.h index 41a6731..01a7869 100644 --- a/gnu/usr.bin/gdb/arch/mips/config.h +++ b/gnu/usr.bin/gdb/arch/mips/config.h @@ -440,7 +440,7 @@ #define PACKAGE "gdb" /* Global directory for separate debug files. */ -#define DEBUGDIR "/usr/local/lib/debug" +#define DEBUGDIR "/usr/lib/debug" /* Define to BFD's default architecture. */ #define DEFAULT_BFD_ARCH bfd_mips_arch diff --git a/gnu/usr.bin/gdb/arch/powerpc/config.h b/gnu/usr.bin/gdb/arch/powerpc/config.h index f169fad..49472e7 100644 --- a/gnu/usr.bin/gdb/arch/powerpc/config.h +++ b/gnu/usr.bin/gdb/arch/powerpc/config.h @@ -440,7 +440,7 @@ #define PACKAGE "gdb" /* Global directory for separate debug files. */ -#define DEBUGDIR "/usr/local/lib/debug" +#define DEBUGDIR "/usr/lib/debug" /* Define to BFD's default architecture. */ #define DEFAULT_BFD_ARCH bfd_rs6000_arch diff --git a/gnu/usr.bin/gdb/arch/powerpc64/config.h b/gnu/usr.bin/gdb/arch/powerpc64/config.h index d8b9b6d..c904d1d 100644 --- a/gnu/usr.bin/gdb/arch/powerpc64/config.h +++ b/gnu/usr.bin/gdb/arch/powerpc64/config.h @@ -440,7 +440,7 @@ #define PACKAGE "gdb" /* Global directory for separate debug files. */ -#define DEBUGDIR "/usr/local/lib/debug" +#define DEBUGDIR "/usr/lib/debug" /* Define to BFD's default architecture. */ #define DEFAULT_BFD_ARCH bfd_rs6000_arch diff --git a/gnu/usr.bin/gdb/arch/sparc64/config.h b/gnu/usr.bin/gdb/arch/sparc64/config.h index 5527a79..ff87c28 100644 --- a/gnu/usr.bin/gdb/arch/sparc64/config.h +++ b/gnu/usr.bin/gdb/arch/sparc64/config.h @@ -440,7 +440,7 @@ #define PACKAGE "gdb" /* Global directory for separate debug files. */ -#define DEBUGDIR "/usr/local/lib/debug" +#define DEBUGDIR "/usr/lib/debug" /* Define to BFD's default architecture. */ #define DEFAULT_BFD_ARCH bfd_sparc_arch diff --git a/share/mk/bsd.lib.mk b/share/mk/bsd.lib.mk index aa3567b..c42b6ed 100644 --- a/share/mk/bsd.lib.mk +++ b/share/mk/bsd.lib.mk @@ -43,6 +43,10 @@ CTFFLAGS+= -g STRIP?= -s .endif +.if defined(MK_DEBUG_FILES) && empty(${DEBUG_FLAGS:M-g}) +CFLAGS+= -g +.endif + .include # prefer .s to a .c, add .po, remove stuff not used in the BSD libraries @@ -173,8 +177,8 @@ SOLINKOPTS+= -Wl,--fatal-warnings -Wl,--warn-shared-textrel .if target(beforelinking) ${SHLIB_NAME}: beforelinking .endif -.if defined(DEBUG_FLAGS) -${SHLIB_NAME}.debug: ${SOBJS} +.if defined(MK_DEBUG_FILES) +${SHLIB_NAME}.full: ${SOBJS} .else ${SHLIB_NAME}: ${SOBJS} .endif @@ -196,13 +200,13 @@ ${SHLIB_NAME}: ${SOBJS} ${CTFMERGE} ${CTFFLAGS} -o ${.TARGET} ${SOBJS} .endif -.if defined(DEBUG_FLAGS) -${SHLIB_NAME}: ${SHLIB_NAME}.debug ${SHLIB_NAME}.symbols - ${OBJCOPY} --strip-debug --add-gnu-debuglink=${SHLIB_NAME}.symbols \ - ${SHLIB_NAME}.debug ${.TARGET} +.if defined(MK_DEBUG_FILES) +${SHLIB_NAME}: ${SHLIB_NAME}.full ${SHLIB_NAME}.debug + ${OBJCOPY} --strip-debug --add-gnu-debuglink=${SHLIB_NAME}.debug \ + ${SHLIB_NAME}.full ${.TARGET} -${SHLIB_NAME}.symbols: ${SHLIB_NAME}.debug - ${OBJCOPY} --only-keep-debug ${SHLIB_NAME}.debug ${.TARGET} +${SHLIB_NAME}.debug: ${SHLIB_NAME}.full + ${OBJCOPY} --only-keep-debug ${SHLIB_NAME}.full ${.TARGET} .endif .endif @@ -280,10 +284,13 @@ _libinstall: ${INSTALL} ${STRIP} -o ${LIBOWN} -g ${LIBGRP} -m ${LIBMODE} \ ${_INSTALLFLAGS} ${_SHLINSTALLFLAGS} \ ${SHLIB_NAME} ${DESTDIR}${SHLIBDIR} -.if defined(DEBUG_FLAGS) +.if defined(MK_DEBUG_FILES) + ${INSTALL} -d -o ${LIBOWN} -g ${LIBGRP} -m ${LIBMODE} \ + ${_INSTALLFLAGS} \ + ${DESTDIR}${DEBUGDIR}${SHLIBDIR} ${INSTALL} -o ${LIBOWN} -g ${LIBGRP} -m ${LIBMODE} \ ${_INSTALLFLAGS} \ - ${SHLIB_NAME}.symbols ${DESTDIR}${SHLIBDIR} + ${SHLIB_NAME}.debug ${DESTDIR}${DEBUGDIR}${SHLIBDIR} .endif .if defined(SHLIB_LINK) # ${_SHLIBDIRPREFIX} and ${_LDSCRIPTROOT} are both needed when cross-building diff --git a/share/mk/bsd.own.mk b/share/mk/bsd.own.mk index 78af8fb..1b3c37e 100644 --- a/share/mk/bsd.own.mk +++ b/share/mk/bsd.own.mk @@ -43,6 +43,9 @@ # LIBMODE Library mode. [${NOBINMODE}] # # +# DEBUGDIR Base path for standalone debug files. [/usr/lib/debug] +# +# # KMODDIR Base path for loadable kernel modules # (see kld(4)). [/boot/kernel] # @@ -147,6 +150,8 @@ LIBOWN?= ${BINOWN} LIBGRP?= ${BINGRP} LIBMODE?= ${NOBINMODE} +DEBUGDIR?= ${LIBDIR}/debug + # Share files SHAREDIR?= /usr/share @@ -427,6 +432,7 @@ __DEFAULT_NO_OPTIONS = \ BSD_GREP \ CLANG_EXTRAS \ CTF \ + DEBUG_FILES \ HESIOD \ ICONV \ IDEA \ --------------000201080901080207010808-- From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 05:42:57 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6EB6A7DC; Sun, 23 Dec 2012 05:42:57 +0000 (UTC) (envelope-from bright@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 394178FC12; Sun, 23 Dec 2012 05:42:56 +0000 (UTC) Received: from Alfreds-MacBook-Pro-9.local (c-67-180-208-218.hsd1.ca.comcast.net [67.180.208.218]) by elvis.mu.org (Postfix) with ESMTPSA id 864FC1A3C2C; Sat, 22 Dec 2012 21:42:56 -0800 (PST) Message-ID: <50D699E3.3090606@mu.org> Date: Sat, 22 Dec 2012 21:42:59 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Jan Beich Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> In-Reply-To: <50D684D7.8050906@mu.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: freebsd-hackers@freebsd.org, Ed Maste X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 05:42:57 -0000 On 12/22/12 8:13 PM, Alfred Perlstein wrote: > On 12/22/12 6:14 PM, Jan Beich wrote: >> Ed Maste writes: >> >>> When this knob is set standalone debug files for shared objects are >>> built and installed in /usr/lib/debug/.debug. GDB >>> searches this path for debug data. >> [...] >> What about ports? They are not allowed to install outside of PREFIX. >> >> $ cd multimedia/cuse4bsd-kmod >> $ make install PREFIX=/tmp/aaa PKG_DBDIR=/tmp/pkg WITH_DEBUG= >> [...] >> install -C -o root -g wheel -m 444 libcuse4bsd.a /tmp/aaa/lib >> install -s -o root -g wheel -m 444 libcuse4bsd.so.1 /tmp/aaa/lib >> install -o root -g wheel -m 444 libcuse4bsd.so.1.debug >> /usr/lib/debug/tmp/aaa/lib >> install: /usr/lib/debug/tmp/aaa/lib: No such file or directory >> *** [_libinstall] Error code 71 > I have a patch for this. I am building world to see what happens, if > you want to try it, or comment on it, please let me know. > > Changes are: > base DEBUGDIR on LIBDIR for ports > create intermediate directories for debug objs. > > -Alfred Buildworld breaks with this for me using my patch, no idea what this all means yet. Will look into it: exer.c -o nslexer.So ctfconvert -L VERSION crypt_xdr.o ctfconvert -L VERSION crypt_clnt.o ctfconvert -L VERSION nsparser.So ctfconvert -L VERSION nsparser.o ctfconvert -L VERSION crypt_clnt.So ctfconvert -L VERSION crypt_xdr.So ctfconvert -L VERSION yp_xdr.o ctfconvert -L VERSION subr_acl_nfs4.So ctfconvert -L VERSION nslexer.o ctfconvert -L VERSION yp_xdr.So ctfconvert -L VERSION subr_acl_nfs4.o building static c library ctfconvert -L VERSION nslexer.So building shared library libc.so.7 building special pic c library BFD: dlfcn.o: invalid SHT_GROUP entry BFD: dlfcn.o: invalid SHT_GROUP entry BFD: dlfcn.o: invalid SHT_GROUP entry BFD: dlfcn.o: invalid SHT_GROUP entry BFD: dlfcn.o: no group info for section .text._rtld_error BFD: dlfcn.o: no group info for section .text.dladdr BFD: dlfcn.o: no group info for section .text.dlclose BFD: dlfcn.o: no group info for section .text.dlerror BFD: dlfcn.o: no group info for section .text.dllockinit BFD: dlfcn.o: no group info for section .text.dlopen BFD: dlfcn.o: no group info for section .text.dlsym BFD: dlfcn.o: no group info for section .text.dlvsym BFD: dlfcn.o: no group info for section .text.dlinfo BFD: dlfcn.o: no group info for section .text._rtld_thread_init BFD: dlfcn.o: no group info for section .text._rtld_atfork_post BFD: dlfcn.o: no group info for section .text._rtld_get_stack_prot nm: dlfcn.o: File format not recognized BFD: elf_utils.o: invalid SHT_GROUP entry BFD: elf_utils.o: no group info for section .text.__pthread_map_stacks_exec BFD: elf_utils.o: unknown [0] section `' in group [__pthread_map_stacks_exec] nm: elf_utils.o: File format not recognized ranlib libc_pic.a BFD: __vdso_gettc.o: invalid SHT_GROUP entry BFD: __vdso_gettc.o: no group info for section .text.__vdso_gettc BFD: __vdso_gettc.o: unknown [0] section `' in group [__vdso_gettc] nm: __vdso_gettc.o: File format not recognized BFD: __vdso_gettimeofday.o: invalid SHT_GROUP entry BFD: __vdso_gettimeofday.o: invalid SHT_GROUP entry BFD: __vdso_gettimeofday.o: no group info for section .text.__vdso_gettimeofday BFD: __vdso_gettimeofday.o: no group info for section .text.__vdso_clock_gettime BFD: __vdso_gettimeofday.o: unknown [0] section `' in group [__vdso_gettimeofday] BFD: __vdso_gettimeofday.o: unknown [0] section `' in group [__vdso_clock_gettime] nm: __vdso_gettimeofday.o: File format not recognized BFD: dlfcn.So: invalid SHT_GROUP entry BFD: dlfcn.So: invalid SHT_GROUP entry BFD: dlfcn.So: invalid SHT_GROUP entry BFD: dlfcn.So: invalid SHT_GROUP entry BFD: dlfcn.So: no group info for section .text._rtld_error BFD: dlfcn.So: no group info for section .text.dladdr BFD: dlfcn.So: no group info for section .text.dlclose BFD: dlfcn.So: no group info for section .text.dlerror BFD: dlfcn.So: no group info for section .text.dllockinit BFD: dlfcn.So: no group info for section .text.dlopen BFD: dlfcn.So: no group info for section .text.dlsym BFD: dlfcn.So: no group info for section .text.dlvsym BFD: dlfcn.So: no group info for section .text.dlinfo BFD: dlfcn.So: no group info for section .text._rtld_thread_init BFD: dlfcn.So: no group info for section .text._rtld_atfork_post BFD: dlfcn.So: no group info for section .text._rtld_get_stack_prot BFD: dlfcn.So: unknown [2] section `.symtab' in group [dl_iterate_phdr] BFD: dlfcn.So: unknown [0] section `' in group [_rtld_atfork_pre] BFD: dlfcn.So: unknown [0] section `' in group [_rtld_atfork_post] BFD: dlfcn.So: unknown [0] section `' in group [_rtld_addr_phdr] BFD: dlfcn.So: unknown [0] section `' in group [_rtld_get_stack_prot] nm: dlfcn.So: File format not recognized BFD: elf_utils.So: invalid SHT_GROUP entry BFD: elf_utils.So: no group info for section .text.__pthread_map_stacks_exec BFD: elf_utils.So: unknown [0] section `' in group [__pthread_map_stacks_exec] nm: elf_utils.So: File format not recognized BFD: __vdso_gettc.So: invalid SHT_GROUP entry BFD: __vdso_gettc.So: no group info for section .text.__vdso_gettc BFD: __vdso_gettc.So: unknown [0] section `' in group [__vdso_gettc] nm: __vdso_gettc.So: File format not recognized BFD: __vdso_gettimeofday.So: invalid SHT_GROUP entry BFD: __vdso_gettimeofday.So: invalid SHT_GROUP entry BFD: __vdso_gettimeofday.So: no group info for section .text.__vdso_gettimeofday BFD: __vdso_gettimeofday.So: no group info for section .text.__vdso_clock_gettime BFD: __vdso_gettimeofday.So: unknown [0] section `' in group [__vdso_gettimeofday] BFD: __vdso_gettimeofday.So: unknown [0] section `' in group [__vdso_clock_gettime] nm: __vdso_gettimeofday.So: File format not recognized ranlib libc.a /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: invalid SHT_GROUP entry /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: invalid SHT_GROUP entry /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: no group info for section .text.__vdso_gettimeofday /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: no group info for section .text.__vdso_clock_gettime /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: unknown [0] section `' in group [__vdso_gettimeofday] /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: unknown [0] section `' in group [__vdso_clock_gettime] __vdso_gettimeofday.So: file not recognized: File format not recognized cc: error: linker command failed with exit code 1 (use -v to see invocation) *** [libc.so.7.full] Error code 1 1 error *** [lib/libc__L] Error code 2 1 error *** [libraries] Error code 2 1 error *** [_libraries] Error code 2 1 error *** [buildworld] Error code 2 1 error > > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 08:32:27 2012 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A4C627C0 for ; Sun, 23 Dec 2012 08:32:27 +0000 (UTC) (envelope-from jmg@h2.funkthat.com) Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18]) by mx1.freebsd.org (Postfix) with ESMTP id 7CB578FC0C for ; Sun, 23 Dec 2012 08:32:27 +0000 (UTC) Received: from h2.funkthat.com (localhost [127.0.0.1]) by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id qBN8WLW4034068 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Sun, 23 Dec 2012 00:32:21 -0800 (PST) (envelope-from jmg@h2.funkthat.com) Received: (from jmg@localhost) by h2.funkthat.com (8.14.3/8.14.3/Submit) id qBN8WLBs034067 for hackers@FreeBSD.org; Sun, 23 Dec 2012 00:32:21 -0800 (PST) (envelope-from jmg) Date: Sun, 23 Dec 2012 00:32:20 -0800 From: John-Mark Gurney To: hackers@FreeBSD.org Subject: looking for someone to fix humanize_number (test cases included) Message-ID: <20121223083220.GL1563@funkthat.com> Mail-Followup-To: hackers@FreeBSD.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 7.2-RELEASE i386 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.2 (h2.funkthat.com [127.0.0.1]); Sun, 23 Dec 2012 00:32:21 -0800 (PST) X-Mailman-Approved-At: Sun, 23 Dec 2012 12:37:07 +0000 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 08:32:27 -0000 I'm looking for a person who is interested in fixing up humanize_number. The other day I copied some data from a 7.2-R box to a 9.1-stable box and did a du -shc and a du-skc to check the results... I noticed the -h run dropped from 11M to 10M, which I thought was weird... Then I looked at the results from the -k run, but the new machine had a larger result (I copied from UFS to ZFS)... It turns out that humanize_number was broken when doing rounding... No longer does humanize_number round up at .5 or more of the prefix.. So I decided to write a test program to test the output, and now I'm even more surprised by the output... Neither 7.2-R nor 10-current give what I expect are the correct results... Feel free to take a look at the test program posted to: http://people.freebsd.org/~jmg/humanize_numbers/ The .c contains what I think the output should be. So far the bugs I know of: 1) rounding is incorrect (started this whole search) 2) buffer calculation is incorrect in some cases, index 11 should fit but doesn't 3) some cases zero is returned though it isn't zero, more like 0T for 512 G (indexes 16, 17, 22, 23) 4) man page is missing required sys/types.h include I'll work to get the code into the tree once we get it in a good state. Please cc me as I'm not subscribed to -hackers. Thanks. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 13:36:10 2012 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3C458D57 for ; Sun, 23 Dec 2012 13:36:10 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 6E4008FC0A for ; Sun, 23 Dec 2012 13:36:09 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id PAA24417 for ; Sun, 23 Dec 2012 15:36:08 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1Tmlip-000FeM-MG for freebsd-hackers@FreeBSD.org; Sun, 23 Dec 2012 15:36:07 +0200 Message-ID: <50D708C6.6060801@FreeBSD.org> Date: Sun, 23 Dec 2012 15:36:06 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: freebsd-hackers@FreeBSD.org Subject: uart: add resume method X-Enigmail-Version: 1.4.6 Content-Type: text/plain; charset=X-VIET-VPS Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 13:36:10 -0000 Guys, do you think that the following change is useful/needed? I needed it with UART emulated in qemu, but I have no experience with real hardware. commit ff1cc9b33c34fec4f3d1d3cb675ec3f8cfbc96de Author: Andriy Gapon Date: Wed Dec 19 23:31:49 2012 +0200 uart: add resume method and enable it for attachments on the most common x86 buses Otherwise the uart hardware could be in such a state after the resume where IER is cleared and thus no interrupts are generated. diff --git a/sys/dev/uart/uart_bus.h b/sys/dev/uart/uart_bus.h index 01752d0..322e9a8 100644 --- a/sys/dev/uart/uart_bus.h +++ b/sys/dev/uart/uart_bus.h @@ -138,6 +138,7 @@ extern char uart_driver_name[]; int uart_bus_attach(device_t dev); int uart_bus_detach(device_t dev); +int uart_bus_resume(device_t dev); serdev_intr_t *uart_bus_ihand(device_t dev, int ipend); int uart_bus_ipend(device_t dev); int uart_bus_probe(device_t dev, int regshft, int rclk, int rid, int chan); diff --git a/sys/dev/uart/uart_bus_acpi.c b/sys/dev/uart/uart_bus_acpi.c index 756f7f2..ccd213d 100644 --- a/sys/dev/uart/uart_bus_acpi.c +++ b/sys/dev/uart/uart_bus_acpi.c @@ -47,6 +47,7 @@ static device_method_t uart_acpi_methods[] = { DEVMETHOD(device_probe, uart_acpi_probe), DEVMETHOD(device_attach, uart_bus_attach), DEVMETHOD(device_detach, uart_bus_detach), + DEVMETHOD(device_resume, uart_bus_resume), { 0, 0 } }; diff --git a/sys/dev/uart/uart_bus_isa.c b/sys/dev/uart/uart_bus_isa.c index 1836663..1fda15f 100644 --- a/sys/dev/uart/uart_bus_isa.c +++ b/sys/dev/uart/uart_bus_isa.c @@ -50,6 +50,7 @@ static device_method_t uart_isa_methods[] = { DEVMETHOD(device_probe, uart_isa_probe), DEVMETHOD(device_attach, uart_bus_attach), DEVMETHOD(device_detach, uart_bus_detach), + DEVMETHOD(device_resume, uart_bus_resume), { 0, 0 } }; diff --git a/sys/dev/uart/uart_bus_pci.c b/sys/dev/uart/uart_bus_pci.c index 307ee340..4237fa4 100644 --- a/sys/dev/uart/uart_bus_pci.c +++ b/sys/dev/uart/uart_bus_pci.c @@ -51,6 +51,7 @@ static device_method_t uart_pci_methods[] = { DEVMETHOD(device_probe, uart_pci_probe), DEVMETHOD(device_attach, uart_bus_attach), DEVMETHOD(device_detach, uart_bus_detach), + DEVMETHOD(device_resume, uart_bus_resume), { 0, 0 } }; diff --git a/sys/dev/uart/uart_core.c b/sys/dev/uart/uart_core.c index 8234d63..aa0d792 100644 --- a/sys/dev/uart/uart_core.c +++ b/sys/dev/uart/uart_core.c @@ -590,3 +590,12 @@ uart_bus_detach(device_t dev) return (0); } + +int +uart_bus_resume(device_t dev) +{ + struct uart_softc *sc; + + sc = device_get_softc(dev); + return (UART_ATTACH(sc)); +} -- Andriy Gapon From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 16:26:56 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9A996EFC for ; Sun, 23 Dec 2012 16:26:56 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-ia0-f175.google.com (mail-ia0-f175.google.com [209.85.210.175]) by mx1.freebsd.org (Postfix) with ESMTP id 59C978FC14 for ; Sun, 23 Dec 2012 16:26:56 +0000 (UTC) Received: by mail-ia0-f175.google.com with SMTP id z3so5284549iad.6 for ; Sun, 23 Dec 2012 08:26:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:cc:content-type; bh=uyWrFfwEvGrV+xM8GrdOwRd31qkOMFFa7mk3w9/VtVI=; b=tCCXWSPlIx1d0kCU2+tf/Zy96Qwf8N5st4t0n3zNfje45hlJPti5NG0ExT11xpzX06 5DDR4FYbrSbvP3CDazMgBGJU5MS3MlaZUSgcAcniJOD6kXPlVBpAuNL3Andx0MlARNse utgYcDC/WnZJsQfTxEl5r1oNZXTOqTTtWbfYkSCAZ8ORUVn3Vmqsp9wZyQv24hjQw6EU aWTDun8SJD3jM5TVTS1v96EwVOt0jsKIeI9FvzdDxf65Pa6TPFEgXI0OfLkdIcuclp2X eS7HBuHKwRm+usIkJaJDNmrnlCHpUaMSENfS70ZlXPUKR9vAnoExFCJQbOYzUKRVOK4t 7xoA== MIME-Version: 1.0 Received: by 10.50.222.226 with SMTP id qp2mr13659928igc.103.1356280015664; Sun, 23 Dec 2012 08:26:55 -0800 (PST) Sender: carpeddiem@gmail.com Received: by 10.50.112.134 with HTTP; Sun, 23 Dec 2012 08:26:55 -0800 (PST) In-Reply-To: <50D684D7.8050906@mu.org> References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> Date: Sun, 23 Dec 2012 11:26:55 -0500 X-Google-Sender-Auth: PDz0thcaE7TK5UqalsHsZAZZPYw Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files From: Ed Maste Cc: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 16:26:56 -0000 On 22 December 2012 23:13, Alfred Perlstein wrote: > I have a patch for this. I am building world to see what happens, if you > want to try it, or comment on it, please let me know. > > Changes are: > base DEBUGDIR on LIBDIR for ports > create intermediate directories for debug objs. Note that just moving ports debug data to /usr/local/lib/debug/... won't work since GDB won't search there. We could teach it to search a list of paths and include /usr/local/lib/debug and /usr/lib/debug, or perhaps a symlink under /usr/local/lib. We could also use a .debug subdirectory for ports and other users of bsd.lib.mk - so for example /usr/local/lib/libfoo.so would have debug info in /usr/local/lib/.debug/libfoo.so.debug. From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 17:28:53 2012 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CD0B1C97; Sun, 23 Dec 2012 17:28:53 +0000 (UTC) (envelope-from jasone@freebsd.org) Received: from canonware.com (canonware.com [204.109.63.53]) by mx1.freebsd.org (Postfix) with ESMTP id A78D58FC0A; Sun, 23 Dec 2012 17:28:53 +0000 (UTC) Received: from [192.168.168.12] (70-91-206-178-BusName-SFBA.hfc.comcastbusiness.net [70.91.206.178]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by canonware.com (Postfix) with ESMTPSA id DE4E628417; Sun, 23 Dec 2012 09:28:52 -0800 (PST) Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: malloc+utrace, tracking memory leaks in a running program. From: Jason Evans In-Reply-To: <50D52B10.1060205@mu.org> Date: Sun, 23 Dec 2012 09:28:52 -0800 Content-Transfer-Encoding: quoted-printable Message-Id: References: <50D52B10.1060205@mu.org> To: Alfred Perlstein X-Mailer: Apple Mail (2.1499) Cc: Daniel Eischen , hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 17:28:53 -0000 On Dec 21, 2012, at 7:37 PM, Alfred Perlstein wrote: > So the other day in an effort to debug a memory leak I decided to take = a look at malloc+utrace(2) and decided to make a tool to debug where = leaks are coming from. >=20 > A few hours later I have: > 1) a new version of utrace(2) (utrace2(2)) that uses structured data = to prevent overloading of data. (utrace2.diff) > 2) changes to ktrace and kdump to decode the new format. (also in = utrace2.diff) > 3) changes to jemalloc to include the new format AND the function = caller so it's easy to get the source of the leaks. (also in = utrace2.diff) > 4) a program that can take a pipe of kdump(1) and figure out what = memory has leaked. (alloctrace.py) > 5) simple test program (test_utrace.c) >=20 > [=85] Have you looked at the heap profiling functionality built into jemalloc? = It's not currently enabled on FreeBSD, but as far as I know, the only = issue keeping it from being useful is the absence of a Linux-compatible = /proc//maps (and the gperftools folks may already have a solution = for that; I haven't looked). I think it makes more sense to get that = sorted out than to develop a separate trace-based leak checker. The = problem with tracing is that it doesn't scale beyond some relatively = small number of allocator events. > Is it time to start installing with some form of debug symbols? This = would help us also with dtrace. Re: debug symbols, frame pointers, etc. necessary to make userland = dtrace work by default, IMO we should strongly prefer such defaults. = It's more reasonable to expect people who need every last bit of = performance to remove functionality than to expect people who want to = figure out what the system is doing to figure out what functionality to = turn on. Thanks, Jason= From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 18:02:16 2012 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 33183246; Sun, 23 Dec 2012 18:02:16 +0000 (UTC) (envelope-from bright@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 11E018FC0C; Sun, 23 Dec 2012 18:02:15 +0000 (UTC) Received: from Alfreds-MacBook-Pro-9.local (c-67-180-208-218.hsd1.ca.comcast.net [67.180.208.218]) by elvis.mu.org (Postfix) with ESMTPSA id 4ABF91A3C2B; Sun, 23 Dec 2012 10:02:15 -0800 (PST) Message-ID: <50D7472B.4070604@mu.org> Date: Sun, 23 Dec 2012 10:02:19 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Jason Evans Subject: Re: malloc+utrace, tracking memory leaks in a running program. References: <50D52B10.1060205@mu.org> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Cc: Daniel Eischen , hackers@freebsd.org, Rui Paulo X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 18:02:16 -0000 On 12/23/12 9:28 AM, Jason Evans wrote: > On Dec 21, 2012, at 7:37 PM, Alfred Perlstein wrote: >> So the other day in an effort to debug a memory leak I decided to take a look at malloc+utrace(2) and decided to make a tool to debug where leaks are coming from. >> >> A few hours later I have: >> 1) a new version of utrace(2) (utrace2(2)) that uses structured data to prevent overloading of data. (utrace2.diff) >> 2) changes to ktrace and kdump to decode the new format. (also in utrace2.diff) >> 3) changes to jemalloc to include the new format AND the function caller so it's easy to get the source of the leaks. (also in utrace2.diff) >> 4) a program that can take a pipe of kdump(1) and figure out what memory has leaked. (alloctrace.py) >> 5) simple test program (test_utrace.c) >> >> […] > Have you looked at the heap profiling functionality built into jemalloc? It's not currently enabled on FreeBSD, but as far as I know, the only issue keeping it from being useful is the absence of a Linux-compatible /proc//maps (and the gperftools folks may already have a solution for that; I haven't looked). I think it makes more sense to get that sorted out than to develop a separate trace-based leak checker. The problem with tracing is that it doesn't scale beyond some relatively small number of allocator events. Ok, we are in agreement on this all. Paul Saab recommended profiling to me, but yes, the problem is that none of this stuff works on FreeBSD out of the box due to missing bits here or there. Augmenting the existing utrace stuff to get what I needed seemed much simpler than figuring out how to get dtrace, pidmaps and whatnot into the system. It's a matter of the requirements to accomplish these higher order things requires X=(skill+time+ability_to_socialize_these_changes) where X > alfred->skill_and_time_and_socialize(). :) To be honest, if dtrace just worked, then I could get the same information I'm getting from utrace2(2) from dtrace with no problem. (at least I think so). As far as scaling it, I agree it does not work for long running programs, however there are a few instances of programs leaking large memory in a short while that I can track down by temporarily ktracing for short while. >> Is it time to start installing with some form of debug symbols? This would help us also with dtrace. > Re: debug symbols, frame pointers, etc. necessary to make userland dtrace work by default, IMO we should strongly prefer such defaults. It's more reasonable to expect people who need every last bit of performance to remove functionality than to expect people who want to figure out what the system is doing to figure out what functionality to turn on. Yes!!! :) Is there an easy way to go about this? Rui says it's really a matter of just turning off stripping of shlibs and adding -fno-omit-frame-pointer and WITH_CTF. I'm going to give this a shot, if it works, can you help me refine this? I'll post diffs later today if I don't get completely stuck somehow. -Alfred From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 21:47:14 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0C8EF4F1; Sun, 23 Dec 2012 21:47:14 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-oa0-f49.google.com (mail-oa0-f49.google.com [209.85.219.49]) by mx1.freebsd.org (Postfix) with ESMTP id ABB1F8FC13; Sun, 23 Dec 2012 21:47:13 +0000 (UTC) Received: by mail-oa0-f49.google.com with SMTP id l10so6407183oag.36 for ; Sun, 23 Dec 2012 13:47:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=0+uKk8fLox5agYsGWr6jDNPQPSKd1VuNhXZlUtk8xvs=; b=GN50d6C0ocLOrK2W/bR0+NzEFiTWLB8CUYC8F+qhQhKqUtF8rYQQ0fv42xCfz3boUb c/68Nej5smhTqfPOcBVwkb9/auxzPTQaJ4pMSN3LIdwnfcZMgUZhUtSNFWOdYa58UAqD Ld1jlfR6LN99H+9zCZ/OHg26hvVV47frrG63CeQLQjgIvy3PbugDBBS6t2oY7/N5zNio RHRXLJHRZeNJ01MKM3YFn6y4+zGVD1EJ1zY6yX9CKt+pjjZCKXntaaXlUHheqTVAH5I3 JAU20hoicVvolURdsWYSwkoL0dXIdRjgcBfSHw7mVa6zwhGIb5Amb7gorET8Nt8YwjJ/ rc/A== MIME-Version: 1.0 Received: by 10.60.172.164 with SMTP id bd4mr4540394oec.51.1356299227418; Sun, 23 Dec 2012 13:47:07 -0800 (PST) Received: by 10.76.143.33 with HTTP; Sun, 23 Dec 2012 13:47:07 -0800 (PST) In-Reply-To: References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> Date: Sun, 23 Dec 2012 13:47:07 -0800 Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files From: Garrett Cooper To: Ed Maste Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 21:47:14 -0000 On Sun, Dec 23, 2012 at 8:26 AM, Ed Maste wrote: > On 22 December 2012 23:13, Alfred Perlstein wrote: >> I have a patch for this. I am building world to see what happens, if you >> want to try it, or comment on it, please let me know. >> >> Changes are: >> base DEBUGDIR on LIBDIR for ports >> create intermediate directories for debug objs. > > Note that just moving ports debug data to /usr/local/lib/debug/... > won't work since GDB won't search there. We could teach it to search > a list of paths and include /usr/local/lib/debug and /usr/lib/debug, > or perhaps a symlink under /usr/local/lib. > > We could also use a .debug subdirectory for ports and other users of > bsd.lib.mk - so for example /usr/local/lib/libfoo.so would have debug > info in /usr/local/lib/.debug/libfoo.so.debug. Crazy idea: why not just provide the user with an example .gdbinit that does these things? For Isilon it makes more sense to tack on additional paths (which we already do in our internal directions), and others potentially are doing similar *shrugs*, so as long as the example makes sense, I'd stick with it. I would probably setup things in such a way that the old default is kept though because I'm sure that there's someone out there that's using it (even it it's not *the best* default per how we prefix things in ports). Thanks! -Garrett From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 21:53:46 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E4FA5993; Sun, 23 Dec 2012 21:53:46 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-ob0-f179.google.com (mail-ob0-f179.google.com [209.85.214.179]) by mx1.freebsd.org (Postfix) with ESMTP id 980F08FC12; Sun, 23 Dec 2012 21:53:46 +0000 (UTC) Received: by mail-ob0-f179.google.com with SMTP id x4so6139125obh.24 for ; Sun, 23 Dec 2012 13:53:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Ed+cea7/+wqoU8B1pKhTZpB1B6G2Z3vFBgANNF2eS8s=; b=VU8hBTTktLeo+3CZljICoBAMBnxlZ49x5iaZGu5hjJCMyvlRW22x1nOFdeolF20FF+ 8zLXS5zkQrzvwR8dwjmjVWUy5bTOcvoeF84n+dQBWQapAEcw0QRmGAgzdrbKn3OZJwNE cLgIDDj/1NHndXV3nBYuWOVu/oQrNynJxo+r7tQl3HoK9OEw2d3OVFga3yDY4C6Zrk2Z i+sE1S2wOOSAgtsJdfnpwNrENGDNiNdlMvFb3AhlC40bLrCTv+rYvUG4pNM491n5Lsbe dYT2TuohWTV6/ck9Q2ldgBsZoYd7NzpHVcFPiPV6bHs2hvLmYxbDDI1AGOLB0yFjzVqn KQoA== MIME-Version: 1.0 Received: by 10.182.95.205 with SMTP id dm13mr16656131obb.9.1356299619849; Sun, 23 Dec 2012 13:53:39 -0800 (PST) Received: by 10.76.143.33 with HTTP; Sun, 23 Dec 2012 13:53:39 -0800 (PST) In-Reply-To: <50D708C6.6060801@FreeBSD.org> References: <50D708C6.6060801@FreeBSD.org> Date: Sun, 23 Dec 2012 13:53:39 -0800 Message-ID: Subject: Re: uart: add resume method From: Garrett Cooper To: Andriy Gapon Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 21:53:47 -0000 On Sun, Dec 23, 2012 at 5:36 AM, Andriy Gapon wrote: > > Guys, > > do you think that the following change is useful/needed? > > I needed it with UART emulated in qemu, but I have no experience with real hardware. I assume that you suspended the emulator and the UART didn't come back to life? Thanks, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Sun Dec 23 22:59:39 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E596961A; Sun, 23 Dec 2012 22:59:39 +0000 (UTC) (envelope-from bright@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id C2CD08FC0A; Sun, 23 Dec 2012 22:59:39 +0000 (UTC) Received: from Alfreds-MacBook-Pro-9.local (c-67-180-208-218.hsd1.ca.comcast.net [67.180.208.218]) by elvis.mu.org (Postfix) with ESMTPSA id 1DF8F1A3C2B; Sun, 23 Dec 2012 14:59:39 -0800 (PST) Message-ID: <50D78CDF.9010605@mu.org> Date: Sun, 23 Dec 2012 14:59:43 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Garrett Cooper Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org, Ed Maste X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2012 22:59:40 -0000 On 12/23/12 1:47 PM, Garrett Cooper wrote: > On Sun, Dec 23, 2012 at 8:26 AM, Ed Maste wrote: >> On 22 December 2012 23:13, Alfred Perlstein wrote: >>> I have a patch for this. I am building world to see what happens, if you >>> want to try it, or comment on it, please let me know. >>> >>> Changes are: >>> base DEBUGDIR on LIBDIR for ports >>> create intermediate directories for debug objs. >> Note that just moving ports debug data to /usr/local/lib/debug/... >> won't work since GDB won't search there. We could teach it to search >> a list of paths and include /usr/local/lib/debug and /usr/lib/debug, >> or perhaps a symlink under /usr/local/lib. >> >> We could also use a .debug subdirectory for ports and other users of >> bsd.lib.mk - so for example /usr/local/lib/libfoo.so would have debug >> info in /usr/local/lib/.debug/libfoo.so.debug. > Crazy idea: why not just provide the user with an example .gdbinit > that does these things? For Isilon it makes more sense to tack on > additional paths (which we already do in our internal directions), and > others potentially are doing similar *shrugs*, so as long as the > example makes sense, I'd stick with it. > I would probably setup things in such a way that the old default > is kept though because I'm sure that there's someone out there that's > using it (even it it's not *the best* default per how we prefix things > in ports). It's not a crazy idea, it's pretty good, however what it really turns into is another "not out of the box working easy" thing. Stuff like this should "just work". And if it doesn't, then we need to think harder about it. -Alfred From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 01:25:30 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 565B6AC5 for ; Mon, 24 Dec 2012 01:25:30 +0000 (UTC) (envelope-from lists@eitanadler.com) Received: from mail-la0-f42.google.com (mail-la0-f42.google.com [209.85.215.42]) by mx1.freebsd.org (Postfix) with ESMTP id BBE578FC14 for ; Mon, 24 Dec 2012 01:25:29 +0000 (UTC) Received: by mail-la0-f42.google.com with SMTP id s15so7952548lag.29 for ; Sun, 23 Dec 2012 17:25:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=eitanadler.com; s=0xdeadbeef; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=GK6xkya02xiQAx7Y74Rf7HPSsKyuiMOhxhYDsjRHQrU=; b=YiubFNcc58hap3juQz9JbHRQ6H62YDjXtnu47opml0DE3GW0w3DEGGdb3IUufu5Y6l Pn4yyD5nPHrnyejfrqHlhYRv4HqfP8r8OVoCU8csIxRfRZBbcO1EG6Ho7S4WXvs1lk64 a24aVUG++Pj8vMzaYqrEgKZcHzU4Cl4Ltewnc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:x-gm-message-state; bh=GK6xkya02xiQAx7Y74Rf7HPSsKyuiMOhxhYDsjRHQrU=; b=Pyrkskemhs9m1yy0Tx8FxQ4vDEcTiWB7WbSalpzx9miBMQY+xh3WQLco+4owEKPdKL Yj11c03XFKQ5qNDzALuotepOlKEFbdoJhIxDBaibbVEPq2WdfL40kr/vIH1B9y+2qgj5 SrV5UGsU6J/dpQkkG2ijl6GbGHxePftpxwFOJnID8VWPuw5AM4MD1MfuQ2KJx05bmckk yXgQJzlr9efnxMgkVBtvYwRjjr11ZNgd3kDzLhZzPL92iBNw1ABMUz9yM22hXLKvTndr qRrm5CDP97mCrjej6DdAChwFxWt71hhZhiD4Dp8mKR5Ri3XkrOMIHq0N+wzoVV46/J4g y6bA== Received: by 10.112.25.70 with SMTP id a6mr8092755lbg.117.1356312328166; Sun, 23 Dec 2012 17:25:28 -0800 (PST) MIME-Version: 1.0 Received: by 10.112.162.100 with HTTP; Sun, 23 Dec 2012 17:24:57 -0800 (PST) In-Reply-To: References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> From: Eitan Adler Date: Sun, 23 Dec 2012 20:24:57 -0500 Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files To: Garrett Cooper Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQm5P5TfAFTM09/Z+BJL7d4U0CU368HQ6Tcbok0u2phiL1w7CDtl1zWP0RSqJSctvAgEVEpD Cc: freebsd-hackers@freebsd.org, Ed Maste X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 01:25:30 -0000 On 23 December 2012 16:47, Garrett Cooper wrote: > I would probably setup things in such a way that the old default > is kept though because I'm sure that there's someone out there that's > using it (even it it's not *the best* default per how we prefix things > in ports). If the old defaults aren't the best defaults - I'd change them. If someone depends on the old defaults they should be explicitly set. POLA should not impede progress. -- Eitan Adler From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 02:22:42 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 99539217; Mon, 24 Dec 2012 02:22:42 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-ob0-f174.google.com (mail-ob0-f174.google.com [209.85.214.174]) by mx1.freebsd.org (Postfix) with ESMTP id 432038FC0A; Mon, 24 Dec 2012 02:22:42 +0000 (UTC) Received: by mail-ob0-f174.google.com with SMTP id ta14so6297252obb.5 for ; Sun, 23 Dec 2012 18:22:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Hzqtmq9/srdHK86u4AX8LDsjbrZ/4KYvwBuC7ySo924=; b=v59z+ME/KbqymMNzP2mh95W6kVyrB2xJhVamJmIJNbCbpA7yRlDev5tdDL8QUUxlLe aAnFH7dz1heVfdOS1WoWosVRwCz2EqhFtRzXzETMmlGgSebtpN6F2+E7k/0xdBxKRhAx 8wGtMej+cz6N3UF3VpcvUXOTEH6oUX1gAxIH0OQatl05sSsEhYW1PWJrx92joKoizGCp nuk4ZRzT4QT1YqjnrBWQQlceA7W3iQDJS2uGJxGDq8adKQV5b0Ehk+8AzdS3jWwYV1fG QKMPapKClRFZjpllM6dBW5/Owo3MkSoIi2kHVhqrG+kzWDL+K7yBE1/JyW8DiUyasXmT FQjw== MIME-Version: 1.0 Received: by 10.60.172.164 with SMTP id bd4mr4877830oec.51.1356315761514; Sun, 23 Dec 2012 18:22:41 -0800 (PST) Received: by 10.76.143.33 with HTTP; Sun, 23 Dec 2012 18:22:41 -0800 (PST) In-Reply-To: References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> Date: Sun, 23 Dec 2012 18:22:41 -0800 Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files From: Garrett Cooper To: Eitan Adler Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org, Ed Maste X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 02:22:42 -0000 On Sun, Dec 23, 2012 at 5:24 PM, Eitan Adler wrote: > On 23 December 2012 16:47, Garrett Cooper wrote: >> I would probably setup things in such a way that the old default >> is kept though because I'm sure that there's someone out there that's >> using it (even it it's not *the best* default per how we prefix things >> in ports). > > If the old defaults aren't the best defaults - I'd change them. If > someone depends on the old defaults they should be explicitly set. > POLA should not impede progress. Good point. Should this be documented in UPDATING? Thanks, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 03:17:57 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DD84770A; Mon, 24 Dec 2012 03:17:57 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-oa0-f46.google.com (mail-oa0-f46.google.com [209.85.219.46]) by mx1.freebsd.org (Postfix) with ESMTP id 8B4D28FC13; Mon, 24 Dec 2012 03:17:57 +0000 (UTC) Received: by mail-oa0-f46.google.com with SMTP id h16so6445482oag.19 for ; Sun, 23 Dec 2012 19:17:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=tu3uOoQn7o5/xqV98hGGdwcgoxV6SsK1ev8S9IqYc6I=; b=vNyMdaqcixzsO0B4CdMjw8JwCnOST4XFFP4echdO4TOQ0sY/a8p4BnD/FHqngHXvlA yBWb7Rn66/e6BykJFS+GYaNHXBCZob/noECDmzGilRkg12H7zdpFBBfUCJfrkEXzrf3q v4sUaNz7IRRpzdZoCZQX4l14y00A3erELQrNa7uv8Ukz0XBIleHlp/8ZI0HD3TpGfXVX rry4eL2jLUmvXmmHxXIcgR26XE6+Vb/zc92utEnGkLiMgiJUbLz6gC8oCcBp8TDa78FJ 94Q9A166X/AV8TkZ8/aER6zwEDsPKo0JycC5JG/IdY9Gg8ahb9s8LTbUkRYZmBnkL7BN GVVA== MIME-Version: 1.0 Received: by 10.60.0.165 with SMTP id 5mr5439020oef.128.1356319071445; Sun, 23 Dec 2012 19:17:51 -0800 (PST) Received: by 10.76.143.33 with HTTP; Sun, 23 Dec 2012 19:17:50 -0800 (PST) In-Reply-To: <50D684D7.8050906@mu.org> References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> Date: Sun, 23 Dec 2012 19:17:50 -0800 Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files From: Garrett Cooper To: Alfred Perlstein Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org, Ed Maste , Jan Beich X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 03:17:57 -0000 On Sat, Dec 22, 2012 at 8:13 PM, Alfred Perlstein wrote: > On 12/22/12 6:14 PM, Jan Beich wrote: >> >> Ed Maste writes: >> >>> When this knob is set standalone debug files for shared objects are >>> built and installed in /usr/lib/debug/.debug. GDB >>> searches this path for debug data. >> >> [...] >> What about ports? They are not allowed to install outside of PREFIX. >> >> $ cd multimedia/cuse4bsd-kmod >> $ make install PREFIX=/tmp/aaa PKG_DBDIR=/tmp/pkg WITH_DEBUG= >> [...] >> install -C -o root -g wheel -m 444 libcuse4bsd.a /tmp/aaa/lib >> install -s -o root -g wheel -m 444 libcuse4bsd.so.1 /tmp/aaa/lib >> install -o root -g wheel -m 444 libcuse4bsd.so.1.debug >> /usr/lib/debug/tmp/aaa/lib >> install: /usr/lib/debug/tmp/aaa/lib: No such file or directory >> *** [_libinstall] Error code 71 > > I have a patch for this. I am building world to see what happens, if you > want to try it, or comment on it, please let me know. > > Changes are: > base DEBUGDIR on LIBDIR for ports > create intermediate directories for debug objs. One thing about this (and the original patch) that may or may not make sense is that DEBUGDIR should be undefined and passed in via CFLAGS in the Makefile (reason being is that it would reduce duplication IMO and it's less duplicated magic juju hanging around some gdb header files). Another thing that might be a good idea is that the changes in bsd.lib.mk diverge from standard expectations for the file extension (.symbols -> .debug), so at the very least this should be documented. Finally, what about debug symbols for programs (bsd.prog.mk)? I assume that's coming soon, but I figured I should ask :). Thanks! -Garrett PS Awesome solution for the ports issue :). From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 03:20:20 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 10418837; Mon, 24 Dec 2012 03:20:20 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-ob0-f180.google.com (mail-ob0-f180.google.com [209.85.214.180]) by mx1.freebsd.org (Postfix) with ESMTP id B14178FC0A; Mon, 24 Dec 2012 03:20:19 +0000 (UTC) Received: by mail-ob0-f180.google.com with SMTP id wd20so6407869obb.11 for ; Sun, 23 Dec 2012 19:20:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=f4sPPK9uRi4faQi6PLqtxXXn9IBHSFs8f9mFrnpQ4KM=; b=c1eAWeLRvJlVO0CpkotjhzZx+DD4C+4gAKn04jxR11f8mZ589yjmg/++tucwns/s+q 5k0LbRKAE+z+AnmL8BF8PS64JzP0EfTuF72g3MGA0QdztFRCutAWt2D5Y0VxFid+8F2Z 9FacCNv2U4f9dXny0qF5XpPI8EiTbHOByVbgTvyvlLo/g13QYFaclUh2rtAIkko/5vk/ 0zfizNMTSrEiLGM/JISHpTteBaf9xo/kYgTg6wGY7N4V163uQQ3sHc8TYq1xB/dLaQgx X0CEMgLGbN35SM+pwzckcILYJxprX1Z1K6HP++0vX2yYTKOrnZvpqdjxwO3mzjm5oHnw CdTg== MIME-Version: 1.0 Received: by 10.182.172.74 with SMTP id ba10mr16853361obc.83.1356319213062; Sun, 23 Dec 2012 19:20:13 -0800 (PST) Received: by 10.76.143.33 with HTTP; Sun, 23 Dec 2012 19:20:12 -0800 (PST) In-Reply-To: <50D699E3.3090606@mu.org> References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> <50D699E3.3090606@mu.org> Date: Sun, 23 Dec 2012 19:20:12 -0800 Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files From: Garrett Cooper To: Alfred Perlstein Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org, Ed Maste , Jan Beich X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 03:20:20 -0000 On Sat, Dec 22, 2012 at 9:42 PM, Alfred Perlstein wrote: ... > Buildworld breaks with this for me using my patch, no idea what this all > means yet. Will look into it: > > exer.c -o nslexer.So > ctfconvert -L VERSION crypt_xdr.o > ctfconvert -L VERSION crypt_clnt.o > ctfconvert -L VERSION nsparser.So > ctfconvert -L VERSION nsparser.o > ctfconvert -L VERSION crypt_clnt.So > ctfconvert -L VERSION crypt_xdr.So > ctfconvert -L VERSION yp_xdr.o > ctfconvert -L VERSION subr_acl_nfs4.So > ctfconvert -L VERSION nslexer.o > ctfconvert -L VERSION yp_xdr.So > ctfconvert -L VERSION subr_acl_nfs4.o > building static c library > ctfconvert -L VERSION nslexer.So > building shared library libc.so.7 > building special pic c library > BFD: dlfcn.o: invalid SHT_GROUP entry > BFD: dlfcn.o: invalid SHT_GROUP entry > BFD: dlfcn.o: invalid SHT_GROUP entry > BFD: dlfcn.o: invalid SHT_GROUP entry > BFD: dlfcn.o: no group info for section .text._rtld_error > BFD: dlfcn.o: no group info for section .text.dladdr > BFD: dlfcn.o: no group info for section .text.dlclose > BFD: dlfcn.o: no group info for section .text.dlerror > BFD: dlfcn.o: no group info for section .text.dllockinit > BFD: dlfcn.o: no group info for section .text.dlopen > BFD: dlfcn.o: no group info for section .text.dlsym > BFD: dlfcn.o: no group info for section .text.dlvsym > BFD: dlfcn.o: no group info for section .text.dlinfo > BFD: dlfcn.o: no group info for section .text._rtld_thread_init > BFD: dlfcn.o: no group info for section .text._rtld_atfork_post > BFD: dlfcn.o: no group info for section .text._rtld_get_stack_prot > nm: dlfcn.o: File format not recognized > BFD: elf_utils.o: invalid SHT_GROUP entry > BFD: elf_utils.o: no group info for section .text.__pthread_map_stacks_exec > BFD: elf_utils.o: unknown [0] section `' in group > [__pthread_map_stacks_exec] > nm: elf_utils.o: File format not recognized > ranlib libc_pic.a > BFD: __vdso_gettc.o: invalid SHT_GROUP entry > BFD: __vdso_gettc.o: no group info for section .text.__vdso_gettc > BFD: __vdso_gettc.o: unknown [0] section `' in group [__vdso_gettc] > nm: __vdso_gettc.o: File format not recognized > BFD: __vdso_gettimeofday.o: invalid SHT_GROUP entry > BFD: __vdso_gettimeofday.o: invalid SHT_GROUP entry > BFD: __vdso_gettimeofday.o: no group info for section > .text.__vdso_gettimeofday > BFD: __vdso_gettimeofday.o: no group info for section > .text.__vdso_clock_gettime > BFD: __vdso_gettimeofday.o: unknown [0] section `' in group > [__vdso_gettimeofday] > BFD: __vdso_gettimeofday.o: unknown [0] section `' in group > [__vdso_clock_gettime] > nm: __vdso_gettimeofday.o: File format not recognized > BFD: dlfcn.So: invalid SHT_GROUP entry > BFD: dlfcn.So: invalid SHT_GROUP entry > BFD: dlfcn.So: invalid SHT_GROUP entry > BFD: dlfcn.So: invalid SHT_GROUP entry > BFD: dlfcn.So: no group info for section .text._rtld_error > BFD: dlfcn.So: no group info for section .text.dladdr > BFD: dlfcn.So: no group info for section .text.dlclose > BFD: dlfcn.So: no group info for section .text.dlerror > BFD: dlfcn.So: no group info for section .text.dllockinit > BFD: dlfcn.So: no group info for section .text.dlopen > BFD: dlfcn.So: no group info for section .text.dlsym > BFD: dlfcn.So: no group info for section .text.dlvsym > BFD: dlfcn.So: no group info for section .text.dlinfo > BFD: dlfcn.So: no group info for section .text._rtld_thread_init > BFD: dlfcn.So: no group info for section .text._rtld_atfork_post > BFD: dlfcn.So: no group info for section .text._rtld_get_stack_prot > BFD: dlfcn.So: unknown [2] section `.symtab' in group [dl_iterate_phdr] > BFD: dlfcn.So: unknown [0] section `' in group [_rtld_atfork_pre] > BFD: dlfcn.So: unknown [0] section `' in group [_rtld_atfork_post] > BFD: dlfcn.So: unknown [0] section `' in group [_rtld_addr_phdr] > BFD: dlfcn.So: unknown [0] section `' in group [_rtld_get_stack_prot] > nm: dlfcn.So: File format not recognized > BFD: elf_utils.So: invalid SHT_GROUP entry > BFD: elf_utils.So: no group info for section .text.__pthread_map_stacks_exec > BFD: elf_utils.So: unknown [0] section `' in group > [__pthread_map_stacks_exec] > nm: elf_utils.So: File format not recognized > BFD: __vdso_gettc.So: invalid SHT_GROUP entry > BFD: __vdso_gettc.So: no group info for section .text.__vdso_gettc > BFD: __vdso_gettc.So: unknown [0] section `' in group [__vdso_gettc] > nm: __vdso_gettc.So: File format not recognized > BFD: __vdso_gettimeofday.So: invalid SHT_GROUP entry > BFD: __vdso_gettimeofday.So: invalid SHT_GROUP entry > BFD: __vdso_gettimeofday.So: no group info for section > .text.__vdso_gettimeofday > BFD: __vdso_gettimeofday.So: no group info for section > .text.__vdso_clock_gettime > BFD: __vdso_gettimeofday.So: unknown [0] section `' in group > [__vdso_gettimeofday] > BFD: __vdso_gettimeofday.So: unknown [0] section `' in group > [__vdso_clock_gettime] > nm: __vdso_gettimeofday.So: File format not recognized > ranlib libc.a > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: > invalid SHT_GROUP entry > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: > invalid SHT_GROUP entry > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: no > group info for section .text.__vdso_gettimeofday > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: no > group info for section .text.__vdso_clock_gettime > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: > unknown [0] section `' in group [__vdso_gettimeofday] > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: > unknown [0] section `' in group [__vdso_clock_gettime] > __vdso_gettimeofday.So: file not recognized: File format not recognized > cc: error: linker command failed with exit code 1 (use -v to see invocation) > *** [libc.so.7.full] Error code 1 > 1 error > *** [lib/libc__L] Error code 2 > 1 error > *** [libraries] Error code 2 > 1 error > *** [_libraries] Error code 2 > 1 error > *** [buildworld] Error code 2 > 1 error Is RANLIB not being called properly (for lack of a better example: https://forums.oracle.com/forums/thread.jspa?messageID=8438118 )? Cheers, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 03:55:17 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 724BDAD9; Mon, 24 Dec 2012 03:55:17 +0000 (UTC) (envelope-from bright@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 5125B8FC0A; Mon, 24 Dec 2012 03:55:17 +0000 (UTC) Received: from Alfreds-MacBook-Pro-9.local (c-67-180-208-218.hsd1.ca.comcast.net [67.180.208.218]) by elvis.mu.org (Postfix) with ESMTPSA id 635621A3C6F; Sun, 23 Dec 2012 19:55:16 -0800 (PST) Message-ID: <50D7D229.6050302@mu.org> Date: Sun, 23 Dec 2012 19:55:21 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Garrett Cooper Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> <50D699E3.3090606@mu.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org, Ed Maste , Jan Beich X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 03:55:17 -0000 On 12/23/12 7:20 PM, Garrett Cooper wrote: > On Sat, Dec 22, 2012 at 9:42 PM, Alfred Perlstein wrote: > > ... > lfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: > invalid SHT_GROUP entry > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: no > group info for section .text.__vdso_gettimeofday > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: no > group info for section .text.__vdso_clock_gettime > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: > unknown [0] section `' in group [__vdso_gettimeofday] > /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: > unknown [0] section `' in group [__vdso_clock_gettime] > __vdso_gettimeofday.So: file not recognized: File format not recognized > cc: error: linker command failed with exit code 1 (use -v to see invocation) > *** [libc.so.7.full] Error code 1 > 1 error > *** [lib/libc__L] Error code 2 > 1 error > *** [libraries] Error code 2 > 1 error > *** [_libraries] Error code 2 > 1 error > *** [buildworld] Error code 2 > 1 error > Is RANLIB not being called properly (for lack of a better example: > https://forums.oracle.com/forums/thread.jspa?messageID=8438118 )? > Cheers, > -Garrett > I had "WITH_CTF=yes" in my /etc/make.conf so this appears to be fallout of WITH_CTF=yes. Basically this seems incompatible with dtrace unless I figure it out further. -Alfred From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 04:14:48 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B2C32115; Mon, 24 Dec 2012 04:14:48 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-wi0-f172.google.com (mail-wi0-f172.google.com [209.85.212.172]) by mx1.freebsd.org (Postfix) with ESMTP id 176C48FC13; Mon, 24 Dec 2012 04:14:47 +0000 (UTC) Received: by mail-wi0-f172.google.com with SMTP id o1so6204424wic.11 for ; Sun, 23 Dec 2012 20:14:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=51sU0aVoEbfuJ3zO4iLGKQPUi6hOH4sbki37iTo1ouw=; b=Kk7oHIzP/Q8l08QOa5hpb+I3rF8jw+/HCuvqoH6dJIIACFGuw+mTleZ1rXVY4B3qzV SFMImajyoXLtOWEtuhjU7icvea2kz5M+IhVxGDyXvU1icpgoYBLtv+FMFpkq55Keep1b 3NcRimTtuFSdVruXos+hFxEU3dNtQ9KuPaemMGTLirLstJqYttUohGXBdaoUXUw+owJ8 gxB9ZtZIJOFDj9Leqy5lRcxsobYjkFQZl44P2wTsV1MJ5pCTj033Hh5M+FjBI5d1vMe9 cYUfWHJl/BUkk09a1eOh+HiRqarjqnEsW6FiVKTDpgBq8IyzUCo5g7dgqBeVQSwMASO/ hWMg== MIME-Version: 1.0 Received: by 10.194.93.40 with SMTP id cr8mr33968745wjb.16.1356322486952; Sun, 23 Dec 2012 20:14:46 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.217.57.9 with HTTP; Sun, 23 Dec 2012 20:14:46 -0800 (PST) In-Reply-To: <50D7D229.6050302@mu.org> References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> <50D699E3.3090606@mu.org> <50D7D229.6050302@mu.org> Date: Sun, 23 Dec 2012 20:14:46 -0800 X-Google-Sender-Auth: P67xPLFbk9ZtJOkfxJmsWSYtjms Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files From: Adrian Chadd To: Alfred Perlstein Content-Type: text/plain; charset=ISO-8859-1 Cc: Garrett Cooper , freebsd-hackers@freebsd.org, Ed Maste , Jan Beich X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 04:14:48 -0000 On 23 December 2012 19:55, Alfred Perlstein wrote: > I had "WITH_CTF=yes" in my /etc/make.conf so this appears to be fallout of > WITH_CTF=yes. Basically this seems incompatible with dtrace unless I figure > it out further. Oh god, please figure this mess out. I'll take you out for drinks if you get dtrace kernel+user debugging working out of the box in -HEAD and stable/9. Adrian From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 04:36:14 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3342A400; Mon, 24 Dec 2012 04:36:14 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-oa0-f49.google.com (mail-oa0-f49.google.com [209.85.219.49]) by mx1.freebsd.org (Postfix) with ESMTP id CF49D8FC15; Mon, 24 Dec 2012 04:36:13 +0000 (UTC) Received: by mail-oa0-f49.google.com with SMTP id l10so6405072oag.22 for ; Sun, 23 Dec 2012 20:36:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=4jLgzCIrrHtjuUuu/qVjCeQDKMPrfJXIJOFCLMslN1A=; b=TEx62N5lw7G7bJZcMKm+72BGD6mI+lhEGPPxIZgDTK6yl8AzpQxVukSoc8h30H3W7J c6NxgGXja6E2ylBh3zkl/m3pYiVK9dzIG9OVZw/dQi+ASr6fbhWVwsbvlIA+Zv3W7xQb s0LF3rHAfqCciklpdA4w3o6BfThHygB38K/69IOQdEwUbR+fwgYCRE5U0/Onr9i53VME yjyxV+d2KDgWyoVTdgl+1jmsdQ3afBwSnj4knZtHiHdwrEqt9VxtCRO23JdQko99TSRB fz1HK7Sz09cZPi4QWhcLC35rupaQKj3wnft5C8c/5X/XN6Uvuua9cjux/dBN5oZZteqP 6lPg== MIME-Version: 1.0 Received: by 10.60.3.167 with SMTP id d7mr4933647oed.85.1356323773040; Sun, 23 Dec 2012 20:36:13 -0800 (PST) Received: by 10.76.34.98 with HTTP; Sun, 23 Dec 2012 20:36:12 -0800 (PST) Received: by 10.76.34.98 with HTTP; Sun, 23 Dec 2012 20:36:12 -0800 (PST) In-Reply-To: <50D7D229.6050302@mu.org> References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> <50D699E3.3090606@mu.org> <50D7D229.6050302@mu.org> Date: Sun, 23 Dec 2012 23:36:12 -0500 Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files From: Mark Johnston To: Alfred Perlstein Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: Garrett Cooper , freebsd-hackers@freebsd.org, Ed Maste , Jan Beich X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 04:36:14 -0000 On Dec 23, 2012 10:55 PM, "Alfred Perlstein" wrote: > > On 12/23/12 7:20 PM, Garrett Cooper wrote: >> >> On Sat, Dec 22, 2012 at 9:42 PM, Alfred Perlstein wrote: >> >> ... >> lfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: >> invalid SHT_GROUP entry >> /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: no >> group info for section .text.__vdso_gettimeofday >> /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: no >> group info for section .text.__vdso_clock_gettime >> /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: >> unknown [0] section `' in group [__vdso_gettimeofday] >> /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: >> unknown [0] section `' in group [__vdso_clock_gettime] >> __vdso_gettimeofday.So: file not recognized: File format not recognized >> cc: error: linker command failed with exit code 1 (use -v to see invocation) >> *** [libc.so.7.full] Error code 1 >> 1 error >> *** [lib/libc__L] Error code 2 >> 1 error >> *** [libraries] Error code 2 >> 1 error >> *** [_libraries] Error code 2 >> 1 error >> *** [buildworld] Error code 2 >> 1 error >> Is RANLIB not being called properly (for lack of a better example: >> https://forums.oracle.com/forums/thread.jspa?messageID=8438118 )? >> Cheers, >> -Garrett >> > I had "WITH_CTF=yes" in my /etc/make.conf so this appears to be fallout of WITH_CTF=yes. Basically this seems incompatible with dtrace unless I figure it out further. I have WITH_CTF=YES in src.conf and I've been able to complete a buildworld+installworld with an extension of this patch. The errors are also occurring before objcopy has done anything, so I don't see why they might be related. From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 04:39:35 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 617DA4FD; Mon, 24 Dec 2012 04:39:35 +0000 (UTC) (envelope-from bright@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 3B6CF8FC0A; Mon, 24 Dec 2012 04:39:35 +0000 (UTC) Received: from Alfreds-MacBook-Pro-9.local (127.sub-174-254-231.myvzw.com [174.254.231.127]) by elvis.mu.org (Postfix) with ESMTPSA id F16581A3CB4; Sun, 23 Dec 2012 20:39:28 -0800 (PST) Message-ID: <50D7DC85.4060902@mu.org> Date: Sun, 23 Dec 2012 20:39:33 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Mark Johnston Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> <50D699E3.3090606@mu.org> <50D7D229.6050302@mu.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: Garrett Cooper , freebsd-hackers@freebsd.org, Ed Maste , Jan Beich X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 04:39:35 -0000 On 12/23/12 8:36 PM, Mark Johnston wrote: > > > On Dec 23, 2012 10:55 PM, "Alfred Perlstein" > wrote: > > > > On 12/23/12 7:20 PM, Garrett Cooper wrote: > >> > >> On Sat, Dec 22, 2012 at 9:42 PM, Alfred Perlstein > wrote: > >> > >> ... > >> lfred/freebsd/tmp/usr/bin/ld: __vdso_gettimeofday.So: > >> invalid SHT_GROUP entry > >> /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: > __vdso_gettimeofday.So: no > >> group info for section .text.__vdso_gettimeofday > >> /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: > __vdso_gettimeofday.So: no > >> group info for section .text.__vdso_clock_gettime > >> /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: > __vdso_gettimeofday.So: > >> unknown [0] section `' in group [__vdso_gettimeofday] > >> /usr/obj/usr/home/alfred/freebsd/tmp/usr/bin/ld: > __vdso_gettimeofday.So: > >> unknown [0] section `' in group [__vdso_clock_gettime] > >> __vdso_gettimeofday.So: file not recognized: File format not recognized > >> cc: error: linker command failed with exit code 1 (use -v to see > invocation) > >> *** [libc.so.7.full] Error code 1 > >> 1 error > >> *** [lib/libc__L] Error code 2 > >> 1 error > >> *** [libraries] Error code 2 > >> 1 error > >> *** [_libraries] Error code 2 > >> 1 error > >> *** [buildworld] Error code 2 > >> 1 error > >> Is RANLIB not being called properly (for lack of a better example: > >> https://forums.oracle.com/forums/thread.jspa?messageID=8438118 )? > >> Cheers, > >> -Garrett > >> > > I had "WITH_CTF=yes" in my /etc/make.conf so this appears to be > fallout of WITH_CTF=yes. Basically this seems incompatible with > dtrace unless I figure it out further. > > I have WITH_CTF=YES in src.conf and I've been able to complete a > buildworld+installworld with an extension of this patch. The errors > are also occurring > before objcopy has done anything, so I don't see why they might be > related. > care to post the patch? I rm-rf'd all of /usr/obj and tried twice before removing WITH_CTF to get through it. -Alfred From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 04:42:07 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E19165F9; Mon, 24 Dec 2012 04:42:07 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-oa0-f47.google.com (mail-oa0-f47.google.com [209.85.219.47]) by mx1.freebsd.org (Postfix) with ESMTP id 8A0788FC12; Mon, 24 Dec 2012 04:42:07 +0000 (UTC) Received: by mail-oa0-f47.google.com with SMTP id h1so6405878oag.6 for ; Sun, 23 Dec 2012 20:42:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=xepCl21NmaZeEsKPWSJt6FJHroC22KjJbCtt/uxh9Cs=; b=erINL3vyoimXZ1rjOUtadT4NIH+7iDKFaHLUBBj1iCA/TCXvXkuyuR4Ne+tWcBTVwu fhULAqul3Sl0Ja6DR7HLYoW71FDgpf0k4Q0oXmRm8lRj9ZoryX2RLGrTcUNY+DuFRtsz HQtLM5rOMlvu37OT3aFztiFRNo4igw6tGggoLQeJW+qJX2AN6N0lzlgCVR8JJA/sOtgV gbvC6k6kHWwWXYOrJn60yKQeZIbW7VXQFNnCYCufs4CKr8Y9TqqUW30vioI920GE91P/ oceG6RR2Guv76kED8r2vu7sTpjwGGYBz5ygqrIPs/9cE7+F+/GEY4eGmgJlUF+KW4+8Z TKog== MIME-Version: 1.0 Received: by 10.60.3.167 with SMTP id d7mr4940638oed.85.1356324120988; Sun, 23 Dec 2012 20:42:00 -0800 (PST) Received: by 10.76.34.98 with HTTP; Sun, 23 Dec 2012 20:42:00 -0800 (PST) Received: by 10.76.34.98 with HTTP; Sun, 23 Dec 2012 20:42:00 -0800 (PST) In-Reply-To: References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> Date: Sun, 23 Dec 2012 23:42:00 -0500 Message-ID: Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files From: Mark Johnston To: Garrett Cooper Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: freebsd-hackers@freebsd.org, Alfred Perlstein , Ed Maste , Jan Beich X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 04:42:08 -0000 On Dec 23, 2012 10:18 PM, "Garrett Cooper" wrote: > > On Sat, Dec 22, 2012 at 8:13 PM, Alfred Perlstein wrote: > > On 12/22/12 6:14 PM, Jan Beich wrote: > >> > >> Ed Maste writes: > >> > >>> When this knob is set standalone debug files for shared objects are > >>> built and installed in /usr/lib/debug/.debug. GDB > >>> searches this path for debug data. > >> > >> [...] > >> What about ports? They are not allowed to install outside of PREFIX. > >> > >> $ cd multimedia/cuse4bsd-kmod > >> $ make install PREFIX=/tmp/aaa PKG_DBDIR=/tmp/pkg WITH_DEBUG= > >> [...] > >> install -C -o root -g wheel -m 444 libcuse4bsd.a /tmp/aaa/lib > >> install -s -o root -g wheel -m 444 libcuse4bsd.so.1 /tmp/aaa/lib > >> install -o root -g wheel -m 444 libcuse4bsd.so.1.debug > >> /usr/lib/debug/tmp/aaa/lib > >> install: /usr/lib/debug/tmp/aaa/lib: No such file or directory > >> *** [_libinstall] Error code 71 > > > > I have a patch for this. I am building world to see what happens, if you > > want to try it, or comment on it, please let me know. > > > > Changes are: > > base DEBUGDIR on LIBDIR for ports > > create intermediate directories for debug objs. > > One thing about this (and the original patch) that may or may not > make sense is that DEBUGDIR should be undefined and passed in via > CFLAGS in the Makefile (reason being is that it would reduce > duplication IMO and it's less duplicated magic juju hanging around > some gdb header files). FWIW, newer versions of gdb have done this. > Another thing that might be a good idea is that the changes in > bsd.lib.mk diverge from standard expectations for the file extension > (.symbols -> .debug), so at the very least this should be documented. > Finally, what about debug symbols for programs (bsd.prog.mk)? I > assume that's coming soon, but I figured I should ask :). I have an extension of Ed's patch which handles bsd.prog.mk at http://people.freebsd.org/~markj/patches/debug_symbols/debug_symbols_full.patch > Thanks! > -Garrett > > PS Awesome solution for the ports issue :). > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 06:55:00 2012 Return-Path: Delivered-To: freebsd-hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 89407296 for ; Mon, 24 Dec 2012 06:55:00 +0000 (UTC) (envelope-from avg@FreeBSD.org) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id C6D088FC0C for ; Mon, 24 Dec 2012 06:54:59 +0000 (UTC) Received: from porto.starpoint.kiev.ua (porto-e.starpoint.kiev.ua [212.40.38.100]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id IAA00279; Mon, 24 Dec 2012 08:54:56 +0200 (EET) (envelope-from avg@FreeBSD.org) Received: from localhost ([127.0.0.1]) by porto.starpoint.kiev.ua with esmtp (Exim 4.34 (FreeBSD)) id 1Tn1w8-000GjK-Et; Mon, 24 Dec 2012 08:54:56 +0200 Message-ID: <50D7FC3D.9090006@FreeBSD.org> Date: Mon, 24 Dec 2012 08:54:53 +0200 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Garrett Cooper Subject: Re: uart: add resume method References: <50D708C6.6060801@FreeBSD.org> In-Reply-To: X-Enigmail-Version: 1.4.6 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@FreeBSD.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 06:55:00 -0000 on 23/12/2012 23:53 Garrett Cooper said the following: > On Sun, Dec 23, 2012 at 5:36 AM, Andriy Gapon wrote: >> >> Guys, >> >> do you think that the following change is useful/needed? >> >> I needed it with UART emulated in qemu, but I have no experience with real hardware. > > I assume that you suspended the emulator and the UART didn't come > back to life? No, I executed acpiconf -s 3 in the guest and then system_wakeup in the qemu monitoring console. -- Andriy Gapon From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 17:45:24 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6DFA534D; Mon, 24 Dec 2012 17:45:24 +0000 (UTC) (envelope-from bright@mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 49A5D8FC0C; Mon, 24 Dec 2012 17:45:24 +0000 (UTC) Received: from Alfreds-MacBook-Pro-9.local (c-67-180-208-218.hsd1.ca.comcast.net [67.180.208.218]) by elvis.mu.org (Postfix) with ESMTPSA id 0C1371A3CD2; Mon, 24 Dec 2012 09:45:23 -0800 (PST) Message-ID: <50D894B9.2030008@mu.org> Date: Mon, 24 Dec 2012 09:45:29 -0800 From: Alfred Perlstein User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Mark Johnston Subject: Re: [PATCH] Add WITH_DEBUG_FILES knob to enable separate debug files References: <20121222164602.GB32022@sandvine.com> <1Tmb5f-000Jy5-CT@internal.tormail.org> <50D684D7.8050906@mu.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Garrett Cooper , freebsd-hackers@freebsd.org, Ed Maste , Jan Beich X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 17:45:24 -0000 On 12/23/12 8:42 PM, Mark Johnston wrote: > I have an extension of Ed's patch which handles bsd.prog.mk at > http://people.freebsd.org/~markj/patches/debug_symbols/debug_symbols_full.patch I am probably doing something wrong, but I am still getting that build error: > BFD: __vdso_gettimeofday.So: invalid SHT_GROUP entry > BFD: __vdso_gettimeofday.So: invalid SHT_GROUP entry > BFD: __vdso_gettimeofday.So: no group info for section > .text.__vdso_gettimeofday > BFD: __vdso_gettimeofday.So: no group info for section > .text.__vdso_clock_gettime with the following flags set: ~/freebsd % cat /etc/make.conf KERNCONF?=VBOX_NOWITNESS # added by use.perl 2012-11-05 11:50:32 PERL_VERSION=5.14.2 .(02:35:34)(alfred@spigot) ~/freebsd % cat /etc/src.conf WITH_CTF=1 WITH_DEBUG_FILES=1 .(02:35:37)(alfred@spigot) /usr/home/alfred/freebsd # printenv _=/usr/bin/printenv SCRIPT=typescript COVERITY_WORKDIR=/root/coverity-output COVERITY_DATADIR=/root/coverity-database COVERITY_UNSUPPORTED=1 PAGER=more PKG_CONFIG=/p/lib/pkgconfig ZPROFILE_SOURCED=yes CVS_RSH=ssh EDITOR=vi PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/root/bin FTP_PASSIVE_MODE=yes COWPATH=cows MAILDIR=/root/Maildir IRCNAME=Alfred Perlstein CVSROOT=/home/ncvs BLOCKSIZE=1K OLDPWD=/usr/home/alfred/freebsd PWD=/usr/home/alfred/freebsd SHLVL=2 TERM=screen SHELL=/usr/local/bin/zsh MAIL=/var/mail/root LOGNAME=root USER=root USERNAME=root HOME=/root SUDO_COMMAND=/usr/local/bin/zsh SUDO_USER=alfred SUDO_UID=501 SUDO_GID=501 http://people.freebsd.org/~alfred/dtrace/markjdb.build.xz >> Thanks! >> -Garrett >> >> PS Awesome solution for the ports issue :). >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@FreeBSD.ORG Mon Dec 24 18:53:25 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 55432C57; Mon, 24 Dec 2012 18:53:25 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-we0-f180.google.com (mail-we0-f180.google.com [74.125.82.180]) by mx1.freebsd.org (Postfix) with ESMTP id 7C5DE8FC13; Mon, 24 Dec 2012 18:53:23 +0000 (UTC) Received: by mail-we0-f180.google.com with SMTP id t57so3348160wey.39 for ; Mon, 24 Dec 2012 10:53:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=DpszjsZqJ2AC/bjMt6rs42mlUcJpx2ncrYYLRx2m/JU=; b=rKivgvAfRRqW0Z982TDwfn7a9TENi4oqx8ZtRtZl0AwqTsFC+A9kOX777tg2ny3h09 m9itgxnvzgSrAK3NoSm+AopIs1m5NKM1BQcyP6HzPnO4XhNsjByzh7nREdv4wjz0+lY/ W9HUPEJTT0IM28B/9jKPNlLxL2mWElcj8hm1RF76kzNp3+i8qNhaZfyXLDBiYCAnlnUo G5Of3xQv1tQWUvblUN39fFfP/Lg+KV82dvQdAeMyH8t9qf1UisVZHoZlDvAh3JZzanGb dcZf5cdadzlYED2o+oOZzTP+LOZHNo7TlzI5Ok+dlCHJC4/OYcB8hWrlK/nxDQ86Sbz8 5tkA== MIME-Version: 1.0 Received: by 10.180.72.146 with SMTP id d18mr28143685wiv.33.1356375197533; Mon, 24 Dec 2012 10:53:17 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.217.57.9 with HTTP; Mon, 24 Dec 2012 10:53:17 -0800 (PST) In-Reply-To: <50D7FC3D.9090006@FreeBSD.org> References: <50D708C6.6060801@FreeBSD.org> <50D7FC3D.9090006@FreeBSD.org> Date: Mon, 24 Dec 2012 10:53:17 -0800 X-Google-Sender-Auth: _W6M76ELM1cSL5cUaUQNIm9wYAE Message-ID: Subject: Re: uart: add resume method From: Adrian Chadd To: Andriy Gapon , Marcel Moolenaar Content-Type: text/plain; charset=ISO-8859-1 Cc: Garrett Cooper , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2012 18:53:25 -0000 + marcel, who knows a little about the uart code. Adrian On 23 December 2012 22:54, Andriy Gapon wrote: > on 23/12/2012 23:53 Garrett Cooper said the following: >> On Sun, Dec 23, 2012 at 5:36 AM, Andriy Gapon wrote: >>> >>> Guys, >>> >>> do you think that the following change is useful/needed? >>> >>> I needed it with UART emulated in qemu, but I have no experience with real hardware. >> >> I assume that you suspended the emulator and the UART didn't come >> back to life? > > No, I executed acpiconf -s 3 in the guest and then system_wakeup in the qemu > monitoring console. > > -- > Andriy Gapon > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Tue Dec 25 13:36:32 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AE1A8CAA for ; Tue, 25 Dec 2012 13:36:32 +0000 (UTC) (envelope-from patrick_dkt@yahoo.com.hk) Received: from nm3-vm6.bullet.mail.sg3.yahoo.com (nm3-vm6.bullet.mail.sg3.yahoo.com [106.10.148.117]) by mx1.freebsd.org (Postfix) with ESMTP id AF1248FC0A for ; Tue, 25 Dec 2012 13:36:29 +0000 (UTC) Received: from [106.10.166.117] by nm3.bullet.mail.sg3.yahoo.com with NNFMP; 25 Dec 2012 13:34:31 -0000 Received: from [106.10.151.171] by tm6.bullet.mail.sg3.yahoo.com with NNFMP; 25 Dec 2012 13:34:31 -0000 Received: from [127.0.0.1] by omp1011.mail.sg3.yahoo.com with NNFMP; 25 Dec 2012 13:34:31 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 21377.18527.bm@omp1011.mail.sg3.yahoo.com Received: (qmail 84039 invoked by uid 60001); 25 Dec 2012 13:34:30 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com.hk; s=s1024; t=1356442470; bh=+0Ig/4+0Cvfv0MdwBasix2L5c3dXRrCu3nS7bXHBOVc=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=Kal3a+UYGCgpdwHFgLsAROzzIK4oRr1HIT95hnionow3MnRnYpJmDIQHb7svt+MTiV45CWwxWhMnvzy4cdWpmwZlMmrxDjPWoDyeGTQI1iBRwHxhrc47/aDc3b/jsSlDx/XQVSRUsJHJv4zYHwlpchswKs7A+nIpZq77B8r5Ri8= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com.hk; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=GyLF+gWQ1sWeTqlocQlEIKs65hDtrDMT1+f9RoFemEp47MwmzZjGtq5Mbk5U4fidsQpbwbGHnprTMXjcIPKoIVoV+xKjDZYeAaMklbh1YZTxW1uYG7zUUSZ2IdytwZZ3VZ4aeb/wsZfhbr2KBqBC9j+vaRaXKDkvgU9lVOWYPPw=; X-YMail-OSG: vaZsbVYVM1kqtd6WPe4v4f2jFvVkT3.IEUF2KA_DVIeihEH DqUPmAyL4rLbHwmML_whuuiag4E8mrIXX8Emtpy0W92kT.ChcR.rRsaDfB7Z foEGrFfKaqTJBAHZ9Vdnrb8YuWc6cArDVU3bf2mRx.xdrBIgKTjNmSIidRaz CBpQzSCbq7jPjboO.WfgBjODq5EqBqfMUS7veskdPcZVKX3v8hJhnyuuARF4 rFJCtchzLpC3nO3pJIB_CB782fEPs7K8CqUyanPEOxy3acEEfGmke_QPVE4u 0XMsZ69qTqa22vBrwgX63eGVwlZWenKD0QmhIRx9iaR7BWMuK6iXhcG3fpO. wAT8y_PS_KoJHZC9fs5QypjA4Now5FPOCRBZab9uXt_d34aUITb3feMEpKMn ZxUGhVkUI.78.XoLwCVWw2PExKwRlzbB8R0OmDYpVkjJa3GInEGOujygxKx3 saGDYPDZs20W8X2ZCyQQTrIABZ677n6hkINHF4genqUM.0zM.aijTo_c- Received: from [61.15.240.116] by web190804.mail.sg3.yahoo.com via HTTP; Tue, 25 Dec 2012 21:34:30 SGT X-Rocket-MIMEInfo: 001.001, SGksDQoNCkkgd291bGQgbGlrZSB0byBrbm93IHdoeSBxdW90YSBpcyBub3QgZW5hYmxlZCBpbiB0aGUgc3RvY2sga2VybmVsLi4NCg0KSSByZW1lbWJlcmVkIHRoYXQgaXQgaXMgbm90IGVuYWJsZWQgc2luY2UgZnJlZWJzZCAzLjUgb3IgZnJlZWJzZCA0IGdlbmVyYXRpb24uDQpOb3cgaW4gZnJlZWJzZCA5LjAsIGl0IHN0aWxsIG5lZWVkIGEga2VybmVsIHJlYnVpbGQuDQoNCkkgaGF2ZSBoZWFyZCBpdCBoYXMgcGVyZm9ybWFuY2UgaXNzdWUgKEdJQU5UIGxvY2spIGFib3V0IHF1b3RhLg0KDQpSZWdhcmRzLA0BMAEBAQE- X-Mailer: YahooMailClassic/15.1.2 YahooMailWebService/0.8.129.483 Message-ID: <1356442470.26290.YahooMailClassic@web190804.mail.sg3.yahoo.com> Date: Tue, 25 Dec 2012 21:34:30 +0800 (SGT) From: Patrick Dung Subject: Re: About QUOTA support in stock kernel (resent) To: freebsd hackers In-Reply-To: <1356111338.1283.YahooMailClassic@web190806.mail.sg3.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Dec 2012 13:36:32 -0000 Hi, I would like to know why quota is not enabled in the stock kernel.. I remembered that it is not enabled since freebsd 3.5 or freebsd 4 generation. Now in freebsd 9.0, it still neeed a kernel rebuild. I have heard it has performance issue (GIANT lock) about quota. Regards, Patrick --- On Sat, 12/22/12, Patrick Dung wrote: From: Patrick Dung Subject: About QUOTA support in stock kernel To: freebsd-questions@freebsd.org, "freebsd hackers" Date: Saturday, December 22, 2012, 1:35 AM Hi, I would like to know why quota is not enabled in the stock kernel.. I remembered that it is not enabled since freebsd 3.5 or freebsd 4 generation. Now in freebsd 9.0, it still neeed a kernel rebuild. I have heard it has performance issue (GIANT lock) about quota. Regards, Patrick From owner-freebsd-hackers@FreeBSD.ORG Tue Dec 25 15:07:17 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8E59CDB5; Tue, 25 Dec 2012 15:07:17 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) by mx1.freebsd.org (Postfix) with ESMTP id E79418FC15; Tue, 25 Dec 2012 15:07:16 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.5/8.14.5) with ESMTP id qBPF7CO2082709; Tue, 25 Dec 2012 17:07:12 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.7.3 kib.kiev.ua qBPF7CO2082709 Received: (from kostik@localhost) by tom.home (8.14.5/8.14.5/Submit) id qBPF7CTr082708; Tue, 25 Dec 2012 17:07:12 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 25 Dec 2012 17:07:12 +0200 From: Konstantin Belousov To: Patrick Dung Subject: Re: About QUOTA support in stock kernel (resent) Message-ID: <20121225150712.GA82219@kib.kiev.ua> References: <1356111338.1283.YahooMailClassic@web190806.mail.sg3.yahoo.com> <1356442470.26290.YahooMailClassic@web190804.mail.sg3.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="CE+1k2dSO48ffgeK" Content-Disposition: inline In-Reply-To: <1356442470.26290.YahooMailClassic@web190804.mail.sg3.yahoo.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on tom.home Cc: freebsd hackers , fs@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Dec 2012 15:07:17 -0000 --CE+1k2dSO48ffgeK Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Dec 25, 2012 at 09:34:30PM +0800, Patrick Dung wrote: > Hi, >=20 > I would like to know why quota is not enabled in the stock kernel.. >=20 > I remembered that it is not enabled since freebsd 3.5 or freebsd 4 genera= tion. > Now in freebsd 9.0, it still neeed a kernel rebuild. >=20 > I have heard it has performance issue (GIANT lock) about quota. Enabling quota by default would cause small overhead, like one mutex acquir= e, for each inode and block alloc/dealloc, even for mount without quotas enabl= ed. Might be, it is reasonable to just enable it now. Unless somebody provide valid objections and I do not forget, I will do it in a week for HEAD. --CE+1k2dSO48ffgeK Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iQIcBAEBAgAGBQJQ2cEfAAoJEJDCuSvBvK1BczoQAJn1t9gpjqh9fckBwd+wMHr9 TeaTYybuGhhY19nTkmodheyAJsRphKhXVw4zDKYTCkO21HE9HbAx4X+NyLaBB+IN mQNhaP7r//TmuCUR0JSi7Wzincrngm6bT4DjGNTxFi5QbsebB4M848LhBe1HJJBH Ojdt4yO8kMYhRLHqeAydlsnwarvSWfD+fVcaOKW/BmekXvz9osLHnkhd2AwxQsUM YLX+4dB7Gao3WcuUWIr5alGaE3Lo5Ehua8ndI+Fl5GWABpq2Q6V2GnFssvCZONo+ ya0l/Sc8iQTprFE3XK1+4+Iu7Pr9PqWhRxwMGOC4ewHjrZH7CVpriamawqfMbB3v VvaPPf0ICrwmA32hR2Wmvv6l+I+T+iXtMocdhkxYBqU202JIgSlbykNRyYg2ztJ8 DSjEijvzSrX4litK8IMHIzpl6PnQ6jmKtlRTEUTtxdaNxpWmdELN6/TqV0o9ekvU u8WuOfVclmIj9RNjwJYGaNcYh9nmEFvD4FOSU4Ac67knO0mi7lMtsL22vPN8F4vQ WGYw1d2u7AYmInPR8AJkvbc/Phv0ux8oECHWKCcSWsfAmBXyUjpIe/zXEQznKSl7 04xMt2/btNzyktqoe70j1HSZyc5xcQ/KjaEvjE2FFJzoe8OYiBFirZ2JqUh80U90 +5TDEVwdRF47jrAq27bY =AZmI -----END PGP SIGNATURE----- --CE+1k2dSO48ffgeK-- From owner-freebsd-hackers@FreeBSD.ORG Tue Dec 25 15:24:03 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 66B38FC6 for ; Tue, 25 Dec 2012 15:24:03 +0000 (UTC) (envelope-from lists@eitanadler.com) Received: from mail-la0-f49.google.com (mail-la0-f49.google.com [209.85.215.49]) by mx1.freebsd.org (Postfix) with ESMTP id C9DD88FC15 for ; Tue, 25 Dec 2012 15:24:02 +0000 (UTC) Received: by mail-la0-f49.google.com with SMTP id r15so9511134lag.22 for ; Tue, 25 Dec 2012 07:23:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=eitanadler.com; s=0xdeadbeef; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=ZDbvvS6JVUEXBhm/0h8gXb3SwOq82qu7T8chPAQfm4o=; b=IqMbHPxSEKpmyeb0tGYTmCKeM8ZP9J8dy5gz/5kHe/sfNhQ1GBuQ6FoinlGxA9HXvU wFfwct8NhZ545j+NYrs3kVzcNDsy1A62kry9YzZh6hwaV8TodzoNB4MLgiPRjQbHnuoc UapSSyrFx5nwY6pABibGEmwRAg1vZwpxiDFgs= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type:x-gm-message-state; bh=ZDbvvS6JVUEXBhm/0h8gXb3SwOq82qu7T8chPAQfm4o=; b=e95QekhQNu8X96RR58gw2RIR6eqllIp0WTnGmZXK7CLpDkGoTExnZhXv2KrfTdl5Yw qi0zTmPb9tEaaAHRQhQ92G6ArbuQ+z4vMZuAtTFgU4wWXi0BcpzrshuMklpaS4cB15/o AC9WI6BAUF1em2stnnNTcigd+GkcqSWnyrrbrQaVcuN+kDaGpZCGIkMtWN2Uq9sIxwFo OxnLSf0VGXXu0vwdALZLsUWhB0PRW2G6mpdBXRqvfxzzIzYVGK/x7nhgcQu5Lv0TOWoX HTTT5fAOE1L7GoKaAg93mxmb1mD4CPwaZNGB7NgYC5ARd7KJXzABKmiap2gX/6Y2AbGr rauA== Received: by 10.112.29.104 with SMTP id j8mr10045772lbh.0.1356449036254; Tue, 25 Dec 2012 07:23:56 -0800 (PST) MIME-Version: 1.0 Received: by 10.112.162.100 with HTTP; Tue, 25 Dec 2012 07:23:26 -0800 (PST) In-Reply-To: <20121225150712.GA82219@kib.kiev.ua> References: <1356111338.1283.YahooMailClassic@web190806.mail.sg3.yahoo.com> <1356442470.26290.YahooMailClassic@web190804.mail.sg3.yahoo.com> <20121225150712.GA82219@kib.kiev.ua> From: Eitan Adler Date: Tue, 25 Dec 2012 10:23:26 -0500 Message-ID: Subject: Re: About QUOTA support in stock kernel (resent) To: Konstantin Belousov Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQka2Cl8PuqZueYxFH4ZQ4AYGf0Bev6zmvh6WWaTkyphJ8R2g3oRGJqUSvkp+gef8MFgnqQb Cc: Patrick Dung , freebsd hackers , fs@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Dec 2012 15:24:03 -0000 On 25 December 2012 10:07, Konstantin Belousov wrote: > Enabling quota by default would cause small overhead, like one mutex acquire, > for each inode and block alloc/dealloc, even for mount without quotas enabled. Why is this, and can it be avoided (for mounts without quotas)? > Might be, it is reasonable to just enable it now. Unless somebody provide > valid objections and I do not forget, I will do it in a week for HEAD. -- Eitan Adler From owner-freebsd-hackers@FreeBSD.ORG Tue Dec 25 15:29:14 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 262861D9; Tue, 25 Dec 2012 15:29:14 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) by mx1.freebsd.org (Postfix) with ESMTP id 8039F8FC12; Tue, 25 Dec 2012 15:29:13 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.5/8.14.5) with ESMTP id qBPFT6oI084650; Tue, 25 Dec 2012 17:29:06 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.7.3 kib.kiev.ua qBPFT6oI084650 Received: (from kostik@localhost) by tom.home (8.14.5/8.14.5/Submit) id qBPFT67S084649; Tue, 25 Dec 2012 17:29:06 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 25 Dec 2012 17:29:06 +0200 From: Konstantin Belousov To: Eitan Adler Subject: Re: About QUOTA support in stock kernel (resent) Message-ID: <20121225152905.GB82219@kib.kiev.ua> References: <1356111338.1283.YahooMailClassic@web190806.mail.sg3.yahoo.com> <1356442470.26290.YahooMailClassic@web190804.mail.sg3.yahoo.com> <20121225150712.GA82219@kib.kiev.ua> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="XF85m9dhOBO43t/C" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on tom.home Cc: Patrick Dung , freebsd hackers , fs@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Dec 2012 15:29:14 -0000 --XF85m9dhOBO43t/C Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Dec 25, 2012 at 10:23:26AM -0500, Eitan Adler wrote: > On 25 December 2012 10:07, Konstantin Belousov wrot= e: > > Enabling quota by default would cause small overhead, like one mutex ac= quire, > > for each inode and block alloc/dealloc, even for mount without quotas e= nabled. >=20 > Why is this, and can it be avoided (for mounts without quotas)? Because system should check whether quota is enabled to do the accounting. >=20 > > Might be, it is reasonable to just enable it now. Unless somebody provi= de > > valid objections and I do not forget, I will do it in a week for HEAD. >=20 >=20 >=20 > --=20 > Eitan Adler --XF85m9dhOBO43t/C Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iQIcBAEBAgAGBQJQ2cY/AAoJEJDCuSvBvK1BfzEP/3ze3Wcu1n28ZIeCaXCEeDXk qnJmZXLuw4y57CZJ2+mASDGTCUkp91iJcCtPAP+UyN91LIqAGgQVkI71L70dCZ3c OO+eAxgCYOCB4OqvjwDhI4cXuTyarf2blIjov0qxjwh9vqp9Zy7hL2FtPttpxmPr FOukKMZ9wMzM3MmPoASULdAgu4jZQQHV7Hhw9H6pujRxgXGPOHHbDoIkT0WHbq8K q6nR9OUjPKHx2hm4/mLQTGTlUqyF8V883IWI7zOoiO2G9S7rpOT7FdTBb7CljLub EUUMKGf9RcheduIew60ZafSXUwbRvD1AHIktlm1xTuXG4ZSyyRluyYN+QmUoQ16Q yh/BA0LzxwrKo3wx9cFUVw5FCHjPRTIKUv91InnxX7TQeRGAxkjNi35LtjzE6nS8 p90NS6v9OCEWNHc++Ece/FhCI5mK80bwzXtsULioLAeBDEzc0d/5vMtntx4wE4pg IYsGHjq0ZJjWjlr4eCf3CUUsAIqkE0dV43SEevV2UTHmXe+VD+v4serfn89AddYP oSb3JyJAJ2eoi81TEH1y6WWEnIBKquT+LvaKOVbBPP/JOSIPRzYOvqwTl9IHC5Vb hTkcXR1JxtZRoPpgvgSlo0F3slLbVnobNex9QWLceI8JSMXexrPJxJgJqT76lxSh VklzlLPHVKpCVEgbP29Y =+ine -----END PGP SIGNATURE----- --XF85m9dhOBO43t/C-- From owner-freebsd-hackers@FreeBSD.ORG Tue Dec 25 17:21:45 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A7CC946A for ; Tue, 25 Dec 2012 17:21:45 +0000 (UTC) (envelope-from cliftonr@volcano.org) Received: from hrndva-omtalb.mail.rr.com (hrndva-omtalb.mail.rr.com [71.74.56.122]) by mx1.freebsd.org (Postfix) with ESMTP id 5AB6C8FC0C for ; Tue, 25 Dec 2012 17:21:44 +0000 (UTC) X-Authority-Analysis: v=2.0 cv=QPnqt33L c=1 sm=0 a=nLSj6wnnDCA9frvL/Tt8NQ==:17 a=3pwD0LKv0YcA:10 a=z1TLwsU0kBEA:10 a=WthmilfBrBsA:10 a=sLPLfFCmqb0A:10 a=kj9zAlcOel0A:10 a=GjEiR67sAAAA:8 a=vbqy14apGeAA:10 a=6I5d2MoRAAAA:8 a=4FFUHJPBAAAA:8 a=jb__rZ8GAAAA:8 a=QgRd-1w8PytrFmQMKzcA:9 a=CjuIK1q_8ugA:10 a=SV7veod9ZcQA:10 a=WglDhLyllLQA:10 a=sHp_62vNEjwA:10 a=Ke08FT2oSu0A:10 a=uaPtF_yVWsO8TDr5:21 a=QagwduKnc66lAhUF:21 a=nLSj6wnnDCA9frvL/Tt8NQ==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 70.95.171.134 Received: from [70.95.171.134] ([70.95.171.134:39809] helo=oz.volcano.org) by hrndva-oedge02.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id BB/18-26019-560E9D05; Tue, 25 Dec 2012 17:20:38 +0000 Received: by oz.volcano.org (Postfix, from userid 1001) id 766355082E; Tue, 25 Dec 2012 07:20:37 -1000 (HST) Date: Tue, 25 Dec 2012 07:20:37 -1000 From: Clifton Royston To: freebsd-hackers@freebsd.org Subject: Re: looking for someone to fix humanize_number (test cases included) Message-ID: <20121225172037.GA56225@volcano.org> Mail-Followup-To: freebsd-hackers@freebsd.org, John-Mark Gurney References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: John-Mark Gurney X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Dec 2012 17:21:45 -0000 On Mon, Dec 24, 2012 at 12:00:01PM +0000, freebsd-hackers-request@freebsd.org wrote: > Date: Sun, 23 Dec 2012 00:32:20 -0800 > From: John-Mark Gurney > To: hackers@FreeBSD.org > Subject: looking for someone to fix humanize_number (test cases > included) > Message-ID: <20121223083220.GL1563@funkthat.com> > Content-Type: text/plain; charset=us-ascii > > I'm looking for a person who is interested in fixing up humanize_number. > > The other day I copied some data from a 7.2-R box to a 9.1-stable box > and did a du -shc and a du-skc to check the results... I noticed the -h > run dropped from 11M to 10M, which I thought was weird... Then I looked > at the results from the -k run, but the new machine had a larger result > (I copied from UFS to ZFS)... It turns out that humanize_number was > broken when doing rounding... No longer does humanize_number round up > at .5 or more of the prefix.. > > So I decided to write a test program to test the output, and now I'm even > more surprised by the output... Neither 7.2-R nor 10-current give what > I expect are the correct results... > > Feel free to take a look at the test program posted to: > http://people.freebsd.org/~jmg/humanize_numbers/ > > The .c contains what I think the output should be. I'm testing on 7.3R (yes, I know, I know, should be on 8 or 9) and see similar results as to rounding problems; see below on the others. > So far the bugs I know of: > 1) rounding is incorrect (started this whole search) > 2) buffer calculation is incorrect in some cases, index 11 should fit > but doesn't > 3) some cases zero is returned though it isn't zero, more like 0T for 512 G > (indexes 16, 17, 22, 23) I think these last are caused by integer wraparound and truncation in the integer constant calculations of your test program, once you get beyond 1G. Even though it's an anachronism in these days of 3TB disks and 8GB RAM in laptops, int is still 32 bits in most C implementations, giving a maximum range of +/- 2G, and constant calculations are done with int by default. Your point 1 and 4 seem correct, at first glance. I've tweaked the test slightly to correct those cases - trailing L doesn't do it, you must also prefix the constant value with (int64_t) - and it fixes the dimensionless 0s for 16, 17, 22, and 23, and the buffer error for 11 (caused because it probably comes out with some really weird value after truncation.) There's another brain-blip bug which took me a couple minutes of staring at - your test skips over "peta-" and expects "exa-" (E) to come after "tera-". Fixing that by replacing "1 E" and "2 E" with "1 P" and "2 P" corrects a couple more errors. I'm left with index 1-11 all showing one less than expected ("0 K" for "1 K", and so on to "1 T" for "2 T"), and 25 and 27 showing the same problem - so at least it's down to just the rounding problem. There's actually another problem implicit in the results from the rounding problem - I think it should never yield "0 M" instead of "512 K"; for that matter, I would think anything up to "999 K" (divisor 1000) or "1023 K" (divisor 1024) should be represented with the smaller unit, not as "1 M". > 4) man page is missing required sys/types.h include > > I'll work to get the code into the tree once we get it in a good state. No promises as I'm chronically oversubscribed but it's intrigued me and I'll take a look. > Please cc me as I'm not subscribed to -hackers. Done. -- Clifton -- Clifton Royston -- cliftonr@iandicomputing.com / cliftonr@volcano.org President - I and I Computing * http://www.iandicomputing.com/ Custom programming, network design, systems and network consulting services From owner-freebsd-hackers@FreeBSD.ORG Tue Dec 25 18:23:58 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C696BD8A for ; Tue, 25 Dec 2012 18:23:58 +0000 (UTC) (envelope-from cliftonr@volcano.org) Received: from hrndva-omtalb.mail.rr.com (hrndva-omtalb.mail.rr.com [71.74.56.122]) by mx1.freebsd.org (Postfix) with ESMTP id 797188FC13 for ; Tue, 25 Dec 2012 18:23:58 +0000 (UTC) X-Authority-Analysis: v=2.0 cv=O9a7TWBW c=1 sm=0 a=nLSj6wnnDCA9frvL/Tt8NQ==:17 a=3pwD0LKv0YcA:10 a=z1TLwsU0kBEA:10 a=WthmilfBrBsA:10 a=sLPLfFCmqb0A:10 a=kj9zAlcOel0A:10 a=GjEiR67sAAAA:8 a=vbqy14apGeAA:10 a=6I5d2MoRAAAA:8 a=4FFUHJPBAAAA:8 a=jb__rZ8GAAAA:8 a=XJKYdy9vcSIdljMzM88A:9 a=CjuIK1q_8ugA:10 a=SV7veod9ZcQA:10 a=WglDhLyllLQA:10 a=sHp_62vNEjwA:10 a=Ke08FT2oSu0A:10 a=JBydAoiqPfli7mb-:21 a=yxoKa41tYRgbEzSE:21 a=nLSj6wnnDCA9frvL/Tt8NQ==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 70.95.171.134 Received: from [70.95.171.134] ([70.95.171.134:29989] helo=oz.volcano.org) by hrndva-oedge04.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id D3/3A-01424-C3FE9D05; Tue, 25 Dec 2012 18:23:57 +0000 Received: by oz.volcano.org (Postfix, from userid 1001) id F3E145082E; Tue, 25 Dec 2012 08:23:55 -1000 (HST) Date: Tue, 25 Dec 2012 08:23:55 -1000 From: Clifton Royston To: freebsd-hackers@freebsd.org, John-Mark Gurney Subject: Re: looking for someone to fix humanize_number (test cases included) Message-ID: <20121225182355.GA56732@volcano.org> Mail-Followup-To: freebsd-hackers@freebsd.org, John-Mark Gurney References: <20121225172037.GA56225@volcano.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20121225172037.GA56225@volcano.org> User-Agent: Mutt/1.4.2.3i X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Dec 2012 18:23:58 -0000 On Tue, Dec 25, 2012 at 07:20:37AM -1000, Clifton Royston wrote: > On Mon, Dec 24, 2012 at 12:00:01PM +0000, freebsd-hackers-request@freebsd.org wrote: > > From: John-Mark Gurney > > To: hackers@FreeBSD.org > > Subject: looking for someone to fix humanize_number (test cases > > included) > > > > I'm looking for a person who is interested in fixing up humanize_number. ... > > So I decided to write a test program to test the output, and now I'm even > > more surprised by the output... Neither 7.2-R nor 10-current give what > > I expect are the correct results... > > > > Feel free to take a look at the test program posted to: > > http://people.freebsd.org/~jmg/humanize_numbers/ > > > > The .c contains what I think the output should be. > > I'm testing on 7.3R (yes, I know, I know, should be on 8 or 9) and > see similar results as to rounding problems; see below on the others. > > > So far the bugs I know of: > > 1) rounding is incorrect (started this whole search) ... > > 3) some cases zero is returned though it isn't zero, more like 0T for 512 G > > (indexes 16, 17, 22, 23) > > I think these last are caused by integer wraparound and truncation in the > integer constant calculations of your test program, once you get beyond 1G. ... > There's another brain-blip bug which took me a couple minutes of staring > at - your test skips over "peta-" and expects "exa-" (E) to come after > "tera-". Fixing that by replacing "1 E" and "2 E" with "1 P" and "2 P" > corrects a couple more errors. I'm left with index 1-11 all showing one > less than expected ("0 K" for "1 K", and so on to "1 T" for "2 T"), and 25 > and 27 showing the same problem - so at least it's down to just the rounding > problem. > > There's actually another problem implicit in the results from the rounding > problem - I think it should never yield "0 M" instead of "512 K"; for that > matter, I would think anything up to "999 K" (divisor 1000) or "1023 K" > (divisor 1024) should be represented with the smaller unit, not as "1 M". Having looked more closely at your test, I now see that it forces the current behavior by setting the buffer length to 4, leaving room for only 3 characters - so that part is reasonable. I also realized that the flags and scale fields in the structure initialization in the test code are swapped, which seemed to explain some problems. However, switching the order to the correct one, so that the flags were actually used, revealed a lot more problems, for instance: mismatch on index 1, got: "500", expected "1 K". (correct!) mismatch on index 2, got: "500", expected "1 M". mismatch on index 3, got: "500", expected "1 G". ... mismatch on index 7, got: "150", expected "2 K". mismatch on index 8, got: "150", expected "2 M". ... I now question whether it's working correctly with any flags other than 0. The man page states: "The len argument must be at least 4 plus the length of suffix, in order to ensure a useful result is generated into buffer." which this satisfies but in fact larger sizes don't seem to be adequate either; for example with a 6 char buffer: mismatch on index 1, got: "500", expected "1 K". (correct!) mismatch on index 2, got: "50000", expected "1 M". mismatch on index 3, got: "50000", expected "1 G". ... mismatch on index 11, got: "15000", expected "2 P". mismatch on index 13, got: "512 ", expected "1 K". (correct!) mismatch on index 14, got: "52428", expected "1 M". mismatch on index 15, got: "53687", expected "1 G". ... I am bemused. -- Clifton -- Clifton Royston -- cliftonr@iandicomputing.com / cliftonr@volcano.org President - I and I Computing * http://www.iandicomputing.com/ Custom programming, network design, systems and network consulting services From owner-freebsd-hackers@FreeBSD.ORG Tue Dec 25 19:46:29 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AA12963D for ; Tue, 25 Dec 2012 19:46:29 +0000 (UTC) (envelope-from cliftonr@volcano.org) Received: from hrndva-omtalb.mail.rr.com (hrndva-omtalb.mail.rr.com [71.74.56.122]) by mx1.freebsd.org (Postfix) with ESMTP id 5CCFF8FC17 for ; Tue, 25 Dec 2012 19:46:29 +0000 (UTC) X-Authority-Analysis: v=2.0 cv=O9a7TWBW c=1 sm=0 a=nLSj6wnnDCA9frvL/Tt8NQ==:17 a=3pwD0LKv0YcA:10 a=z1TLwsU0kBEA:10 a=WthmilfBrBsA:10 a=sLPLfFCmqb0A:10 a=kj9zAlcOel0A:10 a=GjEiR67sAAAA:8 a=vbqy14apGeAA:10 a=6I5d2MoRAAAA:8 a=4FFUHJPBAAAA:8 a=KPhu4TmfTkWQfB3IJaIA:9 a=CjuIK1q_8ugA:10 a=SV7veod9ZcQA:10 a=WglDhLyllLQA:10 a=uGOeqZtyLdsmXGBv:21 a=rwX60XwcmPY_VYHc:21 a=nLSj6wnnDCA9frvL/Tt8NQ==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 70.95.171.134 Received: from [70.95.171.134] ([70.95.171.134:39643] helo=oz.volcano.org) by hrndva-oedge04.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id BF/D1-01424-3920AD05; Tue, 25 Dec 2012 19:46:28 +0000 Received: by oz.volcano.org (Postfix, from userid 1001) id DC36F5082E; Tue, 25 Dec 2012 09:46:26 -1000 (HST) Date: Tue, 25 Dec 2012 09:46:26 -1000 From: Clifton Royston To: freebsd-hackers@freebsd.org, John-Mark Gurney Subject: Re: looking for someone to fix humanize_number (test cases included) Message-ID: <20121225194626.GA57447@volcano.org> Mail-Followup-To: freebsd-hackers@freebsd.org, John-Mark Gurney References: <20121225172037.GA56225@volcano.org> <20121225182355.GA56732@volcano.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20121225182355.GA56732@volcano.org> User-Agent: Mutt/1.4.2.3i X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Dec 2012 19:46:29 -0000 On Tue, Dec 25, 2012 at 08:23:55AM -1000, Clifton Royston wrote: > On Tue, Dec 25, 2012 at 07:20:37AM -1000, Clifton Royston wrote: > > On Mon, Dec 24, 2012 at 12:00:01PM +0000, freebsd-hackers-request@freebsd.org wrote: > > > From: John-Mark Gurney > > > To: hackers@FreeBSD.org > > > Subject: looking for someone to fix humanize_number (test cases > > > included) > > > > > > I'm looking for a person who is interested in fixing up humanize_number. > ... > > > So I decided to write a test program to test the output, and now I'm even > > > more surprised by the output... Neither 7.2-R nor 10-current give what > > > I expect are the correct results... > ... > > I am bemused. I correct myself: the function works fine, and there are no bugs I could find, though it's clear the man page could emphasize the correct usage a bit more. I had to read the source several times and start on debugging it before I understood the correct usage of the flag values with the scale and flags parameters, despite the man page stating: The following flags may be passed in scale: HN_AUTOSCALE Format the buffer using the lowest multiplier pos- sible. HN_GETSCALE Return the prefix index number (the number of times number must be divided to fit) instead of formatting it to the buffer. The following flags may be passed in flags: HN_DECIMAL If the final result is less than 10, display it using one digit. ... HN_DIVISOR_1000 Divide number with 1000 instead of 1024. That is, certain flags must be passed in flags and others must only be passed in scale - a bit counter-intuitive. Also, scale == 0 is clearly not interpreted as AUTOSCALE, but I am not yet clear how it is being handled - it seems somewhat like AUTOSCALE but not identical. When the test program constant table is updated to pass the scale flags as specified, as well as fixing the bugs mentioned in the previous emails, it all passes except for the one (intentional?) inconsistency that "k" is used in place of "K" if HN_DECIMAL is enabled. The bug in the transfer speed results which prompted this inquiry suggests that perhaps some clients of humanize_number in the codebase are also passing the scale parameters incorrectly. I would propose accepting HN_AUTOSCALE and HN_GETSCALE in the flags field (they don't overlap with other values) while continuing to accept them in the scale field for backwards compatibility. Trivial diff below. -- Clifton -- --- /usr/src/lib/libutil/humanize_number.c 2010-12-28 09:36:31.000000000 -1000 +++ humanize_number.c 2012-12-25 09:36:36.000000000 -1000 @@ -54,7 +54,7 @@ const char *suffix, int scale, int flags) { const char *prefixes, *sep; - int b, i, r, maxscale, s1, s2, sign; + int b, i, r, maxscale, s1, s2, sign, autoscale, getscale; int64_t divisor, max; size_t baselen; @@ -84,8 +84,10 @@ #define SCALE2PREFIX(scale) (&prefixes[(scale) << 1]) maxscale = 7; + autoscale = (flags | scale) & HN_AUTOSCALE; + getscale = (flags | scale) & HN_GETSCALE; if (scale >= maxscale && - (scale & (HN_AUTOSCALE | HN_GETSCALE)) == 0) + (autoscale | getscale) == 0) return (-1); if (buf == NULL || suffix == NULL) @@ -114,7 +116,7 @@ if (len < baselen + 1) return (-1); - if (scale & (HN_AUTOSCALE | HN_GETSCALE)) { + if (autoscale | getscale) { /* See if there is additional columns can be used. */ for (max = 100, i = len - baselen; i-- > 0;) max *= 10; @@ -127,7 +129,7 @@ for (i = 0; bytes >= max - 50 && i < maxscale; i++) bytes /= divisor; - if (scale & HN_GETSCALE) + if (getscale) return (i); } else for (i = 0; i < scale && i < maxscale; i++) From owner-freebsd-hackers@FreeBSD.ORG Tue Dec 25 19:52:47 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BCA5B8AD for ; Tue, 25 Dec 2012 19:52:47 +0000 (UTC) (envelope-from lists@eitanadler.com) Received: from mail-la0-f48.google.com (mail-la0-f48.google.com [209.85.215.48]) by mx1.freebsd.org (Postfix) with ESMTP id 347898FC1C for ; Tue, 25 Dec 2012 19:52:46 +0000 (UTC) Received: by mail-la0-f48.google.com with SMTP id m13so9932558lah.35 for ; Tue, 25 Dec 2012 11:52:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=eitanadler.com; s=0xdeadbeef; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=A1KPjHEGWCksHP3w0V+iQGprlkheRStGOd0sd9bfKyk=; b=i81qffqFu3M+8oDP6gMplpggmbkxPci6/6P3q1IUgCRsIvwUs32FZN3XMttvCuSXLg HRgncONRulOE1C2WK9kQjlDrdBC3CWMohxSfHv42KK1atjSeTkuJ/zOvAm+72obCH139 7PO6P8owexPhtJH8hE7kR3gXxOupdFUnp3W6E= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=A1KPjHEGWCksHP3w0V+iQGprlkheRStGOd0sd9bfKyk=; b=LBf1bE/2NoxU7epUf6324yxukkqu8UTm+05QVyLRAoC2nomt1aKMQYz9hGyu7HNlvc fBWZfoglkPGi2HrSH0WPTMdxVwwEpi6ZsyrIruHs6Z1sGCFVBpwgI/4Auu/xdnOd2Xzy WGn/VPhaUO8HhnZob3oTWn2dQzVt0Z3fzNj4Nj6t2UqVG85YZteWWkg/gTqqRGxLOiGK HuDRNyATS0VWY+2QDmhp4DR6nJzadL+20V+Fc3Nnuryosed8H8BRf1mi/K5kZafoYULp +gFRDiyeLLe6xuA+0jKrrSc55yd0QrMVtnkCy0BaO9hzNmcydBAkc7RmT3rlAu1RT4T1 e/hA== Received: by 10.152.124.68 with SMTP id mg4mr23098934lab.51.1356465160099; Tue, 25 Dec 2012 11:52:40 -0800 (PST) MIME-Version: 1.0 Received: by 10.112.162.100 with HTTP; Tue, 25 Dec 2012 11:52:09 -0800 (PST) In-Reply-To: <20121225194626.GA57447@volcano.org> References: <20121225172037.GA56225@volcano.org> <20121225182355.GA56732@volcano.org> <20121225194626.GA57447@volcano.org> From: Eitan Adler Date: Tue, 25 Dec 2012 14:52:09 -0500 Message-ID: Subject: Re: looking for someone to fix humanize_number (test cases included) To: freebsd-hackers@freebsd.org, John-Mark Gurney Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQkUMsdw5jy9QIsGXS8/Zv/gQ8Hi6efDzksCccyMbFqRpW5Uz9fe4gLYnJncZMiJHp6TcDMZ X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Dec 2012 19:52:47 -0000 On 25 December 2012 14:46, Clifton Royston wrote: >> I correct myself: the function works fine, and there are no bugs I > could find, though it's clear the man page could emphasize the correct > usage a bit more. Can you submit a diff to the man page as well? I figure if you got confused at least 10 others got even more confused. -- Eitan Adler From owner-freebsd-hackers@FreeBSD.ORG Wed Dec 26 02:56:28 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B5A35414 for ; Wed, 26 Dec 2012 02:56:28 +0000 (UTC) (envelope-from dieterbsd@engineer.com) Received: from mout.gmx.net (mout.gmx.net [74.208.4.200]) by mx1.freebsd.org (Postfix) with ESMTP id 64BEB8FC0C for ; Wed, 26 Dec 2012 02:56:28 +0000 (UTC) Received: from mailout-us.gmx.com ([172.19.198.41]) by mrigmx.server.lan (mrigmxus002) with ESMTP (Nemesis) id 0LjaqC-1TCRWo0Cca-00bav0 for ; Wed, 26 Dec 2012 03:51:18 +0100 Received: (qmail 15416 invoked by uid 0); 26 Dec 2012 02:51:17 -0000 Received: from 67.206.185.118 by rms-us007 with HTTP Content-Type: text/plain; charset="utf-8" Date: Tue, 25 Dec 2012 21:51:14 -0500 From: "Dieter BSD" Message-ID: <20121226025115.91860@gmx.com> MIME-Version: 1.0 Subject: Re: FreeBSD for serious performance? To: freebsd-hackers@freebsd.org X-Authenticated: #74169980 X-Flags: 0001 X-Mailer: GMX.com Web Mailer x-registered: 0 Content-Transfer-Encoding: 8bit X-GMX-UID: dAOocIZC3zOlNR3dAHAh7Ml+IGRvb8A3 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Dec 2012 02:56:28 -0000 > Which device drivers?  We can't fix problems we don't know about. ata(4) completely hung the system for 19 minutes (at which point I manually intervened, see the PR), probably an infinite loop. http://www.freebsd.org/cgi/query-pr.cgi?pr=170675 Siis(4) and ahci(4) have also caused data loss, presumably by blocking interrupts for too long. Improving these drivers would be wonderful. But better yet, can we please find a way to fix the underlying problem? When a device driver handles an interrupt, it needs to block further interrupts while it modifies its data structures. Otherwise another interrupt coming in might cause it to mangle the data. Right? But! Why does it need to block interrupts for everything? Why does a disk driver need to block interrupts from Ethernet? Why does Ethernet need to block Firewire? Why does Firewire need to block USB? And so on. Can't the disk driver block just its own interrupts and leave the other devices alone? That way, when some device driver writer puts in DELAY(TOO_LONG), at least the other devices will still work. Alternately, why couldn't the data structures be protected with a mutex? Then the drivers shouldn't have to block even themselves. Alternately, why can't drivers have a polling option? Yes, the extra overhead of polling sucks, but losing incoming data sucks a lot more. I am not suggesting that polling should be the default, just an option for those who need it. Alternately, Current machines can have multiple disks, multiple Ethernets, multiple pretty-much-any-device, multiple CPUs, etc. etc. We have SMP kernel to juggle those multiple CPUs. But we still have this absurd bottleneck where the device drivers bring everything to a screaching halt every time an interrupt happens. And if the driver has a bug, or thinks there is a problem and decides to keep DELAY()ing over and over, the entire machine just locks up and stays locked up, often forever. It isn't just me. I have seen quite a few threads where other people are having the same problem. This needs to be fixed. (Fixing this is at *least* a Usenix paper.) From owner-freebsd-hackers@FreeBSD.ORG Wed Dec 26 05:29:13 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3424E501 for ; Wed, 26 Dec 2012 05:29:13 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-wg0-x22a.google.com (wg-in-x022a.1e100.net [IPv6:2a00:1450:400c:c00::22a]) by mx1.freebsd.org (Postfix) with ESMTP id B990C8FC13 for ; Wed, 26 Dec 2012 05:29:12 +0000 (UTC) Received: by mail-wg0-f42.google.com with SMTP id dr1so3149070wgb.3 for ; Tue, 25 Dec 2012 21:29:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=AuExUctz/rnNTNEJ5LyfbNPjM8EQb00vBhielWOaq8M=; b=iGb+d0T9oMhM4/gfWdykWchH4HHwCCVzIpXCt8T3wZ/pzHfgjn/4trPcRcFecckJvP aCj4xBqqj1Ophq6dUHUpq7Nb9yTa7+FW9k2LxSQiAvwzwj+fjGaaWXbcH4cT+dhZ0XRN 9rm1usl1X1IjExdCmcQEYFu9tQUpvKvuI3Ut1EBPaMYHOjqsxb9hcKvH7Va9h764Cto8 tOB9kP+TG4YBhvNXLEaVxkULEjrqyokt073SP/+st7VMiEHq9VfkPRm5rW95wrjaZo34 HZii4Ty2UIiHNadJ6kIoK8qAKClLoBtXpfgix3pdjjH13jli6MnXaRXHyO7ktF4GzPGH aGcg== MIME-Version: 1.0 Received: by 10.180.93.133 with SMTP id cu5mr33420194wib.32.1356499751881; Tue, 25 Dec 2012 21:29:11 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.217.57.9 with HTTP; Tue, 25 Dec 2012 21:29:11 -0800 (PST) In-Reply-To: <20121226025115.91860@gmx.com> References: <20121226025115.91860@gmx.com> Date: Tue, 25 Dec 2012 21:29:11 -0800 X-Google-Sender-Auth: nlufSE_Akev4UHTmwixQsY3fDZE Message-ID: Subject: Re: FreeBSD for serious performance? From: Adrian Chadd To: Dieter BSD Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Dec 2012 05:29:13 -0000 Hi, If the driver is doing something daft like DELAY(x) in a fast interrupt handler which would lead to that behaviour, it should be fixed. If it's doing a DELAY(x) in a critical section, it shuld be fixed. Otherwise, a DELAY(x) in a driver only chews CPU; the scheduler can preempt that. I don't agree with this behaviour, but it's possible. Now, it's quite likely you hit some kind of ata(4) bug which kept it in a tight loop without some kind of "too many errors; bailing" behaviour. I'm not an ata driver person; i have no idea why it's doing that. The driver shouldn't be disabling interrupts for other devices. That happens in critical sections and when doing lock operations. ata(4) doesn't call critical_* in the driver code. So it was likely just spun in some high priority loop that nothing lower-priority could really do anything about. The next time it happens, please break into the debugger and grab some debugging output. Show alllocks, ps, should be a good couple of things to start with. Alternately - please find a currently actively maintained SATA chipset. (Or Alternatively - step up and help migrate the nvidia chipset support out of ata(4).) Adrian From owner-freebsd-hackers@FreeBSD.ORG Wed Dec 26 07:32:13 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C6AF94DB for ; Wed, 26 Dec 2012 07:32:13 +0000 (UTC) (envelope-from patrick_dkt@yahoo.com.hk) Received: from nm26-vm7.bullet.mail.sg3.yahoo.com (nm26-vm7.bullet.mail.sg3.yahoo.com [106.10.151.118]) by mx1.freebsd.org (Postfix) with ESMTP id AF6818FC08 for ; Wed, 26 Dec 2012 07:32:12 +0000 (UTC) Received: from [106.10.166.63] by nm26.bullet.mail.sg3.yahoo.com with NNFMP; 26 Dec 2012 07:32:04 -0000 Received: from [106.10.151.122] by tm20.bullet.mail.sg3.yahoo.com with NNFMP; 26 Dec 2012 07:32:04 -0000 Received: from [127.0.0.1] by omp1004.mail.sg3.yahoo.com with NNFMP; 26 Dec 2012 07:32:04 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 824050.94241.bm@omp1004.mail.sg3.yahoo.com Received: (qmail 60558 invoked by uid 60001); 26 Dec 2012 07:32:04 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com.hk; s=s1024; t=1356507124; bh=aCdyeRg5Gg0hiPcWxxqC2tirkY1XePozzG+xaS/gi/8=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=NNw6mUwYdLtS9pXhsmo2JIgQNwR/ecaQW5N5GHyx0fMmuOWMKMo2HN8arVJw2ZYudQ86FXZ9SCulFVQjLzswVWB63PqsjiJKxkqDqsh56KBvdTk8FtyEW0pFkvzfvFYZg9uVvCKT1mlDB38v+fOP/fboBsyI3Xo/rg3CGEnV8ss= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com.hk; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=VzUaNakN0l9ByUe7q1dVDq1GGCkOGnZ8qvi97btm8fUeoUdWLyVIO9LI0unrLPdxouMD0pJY2ZJVG3S1lytl3vook5NmDnrOkZp1rXh08tjk7VLXFSO1AaQ8Is0rVSuURTqswS20gBbJogReTvkNR7kICYxyyMQIsVpvZmN5G5E=; X-YMail-OSG: Ytgf2XAVM1mJdz.zyZNvcxKs1.7yRF8jAoS.jp4c7uoG0uK mot4EtdXA7vZw0ZXgOBzwVnjQnQhYpmTyygG2DJ4UVpfiie.mxqKy8otqWQA xijduTqulnlPvc.bepVCIeNwsD0D0OUMP4pfLru3_IyeTvTbejr1ZEH30eLy UU2p7eTYQhMe.nFX8K_WpeGbkpUQlw5Hagwg9e4C6MwPlaLeUt_whS1AXLlK aBwcEx57sM89pX5RbPUsH7qfeMiYADgiUMiSimbkY4tZc2.yPQLlgMV3WZtV rod05eRF1oOarRUb92jIRymNyqapkNuIxm_A1oPgYQFSdWF1y1UkH3uRQMeX uFtRZXJ9xfgOKhkhrdmF8NvrC2XJbKvGC2TvtuoOJu1lPNGngnJHtWPoDfcl cekaeBUptTy1T2xlirTdrTCCd.Erh5JpGralfthPwrlYkCbNkOndZQnsRdfZ l9Vom8ISD5ENV7GdC9a2M3z2wKwvso2bsZZePeMW5p6O6ehnKYQUj Received: from [61.15.240.116] by web190803.mail.sg3.yahoo.com via HTTP; Wed, 26 Dec 2012 15:32:04 SGT X-Rocket-MIMEInfo: 001.001, SSBhbSBjdXJpb3VzIGlmIG90aGVyIG9wZXJhdGluZyBzeXN0ZW1zIGhhdmUgdGhpcyBwZXJmb3JtYW5jZSBpbXBhY3QuDQoNCkNvdWxkIHdlIGhhdmUgc29tZSB3b3JrYXJvdW5kIG9yIG5lZWQgc29tZSBjb2RlIGltcHJvdmVtZW50Pw0KRm9yIGV4YW1wbGU6DQpEbyB0aGUgY2hlY2tpbmcvYWNjb3VudGluZyBvbmx5IGlmIHRoZSBzcGVjaWZpYyBtb3VudCBwb2ludCBoYXMgZW5hYmxlZCBxdW90YS4NCmV0Yy4uDQoNClJlZ2FyZHMsDQpQYXRyaWNrDQoNCi0tLSBPbiBUdWUsIDEyLzI1LzEyLCBLb25zdGFudGkBMAEBAQE- X-Mailer: YahooMailClassic/15.1.2 YahooMailWebService/0.8.129.483 Message-ID: <1356507124.60133.YahooMailClassic@web190803.mail.sg3.yahoo.com> Date: Wed, 26 Dec 2012 15:32:04 +0800 (SGT) From: Patrick Dung Subject: Re: About QUOTA support in stock kernel (resent) To: Eitan Adler , Konstantin Belousov In-Reply-To: <20121225152905.GB82219@kib.kiev.ua> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: freebsd hackers , fs@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Dec 2012 07:32:13 -0000 I am curious if other operating systems have this performance impact. Could we have some workaround or need some code improvement? For example: Do the checking/accounting only if the specific mount point has enabled quota. etc.. Regards, Patrick --- On Tue, 12/25/12, Konstantin Belousov wrote: From: Konstantin Belousov Subject: Re: About QUOTA support in stock kernel (resent) To: "Eitan Adler" Cc: "Patrick Dung" , "freebsd hackers" , fs@freebsd.org Date: Tuesday, December 25, 2012, 11:29 PM On Tue, Dec 25, 2012 at 10:23:26AM -0500, Eitan Adler wrote: > On 25 December 2012 10:07, Konstantin Belousov wrote: > > Enabling quota by default would cause small overhead, like one mutex acquire, > > for each inode and block alloc/dealloc, even for mount without quotas enabled. > > Why is this, and can it be avoided (for mounts without quotas)? Because system should check whether quota is enabled to do the accounting. > > > Might be, it is reasonable to just enable it now. Unless somebody provide > > valid objections and I do not forget, I will do it in a week for HEAD. > > > > -- > Eitan Adler From owner-freebsd-hackers@FreeBSD.ORG Wed Dec 26 08:53:18 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3B732E10 for ; Wed, 26 Dec 2012 08:53:18 +0000 (UTC) (envelope-from dieterbsd@engineer.com) Received: from mout.gmx.net (mout.gmx.net [74.208.4.200]) by mx1.freebsd.org (Postfix) with ESMTP id 0065B8FC14 for ; Wed, 26 Dec 2012 08:53:17 +0000 (UTC) Received: from mailout-us.gmx.com ([172.19.198.45]) by mrigmx.server.lan (mrigmxus002) with ESMTP (Nemesis) id 0MYN9B-1TasLv2zMv-00VAm5 for ; Wed, 26 Dec 2012 09:48:06 +0100 Received: (qmail 21254 invoked by uid 0); 26 Dec 2012 08:48:06 -0000 Received: from 67.206.183.187 by rms-us012 with HTTP Content-Type: text/plain; charset="utf-8" Date: Wed, 26 Dec 2012 03:48:04 -0500 From: "Dieter BSD" Message-ID: <20121226084805.91840@gmx.com> MIME-Version: 1.0 Subject: Re: FreeBSD for serious performance? To: freebsd-hackers@freebsd.org X-Authenticated: #74169980 X-Flags: 0001 X-Mailer: GMX.com Web Mailer x-registered: 0 Content-Transfer-Encoding: 8bit X-GMX-UID: ktyocIRC3zOlNR3dAHAhU25+IGRvb4Bc X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Dec 2012 08:53:18 -0000 > If the driver is doing something daft like DELAY(x) in a fast > interrupt handler which would lead to that behaviour, it should be > fixed. > > If it's doing a DELAY(x) in a critical section, it shuld be fixed. They are doing *something* that completely locks out everything else. It is always a device driver. > Now, it's quite likely you hit some kind of ata(4) bug which kept it > in a tight loop Hard to imagine locking everything out for 19 minutes without being in a loop. > So it was likely just spun > in some high priority loop that nothing lower-priority could really do > anything about. Would several different drivers have this same bug? > The next time it happens, please break into the debugger and grab some > debugging output. Show alllocks, ps, should be a good couple of things > to start with. I've only caught it hanging forever once. It only takes a few milliseconds to cause incoming data to be lost, so I usually don't know about it until looking at the log file later. Not that I could jump into the debugger and gather data in a few milliseconds even if I knew when it was happening. BTW, how do I break into the debugger and gather data when all of the devices are locked out, including the console? I assume that once it recovers, there is no point in gathering data. > Alternately - please find a currently actively maintained SATA chipset. The ata controller is soldered to the mainboard, a gazillion pins I'm sure, and no doubt requires very specialized equipment to replace, and I don't know of any pin-compatable replacements. Besides the hardware itself has never caused any problems. The problem is caused by the software, it is the software that needs to be fixed. Ata isn't maintained? Why the bleep not? Disk drivers are essential. I was under the impression that siis(4) and ahci(4) were actively maintained? I'm running four sata controllers using three different drivers and all three drivers lock out other drivers for too long when something unusual happens. And other, non-disk drivers have the same problem of locking out other drivers, even during normal operation. And this happens on yet other drivers on other people's hardware, not just mine. > help migrate the nvidia chipset support out of ata(4) I've looked at several of FreeBSD's device drivers (including, as you might expect, ata, siis, and ahci) and I can't make heads or tails out of any of them. Back before FreeBSD existed, I did manage to make a significant improvement to a driver in a BSD-derived system, so I'm not a complete idiot. Several different drivers cause the same problem. Are they all making the same mistake? Or is there a problem in something they all use? Whether a design problem or an implementation bug. From owner-freebsd-hackers@FreeBSD.ORG Wed Dec 26 20:53:15 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B1BBB7A0 for ; Wed, 26 Dec 2012 20:53:15 +0000 (UTC) (envelope-from cliftonr@volcano.org) Received: from hrndva-omtalb.mail.rr.com (hrndva-omtalb.mail.rr.com [71.74.56.122]) by mx1.freebsd.org (Postfix) with ESMTP id 642A48FC0C for ; Wed, 26 Dec 2012 20:53:14 +0000 (UTC) X-Authority-Analysis: v=2.0 cv=YruNtvkX c=1 sm=0 a=nLSj6wnnDCA9frvL/Tt8NQ==:17 a=3pwD0LKv0YcA:10 a=z1TLwsU0kBEA:10 a=WthmilfBrBsA:10 a=sLPLfFCmqb0A:10 a=kj9zAlcOel0A:10 a=GjEiR67sAAAA:8 a=vbqy14apGeAA:10 a=6I5d2MoRAAAA:8 a=uyavkMrdAAAA:8 a=4FFUHJPBAAAA:8 a=pGLkceISAAAA:8 a=jb__rZ8GAAAA:8 a=rduEX2khb64y_oajGF4A:9 a=CjuIK1q_8ugA:10 a=SV7veod9ZcQA:10 a=JGX6LFFZUg8A:10 a=WglDhLyllLQA:10 a=Ke08FT2oSu0A:10 a=sHp_62vNEjwA:10 a=ldIYYFWFX0Z42rbn:21 a=j2yJN-BlOmestitc:21 a=nLSj6wnnDCA9frvL/Tt8NQ==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 70.95.171.134 Received: from [70.95.171.134] ([70.95.171.134:38530] helo=oz.volcano.org) by hrndva-oedge03.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id F3/E2-23502-4B36BD05; Wed, 26 Dec 2012 20:53:08 +0000 Received: by oz.volcano.org (Postfix, from userid 1001) id 39ACF5082E; Wed, 26 Dec 2012 10:53:07 -1000 (HST) Date: Wed, 26 Dec 2012 10:53:07 -1000 From: Clifton Royston To: Eitan Adler Subject: Re: looking for someone to fix humanize_number (test cases included) Message-ID: <20121226205307.GA66528@volcano.org> Mail-Followup-To: Eitan Adler , freebsd-hackers@freebsd.org, John-Mark Gurney References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-hackers@freebsd.org, John-Mark Gurney X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Dec 2012 20:53:15 -0000 On Wed, Dec 26, 2012 at 12:00:01PM +0000, freebsd-hackers-request@freebsd.org wrote: > Date: Tue, 25 Dec 2012 14:52:09 -0500 > From: Eitan Adler > To: freebsd-hackers@freebsd.org, John-Mark Gurney > Subject: Re: looking for someone to fix humanize_number (test cases > included) > Message-ID: > > Content-Type: text/plain; charset=UTF-8 > > On 25 December 2012 14:46, Clifton Royston wrote: > >> I correct myself: the function works fine, and there are no bugs I > > could find, though it's clear the man page could emphasize the correct > > usage a bit more. > > Can you submit a diff to the man page as well? I figure if you got > confused at least 10 others got even more confused. I'd be happy to, and will do so soon. I would like to finish rereading and poking the code a little more first, so I understand and can document how scale actually works and what it's doing without "autoscale" set, which is the actual case which John's tests first brought up. Right now its results for some test cases I'm writing don't make much sense to me, particularly with HN_DIVISOR_1000. So far from find+grep under /usr/src it appears to me that every call to humanize_number() in the code base is correctly passing HN_AUTOSCALE - i.e. the ability to pass a specific scale is unused - which may be why this never came up. -- Clifton -- Clifton Royston -- cliftonr@iandicomputing.com / cliftonr@volcano.org President - I and I Computing * http://www.iandicomputing.com/ Custom programming, network design, systems and network consulting services From owner-freebsd-hackers@FreeBSD.ORG Wed Dec 26 22:19:31 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 355C417C for ; Wed, 26 Dec 2012 22:19:31 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-wg0-f49.google.com (mail-wg0-f49.google.com [74.125.82.49]) by mx1.freebsd.org (Postfix) with ESMTP id B66888FC08 for ; Wed, 26 Dec 2012 22:19:30 +0000 (UTC) Received: by mail-wg0-f49.google.com with SMTP id 15so3963223wgd.28 for ; Wed, 26 Dec 2012 14:19:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=gPkLX25wf3ImJT3AFoyF38wOuhdfRsCHt6gBr17hu0Y=; b=Udu2H0KPdtSy4M+hwlAUGttkutFR/dMugwXR6v8M/ESYFLNvcy7ZyQBKQAjtQzCCBp Rx7lQ2lHWAtCpptFi+I5C6nM58Lvo0peTe1kzWIj1R6a/w8brt0J2+897FIz1e41FX1d qqhCvm5lIGdUL6mndzk6pWbjgfHmGei22OwRRbY7qaFBkDJwWOK/2S9MJSF4bJjBzuFv /of0cBFh2uX6oJN8TPIq3iU1B17UkWUP9pHSR4l12ZwSx5iJzlnhBMN2wWfL6fXGc4Te MOwj1WT6Rg1TZC/XC5uvYPZjUh1xJHTVLj9GxRAGHsn235XUcD7uRcSNRHP01o28Sf9p ndRA== MIME-Version: 1.0 Received: by 10.180.33.44 with SMTP id o12mr37972632wii.28.1356560364207; Wed, 26 Dec 2012 14:19:24 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.217.57.9 with HTTP; Wed, 26 Dec 2012 14:19:24 -0800 (PST) In-Reply-To: <20121226084805.91840@gmx.com> References: <20121226084805.91840@gmx.com> Date: Wed, 26 Dec 2012 14:19:24 -0800 X-Google-Sender-Auth: qg_bM52TN853kXcUoiGKvpSYqmo Message-ID: Subject: Re: FreeBSD for serious performance? From: Adrian Chadd To: Dieter BSD Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Dec 2012 22:19:31 -0000 Hm, can you come up with a reproducable scenario where this happening? A lot of times the issues with disk drivers being upset is due to "bad" or "incorrectly seated" SATA cables. We're willing to help you out if you're willing to delve into the driver. Just ask questions about how it works and you'll likely get help :) Adrian From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 03:14:44 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9B905BD0 for ; Thu, 27 Dec 2012 03:14:44 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from vps.rulingia.com (host-122-100-2-194.octopus.com.au [122.100.2.194]) by mx1.freebsd.org (Postfix) with ESMTP id 0A2808FC14 for ; Thu, 27 Dec 2012 03:14:43 +0000 (UTC) Received: from server.rulingia.com (c220-239-254-207.belrs5.nsw.optusnet.com.au [220.239.254.207]) by vps.rulingia.com (8.14.5/8.14.5) with ESMTP id qBR3EafA004823 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Thu, 27 Dec 2012 14:14:37 +1100 (EST) (envelope-from peter@rulingia.com) X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.14.5/8.14.5) with ESMTP id qBR3EVrL005507 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 27 Dec 2012 14:14:31 +1100 (EST) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.14.5/8.14.5/Submit) id qBR3EU8C005505; Thu, 27 Dec 2012 14:14:30 +1100 (EST) (envelope-from peter) Date: Thu, 27 Dec 2012 14:14:30 +1100 From: Peter Jeremy To: Dieter BSD Subject: Re: FreeBSD for serious performance? Message-ID: <20121227031430.GD82100@server.rulingia.com> References: <20121226084805.91840@gmx.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="xgyAXRrhYN0wYx8y" Content-Disposition: inline In-Reply-To: <20121226084805.91840@gmx.com> X-PGP-Key: http://www.rulingia.com/keys/peter.pgp User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 03:14:44 -0000 --xgyAXRrhYN0wYx8y Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2012-Dec-25 21:51:14 -0500, Dieter BSD wrote: >ata(4) completely hung the system for 19 minutes (at which point >I manually intervened, see the PR), probably an infinite loop. > >http://www.freebsd.org/cgi/query-pr.cgi?pr=3D170675 Which contains no useful information. You've even edited out system details that are automatically inserted by send-pr. Please provide a dmesg from a verbose boot of that machine. What brand/model motherboard? What add-in cards do yau have? What do you mean by "completely hung"? What did you try to do to provoke a response? Are you running a GENERIC kernel? If not, please provide your kernel configuration. Please provide the SMART data for ad6 (smartctl -a /dev/ad6). Where does ad6 connect to the controller? Do you use any port-multipliers? What was the system doing when ad6 detached? Since the system ran for 24 hours, apparently without you noticing that ad6 had detached, is ad6 part of a RAID? If so, what is the RAID configuration and technology? >Siis(4) and ahci(4) have also caused data loss, presumably by >blocking interrupts for too long. You're still refusing to provide any useful information that might allow us to locate the supposed problem. >Improving these drivers would be wonderful. But better yet, >can we please find a way to fix the underlying problem? What underlying problem? >When a device driver handles an interrupt, it needs to block >further interrupts while it modifies its data structures. Otherwise >another interrupt coming in might cause it to mangle the data. >Right? But! Why does it need to block interrupts for everything? That depends on how the interrupts are laid out in the hardware. One popular approach on cheap motherboards is to have lots of different devices sharing the same interrupt. In this case, an interrupt generated by one device can block interrupts by all other devices sharing that interrupt. >Alternately, why couldn't the data structures be protected with >a mutex? Then the drivers shouldn't have to block even themselves. > >Alternately, why can't drivers have a polling option? Your patches implementing this functionality appear to have gotten detached from your mail. Could you please resend them. Note that several ethernet drivers already have a polling option (intended to avoid livelock issues at high traffic levels on primitive NICs). >Current machines can have multiple disks, multiple Ethernets, >multiple pretty-much-any-device, multiple CPUs, etc. etc. Which is why it's important to have complete details of the system when reporting issues since the problem may be caused by an unexpected interaction between the components. >have this absurd bottleneck where the device drivers bring >everything to a screaching halt every time an interrupt happens. So you keep claiming without producing any evidence. Can you please point to the code that does this. On 2012-Dec-26 03:48:04 -0500, Dieter BSD wrote: >They are doing *something* that completely locks out everything else. >It is always a device driver. So far, you have failed to provide any details to back this claim up. >Hard to imagine locking everything out for 19 minutes without being >in a loop. I can think of several possibilities: - broken controller locking up the bus - deadlock - clocks stopping (I've seen this in a different scenario) >Would several different drivers have this same bug? You haven't provided any evidence of a software bug. If you're seeing the saem problem across lots of different devices, it suggests a hardware problem. >I've only caught it hanging forever once. It only takes a few >milliseconds to cause incoming data to be lost, I'm not sure what you mean by this. FreeBSD is not a real-time operating system and so offers no guarantees on how long it will take before incoming data will be processed. If you have an application that relies on incoming data being processed within milliseconds, you may need to do some redesign. >BTW, how do I break into the debugger and gather data when all of >the devices are locked out, including the console? Firewire? Have you verified that the console is locked up and you can't enter the debugger? >The ata controller is soldered to the mainboard, a gazillion pins >I'm sure, and no doubt requires very specialized equipment to replace, >and I don't know of any pin-compatable replacements. Besides the >hardware itself has never caused any problems. The problem is caused >by the software, it is the software that needs to be fixed. The limited information you have provided points to a hardware fault, not a software bug. If you have evidence that it's a software bug, please provide it. >Ata isn't maintained? Why the bleep not? Disk drivers are essential. ata(4) _is_ maintained. Your particular obsolete ATA controller may not be. >I was under the impression that siis(4) and ahci(4) were actively >maintained? I'm running four sata controllers using three different >drivers and all three drivers lock out other drivers for too long >when something unusual happens. I'm using both siis & ahci and have never seen anything that points to a bug in those device drivers causing the system to lockup. And I don't recall (offhand) seeing other reports of it. This again points to a problem with your particular configuration, rather than FreeBSD. >And other, non-disk drivers have the same problem of locking out >other drivers, even during normal operation. And this happens on >yet other drivers on other people's hardware, not just mine. Can you provide mailing list or PR references to these. --=20 Peter Jeremy --xgyAXRrhYN0wYx8y Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAlDbvRYACgkQ/opHv/APuIcvqwCgu3JmXM4zsowFIHaXnn5xYDm+ dacAn0fS8zYTrqySCzEkz80BeT5kRppN =HKKM -----END PGP SIGNATURE----- --xgyAXRrhYN0wYx8y-- From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 05:43:02 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D4C71E9F; Thu, 27 Dec 2012 05:43:02 +0000 (UTC) (envelope-from masked@internode.on.net) Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [IPv6:2001:44b8:8060:ff02:300:1:6:6]) by mx1.freebsd.org (Postfix) with ESMTP id 157048FC12; Thu, 27 Dec 2012 05:43:00 +0000 (UTC) Received: from ppp221-140.static.internode.on.net (HELO forexamplePC) ([150.101.221.140]) by ipmail06.adl6.internode.on.net with SMTP; 27 Dec 2012 16:12:46 +1030 Message-ID: From: "Michael Vale" To: , , Subject: Cross Compiling of ports Makefiles. Date: Thu, 27 Dec 2012 16:42:48 +1100 MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal Importance: Normal X-Mailer: Microsoft Windows Live Mail 16.4.3505.912 X-MimeOLE: Produced By Microsoft MimeOLE V16.4.3505.912 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 05:43:02 -0000 Hi,=20 For those of you who are aware I=E2=80=99ve been implementing a complete = cross-compiling series of functions to ports makefiles. I had a good 3+ week break since my last email with a patch to show, and = I=E2=80=99ve totally re-written it and have started from scratch. Not = including any of Ray=E2=80=99s Zrouter code either. While it=E2=80=99s still a work in progress, i have outlined the entire = system to produce target installs into the same staging directory as a = bsd system ready to be flashed onto NAND for embedded, complete with pkg = registry and ldconfig, everything has been thought of. - The reason I = have chosen this method for the ports to be installed into a tree is so = they can be compliled after build/install kernel/world and be combined = into one firmware image seemlessly. Some ports won=E2=80=99t just be = optional applications for future embedded firmware images, = they=E2=80=99ll be an integral part of it. The goal here is to be able = to build complete firmware images in one fowl swoop. Perhaps beyond the = scope most of you out there but I may wish to pick and choose exclude = required parts of the BSD system and replace them with the busybox port = and replace libc with google=E2=80=99s Bionic, uClibc or even musl. = This cannot be achieved currently with the likes of tinderbox and = pourdiere It will still be possible to build packages though. Due to the nature of cross building first i=E2=80=99ll lay out the = options and then tell you which one I am implementing first as there are = reasons for having different build-enviornments/toolchains. Ok, firstly I was going to give you all detail of all possible = cross-compiling scenarios as I outline them. but I=E2=80=99ll have you = know it=E2=80=99s much of a muchness, there is the pros and cons to each = and every different step, the one i=E2=80=99m about to put to you now is = the most feature complete and quickest to implement. That = doesn=E2=80=99t mean building without a DESTDIR JAIL in the future and = just using the build system and it=E2=80=99s tools without a new = toolchain doesn=E2=80=99t make sense (sometimes it does!) and that = i=E2=80=99m not going to do it or that I=E2=80=99m not going to do a = full '=E2=80=99Canadian Cross=E2=80=99. Ultimately as a goal the minimal command do invoke cross compliation is = TARGET(_ARCH)=3D${ARCH} make. This could go on for hours, so after just deleted to extra paragraphs, = i=E2=80=99m going to summerise. first we check for CLANG (as the x-compiler) or if we need to install = xdev (bsd make of gcc compiled for target arch). (ok so some of this wont be in Makefile order (upside down and back to = front), but im just spitting it out as it comes) if GNU configure is used, it usually pretty good at detecting the = compilers executable path from the TARGET triple alone, for worse case = scenario also set ${CC}=E2=80=99s path at the beginning of global env = ${PATH} to override any subsequent. pre-chroot: is mostly used to declare global env variables to keep the = build from failing and making sure the install will complete. do-chroot: and we have to firstly install and BUILD_DEPENDS, remember = these can be libraries too and they have to be built with the build = machines usual stuff and installed in their usual place (lucky we are = using a CHROOTED JAIL here! we could easy make a mess otherwise) = remembering sometimes some depends can be both a BUILD dep AND a RUN dep = to the TARGET. That=E2=80=99s okay, they should always be declared as = correctly and never have to cross-compile a BUILD depend. However a = BUILD depend can be build twice, (once for the build system) and again = (as a TARGET) for the TARGET as a RUN depend for the TARGET. The beauty of doing this work is we can now treat the lib and run = depends more suitably. During this process we can strip the libs, = exclude the headers and change the directory structure to one, save on = inodes, and second pkg register, libtool and ld require the files are = installed into the root tree correctly in order for them to build valid = databases and register them. Now, BUILD/HOST system has already had = it=E2=80=99s tail cut off by DESTDIR. Now there is plenty of ways we = can install everything into a valid sub-directory and have DESTDIR still = considered ROOT and PREFIX or LOCALDIR doesn=E2=80=99t have some obscure = prepending directory that doesn=E2=80=99t exist in the = CROSS_STAGING_ROOT. Some ways include adding a variable in bsd.lib.mk = and in every single one of make=E2=80=99s install targets between = ${DESTDIR} and ${LOCALBASE} or ${PREFIX}. And we could include if = statements for cross, this would leave it at that and we could go ahead = and simply install into a sub-directory before pkg, ldconfig and = firmware image packing occurs, but I=E2=80=99d rather keep all = cross-building to bsd.cross.mk and include it in bsd.port.mk and instead = within DESTDIR do-chroot: re-define ${DESTDIR} as ${_bldroot}${DESTDIR} = and all TARGET_LIBS, RUN_DEPENDS and TARGET install in a CHROOTED=3Dno = chroot. Doing the same thing could also prevent the need for a DESTDIR JAIL = install at all and just use the real build machine=E2=80=99s build env, = rather than a jail. Regardless. We still have to install these targets = and their DESTDIR is skewed. There is a few options, One is to have a MAKEOBJDIRPREFIX like option, and redefine every = target=E2=80=99s DESTDIR ${makeobjDESTDIR} before running do-install. = Now i=E2=80=99ve yet to complete this stage, but I believe this is the = way to do it. There are other options but they aren=E2=80=99t as elegant/will make = baby jesus cry. Now the install of these targets won=E2=80=99t require a chroot. A = chroot could be done, and that would be okay for one port. but if there = is already a cross compiled system in there ready for flashing to disk, = theres no way to chroot without moving files temporarially form the = existing target system and copying or building programs like /bin/sh = that will execute on the build machine and allow chroot to run. We can patch/sed PLIST files, for pkg register to work, patch/sed/edit = ldconfig=E2=80=99s db, and some other steps. But I don=E2=80=99t like = that idea. that=E2=80=99s why I=E2=80=99m opting with the other option and that is = to create some INSTALL_DEPENDS or = CROSS_COMPILING_CHROOT_INSTALL_DEPENDS, if you will. just /bin/sh and = another few=20 build TARGET port in jailed DESTDIR/CHROOTED=3Dyes. this is achieved by installing all build dependencies first... Sorry, I=E2=80=99m too tired to continue on any further! I wanted to wait until the initial plan works, shoot an email off then = get into the good stuff. But it=E2=80=99s taking me longer than I = thought even just to describe all the processes. I didn=E2=80=99t want to submit half-baked Makefiles that don=E2=80=99t = work, but I can only write about half of one anyway haha! Anyway, I=E2=80=99m going to spend some time working on them in the next = few days, so please expect an update. From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 09:40:47 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C9D0FD37 for ; Thu, 27 Dec 2012 09:40:47 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (wojtek.tensor.gdynia.pl [188.252.31.196]) by mx1.freebsd.org (Postfix) with ESMTP id 12C5E8FC13 for ; Thu, 27 Dec 2012 09:40:46 +0000 (UTC) Received: from wojtek.tensor.gdynia.pl (localhost [127.0.0.1]) by wojtek.tensor.gdynia.pl (8.14.5/8.14.5) with ESMTP id qBR9Iljq035122 for ; Thu, 27 Dec 2012 10:18:47 +0100 (CET) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from localhost (wojtek@localhost) by wojtek.tensor.gdynia.pl (8.14.5/8.14.5/Submit) with ESMTP id qBR9Ilc2035119 for ; Thu, 27 Dec 2012 10:18:47 +0100 (CET) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Date: Thu, 27 Dec 2012 10:18:47 +0100 (CET) From: Wojciech Puchar To: freebsd-hackers@freebsd.org Subject: cvs deprecated Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (wojtek.tensor.gdynia.pl [127.0.0.1]); Thu, 27 Dec 2012 10:18:47 +0100 (CET) X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 09:40:47 -0000 but i can't find "moron guide" for using svn to update tree. I never used cvs or svn myself just want to 1) get latest FreeBSD 9-* sources 2) get latest HEAD sources. could someone just tell me what command (and/or config file) i have to use today, as cvs will not work soon From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 09:46:34 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EDF88F53 for ; Thu, 27 Dec 2012 09:46:34 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id ABC598FC12 for ; Thu, 27 Dec 2012 09:46:34 +0000 (UTC) Received: by mail-ob0-f182.google.com with SMTP id 16so8654971obc.13 for ; Thu, 27 Dec 2012 01:46:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=j3PGzRMQVxeykODPk0NIm8r8eSI46VG3bcDx4V4GKQg=; b=zbEfXAbkO0OklJHmYSsN7B1ozm/dBX2mvZQoJa2pJGxMEYh6b8BrpyG9yP2KJ/5Vcu gbQ6F6qxz2aL4mJrzj49wRPzCIPA4MTeUux80fvqOqwgxqjQjxX/qeF+TOwWZfM/FcHq zLVcxjnMLneS71Bbu/frikdn0xT3RQQsN6sN2iyX/5QXri27lkLCR6FgepbYk58xcvUH yk4ZgnVZ/GkIotIpQjvVe59AKwS/J0ZIXhHmhUKfIWas/uBHVlOgCR4MxJCSWJxAbbIB 0ikllJahKzQbfKybmdizg2KXsVyTAt3SpySJ+68mYVztThVpyZaTR0cbRrHyrhSXkH1F u/uw== MIME-Version: 1.0 Received: by 10.60.172.164 with SMTP id bd4mr12458263oec.51.1356601588498; Thu, 27 Dec 2012 01:46:28 -0800 (PST) Received: by 10.76.143.33 with HTTP; Thu, 27 Dec 2012 01:46:28 -0800 (PST) In-Reply-To: References: Date: Thu, 27 Dec 2012 01:46:28 -0800 Message-ID: Subject: Re: cvs deprecated From: Garrett Cooper To: Wojciech Puchar Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 09:46:35 -0000 On Thu, Dec 27, 2012 at 1:18 AM, Wojciech Puchar wrote: > but i can't find "moron guide" for using svn to update tree. > > I never used cvs or svn myself just want to > > 1) get latest FreeBSD 9-* sources > 2) get latest HEAD sources. 1. Checkout the sources: cd /usr/src # Change to something else if you don't want to checkout to /usr/src. svn co http://svn.freebsd.org/base/stable/9 . # stable/9 svn co http://svn.freebsd.org/base/head . # CURRENT 2. Updating: cd /usr/src # Same caveat as above. svn up See also: http://www.freebsd.org/doc/handbook/svn.html . ... HTH, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 09:50:38 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9622C23D for ; Thu, 27 Dec 2012 09:50:38 +0000 (UTC) (envelope-from xxjack12xx@gmail.com) Received: from mail-ie0-f172.google.com (mail-ie0-f172.google.com [209.85.223.172]) by mx1.freebsd.org (Postfix) with ESMTP id 584408FC08 for ; Thu, 27 Dec 2012 09:50:37 +0000 (UTC) Received: by mail-ie0-f172.google.com with SMTP id c13so11516944ieb.31 for ; Thu, 27 Dec 2012 01:50:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=cHznVbSrm2oya/D9q7CYTXYOscqq+bfLdQ0Hbf51zhU=; b=J6TUWnHLa1LrPVLULN0SGSTjU6G5kVjPWXYDKnM6LgP8MrZor09kKRS5MjxqsWbcUY DmCACmsQzhdE9FIBo3z7/pI8oxdtfPB0xG1ak56HK3LgrbVtOK3Z5xCUrAJikzGoQWss cSpT1iSrU0w/tkcLRKt1CUxwWP90QMFKfrIOTN9nZM8aQWG538rH20XWNVJlXaJC5+jP iZwavPthaLhWDdeAde5+KIIVBTfitikZM8EG9jE4N6z6pDG89vMgVBG6KmRDYMHVTSBM RRY1te0vgcv+E184rQ/VS6LnbpRQTwrqwzAOx8zCN0Fh0PLVr/clTiNcPNOXXutev9I1 SHSg== Received: by 10.50.12.165 with SMTP id z5mr26601290igb.17.1356601837482; Thu, 27 Dec 2012 01:50:37 -0800 (PST) MIME-Version: 1.0 Received: by 10.64.55.7 with HTTP; Thu, 27 Dec 2012 01:49:57 -0800 (PST) In-Reply-To: References: From: "Jack L." Date: Thu, 27 Dec 2012 01:49:57 -0800 Message-ID: Subject: Re: cvs deprecated To: Wojciech Puchar Content-Type: text/plain; charset=UTF-8 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 09:50:38 -0000 For svn, you can use svn co svn://svn.freebsd.org/base/[whatever] You can find all the [whatever] at http://svnweb.freebsd.org/base/ so if you wanted to get the latest HEAD src, then it would go something like svn co svn://svn.freebsd.org/base/head On Thu, Dec 27, 2012 at 1:18 AM, Wojciech Puchar wrote: > but i can't find "moron guide" for using svn to update tree. > > I never used cvs or svn myself just want to > > 1) get latest FreeBSD 9-* sources > 2) get latest HEAD sources. > > could someone just tell me what command (and/or config file) i have to use > today, as cvs will not work soon > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 10:30:08 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 20311B42 for ; Thu, 27 Dec 2012 10:30:08 +0000 (UTC) (envelope-from utisoft@gmail.com) Received: from mail-ie0-f181.google.com (mail-ie0-f181.google.com [209.85.223.181]) by mx1.freebsd.org (Postfix) with ESMTP id D284C8FC0A for ; Thu, 27 Dec 2012 10:30:07 +0000 (UTC) Received: by mail-ie0-f181.google.com with SMTP id 16so11438931iea.12 for ; Thu, 27 Dec 2012 02:30:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=/2YZjyGqHX+dP5mZUwYHQSjY1YxACwvGFTFnYyL4CSY=; b=bqiwcEl636Rqd1DvvWf23mCe542kcy03sCKxX3c9op7G98MBVqqZPf8txtP5BDwPzn SlQjnOvsk17jyMiukkvuRzw9+4Aim67GgsNyA+KP1DC4Y+nhzHTQiwk5RYyzVetpgZu8 HWZAoos4V3nkksMYQMuEo9FjyJKV7cM9aY/MLb71ore47r/acf02yxultcbAThHBR+bw IDPSFNl1KxTWKssMjTg7dhskqqH/WC50w/4kv96nnKtIn+UV9YpXto9NDV+wM1MGzrLo 24NHGQsann7lVBifNOoYCdyoW6+c67xSonZs9mtYSfvvY242hPrSU4RsMMBsWp2sAFAT e4BQ== MIME-Version: 1.0 Received: by 10.50.178.10 with SMTP id cu10mr22096536igc.75.1356604201730; Thu, 27 Dec 2012 02:30:01 -0800 (PST) Received: by 10.64.65.132 with HTTP; Thu, 27 Dec 2012 02:30:01 -0800 (PST) Received: by 10.64.65.132 with HTTP; Thu, 27 Dec 2012 02:30:01 -0800 (PST) In-Reply-To: References: Date: Thu, 27 Dec 2012 10:30:01 +0000 Message-ID: Subject: Re: cvs deprecated From: Chris Rees To: Garrett Cooper Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: freebsd-hackers@freebsd.org, Wojciech Puchar X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 10:30:08 -0000 On 27 Dec 2012 09:47, "Garrett Cooper" wrote: > > On Thu, Dec 27, 2012 at 1:18 AM, Wojciech Puchar > wrote: > > but i can't find "moron guide" for using svn to update tree. > > > > I never used cvs or svn myself just want to > > > > 1) get latest FreeBSD 9-* sources > > 2) get latest HEAD sources. > > 1. Checkout the sources: > > cd /usr/src # Change to something else if you don't want to checkout > to /usr/src. > svn co http://svn.freebsd.org/base/stable/9 . # stable/9 > svn co http://svn.freebsd.org/base/head . # CURRENT I recall a cluster administrator advising use of svn protocol rather than http. Something to do with overheads. Chris From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 10:33:01 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B423DDA5 for ; Thu, 27 Dec 2012 10:33:01 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-oa0-f43.google.com (mail-oa0-f43.google.com [209.85.219.43]) by mx1.freebsd.org (Postfix) with ESMTP id 712F18FC08 for ; Thu, 27 Dec 2012 10:33:01 +0000 (UTC) Received: by mail-oa0-f43.google.com with SMTP id k1so8819463oag.30 for ; Thu, 27 Dec 2012 02:33:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=FRGPRDPdZzL4eJGjhmxCSYKf7EttSUAO58EPbi7DMXM=; b=lhqzYdU2iwgj4ltkwD8bAnh08tG6Vv1VAiorNZi+EDTNMybGmEpViHq0TP4xiAwPY2 GYNe3fuPZnGuKtP+uBzJmDb1BIyTywmS+TeNPRX6EA8L3RN0NWNd6lsp7N9NtvXtarXM 5pYOZsFCV2NzdfMLvJrmFFE/LGXwVPbV59/HbOO3qJeFgf5A8u8zEB/5WD+ruNLxuVOY ymQPdVqToYQ8BiNf71wUNPfMB27wCk5otrw2DLm+yI+YNbOdAeKxCu0DLHDlhWWis5vc kC0axm/jA5ljJyARRTWyh28s4sAZs4z5yXwFpe1PuHwMRBgOFhZNzzHTV0V0H+s9mLW7 9l8g== MIME-Version: 1.0 Received: by 10.60.21.167 with SMTP id w7mr12351215oee.18.1356604380882; Thu, 27 Dec 2012 02:33:00 -0800 (PST) Received: by 10.76.143.33 with HTTP; Thu, 27 Dec 2012 02:33:00 -0800 (PST) In-Reply-To: References: Date: Thu, 27 Dec 2012 02:33:00 -0800 Message-ID: Subject: Re: cvs deprecated From: Garrett Cooper To: Chris Rees Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org, Wojciech Puchar X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 10:33:01 -0000 On Thu, Dec 27, 2012 at 2:30 AM, Chris Rees wrote: > > On 27 Dec 2012 09:47, "Garrett Cooper" wrote: >> >> On Thu, Dec 27, 2012 at 1:18 AM, Wojciech Puchar >> wrote: >> > but i can't find "moron guide" for using svn to update tree. >> > >> > I never used cvs or svn myself just want to >> > >> > 1) get latest FreeBSD 9-* sources >> > 2) get latest HEAD sources. >> >> 1. Checkout the sources: >> >> cd /usr/src # Change to something else if you don't want to checkout >> to /usr/src. >> svn co http://svn.freebsd.org/base/stable/9 . # stable/9 >> svn co http://svn.freebsd.org/base/head . # CURRENT > > I recall a cluster administrator advising use of svn protocol rather than > http. Something to do with overheads. Yes, you're right. http opens a connection per-file, which is horrendous with server load and is very slow as HTTP isn't optimized for this purpose (and the current defacto HTTP library used with svn isn't the most performant thing in the world). Unfortunately some groups filter svn:// traffic though (like my employer), so I'm stuck with http:// URIs for now (hence, the force of habit). Thanks, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 14:57:26 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1B68BAC6 for ; Thu, 27 Dec 2012 14:57:26 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-oa0-f46.google.com (mail-oa0-f46.google.com [209.85.219.46]) by mx1.freebsd.org (Postfix) with ESMTP id CD0DE8FC08 for ; Thu, 27 Dec 2012 14:57:25 +0000 (UTC) Received: by mail-oa0-f46.google.com with SMTP id h16so8996503oag.19 for ; Thu, 27 Dec 2012 06:57:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=lG5duq8qNgZT5/3exgGW+NwxoFhGYpGAHhL3+PaGJoI=; b=uF2WL4VjmDFFiAGFIq9oGr2qC2BqiYRJ+Hw0TPKajpLI5mLVmgonTDYU3l9+4Dzd26 +pbVlsVTaSrerylBtJylQW8ssyLMC4vV8dqLVOZKrIoR6pP9VXDImHjUWg8lCFpSaKui /wW/VFKDr9sv7T/x8QyyRUr2pBM26zcNAQcsbp0XkjDV1E+L/4HP8GEfv5nFZTE/vjw2 dalHWz2IgbDL/BXadt9IaEM3mQcRnNTnrYgEptOplwkLzK4RyAJm5a66X7xiMQFZxCrd soCdzelcYata8FmrPu30bwmwCiIoLQQlmaWio1Dd7+hZ3B8xBKAX8Trpyp7VAHgmirPQ aULA== MIME-Version: 1.0 Received: by 10.60.0.165 with SMTP id 5mr13809518oef.128.1356620245015; Thu, 27 Dec 2012 06:57:25 -0800 (PST) Received: by 10.76.143.33 with HTTP; Thu, 27 Dec 2012 06:57:24 -0800 (PST) In-Reply-To: References: Date: Thu, 27 Dec 2012 06:57:24 -0800 Message-ID: Subject: Re: cvs deprecated From: Garrett Cooper To: Warren Block Content-Type: text/plain; charset=ISO-8859-1 Cc: Wojciech Puchar , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 14:57:26 -0000 On Thu, Dec 27, 2012 at 6:50 AM, Warren Block wrote: ... > I see a lot of people switching to the target directory first rather than > just including it as an argument for svn. Is there an advantage there that > I'm missing? I've always just used > > svn co http://svn.freebsd.org/base/stable/9 /usr/src > > and > > svn up /usr/src No difference really, other than the cumulative amount of typed characters is less in the former form compared to the latter form. Thanks, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 14:58:15 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 12EF9BB6 for ; Thu, 27 Dec 2012 14:58:15 +0000 (UTC) (envelope-from wblock@wonkity.com) Received: from wonkity.com (wonkity.com [67.158.26.137]) by mx1.freebsd.org (Postfix) with ESMTP id BCDEB8FC0C for ; Thu, 27 Dec 2012 14:58:14 +0000 (UTC) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.14.5/8.14.5) with ESMTP id qBREolYg066291; Thu, 27 Dec 2012 07:50:47 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.14.5/8.14.5/Submit) with ESMTP id qBREojUN066288; Thu, 27 Dec 2012 07:50:45 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Thu, 27 Dec 2012 07:50:45 -0700 (MST) From: Warren Block To: Garrett Cooper Subject: Re: cvs deprecated In-Reply-To: Message-ID: References: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (wonkity.com [127.0.0.1]); Thu, 27 Dec 2012 07:50:47 -0700 (MST) Cc: Wojciech Puchar , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 14:58:15 -0000 On Thu, 27 Dec 2012, Garrett Cooper wrote: > On Thu, Dec 27, 2012 at 1:18 AM, Wojciech Puchar > wrote: >> but i can't find "moron guide" for using svn to update tree. >> >> I never used cvs or svn myself just want to >> >> 1) get latest FreeBSD 9-* sources >> 2) get latest HEAD sources. > > 1. Checkout the sources: > > cd /usr/src # Change to something else if you don't want to checkout > to /usr/src. > svn co http://svn.freebsd.org/base/stable/9 . # stable/9 > svn co http://svn.freebsd.org/base/head . # CURRENT > > 2. Updating: > > cd /usr/src # Same caveat as above. > svn up > > See also: http://www.freebsd.org/doc/handbook/svn.html . I see a lot of people switching to the target directory first rather than just including it as an argument for svn. Is there an advantage there that I'm missing? I've always just used svn co http://svn.freebsd.org/base/stable/9 /usr/src and svn up /usr/src From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 15:11:53 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BA5C1482 for ; Thu, 27 Dec 2012 15:11:53 +0000 (UTC) (envelope-from wblock@wonkity.com) Received: from wonkity.com (wonkity.com [67.158.26.137]) by mx1.freebsd.org (Postfix) with ESMTP id 6DF848FC13 for ; Thu, 27 Dec 2012 15:11:53 +0000 (UTC) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.14.5/8.14.5) with ESMTP id qBRFBqWZ066618; Thu, 27 Dec 2012 08:11:52 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.14.5/8.14.5/Submit) with ESMTP id qBRFBqLX066615; Thu, 27 Dec 2012 08:11:52 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Thu, 27 Dec 2012 08:11:52 -0700 (MST) From: Warren Block To: Garrett Cooper Subject: Re: cvs deprecated In-Reply-To: Message-ID: References: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (wonkity.com [127.0.0.1]); Thu, 27 Dec 2012 08:11:52 -0700 (MST) Cc: Wojciech Puchar , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 15:11:53 -0000 On Thu, 27 Dec 2012, Garrett Cooper wrote: > On Thu, Dec 27, 2012 at 6:50 AM, Warren Block wrote: > > ... > >> I see a lot of people switching to the target directory first rather than >> just including it as an argument for svn. Is there an advantage there that >> I'm missing? I've always just used >> >> svn co http://svn.freebsd.org/base/stable/9 /usr/src >> >> and >> >> svn up /usr/src > > No difference really, other than the cumulative amount of typed > characters is less in the former form compared to the latter form. Ah, I see what you mean. Depends on whether you were going to cd into the target directory immediately. svn up can update multiple local working copies through one command, too: svn up /usr/src /usr/ports From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 15:28:19 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1424B76B for ; Thu, 27 Dec 2012 15:28:19 +0000 (UTC) (envelope-from rwmaillists@googlemail.com) Received: from mail-bk0-f48.google.com (mail-bk0-f48.google.com [209.85.214.48]) by mx1.freebsd.org (Postfix) with ESMTP id 8638B8FC08 for ; Thu, 27 Dec 2012 15:28:18 +0000 (UTC) Received: by mail-bk0-f48.google.com with SMTP id jc3so4360252bkc.35 for ; Thu, 27 Dec 2012 07:28:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:date:from:to:subject:message-id:in-reply-to:references :x-mailer:mime-version:content-type:content-transfer-encoding; bh=0IzIlcnLaaRmI7fvSj5Ipdg3nTJXOe2GI99N29L/YcE=; b=Br+QAQFkDcKuGYTeHrk8aTjD/1toGKhvfSI01UdRCjXwsWk4mf3JJR92by01k6dX7e 1Hfy2DH7vmAOSmBicfPMs0SQSsmwWJz/O3WifNU8MTDtFRIwZOX7u2Ag9Z3HK4xw9djO 5t/YYbfKOZ/thNPB09DjM/oEeuVK3DLm4xVD++FBmTCDbLUvZCbzysix3RFtgbNTxu29 LLHdBtoiDFBRAgc9hP74AhUJU/mb+LgfKaEeT/AbCg06HcIXglCZUg2b881M3y91WLZi M0MuhdOJkhoJXviV2sVoKzl6wwpigPB3MDXS24yajQPp1mW/I0PiaV3HLAab9ZLC8hsL OD3w== X-Received: by 10.204.128.197 with SMTP id l5mr15227517bks.59.1356622091083; Thu, 27 Dec 2012 07:28:11 -0800 (PST) Received: from gumby.homeunix.com (87-194-105-247.bethere.co.uk. [87.194.105.247]) by mx.google.com with ESMTPS id l17sm20901799bkw.12.2012.12.27.07.28.07 (version=SSLv3 cipher=OTHER); Thu, 27 Dec 2012 07:28:09 -0800 (PST) Date: Thu, 27 Dec 2012 15:28:04 +0000 From: RW To: freebsd-hackers@freebsd.org Subject: Re: cvs deprecated Message-ID: <20121227152804.3fab55e8@gumby.homeunix.com> In-Reply-To: References: X-Mailer: Claws Mail 3.9.0 (GTK+ 2.24.6; amd64-portbld-freebsd8.3) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 15:28:19 -0000 On Thu, 27 Dec 2012 02:33:00 -0800 Garrett Cooper wrote: > On Thu, Dec 27, 2012 at 2:30 AM, Chris Rees wrote: > > > > I recall a cluster administrator advising use of svn protocol > > rather than http. Something to do with overheads. > > Yes, you're right. http opens a connection per-file, which is > horrendous with server load and is very slow as HTTP isn't optimized > for this purpose Presumably that's a limitation of the library or subversion because it's not true of HTTP per se. Portsnap, for example, uses persistent connections with pipelining. > (and the current defacto HTTP library used with svn > isn't the most performant thing in the world). From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 15:43:59 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 13711B22 for ; Thu, 27 Dec 2012 15:43:59 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-ob0-f172.google.com (mail-ob0-f172.google.com [209.85.214.172]) by mx1.freebsd.org (Postfix) with ESMTP id C2A158FC0A for ; Thu, 27 Dec 2012 15:43:58 +0000 (UTC) Received: by mail-ob0-f172.google.com with SMTP id za17so8953034obc.31 for ; Thu, 27 Dec 2012 07:43:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Aj5YdrHU9e3+s09rFi9qWAFrdnl1hGn/yoKkvzdIWbY=; b=bMEsFPsoJ3Ml3g6lxqLJBs0n8iqX1q9yi0VjsWgMic2gyqxC9lqZ9hA/BYe2fulVwf sVVIWocyWf7Wmzli5XgmhkVPbozRs+AHLNh0g6d6zSIIhW80Xb+afxIlJfRKE6Pn6Mp0 a4zLqKvtt/PdNBpg+1qHIlZlZs0EJgdE6kgzrYA+ZSS3oaFnlCIR6PjAd9TL03TCmsg6 pQG5i8P602JLkBAKD4U2W/4cr1ctXEixifvMyasBip/oDEn9gSEX0ynka81I+McynjQh 7hez3fKsyQPJWwyNklV/TETJt2ylMXul0kKGdcGP806wAuCe63YAKIS4JeIQiqrQE5qI /tqA== MIME-Version: 1.0 Received: by 10.60.0.165 with SMTP id 5mr13927987oef.128.1356623032183; Thu, 27 Dec 2012 07:43:52 -0800 (PST) Received: by 10.76.143.33 with HTTP; Thu, 27 Dec 2012 07:43:52 -0800 (PST) In-Reply-To: <20121227152804.3fab55e8@gumby.homeunix.com> References: <20121227152804.3fab55e8@gumby.homeunix.com> Date: Thu, 27 Dec 2012 07:43:52 -0800 Message-ID: Subject: Re: cvs deprecated From: Garrett Cooper To: RW Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 15:43:59 -0000 On Thu, Dec 27, 2012 at 7:28 AM, RW wrote: > On Thu, 27 Dec 2012 02:33:00 -0800 > Garrett Cooper wrote: > >> On Thu, Dec 27, 2012 at 2:30 AM, Chris Rees wrote: >> > > >> > I recall a cluster administrator advising use of svn protocol >> > rather than http. Something to do with overheads. >> >> Yes, you're right. http opens a connection per-file, which is >> horrendous with server load and is very slow as HTTP isn't optimized >> for this purpose > > Presumably that's a limitation of the library or subversion because it's > not true of HTTP per se. Portsnap, for example, uses persistent > connections with pipelining. An example of what I mean [1]: ======================= A checkout/update over svn:// is approx 4-12 times faster than over http(s):// . The factor depends on number of files/folders and file size . Apache is much slower on many small files because each file is a full http-request-response cycle. In Tortoise you can easily see the speed dropping: Checkout a large java projects If you transfer a huge .jar, transfer is going up, on getting source java files and creating package structure, it will drop. Also important is that svn checkout is slower on client than svn export and also eclipse(java) is much slower than tortoise/CMD. share|improve this answer ======================= Qualitatively we (my group) have seen a huge performance increase in our svnsyncs from freebsd.org using svn:// instead of http:// . We haven't measured how much the difference is quantatively though because a qualitative answer was sufficient for helping reinforce a business case for unfiltering that port with corporate. HTH, -Garrett 1. http://stackoverflow.com/questions/372569/subversion-protocol-performance From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 16:29:23 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A9368927 for ; Thu, 27 Dec 2012 16:29:23 +0000 (UTC) (envelope-from sfourman@gmail.com) Received: from mail-ea0-f177.google.com (mail-ea0-f177.google.com [209.85.215.177]) by mx1.freebsd.org (Postfix) with ESMTP id 3A6078FC08 for ; Thu, 27 Dec 2012 16:29:23 +0000 (UTC) Received: by mail-ea0-f177.google.com with SMTP id c10so3894013eaa.8 for ; Thu, 27 Dec 2012 08:29:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=9laoIJ6RduHaTzn1Ec/SWoGONJ5Cr84r+enqJpfALak=; b=WGT46A/zLIKAeSToL/Ogl1zZlr/OijC/XaXVdzXQ5UHGs4sU7i20S1JZ0VgpK4CJIP CYBWAh9lKTv02lMDYrP+i9m3Q9YCVVTtq7F2Uhwk9Zmhna4k/31oP05jXKey222dPLTP Mb4Ua92FOWmQ84htS5sMNWGFAdWkIp9HT35kDbf6Gc5/8fJU/eGW0Zv1h5JJLrsKE7YS LWxk91sqVS6i0SCjvxgyp+toovx60DyJ2xTcP4CPHTHl7OrXyLl9VYbZjQpQJZP7IhbN 6xTImHLszv+rgEGfgNyDu6UZcUyj0Z2IrqUksVduSAvOZVYaT/QF4sky0SbRZfijyLPq dLEw== MIME-Version: 1.0 Received: by 10.14.208.137 with SMTP id q9mr78546521eeo.28.1356625762125; Thu, 27 Dec 2012 08:29:22 -0800 (PST) Received: by 10.223.6.69 with HTTP; Thu, 27 Dec 2012 08:29:21 -0800 (PST) In-Reply-To: References: Date: Thu, 27 Dec 2012 11:29:21 -0500 Message-ID: Subject: Re: cvs deprecated From: "Sam Fourman Jr." To: Wojciech Puchar Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 16:29:23 -0000 On Thu, Dec 27, 2012 at 4:18 AM, Wojciech Puchar wrote: > but i can't find "moron guide" for using svn to update tree. I cant seem to find a way to handle conflicts, ive tried to do svn revert on every directory, but there is always more... maybe svn just isnt a good way to keep your ports tree current svn up Updating '.': Skipped 'databases' -- Node remains in conflict Skipped 'irc' -- Node remains in conflict Skipped 'lang' -- Node remains in conflict Skipped 'security/cyrus-sasl2' -- Node remains in conflict Skipped 'x11/keybinder' -- Node remains in conflict Skipped 'net-mgmt' -- Node remains in conflict At revision 309546. Summary of conflicts: Skipped paths: 6 -- Sam Fourman Jr. From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 17:15:47 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 682D79AE for ; Thu, 27 Dec 2012 17:15:47 +0000 (UTC) (envelope-from sem@FreeBSD.org) Received: from mail.ciam.ru (mail.ciam.ru [91.209.218.18]) by mx1.freebsd.org (Postfix) with ESMTP id 0FE078FC08 for ; Thu, 27 Dec 2012 17:15:46 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ciam.ru; s=dkim; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:References:Subject:CC:To:MIME-Version:From:Date:Message-ID; bh=qcA2KskT7eLgYMQ4C2M/GUflxDYrOeevmVQ/ITQ/Yrg=; b=fg1IiSov66DQPs8yiW7A0UhvKWTIYIbpxBQzfmarJ+xedxtl1ZeA1j78wxoxgomU6cHQ3JsHtjQ1KpdLD/mAcc4f2u4y9F9EhIp6uip6vfGmmSN0sLfEKoZhfL++1cO94MYBuVHB96WF+WIi1D1nNpR+p0ZdVN+gEZion3332gU=; Received: from dhcp170-188-red.yandex.net ([95.108.170.188]) by mail.ciam.ru with esmtpa (Exim 4.x) id 1ToGSW-0006vj-R9; Thu, 27 Dec 2012 20:37:28 +0400 Message-ID: <50DC7958.70305@FreeBSD.org> Date: Thu, 27 Dec 2012 20:37:44 +0400 From: Sergey Matveychuk User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: "Sam Fourman Jr." Subject: Re: cvs deprecated References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Wojciech Puchar , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 17:15:47 -0000 27.12.2012 20:29, Sam Fourman Jr. wrote: > On Thu, Dec 27, 2012 at 4:18 AM, Wojciech Puchar > wrote: >> but i can't find "moron guide" for using svn to update tree. > > I cant seem to find a way to handle conflicts, ive tried to do svn > revert on every directory, but there is always more... maybe svn just > isnt a good way to keep your ports tree current > > svn up > Updating '.': > Skipped 'databases' -- Node remains in conflict > Skipped 'irc' -- Node remains in conflict > Skipped 'lang' -- Node remains in conflict > Skipped 'security/cyrus-sasl2' -- Node remains in conflict > Skipped 'x11/keybinder' -- Node remains in conflict > Skipped 'net-mgmt' -- Node remains in conflict > At revision 309546. > Summary of conflicts: > Skipped paths: 6 > svn revert -R /usr/ports - works for me. From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 17:22:37 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B43F8AF3; Thu, 27 Dec 2012 17:22:37 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-pb0-f43.google.com (mail-pb0-f43.google.com [209.85.160.43]) by mx1.freebsd.org (Postfix) with ESMTP id 76E948FC12; Thu, 27 Dec 2012 17:22:37 +0000 (UTC) Received: by mail-pb0-f43.google.com with SMTP id um15so5496168pbc.30 for ; Thu, 27 Dec 2012 09:22:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:x-mailer:from:subject:date :to; bh=spVO4lUfAthIAFWrxf3laCf/YZIUsmlZcVOr1ICuP2k=; b=0ZA1G0LZIZpdbZNDsZiUZmpXMeByYlXGl6t9HZNc72gMTaHWlB7ol/d3njtxoJaAmB fAk+Uj5Y/cnVfql0pNX2C56d2HbMxRu8OtesOclU2j4o25ca/crIxlc6q//VfaFSjsAa y5kNhJokMhhCnGj0vpDQBvFAkb8j04QAHaF3m85Dg+7XZlx/6ZDY/ybaklvz13Zz0mps FQnb2eTbXdM8HAbMD02Ytq1lNGYRd/+eK6kLH+FHcIpgrYiuSeN0lWNcAtLVmAfWdqV7 3B3gISNzkzjelh6iF1AhcxFc+D06KN9BZEgkR/9JZdkfFmG1JH7mmGChrgjSPTVy589x IbQA== X-Received: by 10.68.239.99 with SMTP id vr3mr96454666pbc.154.1356628950967; Thu, 27 Dec 2012 09:22:30 -0800 (PST) Received: from [10.35.85.214] (mobile-166-147-094-097.mycingular.net. [166.147.94.97]) by mx.google.com with ESMTPS id nw9sm18109765pbb.42.2012.12.27.09.22.28 (version=SSLv3 cipher=OTHER); Thu, 27 Dec 2012 09:22:29 -0800 (PST) References: <50DC7958.70305@FreeBSD.org> Mime-Version: 1.0 (1.0) In-Reply-To: <50DC7958.70305@FreeBSD.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: <74CCA452-07DD-4E17-9E0E-66EBAF9B0470@gmail.com> X-Mailer: iPhone Mail (10A523) From: Garrett Cooper Subject: Re: cvs deprecated Date: Thu, 27 Dec 2012 09:22:24 -0800 To: Sergey Matveychuk Cc: "Sam Fourman Jr." , Wojciech Puchar , "freebsd-hackers@freebsd.org" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 17:22:37 -0000 On Dec 27, 2012, at 8:37 AM, Sergey Matveychuk wrote: > 27.12.2012 20:29, Sam Fourman Jr. wrote: >> On Thu, Dec 27, 2012 at 4:18 AM, Wojciech Puchar >> wrote: >>> but i can't find "moron guide" for using svn to update tree. >>=20 >> I cant seem to find a way to handle conflicts, ive tried to do svn >> revert on every directory, but there is always more... maybe svn just >> isnt a good way to keep your ports tree current >>=20 >> svn up >> Updating '.': >> Skipped 'databases' -- Node remains in conflict >> Skipped 'irc' -- Node remains in conflict >> Skipped 'lang' -- Node remains in conflict >> Skipped 'security/cyrus-sasl2' -- Node remains in conflict >> Skipped 'x11/keybinder' -- Node remains in conflict >> Skipped 'net-mgmt' -- Node remains in conflict >> At revision 309546. >> Summary of conflicts: >> Skipped paths: 6 >=20 > svn revert -R /usr/ports - works for me. If you're checking out to a directory that already exists, svn resolved is t= he way to handle that. There might be (-> probably is) a way to check out th= e metadata by itself, but I can't verify how right now. Hth, -Garrett= From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 18:31:40 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 28066917 for ; Thu, 27 Dec 2012 18:31:40 +0000 (UTC) (envelope-from cliftonr@volcano.org) Received: from hrndva-omtalb.mail.rr.com (hrndva-omtalb.mail.rr.com [71.74.56.122]) by mx1.freebsd.org (Postfix) with ESMTP id CBA678FC0A for ; Thu, 27 Dec 2012 18:31:39 +0000 (UTC) X-Authority-Analysis: v=2.0 cv=Jaw+XD2V c=1 sm=0 a=nLSj6wnnDCA9frvL/Tt8NQ==:17 a=3pwD0LKv0YcA:10 a=z1TLwsU0kBEA:10 a=WthmilfBrBsA:10 a=sLPLfFCmqb0A:10 a=kj9zAlcOel0A:10 a=GjEiR67sAAAA:8 a=vbqy14apGeAA:10 a=6I5d2MoRAAAA:8 a=uyavkMrdAAAA:8 a=4FFUHJPBAAAA:8 a=pGLkceISAAAA:8 a=jb__rZ8GAAAA:8 a=xERaT4hCXWtQ0p4kfbsA:9 a=CjuIK1q_8ugA:10 a=lQ7BwGF-Y-wA:10 a=SV7veod9ZcQA:10 a=JGX6LFFZUg8A:10 a=WglDhLyllLQA:10 a=Ke08FT2oSu0A:10 a=sHp_62vNEjwA:10 a=YWxM20KZKtQXhz3x:21 a=E3B3KeU8iniZbwx2:21 a=nLSj6wnnDCA9frvL/Tt8NQ==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 70.95.171.134 Received: from [70.95.171.134] ([70.95.171.134:57720] helo=oz.volcano.org) by hrndva-oedge01.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id F5/35-15459-A049CD05; Thu, 27 Dec 2012 18:31:38 +0000 Received: by oz.volcano.org (Postfix, from userid 1001) id DC7235082E; Thu, 27 Dec 2012 08:31:36 -1000 (HST) Date: Thu, 27 Dec 2012 08:31:36 -1000 From: Clifton Royston To: Eitan Adler , freebsd-hackers@freebsd.org, John-Mark Gurney Subject: Re: looking for someone to fix humanize_number (test cases included) Message-ID: <20121227183136.GA77509@volcano.org> Mail-Followup-To: Eitan Adler , freebsd-hackers@freebsd.org, John-Mark Gurney References: <20121226205307.GA66528@volcano.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20121226205307.GA66528@volcano.org> User-Agent: Mutt/1.4.2.3i X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 18:31:40 -0000 On Wed, Dec 26, 2012 at 10:53:07AM -1000, Clifton Royston wrote: > On Wed, Dec 26, 2012 at 12:00:01PM +0000, freebsd-hackers-request@freebsd.org wrote: > > Date: Tue, 25 Dec 2012 14:52:09 -0500 > > From: Eitan Adler > > To: freebsd-hackers@freebsd.org, John-Mark Gurney > > Subject: Re: looking for someone to fix humanize_number (test cases included) > > Message-ID: > > > > Content-Type: text/plain; charset=UTF-8 > > > > On 25 December 2012 14:46, Clifton Royston wrote: > > >> I correct myself: the function works fine, and there are no bugs I > > > could find, though it's clear the man page could emphasize the correct > > > usage a bit more. > > > > Can you submit a diff to the man page as well? I figure if you got > > confused at least 10 others got even more confused. > > I'd be happy to, and will do so soon. ... Update - I've much expanded the test cases, up to around 120 so far, although they don't yet cover HN_GETSCALE, HN_DECIMAL, HN_NOSPACE, or HN_B. I may put in some rudimentary tests for HN_GETSCALE but don't plan to cover the latter three at all, although HN_NOSPACE and HN_B are pretty trivial. I've also added checking of expected vs. actual return values. I'll put the updated test program somewhere shortly. In the current library routine, these tests have found one more piece of arguable misdesign for discussion, and several out-and-out bugs. 1) Possible misdesign - the current implementation raises an assertion and coredumps the calling program on a negative scale value; other invalid scale values simply return -1. I'd argue both should do the same thing, and I think the latter is less astonishing. (It's not like passing a null buffer pointer IMHO.) It's not a huge issue though so I'd be willing to leave it. The new test program has an option to enable testing of negative scale values. 2) Bug: If compiled with NDEBUG to disable the assert, negative values of scale < 0 would not be checked for. I am fixing this. 3) Bug: the only valid scale values are 0-7, HN_GETSCALE, and HN_AUTOSCALE; no combinations of these are valid. (0 does no scaling and acts as a glorified printf, so is rarely useful.) However, any number which happens to have the HN_GETSCALE and/or HN_AUTOSCALE bit set will be accepted and likely do something astonishing for the caller. I am fixing this so only the specified values are accepted. 4) Documentation: needs to specify what I just wrote about scale values, plus what must be true to avoid assertion failures, as well as points raised above about values passed via scale vs. flags parms. 5) Bug: number values in the range of .5 exa[byte] and above are never or rarely handled correctly; the code does some multiplies up front which will cause them to wrap and return completely bogus values. I haven't tried to fix this as yet. The new test program has a -E option to enable testing of exabyte range number values. Obviously nobody's using our utils on exabyte-sized filesystems as yet... The new test program has a -E option to enable testing of exabyte range number values. 6) Undefined case: when the function exits due to an invalid scale value, it does not set the buffer (if valid) to an empty string. I intend to have it do that, mostly to make it more convenient for testing. -- Clifton Comparison of results from libutil vs. my current version: [cliftonr@oz ~/humanize_number]$ ./test_humanize_numbers -E wrong return value on index 6, got: 19 + "-53", expected 3 + "1 E"; num = 500000000000000000, scale = 32, flags= HN_DIVISOR_1000. result mismatch on index 13, got: "0 E", expected "2 E"; num = 1500000000000000000, scale = 32, flags= HN_DIVISOR_1000. result mismatch on index 20, got: "0 E", expected "1 E"; num = 576460752303423488, scale = 32, flags= . result mismatch on index 27, got: "0 E", expected "2 E"; num = 1729382256910270464, scale = 32, flags= . result mismatch on index 48, got: "0 E", expected "1 E"; num = 500000000000000000, scale = 6, flags= HN_DIVISOR_1000. result mismatch on index 60, got: "0 E", expected "2 E"; num = 1500000000000000000, scale = 6, flags= HN_DIVISOR_1000. result mismatch on index 72, got: "0 E", expected "1 E"; num = 576460752303423488, scale = 6, flags= . result mismatch on index 84, got: "0 E", expected "2 E"; num = 1729382256910270464, scale = 6, flags= . result mismatch on index 85, got: "0 E", expected ""; num = 1, scale = 7, flags= . result mismatch on index 86, got: "0 E", expected ""; num = 1, scale = 7, flags= HN_DIVISOR_1000. expected error on index 87, but got: 2 + "1 "; num = 1, scale = 1000, flags= . expected error on index 88, but got: 2 + "1 "; num = 1, scale = 1000, flags= HN_DIVISOR_1000. result mismatch on index 89, got: "1 ", expected ""; num = 0, scale = 1000000, flags= . result mismatch on index 90, got: "1 ", expected ""; num = 0, scale = 1000000, flags= HN_DIVISOR_1000. expected error on index 91, but got: 0 + ""; num = 0, scale = 2147483647, flags= . expected error on index 92, but got: 0 + ""; num = 0, scale = 2147483647, flags= HN_DIVISOR_1000. total errors: 16/117 tests [cliftonr@oz ~/humanize_number]$ ./test_humanize_numbers_new -E -n wrong return value on index 6, got: 19 + "-53", expected 3 + "1 E"; num = 500000000000000000, scale = 32, flags= HN_DIVISOR_1000. result mismatch on index 13, got: "0 E", expected "2 E"; num = 1500000000000000000, scale = 32, flags= HN_DIVISOR_1000. result mismatch on index 20, got: "0 E", expected "1 E"; num = 576460752303423488, scale = 32, flags= . result mismatch on index 27, got: "0 E", expected "2 E"; num = 1729382256910270464, scale = 32, flags= . result mismatch on index 48, got: "0 E", expected "1 E"; num = 500000000000000000, scale = 6, flags= HN_DIVISOR_1000. result mismatch on index 60, got: "0 E", expected "2 E"; num = 1500000000000000000, scale = 6, flags= HN_DIVISOR_1000. result mismatch on index 72, got: "0 E", expected "1 E"; num = 576460752303423488, scale = 6, flags= . result mismatch on index 84, got: "0 E", expected "2 E"; num = 1729382256910270464, scale = 6, flags= . total errors: 8/123 tests -- Clifton Royston -- cliftonr@iandicomputing.com / cliftonr@volcano.org President - I and I Computing * http://www.iandicomputing.com/ Custom programming, network design, systems and network consulting services From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 18:19:50 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 248B073F; Thu, 27 Dec 2012 18:19:50 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from exprod7og123.obsmtp.com (exprod7og123.obsmtp.com [64.18.2.24]) by mx1.freebsd.org (Postfix) with ESMTP id C7DBB8FC0C; Thu, 27 Dec 2012 18:19:49 +0000 (UTC) Received: from P-EMHUB03-HQ.jnpr.net ([66.129.224.36]) (using TLSv1) by exprod7ob123.postini.com ([64.18.6.12]) with SMTP ID DSNKUNyRRfx8jGDkcP6nEZ6NSV8YljduXqtB@postini.com; Thu, 27 Dec 2012 10:19:49 PST Received: from magenta.juniper.net (172.17.27.123) by P-EMHUB03-HQ.jnpr.net (172.24.192.33) with Microsoft SMTP Server (TLS) id 8.3.213.0; Thu, 27 Dec 2012 10:00:47 -0800 Received: from chaos.jnpr.net (chaos.jnpr.net [172.24.29.229]) by magenta.juniper.net (8.11.3/8.11.3) with ESMTP id qBRI0i301557; Thu, 27 Dec 2012 10:00:46 -0800 (PST) (envelope-from sjg@juniper.net) Received: from chaos.jnpr.net (localhost [127.0.0.1]) by chaos.jnpr.net (Postfix) with ESMTP id 7947F58094; Thu, 27 Dec 2012 10:00:44 -0800 (PST) To: Michael Vale Subject: Re: Cross Compiling of ports Makefiles. In-Reply-To: References: Comments: In-reply-to: "Michael Vale" message dated "Thu, 27 Dec 2012 16:42:48 +1100." From: "Simon J. Gerraty" X-Mailer: MH-E 7.82+cvs; nmh 1.3; GNU Emacs 22.3.1 MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Date: Thu, 27 Dec 2012 10:00:44 -0800 Message-ID: <20121227180044.7947F58094@chaos.jnpr.net> X-Mailman-Approved-At: Thu, 27 Dec 2012 21:49:35 +0000 Cc: freebsd-hackers@freebsd.org, freebsd-ports@freebsd.org, freebsd-arch@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 18:19:50 -0000 >Doing the same thing could also prevent the need for a DESTDIR JAIL >install at all and just use the real build machine=E2=80=99s build env, ra= ther >than a jail. Regardless. We still have to install these targets and >their DESTDIR is skewed. There is a few options,=20 I think I know what you mean, but not clear on the "their DESTDIR is skewed" bit. >One is to have a MAKEOBJDIRPREFIX like option, and redefine every >target=E2=80=99s DESTDIR ${makeobjDESTDIR} before running do-install. Now= i=E2=80=99ve >yet to complete this stage, but I believe this is the way to do it.=20 Would it be sufficient to have an INSTALL_PREFIX and/or INSTALL_DESTDIR so that DESTDIR can be different during install ? [I was recently experimenting with something similar...] From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 23:04:59 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A7E65CB3 for ; Thu, 27 Dec 2012 23:04:59 +0000 (UTC) (envelope-from wblock@wonkity.com) Received: from wonkity.com (wonkity.com [67.158.26.137]) by mx1.freebsd.org (Postfix) with ESMTP id 5E88D8FC08 for ; Thu, 27 Dec 2012 23:04:59 +0000 (UTC) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.14.5/8.14.5) with ESMTP id qBRN4wPh043708; Thu, 27 Dec 2012 16:04:58 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.14.5/8.14.5/Submit) with ESMTP id qBRN4vjf043705; Thu, 27 Dec 2012 16:04:57 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Thu, 27 Dec 2012 16:04:57 -0700 (MST) From: Warren Block To: "Sam Fourman Jr." Subject: Re: cvs deprecated In-Reply-To: Message-ID: References: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (wonkity.com [127.0.0.1]); Thu, 27 Dec 2012 16:04:58 -0700 (MST) Cc: Wojciech Puchar , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 23:04:59 -0000 On Thu, 27 Dec 2012, Sam Fourman Jr. wrote: > On Thu, Dec 27, 2012 at 4:18 AM, Wojciech Puchar > wrote: >> but i can't find "moron guide" for using svn to update tree. > > I cant seem to find a way to handle conflicts, ive tried to do svn > revert on every directory, but there is always more... maybe svn just > isnt a good way to keep your ports tree current > > svn up > Updating '.': > Skipped 'databases' -- Node remains in conflict > Skipped 'irc' -- Node remains in conflict > Skipped 'lang' -- Node remains in conflict > Skipped 'security/cyrus-sasl2' -- Node remains in conflict > Skipped 'x11/keybinder' -- Node remains in conflict > Skipped 'net-mgmt' -- Node remains in conflict > At revision 309546. > Summary of conflicts: > Skipped paths: 6 A checkout of the entire /usr/ports into an empty directory is the way to start. You can save the distfiles directory out of an existing /usr/ports first if desired. And any customizations to ports files, if you have them. Note that svn checkouts don't automatically combine. Checking out /usr/ports is not equivalent to checking out all the category subdirectories into /usr/ports. From owner-freebsd-hackers@FreeBSD.ORG Thu Dec 27 23:11:47 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3F36FDDA for ; Thu, 27 Dec 2012 23:11:47 +0000 (UTC) (envelope-from doconnor@gsoft.com.au) Received: from cain.gsoft.com.au (cain.gsoft.com.au [203.31.81.10]) by mx1.freebsd.org (Postfix) with ESMTP id 375638FC0C for ; Thu, 27 Dec 2012 23:11:44 +0000 (UTC) Received: from ur.dons.net.au (ppp14-2-18-58.lns21.adl2.internode.on.net [14.2.18.58]) (authenticated bits=0) by cain.gsoft.com.au (8.14.4/8.14.3) with ESMTP id qBRMtk0Z051402 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Fri, 28 Dec 2012 09:25:51 +1030 (CST) (envelope-from doconnor@gsoft.com.au) Subject: Re: FreeBSD for serious performance? Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Content-Type: multipart/signed; boundary="Apple-Mail=_6E156F4A-83B7-487B-B28B-D16BCF726430"; protocol="application/pkcs7-signature"; micalg=sha1 From: "Daniel O'Connor" In-Reply-To: <20121227031430.GD82100@server.rulingia.com> Date: Fri, 28 Dec 2012 09:25:45 +1030 Message-Id: <66E63A5B-FD16-4B1C-94D3-EA15F51EC22F@gsoft.com.au> References: <20121226084805.91840@gmx.com> <20121227031430.GD82100@server.rulingia.com> To: Peter Jeremy X-Mailer: Apple Mail (2.1499) X-Spam-Score: 0.163 () BAYES_00,RDNS_DYNAMIC X-Scanned-By: MIMEDefang 2.67 on 203.31.81.10 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: freebsd-hackers@freebsd.org, Dieter BSD X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Dec 2012 23:11:47 -0000 --Apple-Mail=_6E156F4A-83B7-487B-B28B-D16BCF726430 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 27/12/2012, at 13:44, Peter Jeremy wrote: >> I've only caught it hanging forever once. It only takes a few >> milliseconds to cause incoming data to be lost, >=20 > I'm not sure what you mean by this. FreeBSD is not a real-time > operating system and so offers no guarantees on how long it will > take before incoming data will be processed. If you have an > application that relies on incoming data being processed within > milliseconds, you may need to do some redesign. In practise FreeBSD can actually do this (at least for moderate IO = loads). At $work we use a USB interface to acquire ~10MB/sec from a data = acquisition system which has a 96k FIFO (which is ~10 msec of = buffering). We use 3ware RAID cards to write to disk on Supermicro boards though, = you get what you pay for.. -- Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C --Apple-Mail=_6E156F4A-83B7-487B-B28B-D16BCF726430-- From owner-freebsd-hackers@FreeBSD.ORG Fri Dec 28 00:24:42 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 22586ADE for ; Fri, 28 Dec 2012 00:24:42 +0000 (UTC) (envelope-from cliftonr@volcano.org) Received: from hrndva-omtalb.mail.rr.com (hrndva-omtalb.mail.rr.com [71.74.56.122]) by mx1.freebsd.org (Postfix) with ESMTP id CAA138FC08 for ; Fri, 28 Dec 2012 00:24:41 +0000 (UTC) X-Authority-Analysis: v=2.0 cv=YruNtvkX c=1 sm=0 a=nLSj6wnnDCA9frvL/Tt8NQ==:17 a=3pwD0LKv0YcA:10 a=z1TLwsU0kBEA:10 a=WthmilfBrBsA:10 a=sLPLfFCmqb0A:10 a=kj9zAlcOel0A:10 a=GjEiR67sAAAA:8 a=vbqy14apGeAA:10 a=jb__rZ8GAAAA:8 a=qPUcOVMP4eTO3szC4kQA:9 a=CjuIK1q_8ugA:10 a=sHp_62vNEjwA:10 a=Ke08FT2oSu0A:10 a=nLSj6wnnDCA9frvL/Tt8NQ==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 70.95.171.134 Received: from [70.95.171.134] ([70.95.171.134:11967] helo=oz.volcano.org) by hrndva-oedge03.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id 39/ED-23502-2C6ECD05; Fri, 28 Dec 2012 00:24:35 +0000 Received: by oz.volcano.org (Postfix, from userid 1001) id E33CB5082E; Thu, 27 Dec 2012 14:24:33 -1000 (HST) Date: Thu, 27 Dec 2012 14:24:33 -1000 From: Clifton Royston To: Eitan Adler , freebsd-hackers@freebsd.org, John-Mark Gurney Subject: Re: looking for someone to fix humanize_number (test cases included) Message-ID: <20121228002433.GA80168@volcano.org> Mail-Followup-To: Eitan Adler , freebsd-hackers@freebsd.org, John-Mark Gurney References: <20121226205307.GA66528@volcano.org> <20121227183136.GA77509@volcano.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20121227183136.GA77509@volcano.org> User-Agent: Mutt/1.4.2.3i X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2012 00:24:42 -0000 On Thu, Dec 27, 2012 at 08:31:36AM -1000, Clifton Royston wrote: > ... > I'll put the updated test program somewhere shortly. Test code and draft of revisions to function are at http://www.volcano.org/misc/humanize_number/ Man page update will follow later. -- Clifton -- Clifton Royston -- cliftonr@iandicomputing.com / cliftonr@volcano.org President - I and I Computing * http://www.iandicomputing.com/ Custom programming, network design, systems and network consulting services From owner-freebsd-hackers@FreeBSD.ORG Fri Dec 28 17:12:52 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 988E03DC; Fri, 28 Dec 2012 17:12:52 +0000 (UTC) (envelope-from rsmith@xs4all.nl) Received: from smtp-vbr9.xs4all.nl (smtp-vbr9.xs4all.nl [194.109.24.29]) by mx1.freebsd.org (Postfix) with ESMTP id 06BF58FC08; Fri, 28 Dec 2012 17:12:51 +0000 (UTC) Received: from slackbox.erewhon.net (slackbox.xs4all.nl [213.84.242.160]) by smtp-vbr9.xs4all.nl (8.13.8/8.13.8) with ESMTP id qBSHCEK1007973; Fri, 28 Dec 2012 18:12:14 +0100 (CET) (envelope-from rsmith@xs4all.nl) Received: by slackbox.erewhon.net (Postfix, from userid 1001) id 02CCD1231D; Fri, 28 Dec 2012 18:12:13 +0100 (CET) Date: Fri, 28 Dec 2012 18:12:13 +0100 From: Roland Smith To: Bas Vermin Subject: Re: Your thoughts on a buffer sharing mechanism for FreeBSD (dma-buf for drm2) Message-ID: <20121228171213.GA4522@slackbox.erewhon.net> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="k1lZvvs/B4yU6o8G" Content-Disposition: inline In-Reply-To: X-GPG-Fingerprint: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 X-GPG-Key: http://www.xs4all.nl/~rsmith/pubkey.txt X-GPG-Notice: If this message is not signed, don't assume I sent it! User-Agent: Mutt/1.5.21 (2010-09-15) X-Virus-Scanned: by XS4ALL Virus Scanner X-Mailman-Approved-At: Fri, 28 Dec 2012 17:28:25 +0000 Cc: "freebsd-hackers@freebsd.org" , "freebsd-x11@freebsd.org" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2012 17:12:52 -0000 --k1lZvvs/B4yU6o8G Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Dec 26, 2012 at 12:37:10AM +0100, Bas Vermin wrote: > Hi Guys, >=20 > Today I decided to do something useful for the FreeBSD community, working= on > the TTM and KMS for the AMD graphics cards which I think a lot of people > could use. Great!=20 > As most of us know Intel KMS support was added to FreeBSD a few months ag= o, > and as far as I know this code was based on the Linux 3.1 kernel. The FAQ= in > the wiki states that in order to keep this code up to date the Linux comm= it > log would be checked and changes merged into FreeBSD. Then came Linux 3.3 > which added support for dma-buf, the buffer sharing mechanism to be used = by > PRIME for offloading work to different GPU's, a feature we obviously > want. The problem with dma-buf is that it is licensed under the GPL and h= as > now littered all over the otherwise MIT licensed drm code (even nVidia > wasn't allowed to use dma-buf for their propietary driver). The license would not be a problem as long as we don't copy the code, but j= ust provide the same interface. > My question is, does such a buffer sharing mechanism exist in FreeBSD? I may be off-base here, but what about buf(9)? > And if so, would it be somewhat compatible with what dma-buf is doing in = the PRIME code? >=20 > If not I think such a mechanism should be created, prehaps part of the vm= system (not separate as dma-buf is). Or am I just being stupid and is ther= e a much better way of solving this problem? Since the develompent of Xorg (and other systems like Wayland) is driven by Linux, it would probably make porting less painful if the FreeBSD kernel co= uld supply the same interfaces to drivers as Linux does. But I don't see most graphics chips vendors implement dma-buf in their (proprietary) drivers, because of its license. I do hope that in the end th= is will lead to more and better open-source drivers! Roland --=20 R.F.Smith http://rsmith.home.xs4all.nl/ [plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated] pgp: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 (KeyID: C321A725) --k1lZvvs/B4yU6o8G Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) iEYEARECAAYFAlDd0u0ACgkQEnfvsMMhpyWGUwCgk8fspL8hrpxKXMX99Jz0VFSm RoQAmgNE1BkbEJV56K7ezqGQRN/PUBtT =KdyC -----END PGP SIGNATURE----- --k1lZvvs/B4yU6o8G-- From owner-freebsd-hackers@FreeBSD.ORG Fri Dec 28 20:06:31 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0BD79B24 for ; Fri, 28 Dec 2012 20:06:31 +0000 (UTC) (envelope-from cliftonr@volcano.org) Received: from hrndva-omtalb.mail.rr.com (hrndva-omtalb.mail.rr.com [71.74.56.122]) by mx1.freebsd.org (Postfix) with ESMTP id B21B48FC14 for ; Fri, 28 Dec 2012 20:06:29 +0000 (UTC) X-Authority-Analysis: v=2.0 cv=YruNtvkX c=1 sm=0 a=nLSj6wnnDCA9frvL/Tt8NQ==:17 a=3pwD0LKv0YcA:10 a=z1TLwsU0kBEA:10 a=WthmilfBrBsA:10 a=sLPLfFCmqb0A:10 a=kj9zAlcOel0A:10 a=GjEiR67sAAAA:8 a=vbqy14apGeAA:10 a=jb__rZ8GAAAA:8 a=aFfbZGGNudtPEWjFmTMA:9 a=CjuIK1q_8ugA:10 a=sHp_62vNEjwA:10 a=Ke08FT2oSu0A:10 a=Plx_6KoHmakatvLX:21 a=lh7BmEqGAnGmqoX3:21 a=nLSj6wnnDCA9frvL/Tt8NQ==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 70.95.171.134 Received: from [70.95.171.134] ([70.95.171.134:24748] helo=oz.volcano.org) by hrndva-oedge03.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id 73/A2-23502-4CBFDD05; Fri, 28 Dec 2012 20:06:29 +0000 Received: by oz.volcano.org (Postfix, from userid 1001) id EA2C65082E; Fri, 28 Dec 2012 10:06:27 -1000 (HST) Date: Fri, 28 Dec 2012 10:06:27 -1000 From: Clifton Royston To: Eitan Adler , freebsd-hackers@freebsd.org, John-Mark Gurney Subject: Re: looking for someone to fix humanize_number (test cases included) Message-ID: <20121228200627.GA91874@volcano.org> Mail-Followup-To: Eitan Adler , freebsd-hackers@freebsd.org, John-Mark Gurney References: <20121226205307.GA66528@volcano.org> <20121227183136.GA77509@volcano.org> <20121228002433.GA80168@volcano.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20121228002433.GA80168@volcano.org> User-Agent: Mutt/1.4.2.3i X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2012 20:06:31 -0000 On Thu, Dec 27, 2012 at 02:24:33PM -1000, Clifton Royston wrote: > On Thu, Dec 27, 2012 at 08:31:36AM -1000, Clifton Royston wrote: > > ... > > I'll put the updated test program somewhere shortly. > > Test code and draft of revisions to function are at > > http://www.volcano.org/misc/humanize_number/ Improved revision of function, improved tests (up to 177 now), and an updated man page are now at the above URL. Of note in the latest code revision: I corrected the code to correctly scale and format values to +/- INT64_MAX (except when scale == 0); it will now handle values above 82 petabytes (INT64_MAX/100) which never worked correctly before. Invalid arguments are better detected and rejected. The tests now cover boundary cases for large number values, and have some command line options to control what subset of tests get run, initial buffer size, etc. The man page now documents correct values for the scale argument, what the output and return values are for scale == 0, when 'K' vs 'k' is used in the output, and which invalid parameters will cause an assertion, along with some changes to wording mostly relating to the 1024 vs 1000 divisor. I think I'm done playing with it now. -- Clifton -- Clifton Royston -- cliftonr@iandicomputing.com / cliftonr@volcano.org President - I and I Computing * http://www.iandicomputing.com/ Custom programming, network design, systems and network consulting services From owner-freebsd-hackers@FreeBSD.ORG Fri Dec 28 20:57:32 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A9585FDD for ; Fri, 28 Dec 2012 20:57:32 +0000 (UTC) (envelope-from lists@eitanadler.com) Received: from mail-la0-f51.google.com (mail-la0-f51.google.com [209.85.215.51]) by mx1.freebsd.org (Postfix) with ESMTP id 1F70C8FC08 for ; Fri, 28 Dec 2012 20:57:31 +0000 (UTC) Received: by mail-la0-f51.google.com with SMTP id fj20so1414335lab.10 for ; Fri, 28 Dec 2012 12:57:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=eitanadler.com; s=0xdeadbeef; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type; bh=00R7vCCx6RStFwPKjy2HR2uA7XRSC9QSOJ7dEiAsFfo=; b=Ys93irXGy7MfKduTKw2vntCwUoObfZj3WMBhLuEdJxK3P7HDFAocTFX6UUatlV7Sih oE3/A9bmY8vOZwPMbyphOeyJxa6jA2RX4siJheck7rIMvynP+cjFcGJD9rGrFMtL8Xpo onPTxRELd0LMPi5fWudlI5jUQj0l1JDneMbHY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:x-gm-message-state; bh=00R7vCCx6RStFwPKjy2HR2uA7XRSC9QSOJ7dEiAsFfo=; b=EWty1NOXZPEGk/gTXU7rZ0QgbLB4N8slCjjS2ZKEyXpol5vHRGO3TOq2/O4z8DVswV pYO+UT4opf9aKWW6dKQr2sKREqCj11/9L6JCy5KJyOYM/n7h7sOBXZwe+zQr+N9tYe2/ 0wJNuqtWUDaf2DrlIRyFx+B1+szetLSbNa5/9E95gM7Y3pgDNrF43FYAyNiVgGvoE7ym SREmixuXmXbeFuCKMPvJYFLPOIiguVv567It+MooqUefSekt0BvWdhj4Q1+jvrD2ye/7 5aXwTPOvRkjNWiQaMEUpnoB9l4O/iHmLK0jpPsZWcG82E4+oXl6g3EVQiAqKMwUWCOwH VZig== Received: by 10.112.25.198 with SMTP id e6mr14122214lbg.63.1356728244564; Fri, 28 Dec 2012 12:57:24 -0800 (PST) MIME-Version: 1.0 Received: by 10.112.87.102 with HTTP; Fri, 28 Dec 2012 12:56:53 -0800 (PST) In-Reply-To: <20121228200627.GA91874@volcano.org> References: <20121226205307.GA66528@volcano.org> <20121227183136.GA77509@volcano.org> <20121228002433.GA80168@volcano.org> <20121228200627.GA91874@volcano.org> From: Eitan Adler Date: Fri, 28 Dec 2012 15:56:53 -0500 Message-ID: Subject: Re: looking for someone to fix humanize_number (test cases included) To: Eitan Adler , freebsd-hackers@freebsd.org, John-Mark Gurney Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQmQsHLdY4DNvFoev/w9BOMJIei0dtBGqMA7Z6Al9/0rH1xmsmZfavwVDlIDk8QeDcseSbUe X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2012 20:57:32 -0000 On 28 December 2012 15:06, Clifton Royston wrote: > On Thu, Dec 27, 2012 at 02:24:33PM -1000, Clifton Royston wrote: >> On Thu, Dec 27, 2012 at 08:31:36AM -1000, Clifton Royston wrote: >> > ... >> > I'll put the updated test program somewhere shortly. >> >> Test code and draft of revisions to function are at >> >> http://www.volcano.org/misc/humanize_number/ > > Improved revision of function, improved tests (up to 177 now), and an > updated man page are now at the above URL. > > Of note in the latest code revision: I corrected the code to correctly > scale and format values to +/- INT64_MAX (except when scale == 0); it > will now handle values above 82 petabytes (INT64_MAX/100) which never > worked correctly before. Invalid arguments are better detected and > rejected. > > The tests now cover boundary cases for large number values, and have > some command line options to control what subset of tests get run, > initial buffer size, etc. > > The man page now documents correct values for the scale argument, what > the output and return values are for scale == 0, when 'K' vs 'k' is > used in the output, and which invalid parameters will cause an > assertion, along with some changes to wording mostly relating to the > 1024 vs 1000 divisor. > > I think I'm done playing with it now. My computer is broken at the moment (hardware issue). I will review, comment, and hopefully commit when I manage to fix it. -- Eitan Adler From owner-freebsd-hackers@FreeBSD.ORG Sat Dec 29 16:43:36 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 81998768 for ; Sat, 29 Dec 2012 16:43:36 +0000 (UTC) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from wojtek.tensor.gdynia.pl (wojtek.tensor.gdynia.pl [188.252.31.196]) by mx1.freebsd.org (Postfix) with ESMTP id 15FBD8FC0A for ; Sat, 29 Dec 2012 16:43:29 +0000 (UTC) Received: from wojtek.tensor.gdynia.pl (localhost [127.0.0.1]) by wojtek.tensor.gdynia.pl (8.14.5/8.14.5) with ESMTP id qBTHh9CZ001695; Sat, 29 Dec 2012 18:43:09 +0100 (CET) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Received: from localhost (wojtek@localhost) by wojtek.tensor.gdynia.pl (8.14.5/8.14.5/Submit) with ESMTP id qBTHh6q3001692; Sat, 29 Dec 2012 18:43:07 +0100 (CET) (envelope-from wojtek@wojtek.tensor.gdynia.pl) Date: Sat, 29 Dec 2012 18:43:06 +0100 (CET) From: Wojciech Puchar To: Garrett Cooper Subject: Re: cvs deprecated In-Reply-To: Message-ID: References: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (wojtek.tensor.gdynia.pl [127.0.0.1]); Sat, 29 Dec 2012 18:43:09 +0100 (CET) Cc: freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2012 16:43:36 -0000 > > 1. Checkout the sources: > > cd /usr/src # Change to something else if you don't want to checkout > to /usr/src. > svn co http://svn.freebsd.org/base/stable/9 . # stable/9 > svn co http://svn.freebsd.org/base/head . # CURRENT > > 2. Updating: > > cd /usr/src # Same caveat as above. > svn up > > See also: http://www.freebsd.org/doc/handbook/svn.html . > seen but not found simple explanation which you gave me. Thank you very much.