From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 15 22:32:11 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C2F651065672 for ; Sat, 15 Nov 2008 22:32:11 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.168]) by mx1.freebsd.org (Postfix) with ESMTP id 961FB8FC1E for ; Sat, 15 Nov 2008 22:32:11 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: by wf-out-1314.google.com with SMTP id 24so1945316wfg.7 for ; Sat, 15 Nov 2008 14:32:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:from:to :content-type:content-transfer-encoding:subject:mime-version:date :x-mailer; bh=XqMHyr+v3yroirt9PMr0xSsVSPXl2SH+vRqAfAU0Juk=; b=GY5J6YNIBMbY6elTirq2t63zuINdWnCWt6i/jliC8gDqt5nQoaOaXwtrTvSR94t4gv wemu6mQmN8DhIN4u2ulF4K1SLh1jsdAVOiukZA8FzPwiH5YQJ7T+QIRxxYDDj8JlE3qO 9RG2AVtmcUlVHgI+wB9n40gE4Da6GfbEhryT4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:from:to:content-type:content-transfer-encoding:subject :mime-version:date:x-mailer; b=YWBoKF+ZeS44MZ9+77zZ/jXl+nX8ITsneoVdHZDTJvzbd54dGm+04s/+Te3FQ2KFD+ coBKfEu2sEyLMKBroKMgBORmU3PMhTRtjTEN48TvBcZr0AzWnxq6q9O2tNKu7xsfoXW0 a+0W3I5GL3Rb2tfXudVnBjlEOBqBNpb3etNd4= Received: by 10.142.166.1 with SMTP id o1mr1125348wfe.237.1226786675215; Sat, 15 Nov 2008 14:04:35 -0800 (PST) Received: from ?192.168.153.249? ([216.239.45.19]) by mx.google.com with ESMTPS id 20sm853443wfi.7.2008.11.15.14.04.33 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sat, 15 Nov 2008 14:04:34 -0800 (PST) Message-Id: <1155143A-D9F9-4988-B648-F9CDC2A4080C@gmail.com> From: Garrett Cooper To: Garrett Cooper Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Sat, 15 Nov 2008 14:08:02 -0800 X-Mailer: Apple Mail (2.929.2) X-Mailman-Approved-At: Sun, 16 Nov 2008 00:22:58 +0000 Cc: Subject: Request for individuals interested in reviewing test / python topics X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 15 Nov 2008 22:32:11 -0000 Hello Hackers and Porters, I'm currently working on a proposal to the FreeBSD foundation to use Python Nose as a testing framework for writing tests. If there are any individuals who are experienced and interested helping review and provide insight into my plans for using nose as a testing framework / backend, it would be extremely helpful. By completing this work, we could finally settle on a single regression and unit testing framework for writing future testcases, which would in turn reduce the required overhead on the release team during releases, which may reduce ports freeze periods, also reduce development time while increasing productivity within the FreeBSD community for new feature and regression testing in the of the entire system and the ports / packages we provide to the community. Thanks, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 03:27:49 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 549E7106567C for ; Sun, 16 Nov 2008 03:27:49 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: from po-out-1718.google.com (po-out-1718.google.com [72.14.252.156]) by mx1.freebsd.org (Postfix) with ESMTP id 2759C8FC13 for ; Sun, 16 Nov 2008 03:27:48 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: by po-out-1718.google.com with SMTP id y22so3342886pof.3 for ; Sat, 15 Nov 2008 19:27:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=mXE6B/+each0O2VUZq+kfQ+jORzysHXGBp9XhwIClOI=; b=fwCvN///1KIpMNcRZR0nduHhZNnsf2LgUY+RqDIIVu69NIdap0E+IGSlZWazg9mOS4 Ugsu0xHCH4ShOobo0LpsPHk8AeiZiUNobjKSQuMnH15v6dR2BfLbpnxDIJ6Gvvw9KEWF LOu7JbTLfZSY0OjKzhqz/CqsYWvdJu8YpIzik= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=tw/igQtPy0UPHPc6QL5Thzqfq5luzJtrXLbl8oezDIkbHmwS0uXi6ry/m9SouCZT73 cSeGrRbeu+yZaxYkPa1paVs+71FsRYbUHZoexpxPKoScfYo/gxrREkaOLpakEFQSC1M+ cuZ5bQAG9bx7yR3XdLnu77sjGMoMobPoE9bnI= Received: by 10.114.102.20 with SMTP id z20mr1631059wab.53.1226806068564; Sat, 15 Nov 2008 19:27:48 -0800 (PST) Received: by 10.114.201.14 with HTTP; Sat, 15 Nov 2008 19:27:48 -0800 (PST) Message-ID: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> Date: Sun, 16 Nov 2008 04:26:48 +0059 From: "Alexej Sokolov" To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: KLD loading, liking X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 03:27:49 -0000 Hello, i am looking for some infos (may be papers) about how KLD linker works. After kompiling the KLD contain two important sections: % readelf -S mymod.ko | grep set [ 7] set_sysinit_set PROGBITS 00000560 000560 000004 00 A 0 0 4 [ 8] set_modmetadata_s PROGBITS 00000564 000564 000008 00 A 0 0 4 ..... sysinit_set -contain a structure with a pointer to function which will be called by loading of KLD modmetadata_set - what kind of information is there and which functions of linking/loading use it ? What exact does the macro MODULE_DEPEND ? The man page is to short, and I guess it tell no all things that the macro does. Thanks From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 03:43:44 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5280A106567F for ; Sun, 16 Nov 2008 03:43:44 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: from po-out-1718.google.com (po-out-1718.google.com [72.14.252.152]) by mx1.freebsd.org (Postfix) with ESMTP id 2429A8FC08 for ; Sun, 16 Nov 2008 03:43:44 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: by po-out-1718.google.com with SMTP id y22so3351842pof.3 for ; Sat, 15 Nov 2008 19:43:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=1WQse7aAxgt3BIzrCITo9YzD/qw5NJwgEpTdzPBuRd4=; b=WY3egMkNhxMj6k8X0X69ka8V/G4kLys47Rcs0xgzreQWLbBFjdqAqAYW6gTFX21von zR8VoZLhyIsUfMZOlM39xN/3C5Aqutmn4au1QP+iCqt6UIKIDaHt4dT6jTHF/CP2Zjsh CVe61oWXuKG8xOqjLKfA3ONpomDJgsvekRHiU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=ct5M1NIJylLKYFhbGK9EmSS+xx+atqssRdiSGYP44h/UCJcBbnTZDBWQJW5iLKxKBH rm3neSuZPlu3S+UpjDMwEv70smXy/dcQ8dc6XBWOJLAilF44GDO3jBC8oLQK+ewsligy CWl8GETe5dRtVpIDmVyNmqyic2/Hw01i5Ahr4= Received: by 10.114.196.13 with SMTP id t13mr1633743waf.82.1226807023582; Sat, 15 Nov 2008 19:43:43 -0800 (PST) Received: by 10.114.201.14 with HTTP; Sat, 15 Nov 2008 19:43:43 -0800 (PST) Message-ID: <671bb5fc0811151943m7602476fy19e0f8ee75ea2377@mail.gmail.com> Date: Sun, 16 Nov 2008 04:42:43 +0059 From: "Alexej Sokolov" To: freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: vm_map_find X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 03:43:44 -0000 Hello, my question is about vm_map_find (9) int vm_map_find(vm_map_t map, vm_object_t object, vm_ooffset_t offset, vm_offset_t *addr, vm_size_t length, boolean_t find_space, vm_prot_t prot, vm_prot_t max, int cow); Could anyone explain what exactly parameter "cow" for ? Which values and meanings ? man page dives not enough informations about it. Thanks From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 03:26:07 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 065E0106567A for ; Sun, 16 Nov 2008 03:26:07 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: from po-out-1718.google.com (po-out-1718.google.com [72.14.252.153]) by mx1.freebsd.org (Postfix) with ESMTP id CD7FB8FC0A for ; Sun, 16 Nov 2008 03:26:06 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: by po-out-1718.google.com with SMTP id y22so3341605pof.3 for ; Sat, 15 Nov 2008 19:26:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type; bh=kQ5lgDM5GGgeREnpOy4mj/n7c2z5ZyeF6MR45SouVXk=; b=jCBQdR2SSd83h9K7R5rDgfHrNDNk1866kutVOqyf6vj+84B3SWVkIQiAvWvF2Rc08T O0eDlFMh1rZS6vS996VkqXsgUaOk+rKUD8t8mh1AeCauYAB9dH9UAD+SL2ib+4uuFXge IeeRshVIusviNKOftw9to2V0/+JSpUOStQtZQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type; b=yDPlNnvvktV6cYktQ2XtsuKbKiIFTOp4T641jII6jWcI0OHmUiuHWSQhbssXhJBW2t l12jncOukVEylnIfL91qUWv7X/JGQEHi4hddAwNBd9dWwPECnhRrTZ+tx5erbR8RA+sN fZSn9NHEqwSSf6xbUqyi+c114pogrK6WswY48= Received: by 10.114.169.2 with SMTP id r2mr1613979wae.161.1226805092001; Sat, 15 Nov 2008 19:11:32 -0800 (PST) Received: by 10.114.201.14 with HTTP; Sat, 15 Nov 2008 19:11:31 -0800 (PST) Message-ID: <671bb5fc0811151911oa132f75j3995e8188cbf81b2@mail.gmail.com> Date: Sun, 16 Nov 2008 04:10:31 +0059 From: "Alexej Sokolov" To: freebsd-hackers@freebsd.org MIME-Version: 1.0 X-Mailman-Approved-At: Sun, 16 Nov 2008 04:25:10 +0000 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Make files for /usr/src/sys/dev/* X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 03:26:07 -0000 hello, where are the Makefiles for drivers in /usr/src/dev/* % uname -v FreeBSD 7.0-RELEASE-p5 Thanks From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 04:27:52 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6A3E3106564A for ; Sun, 16 Nov 2008 04:27:52 +0000 (UTC) (envelope-from rnoland@FreeBSD.org) Received: from gizmo.2hip.net (gizmo.2hip.net [64.74.207.195]) by mx1.freebsd.org (Postfix) with ESMTP id 301368FC1C for ; Sun, 16 Nov 2008 04:27:52 +0000 (UTC) (envelope-from rnoland@FreeBSD.org) Received: from [192.168.2.57] (c-71-56-39-94.hsd1.ga.comcast.net [71.56.39.94]) (authenticated bits=0) by gizmo.2hip.net (8.14.3/8.14.3) with ESMTP id mAG4B5SH009363 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 15 Nov 2008 23:11:06 -0500 (EST) (envelope-from rnoland@FreeBSD.org) From: Robert Noland To: Alexej Sokolov In-Reply-To: <671bb5fc0811151943m7602476fy19e0f8ee75ea2377@mail.gmail.com> References: <671bb5fc0811151943m7602476fy19e0f8ee75ea2377@mail.gmail.com> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-WEgJM4LZvJI0FjZrMuPk" Organization: FreeBSD Date: Sat, 15 Nov 2008 23:10:48 -0500 Message-Id: <1226808653.1739.5.camel@wombat.2hip.net> Mime-Version: 1.0 X-Mailer: Evolution 2.22.3.1 FreeBSD GNOME Team Port X-Spam-Status: No, score=-1.3 required=5.0 tests=AWL,BAYES_00,RCVD_IN_PBL, RCVD_IN_SORBS_DUL,RDNS_DYNAMIC autolearn=no version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on gizmo.2hip.net Cc: freebsd-hackers@freebsd.org Subject: Re: vm_map_find X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 04:27:52 -0000 --=-WEgJM4LZvJI0FjZrMuPk Content-Type: text/plain Content-Transfer-Encoding: quoted-printable On Sun, 2008-11-16 at 04:42 +0059, Alexej Sokolov wrote: > Hello, > my question is about vm_map_find (9) > int > vm_map_find(vm_map_t map, vm_object_t object, vm_ooffset_t offset, > vm_offset_t *addr, vm_size_t length, boolean_t find_space, > vm_prot_t prot, vm_prot_t max, int cow); >=20 > Could anyone explain what exactly parameter "cow" for ? Which values and > meanings ? Well, cow is COPY_ON_WRITE. See vm_map(9) for the list of flags. robert. > man page dives not enough informations about it. >=20 > Thanks > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org= " --=-WEgJM4LZvJI0FjZrMuPk Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEABECAAYFAkkfnUgACgkQM4TrQ4qfROPljgCghuST3DFvt7zo/UyRt/bM48FC 2kMAnimY23qDgJjAw+YYhnvkKqmJHA5f =sZ8o -----END PGP SIGNATURE----- --=-WEgJM4LZvJI0FjZrMuPk-- From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 05:15:45 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A542B106567D for ; Sun, 16 Nov 2008 05:15:45 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: from qb-out-0506.google.com (qb-out-0506.google.com [72.14.204.239]) by mx1.freebsd.org (Postfix) with ESMTP id 579DB8FC0C for ; Sun, 16 Nov 2008 05:15:45 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: by qb-out-0506.google.com with SMTP id f30so1832009qba.35 for ; Sat, 15 Nov 2008 21:15:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:subject :message-id:reply-to:mail-followup-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=kjcplbBZSV+yqs9qMl43a3a5tCQWTcVsGjqXpdhN2W8=; b=g2+WF43Spq8NZlX3yZtTdpsituQYSIGmm4IfCSb1y5ZrpQ8fVbBOJrdulCs0t8VlNa SwoJBKknmybKAjurUxZgzAmcpX6/3kUMU7j1EFSRr12w2FYqYx0AYGND6EWi0raaMSJh UTyvVHPrbfw0k4erub4hT91XW7MEY8GTPElHk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:subject:message-id:reply-to:mail-followup-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; b=SA2LhbCvKP1EP4YqQRaZol4g08ZeFMwcQsur/DDMf7Pfouek7xuqs+p/eICkhWtepy 6KhyujiVLDpj3cA/+T/OJsq3qA84+01znvMbSWrpwtE77ytBxpau3E0KmuB4JRWB+C4C a3rjSnZ7fO63zugz/d2D4jlvDXf8ovAgNtyIU= Received: by 10.103.24.17 with SMTP id b17mr836437muj.112.1226812544061; Sat, 15 Nov 2008 21:15:44 -0800 (PST) Received: from localhost (BADe9ba.bad.pppool.de [77.131.233.186]) by mx.google.com with ESMTPS id w5sm6949397mue.10.2008.11.15.21.15.42 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sat, 15 Nov 2008 21:15:43 -0800 (PST) Date: Sun, 16 Nov 2008 06:15:14 +0100 From: Alexej Sokolov To: freebsd-hackers@freebsd.org Message-ID: <20081116051514.GA5818@debian.samsung.router> Mail-Followup-To: freebsd-hackers@freebsd.org References: <671bb5fc0811151943m7602476fy19e0f8ee75ea2377@mail.gmail.com> <1226808653.1739.5.camel@wombat.2hip.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <1226808653.1739.5.camel@wombat.2hip.net> User-Agent: Mutt/1.5.18 (2008-05-17) Subject: Re: vm_map_find X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Alexej Sokolov List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 05:15:45 -0000 On Sat, Nov 15, 2008 at 11:10:25PM -0500, Robert Noland wrote: > On Sun, 2008-11-16 at 04:42 +0059, Alexej Sokolov wrote: > > Hello, > > my question is about vm_map_find (9) > > int > > vm_map_find(vm_map_t map, vm_object_t object, vm_ooffset_t offset, > > vm_offset_t *addr, vm_size_t length, boolean_t find_space, > > vm_prot_t prot, vm_prot_t max, int cow); > > > > Could anyone explain what exactly parameter "cow" for ? Which values and > > meanings ? > > Well, cow is COPY_ON_WRITE. See vm_map(9) for the list of flags. > > robert. Ok, thanx a lot, but I find it strange that the info about possible values of "cow" isn't present in man pages vm_map_insert and vm_map_find Thnks again! > > > man page dives not enough informations about it. > > > > Thanks > > _______________________________________________ > > freebsd-hackers@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 06:42:27 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8FA64106564A for ; Sun, 16 Nov 2008 06:42:27 +0000 (UTC) (envelope-from bruce@cran.org.uk) Received: from muon.cran.org.uk (muon.cran.org.uk [66.246.138.153]) by mx1.freebsd.org (Postfix) with ESMTP id 5F23C8FC08 for ; Sun, 16 Nov 2008 06:42:27 +0000 (UTC) (envelope-from bruce@cran.org.uk) Received: from muon.cran.org.uk (localhost [127.0.0.1]) by muon.cran.org.uk (Postfix) with ESMTP id B4F1A1900E; Sun, 16 Nov 2008 01:25:14 -0500 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on muon X-Spam-Level: X-Spam-Status: No, score=-2.0 required=5.0 tests=AWL,BAYES_00,RDNS_NONE autolearn=no version=3.2.5 Received: from tau.draftnet (unknown [66.45.161.67]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by muon.cran.org.uk (Postfix) with ESMTPSA; Sun, 16 Nov 2008 01:25:14 -0500 (EST) Date: Sat, 15 Nov 2008 22:24:50 -0800 From: Bruce Cran To: "Alexej Sokolov" Message-ID: <20081115222450.02a0f0c5@tau.draftnet> In-Reply-To: <671bb5fc0811151911oa132f75j3995e8188cbf81b2@mail.gmail.com> References: <671bb5fc0811151911oa132f75j3995e8188cbf81b2@mail.gmail.com> X-Mailer: Claws Mail 3.5.0 (GTK+ 2.12.11; amd64-portbld-freebsd7.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: freebsd-hackers@freebsd.org Subject: Re: Make files for /usr/src/sys/dev/* X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 06:42:27 -0000 On Sun, 16 Nov 2008 04:10:31 +0059 "Alexej Sokolov" wrote: > > where are the Makefiles for drivers in /usr/src/dev/* For drivers which can be built as modules, they're in /usr/src/sys/modules/* -- Bruce Cran From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 10:09:25 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7DD01106568C for ; Sun, 16 Nov 2008 10:09:25 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: from palm.hoeg.nl (unknown [IPv6:2001:7b8:613:100::211]) by mx1.freebsd.org (Postfix) with ESMTP id 18EC78FC2C for ; Sun, 16 Nov 2008 10:09:24 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: by palm.hoeg.nl (Postfix, from userid 1000) id BAFF51CD2C; Sun, 16 Nov 2008 11:09:23 +0100 (CET) Date: Sun, 16 Nov 2008 11:09:23 +0100 From: Ed Schouten To: Alexej Sokolov Message-ID: <20081116100923.GU81783@hoeg.nl> References: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="DvifzEOEABd5jzbd" Content-Disposition: inline In-Reply-To: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: FreeBSD Hackers Subject: Re: KLD loading, liking X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 10:09:25 -0000 --DvifzEOEABd5jzbd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Alexej Sokolov wrote: > sysinit_set -contain a structure with a pointer to function which will be > called by loading of KLD When you place SYSINIT() lines in your code, you can request functions to be called when the code is loaded. There are also some macro's such as MTX_SYSINIT(), which is a friendly wrapper around SYSINIT() which initialises a mutex. > modmetadata_set - what kind of information is there and which functions of > linking/loading use it ? Each loadable kernel module contains a structure that contains the module name, but also a function pointer to the routine that contains the module's load/unload function. If this function returns an error, the kernel module will not be (un)loaded. Take a look at the simple kernel modules such as snp(4). > What exact does the macro MODULE_DEPEND ? The man page is to short, and I > guess it tell no all things that the macro does. MODULE_DEPEND is used to say: this kernel module also depends on another module (i.e. the USB printer module depends on the USB code). Tools like kldload can then automatically load the missing modules. --=20 Ed Schouten WWW: http://80386.nl/ --DvifzEOEABd5jzbd Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkkf8VMACgkQ52SDGA2eCwXCigCfbiphKlXh5vTMpycMsCvcAcnV 5g4AmQE8/fRTTrn653eOOb4PZH1P+aKC =wvvJ -----END PGP SIGNATURE----- --DvifzEOEABd5jzbd-- From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 11:18:49 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9E0F2106568D for ; Sun, 16 Nov 2008 11:18:49 +0000 (UTC) (envelope-from won.derick@yahoo.com) Received: from n73.bullet.mail.sp1.yahoo.com (n73.bullet.mail.sp1.yahoo.com [98.136.44.191]) by mx1.freebsd.org (Postfix) with SMTP id 7BB8B8FC16 for ; Sun, 16 Nov 2008 11:18:49 +0000 (UTC) (envelope-from won.derick@yahoo.com) Received: from [69.147.65.150] by n73.bullet.mail.sp1.yahoo.com with NNFMP; 16 Nov 2008 11:18:49 -0000 Received: from [69.147.65.170] by t7.bullet.mail.sp1.yahoo.com with NNFMP; 16 Nov 2008 11:18:49 -0000 Received: from [127.0.0.1] by omp505.mail.sp1.yahoo.com with NNFMP; 16 Nov 2008 11:18:49 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 398460.7861.bm@omp505.mail.sp1.yahoo.com Received: (qmail 65045 invoked by uid 60001); 16 Nov 2008 11:18:49 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:Cc:MIME-Version:Content-Type:Message-ID; b=r6OYslmsjxtxUCevT2F2EJD8SHr5bZiA/V0bDJS2DfecqUVvoVIvwvQ+XYNtD1PGgFxn6V3E2Lo+Os3YxJdE0jNmot4C+UNkp7g3BO0+GuHJ8nhAGAUoIyTh/EN3/xhLgpwMq9rUzTTXUfFbsXivAwdW15Dvg9jmV2lMCpSgFso=; X-YMail-OSG: DXtOgP0VM1nd7oyGoKsyw5KvuiVs2jdCIBZxCiGsGgKgG6etJI.MvSwUW7Cb4L8QmPIYpyuP0NV7dG3npExo_sZsHp1BzAn6DuaG2ICPhC.cTAz1megzZ6i.dubPx7IaRmABBBog18cygbeYcBq0GAV4XYw- Received: from [58.71.34.137] by web45803.mail.sp1.yahoo.com via HTTP; Sun, 16 Nov 2008 03:18:46 PST X-Mailer: YahooMailRC/1155.29 YahooMailWebService/0.7.260.1 References: <557765.55617.qm@web45804.mail.sp1.yahoo.com> <20081115141631.GA75733@icarus.home.lan> Date: Sun, 16 Nov 2008 03:18:46 -0800 (PST) From: Won De Erick To: Jeremy Chadwick MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Message-ID: <193147.59821.qm@web45803.mail.sp1.yahoo.com> Cc: freebsd-hackers@freebsd.org, rwatson@freebsd.org Subject: Re: NET.ISR and CPU utilization performance w/ HP DL 585 using FreeBSD 7.1 Beta2 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 11:18:49 -0000 > ----- Original Message ---- > From: Jeremy Chadwick > To: Won De Erick > Cc: rwatson@freebsd.org; freebsd-hackers@freebsd.org > Sent: Saturday, November 15, 2008 10:16:31 PM > Subject: Re: NET.ISR and CPU utilization performance w/ HP DL 585 using FreeBSD 7.1 Beta2 > > On Sat, Nov 15, 2008 at 04:59:16AM -0800, Won De Erick wrote: > > Hello, > > > > I tested HP DL 585 (16 CPUs, w/ built-in Broadcom NICs) running FreeBSD 7.1 Beta2 under heavy network traffic (TCP). > > > > SCENARIO A : Bombarded w/ TCP traffic: > > > > When net.isr.direct=1, > > > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > > 52 root 1 -68 - 0K 16K CPU11 b 38:43 95.36% irq32: bce1 > > 51 root 1 -68 - 0K 16K CPU10 a 25:50 85.16% irq31: bce0 > > 16 root 1 171 ki31 0K 16K RUN a 65:39 15.97% idle: cpu10 > > 28 root 1 -32 - 0K 16K WAIT 8 12:28 5.18% swi4: clock sio > > 15 root 1 171 ki31 0K 16K RUN b 52:46 3.76% idle: cpu11 > > 45 root 1 -64 - 0K 16K WAIT 7 7:29 1.17% irq17: uhci0 > > 47 root 1 -64 - 0K 16K WAIT 6 1:11 0.10% irq16: ciss0 > > 27 root 1 -44 - 0K 16K WAIT 0 28:52 0.00% swi1: net > > > > When net.isr.direct=0, > > > > 16 root 1 171 ki31 0K 16K CPU10 a 106:46 92.58% idle: cpu10 > > 19 root 1 171 ki31 0K 16K CPU7 7 133:37 89.16% idle: cpu7 > > 27 root 1 -44 - 0K 16K WAIT 0 52:20 76.37% swi1: net > > 25 root 1 171 ki31 0K 16K RUN 1 132:30 70.26% idle: cpu1 > > 26 root 1 171 ki31 0K 16K CPU0 0 111:58 64.36% idle: cpu0 > > 15 root 1 171 ki31 0K 16K CPU11 b 81:09 57.76% idle: cpu11 > > 52 root 1 -68 - 0K 16K WAIT b 64:00 42.97% irq32: bce1 > > 51 root 1 -68 - 0K 16K WAIT a 38:22 12.26% irq31: bce0 > > 45 root 1 -64 - 0K 16K WAIT 7 11:31 12.06% irq17: uhci0 > > 47 root 1 -64 - 0K 16K WAIT 6 1:54 3.66% irq16: ciss0 > > 28 root 1 -32 - 0K 16K WAIT 8 16:01 0.00% swi4: clock sio > > > > Overall CPU utilization has significantly dropped, but I noticed that swi1 has taken CPU0 with high utilization when the net.isr.direct=0. > > What does this mean? > > > > SCENARIO B : Bombarded w/ more TCP traffic: > > > > Worst thing, the box has become unresponsive (can't be PINGed, inaccessible through SSH) after more traffic was added retaining net.isr.direct=0. > > This is due maybe to the 100% utilization on CPU0 for sw1:net (see below result, first line). bce's and swi's seem to race each other based on the result when net.isr.direct=1, swi1 . > > The rest of the CPUs are sitting pretty (100% Idle). Can you shed some lights on this? > > > > When net.isr.direct=0: > > 27 root 1 -44 - 0K 16K CPU0 0 5:45 100.00% swi1: net > > 11 root 1 171 ki31 0K 16K CPU15 0 0:00 100.00% idle: cpu15 > > 13 root 1 171 ki31 0K 16K CPU13 0 0:00 100.00% idle: cpu13 > > 17 root 1 171 ki31 0K 16K CPU9 0 0:00 100.00% idle: cpu9 > > 18 root 1 171 ki31 0K 16K CPU8 0 0:00 100.00% idle: cpu8 > > 21 root 1 171 ki31 0K 16K CPU5 5 146:17 99.17% idle: cpu5 > > 22 root 1 171 ki31 0K 16K CPU4 4 146:17 99.07% idle: cpu4 > > 14 root 1 171 ki31 0K 16K CPU12 0 0:00 99.07% idle: cpu12 > > 16 root 1 171 ki31 0K 16K CPU10 a 109:33 98.88% idle: cpu10 > > 15 root 1 171 ki31 0K 16K CPU11 b 86:36 93.55% idle: cpu11 > > 52 root 1 -68 - 0K 16K WAIT b 59:42 13.87% irq32: bce1 > > > > When net.isr.direct=1, > > 52 root 1 -68 - 0K 16K CPU11 b 55:04 97.66% irq32: bce1 > > 51 root 1 -68 - 0K 16K CPU10 a 33:52 73.88% irq31: bce0 > > 16 root 1 171 ki31 0K 16K RUN a 102:42 26.86% idle: cpu10 > > 15 root 1 171 ki31 0K 16K RUN b 81:20 3.17% idle: cpu11 > > 28 root 1 -32 - 0K 16K WAIT e 13:40 0.00% swi4: clock sio > > > > With regards to bandwidth in all scenarios above, the result is extremely low (expected is several hundred Mb/s). Why? The below result should be under scenario B above only. > > > > - iface Rx Tx Total > > ============================================================================== > > bce0: 4.69 Mb/s 10.49 Mb/s 15.18 Mb/s > > bce1: 20.66 Mb/s 4.68 Mb/s 25.34 Mb/s > > lo0: 0.00 b/s 0.00 b/s 0.00 b/s > > ------------------------------------------------------------------------------ > > total: 25.35 Mb/s 15.17 Mb/s 40.52 Mb/s > > > > > > Thanks, > > > > Won > > And does this behaviour change if you use some other brand of NIC? With Intel Pro NIC ( 82571): When net.isr.direct=1, 49 root 1 -68 - 0K 16K CPU12 c 6:50 100.00% em0 taskq 15 root 1 171 ki31 0K 16K CPU11 b 5:47 100.00% idle: cpu11 50 root 1 -68 - 0K 16K CPU13 d 6:15 86.96% em1 taskq 25 root 1 171 ki31 0K 16K CPU1 1 9:27 79.79% idle: cpu1 28 root 1 -32 - 0K 16K WAIT 1 1:33 22.75% swi4: clock sio 13 root 1 171 ki31 0K 16K RUN d 4:14 12.26% idle: cpu13 14 root 1 171 ki31 0K 16K RUN c 3:37 0.00% idle: cpu12 em0 and em1 have high CPU utilization, and with netstat, there were packet errors. # netstat -I em0 -w 1 -d input (em0) output packets errs bytes packets errs bytes colls drops 15258 3066 22748316 18468 0 4886567 0 0 15461 3096 22783724 18379 0 5350130 0 0 When net.isr.direct=0, 12 root 1 171 ki31 0K 16K CPU14 e 22:28 100.00% idle: cpu14 20 root 1 171 ki31 0K 16K CPU6 6 24:32 97.85% idle: cpu6 25 root 1 171 ki31 0K 16K RUN 1 21:51 96.97% idle: cpu1 27 root 1 -44 - 0K 16K CPU2 2 5:12 91.55% swi1: net 13 root 1 171 ki31 0K 16K CPU13 d 11:04 86.96% idle: cpu13 14 root 1 171 ki31 0K 16K CPU12 c 10:51 81.59% idle: cpu12 49 root 1 -68 - 0K 16K CPU12 c 13:48 22.17% em0 taskq 24 root 1 171 ki31 0K 16K RUN 2 19:16 12.16% idle: cpu2 50 root 1 -68 - 0K 16K - d 13:34 11.87% em1 taskq 28 root 1 -32 - 0K 16K WAIT 3 3:48 0.00% swi4: clock sio sw1:net is taking high CPU utilization this time, but without packet errors: # netstat -I em0 -w 1 -d input (em0) output packets errs bytes packets errs bytes colls drops 4275 0 5528012 24878 0 24162198 0 0 4317 0 5585954 24880 0 24066583 0 0 Is this related to the context switching in FreeBSD 7.x? I noticed that there were no significant difference in enabling and disabling net.isr.direct in FreeBSD 6.2. Also, is there any significance of enabling device polling? > > -- > | Jeremy Chadwick jdc at parodius.com | > | Parodius Networking http://www.parodius.com/ | > | UNIX Systems Administrator Mountain View, CA, USA | > | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 08:16:39 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D0745106564A for ; Sun, 16 Nov 2008 08:16:39 +0000 (UTC) (envelope-from alexander@leidinger.net) Received: from redbull.bpaserver.net (redbullneu.bpaserver.net [213.198.78.217]) by mx1.freebsd.org (Postfix) with ESMTP id 572748FC0A for ; Sun, 16 Nov 2008 08:16:39 +0000 (UTC) (envelope-from alexander@leidinger.net) Received: from outgoing.leidinger.net (pD9E2C65D.dip.t-dialin.net [217.226.198.93]) by redbull.bpaserver.net (Postfix) with ESMTP id 0CECB2E0F8; Sun, 16 Nov 2008 08:58:08 +0100 (CET) Received: from webmail.leidinger.net (webmail.leidinger.net [192.168.1.102]) by outgoing.leidinger.net (Postfix) with ESMTP id 6BE1065F00; Sun, 16 Nov 2008 08:57:54 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=Leidinger.net; s=outgoing-alex; t=1226822274; bh=hMwwTQ5NRVGR7rKCObJOD20mXdmEcyTCh GU4ZMl6QBY=; h=Message-ID:Date:From:To:Cc:Subject:References: In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=ctSpw14vjTiR+kQdlXU4JXm/rKC2EdLtLGBXong5qaktHPSkSXkfduOuor7md9KAi xjrqSkmkhBZYOz8MgC+emDXZM918srsj6REI+qPVnWe1u7Bv3fJZ76PBWvSw3iCGxp9 VjVpwWo6Lz42yULP+Vh2cn1F8gA3V+QLvJfi66Icg8SIpcMr1eK4fNPsWT7xh8pEz9M nGlSN+2lbh+4IIYWiuHHTYlP5CYfk8BYavX9/kI3P07IMxIX1JQ0pU5/eOVf2Xh7NuD TwZaN0USCBD7JfXaJJXwb10chaa8TjbnllSOPcq+plOQkw4mfPCeq00XP5f/XvJc+W4 LDzGKld1g== Received: (from www@localhost) by webmail.leidinger.net (8.14.2/8.13.8/Submit) id mAG7vsUr007248; Sun, 16 Nov 2008 08:57:54 +0100 (CET) (envelope-from Alexander@Leidinger.net) Received: from 192.168.2.100 ([192.168.2.100]) by webmail.leidinger.net (Horde Framework) with HTTP; Sun, 16 Nov 2008 08:57:53 +0100 Message-ID: <20081116085753.10415gcgqo0etm04@webmail.leidinger.net> X-Priority: 3 (Normal) Date: Sun, 16 Nov 2008 08:57:53 +0100 From: Alexander Leidinger To: Garrett Cooper References: <1155143A-D9F9-4988-B648-F9CDC2A4080C@gmail.com> In-Reply-To: <1155143A-D9F9-4988-B648-F9CDC2A4080C@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; DelSp="Yes"; format="flowed" Content-Disposition: inline Content-Transfer-Encoding: quoted-printable User-Agent: Internet Messaging Program (IMP) H3 (4.3) / FreeBSD-8.0 X-BPAnet-MailScanner-Information: Please contact the ISP for more information X-MailScanner-ID: 0CECB2E0F8.61AB8 X-BPAnet-MailScanner: Found to be clean X-BPAnet-MailScanner-SpamCheck: not spam, ORDB-RBL, SpamAssassin (not cached, score=-14.89, required 6, BAYES_00 -15.00, DKIM_SIGNED 0.00, DKIM_VERIFIED -0.00, NO_RDNS2 0.01, RDNS_DYNAMIC 0.10) X-BPAnet-MailScanner-From: alexander@leidinger.net X-Spam-Status: No X-Mailman-Approved-At: Sun, 16 Nov 2008 13:37:21 +0000 Cc: hackers@freebsd.org Subject: Re: Request for individuals interested in reviewing test / python topics X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 08:16:40 -0000 Quoting Garrett Cooper (from Sat, 15 Nov 2008 =20 14:08:02 -0800): > Hello Hackers and Porters, > =09I'm currently working on a proposal to the FreeBSD foundation to =20 > use Python Nose as a testing framework for writing tests. If there are Are you aware of the history of the current regression tests? If not: It started without a structure, then some work was done to move to the =20 perl testing framework style (really only the output of the tests, and =20 the naming conventions in the directory). This was not completed, and =20 newer tests may not comply. The reason for chosing the perl style was, to be able to use the =20 extensive perl tools to - automatically run all the tests - be able to compare different runs with the perl tools - be able to generate a lot of different output formats (html/text/...) There's also a wiki page about testing, which you may want to check out: http://wiki.freebsd.org/TetIntegration I don't really know python nose. I just looked at it quickly and can =20 not see any big benefit compared to the perl test protocol outlined =20 above (and the stuff outlined in the wiki looks even more advanced =20 than that). Would you please elaborate where you see the benefits of it? Note that during release building perl is needed anyway to generate =20 the index for the ports collection. I don't know if python is required =20 currently during the release generation. Bye, Alexander. --=20 I would have made a good pope. =09=09-- Richard Nixon http://www.Leidinger.net Alexander @ Leidinger.net: PGP ID =3D B0063FE7 http://www.FreeBSD.org netchild @ FreeBSD.org : PGP ID =3D 72077137 From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 14:10:20 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 371921065679 for ; Sun, 16 Nov 2008 14:10:20 +0000 (UTC) (envelope-from yonyossef.lists@gmail.com) Received: from mail-gx0-f13.google.com (mail-gx0-f13.google.com [209.85.217.13]) by mx1.freebsd.org (Postfix) with ESMTP id EAB888FC12 for ; Sun, 16 Nov 2008 14:10:19 +0000 (UTC) (envelope-from yonyossef.lists@gmail.com) Received: by gxk6 with SMTP id 6so743500gxk.19 for ; Sun, 16 Nov 2008 06:10:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=TmP6+oOCqv+DraBKUvzWACmUV2H5zBcuAvE+ummc04U=; b=JRp00Vj2erxz+O9YgcnxONG1oGMu+rWm3ZpToZXLOcCa1zsLZG9Px44R3qO7hF/Twm usju02TKV/NbZlFte9KZlilGKGjVmIfrvh1s5V17YsguWhiG24xhJtclKAjvd2/Yu3/n oZRGWHpou7oOwoVKTGMS2I0OocNuuwC5b0FwE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=cAJy31oklrgazt7biAZWDOL8gzP4gy9TIgp9U6IFl8bCylxTvqTN1rhXjd9ZXN4nf5 Tw5EiYchCBzWA8JMMjKrHe+r1ibJfJ+eKMrufTbEp1JM4b9uxUvIc1CtdqgEu09YTUVQ CnkaaXVZmex8+ZMrlNzSh/e8DzHCVjwQFXBqY= Received: by 10.150.145.20 with SMTP id s20mr5872439ybd.126.1226844619175; Sun, 16 Nov 2008 06:10:19 -0800 (PST) Received: by 10.150.124.5 with HTTP; Sun, 16 Nov 2008 06:10:19 -0800 (PST) Message-ID: <20def4870811160610l5289267erfd7abafb9916b706@mail.gmail.com> Date: Sun, 16 Nov 2008 16:10:19 +0200 From: "Yony Yossef" To: freebsd-hackers@freebsd.org, "Yehonatan Yossef" MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Subject: VLAN offloads on FreeBSD 6.3 & 7.0 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 14:10:20 -0000 Hi All, I'm working on an Ethernet driver for FreeBSD, currently implementing VLAN offloads. I have two problems, one is enabling TSO over the VLAN interface and the second is enabling the VLAN filtering offload. About the TSO problem, I'm currently suffering a hugh performance penalty since I have no TSO enabled over my vlan interfaces. When I create a VLAN interface it does not inherit the features of it's mother-interface, e.g. IFCAP_TSO. Can it be done on FreeBSD 6.3 / 7.0 ? Second, my NIC is capable of holding a vlan table on HW, filtering vlans on it's own, now I need to find a way to update that HW table with added/deleted VLANs in order to use that VLAN filtering offload. One way is to recieve a ioctl from the OS of it's vlan table events (add, remove). I can't find such ioctl. Second way is to have direct access from the driver to the OS vlan table. I'm not familiar with the interface though (something parallel to vlan_group_get_device on linux) or if it's possible at all, can anyone help on this one? Thanks, Yony From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 15:09:01 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 753D31065678 for ; Sun, 16 Nov 2008 15:09:01 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.177]) by mx1.freebsd.org (Postfix) with ESMTP id 096A08FC1F for ; Sun, 16 Nov 2008 15:09:00 +0000 (UTC) (envelope-from max@love2party.net) Received: from vampire.homelinux.org (dslb-088-066-022-110.pools.arcor-ip.net [88.66.22.110]) by mrelayeu.kundenserver.de (node=mrelayeu7) with ESMTP (Nemesis) id 0ML2xA-1L1jFA31JY-0003zw; Sun, 16 Nov 2008 16:08:59 +0100 Received: (qmail 60970 invoked from network); 16 Nov 2008 15:08:52 -0000 Received: from fbsd8.laiers.local (192.168.4.151) by laiers.local with SMTP; 16 Nov 2008 15:08:52 -0000 From: Max Laier Organization: FreeBSD To: freebsd-hackers@freebsd.org Date: Sun, 16 Nov 2008 16:08:51 +0100 User-Agent: KMail/1.10.1 (FreeBSD/8.0-CURRENT; KDE/4.1.1; i386; ; ) References: <20def4870811160610l5289267erfd7abafb9916b706@mail.gmail.com> In-Reply-To: <20def4870811160610l5289267erfd7abafb9916b706@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811161608.51813.max@love2party.net> X-Provags-ID: V01U2FsdGVkX18dplM7+4N2nIgrA6+cRPcj7LHF9bKZS+4Vph6 1NKuDS3jqtmedQJ7aScFpJDAmrM2Y9fTEzq4zccInUswDxOUnk 1oqlOifZ+i/xMg5dRs7Pw== Cc: Yehonatan Yossef , Yony Yossef Subject: Re: VLAN offloads on FreeBSD 6.3 & 7.0 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 15:09:01 -0000 On Sunday 16 November 2008 15:10:19 Yony Yossef wrote: > Hi All, > > I'm working on an Ethernet driver for FreeBSD, currently implementing > VLAN offloads. > I have two problems, one is enabling TSO over the VLAN interface and > the second is enabling the VLAN filtering offload. > > About the TSO problem, I'm currently suffering a hugh performance > penalty since I have no TSO enabled over my vlan interfaces. > When I create a VLAN interface it does not inherit the features of > it's mother-interface, e.g. IFCAP_TSO. > Can it be done on FreeBSD 6.3 / 7.0 ? > > Second, my NIC is capable of holding a vlan table on HW, filtering > vlans on it's own, now I need to find a way to update that HW table > with added/deleted VLANs in order to use that VLAN filtering offload. > One way is to recieve a ioctl from the OS of it's vlan table events > (add, remove). I can't find such ioctl. > > Second way is to have direct access from the driver to the OS vlan > table. I'm not familiar with the interface though (something parallel > to vlan_group_get_device on linux) or if it's possible at all, can > anyone help on this one? See http://svn.freebsd.org/viewvc/base?view=revision&revision=180510 for the VLAN tag issue. Simply EVENTHANDLER_REGISTER a function in your driver to update the hw-table on config/unconfig events. I hope this helps. -- /"\ Best regards, | mlaier@freebsd.org \ / Max Laier | ICQ #67774661 X http://pf4freebsd.love2party.net/ | mlaier@EFnet / \ ASCII Ribbon Campaign | Against HTML Mail and News From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 15:57:10 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 930D01065674 for ; Sun, 16 Nov 2008 15:57:10 +0000 (UTC) (envelope-from yonyossef.lists@gmail.com) Received: from mail-gx0-f13.google.com (mail-gx0-f13.google.com [209.85.217.13]) by mx1.freebsd.org (Postfix) with ESMTP id 24A018FC0C for ; Sun, 16 Nov 2008 15:57:09 +0000 (UTC) (envelope-from yonyossef.lists@gmail.com) Received: by gxk6 with SMTP id 6so760293gxk.19 for ; Sun, 16 Nov 2008 07:57:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=J0JJ9lnePVCoaivdF+yFixYF9jH6GSh2rN0eI0cWCNQ=; b=wVMZODfe7L2s5BdyW3HyjivDpRu8tCgoVn88BwjalcasI8wTf14V5Tag+VjdjE0VTG B4+1FGt7/OlJf8dgzfqkc7SzMGC0v2Dj7zj9KrtUCTp9ob/5xtCUpIg33Tr9ptdhGSgl DGfsHs/mteswpQdk16y5gKwXeuVkI2G8LrM4k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=BiOvrDhjMd2rCostqcsSJSgkt9MpOjUBw/te4p+/DdrgUJlXyErB5G5iLRoh0cUS1h SPf8AOs5QWlqz7eoVoQxBMRIHV3tyZrF3CM85XEj31TF2Bb5vUkKr0MQW87i5h9BbEzx CmU+Q1TH3gE8T697vY0atvXdVF7iElqvJIrmo= Received: by 10.150.228.2 with SMTP id a2mr6022371ybh.166.1226851029075; Sun, 16 Nov 2008 07:57:09 -0800 (PST) Received: by 10.150.124.5 with HTTP; Sun, 16 Nov 2008 07:57:09 -0800 (PST) Message-ID: <20def4870811160757v76bec46bt5cb134388b7d733f@mail.gmail.com> Date: Sun, 16 Nov 2008 17:57:09 +0200 From: "Yony Yossef" To: "Max Laier" In-Reply-To: <200811161608.51813.max@love2party.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20def4870811160610l5289267erfd7abafb9916b706@mail.gmail.com> <200811161608.51813.max@love2party.net> Cc: freebsd-hackers@freebsd.org, Yehonatan Yossef , liranl@mellanox.co.il Subject: Re: VLAN offloads on FreeBSD 6.3 & 7.0 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 15:57:10 -0000 Thanks! it looks like a solution. On Sun, Nov 16, 2008 at 5:08 PM, Max Laier wrote: > On Sunday 16 November 2008 15:10:19 Yony Yossef wrote: >> Hi All, >> >> I'm working on an Ethernet driver for FreeBSD, currently implementing >> VLAN offloads. >> I have two problems, one is enabling TSO over the VLAN interface and >> the second is enabling the VLAN filtering offload. >> >> About the TSO problem, I'm currently suffering a hugh performance >> penalty since I have no TSO enabled over my vlan interfaces. >> When I create a VLAN interface it does not inherit the features of >> it's mother-interface, e.g. IFCAP_TSO. >> Can it be done on FreeBSD 6.3 / 7.0 ? >> >> Second, my NIC is capable of holding a vlan table on HW, filtering >> vlans on it's own, now I need to find a way to update that HW table >> with added/deleted VLANs in order to use that VLAN filtering offload. >> One way is to recieve a ioctl from the OS of it's vlan table events >> (add, remove). I can't find such ioctl. >> >> Second way is to have direct access from the driver to the OS vlan >> table. I'm not familiar with the interface though (something parallel >> to vlan_group_get_device on linux) or if it's possible at all, can >> anyone help on this one? > > See http://svn.freebsd.org/viewvc/base?view=revision&revision=180510 for the > VLAN tag issue. Simply EVENTHANDLER_REGISTER a function in your driver to > update the hw-table on config/unconfig events. I hope this helps. > > -- > /"\ Best regards, | mlaier@freebsd.org > \ / Max Laier | ICQ #67774661 > X http://pf4freebsd.love2party.net/ | mlaier@EFnet > / \ ASCII Ribbon Campaign | Against HTML Mail and News > From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 17:37:02 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9058110656EC for ; Sun, 16 Nov 2008 17:37:02 +0000 (UTC) (envelope-from kientzle@freebsd.org) Received: from kientzle.com (kientzle.com [66.166.149.50]) by mx1.freebsd.org (Postfix) with ESMTP id 71A738FC0A for ; Sun, 16 Nov 2008 17:37:02 +0000 (UTC) (envelope-from kientzle@freebsd.org) Received: from [10.123.2.178] (p53.kientzle.com [66.166.149.53]) by kientzle.com (8.12.9/8.12.9) with ESMTP id mAGHP1tv004066; Sun, 16 Nov 2008 09:25:06 -0800 (PST) (envelope-from kientzle@freebsd.org) Message-ID: <4920576F.9030606@freebsd.org> Date: Sun, 16 Nov 2008 09:25:03 -0800 From: Tim Kientzle User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20060422 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Luigi Rizzo References: <20081114131217.GA62275@onelab2.iet.unipi.it> In-Reply-To: <20081114131217.GA62275@onelab2.iet.unipi.it> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: hackers@freebsd.org Subject: Re: convert bootable freebsd iso to bootable flash image X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 17:37:02 -0000 Luigi Rizzo wrote: > Just in case people have a similar need, or can point me to better > code to do the same job: > > i needed to convert a bootable FreeBSD iso image into a bootable > flash image, and have come up with the following code (derived > from PicoBSD). The nice part is that this is all done without > requiring root permissions -- the iso extraction is done with > bsdtar, the file system is created using makefs, and the > other patching is done with bsdlabel and dd. It doesn't look like this would preserve file ownership, which can be important. It might be interesting to use libarchive within makefs so that makefs can generate the filesystem image directly from tar or iso archives and preserve all of the ownership, permissions, etc. Tim From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 17:00:31 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 78F431065677 for ; Sun, 16 Nov 2008 17:00:31 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.158]) by mx1.freebsd.org (Postfix) with ESMTP id 02F2C8FC0A for ; Sun, 16 Nov 2008 17:00:30 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so1715648fgb.35 for ; Sun, 16 Nov 2008 09:00:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=VZdVx+AkuwMU722S4ih2ajQmfRV45m3/0TdXW+L8byM=; b=sEroppaGlIuoWkUdIRMPjDiGSFy425cqBHhnofn8fDVyV27zqDE7Zcf45xoqm2SD5J N+m6ZRa54qOhQxVqI+XAhJZfGIQi5DQXy9+nghsP5t2vhFDihh20oq/XnbBJP4IMRzXy cD0xbvVv6tdQXrLn7FwU6N6Ui0F97blTNdji4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=rN8HgT3UpTMkqm+2UcRXrLu5VURN9aYt5XF8Ux7qDy9zZLNwBqzlIlhNpb801neral HrHMkWpI2cMrEMwChLG4E5ft4R/uMqYNWGIClq3o61sh2oWowk+hXUCTDwb/hQRW+brs I2/GNn1clq752OPa23i0DnI7fWyh4IcFZQCJM= Received: by 10.86.59.18 with SMTP id h18mr1795157fga.31.1226854829577; Sun, 16 Nov 2008 09:00:29 -0800 (PST) Received: by 10.86.76.13 with HTTP; Sun, 16 Nov 2008 09:00:29 -0800 (PST) Message-ID: <364299f40811160900r420cd841xb8b1546692158b33@mail.gmail.com> Date: Sun, 16 Nov 2008 09:00:29 -0800 From: "Garrett Cooper" To: "Alexander Leidinger" In-Reply-To: <20081116085753.10415gcgqo0etm04@webmail.leidinger.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <1155143A-D9F9-4988-B648-F9CDC2A4080C@gmail.com> <20081116085753.10415gcgqo0etm04@webmail.leidinger.net> X-Mailman-Approved-At: Sun, 16 Nov 2008 17:41:33 +0000 Cc: hackers@freebsd.org Subject: Re: Request for individuals interested in reviewing test / python topics X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 17:00:31 -0000 On Sat, Nov 15, 2008 at 11:57 PM, Alexander Leidinger wrote: > Quoting Garrett Cooper (from Sat, 15 Nov 2008 14:08:02 > -0800): > >> Hello Hackers and Porters, >> I'm currently working on a proposal to the FreeBSD foundation to >> use Python Nose as a testing framework for writing tests. If there are > > Are you aware of the history of the current regression tests? > > If not: > > It started without a structure, then some work was done to move to the perl > testing framework style (really only the output of the tests, and the naming > conventions in the directory). This was not completed, and newer tests may > not comply. > > The reason for choosing the perl style was, to be able to use the extensive > perl tools to > - automatically run all the tests > - be able to compare different runs with the perl tools > - be able to generate a lot of different output formats (html/text/...) > > There's also a wiki page about testing, which you may want to check out: > http://wiki.freebsd.org/TetIntegration > > I don't really know python nose. I just looked at it quickly and can not see > any big benefit compared to the perl test protocol outlined above (and the > stuff outlined in the wiki looks even more advanced than that). Would you > please elaborate where you see the benefits of it? > > Note that during release building perl is needed anyway to generate the > index for the ports collection. I don't know if python is required currently > during the release generation. > > Bye, > Alexander. Alexander, Thanks for getting back with me so quickly. Let me help explain a bit... About selecting tests -- Ok. I gave a quick look at Test::Simple, Test::Harness, etc and although Perl's Test:: modules appear to be rather expedited for executing entire tests, it's not helpful when executing selected tests, unless you write wrappers -- which is part of the point where the pain in adding infrastructure comes in. The default selector plugin that comes with nose is smart enough to crack open the files in a directory structure, do some regexed based searching for ^\s+def\s+test, or something along those lines, and from that you can select individual files with testcases, individual functions in files to execute, or classes, or instances of classes, etc. So if you're developing a fix for a feature bugfix and were provided a single regression test to use for finding the issue and were adding that test to a master test file (for suite execution), but instead wanted to execute only one testcase -- nose supports that functionality out of the box with little change for the user with the default selector plugin: nosetests some_file.py:some_func Furthermore, About capture and printout -- Also, nose with plugins gives you the ability to print not just in plaintext output on a console, but also HTML (I tried looking for the example on the site that was available before, but it appears to be missing now). The example probably consisted of approximately 30~40 lines real code, which for the most part had embedded HTML formatting tags, etc. So, a basic output capture plugins with nose that prints out HTML can be written with <= 25 lines. I'm not sure whether or not Python is required for release generation, but it will have to be listed as one of the required tools in the proposal I'm going to write. Thankfully the required dependencies for Python are small (just a base system with the typical components), and if using Python v2.5+, you also have access to ctypes (a means for testing C-API's in libraries), which is incredibly beneficial I've discovered through my work at Cisco. Assembler instructions would potentially need to be added for architectures other than x86. I'll have to look into this further with Python 2.5 (we currently use Python 2.4.5 -- the last maintenance release of Python -- in our group). Hope that helps explain things a bit more, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 17:04:48 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B2581106564A for ; Sun, 16 Nov 2008 17:04:48 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.157]) by mx1.freebsd.org (Postfix) with ESMTP id 4507E8FC18 for ; Sun, 16 Nov 2008 17:04:48 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so1716622fgb.35 for ; Sun, 16 Nov 2008 09:04:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=E8u4bZcuZu+3daA084iXFH+q6wQgECNFT/NTBlRHRxo=; b=rgLkZpy+CEmKdC+4peugRv7JdhnFR1jfxKT8+GOXakjXbVyPT8gK4sjkXBRvTc/Dp5 GUnO8+ThfRRZ2Ir5IqDwn19bWKAeJ7mMoLqgqT6vFKjuE3p3sTWaKpjkWkYtWNFRc00k FUhF3Y5xKjbtyEPKOwTnWMcgYWnv1aIVldR28= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=YOvjXdvuwdGlyrWsmEhtYzZxPDrOUFB4cxuxu3Spz3scZiCJaDzAqdlU61tYh4IdKl vM6RDnppiV1ALIOKpIFrq4GRQgstIEzONV97tpZsD42UP6NvQqSUWirExbhuoVuJ26VG 3uTphMqZGcNOB+w7jJxcf8xvQorCQeJPMz4js= Received: by 10.86.70.3 with SMTP id s3mr1817952fga.25.1226855087104; Sun, 16 Nov 2008 09:04:47 -0800 (PST) Received: by 10.86.76.13 with HTTP; Sun, 16 Nov 2008 09:04:47 -0800 (PST) Message-ID: <364299f40811160904n33e92a02t6cbeee414bf8c2bf@mail.gmail.com> Date: Sun, 16 Nov 2008 09:04:47 -0800 From: "Garrett Cooper" To: "Alexander Leidinger" In-Reply-To: <364299f40811160900r420cd841xb8b1546692158b33@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <1155143A-D9F9-4988-B648-F9CDC2A4080C@gmail.com> <20081116085753.10415gcgqo0etm04@webmail.leidinger.net> <364299f40811160900r420cd841xb8b1546692158b33@mail.gmail.com> X-Mailman-Approved-At: Sun, 16 Nov 2008 18:58:54 +0000 Cc: hackers@freebsd.org Subject: Re: Request for individuals interested in reviewing test / python topics X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 17:04:48 -0000 On Sun, Nov 16, 2008 at 9:00 AM, Garrett Cooper wrote: > On Sat, Nov 15, 2008 at 11:57 PM, Alexander Leidinger > wrote: >> Quoting Garrett Cooper (from Sat, 15 Nov 2008 14:08:02 >> -0800): >> >>> Hello Hackers and Porters, >>> I'm currently working on a proposal to the FreeBSD foundation to >>> use Python Nose as a testing framework for writing tests. If there are >> >> Are you aware of the history of the current regression tests? >> >> If not: >> >> It started without a structure, then some work was done to move to the perl >> testing framework style (really only the output of the tests, and the naming >> conventions in the directory). This was not completed, and newer tests may >> not comply. >> >> The reason for choosing the perl style was, to be able to use the extensive >> perl tools to >> - automatically run all the tests >> - be able to compare different runs with the perl tools >> - be able to generate a lot of different output formats (html/text/...) >> >> There's also a wiki page about testing, which you may want to check out: >> http://wiki.freebsd.org/TetIntegration >> >> I don't really know python nose. I just looked at it quickly and can not see >> any big benefit compared to the perl test protocol outlined above (and the >> stuff outlined in the wiki looks even more advanced than that). Would you >> please elaborate where you see the benefits of it? >> >> Note that during release building perl is needed anyway to generate the >> index for the ports collection. I don't know if python is required currently >> during the release generation. >> >> Bye, >> Alexander. > > Alexander, Wanted to clarify a few points where I didn't properly word things: > Thanks for getting back with me so quickly. Let me help explain a bit... [..] > executing entire tests, it's not helpful when executing selected s/entire tests/test suites/ [..] > developing a fix for a feature bugfix and were provided a single s/feature bugfix/feature/ [..] > Furthermore, s/Furthermore,// Thanks, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 23:11:19 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 082B8106564A for ; Sun, 16 Nov 2008 23:11:19 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id D73FF8FC1A for ; Sun, 16 Nov 2008 23:11:18 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1226876372-0dac00000000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id CFFCD2F933 for ; Sun, 16 Nov 2008 14:59:32 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id N22Zng4GNZyngr3F for ; Sun, 16 Nov 2008 14:59:32 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 X-ASG-Orig-Subj: How can I add new binaries to the mfsroot image? Date: Sun, 16 Nov 2008 14:59:29 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How can I add new binaries to the mfsroot image? Thread-Index: AclIPvtBgFrF4jrxQi+dQmwjpIT3fQ== From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1226876373 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 23:11:19 -0000 I want to make a custom FreeBSD install CD-ROM with additional commands available in the mfsroot image. Adding the new commands to the image is easy enough, and I've made an install.cfg file on the CD-ROM as well so that when the CD runs the commands in install.cfg are automatically executed. This all works, except none of the new binaries I add to the mfsroot image run during the automated sysinstall session. If I reference one of the default commands (the ones stored in /stand) they run fine, but if I add a new FreeBSD binary to the /stand directory (e.g. gmirror), the command fails. =20 What's weird is that I can open a fixit shell after the install.cfg script fails and then run the same commands interactively and they work fine. Why would work these commands work in an interactive fixit shell but not during the automated sysinstall session? =20 From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 23:41:07 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CB5311065675 for ; Sun, 16 Nov 2008 23:41:07 +0000 (UTC) (envelope-from neldredge@math.ucsd.edu) Received: from euclid.ucsd.edu (euclid.ucsd.edu [132.239.145.52]) by mx1.freebsd.org (Postfix) with ESMTP id ADE868FC1A for ; Sun, 16 Nov 2008 23:41:07 +0000 (UTC) (envelope-from neldredge@math.ucsd.edu) Received: from zeno.ucsd.edu (zeno.ucsd.edu [132.239.145.22]) by euclid.ucsd.edu (8.11.7p3+Sun/8.11.7) with ESMTP id mAGNf6601335; Sun, 16 Nov 2008 15:41:06 -0800 (PST) Received: from localhost (neldredg@localhost) by zeno.ucsd.edu (8.11.7p3+Sun/8.11.7) with ESMTP id mAGNf6804553; Sun, 16 Nov 2008 15:41:06 -0800 (PST) X-Authentication-Warning: zeno.ucsd.edu: neldredg owned process doing -bs Date: Sun, 16 Nov 2008 15:41:06 -0800 (PST) From: Nate Eldredge X-X-Sender: neldredg@zeno.ucsd.edu To: Peter Steele In-Reply-To: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> Message-ID: References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-hackers@freebsd.org Subject: Re: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 23:41:07 -0000 On Sun, 16 Nov 2008, Peter Steele wrote: > I want to make a custom FreeBSD install CD-ROM with additional commands > available in the mfsroot image. Adding the new commands to the image is > easy enough, and I've made an install.cfg file on the CD-ROM as well so > that when the CD runs the commands in install.cfg are automatically > executed. This all works, except none of the new binaries I add to the > mfsroot image run during the automated sysinstall session. If I > reference one of the default commands (the ones stored in /stand) they > run fine, but if I add a new FreeBSD binary to the /stand directory > (e.g. gmirror), the command fails. How does it fail? Is the binary you added statically linked? > What's weird is that I can open a fixit shell after the install.cfg > script fails and then run the same commands interactively and they work > fine. Why would work these commands work in an interactive fixit shell > but not during the automated sysinstall session? Wild guess: the shared libraries are present somewhere else on the CD, which perhaps is either not mounted or not pointed to by LD_LIBRARY_PATH or similar until the fixit shell is run. -- Nate Eldredge neldredge@math.ucsd.edu From owner-freebsd-hackers@FreeBSD.ORG Sun Nov 16 23:41:46 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C9E191065670 for ; Sun, 16 Nov 2008 23:41:46 +0000 (UTC) (envelope-from mailnull@mips.inka.de) Received: from mail-in-07.arcor-online.net (mail-in-07.arcor-online.net [151.189.21.47]) by mx1.freebsd.org (Postfix) with ESMTP id 81AD68FC1D for ; Sun, 16 Nov 2008 23:41:46 +0000 (UTC) (envelope-from mailnull@mips.inka.de) Received: from mail-in-13-z2.arcor-online.net (mail-in-13-z2.arcor-online.net [151.189.8.30]) by mail-in-07.arcor-online.net (Postfix) with ESMTP id 28AD424DF20 for ; Mon, 17 Nov 2008 00:10:20 +0100 (CET) Received: from mail-in-03.arcor-online.net (mail-in-03.arcor-online.net [151.189.21.43]) by mail-in-13-z2.arcor-online.net (Postfix) with ESMTP id 157FD1B8E45 for ; Mon, 17 Nov 2008 00:10:20 +0100 (CET) Received: from lorvorc.mips.inka.de (dslb-088-067-118-215.pools.arcor-ip.net [88.67.118.215]) by mail-in-03.arcor-online.net (Postfix) with ESMTP id 1523930AC4C for ; Mon, 17 Nov 2008 00:10:19 +0100 (CET) Received: from lorvorc.mips.inka.de (localhost [127.0.0.1]) by lorvorc.mips.inka.de (8.14.3/8.14.3) with ESMTP id mAGNAJtO094001 for ; Mon, 17 Nov 2008 00:10:19 +0100 (CET) (envelope-from mailnull@lorvorc.mips.inka.de) Received: (from mailnull@localhost) by lorvorc.mips.inka.de (8.14.3/8.14.3/Submit) id mAGNAJDD094000 for freebsd-hackers@freebsd.org; Mon, 17 Nov 2008 00:10:19 +0100 (CET) (envelope-from mailnull) From: naddy@mips.inka.de (Christian Weisgerber) Date: Sun, 16 Nov 2008 23:10:19 +0000 (UTC) Message-ID: References: <20def4870811160610l5289267erfd7abafb9916b706@mail.gmail.com> Originator: naddy@mips.inka.de (Christian Weisgerber) To: freebsd-hackers@freebsd.org X-Virus-Scanned: ClamAV 0.94.1/8636/Sat Nov 15 06:05:47 2008 on mail-in-03.arcor-online.net X-Virus-Status: Clean Subject: Re: VLAN offloads on FreeBSD 6.3 & 7.0 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 23:41:46 -0000 Yony Yossef wrote: > Second, my NIC is capable of holding a vlan table on HW, filtering > vlans on it's own, now I need to find a way to update that HW table > with added/deleted VLANs in order to use that VLAN filtering offload. If I may piggyback a question here: What is the use of a HW VLAN filter? In what scenario do we receive significant traffic of frames with our station address or multicast but not for any VLAN we have joined? -- Christian "naddy" Weisgerber naddy@mips.inka.de From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 01:04:25 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0D12D1065674 for ; Mon, 17 Nov 2008 01:04:25 +0000 (UTC) (envelope-from tremblett@gmail.com) Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.188]) by mx1.freebsd.org (Postfix) with ESMTP id 951248FC0C for ; Mon, 17 Nov 2008 01:04:24 +0000 (UTC) (envelope-from tremblett@gmail.com) Received: by nf-out-0910.google.com with SMTP id h3so1183622nfh.33 for ; Sun, 16 Nov 2008 17:04:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:mime-version:content-type:content-transfer-encoding :content-disposition; bh=43Q+RfrEcRBtTuvdSoWiPwHOe+Na+LORaCOH+6C0Ryo=; b=TesCxr+886MkOsoXwAUdspIgrY403xP02Py7vCvuWYci3t5O8RcfrxOEm8dI/IzL8y N83rELnIX4quICJrsnjZrSsLxbNrZBvINIMz5Cd0mPyUTIMfePFXbhRRTebxvdpLNYeg xXEpr4+ZlM1hLZkT2M5UWvQAixZNyxIewApxE= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:mime-version:content-type :content-transfer-encoding:content-disposition; b=V/N1Nri/tVyUBDxGazwBL9eKf3oRVg5zs27sf4oA36GitVIClUwYAZhtPoPe4G3mjc 5+IoU84x9Q18FTlEWqqVJCiY4kTLRaa+XYM7z6GOEDyWSdEjeTSZksdxRSl7B2QvXDf9 c77VAdoGMKsjQB9u87JUoFIJDKKVT54/RBE+M= Received: by 10.103.12.8 with SMTP id p8mr1072331mui.44.1226882645159; Sun, 16 Nov 2008 16:44:05 -0800 (PST) Received: by 10.103.134.17 with HTTP; Sun, 16 Nov 2008 16:44:05 -0800 (PST) Message-ID: Date: Sun, 16 Nov 2008 19:44:05 -0500 From: "Steve Tremblett" To: freebsd-questions@freebsd.org, freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Subject: Intel 5100 WiFi X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 01:04:25 -0000 Is there any development being done to support the Intel 5100 wireless device? Linux support is very recent (within the last month), and I believe it requires a firmware blob. Does FreeBSD align with OpenBSD on the whole blob debate? From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 02:19:52 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 029B7106564A for ; Mon, 17 Nov 2008 02:19:52 +0000 (UTC) (envelope-from jamesfrancistoy@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.154]) by mx1.freebsd.org (Postfix) with ESMTP id 834298FC08 for ; Mon, 17 Nov 2008 02:19:51 +0000 (UTC) (envelope-from jamesfrancistoy@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so1844640fgb.35 for ; Sun, 16 Nov 2008 18:19:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender :to:subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references :x-google-sender-auth; bh=wTc1YXFUykwn2eM705Uui6HXuMrUkZoqGujGyqrw4hI=; b=ImFdOe/6ZqGOfXiAESHt/2P6hb3H1ARwwQHJkw19bcGYMYinGAxWlpoJ2sBoFPt0Bo mk/3e4TMBS/1LYOMLdxPTn6H21dN0PYpsANXeLCx9yv3RODENam8kEyTxWdJQDwpsf8l K9jKC9NPEFY38dXKiNbtkDV5zIBoafxFhgmsY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references:x-google-sender-auth; b=h1+OYUKiYeRUo8dQ1BvAXSF1v3vd1BGSOyUpMWLxJzQVpncWjQz5RHC9B4ikti6/P8 Vs/vjTrl8NrO1MZH5Go09NHVsnj3zDYW3ZltmTOPeqYMqo8e386wUtueGGutN74vlhuu B8OuoRhb6fE+JY+39GvNfN+EZUlKtnbRFme3Q= Received: by 10.187.182.10 with SMTP id j10mr395432fap.12.1226888389510; Sun, 16 Nov 2008 18:19:49 -0800 (PST) Received: by 10.187.221.18 with HTTP; Sun, 16 Nov 2008 18:19:49 -0800 (PST) Message-ID: <9f8af95f0811161819i58e3f8bep851ca9ae25c2a43f@mail.gmail.com> Date: Sun, 16 Nov 2008 21:19:49 -0500 From: jT Sender: jamesfrancistoy@gmail.com To: "Steve Tremblett" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: X-Google-Sender-Auth: 0ff927163cde58a0 Cc: freebsd-hackers Subject: Re: Intel 5100 WiFi X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 02:19:52 -0000 Steve, A few Iwn drivers *are* supported, mine being iwn 4965 -- is supported and has been committed to 8.0-CURRENT. You can find more information about development on this hardware here : http://www.clearchain.com/blog/posts/iwn. I'm pretty sure that there is not that much work done on your model yet. Yes it will require a firmware blob as the 4965 one does. You are required to take notice to the legal aspects of the blob via setting a key in loader.conf. In terms of FreeBSD aligning with OpenBSD, I have no idea -- i have only run BSD. We *always* prefer Free as in Freedom -- hence FreeBSD -- again not sure what the OBSD policies are. In addition this is probably a better question for freebsd-mobile or freebsd-questions Thanks and good luck -- /jT http://git.zen-sources.org/?p=kernel/zenmm.git;a=summary From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 03:17:42 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 17637106564A for ; Mon, 17 Nov 2008 03:17:42 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id E97EB8FC0C for ; Mon, 17 Nov 2008 03:17:41 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1226891720-22b200000000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id A165E2F752 for ; Sun, 16 Nov 2008 19:15:20 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id aFmr2SQJ3QosfdhP for ; Sun, 16 Nov 2008 19:15:20 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: RE: How can I add new binaries to the mfsroot image? Date: Sun, 16 Nov 2008 19:15:12 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F23B5040@polaris.maxiscale.com> In-Reply-To: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How can I add new binaries to the mfsroot image? Thread-Index: AclIROOVma+4yZpNQ/+kTxmAijzKmAAAKl5A References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1226891782 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Subject: RE: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 03:17:42 -0000 > How does it fail? There doesn't seem to be any error generated. Or at least I tried to capture stderr and got nothing. > Is the binary you added statically linked? The command I'm doing most of my testing with is gmirror. I pulled it from one of our operation FreeBSD boxes, and it appears to be referencing several shared libraries: # strings /stand/gmirror | grep '.so.' /libexec/ld-elf.so.1 libgeom.so.4 libsbuf.so.4 libbsdxml.so.3 libutil.so.7 libc.so.7 >Wild guess: the shared libraries are present somewhere else on the CD,=20 >which perhaps is either not mounted or not pointed to by LD_LIBRARY_PATH=20 >or similar until the fixit shell is run. All of these shared libraries exist under /dist, which is mounted as the FreeBSD CD. The first one is an absolute path that is in fact a symbolic link in the fixit shell that ends up pointing to a location under /dist. LD_LIBRARY_PATH is not set in the fixit shell, so I'm curious how these shared libraries are being located under /dist (the ones without the explicit path). I think you are right though, it might be related to the shared libraries. I'll try setting LD_LIBRARY_PATH explicitly to see if that solves the problem. From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 03:45:02 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F32F7106564A for ; Mon, 17 Nov 2008 03:45:02 +0000 (UTC) (envelope-from sam@freebsd.org) Received: from ebb.errno.com (ebb.errno.com [69.12.149.25]) by mx1.freebsd.org (Postfix) with ESMTP id CA02C8FC0C for ; Mon, 17 Nov 2008 03:45:02 +0000 (UTC) (envelope-from sam@freebsd.org) Received: from trouble.errno.com (trouble.errno.com [10.0.0.248]) (authenticated bits=0) by ebb.errno.com (8.13.6/8.12.6) with ESMTP id mAH3j2VQ086340 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 16 Nov 2008 19:45:02 -0800 (PST) (envelope-from sam@freebsd.org) Message-ID: <4920E8BE.7080208@freebsd.org> Date: Sun, 16 Nov 2008 19:45:02 -0800 From: Sam Leffler Organization: FreeBSD Project User-Agent: Thunderbird 2.0.0.9 (X11/20071125) MIME-Version: 1.0 To: jT References: <9f8af95f0811161819i58e3f8bep851ca9ae25c2a43f@mail.gmail.com> In-Reply-To: <9f8af95f0811161819i58e3f8bep851ca9ae25c2a43f@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-DCC-sonic.net-Metrics: ebb.errno.com; whitelist Cc: freebsd-hackers , Steve Tremblett Subject: Re: Intel 5100 WiFi X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 03:45:03 -0000 jT wrote: > Steve, > A few Iwn drivers *are* supported, mine being iwn 4965 -- is > supported and has been committed to 8.0-CURRENT. You can find more > information about development on this hardware here : > http://www.clearchain.com/blog/posts/iwn. I'm pretty sure that there > is not that much work done on your model yet. > > Yes it will require a firmware blob as the 4965 one does. You are > required to take notice to the legal aspects of the blob via setting a > key in loader.conf. In terms of FreeBSD aligning with OpenBSD, I have > no idea -- i have only run BSD. We *always* prefer Free as in Freedom > -- hence FreeBSD -- again not sure what the OBSD policies are. > > In addition this is probably a better question for freebsd-mobile or > freebsd-questions > > iwn firmware does not require a sysctl ack. Sam From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 04:27:51 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 941A0106564A for ; Mon, 17 Nov 2008 04:27:51 +0000 (UTC) (envelope-from jamesfrancistoy@gmail.com) Received: from fk-out-0910.google.com (fk-out-0910.google.com [209.85.128.185]) by mx1.freebsd.org (Postfix) with ESMTP id DF4B98FC19 for ; Mon, 17 Nov 2008 04:27:50 +0000 (UTC) (envelope-from jamesfrancistoy@gmail.com) Received: by fk-out-0910.google.com with SMTP id k31so2780902fkk.11 for ; Sun, 16 Nov 2008 20:27:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender :to:subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references :x-google-sender-auth; bh=5hhKTVKuE7z+oGmBNxyPYvYCMtGf1pD26wSobEL6xTs=; b=X4Y4pFTjnan9eHlH/6Ad3oIRyL4d7NbBoH0I3TvHqhkh1zIoiXrS8Koa7NYJnauquK HLc5iZTs+ah6jCjwQlfx/aqic2lIUevcmkzgiGDQ/5rKG0ohrISGE6KvoaqKGi4pkVwS jwk3AbFTF711xpM7lAaktApXKocEbMjpsLy2s= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references:x-google-sender-auth; b=g+cts53N2e1VRnwVWyUPfgkp9ZFmY3oNJKEZl8SgdG+AOqwTHhwYfU9JLj5qvgNjDw CcCdKViSHL1pSiEwlGgK/IPNU56h/d2aUmMgYGf2cWggFIEjrOWDSMZ9SoaHmiFDlALh ctre6M2e4thB0LU3jDmatgexTH1kvfilS5ru4= Received: by 10.187.208.18 with SMTP id k18mr399717faq.75.1226896069021; Sun, 16 Nov 2008 20:27:49 -0800 (PST) Received: by 10.187.221.18 with HTTP; Sun, 16 Nov 2008 20:27:48 -0800 (PST) Message-ID: <9f8af95f0811162027g41c4460fq89cf106ad64cf505@mail.gmail.com> Date: Sun, 16 Nov 2008 23:27:48 -0500 From: jT Sender: jamesfrancistoy@gmail.com To: "Sam Leffler" In-Reply-To: <4920E8BE.7080208@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <9f8af95f0811161819i58e3f8bep851ca9ae25c2a43f@mail.gmail.com> <4920E8BE.7080208@freebsd.org> X-Google-Sender-Auth: bd9014383dc24cef Cc: freebsd-hackers , Steve Tremblett Subject: Re: Intel 5100 WiFi X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 04:27:51 -0000 Sam, I know you are busy, but can you explain what about my response was wrong when you say doesn't require sysctl ack -- you mean acknowledgment? I just would like to know for my future reference and Steve sorry for my misinformation. > > iwn firmware does not require a sysctl ack. > > Sam > > -- /jT http://git.zen-sources.org/?p=kernel/zenmm.git;a=summary From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 04:43:27 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D71ED106564A for ; Mon, 17 Nov 2008 04:43:27 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.177]) by mx1.freebsd.org (Postfix) with ESMTP id 63B808FC12 for ; Mon, 17 Nov 2008 04:43:27 +0000 (UTC) (envelope-from max@love2party.net) Received: from vampire.homelinux.org (dslb-088-066-041-229.pools.arcor-ip.net [88.66.41.229]) by mrelayeu.kundenserver.de (node=mrelayeu7) with ESMTP (Nemesis) id 0ML2xA-1L1vxL3Pko-000440; Mon, 17 Nov 2008 05:43:26 +0100 Received: (qmail 73095 invoked from network); 17 Nov 2008 04:43:19 -0000 Received: from fbsd8.laiers.local (192.168.4.151) by laiers.local with SMTP; 17 Nov 2008 04:43:19 -0000 From: Max Laier Organization: FreeBSD To: freebsd-hackers@freebsd.org Date: Mon, 17 Nov 2008 05:43:18 +0100 User-Agent: KMail/1.10.1 (FreeBSD/8.0-CURRENT; KDE/4.1.1; i386; ; ) References: <4920E8BE.7080208@freebsd.org> <9f8af95f0811162027g41c4460fq89cf106ad64cf505@mail.gmail.com> In-Reply-To: <9f8af95f0811162027g41c4460fq89cf106ad64cf505@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811170543.19218.max@love2party.net> X-Provags-ID: V01U2FsdGVkX190k6m6LnLZ1iE4Jjbd8WpBDBpIQETw6PpTlIt T4XrD+5yE/Jhg7h6mlFZDOgfFLIID7yxiz4sw3wAy8vXNBz2sX zv+D1fsxZCq7RQ1cYAXWw== Cc: Steve Tremblett , Sam Leffler , jT Subject: Re: Intel 5100 WiFi X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 04:43:27 -0000 On Monday 17 November 2008 05:27:48 jT wrote: > I know you are busy, but can you explain what about my response was > wrong when you say doesn't require sysctl ack -- you mean > acknowledgment? I just would like to know for my future reference and > Steve sorry for my misinformation. the firmware for the iwn(4) powered cards is (in contrast to ipw(4)) provided by Intel under a permissive license that does not require end-user acknowledgment. It is unfortunate that Intel doesn't release all firmware similarly - so we have to live with the slight confusion stemming from that. You can identify all firmware(9) modules in the tree that require a license ack, by grepping for "FIRMWARE_LICENSE" in the module Makefiles. -- /"\ Best regards, | mlaier@freebsd.org \ / Max Laier | ICQ #67774661 X http://pf4freebsd.love2party.net/ | mlaier@EFnet / \ ASCII Ribbon Campaign | Against HTML Mail and News From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 04:43:39 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1C0221065706 for ; Mon, 17 Nov 2008 04:43:39 +0000 (UTC) (envelope-from sam@freebsd.org) Received: from ebb.errno.com (ebb.errno.com [69.12.149.25]) by mx1.freebsd.org (Postfix) with ESMTP id DF2A68FC08 for ; Mon, 17 Nov 2008 04:43:38 +0000 (UTC) (envelope-from sam@freebsd.org) Received: from trouble.errno.com (trouble.errno.com [10.0.0.248]) (authenticated bits=0) by ebb.errno.com (8.13.6/8.12.6) with ESMTP id mAH4hcgt086599 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 16 Nov 2008 20:43:38 -0800 (PST) (envelope-from sam@freebsd.org) Message-ID: <4920F67A.1010103@freebsd.org> Date: Sun, 16 Nov 2008 20:43:38 -0800 From: Sam Leffler Organization: FreeBSD Project User-Agent: Thunderbird 2.0.0.9 (X11/20071125) MIME-Version: 1.0 To: jT References: <9f8af95f0811161819i58e3f8bep851ca9ae25c2a43f@mail.gmail.com> <4920E8BE.7080208@freebsd.org> <9f8af95f0811162027g41c4460fq89cf106ad64cf505@mail.gmail.com> In-Reply-To: <9f8af95f0811162027g41c4460fq89cf106ad64cf505@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-DCC-sonic.net-Metrics: ebb.errno.com; whitelist Cc: freebsd-hackers , Steve Tremblett Subject: Re: Intel 5100 WiFi X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 04:43:39 -0000 The 4965 firmware license does not require an ack via the loader tunable. This used to be true but was changed recently as I was mistaken about the license (only iwi and ipw firmware requires the end user acknowledge the EULA). Everything else that was said seemed spot on. Sam jT wrote: > Sam, > I know you are busy, but can you explain what about my response was > wrong when you say doesn't require sysctl ack -- you mean > acknowledgment? I just would like to know for my future reference and > Steve sorry for my misinformation. > > >> iwn firmware does not require a sysctl ack. >> >> Sam >> >> >> > > > > From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 04:56:11 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C98E7106564A for ; Mon, 17 Nov 2008 04:56:11 +0000 (UTC) (envelope-from joerg@britannica.bec.de) Received: from www.sonnenberger.org (www.ostsee-abc.de [62.206.222.50]) by mx1.freebsd.org (Postfix) with ESMTP id 8497F8FC0C for ; Mon, 17 Nov 2008 04:56:11 +0000 (UTC) (envelope-from joerg@britannica.bec.de) Received: from britannica.bec.de (www.sonnenberger.org [192.168.1.10]) by www.sonnenberger.org (Postfix) with ESMTP id 6351D66796 for ; Mon, 17 Nov 2008 05:53:37 +0100 (CET) Received: by britannica.bec.de (Postfix, from userid 1000) id 33A72937CB; Mon, 17 Nov 2008 05:51:51 +0100 (CET) Date: Mon, 17 Nov 2008 05:51:50 +0100 From: Joerg Sonnenberger To: freebsd-hackers@freebsd.org Message-ID: <20081117045148.GA97@britannica.bec.de> Mail-Followup-To: freebsd-hackers@freebsd.org References: <9f8af95f0811161819i58e3f8bep851ca9ae25c2a43f@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <9f8af95f0811161819i58e3f8bep851ca9ae25c2a43f@mail.gmail.com> User-Agent: Mutt/1.5.18 (2008-05-17) Subject: Re: Intel 5100 WiFi X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 04:56:11 -0000 On Sun, Nov 16, 2008 at 09:19:49PM -0500, jT wrote: > Yes it will require a firmware blob as the 4965 one does. You are > required to take notice to the legal aspects of the blob via setting a > key in loader.conf. The firmware "blob" here is simply a large binary file that is loaded directly into the card memory. Contrary to the image for first and second generation Centrino, Intel changed to license to a BSDish license, so no further user interaction is needed to accept an EULA. Note that this image is run on the card, not your CPU. Joerg From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 06:17:16 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A9AE81065672 for ; Mon, 17 Nov 2008 06:17:16 +0000 (UTC) (envelope-from yonyossef.lists@gmail.com) Received: from yx-out-2324.google.com (yx-out-2324.google.com [74.125.44.30]) by mx1.freebsd.org (Postfix) with ESMTP id 57F678FC0C for ; Mon, 17 Nov 2008 06:17:15 +0000 (UTC) (envelope-from yonyossef.lists@gmail.com) Received: by yx-out-2324.google.com with SMTP id 8so945004yxb.13 for ; Sun, 16 Nov 2008 22:17:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=fGOHrWHCgk/GRjvcgtGedW8KRq0DdXzecIgWY2hDe0E=; b=rRyvT7yiyoiWHDbH0Gff1qvNJLjHOwdMBW/np08h/o76cq41ScUbtzG0n86jIZnGDx eC39A4onsHoHDv312uRS4/n5LIvRKjlSK/89x+ibNE4saa45cCpaoIdl73R8HifJAwsl wBcd7DL1Yj8I269IHpDRufU/Yf7e8qTx4cwN8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=bfDBuf5UEQ30WgzgJci8nYCmwq3iOz4P2CDu7DaFmCsO8Nut8Vj24ef6ub9ZGpgRJQ PywFrp2IRQ7SLb95aBgu1zzGqP5bFQhKvpFLk3YWEqMK18WB2kUROx4kk8bcZQ5pIcca 2wNDh/6+om+no/GCquUGqUrceOD3ZW1bvdBE8= Received: by 10.151.145.21 with SMTP id x21mr7281229ybn.130.1226902635126; Sun, 16 Nov 2008 22:17:15 -0800 (PST) Received: by 10.150.124.5 with HTTP; Sun, 16 Nov 2008 22:17:15 -0800 (PST) Message-ID: <20def4870811162217t7aef5cb2m5f8989c405c0a9c@mail.gmail.com> Date: Mon, 17 Nov 2008 08:17:15 +0200 From: "Yony Yossef" To: "Max Laier" In-Reply-To: <200811161608.51813.max@love2party.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20def4870811160610l5289267erfd7abafb9916b706@mail.gmail.com> <200811161608.51813.max@love2party.net> Cc: freebsd-hackers@freebsd.org, Yehonatan Yossef Subject: Re: VLAN offloads on FreeBSD 6.3 & 7.0 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 06:17:16 -0000 Hi Max, do you happen to know if TSO (as other capabilities) can be enabled on a VLAN interface? I've already posted this question so I'm not sending this mail to the list. On Sun, Nov 16, 2008 at 5:08 PM, Max Laier wrote: > On Sunday 16 November 2008 15:10:19 Yony Yossef wrote: >> Hi All, >> >> I'm working on an Ethernet driver for FreeBSD, currently implementing >> VLAN offloads. >> I have two problems, one is enabling TSO over the VLAN interface and >> the second is enabling the VLAN filtering offload. >> >> About the TSO problem, I'm currently suffering a hugh performance >> penalty since I have no TSO enabled over my vlan interfaces. >> When I create a VLAN interface it does not inherit the features of >> it's mother-interface, e.g. IFCAP_TSO. >> Can it be done on FreeBSD 6.3 / 7.0 ? >> >> Second, my NIC is capable of holding a vlan table on HW, filtering >> vlans on it's own, now I need to find a way to update that HW table >> with added/deleted VLANs in order to use that VLAN filtering offload. >> One way is to recieve a ioctl from the OS of it's vlan table events >> (add, remove). I can't find such ioctl. >> >> Second way is to have direct access from the driver to the OS vlan >> table. I'm not familiar with the interface though (something parallel >> to vlan_group_get_device on linux) or if it's possible at all, can >> anyone help on this one? > > See http://svn.freebsd.org/viewvc/base?view=revision&revision=180510 for the > VLAN tag issue. Simply EVENTHANDLER_REGISTER a function in your driver to > update the hw-table on config/unconfig events. I hope this helps. > > -- > /"\ Best regards, | mlaier@freebsd.org > \ / Max Laier | ICQ #67774661 > X http://pf4freebsd.love2party.net/ | mlaier@EFnet > / \ ASCII Ribbon Campaign | Against HTML Mail and News > From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 10:28:25 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 301FE1065672 for ; Mon, 17 Nov 2008 10:28:25 +0000 (UTC) (envelope-from stas@ht-systems.ru) Received: from smtp.ht-systems.ru (mr0.ht-systems.ru [78.110.50.55]) by mx1.freebsd.org (Postfix) with ESMTP id D7D348FC17 for ; Mon, 17 Nov 2008 10:28:24 +0000 (UTC) (envelope-from stas@ht-systems.ru) Received: from [78.110.49.49] (helo=quasar.ht-systems.ru) by smtp.ht-systems.ru with esmtpa (Exim 4.62) (envelope-from ) id 1L212S-0005Hk-Ra; Mon, 17 Nov 2008 13:09:00 +0300 Received: by quasar.ht-systems.ru (Postfix, from userid 1024) id B5CF373023; Mon, 17 Nov 2008 13:08:59 +0300 (MSK) Date: Mon, 17 Nov 2008 13:08:55 +0300 From: Stanislav Sedov To: "Peter Steele" Message-Id: <20081117130855.d845d507.stas@FreeBSD.org> In-Reply-To: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> Organization: The FreeBSD Project X-XMPP: ssedov@jabber.ru X-Voice: +7 916 849 20 23 X-PGP-Fingerprint: F21E D6CC 5626 9609 6CE2 A385 2BF5 5993 EB26 9581 X-Mailer: carrier-pigeon Mime-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg="PGP-SHA1"; boundary="Signature=_Mon__17_Nov_2008_13_08_55_+0300_xIuE4NsJlc_0jzZn" Cc: freebsd-hackers@freebsd.org Subject: Re: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 10:28:25 -0000 --Signature=_Mon__17_Nov_2008_13_08_55_+0300_xIuE4NsJlc_0jzZn Content-Type: text/plain; charset=US-ASCII Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, 16 Nov 2008 14:59:29 -0800 "Peter Steele" mentioned: >=20 > What's weird is that I can open a fixit shell after the install.cfg > script fails and then run the same commands interactively and they work > fine. Why would work these commands work in an interactive fixit shell > but not during the automated sysinstall session? >=20 I'm not sure, but probably the installation CD doesn't carry shared libraries at all? All binaries in /stand are static-linked ones. You could also try scripts from mfsbsd project: http://people.freebsd.org/~mm/mfsbsd/ These works for me fine for building custom installation CDs. --=20 Stanislav Sedov ST4096-RIPE --Signature=_Mon__17_Nov_2008_13_08_55_+0300_xIuE4NsJlc_0jzZn Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkkhQrsACgkQK/VZk+smlYGcEQCeMwVpXN8aI+u6uBplEL+azoyU 4a0An1bgmLxAWZN4/ClDpyJe+tj6fcU/ =IqhS -----END PGP SIGNATURE----- --Signature=_Mon__17_Nov_2008_13_08_55_+0300_xIuE4NsJlc_0jzZn-- From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 11:35:52 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EF06C1065675 for ; Mon, 17 Nov 2008 11:35:52 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: from qb-out-0506.google.com (qb-out-0506.google.com [72.14.204.224]) by mx1.freebsd.org (Postfix) with ESMTP id A11298FC13 for ; Mon, 17 Nov 2008 11:35:52 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: by qb-out-0506.google.com with SMTP id f30so2163739qba.35 for ; Mon, 17 Nov 2008 03:35:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:subject :message-id:reply-to:mail-followup-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=Mbwa3Mv1fOxvq6VoU4W+YqpNrmp4jo7/uRehm09JZDc=; b=PdtK2Zj+OPS3Ub7adaqz1bSews+eLZ1V0T3SCFd864tCK9KkWtneTP74SBYHpRf7MO +0skI37XBYJUUqLmUq5i9LqRMn2WVXgKXkKHNlZ4XP/GtpoWs9PyHSSrbfXjWaiiqKSZ WQENly6LzhPfQfMZ1eYMNKFZ1Mlr2Nt0mTEdM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:subject:message-id:reply-to:mail-followup-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; b=Upc342zy9n6hQweeVckoGNMH6KGu348zm8ODZrDrROIvxk0V75sHaHvnI94H8MCw22 4Bj/7g8Jjh3B6YGpfc66t5ATjlcthWADCPicOicXjyPtSwcZZ4bbbWp/6sUemLh09ttO sl1rIliZnqxvxhOEMIvyTMaMZgleZmVCSxBwQ= Received: by 10.103.170.6 with SMTP id x6mr1233318muo.13.1226921751150; Mon, 17 Nov 2008 03:35:51 -0800 (PST) Received: from localhost (BAD9344.bad.pppool.de [77.131.147.68]) by mx.google.com with ESMTPS id j10sm4303332muh.1.2008.11.17.03.35.48 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 17 Nov 2008 03:35:49 -0800 (PST) Date: Mon, 17 Nov 2008 12:35:22 +0100 From: Alexej Sokolov To: FreeBSD Hackers Message-ID: <20081117113522.GA2732@debian.samsung.router> Mail-Followup-To: FreeBSD Hackers References: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> <20081116100923.GU81783@hoeg.nl> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <20081116100923.GU81783@hoeg.nl> User-Agent: Mutt/1.5.18 (2008-05-17) Subject: Re: KLD loading, liking X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Alexej Sokolov List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 11:35:53 -0000 On Sun, Nov 16, 2008 at 11:09:00AM +0100, Ed Schouten wrote: > * Alexej Sokolov wrote: > > What exact does the macro MODULE_DEPEND ? The man page is to short, and I > > guess it tell no all things that the macro does. > > MODULE_DEPEND is used to say: this kernel module also depends on another > module (i.e. the USB printer module depends on the USB code). Tools like > kldload can then automatically load the missing modules. Not only that. The use of the MODULE_DEPEND macro allows one module to access the variables of modules on which it depends. But man page of MODULE_DEPEND doesn't tell anything about this functionality. Hence I am looking for any good documentation of KLD loader. But I didn't find anything. May be looking in the source code is the best solution. > > -- > Ed Schouten > WWW: http://80386.nl/ -- Alexej Sokolov From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 09:19:36 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A05301065673 for ; Mon, 17 Nov 2008 09:19:36 +0000 (UTC) (envelope-from won.derick@yahoo.com) Received: from n6.bullet.mud.yahoo.com (n6.bullet.mud.yahoo.com [216.252.100.57]) by mx1.freebsd.org (Postfix) with SMTP id 67F458FC1C for ; Mon, 17 Nov 2008 09:19:36 +0000 (UTC) (envelope-from won.derick@yahoo.com) Received: from [68.142.194.243] by n6.bullet.mud.yahoo.com with NNFMP; 17 Nov 2008 09:07:03 -0000 Received: from [68.142.201.66] by t1.bullet.mud.yahoo.com with NNFMP; 17 Nov 2008 09:07:03 -0000 Received: from [127.0.0.1] by omp418.mail.mud.yahoo.com with NNFMP; 17 Nov 2008 09:07:03 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 821961.6700.bm@omp418.mail.mud.yahoo.com Received: (qmail 96777 invoked by uid 60001); 17 Nov 2008 09:07:03 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:MIME-Version:Content-Type:Message-ID; b=TTg/RUfMaQvH+YW1LstJ/yLL7pUaHQzhqkO04buBYeNRflIYuwL0o3fWA/20Y/4ygl9bc1bsqx3WW1iCuIsDFAR8RGzhH4LtdPd0eP7nU9b569O3txlzVrsmFy7JEhbX2IGZllxljgDwN4BzBiDkfYp2lZnJqc0pdoBAPNKdAg8=; X-YMail-OSG: 2Q5y9oUVM1lzziwGTHhYvN9qI3ZWmsAc41v1ezBqzRlxnGf3r.SmmW9SPbwoYJy3iVTDseTsoB0geW1AIPWhzrqR1_2w2gCchDj.nV_kppceRYuhEmTKQffDqNhzRXmuGHl0QWneccwTiOyKi6UaaK00jIM- Received: from [58.71.34.137] by web45809.mail.sp1.yahoo.com via HTTP; Mon, 17 Nov 2008 01:07:02 PST X-Mailer: YahooMailRC/1155.29 YahooMailWebService/0.7.260.1 Date: Mon, 17 Nov 2008 01:07:02 -0800 (PST) From: Won De Erick To: Jeremy Chadwick MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Message-ID: <245613.95922.qm@web45809.mail.sp1.yahoo.com> X-Mailman-Approved-At: Mon, 17 Nov 2008 12:27:52 +0000 Cc: freebsd-hackers@freebsd.org, rwatson@freebsd.org Subject: Re: NET.ISR and CPU utilization performance w/ HP DL 585 using FreeBSD 7.1 Beta2 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 09:19:36 -0000 > ----- Original Message ---- > From: Won De Erick > To: Jeremy Chadwick > Cc: rwatson@freebsd.org; freebsd-hackers@freebsd.org > Sent: Sunday, November 16, 2008 7:18:46 PM > Subject: Re: NET.ISR and CPU utilization performance w/ HP DL 585 using FreeBSD 7.1 Beta2 > > > ----- Original Message ---- > > > From: Jeremy Chadwick > > To: Won De Erick > > Cc: rwatson@freebsd.org; freebsd-hackers@freebsd.org > > Sent: Saturday, November 15, 2008 10:16:31 PM > > Subject: Re: NET.ISR and CPU utilization performance w/ HP DL 585 using FreeBSD 7.1 Beta2 > > > > On Sat, Nov 15, 2008 at 04:59:16AM -0800, Won De Erick wrote: > > > Hello, > > > > > > I tested HP DL 585 (16 CPUs, w/ built-in Broadcom NICs) running FreeBSD 7.1 Beta2 under heavy network traffic (TCP). > > > > > > SCENARIO A : Bombarded w/ TCP traffic: > > > > > > When net.isr.direct=1, > > > > > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > > > 52 root 1 -68 - 0K 16K CPU11 b 38:43 95.36% irq32: bce1 > > > 51 root 1 -68 - 0K 16K CPU10 a 25:50 85.16% irq31: bce0 > > > 16 root 1 171 ki31 0K 16K RUN a 65:39 15.97% idle: cpu10 > > > 28 root 1 -32 - 0K 16K WAIT 8 12:28 5.18% swi4: clock sio > > > 15 root 1 171 ki31 0K 16K RUN b 52:46 3.76% idle: cpu11 > > > 45 root 1 -64 - 0K 16K WAIT 7 7:29 1.17% irq17: uhci0 > > > 47 root 1 -64 - 0K 16K WAIT 6 1:11 0.10% irq16: ciss0 > > > 27 root 1 -44 - 0K 16K WAIT 0 28:52 0.00% swi1: net > > > > > > When net.isr.direct=0, > > > > > > 16 root 1 171 ki31 0K 16K CPU10 a 106:46 92.58% idle: cpu10 > > > 19 root 1 171 ki31 0K 16K CPU7 7 133:37 89.16% idle: cpu7 > > > 27 root 1 -44 - 0K 16K WAIT 0 52:20 76.37% swi1: net > > > 25 root 1 171 ki31 0K 16K RUN 1 132:30 70.26% idle: cpu1 > > > 26 root 1 171 ki31 0K 16K CPU0 0 111:58 64.36% idle: cpu0 > > > 15 root 1 171 ki31 0K 16K CPU11 b 81:09 57.76% idle: cpu11 > > > 52 root 1 -68 - 0K 16K WAIT b 64:00 42.97% irq32: bce1 > > 51 root 1 -68 - 0K 16K WAIT a 38:22 12.26% irq31: bce0 > > > 45 root 1 -64 - 0K 16K WAIT 7 11:31 12.06% irq17: uhci0 > > > 47 root 1 -64 - 0K 16K WAIT 6 1:54 3.66% irq16: ciss0 > > > 28 root 1 -32 - 0K 16K WAIT 8 16:01 0.00% swi4: clock sio > > > > > > Overall CPU utilization has significantly dropped, but I noticed that swi1 has taken CPU0 with high utilization when the net.isr.direct=0. > > > What does this mean? > > > > > > SCENARIO B : Bombarded w/ more TCP traffic: > > > > > > Worst thing, the box has become unresponsive (can't be PINGed, inaccessible through SSH) after more traffic was added retaining net.isr.direct=0. > > > This is due maybe to the 100% utilization on CPU0 for sw1:net (see below result, first line). bce's and swi's seem to race each other based on the > result when net.isr.direct=1, swi1 . > > > The rest of the CPUs are sitting pretty (100% Idle). Can you shed some lights on this? > > > > > > When net.isr.direct=0: > > > 27 root 1 -44 - 0K 16K CPU0 0 5:45 100.00% swi1: net > > > 11 root 1 171 ki31 0K 16K CPU15 0 0:00 100.00% idle: cpu15 > > > 13 root 1 171 ki31 0K 16K CPU13 0 0:00 100.00% idle: cpu13 > > > 17 root 1 171 ki31 0K 16K CPU9 0 0:00 100.00% idle: cpu9 > > > 18 root 1 171 ki31 0K 16K CPU8 0 0:00 100.00% idle: cpu8 > > > 21 root 1 171 ki31 0K 16K CPU5 5 146:17 99.17% idle: cpu5 > > > 22 root 1 171 ki31 0K 16K CPU4 4 146:17 99.07% idle: cpu4 > > > 14 root 1 171 ki31 0K 16K CPU12 0 0:00 99.07% idle: cpu12 > > > 16 root 1 171 ki31 0K 16K CPU10 a 109:33 98.88% idle: cpu10 > > > 15 root 1 171 ki31 0K 16K CPU11 b 86:36 93.55% idle: cpu11 > > > 52 root 1 -68 - 0K 16K WAIT b 59:42 13.87% irq32: bce1 > > > > > > When net.isr.direct=1, > > > 52 root 1 -68 - 0K 16K CPU11 b 55:04 97.66% irq32: bce1 > > > 51 root 1 -68 - 0K 16K CPU10 a 33:52 73.88% irq31: bce0 > > > 16 root 1 171 ki31 0K 16K RUN a 102:42 26.86% idle: cpu10 > > > 15 root 1 171 ki31 0K 16K RUN b 81:20 3.17% idle: cpu11 > > > 28 root 1 -32 - 0K 16K WAIT e 13:40 0.00% swi4: clock sio > > > > > > With regards to bandwidth in all scenarios above, the result is extremely low (expected is several hundred Mb/s). Why? > > The below result should be under scenario B above only. > > > > > > > - iface Rx Tx Total > > > ============================================================================== > > > bce0: 4.69 Mb/s 10.49 Mb/s 15.18 Mb/s > > > bce1: 20.66 Mb/s 4.68 Mb/s 25.34 Mb/s > > > lo0: 0.00 b/s 0.00 b/s 0.00 b/s > > > ------------------------------------------------------------------------------ > > > total: 25.35 Mb/s 15.17 Mb/s 40.52 Mb/s > > > > > > > > > Thanks, > > > > > > Won > > > > And does this behaviour change if you use some other brand of NIC? > > With Intel Pro NIC ( 82571): > > When net.isr.direct=1, > > 49 root 1 -68 - 0K 16K CPU12 c 6:50 100.00% em0 taskq > 15 root 1 171 ki31 0K 16K CPU11 b 5:47 100.00% idle: cpu11 > 50 root 1 -68 - 0K 16K CPU13 d 6:15 86.96% em1 taskq > 25 root 1 171 ki31 0K 16K CPU1 1 9:27 79.79% idle: cpu1 > 28 root 1 -32 - 0K 16K WAIT 1 1:33 22.75% swi4: clock sio > 13 root 1 171 ki31 0K 16K RUN d 4:14 12.26% idle: cpu13 > 14 root 1 171 ki31 0K 16K RUN c 3:37 0.00% idle: cpu12 > > em0 and em1 have high CPU utilization, and with netstat, there were packet errors. > > # netstat -I em0 -w 1 -d > input (em0) output > packets errs bytes packets errs bytes colls drops > 15258 3066 22748316 18468 0 4886567 0 0 > 15461 3096 22783724 18379 0 5350130 0 0 > > > When net.isr.direct=0, > 12 root 1 171 ki31 0K 16K CPU14 e 22:28 100.00% idle: cpu14 > 20 root 1 171 ki31 0K 16K CPU6 6 24:32 97.85% idle: cpu6 > 25 root 1 171 ki31 0K 16K RUN 1 21:51 96.97% idle: cpu1 > 27 root 1 -44 - 0K 16K CPU2 2 5:12 91.55% swi1: net > 13 root 1 171 ki31 0K 16K CPU13 d 11:04 86.96% idle: cpu13 > 14 root 1 171 ki31 0K 16K CPU12 c 10:51 81.59% idle: cpu12 > 49 root 1 -68 - 0K 16K CPU12 c 13:48 22.17% em0 taskq > 24 root 1 171 ki31 0K 16K RUN 2 19:16 12.16% idle: cpu2 > 50 root 1 -68 - 0K 16K - d 13:34 11.87% em1 taskq > 28 root 1 -32 - 0K 16K WAIT 3 3:48 0.00% swi4: clock sio > > sw1:net is taking high CPU utilization this time, but without packet errors: > > # netstat -I em0 -w 1 -d > input (em0) output > packets errs bytes packets errs bytes colls drops > 4275 0 5528012 24878 0 24162198 0 0 > 4317 0 5585954 24880 0 24066583 0 0 > > > Is this related to the context switching in FreeBSD 7.x? I noticed that there were no significant difference in enabling and disabling net.isr.direct in FreeBSD > 6.2. > Also, is there any significance of enabling device polling? > > > > > -- > > | Jeremy Chadwick jdc at parodius.com | > > | Parodius Networking http://www.parodius.com/ | > > | UNIX Systems Administrator Mountain View, CA, USA | > > | Making life hard for others since 1977. PGP: 4BD6C0CB | > > I compiled the following em driver for Intel NIC Pro (82571) w/ FreeBSD 7.1 Beta 2 on HPDL 585 machine having 16CPUs. http://people.yandex-team.ru/~wawa/ With net.isr.direct=1, I made some changes on kthreads(default=2) for em0 and em1's rx. dev.em.0.rx_kthreads: 6 .... dev.em.1.rx_kthreads: 6 With these settings, the result is: CPU: 0.0% user, 0.0% nice, 57.2% system, 3.6% interrupt, 39.2% idle Mem: 17M Active, 7228K Inact, 156M Wired, 76K Cache, 21M Buf, 31G Free Swap: 4096M Total, 4096M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 52 root 1 43 - 0K 16K CPU12 c 41:38 100.00% em0_rx_kthread_1 51 root 1 43 - 0K 16K CPU3 3 41:38 100.00% em0_rx_kthread_0 54 root 1 -68 - 0K 16K CPU2 2 39:39 100.00% em1_txcleaner 1283 root 1 43 - 0K 16K CPU1 1 38:55 100.00% em0_rx_kthread_3 1282 root 1 43 - 0K 16K CPU10 a 38:55 100.00% em0_rx_kthread_2 1344 root 1 43 - 0K 16K CPU9 9 25:51 100.00% em0_rx_kthread_5 1343 root 1 43 - 0K 16K CPU4 4 25:51 100.00% em0_rx_kthread_4 12 root 1 171 ki31 0K 16K CPU14 e 44:28 91.70% idle: cpu14 11 root 1 171 ki31 0K 16K CPU15 f 35:18 76.86% idle: cpu15 19 root 1 171 ki31 0K 16K RUN 7 24:56 70.46% idle: cpu7 20 root 1 171 ki31 0K 16K CPU6 6 35:23 69.38% idle: cpu6 15 root 1 171 ki31 0K 16K CPU11 b 34:33 65.97% idle: cpu11 18 root 1 171 ki31 0K 16K CPU8 8 40:24 64.45% idle: cpu8 13 root 1 171 ki31 0K 16K CPU13 d 42:07 61.96% idle: cpu13 21 root 1 171 ki31 0K 16K CPU5 5 21:35 58.79% idle: cpu5 28 root 1 -32 - 0K 16K WAIT 8 33:23 57.08% swi4: clock sio 25 root 1 171 ki31 0K 16K RUN 1 18:13 50.00% idle: cpu1 1347 root 1 43 - 0K 16K WAIT 5 10:48 44.68% em1_rx_kthread_5 55 root 1 43 - 0K 16K RUN 0 18:46 43.65% em1_rx_kthread_0 56 root 1 43 - 0K 16K WAIT 6 18:50 42.97% em1_rx_kthread_1 1280 root 1 43 - 0K 16K WAIT d 16:59 41.46% em1_rx_kthread_3 1279 root 1 43 - 0K 16K WAIT 7 17:00 41.06% em1_rx_kthread_2 1346 root 1 43 - 0K 16K WAIT b 10:47 40.77% em1_rx_kthread_4 26 root 1 171 ki31 0K 16K RUN 0 19:38 10.79% idle: cpu0 50 root 1 -68 - 0K 16K WAIT f 1:41 3.86% em0_txcleaner 24 root 1 171 ki31 0K 16K RUN 2 30:28 0.00% idle: cpu2 16 root 1 171 ki31 0K 16K RUN a 29:39 0.00% idle: cpu10 17 root 1 171 ki31 0K 16K RUN 9 27:08 0.00% idle: cpu9 14 root 1 171 ki31 0K 16K RUN c 21:58 0.00% idle: cpu12 23 root 1 171 ki31 0K 16K RUN 3 11:36 0.00% idle: cpu3 22 root 1 171 ki31 0K 16K RUN 4 10:24 0.00% idle: cpu4 27 root 1 -44 - 0K 16K WAIT 2 3:04 0.00% swi1: net I am happy to see that more processors are now working, but the kthreads are consuming HIGH CPU utilizations. is there any other things that I can look into and set to minimize CPU utilization for the threads? thanks, won From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 13:34:53 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 00EE51065670 for ; Mon, 17 Nov 2008 13:34:53 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id B630D8FC14 for ; Mon, 17 Nov 2008 13:34:52 +0000 (UTC) (envelope-from des@des.no) Received: from ds4.des.no (des.no [84.49.246.2]) by smtp.des.no (Postfix) with ESMTP id B05946D43F for ; Mon, 17 Nov 2008 13:34:51 +0000 (UTC) Received: by ds4.des.no (Postfix, from userid 1001) id 9012C84490; Mon, 17 Nov 2008 14:34:51 +0100 (CET) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: FreeBSD Hackers References: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> <20081116100923.GU81783@hoeg.nl> <20081117113522.GA2732@debian.samsung.router> Date: Mon, 17 Nov 2008 14:34:51 +0100 In-Reply-To: <20081117113522.GA2732@debian.samsung.router> (Alexej Sokolov's message of "Mon, 17 Nov 2008 12:35:22 +0100") Message-ID: <868wri3284.fsf@ds4.des.no> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: KLD loading, liking X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 13:34:53 -0000 Alexej Sokolov writes: > Not only that. The use of the MODULE_DEPEND macro allows one module to > access the variables of modules on which it depends. No. Any module X can access any public variable or function in the kernel or in any other module Y, but loading X will fail if Y is not already loaded. The only effect of MODULE_DEPEND is to tell the loader that Y must be loaded before X. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@des.no From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 15:42:25 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C1AFC106564A for ; Mon, 17 Nov 2008 15:42:25 +0000 (UTC) (envelope-from murat@enderunix.org) Received: from istanbul.enderunix.org (freefall.marmara.edu.tr [193.140.143.23]) by mx1.freebsd.org (Postfix) with ESMTP id EAC068FC18 for ; Mon, 17 Nov 2008 15:42:24 +0000 (UTC) (envelope-from murat@enderunix.org) Received: (qmail 37680 invoked from network); 17 Nov 2008 15:14:12 -0000 Received: from unknown (HELO ?10.1.0.13?) (127.0.0.1) by 0 with SMTP; 17 Nov 2008 15:14:12 -0000 From: Murat Balaban To: freebsd-hackers@freebsd.org Organization: EnderUNIX SDT Date: Mon, 17 Nov 2008 17:14:21 +0200 Message-Id: <1226934861.6310.25.camel@efe> Mime-Version: 1.0 X-Mailer: Evolution 2.22.3.1 Content-Type: text/plain Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Giant lock, bce and uhc using the same irq X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 15:42:25 -0000 Hello hackers, In one of my production servers (64-bit Intel Xeon machine) running 6.3-RELEASE-p4 (amd64) FreeBSD 6.3-RELEASE-p4 #0: Fri Sep 12 17:07:19 EEST 2008 I see this "top -S" output excerpt: 32 root 1 -68 -187 0K 16K *Giant 0 48.3H 3.08% irq17: bce1 uhci1 What I get from above is that bce and uhc drivers both use irq17. I assume bce is SMPng'ed, and uhc is not. Does uhc being Giant locked, affect bce performance, because they use the same interrupt handler thread? -- Murat http://www.enderunix.org/murat/ From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 16:02:04 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 39E251065672 for ; Mon, 17 Nov 2008 16:02:04 +0000 (UTC) (envelope-from free.dvig@gmail.com) Received: from an-out-0708.google.com (an-out-0708.google.com [209.85.132.249]) by mx1.freebsd.org (Postfix) with ESMTP id DCD478FC21 for ; Mon, 17 Nov 2008 16:02:03 +0000 (UTC) (envelope-from free.dvig@gmail.com) Received: by an-out-0708.google.com with SMTP id b6so1039005ana.13 for ; Mon, 17 Nov 2008 08:02:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=3yDyPS44H7NvJiXgAfwfLLTavwqXj4kwAvjYa+Sg/kY=; b=tZbyXFDGP9UBdQH62vzNnGklRNJI+vzjocxNy0bu/KGCWp4+2kVhx4RbE//NoE1OO/ IwdzJHteTBugoZ7IBnowfYmTyeF2lLEzahk+mKQYCVxM5yvMpXf8GB5bVgkfWAKH/UUO GPYHNltR1hQsZEVs/bCHRubaT0BDAC70o2Zos= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=TN6CdlIvbuZeR6zgE/G4YHxbJyZirxuqxONY1w6KqyQSNFQHwfn9wU2CpQozlAh+xV Bq6+h8bycb8KT+EkA5lCDZThVDBMnxbWSwwuY/iGFZgDDomraTo6Xx3bByG9zLxGm99R WDuGyoV+v4trng86haFHu0LV+Slyp4Wy2O80c= Received: by 10.142.162.5 with SMTP id k5mr2029222wfe.287.1226936141694; Mon, 17 Nov 2008 07:35:41 -0800 (PST) Received: by 10.143.141.2 with HTTP; Mon, 17 Nov 2008 07:35:41 -0800 (PST) Message-ID: <65f70ae30811170735i60891633ja0791f3d73cee188@mail.gmail.com> Date: Mon, 17 Nov 2008 20:35:41 +0500 From: "Aleksandr Litvinov" To: "Alexej Sokolov" , "FreeBSD Hackers" In-Reply-To: <20081117113522.GA2732@debian.samsung.router> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> <20081116100923.GU81783@hoeg.nl> <20081117113522.GA2732@debian.samsung.router> Cc: Subject: =?koi8-r?b?79TXxdQ6IEtMRCBsb2FkaW5nLCBsaWtpbmc=?= X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 16:02:04 -0000 2008/11/17, Alexej Sokolov : > On Sun, Nov 16, 2008 at 11:09:00AM +0100, Ed Schouten wrote: >> * Alexej Sokolov wrote: > >> > What exact does the macro MODULE_DEPEND ? The man page is to short, and >> > I >> > guess it tell no all things that the macro does. >> >> MODULE_DEPEND is used to say: this kernel module also depends on another >> module (i.e. the USB printer module depends on the USB code). Tools like >> kldload can then automatically load the missing modules. > Not only that. The use of the MODULE_DEPEND macro allows one module to > access > the variables of modules on which it depends. But man page of > MODULE_DEPEND doesn't tell anything about this functionality. Hence I > am looking for any good documentation of KLD loader. But I didn't find > anything. May be looking in the source code is the best solution. > >> >> -- >> Ed Schouten >> WWW: http://80386.nl/ > > > > -- > Alexej Sokolov > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > Hello, You can receive a little information about KLD from the book "designing BSD rootkits". -- -- Good Luck. -- Litvinov Aleksandr. From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 17:12:50 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: by hub.freebsd.org (Postfix, from userid 758) id 150681065674; Mon, 17 Nov 2008 17:12:50 +0000 (UTC) Date: Mon, 17 Nov 2008 17:12:50 +0000 From: Kris Kennaway To: Murat Balaban Message-ID: <20081117171250.GA43367@hub.freebsd.org> References: <1226934861.6310.25.camel@efe> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1226934861.6310.25.camel@efe> User-Agent: Mutt/1.4.2.1i Cc: freebsd-hackers@freebsd.org Subject: Re: Giant lock, bce and uhc using the same irq X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 17:12:50 -0000 On Mon, Nov 17, 2008 at 05:14:21PM +0200, Murat Balaban wrote: > Hello hackers, > > In one of my production servers (64-bit Intel Xeon machine) running > > 6.3-RELEASE-p4 (amd64) FreeBSD 6.3-RELEASE-p4 #0: Fri Sep 12 17:07:19 > EEST 2008 > > I see this "top -S" output excerpt: > > 32 root 1 -68 -187 0K 16K *Giant 0 48.3H 3.08% irq17: > bce1 uhci1 > > What I get from above is that bce and uhc drivers both use irq17. I > assume > bce is SMPng'ed, and uhc is not. > > Does uhc being Giant locked, affect bce performance, because they use > the same > interrupt handler thread? bce will not need to acquire Giant at all so they will not fight for the lock. However both of them will have to wake up to check each interrupt so there is some time spent there. Also if you have some other workload on the system that is still heavily dependent onGiant (e.g. MSDOSFS, etc) then that will interfere with uhci while interrupts are coming in. Kris P.S. In 8.0 there is a new USB stack that is Giant-free. -- In God we Trust -- all others must submit an X.509 certificate. -- Charles Forsythe From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 17:47:24 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 554611065673 for ; Mon, 17 Nov 2008 17:47:24 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id 30F4B8FC16 for ; Mon, 17 Nov 2008 17:47:24 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1226944041-1bfc00000000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id AE85B2F0B7 for ; Mon, 17 Nov 2008 09:47:21 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id hk140s3Z6wODw6lb for ; Mon, 17 Nov 2008 09:47:21 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: RE: How can I add new binaries to the mfsroot image? Date: Mon, 17 Nov 2008 09:47:20 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F23B505B@polaris.maxiscale.com> In-Reply-To: <20081117130855.d845d507.stas@FreeBSD.org> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How can I add new binaries to the mfsroot image? Thread-Index: AclInJLN9UVMXIw1RAOkNcvb/JCjzwAP40ww References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> <20081117130855.d845d507.stas@FreeBSD.org> From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1226944041 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Subject: RE: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 17:47:24 -0000 >I'm not sure, but probably the installation CD doesn't carry shared libraries at all? All binaries in /stand are >static-linked ones. Yeah, that is absolutely the problem--no shared libraries are available when sysinstall is running.=20 >You could also try scripts from mfsbsd project: >http://people.freebsd.org/~mm/mfsbsd/ > >These works for me fine for building custom installation CDs. I'll have to check this out. I'm not getting anywhere with trying to customize mfsroot with my current approach... From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 17:52:37 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E37D61065678 for ; Mon, 17 Nov 2008 17:52:37 +0000 (UTC) (envelope-from arhimed@gmx.net) Received: from mail.gmx.net (mail.gmx.net [213.165.64.20]) by mx1.freebsd.org (Postfix) with SMTP id 86A068FC22 for ; Mon, 17 Nov 2008 17:52:35 +0000 (UTC) (envelope-from arhimed@gmx.net) Received: (qmail invoked by alias); 17 Nov 2008 17:25:51 -0000 Received: from BAD92f2.bad.pppool.de (EHLO localhost) [77.131.146.242] by mail.gmx.net (mp027) with SMTP; 17 Nov 2008 18:25:51 +0100 X-Authenticated: #18080636 X-Provags-ID: V01U2FsdGVkX18mFGgdyn4mKIOlUMLqnIEJn74EU5ZKpodA46xyVA G2pNhyiXV3vuI5 Date: Mon, 17 Nov 2008 18:25:24 +0100 From: Alexandre Fiveg To: freebsd-hackers@freebsd.org Message-ID: <20081117172524.GC2732@debian.samsung.router> Mail-Followup-To: freebsd-hackers@freebsd.org References: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> <20081116100923.GU81783@hoeg.nl> <20081117113522.GA2732@debian.samsung.router> <868wri3284.fsf@ds4.des.no> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <868wri3284.fsf@ds4.des.no> User-Agent: Mutt/1.5.18 (2008-05-17) X-Y-GMX-Trusted: 0 X-FuHaFi: 0.5600000000000001 X-Mailman-Approved-At: Mon, 17 Nov 2008 18:00:01 +0000 Subject: Re: KLD loading, liking X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Alexandre Fiveg List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 17:52:38 -0000 On Mon, Nov 17, 2008 at 02:34:28PM +0100, Dag-Erling Smørgrav wrote: > Alexej Sokolov writes: > > Not only that. The use of the MODULE_DEPEND macro allows one module to > > access the variables of modules on which it depends. > > No. Any module X can access any public variable or function in the > kernel or in any other module Y, but loading X will fail if Y is not > already loaded. The only effect of MODULE_DEPEND is to tell the loader > that Y must be loaded before X. No, Example: two modules kld.c and kld1.1: kld: http://pastebin.com/m67799565 Makefile: http://pastebin.com/m5418e5a7 kld1: http://pastebin.com/d154e8474 Makefile: http://pastebin.com/m79723138 In kld is public int var_from_kld declared. To access this variable from kld1 you have to uncomment macro MODULE_DEPEND My system: % uname -v FreeBSD 7.0-RELEASE-p5 #0: Tue Oct 7 19:05:20 CEST 2008 Tell me please if I do something wrong! Thanx > > DES > -- > Dag-Erling Smørgrav - des@des.no > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" -- Alexandre Fiveg Key fingerprint = 0B23 EB52 3944 E440 CFF3 C1F1 7D05 8D00 34F7 A6BD From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 20:44:08 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EB12C106564A for ; Mon, 17 Nov 2008 20:44:08 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: from palm.hoeg.nl (unknown [IPv6:2001:7b8:613:100::211]) by mx1.freebsd.org (Postfix) with ESMTP id 856458FC14 for ; Mon, 17 Nov 2008 20:44:08 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: by palm.hoeg.nl (Postfix, from userid 1000) id 12AF01CCEC; Mon, 17 Nov 2008 21:44:07 +0100 (CET) Date: Mon, 17 Nov 2008 21:44:07 +0100 From: Ed Schouten To: Aleksandr Litvinov Message-ID: <20081117204407.GY81783@hoeg.nl> References: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> <20081116100923.GU81783@hoeg.nl> <20081117113522.GA2732@debian.samsung.router> <65f70ae30811170735i60891633ja0791f3d73cee188@mail.gmail.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qZTZQd/MRfnLEAAX" Content-Disposition: inline In-Reply-To: <65f70ae30811170735i60891633ja0791f3d73cee188@mail.gmail.com> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Alexej Sokolov , FreeBSD Hackers Subject: Re: =?utf-8?b?0J7RgtCy0LXRgjo=?= KLD loading, liking X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 20:44:09 -0000 --qZTZQd/MRfnLEAAX Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Aleksandr Litvinov wrote: > Hello, > You can receive a little information about KLD from the book > "designing BSD rootkits". I don't own this book myself, but a colleague at Snow B.V. once showed it to me. I only looked through it a couple of minutes, but it seemed like a book nice to have. It also shows some techniques on how to hide KLD's. --=20 Ed Schouten WWW: http://80386.nl/ --qZTZQd/MRfnLEAAX Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkkh15cACgkQ52SDGA2eCwW4zgCbBvZFWq4H7XsZWqWhgF2ssZVA O30AnRMCszOeEtS0+DjhrexXICz2p+S5 =nfZY -----END PGP SIGNATURE----- --qZTZQd/MRfnLEAAX-- From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 20:48:03 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 624001065672; Mon, 17 Nov 2008 20:48:03 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: from palm.hoeg.nl (unknown [IPv6:2001:7b8:613:100::211]) by mx1.freebsd.org (Postfix) with ESMTP id 25F3E8FC1F; Mon, 17 Nov 2008 20:48:03 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: by palm.hoeg.nl (Postfix, from userid 1000) id 8AA551CCEC; Mon, 17 Nov 2008 21:48:02 +0100 (CET) Date: Mon, 17 Nov 2008 21:48:02 +0100 From: Ed Schouten To: Kris Kennaway Message-ID: <20081117204802.GZ81783@hoeg.nl> References: <1226934861.6310.25.camel@efe> <20081117171250.GA43367@hub.freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="2VOk7s3pVsDYAazo" Content-Disposition: inline In-Reply-To: <20081117171250.GA43367@hub.freebsd.org> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Murat Balaban , FreeBSD Hackers Subject: Re: Giant lock, bce and uhc using the same irq X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 20:48:03 -0000 --2VOk7s3pVsDYAazo Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Kris Kennaway wrote: > P.S. In 8.0 there is a new USB stack that is Giant-free. I'm not sure this is completely true. Maybe HPS could explain it in more detail, but Giant still seems to be used pretty often. --=20 Ed Schouten WWW: http://80386.nl/ --2VOk7s3pVsDYAazo Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkkh2IIACgkQ52SDGA2eCwWIjgCfQj1bnDx7TwrcfmYyIJKZV+TE oOIAn3pcueCzb2xrbb0V1pdEJchfr0lF =HDmt -----END PGP SIGNATURE----- --2VOk7s3pVsDYAazo-- From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 21:21:43 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7F642106564A for ; Mon, 17 Nov 2008 21:21:43 +0000 (UTC) (envelope-from hselasky@c2i.net) Received: from swip.net (mailfe04.swip.net [212.247.154.97]) by mx1.freebsd.org (Postfix) with ESMTP id DDD158FC16 for ; Mon, 17 Nov 2008 21:21:42 +0000 (UTC) (envelope-from hselasky@c2i.net) X-Cloudmark-Score: 0.000000 [] X-Cloudmark-Analysis: v=1.0 c=1 a=CmCrj1Lm9Q4A:10 a=gBvLJ3r9iE8A:10 a=aniA1o7mVp4QawOfT9qHqA==:17 a=L_kApNG8BjtEhqcw1QIA:9 a=_p1DzmURR115e9XFP7501RW2fMIA:4 a=SV7veod9ZcQA:10 a=LY0hPdMaydYA:10 Received: from [62.113.133.1] (account mc467741@c2i.net [62.113.133.1] verified) by mailfe04.swip.net (CommuniGate Pro SMTP 5.2.6) with ESMTPA id 1150625421; Mon, 17 Nov 2008 22:21:40 +0100 From: Hans Petter Selasky To: freebsd-hackers@freebsd.org Date: Mon, 17 Nov 2008 22:23:49 +0100 User-Agent: KMail/1.9.7 References: <1226934861.6310.25.camel@efe> <20081117171250.GA43367@hub.freebsd.org> <20081117204802.GZ81783@hoeg.nl> In-Reply-To: <20081117204802.GZ81783@hoeg.nl> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811172223.51209.hselasky@c2i.net> Cc: Murat Balaban , Ed Schouten Subject: Re: Giant lock, bce and uhc using the same irq X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 21:21:43 -0000 On Monday 17 November 2008, Ed Schouten wrote: > * Kris Kennaway wrote: > > P.S. In 8.0 there is a new USB stack that is Giant-free. > > I'm not sure this is completely true. Maybe HPS could explain it in more > detail, but Giant still seems to be used pretty often. All the interrupt handlers of the Host- and Device-controller drivers are free from locking Giant when executing. --HPS From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 21:25:04 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 950881065742 for ; Mon, 17 Nov 2008 21:25:04 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 16F278FC0A for ; Mon, 17 Nov 2008 21:25:04 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from root by ciao.gmane.org with local (Exim 4.43) id 1L2Bah-0007AH-28 for freebsd-hackers@freebsd.org; Mon, 17 Nov 2008 21:25:03 +0000 Received: from 93-138-105-237.adsl.net.t-com.hr ([93.138.105.237]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 17 Nov 2008 21:25:03 +0000 Received: from ivoras by 93-138-105-237.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 17 Nov 2008 21:25:03 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Ivan Voras Date: Mon, 17 Nov 2008 22:21:04 +0100 Lines: 63 Message-ID: References: <245613.95922.qm@web45809.mail.sp1.yahoo.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig9BF5AB28FF0506B8B20112D3" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 93-138-105-237.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) In-Reply-To: <245613.95922.qm@web45809.mail.sp1.yahoo.com> X-Enigmail-Version: 0.95.7 Sender: news Subject: Re: NET.ISR and CPU utilization performance w/ HP DL 585 using FreeBSD 7.1 Beta2 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 21:25:04 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig9BF5AB28FF0506B8B20112D3 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Won De Erick wrote: > I compiled the following em driver for Intel NIC Pro (82571) w/ FreeBSD= 7.1 Beta 2 on HPDL 585 machine having 16CPUs. >=20 > http://people.yandex-team.ru/~wawa/ >=20 > With net.isr.direct=3D1, I made some changes on kthreads(default=3D2) f= or em0 and em1's rx. >=20 > dev.em.0.rx_kthreads: 6 > .... > dev.em.1.rx_kthreads: 6 >=20 > With these settings, the result is: >=20 > CPU: 0.0% user, 0.0% nice, 57.2% system, 3.6% interrupt, 39.2% idle > Mem: 17M Active, 7228K Inact, 156M Wired, 76K Cache, 21M Buf, 31G Free > Swap: 4096M Total, 4096M Free >=20 > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMA= ND > 52 root 1 43 - 0K 16K CPU12 c 41:38 100.00% em0_= rx_kthread_1 > 51 root 1 43 - 0K 16K CPU3 3 41:38 100.00% em0_= rx_kthread_0 > 54 root 1 -68 - 0K 16K CPU2 2 39:39 100.00% em1_= txcleaner > 1283 root 1 43 - 0K 16K CPU1 1 38:55 100.00% em0_= rx_kthread_3 > 1282 root 1 43 - 0K 16K CPU10 a 38:55 100.00% em0_= rx_kthread_2 > 1344 root 1 43 - 0K 16K CPU9 9 25:51 100.00% em0_= rx_kthread_5 > 1343 root 1 43 - 0K 16K CPU4 4 25:51 100.00% em0_= rx_kthread_4 > 12 root 1 171 ki31 0K 16K CPU14 e 44:28 91.70% idle:= cpu14 This is very interesting. Do you see real performance (network throughput) increase? --------------enig9BF5AB28FF0506B8B20112D3 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkkh4EAACgkQldnAQVacBcjqYwCeNzzW4z8+q90S5Sfa4eJBLGkY DwEAnRragJk7hbt9XffwFfxjQtvBBerv =PBXc -----END PGP SIGNATURE----- --------------enig9BF5AB28FF0506B8B20112D3-- From owner-freebsd-hackers@FreeBSD.ORG Mon Nov 17 23:56:54 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 57BAC1065672 for ; Mon, 17 Nov 2008 23:56:54 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id 2F5A08FC1A for ; Mon, 17 Nov 2008 23:56:54 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1226966187-763100010000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id B1EBD2FA13 for ; Mon, 17 Nov 2008 15:56:27 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id fV7ioubbhAbh6GQs for ; Mon, 17 Nov 2008 15:56:27 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: RE: How can I add new binaries to the mfsroot image? Date: Mon, 17 Nov 2008 15:56:26 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> In-Reply-To: <2ACA3DE8F9758A48B8BE2C7A847F91F23B505B@polaris.maxiscale.com> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How can I add new binaries to the mfsroot image? Thread-Index: AclInJLN9UVMXIw1RAOkNcvb/JCjzwAP40wwAAyNpPA= References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com><20081117130855.d845d507.stas@FreeBSD.org> <2ACA3DE8F9758A48B8BE2C7A847F91F23B505B@polaris.maxiscale.com> From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1226966188 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Subject: RE: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Nov 2008 23:56:54 -0000 >I'll have to check this out. I'm not getting anywhere with trying to >customize mfsroot with my current approach... The goal we are trying to achieve btw is to make gmirror available during an install so that the file systems are mirrored right from the get-go, so that we can avoid having to go through the process of converting a system as a post operation. The standard slicing/partition commands of sysinstall do support the creation of a mirrored file system though, so our idea was to run a script via install.cfg to take care of fdisk/bsdlabel/gmirror phase, and then install the packages in the normal fashion via subsequent steps in install.cfg. Is this something that can be done via sysinstall? If not, what's the best alternative? This whole process is targeted to be on a PXE boot server so we can configure our systems in a completely automated hands-off manner. We have 200+ FreeBSD systems and we definitely need an automated process. We already have it working fine, but without mirroring. We can upgrade doezens of systems at a time simply by making them boot from our PXE server. We now need to tweak this process so that we can establish the mirrored file systems as part of the automated install. From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 01:45:17 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 441D9106564A for ; Tue, 18 Nov 2008 01:45:17 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id 1B7768FC18 for ; Tue, 18 Nov 2008 01:45:17 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1226972702-377000010000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id 756882F8B7 for ; Mon, 17 Nov 2008 17:45:02 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id mFMmHivsp3XGFAmN for ; Mon, 17 Nov 2008 17:45:02 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: RE: How can I add new binaries to the mfsroot image? Date: Mon, 17 Nov 2008 17:44:59 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F240C8F6@polaris.maxiscale.com> In-Reply-To: <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How can I add new binaries to the mfsroot image? Thread-Index: AclInJLN9UVMXIw1RAOkNcvb/JCjzwAP40wwAAyNpPAABDRPkA== References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com><20081117130855.d845d507.stas@FreeBSD.org><2ACA3DE8F9758A48B8BE2C7A847F91F23B505B@polaris.maxiscale.com> <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> From: "Peter Steele" To: "Peter Steele" , X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1226972702 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Cc: Subject: RE: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 01:45:17 -0000 >I'll have to check this out. I'm not getting anywhere with trying to >customize mfsroot with my current approach... The goal we are trying to achieve btw is to make gmirror available during an install so that the file systems are mirrored right from the get-go, so that we can avoid having to go through the process of converting a system as a post operation. The standard slicing/partition commands of sysinstall do *not* support the creation of a mirrored file system though, so our idea was to run a script via install.cfg to take care of fdisk/bsdlabel/gmirror phase, and then install the packages in the normal fashion via subsequent steps in install.cfg. Is this something that can be done via sysinstall? If not, what's the best alternative? This whole process is targeted to be on a PXE boot server so we can configure our systems in a completely automated hands-off manner. We have 200+ FreeBSD systems and we definitely need an automated process. We already have it working fine, but without mirroring. We can upgrade doezens of systems at a time simply by making them boot from our PXE server. We now need to tweak this process so that we can establish the mirrored file systems as part of the automated install. From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 00:45:43 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 50C991065674 for ; Tue, 18 Nov 2008 00:45:43 +0000 (UTC) (envelope-from won.derick@yahoo.com) Received: from n55.bullet.mail.sp1.yahoo.com (n55.bullet.mail.sp1.yahoo.com [98.136.44.188]) by mx1.freebsd.org (Postfix) with SMTP id 2E9E18FC17 for ; Tue, 18 Nov 2008 00:45:42 +0000 (UTC) (envelope-from won.derick@yahoo.com) Received: from [69.147.65.148] by n55.bullet.mail.sp1.yahoo.com with NNFMP; 18 Nov 2008 00:45:42 -0000 Received: from [69.147.84.123] by t11.bullet.mail.sp1.yahoo.com with NNFMP; 18 Nov 2008 00:45:42 -0000 Received: from [127.0.0.1] by omp209.mail.sp1.yahoo.com with NNFMP; 18 Nov 2008 00:45:42 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 807172.20181.bm@omp209.mail.sp1.yahoo.com Received: (qmail 27144 invoked by uid 60001); 18 Nov 2008 00:45:42 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:MIME-Version:Content-Type:Message-ID; b=xURvVOcyWOufgW9rA0zsTLoilMkqZq4Wer4QjIn0YzHQy5uNPRlfeOUHN0Sd3cIodrZcgEJDVoWvPa/lEOcGatRaH5m3zDMyzZAgCPXBIzhK/C/3sJWULSDlc9H3FWbgz2FhAcZSUZuPyUty2DbM+uIqapr1z9f2BIoGiyhMkkM=; X-YMail-OSG: ZRHODTIVM1mC56W7hU5Q9EIL8TT68rf6lzm8eccBFkwcffkOs3FAHF4e_4u_gQraYAqupd8xWG7yWJ97V15dTL7Pq0jKn0LpeFQ9lBiMNbhETsDi2gO8RLnnK2dGtsli0hzisJD8bs0UHSKjJLrQ5jzmc.Y- Received: from [58.71.34.137] by web45805.mail.sp1.yahoo.com via HTTP; Mon, 17 Nov 2008 16:45:42 PST X-Mailer: YahooMailRC/1155.29 YahooMailWebService/0.7.260.1 References: <245613.95922.qm@web45809.mail.sp1.yahoo.com> Date: Mon, 17 Nov 2008 16:45:42 -0800 (PST) From: Won De Erick To: Ivan Voras , freebsd-hackers@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Message-ID: <718671.27101.qm@web45805.mail.sp1.yahoo.com> X-Mailman-Approved-At: Tue, 18 Nov 2008 02:49:52 +0000 Cc: Subject: Re: NET.ISR and CPU utilization performance w/ HP DL 585 using FreeBSD 7.1 Beta2 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 00:45:43 -0000 > ----- Original Message ---- > From: Ivan Voras > To: freebsd-hackers@freebsd.org > Sent: Tuesday, November 18, 2008 5:21:04 AM > Subject: Re: NET.ISR and CPU utilization performance w/ HP DL 585 using FreeBSD 7.1 Beta2 > > Won De Erick wrote: > > > I compiled the following em driver for Intel NIC Pro (82571) w/ FreeBSD 7.1 Beta 2 on HPDL 585 machine having 16CPUs. > > > > http://people.yandex-team.ru/~wawa/ > > > > With net.isr.direct=1, I made some changes on kthreads(default=2) for em0 and em1's rx. > > > > dev.em.0.rx_kthreads: 6 > > .... > > dev.em.1.rx_kthreads: 6 > > > > With these settings, the result is: > > > > CPU: 0.0% user, 0.0% nice, 57.2% system, 3.6% interrupt, 39.2% idle > > Mem: 17M Active, 7228K Inact, 156M Wired, 76K Cache, 21M Buf, 31G Free > > Swap: 4096M Total, 4096M Free > > > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > > 52 root 1 43 - 0K 16K CPU12 c 41:38 100.00% em0_rx_kthread_1 > > 51 root 1 43 - 0K 16K CPU3 3 41:38 100.00% em0_rx_kthread_0 > > 54 root 1 -68 - 0K 16K CPU2 2 39:39 100.00% em1_txcleaner > > 1283 root 1 43 - 0K 16K CPU1 1 38:55 100.00% em0_rx_kthread_3 > > 1282 root 1 43 - 0K 16K CPU10 a 38:55 100.00% em0_rx_kthread_2 > > 1344 root 1 43 - 0K 16K CPU9 9 25:51 100.00% em0_rx_kthread_5 > > 1343 root 1 43 - 0K 16K CPU4 4 25:51 100.00% em0_rx_kthread_4 > > 12 root 1 171 ki31 0K 16K CPU14 e 44:28 91.70% idle: cpu14 > > This is very interesting. Do you see real performance (network > throughput) increase? > There's a little improvement on the throughput, but packet errors occurred on both interfaces. # netstat -I em1 -w 1 -d input (em1) output packets errs bytes packets errs bytes colls drops 32494 483 23083087 15681 0 23719154 0 82 30547 330 23104447 16062 0 23077442 0 44 # netstat -I em0 -w 1 -d input (em0) output packets errs bytes packets errs bytes colls drops 19889 640 24144754 21307 0 8719922 0 0 18071 2436 25966238 21088 0 8766995 0 0 Is there any other thing that I can tweak to solve the problem? From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 10:41:08 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 71987106567C for ; Tue, 18 Nov 2008 10:41:08 +0000 (UTC) (envelope-from doconnor@gsoft.com.au) Received: from cain.gsoft.com.au (cain.gsoft.com.au [203.31.81.10]) by mx1.freebsd.org (Postfix) with ESMTP id B2D388FC16 for ; Tue, 18 Nov 2008 10:41:07 +0000 (UTC) (envelope-from doconnor@gsoft.com.au) Received: from inchoate.dons.net.au (ppp121-45-30-187.lns10.adl2.internode.on.net [121.45.30.187]) (authenticated bits=0) by cain.gsoft.com.au (8.13.8/8.13.8) with ESMTP id mAIAf2u4005224 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 18 Nov 2008 21:11:03 +1030 (CST) (envelope-from doconnor@gsoft.com.au) From: "Daniel O'Connor" To: freebsd-hackers@freebsd.org Date: Tue, 18 Nov 2008 21:11:01 +1030 User-Agent: KMail/1.9.10 References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> <2ACA3DE8F9758A48B8BE2C7A847F91F23B505B@polaris.maxiscale.com> <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> In-Reply-To: <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart1794671.2V6Ung58dz"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200811182111.02367.doconnor@gsoft.com.au> X-Spam-Score: -2.212 () BAYES_00,RDNS_DYNAMIC X-Scanned-By: MIMEDefang 2.63 on 203.31.81.10 Cc: Peter Steele Subject: Re: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 10:41:08 -0000 --nextPart1794671.2V6Ung58dz Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline On Tuesday 18 November 2008 10:26:26 Peter Steele wrote: > Is this something that can be done via sysinstall? If not, what's the > best alternative? This whole process is targeted to be on a PXE boot > server so we can configure our systems in a completely automated > hands-off manner. We have 200+ FreeBSD systems and we definitely need an > automated process. We already have it working fine, but without > mirroring. We can upgrade doezens of systems at a time simply by making > them boot from our PXE server. We now need to tweak this process so that > we can establish the mirrored file systems as part of the automated > install. I believe you modify /usr/src/release/${ARCH}/boot_crunch.conf to do this. I haven't actually tried though... I think it would be possible to have a 'GEOM' menu that you can run prior t= o=20 fdisk, label, etc that would allow you to do some basic stuff like this. While the sysinstall code is a bit fugly it's not that difficult to hack on= =20 (speaking from limited experience :) =2D-=20 Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C --nextPart1794671.2V6Ung58dz Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQBJIpu+5ZPcIHs/zowRApDeAJ4x3xNOLUf/33N0aGta0ULeiz+mrACggSuU nweLMjr2TvtUoDxRqgljoUw= =+jMU -----END PGP SIGNATURE----- --nextPart1794671.2V6Ung58dz-- From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 08:57:46 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2F3381065672 for ; Tue, 18 Nov 2008 08:57:46 +0000 (UTC) (envelope-from mail25@bzerk.org) Received: from ei.bzerk.org (tunnel490.ipv6.xs4all.nl [IPv6:2001:888:10:1ea::2]) by mx1.freebsd.org (Postfix) with ESMTP id 950F08FC19 for ; Tue, 18 Nov 2008 08:57:45 +0000 (UTC) (envelope-from mail25@bzerk.org) Received: from ei.bzerk.org (BOFH@localhost [127.0.0.1]) by ei.bzerk.org (8.14.2/8.14.2) with ESMTP id mAI8vdlm095286; Tue, 18 Nov 2008 09:57:39 +0100 (CET) (envelope-from mail25@bzerk.org) Received: (from bulk@localhost) by ei.bzerk.org (8.14.2/8.14.2/Submit) id mAI8vdam095285; Tue, 18 Nov 2008 09:57:39 +0100 (CET) (envelope-from mail25@bzerk.org) Date: Tue, 18 Nov 2008 09:57:39 +0100 From: Ruben de Groot To: Peter Steele Message-ID: <20081118085739.GA95079@ei.bzerk.org> Mail-Followup-To: Ruben de Groot , Peter Steele , freebsd-hackers@freebsd.org References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B505B@polaris.maxiscale.com> <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> User-Agent: Mutt/1.4.2.3i X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ei.bzerk.org X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-3.0 (ei.bzerk.org [127.0.0.1]); Tue, 18 Nov 2008 09:57:43 +0100 (CET) X-Mailman-Approved-At: Tue, 18 Nov 2008 12:42:24 +0000 Cc: freebsd-hackers@freebsd.org Subject: Re: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 08:57:46 -0000 On Mon, Nov 17, 2008 at 03:56:26PM -0800, Peter Steele typed: > >I'll have to check this out. I'm not getting anywhere with trying to > >customize mfsroot with my current approach... > > The goal we are trying to achieve btw is to make gmirror available > during an install so that the file systems are mirrored right from the > get-go, so that we can avoid having to go through the process of > converting a system as a post operation. The standard slicing/partition > commands of sysinstall do support the creation of a mirrored file system > though, so our idea was to run a script via install.cfg to take care of > fdisk/bsdlabel/gmirror phase, and then install the packages in the > normal fashion via subsequent steps in install.cfg. > > Is this something that can be done via sysinstall? If not, what's the > best alternative? This whole process is targeted to be on a PXE boot > server so we can configure our systems in a completely automated > hands-off manner. We have 200+ FreeBSD systems and we definitely need an > automated process. We already have it working fine, but without > mirroring. We can upgrade doezens of systems at a time simply by making > them boot from our PXE server. We now need to tweak this process so that > we can establish the mirrored file systems as part of the automated > install. What I've done in the past is skip sysinstall alltogether and just boot of an NFS root. Then use custom scripts for the slicing/partitioning/ mirroring, copy a minimal system to disk and pkg_add the rest. Would be nice to do all this with install.cfg though. Please let me know when you get this working. Ruben From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 13:30:13 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D20F31065672 for ; Tue, 18 Nov 2008 13:30:13 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.187]) by mx1.freebsd.org (Postfix) with ESMTP id 5D19F8FC08 for ; Tue, 18 Nov 2008 13:30:13 +0000 (UTC) (envelope-from bsd.quest@googlemail.com) Received: by nf-out-0910.google.com with SMTP id h3so1923453nfh.33 for ; Tue, 18 Nov 2008 05:30:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:subject :message-id:reply-to:mail-followup-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=Hpfkqm9pGW7MfxtVk+crpHmEh9qSA6PxRGi2L4eWDgA=; b=V2icXT2AVGpUeIjar7cggbRzlt0N8ZkyexOYzgBmL5JKxe0sNDnJarPc3kZa+IxmAl 4Gey5PN5LAY1vUUDoCXpCmSBrunS+mJIDVcKFudx0lUb6lZO8ms6V2J5lU4aAaa/x3a6 bftLPqvrKsAdp1zC3yIO7ehubeBKuMnLL5fkU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=date:from:to:subject:message-id:reply-to:mail-followup-to :references:mime-version:content-type:content-disposition :in-reply-to:user-agent; b=f1uxCd1yDgjxy0TEP3no9ylKcL+B8jawbEP8fEY4vRJrjNCWh9DUvTCKbNlWRP4JxX 2Y8HdMYGk0xs3aBC3VQhaLI38kMgj9K5Bpz76J9EVNhU3z2D9VkOLD0WphEHugu56bNd 8dTKcmjkqiWiKShKHGDPa1OcBNbyxooVO1jpg= Received: by 10.86.80.5 with SMTP id d5mr2898111fgb.47.1227015011337; Tue, 18 Nov 2008 05:30:11 -0800 (PST) Received: from localhost (BADc378.bad.pppool.de [77.131.195.120]) by mx.google.com with ESMTPS id d4sm4854277fga.5.2008.11.18.05.30.09 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 18 Nov 2008 05:30:10 -0800 (PST) Date: Tue, 18 Nov 2008 14:29:44 +0100 From: Alexej Sokolov To: FreeBSD Hackers Message-ID: <20081118132944.GA2967@debian.samsung.router> Mail-Followup-To: FreeBSD Hackers References: <671bb5fc0811151927j6dcb5155oeffbf4cc95cbccb6@mail.gmail.com> <20081116100923.GU81783@hoeg.nl> <20081117113522.GA2732@debian.samsung.router> <65f70ae30811170735i60891633ja0791f3d73cee188@mail.gmail.com> <20081117204407.GY81783@hoeg.nl> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <20081117204407.GY81783@hoeg.nl> User-Agent: Mutt/1.5.18 (2008-05-17) Subject: Re: =?utf-8?b?0J7RgtCy0LXRgjo=?= KLD loading, liking X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Alexej Sokolov List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 13:30:13 -0000 On Mon, Nov 17, 2008 at 09:43:44PM +0100, Ed Schouten wrote: > * Aleksandr Litvinov wrote: > > Hello, > > You can receive a little information about KLD from the book > > "designing BSD rootkits". > > I don't own this book myself, but a colleague at Snow B.V. once showed > it to me. I only looked through it a couple of minutes, but it seemed > like a book nice to have. It also shows some techniques on how to hide > KLD's. I have this book. It shows some techniques, but it doesn't explain many things. And for KLD loading it gives only easy examples without explaining how KLD-Loader works. It's not absolutely necessary to bye this book. There are some papers, which explain the topics of the book very well: 1. Fun and Games with FreeBSD Kernel Modules http://www.r4k.net/mod/fbsdfun.html 2. Attacking FreeBSD with Kernel Modules: http://packetstormsecurity.org/papers/unix/bsdkern.htm > > -- > Ed Schouten > WWW: http://80386.nl/ -- Alexej Sokolov From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 15:55:33 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7AF031065673 for ; Tue, 18 Nov 2008 15:55:33 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id 5A6F68FC24 for ; Tue, 18 Nov 2008 15:55:33 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1227023713-2ad900000000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id 1AF5D2FCD0 for ; Tue, 18 Nov 2008 07:55:13 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id yoVsZfsjPqgAaBDH for ; Tue, 18 Nov 2008 07:55:13 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: RE: How can I add new binaries to the mfsroot image? Date: Tue, 18 Nov 2008 07:55:12 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F240C920@polaris.maxiscale.com> In-Reply-To: <200811182111.02367.doconnor@gsoft.com.au> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How can I add new binaries to the mfsroot image? Thread-Index: AclJakbwz4VfK68pScOV6AGR9fkjewAK2bEw References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> <2ACA3DE8F9758A48B8BE2C7A847F91F23B505B@polaris.maxiscale.com> <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> <200811182111.02367.doconnor@gsoft.com.au> From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1227023723 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Subject: RE: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 15:55:33 -0000 >I believe you modify /usr/src/release/${ARCH}/boot_crunch.conf to do this. > >I haven't actually tried though... > >I think it would be possible to have a 'GEOM' menu that you can run prior to fdisk, label, etc that would allow you to >do some basic stuff like this. > >While the sysinstall code is a bit fugly it's not that difficult to hack on (speaking from limited experience :) Hmmm. I hadn't planned on actually creating a custom sysinstall but I guess that's another way we could approach this. I have some research to do... From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 16:00:25 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 208141065674 for ; Tue, 18 Nov 2008 16:00:25 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id 005BF8FC1C for ; Tue, 18 Nov 2008 16:00:24 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1227024002-2b1000000000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id 5C9052FCAF for ; Tue, 18 Nov 2008 08:00:03 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id gzAWhRjfufX6uSZD for ; Tue, 18 Nov 2008 08:00:02 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: RE: How can I add new binaries to the mfsroot image? Date: Tue, 18 Nov 2008 08:00:02 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F240C922@polaris.maxiscale.com> In-Reply-To: <20081118085739.GA95079@ei.bzerk.org> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How can I add new binaries to the mfsroot image? Thread-Index: AclJW82/uOUTaxthRdaF1entEHcPSgAOkRwQ References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B505B@polaris.maxiscale.com> <2ACA3DE8F9758A48B8BE2C7A847F91F23B5102@polaris.maxiscale.com> <20081118085739.GA95079@ei.bzerk.org> From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1227024007 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Subject: RE: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 16:00:25 -0000 >What I've done in the past is skip sysinstall alltogether and just boot >of an NFS root. Then use custom scripts for the slicing/partitioning/=20 >mirroring, copy a minimal system to disk and pkg_add the rest. >Would be nice to do all this with install.cfg though. Please let me know=20 >when you get this working. I thought of doing something like this as well. I'll have to investigate this as another option to this problem. Thanks for the feedback guys. From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 21:34:11 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A9E501065678 for ; Tue, 18 Nov 2008 21:34:11 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: from palm.hoeg.nl (unknown [IPv6:2001:7b8:613:100::211]) by mx1.freebsd.org (Postfix) with ESMTP id 43B5A8FC13 for ; Tue, 18 Nov 2008 21:34:11 +0000 (UTC) (envelope-from ed@hoeg.nl) Received: by palm.hoeg.nl (Postfix, from userid 1000) id 425AC1CCEC; Tue, 18 Nov 2008 22:34:10 +0100 (CET) Date: Tue, 18 Nov 2008 22:34:10 +0100 From: Ed Schouten To: "Carlos A. M. dos Santos" Message-ID: <20081118213410.GA81783@hoeg.nl> References: <20081028081154.GQ6808@hoeg.nl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="5mjPmdht4ZehXHR2" Content-Disposition: inline In-Reply-To: <20081028081154.GQ6808@hoeg.nl> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 21:34:11 -0000 --5mjPmdht4ZehXHR2 Content-Type: multipart/mixed; boundary="Y46NoIcKQuicSz3X" Content-Disposition: inline --Y46NoIcKQuicSz3X Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello Carlos, others, * Ed Schouten wrote: > About the /dev/console issues: Robert Watson and I discussed this some > time ago on IRC and what I did in HEAD (not RELENG_7) was that I changed > TIOCCONS not to take a look at the permissions of /dev/console, but we > changed it to use priv_check(). This means that right now you can only > call TIOCCONS as root. I can't really understand why the problem exists > on RELENG_7. >=20 > About making xconsole setuid: I've read the messages you mentioned, but > I think we could just alter console to call TIOCCONS and just drop > privileges. An even better solution would be to just get rid of TIOCCONS > and invent a better solution to capture syslog messages. I can't really > understand why we want to abuse TTY's to do this. >=20 > So I can't say we're working on this, but at least I can confirm the > issue. One solution would be to let xconsole just display /var/log/messages. There shouldn't be a valid reason to let syslogd print messages to /dev/console and capture them again using TIOCCONS. We could just instruct xconsole to read its data from the log files. If you save the attached patch as /usr/ports/x11/xconsole/files/ patch-xconsole.c (create directory first) and recompile xconsole, it will use the log file. I'll discuss this with others to decide if we should take such an approach. --=20 Ed Schouten WWW: http://80386.nl/ --Y46NoIcKQuicSz3X Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="xconsole.diff" Content-Transfer-Encoding: quoted-printable --- xconsole.c +++ xconsole.c @@ -145,6 +145,11 @@ {"-saveLines", "*saveLines", XrmoptionSepArg, NULL}, }; =20 +#ifdef __FreeBSD__ +#define USE_FILE +#define FILE_NAME "/var/log/messages" +#endif + #ifdef ultrix #define USE_FILE #define FILE_NAME "/dev/xcons" @@ -252,7 +257,7 @@ if (!strcmp (app_resources.file, "console")) { /* must be owner and have read/write permission */ -#if !defined(__NetBSD__) && !defined(__OpenBSD__) && !defined(Lynx) && !de= fined(__UNIXOS2__) +#if !defined(__FreeBSD__) && !defined(__NetBSD__) && !defined(__OpenBSD__)= && !defined(Lynx) && !defined(__UNIXOS2__) struct stat sbuf; # if !defined (linux) if (!stat("/dev/console", &sbuf) && @@ -266,9 +271,11 @@ if (!stat(FILE_NAME, &sbuf)) # endif input =3D fopen (FILE_NAME, "r"); -# ifdef __UNIXOS2__ if (input) { + struct stat sbuf; + +# ifdef __UNIXOS2__ ULONG arg =3D 1,arglen; APIRET rc; if ((rc=3DDosDevIOCtl(fileno(input), 0x76,0x4d, @@ -278,8 +285,11 @@ fclose(input); input =3D 0; } - } # endif + + if (!fstat(fileno(input), &sbuf) && S_ISREG(sbuf.st_mode)) + regularFile =3D TRUE; + } #endif =09 #ifdef USE_PTY --Y46NoIcKQuicSz3X-- --5mjPmdht4ZehXHR2 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkkjNNIACgkQ52SDGA2eCwXGXgCcDIyYlmFrOuJTBohm6Q10y0TF EgcAn3eb9oECrquRZQAgzElMVXd+EXbp =rB7+ -----END PGP SIGNATURE----- --5mjPmdht4ZehXHR2-- From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 21:39:37 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 507481065672 for ; Tue, 18 Nov 2008 21:39:37 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id 278D58FC12 for ; Tue, 18 Nov 2008 21:39:37 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1227044148-7adb00020000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id A57EE2FF1B for ; Tue, 18 Nov 2008 13:35:48 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id CYkrERLEPg1mhsV8 for ; Tue, 18 Nov 2008 13:35:48 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 X-ASG-Orig-Subj: What are proper install.cfg for configuring multiple slices? Date: Tue, 18 Nov 2008 13:35:46 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F240C97F@polaris.maxiscale.com> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: What are proper install.cfg for configuring multiple slices? Thread-Index: AclJxZ3MGVGFCUBhRhG5VKk+2wbncQ== From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1227044148 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: What are proper install.cfg for configuring multiple slices? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 21:39:37 -0000 I want to do an automated sysinstall through an install.cfg script and the script partition the install disk into three slices. I've been going through various tests trying to figure out what the proper directives are but I haven't had much luck, and I can't find any good examples. Here is a snippet of my config file: =20 disk=3Dad0 bootManager=3Dstandard partition=3D12582912 diskPartitionEditor partition=3D2097152 diskPartitionEditor partition=3Dfree diskPartitionEditor =20 ad0s1-1=3Dufs 4194304 / ad0s1-2=3Dufs 4194304 /tmp ad0s1-3=3Dufs 4194304 /var ad0s2-1=3Dswap 2097152 none ad0s3-1=3Dufs 4194304 none ad0s3-2=3Dufs 4194304 none ad0s3-3=3Dufs 0 none diskLabelEditor diskLabelCommit =20 My intent here is to create three slices-one 6GB in size, another 1GB in size, and the third sized to consume the remaining free space. When I run this through sysinstall, it complains that it can't find the space for the partitions. It even complains that it can't find any free space. Because the slices don't get created, the subsequent label assignments fail as well. What is the proper commands for creating multiple slices in install.cfg? =20 Another thing I'm having trouble with is partitioning more than one disk. I have four disks that I'd like to partition as part of the install.cfg script. In fact, I want to partition the four disks more or less identically (although only one should have an active root partition). Again though, if I try partitioning another disk after ad0, sysinstall complains about various things and the disk does not get partitioned. Can multiple disks be partitioned in this manner or does the step have to be done as a post-install operation? =20 From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 22:13:12 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 13944106564A for ; Tue, 18 Nov 2008 22:13:12 +0000 (UTC) (envelope-from doconnor@gsoft.com.au) Received: from cain.gsoft.com.au (cain.gsoft.com.au [203.31.81.10]) by mx1.freebsd.org (Postfix) with ESMTP id 6A9828FC14 for ; Tue, 18 Nov 2008 22:13:11 +0000 (UTC) (envelope-from doconnor@gsoft.com.au) Received: from inchoate.dons.net.au (ppp121-45-191-177.lns11.adl2.internode.on.net [121.45.191.177]) (authenticated bits=0) by cain.gsoft.com.au (8.13.8/8.13.8) with ESMTP id mAIMD4bs063854 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 19 Nov 2008 08:43:07 +1030 (CST) (envelope-from doconnor@gsoft.com.au) From: "Daniel O'Connor" To: freebsd-hackers@freebsd.org Date: Wed, 19 Nov 2008 08:42:43 +1030 User-Agent: KMail/1.9.10 References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> <200811182111.02367.doconnor@gsoft.com.au> <2ACA3DE8F9758A48B8BE2C7A847F91F240C920@polaris.maxiscale.com> In-Reply-To: <2ACA3DE8F9758A48B8BE2C7A847F91F240C920@polaris.maxiscale.com> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart3278158.uCOcgtbUcn"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200811190843.01321.doconnor@gsoft.com.au> X-Spam-Score: -2.212 () BAYES_00,RDNS_DYNAMIC X-Scanned-By: MIMEDefang 2.63 on 203.31.81.10 Cc: Peter Steele Subject: Re: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 22:13:12 -0000 --nextPart3278158.uCOcgtbUcn Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline On Wednesday 19 November 2008 02:25:12 Peter Steele wrote: > >I believe you modify /usr/src/release/${ARCH}/boot_crunch.conf to do > > this. > > >I haven't actually tried though... > > > >I think it would be possible to have a 'GEOM' menu that you can run > > prior to fdisk, label, etc that would allow you to > > >do some basic stuff like this. > > > >While the sysinstall code is a bit fugly it's not that difficult to > > hack on (speaking from limited experience :) > > Hmmm. I hadn't planned on actually creating a custom sysinstall but I > guess that's another way we could approach this. I have some research to > do... You wouldn't have to do so - you could just run a shell script from sysinst= all=20 and do what you want. =2D-=20 Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C --nextPart3278158.uCOcgtbUcn Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQBJIz3t5ZPcIHs/zowRAmeWAJwO5J1/cXitFovJrcvNfnr+6t5i4wCfcHZX qxjktdJqdu6Lb23hhVCE6mU= =HA5I -----END PGP SIGNATURE----- --nextPart3278158.uCOcgtbUcn-- From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 22:26:29 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 77338106564A for ; Tue, 18 Nov 2008 22:26:29 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from bunrab.catwhisker.org (adsl-63-193-123-122.dsl.snfc21.pacbell.net [63.193.123.122]) by mx1.freebsd.org (Postfix) with ESMTP id 2733B8FC19 for ; Tue, 18 Nov 2008 22:26:28 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from bunrab.catwhisker.org (localhost [127.0.0.1]) by bunrab.catwhisker.org (8.13.3/8.13.3) with ESMTP id mAILnK9S015440; Tue, 18 Nov 2008 13:49:20 -0800 (PST) (envelope-from david@bunrab.catwhisker.org) Received: (from david@localhost) by bunrab.catwhisker.org (8.13.3/8.13.1/Submit) id mAILnKfA015439; Tue, 18 Nov 2008 13:49:20 -0800 (PST) (envelope-from david) Date: Tue, 18 Nov 2008 13:49:19 -0800 From: David Wolfskill To: Ed Schouten Message-ID: <20081118214919.GM83287@bunrab.catwhisker.org> Mail-Followup-To: David Wolfskill , Ed Schouten , FreeBSD Hackers References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="W302I+VHGNbNYdEm" Content-Disposition: inline In-Reply-To: <20081118213410.GA81783@hoeg.nl> User-Agent: Mutt/1.4.2.1i Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 22:26:29 -0000 --W302I+VHGNbNYdEm Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Nov 18, 2008 at 10:34:10PM +0100, Ed Schouten wrote: > ... > One solution would be to let xconsole just display /var/log/messages. Errr... it may be rather a pathological case, but you might want to check the content of /etc/syslog.conf on the local machine before getting too carried away with that approach. For example, on my "firewall" box at home (where I really do not want to log anything to local disk files, though I do have a serial console on it): janus(6.4-P)[1] grep -v '^#' /etc/syslog.conf=20 *.* @bunrab.catwhisker.org janus(6.4-P)[2]=20 And then consider the fate of bunrab -- with stuff getting logged to /var/log/messages from various machines.... > ... > I'll discuss this with others to decide if we should take such an > approach. I'm not trying to be obstructionist, here. If the above case is really "too pathological to consider" -- or if it's a case of me bringing that fate upon myself, I suppose -- that's actually something I can live with. It would be nice to be forwarned about it, though. :-} Peace, david --=20 David H. Wolfskill david@catwhisker.org Depriving a girl or boy of an opportunity for education is evil. See http://www.catwhisker.org/~david/publickey.gpg for my public key. --W302I+VHGNbNYdEm Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.0 (FreeBSD) iEYEARECAAYFAkkjOF8ACgkQmprOCmdXAD12IgCfSYhgY+QBi8wGgnUb+2SP6SpM BkIAnjUtiTny5+VmLkxYprxYG5iUKFx8 =LY+e -----END PGP SIGNATURE----- --W302I+VHGNbNYdEm-- From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 18 22:36:40 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 710CD106564A for ; Tue, 18 Nov 2008 22:36:40 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id 49C848FC19 for ; Tue, 18 Nov 2008 22:36:40 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1227047729-217d00000000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id BC2C82FCCE for ; Tue, 18 Nov 2008 14:35:29 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id FGs4QDlFZKxehi04 for ; Tue, 18 Nov 2008 14:35:29 -0800 (PST) X-ASG-Whitelist: Client X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-ASG-Orig-Subj: RE: How can I add new binaries to the mfsroot image? Date: Tue, 18 Nov 2008 14:35:26 -0800 Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F240C996@polaris.maxiscale.com> In-Reply-To: <200811190843.01321.doconnor@gsoft.com.au> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: How can I add new binaries to the mfsroot image? Thread-Index: AclJyt6XspXCTvWIQbGj9Ex74betyQAAq8KA References: <2ACA3DE8F9758A48B8BE2C7A847F91F23B502B@polaris.maxiscale.com> <200811182111.02367.doconnor@gsoft.com.au> <2ACA3DE8F9758A48B8BE2C7A847F91F240C920@polaris.maxiscale.com> <200811190843.01321.doconnor@gsoft.com.au> From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1227047729 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Subject: RE: How can I add new binaries to the mfsroot image? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Nov 2008 22:36:40 -0000 >You wouldn't have to do so - you could just run a shell script from sysinstall and do what you want. That brings me back to my original problem. Yes, I can run a shell script from sysinstall, but gmirror isn't available in mfsroot, and adding gmirror to mfsroot isn't straightforward because it needs shared libraries. I think the best approach to use may very well to have a custom boot that mounts root from an NFS disk. Then I can run whatever commands I need without having to actually add anything to mfsroot... From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 07:55:15 2008 Return-Path: Delivered-To: hackers@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CF4A41065670 for ; Wed, 19 Nov 2008 07:55:15 +0000 (UTC) (envelope-from nick@van-laarhoven.org) Received: from cpsmtpo-eml04.kpnxchange.com (cpsmtpo-eml04.KPNXCHANGE.COM [213.75.38.153]) by mx1.freebsd.org (Postfix) with ESMTP id 624448FC16 for ; Wed, 19 Nov 2008 07:55:15 +0000 (UTC) (envelope-from nick@van-laarhoven.org) Received: from cpsmtp-eml114.kpnxchange.com ([213.75.84.114]) by cpsmtpo-eml04.kpnxchange.com with Microsoft SMTPSVC(6.0.3790.3959); Wed, 19 Nov 2008 08:43:10 +0100 Received: from uitsmijter.van-laarhoven.org ([81.207.207.222]) by cpsmtp-eml114.kpnxchange.com with Microsoft SMTPSVC(6.0.3790.3959); Wed, 19 Nov 2008 08:43:10 +0100 Received: (qmail 81887 invoked by uid 98); 19 Nov 2008 07:43:23 -0000 Received: from 77.62.210.250 (nick@77.62.210.250) by uitsmijter.van-laarhoven.org (envelope-from , uid 82) with qmail-scanner-2.01 (clamdscan: 0.92/5270. f-prot: 4.6.7/3.16.15. spamassassin: 3.2.3. Clear:RC:0(77.62.210.250):SA:0(0.5/5.0):. Processed in 4.122417 secs); 19 Nov 2008 07:43:23 -0000 X-Spam-Status: No, score=0.5 required=5.0 X-Spam-Level: Received: from unknown (HELO van-laarhoven.org) (nick@77.62.210.250) by uitsmijter.van-laarhoven.org with SMTP; 19 Nov 2008 07:43:18 -0000 Received: (nullmailer pid 1528 invoked by uid 1001); Wed, 19 Nov 2008 07:42:59 -0000 From: Nick Hibma To: FreeBSD Hackers Mailing List Date: Wed, 19 Nov 2008 08:42:58 +0100 User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811190842.59377.nick@van-laarhoven.org> X-OriginalArrivalTime: 19 Nov 2008 07:43:10.0516 (UTC) FILETIME=[78543740:01C94A1A] Cc: Subject: Unicode USB strings conversion X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 07:55:15 -0000 In the USB code (and I bet it is the same in the USB4BSD code) unicode characters in strings are converted in a very crude way to ASCII. As I have a user on the line who sees rubbish in his logs and when using usbctl/usbdevs/etc., I bet this is the problem. I'd like to try and fix this problem by using libkern/libiconv. 1) Is this the right approach to convert UTF8 to printable string in the kernel? 2) Is this needed at all in the short term future? I remember seeing attempts at making the kernel use UTF8. 3) Does anyone know of a good example in the code without me having to hunt through the kernel to find it? For reference: The code that needs replacing is: usbd_get_string(): s = buf; n = size / 2 - 1; for (i = 0; i < n && i < len - 1; i++) { c = UGETW(us.bString[i]); /* Convert from Unicode, handle buggy strings. */ if ((c & 0xff00) == 0) *s++ = c; else if ((c & 0x00ff) == 0 && swap) *s++ = c >> 8; else *s++ = '?'; } *s++ = 0; I haven't got the USB specs handy, but I believe that this is a simple way of converting LE and BE UTF8 to ASCII. Nick From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 08:19:09 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7465E1065673 for ; Wed, 19 Nov 2008 08:19:09 +0000 (UTC) (envelope-from hselasky@c2i.net) Received: from swip.net (mailfe11.swip.net [212.247.155.65]) by mx1.freebsd.org (Postfix) with ESMTP id D1C858FC0A for ; Wed, 19 Nov 2008 08:19:08 +0000 (UTC) (envelope-from hselasky@c2i.net) X-Cloudmark-Score: 0.000000 [] X-Cloudmark-Analysis: v=1.0 c=1 a=aniA1o7mVp4QawOfT9qHqA==:17 a=MDXcvVOm-T_fsBTNoW8A:9 a=GQyCKAhj4s3td-REwuoA:7 a=CqxSfrD98CMMYZi7M71__QfCPncA:4 a=LY0hPdMaydYA:10 Received: from [62.113.133.1] (account mc467741@c2i.net [62.113.133.1] verified) by mailfe11.swip.net (CommuniGate Pro SMTP 5.2.6) with ESMTPA id 979525479; Wed, 19 Nov 2008 09:19:06 +0100 From: Hans Petter Selasky To: freebsd-hackers@freebsd.org Date: Wed, 19 Nov 2008 09:21:12 +0100 User-Agent: KMail/1.9.7 References: <200811190842.59377.nick@van-laarhoven.org> In-Reply-To: <200811190842.59377.nick@van-laarhoven.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811190921.13859.hselasky@c2i.net> Cc: FreeBSD Hackers Mailing List , Nick Hibma Subject: Re: Unicode USB strings conversion X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 08:19:09 -0000 On Wednesday 19 November 2008, Nick Hibma wrote: > In the USB code (and I bet it is the same in the USB4BSD code) unicode > characters in strings are converted in a very crude way to ASCII. As I have > a user on the line who sees rubbish in his logs and when using > usbctl/usbdevs/etc., I bet this is the problem. > > I'd like to try and fix this problem by using libkern/libiconv. > > 1) Is this the right approach to convert UTF8 to printable string in the > kernel? > > 2) Is this needed at all in the short term future? I remember seeing > attempts at making the kernel use UTF8. > > 3) Does anyone know of a good example in the code without me having to hunt > through the kernel to find it? > > For reference: The code that needs replacing is: > > usbd_get_string(): > > s = buf; > n = size / 2 - 1; > for (i = 0; i < n && i < len - 1; i++) { > c = UGETW(us.bString[i]); > /* Convert from Unicode, handle buggy strings. */ > if ((c & 0xff00) == 0) > *s++ = c; > else if ((c & 0x00ff) == 0 && swap) > *s++ = c >> 8; > else > *s++ = '?'; > } > *s++ = 0; > > I haven't got the USB specs handy, but I believe that this is a simple way > of converting LE and BE UTF8 to ASCII. Or you could try to search for a better language ID. Currently the USB stack (old and new) selects the first language ID in the language string. Probably there is an english language ID, but not as the first selection. --HPS From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 08:42:36 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 729361065670 for ; Wed, 19 Nov 2008 08:42:36 +0000 (UTC) (envelope-from nick@van-laarhoven.org) Received: from hpsmtp-eml16.kpnxchange.com (hpsmtp-eml16.KPNXCHANGE.COM [213.75.38.116]) by mx1.freebsd.org (Postfix) with ESMTP id 036C28FC28 for ; Wed, 19 Nov 2008 08:42:35 +0000 (UTC) (envelope-from nick@van-laarhoven.org) Received: from cpsmtp-eml102.kpnxchange.com ([213.75.84.102]) by hpsmtp-eml16.kpnxchange.com with Microsoft SMTPSVC(6.0.3790.3959); Wed, 19 Nov 2008 09:30:32 +0100 Received: from uitsmijter.van-laarhoven.org ([81.207.207.222]) by cpsmtp-eml102.kpnxchange.com with Microsoft SMTPSVC(6.0.3790.3959); Wed, 19 Nov 2008 09:30:31 +0100 Received: (qmail 82444 invoked by uid 98); 19 Nov 2008 08:30:44 -0000 Received: from 77.62.210.250 (nick@77.62.210.250) by uitsmijter.van-laarhoven.org (envelope-from , uid 82) with qmail-scanner-2.01 (clamdscan: 0.92/5270. f-prot: 4.6.7/3.16.15. spamassassin: 3.2.3. Clear:RC:0(77.62.210.250):SA:0(0.0/5.0):. Processed in 3.001042 secs); 19 Nov 2008 08:30:44 -0000 X-Spam-Status: No, score=0.0 required=5.0 X-Spam-Level: Received: from unknown (HELO van-laarhoven.org) (nick@77.62.210.250) by uitsmijter.van-laarhoven.org with SMTP; 19 Nov 2008 08:30:41 -0000 Received: (nullmailer pid 2108 invoked by uid 1001); Wed, 19 Nov 2008 08:30:25 -0000 From: Nick Hibma To: freebsd-hackers@freebsd.org Date: Wed, 19 Nov 2008 09:30:25 +0100 User-Agent: KMail/1.9.7 References: <200811190842.59377.nick@van-laarhoven.org> <200811190921.13859.hselasky@c2i.net> In-Reply-To: <200811190921.13859.hselasky@c2i.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811190930.25770.nick@van-laarhoven.org> X-OriginalArrivalTime: 19 Nov 2008 08:30:31.0960 (UTC) FILETIME=[15F62980:01C94A21] Subject: Re: Unicode USB strings conversion X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 08:42:36 -0000 > Or you could try to search for a better language ID. Currently the USB > stack (old and new) selects the first language ID in the language string. > Probably there is an english language ID, but not as the first selection. The first part of the string is correct, so I assume that they added some strange characters (like copyright) at the end. Besides, even in the English character set there might be strange characters, for example scandinavian characters in names. Nick From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 09:19:10 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E92D91065673 for ; Wed, 19 Nov 2008 09:19:10 +0000 (UTC) (envelope-from hselasky@c2i.net) Received: from swip.net (mailfe11.swip.net [212.247.155.65]) by mx1.freebsd.org (Postfix) with ESMTP id 7EBC38FC23 for ; Wed, 19 Nov 2008 09:19:10 +0000 (UTC) (envelope-from hselasky@c2i.net) X-Cloudmark-Score: 0.000000 [] X-Cloudmark-Analysis: v=1.0 c=1 a=aniA1o7mVp4QawOfT9qHqA==:17 a=MDXcvVOm-T_fsBTNoW8A:9 a=GQyCKAhj4s3td-REwuoA:7 a=CqxSfrD98CMMYZi7M71__QfCPncA:4 a=LY0hPdMaydYA:10 Received: from [62.113.133.1] (account mc467741@c2i.net [62.113.133.1] verified) by mailfe11.swip.net (CommuniGate Pro SMTP 5.2.6) with ESMTPA id 979525479; Wed, 19 Nov 2008 09:19:06 +0100 From: Hans Petter Selasky To: freebsd-hackers@freebsd.org Date: Wed, 19 Nov 2008 09:21:12 +0100 User-Agent: KMail/1.9.7 References: <200811190842.59377.nick@van-laarhoven.org> In-Reply-To: <200811190842.59377.nick@van-laarhoven.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811190921.13859.hselasky@c2i.net> Cc: FreeBSD Hackers Mailing List , Nick Hibma Subject: Re: Unicode USB strings conversion X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 09:19:11 -0000 On Wednesday 19 November 2008, Nick Hibma wrote: > In the USB code (and I bet it is the same in the USB4BSD code) unicode > characters in strings are converted in a very crude way to ASCII. As I have > a user on the line who sees rubbish in his logs and when using > usbctl/usbdevs/etc., I bet this is the problem. > > I'd like to try and fix this problem by using libkern/libiconv. > > 1) Is this the right approach to convert UTF8 to printable string in the > kernel? > > 2) Is this needed at all in the short term future? I remember seeing > attempts at making the kernel use UTF8. > > 3) Does anyone know of a good example in the code without me having to hunt > through the kernel to find it? > > For reference: The code that needs replacing is: > > usbd_get_string(): > > s = buf; > n = size / 2 - 1; > for (i = 0; i < n && i < len - 1; i++) { > c = UGETW(us.bString[i]); > /* Convert from Unicode, handle buggy strings. */ > if ((c & 0xff00) == 0) > *s++ = c; > else if ((c & 0x00ff) == 0 && swap) > *s++ = c >> 8; > else > *s++ = '?'; > } > *s++ = 0; > > I haven't got the USB specs handy, but I believe that this is a simple way > of converting LE and BE UTF8 to ASCII. Or you could try to search for a better language ID. Currently the USB stack (old and new) selects the first language ID in the language string. Probably there is an english language ID, but not as the first selection. --HPS From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 10:34:01 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8BD481065672 for ; Wed, 19 Nov 2008 10:34:01 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.229]) by mx1.freebsd.org (Postfix) with ESMTP id 591B68FC19 for ; Wed, 19 Nov 2008 10:34:01 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so3216027rvf.43 for ; Wed, 19 Nov 2008 02:34:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=jtRGQCFpBYcFF8AZmSXUlL7TcyLhT7U0/I7fm6SSoGg=; b=m/mwJypONrcS8EI+rkPOrNNT53KVgYXGu24EkjfmGGsSpEiFxPeZEKI57cSm0HG0uj kxntLo9EoVLK5hcVyIZpdo608/nGopX2SB4XLuNgIoSkXBpMryUfTlRVW40cfOQzRqeQ 3G9WFLjw1jDfE3eEflm4zLvQ7Z68EfvnttREk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=Zt0x0rDXEgxUGTn6aakQjujcMGkZOMBdkvuE6IkpGlj9pYzzhVyNsSOyDd/jq1QxZL 1OuWA6TctIH4DVz05+8xci7OXmvcoaDCeiFg15VDUuBBlGyJGfiSTaDKmGqjoaFI6RT8 swzcPOzYniFaVCpcI11wTFORrIeWw8LfrpaV0= Received: by 10.141.162.9 with SMTP id p9mr510243rvo.45.1227088962577; Wed, 19 Nov 2008 02:02:42 -0800 (PST) Received: by 10.141.79.14 with HTTP; Wed, 19 Nov 2008 02:02:42 -0800 (PST) Message-ID: <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> Date: Wed, 19 Nov 2008 02:02:42 -0800 From: "Garrett Cooper" To: "David Wolfskill" , "Ed Schouten" , "FreeBSD Hackers" In-Reply-To: <20081118214919.GM83287@bunrab.catwhisker.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> Cc: Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 10:34:01 -0000 On Tue, Nov 18, 2008 at 1:49 PM, David Wolfskill wrote: > On Tue, Nov 18, 2008 at 10:34:10PM +0100, Ed Schouten wrote: >> ... >> One solution would be to let xconsole just display /var/log/messages. > > Errr... it may be rather a pathological case, but you might want to > check the content of /etc/syslog.conf on the local machine before > getting too carried away with that approach. > > For example, on my "firewall" box at home (where I really do not want to > log anything to local disk files, though I do have a serial console on it): > > janus(6.4-P)[1] grep -v '^#' /etc/syslog.conf > *.* @bunrab.catwhisker.org > janus(6.4-P)[2] > > And then consider the fate of bunrab -- with stuff getting logged to > /var/log/messages from various machines.... > >> ... >> I'll discuss this with others to decide if we should take such an >> approach. > > I'm not trying to be obstructionist, here. If the above case is really > "too pathological to consider" -- or if it's a case of me bringing that > fate upon myself, I suppose -- that's actually something I can live > with. It would be nice to be forwarned about it, though. :-} > > Peace, > david Uh, I second that. /var/log/messages shouldn't necessarily be accessible by non-root users. Also, OSX 10.5 protects against non-root access to dmesg. Not saying we should go that far, but it's already being implemented, so I don't see any harm in hiding the contents of `messages', as required by the sysadmin. -Garrett From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 10:47:33 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D4D5C106564A for ; Wed, 19 Nov 2008 10:47:33 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA06.westchester.pa.mail.comcast.net (qmta06.westchester.pa.mail.comcast.net [76.96.62.56]) by mx1.freebsd.org (Postfix) with ESMTP id 775368FC20 for ; Wed, 19 Nov 2008 10:47:33 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA05.westchester.pa.mail.comcast.net ([76.96.62.43]) by QMTA06.westchester.pa.mail.comcast.net with comcast id gySw1a0010vyq2s56ynYui; Wed, 19 Nov 2008 10:47:32 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA05.westchester.pa.mail.comcast.net with comcast id gynX1a0052P6wsM3RynXxL; Wed, 19 Nov 2008 10:47:32 +0000 X-Authority-Analysis: v=1.0 c=1 a=NTqVaNuko5sA:10 a=QycZ5dHgAAAA:8 a=48gLa1GcRi-lpoS5xS4A:9 a=8_xUQ1drp4wAVpXyh7cA:7 a=N7-ST9V3kKPLEbYi7xZhjtggGpcA:4 a=EoioJ0NPDVgA:10 a=AxzJsZMqWAcA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 20FB633C36; Wed, 19 Nov 2008 02:47:31 -0800 (PST) Date: Wed, 19 Nov 2008 02:47:31 -0800 From: Jeremy Chadwick To: Garrett Cooper Message-ID: <20081119104731.GA83366@icarus.home.lan> References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Ed Schouten , FreeBSD Hackers , David Wolfskill Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 10:47:33 -0000 On Wed, Nov 19, 2008 at 02:02:42AM -0800, Garrett Cooper wrote: > On Tue, Nov 18, 2008 at 1:49 PM, David Wolfskill wrote: > > On Tue, Nov 18, 2008 at 10:34:10PM +0100, Ed Schouten wrote: > >> ... > >> One solution would be to let xconsole just display /var/log/messages. > > > > Errr... it may be rather a pathological case, but you might want to > > check the content of /etc/syslog.conf on the local machine before > > getting too carried away with that approach. > > > > For example, on my "firewall" box at home (where I really do not want to > > log anything to local disk files, though I do have a serial console on it): > > > > janus(6.4-P)[1] grep -v '^#' /etc/syslog.conf > > *.* @bunrab.catwhisker.org > > janus(6.4-P)[2] > > > > And then consider the fate of bunrab -- with stuff getting logged to > > /var/log/messages from various machines.... > > > >> ... > >> I'll discuss this with others to decide if we should take such an > >> approach. > > > > I'm not trying to be obstructionist, here. If the above case is really > > "too pathological to consider" -- or if it's a case of me bringing that > > fate upon myself, I suppose -- that's actually something I can live > > with. It would be nice to be forwarned about it, though. :-} > > > > Peace, > > david > > Uh, I second that. /var/log/messages shouldn't necessarily be > accessible by non-root users. Also, OSX 10.5 protects against non-root > access to dmesg. Not saying we should go that far, but it's already > being implemented, so I don't see any harm in hiding the contents of > `messages', as required by the sysadmin. Footnote (not really applicable to the thread, but I want to point it out to users/admins reading): inhibiting users viewing the kernel message buffer (dmesg) can be accomplished by setting the security.bsd.unprivileged_read_msgbuf sysctl to 0. However, note that this can piss users off. We have numerous users on our system who rely on this information to see if anything "weird" is going on with the box. I set that sysctl one day (see below for why), and I got flames in my mailbox within 48 hours. Just something to keep in mind if you have technically-savvy users. There's a known "issue" with the kernel message buffer though: it's not NULL'd out upon reboot. Meaning, in some cases (depends on the BIOS or system), the kernel message buffer from single-user mode is retained even after a reboot! A user can then do "dmesg" and see all the nifty stuff you've done during single-user, which could include unencrypted passwords if mergemaster was tinkering with passwd/master.passwd, etc.. I've brought this up before, and people said "Yeah, we know, moving on". Rink Springer created a patch where the kernel message buffer will start with NULL to keep this from happening, but it needs to be made into a loader.conf tunable. Also, /var/log/messages is explicitly set to 0644 in newsyslog.conf. If people want to debate that, be my guest. I'm not sure what "security hole" we'd be plugging if it was set to 0600, especially given that many userland programs use the LOG_NOTICE facility in syslog. If people want to debate those default perms, be my guest. I would rather people debate the default syslog.conf layout altogether; I'm surprised we haven't moved to syslog-ng (as part of the base system) by now. :-) -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 11:33:07 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1201E1065672 for ; Wed, 19 Nov 2008 11:33:07 +0000 (UTC) (envelope-from unixmania@gmail.com) Received: from ey-out-2122.google.com (ey-out-2122.google.com [74.125.78.25]) by mx1.freebsd.org (Postfix) with ESMTP id 91DAB8FC0A for ; Wed, 19 Nov 2008 11:33:06 +0000 (UTC) (envelope-from unixmania@gmail.com) Received: by ey-out-2122.google.com with SMTP id 6so1336800eyi.7 for ; Wed, 19 Nov 2008 03:33:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=jNaKXFiqoCphnDHLk7s5nIjtPdHHLvR7RhgSaxhZ3aw=; b=d6pB/PIvDGTi5mbi32nSFNZ26LB1rUXM1V+lIhtVHtNe1ayuf+IaitAcCE3B/WGoYX IK9JCcJAjq5DGCl480quBH4p9Zo12yuF/qsAQNiPMWa/sj4OyDAf5oSSG7VlwyVokrIO 288xBY0y7dXMPdlMhy032X6L+0vfF4OcemwF8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=GpsmNQjeKCSMAYZ6D+cICIqMyUQQ32T73eMQdsueS468hHFMvlh2+JcG7qI+trgILY l14aueeEEkWv56ES4FO8n1nc9f8eobGJ9GZiNls6+8gtQGLdyB0VGA0JliqUzDGj5BlL XH0V6gYwTTuurL8dxq27STClXgfbb8/dif4HY= Received: by 10.103.229.12 with SMTP id g12mr330236mur.87.1227094385313; Wed, 19 Nov 2008 03:33:05 -0800 (PST) Received: by 10.103.137.8 with HTTP; Wed, 19 Nov 2008 03:33:05 -0800 (PST) Message-ID: Date: Wed, 19 Nov 2008 09:33:05 -0200 From: "Carlos A. M. dos Santos" To: "Ed Schouten" In-Reply-To: <20081118213410.GA81783@hoeg.nl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 11:33:07 -0000 On Tue, Nov 18, 2008 at 7:34 PM, Ed Schouten wrote: > Hello Carlos, others, > > * Ed Schouten wrote: >> About the /dev/console issues: Robert Watson and I discussed this some >> time ago on IRC and what I did in HEAD (not RELENG_7) was that I changed >> TIOCCONS not to take a look at the permissions of /dev/console, but we >> changed it to use priv_check(). This means that right now you can only >> call TIOCCONS as root. I can't really understand why the problem exists >> on RELENG_7. >> >> About making xconsole setuid: I've read the messages you mentioned, but >> I think we could just alter console to call TIOCCONS and just drop >> privileges. An even better solution would be to just get rid of TIOCCONS >> and invent a better solution to capture syslog messages. I can't really >> understand why we want to abuse TTY's to do this. >> >> So I can't say we're working on this, but at least I can confirm the >> issue. > > One solution would be to let xconsole just display /var/log/messages. > There shouldn't be a valid reason to let syslogd print messages to > /dev/console and capture them again using TIOCCONS. We could just > instruct xconsole to read its data from the log files. > > If you save the attached patch as /usr/ports/x11/xconsole/files/ > patch-xconsole.c (create directory first) and recompile xconsole, it > will use the log file. > > I'll discuss this with others to decide if we should take such an > approach. It is not necessary to patch xconsole to accomplish this. Using the -file command line argument would be enough. Be warned, however, that 1. messages sent straight to /dev/console will not show up at the xconsole window; 2. with large files it will become slow and consume lots of memory, because it will load the entire contents of /mar/log/messages to its text buffer; 3. it will show *all* messages, not only the urgent ones, which is not necessarily the desired behavior; 4. it will stop working upon log rotation. -- cd /usr/ports/sysutils/life make clean From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 11:37:18 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 964A4106567F for ; Wed, 19 Nov 2008 11:37:18 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 4B7398FC18 for ; Wed, 19 Nov 2008 11:37:18 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1L2lMt-0004dB-Uz for freebsd-hackers@freebsd.org; Wed, 19 Nov 2008 11:37:11 +0000 Received: from 195.208.174.178 ([195.208.174.178]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 19 Nov 2008 11:37:11 +0000 Received: from vadim_nuclight by 195.208.174.178 with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 19 Nov 2008 11:37:11 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Vadim Goncharov Followup-To: gmane.os.freebsd.current Date: Wed, 19 Nov 2008 11:37:01 +0000 (UTC) Organization: Nuclear Lightning @ Tomsk, TPU AVTF Hostel Lines: 31 Message-ID: References: <200809222233.26053.max@love2party.net> X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 195.208.174.178 X-Comment-To: Max Laier User-Agent: slrn/0.9.8.1 (FreeBSD) Sender: news Cc: freebsd-current@freebsd.org Subject: Re: cosum: Checkout verification PoC X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: vadim_nuclight@mail.ru List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 11:37:18 -0000 Hi Max Laier! On Mon, 22 Sep 2008 22:33:25 +0200; Max Laier wrote about 'cosum: Checkout verification PoC': > the attached script will generate md5 and sha256 checksums of a checkout and > try to find the corresponding svn-revision. This can help to verify that your > checkout from cvsupX.yy.freebsd.org is authentic. Not that there is reason to > believe that we have compromised cvsup-servers. This is just something I've > been toying with and wanted to let you know to see if people find the idea > interesting. I'd also be interested in reviews of the concept (note that I > know that https would be a good idea, I just cba to setup a certificate). > The coverage currently is head and stable/{6,7} svn revision 179451:183186 > (i.e. since the first svn commit up to "2008-09-19 16:51:41 +0200". I don't > yet have a cronjob in place to generate new checksums, so this will become > less useful quick. If people do find it interesting, however, I could > certainly roll something. > As you can see, the script is ready to checksum cvs and svn checkouts. If you > obtain your checkout from some local git/hg/svk/... mirror you must modify the > find excludes accordingly. > Let me know what you think. This is a good solution for our users caring about security. I think such definitely should be incorporated into base system and server-side support be provided at freebsd.org on official basis. -- WBR, Vadim Goncharov. ICQ#166852181 mailto:vadim_nuclight@mail.ru [Moderator of RU.ANTI-ECOLOGY][FreeBSD][http://antigreen.org][LJ:/nuclight] From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 11:42:02 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DC6F0106564A; Wed, 19 Nov 2008 11:42:02 +0000 (UTC) (envelope-from takawata@init-main.com) Received: from sana.init-main.com (unknown [IPv6:2001:240:28::1]) by mx1.freebsd.org (Postfix) with ESMTP id 761798FC17; Wed, 19 Nov 2008 11:42:02 +0000 (UTC) (envelope-from takawata@init-main.com) Received: from init-main.com (localhost [127.0.0.1]) by sana.init-main.com (8.14.3/8.14.3) with ESMTP id mAJBi3Lg004559; Wed, 19 Nov 2008 20:44:03 +0900 (JST) (envelope-from takawata@init-main.com) Message-Id: <200811191144.mAJBi3Lg004559@sana.init-main.com> To: freebsd-current@freebsd.org, freebsd-hackers@freebsd.org, freebsd-smp@freebsd.org Date: Wed, 19 Nov 2008 20:44:03 +0900 From: Takanori Watanabe Cc: Subject: Core i7 anyone else? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 11:42:03 -0000 Hi, I recently bought Core i7 machine(for 145,000JPY: about $1500) and sometimes hangs up oddly. When in the state, some specific process only works and replys ping, but not reply any useful information. I suspect it may caused by CPU power management, so I cut almost all CPU power management feature on BIOS parameter. Are there any people encouterd such trouble? And on this machine build world in SCHED_ULE(15min.) is slower than SCHED_4BSD(12min.). ===dmesg=== http://www.init-main.com/corei7.dmesg or http://pastebin.com/m187f77aa (if host is down) =====DSDT==== http://www.init-main.com/corei7.asl or http://pastebin.com/m6879984a ==some sysctls== hw.machine: i386 hw.model: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz hw.ncpu: 8 hw.byteorder: 1234 hw.physmem: 3202322432 hw.usermem: 2956083200 hw.pagesize: 4096 hw.floatingpoint: 1 hw.machine_arch: i386 hw.realmem: 3211264000 == machdep.enable_panic_key: 0 machdep.adjkerntz: -32400 machdep.wall_cmos_clock: 1 machdep.disable_rtc_set: 0 machdep.disable_mtrrs: 0 machdep.guessed_bootdev: 2686451712 machdep.idle: acpi machdep.idle_available: spin, mwait, mwait_hlt, hlt, acpi, machdep.hlt_cpus: 0 machdep.prot_fault_translation: 0 machdep.panic_on_nmi: 1 machdep.kdb_on_nmi: 1 machdep.tsc_freq: 2684011396 machdep.i8254_freq: 1193182 machdep.acpi_timer_freq: 3579545 machdep.acpi_root: 1024240 machdep.hlt_logical_cpus: 0 machdep.logical_cpus_mask: 254 machdep.hyperthreading_allowed: 1 == kern.sched.preemption: 0 kern.sched.topology_spec: 0, 1, 2, 3, 4, 5, 6, 7 kern.sched.steal_thresh: 3 kern.sched.steal_idle: 1 kern.sched.steal_htt: 1 kern.sched.balance_interval: 133 kern.sched.balance: 1 kern.sched.affinity: 1 kern.sched.idlespinthresh: 4 kern.sched.idlespins: 10000 kern.sched.static_boost: 160 kern.sched.preempt_thresh: 0 kern.sched.interact: 30 kern.sched.slice: 13 kern.sched.name: ULE === From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 11:47:17 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 57C401065675 for ; Wed, 19 Nov 2008 11:47:17 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA01.westchester.pa.mail.comcast.net (qmta01.westchester.pa.mail.comcast.net [76.96.62.16]) by mx1.freebsd.org (Postfix) with ESMTP id F138F8FC16 for ; Wed, 19 Nov 2008 11:47:16 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA08.westchester.pa.mail.comcast.net ([76.96.62.12]) by QMTA01.westchester.pa.mail.comcast.net with comcast id gzRU1a0080Fqzac51znGaM; Wed, 19 Nov 2008 11:47:16 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA08.westchester.pa.mail.comcast.net with comcast id gznE1a00Q2P6wsM3UznFzA; Wed, 19 Nov 2008 11:47:16 +0000 X-Authority-Analysis: v=1.0 c=1 a=DiZ76wm4AAAA:8 a=fGO4tVQLAAAA:8 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=8oBBsJxBPgm8k0VuyQAA:9 a=CmO0HorRqYcm4XbtWS8pjeXFcQ8A:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id B30E933C36; Wed, 19 Nov 2008 03:47:14 -0800 (PST) Date: Wed, 19 Nov 2008 03:47:14 -0800 From: Jeremy Chadwick To: Takanori Watanabe Message-ID: <20081119114714.GA85533@icarus.home.lan> References: <200811191144.mAJBi3Lg004559@sana.init-main.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200811191144.mAJBi3Lg004559@sana.init-main.com> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-hackers@freebsd.org, freebsd-current@freebsd.org, freebsd-smp@freebsd.org Subject: Re: Core i7 anyone else? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 11:47:17 -0000 On Wed, Nov 19, 2008 at 08:44:03PM +0900, Takanori Watanabe wrote: > Hi, I recently bought Core i7 machine(for 145,000JPY: about $1500) > and sometimes hangs up oddly. > When in the state, some specific process only works and > replys ping, but not reply any useful information. > > I suspect it may caused by CPU power management, so I cut > almost all CPU power management feature on BIOS parameter. > > Are there any people encouterd such trouble? > And on this machine build world in SCHED_ULE(15min.) is slower > than SCHED_4BSD(12min.). > > > ===dmesg=== > http://www.init-main.com/corei7.dmesg > or > http://pastebin.com/m187f77aa > (if host is down) > > =====DSDT==== > http://www.init-main.com/corei7.asl > or > http://pastebin.com/m6879984a > > ==some sysctls== > hw.machine: i386 > hw.model: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz > hw.ncpu: 8 > hw.byteorder: 1234 > hw.physmem: 3202322432 > hw.usermem: 2956083200 > hw.pagesize: 4096 > hw.floatingpoint: 1 > hw.machine_arch: i386 > hw.realmem: 3211264000 > == > machdep.enable_panic_key: 0 > machdep.adjkerntz: -32400 > machdep.wall_cmos_clock: 1 > machdep.disable_rtc_set: 0 > machdep.disable_mtrrs: 0 > machdep.guessed_bootdev: 2686451712 > machdep.idle: acpi > machdep.idle_available: spin, mwait, mwait_hlt, hlt, acpi, > machdep.hlt_cpus: 0 > machdep.prot_fault_translation: 0 > machdep.panic_on_nmi: 1 > machdep.kdb_on_nmi: 1 > machdep.tsc_freq: 2684011396 > machdep.i8254_freq: 1193182 > machdep.acpi_timer_freq: 3579545 > machdep.acpi_root: 1024240 > machdep.hlt_logical_cpus: 0 > machdep.logical_cpus_mask: 254 > machdep.hyperthreading_allowed: 1 > == > kern.sched.preemption: 0 > kern.sched.topology_spec: > > 0, 1, 2, 3, 4, 5, 6, 7 > > > > > kern.sched.steal_thresh: 3 > kern.sched.steal_idle: 1 > kern.sched.steal_htt: 1 > kern.sched.balance_interval: 133 > kern.sched.balance: 1 > kern.sched.affinity: 1 > kern.sched.idlespinthresh: 4 > kern.sched.idlespins: 10000 > kern.sched.static_boost: 160 > kern.sched.preempt_thresh: 0 > kern.sched.interact: 30 > kern.sched.slice: 13 > kern.sched.name: ULE > === When building world/kernel, do you see odd behaviour (on CURRENT) such as the load average being absurdly high, or processes (anything; sh, make, mutt, etc.) getting stuck in bizarre states? These things are what caused my buildworld/buildkernel times to increase (compared to RELENG_7). I was using ULE entirely (on CURRENT and RELENG_7), but did not try 4BSD. I documented my experience. http://wiki.freebsd.org/JeremyChadwick/Bizarre_CURRENT_experience I have no idea if your problem is the same as mine. This is purely speculative on my part. (And readers of that Wiki article should note that the problem was not hardware-related) -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 11:58:16 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8D1CE106567B for ; Wed, 19 Nov 2008 11:58:16 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 0DD2B8FC1C for ; Wed, 19 Nov 2008 11:58:15 +0000 (UTC) (envelope-from freebsd-hackers@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1L2lhD-0005Lb-KG for freebsd-hackers@freebsd.org; Wed, 19 Nov 2008 11:58:11 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 19 Nov 2008 11:58:11 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 19 Nov 2008 11:58:11 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-hackers@freebsd.org From: Ivan Voras Date: Wed, 19 Nov 2008 12:58:54 +0100 Lines: 92 Message-ID: <4923FF7E.1080101@freebsd.org> References: <200811191144.mAJBi3Lg004559@sana.init-main.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigCFC1809BFB1D0993DBF70FC6" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.17 (X11/20080925) In-Reply-To: <200811191144.mAJBi3Lg004559@sana.init-main.com> X-Enigmail-Version: 0.95.0 Sender: news Cc: freebsd-current@freebsd.org, freebsd-smp@freebsd.org Subject: Re: Core i7 anyone else? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 11:58:16 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigCFC1809BFB1D0993DBF70FC6 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Takanori Watanabe wrote: > Hi, I recently bought Core i7 machine(for 145,000JPY: about $1500) > and sometimes hangs up oddly. > When in the state, some specific process only works and=20 > replys ping, but not reply any useful information. >=20 > I suspect it may caused by CPU power management, so I cut=20 > almost all CPU power management feature on BIOS parameter. >=20 > Are there any people encouterd such trouble? > And on this machine build world in SCHED_ULE(15min.) is slower=20 > than SCHED_4BSD(12min.). I don't know but this: > =3D=3D=3Ddmesg=3D=3D=3D > http://www.init-main.com/corei7.dmesg > or > http://pastebin.com/m187f77aa > (if host is down) CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz (2684.00-MHz 686-class CPU) Origin =3D "GenuineIntel" Id =3D 0x106a4 Stepping =3D 4 Features=3D0xbfebfbff Features2=3D0x98e3bd AMD Features=3D0x28100000 AMD Features2=3D0x1 Cores per package: 8 Logical CPUs per core: 2 real memory =3D 3211264000 (3062 MB) avail memory =3D 3143983104 (2998 MB) ACPI APIC Table: <7522MS A7522100> FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 is a bit in conflict with this: > kern.sched.topology_spec: > > 0, 1, 2, 3, 4, 5, 6, 7 > > > =46rom what I know of its architecture i7 has hyperthreading - i.e. the CPU has 4 "real" cores which are hyperthreaded, so you get 8 cores total. It probably also includes a different way of enumerating its topology which might have caused wrong topology detection and your slowdown in buildworld. (the CPU also has L3 cache, but I think it's not looked up in topology detection). I don't know it this particular error could be responsible for your lockups - probably not. The CPU also introduces some big changes in power management (dynamic powerdown of individual cores) which could cause them - but I can't help you there. Are you sure it's not something trivial like overheating? --------------enigCFC1809BFB1D0993DBF70FC6 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJI/9+ldnAQVacBcgRAptBAKCvy5iMZkVJ7f/v/8jWVRvs0Oa1vwCgnlPY fl3ySAZXU5NXl0ZmOXf43t4= =hTDW -----END PGP SIGNATURE----- --------------enigCFC1809BFB1D0993DBF70FC6-- From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 14:27:04 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 29469106564A for ; Wed, 19 Nov 2008 14:27:04 +0000 (UTC) (envelope-from prvs=1209f9aad2=marc.loerner@hob.de) Received: from mailgate.hob.de (mailgate.hob.de [212.185.199.3]) by mx1.freebsd.org (Postfix) with ESMTP id DCDFD8FC17 for ; Wed, 19 Nov 2008 14:27:03 +0000 (UTC) (envelope-from prvs=1209f9aad2=marc.loerner@hob.de) Received: from imap.hob.de (mail2.hob.de [172.25.1.102]) by mailgate.hob.de (Postfix) with ESMTP id 27E9A52001F for ; Wed, 19 Nov 2008 15:06:01 +0100 (CET) Received: from linux03.hob.de (linux03.hob.de [172.22.0.190]) by imap.hob.de (Postfix on SuSE eMail Server 2.0) with ESMTP id B5D43FD77A for ; Wed, 19 Nov 2008 15:06:00 +0100 (CET) From: Marc =?iso-8859-1?q?L=F6rner?= Organization: hob To: freebsd-hackers@freebsd.org Date: Wed, 19 Nov 2008 15:07:20 +0100 User-Agent: KMail/1.6.2 References: <200811121823.14400.marc.loerner@hob.de> <200811131502.04370.jhb@freebsd.org> In-Reply-To: <200811131502.04370.jhb@freebsd.org> MIME-Version: 1.0 Content-Disposition: inline Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit Message-Id: <200811191507.22455.marc.loerner@hob.de> Subject: Re: ide with DMA and ram > 4GB X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 14:27:04 -0000 On Thursday 13 November 2008 21:02, John Baldwin wrote: > On Wednesday 12 November 2008 12:23:14 pm Marc Lörner wrote: > > Hello, > > I just stepped over a problem with my IDE disk running in DMA-mode > > and having more than 4GB of RAM. > > It seems that the whole way down GEOM, ata-disk, ata-dma never is checked > > whether physical address of buffer is less than 4GB an so fits in 32bits. > > => when PRD is set the address is rigorously truncated to fit into 32bit, > > with buffer < 4GB all is quite fine. > > bus_dmamap_load() in ata-dma.c should result in bounce pages being > allocated and having the data copied to pages below 4GB and having those > addresses passed to the callback and stored in the PRD. Thanks for pointing this out! So it seems that bounce-pages are counted with helper-function run_filter. But this function does never return 1 with dma-pages not lying in range (e.g. paddr > 4GB) but being aligned. Did nobody else have problems on 64bit ide-dma, or is it already working, but I didn't grasp functionality, yet? For now, I came around this by adding a flag in "/sys/bus_dma.h" and setting this flag on tag-creation. So I now can check in run_filter whether I'm doing an ide-dma, relying on this and on check whether I got paddr > 4GB, I then can tell bus_dmamap_load to use bounce-pages. Any thoughts or comments? Regards, Marc Loerner From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 17:14:40 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0531F1065670 for ; Wed, 19 Nov 2008 17:14:40 +0000 (UTC) (envelope-from psteele@maxiscale.com) Received: from arcturus.maxiscale.com (arcturus.maxiscale.com [76.231.178.136]) by mx1.freebsd.org (Postfix) with ESMTP id D8AE08FC18 for ; Wed, 19 Nov 2008 17:14:39 +0000 (UTC) (envelope-from psteele@maxiscale.com) X-ASG-Debug-ID: 1227114878-1e2300010000-P5m3U7 X-Barracuda-URL: http://10.100.1.25:8000/cgi-bin/mark.cgi Received: from polaris.maxiscale.com (localhost [127.0.0.1]) by arcturus.maxiscale.com (Spam Firewall) with ESMTP id 1E0BB2FF5C for ; Wed, 19 Nov 2008 09:14:38 -0800 (PST) Received: from polaris.maxiscale.com (polaris.maxiscale.com [10.100.1.24]) by arcturus.maxiscale.com with ESMTP id yENPzQDY62bXXu8G for ; Wed, 19 Nov 2008 09:14:38 -0800 (PST) X-ASG-Whitelist: Client Content-class: urn:content-classes:message X-ASG-Orig-Subj: RE: What are proper install.cfg for configuring multiple slices? MIME-Version: 1.0 Date: Wed, 19 Nov 2008 09:14:37 -0800 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Message-ID: <2ACA3DE8F9758A48B8BE2C7A847F91F240CA25@polaris.maxiscale.com> In-Reply-To: <2ACA3DE8F9758A48B8BE2C7A847F91F240C97F@polaris.maxiscale.com> X-MimeOLE: Produced By Microsoft Exchange V6.5 X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: What are proper install.cfg for configuring multiple slices? Thread-Index: AclJxZ3MGVGFCUBhRhG5VKk+2wbncQAk/eGw References: <2ACA3DE8F9758A48B8BE2C7A847F91F240C97F@polaris.maxiscale.com> From: "Peter Steele" To: X-Barracuda-Connect: polaris.maxiscale.com[10.100.1.24] X-Barracuda-Start-Time: 1227114879 X-Barracuda-Virus-Scanned: by Barracuda Spam Firewall at maxiscale.com Subject: RE: What are proper install.cfg for configuring multiple slices? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 17:14:40 -0000 >I want to do an automated sysinstall through an install.cfg script and >the script partition the install disk into three slices. I've been going >through various tests trying to figure out what the proper directives >are but I haven't had much luck, and I can't find any good examples. After a lot of experimenting, my impression is that sysinstall simply doesn't support multiple slice installations. It works to a point, but I get some unexpected errors, e.g. Unable to make device node for /dev/ad0s1a in /dev and after the partitioning is complete, there are funky entries under /dev: /dev/ad0c /dev/ad0cs1 /dev/ad0cs2 /dev/ad0cs3 /dev/ad0s1 /dev/ad0s2 /dev/ad0s3 There should be entries such as /dev/ad0s1a and so on, but these do not get created. I've been unable to find even one example of how to formulate multiple partitions in install.cfg, but I'm pretty sure I'm doing it right, based on the sysinstall docs. Does anyone have any experience with this? From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 18:00:18 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9BF0D1065672 for ; Wed, 19 Nov 2008 18:00:18 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from flat.berklix.org (flat.berklix.org [83.236.223.115]) by mx1.freebsd.org (Postfix) with ESMTP id 01D398FC0C for ; Wed, 19 Nov 2008 18:00:17 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from js.berklix.net (p549A6C95.dip.t-dialin.net [84.154.108.149]) (authenticated bits=0) by flat.berklix.org (8.13.8/8.13.8) with ESMTP id mAJHOSju031529 for ; Wed, 19 Nov 2008 18:24:29 +0100 (CET) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by js.berklix.net (8.13.8/8.13.8) with ESMTP id mAJHOQ1c054769 for ; Wed, 19 Nov 2008 18:24:27 +0100 (CET) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (localhost [127.0.0.1]) by fire.js.berklix.net (8.13.8/8.13.8) with ESMTP id mAJHOL8r062364 for ; Wed, 19 Nov 2008 18:24:26 +0100 (CET) (envelope-from jhs@fire.js.berklix.net) Message-Id: <200811191724.mAJHOL8r062364@fire.js.berklix.net> To: hackers@freebsd.org From: "Julian Stacey" Organization: http://berklix.com BSD Unix Linux Consultancy, Munich Germany User-agent: EXMH on FreeBSD http://berklix.com/free/ X-URL: http://berklix.com/~jhs/cv/ Date: Wed, 19 Nov 2008 18:24:21 +0100 Sender: jhs@berklix.org Cc: Subject: Reccomendation for tools to use on FreeBSD for a wiki ? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 18:00:18 -0000 Hi hackers, Maybe Some of you might suggest some software I might install, Wiki I guess. ? I got zero response from ports@, I could use some reccomendations please. PS From http://wiki.freebsd.org/HelpContents I tried cd /usr/ports/www ; vi *iki*/pkg-descr or is /usr/ports/www/moinmoin the way to go ? Thanks. ----------- Subject: Reccomendation for ports for web based club events forthcoming diary ? Can anyone reccomend some ports to install on a FreeBSD web server, for a club of mostly non technical people, to support: - All club members can add events to a forthcoming calendar, - All club members can request server to prepare a listing of next next upcoming events, to download (probably in PDF, or perhaps tbl to a pipe or ? - A list of moderators can delete fake events from robots & the malicious. - Preferably moderators should not themselves be capable of deleting logged event submission, but only capable of deleting events formatted to the ouput printable programme sheet. (To autopsy for suspect rogue moderators) - I guess first entry criteria might be a fuzzy picture for human to decode password from). 2nd might be mail return for confirm password, - & 3rd, A majordomo (later mailman) maintained list of club members & moderators etc is available for automated validation. - I hope there will be some packages available, http & probably wiki based etc, that will come close enough ? I'm hoping this has been done often enough that people can suggest names of ports already existing ? If not I dont mind creating a port if I have to, but dont want to write something from scratch. PS - - I've had apache up for years, but no wiki yet, so if any tips, shout please, even if just RTFM URL=.... :-) - - Web based forums I don't care about, but others may, so I suppose if some software does & does not support web forums, it'd be good to know. Suggestions welcome please ! Thanks in advance. Cheers, Julian - -- Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com Mail plain ASCII text. HTML & Base64 text are spam. www.asciiribbon.org From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 18:39:33 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A20B9106564A for ; Wed, 19 Nov 2008 18:39:33 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.238]) by mx1.freebsd.org (Postfix) with ESMTP id 768238FC12 for ; Wed, 19 Nov 2008 18:39:33 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so66776rvf.43 for ; Wed, 19 Nov 2008 10:39:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=P7POLp1BHndPncJx55ppl7eBOu0Gkm7PMTwYmNElqAw=; b=Kagii558tkyon0kXi1AbRf7TnY3Yf1vcPz1t0D547SCIYk/N+tDAaxUZxRbOtIIT7X IhJiY7m+3VUO7cHzp6MvU/nBaxXe32Q/X97hdQcLZi/JFUlhY/Lz/98mTiHIkZW44ypd EUf3cRQ62k6uGrZVOhr6jD05s4BGeOouGnSpw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=X0MqyUsCbHQnh9ZsLNxBE6r8mcj5pTEMYgx/ubUbv3yh2B/opauo2+eDp+FwYXo3Tk VJHUssvmRZfosNFXh97mSYDGDxGUkUCMy9bL7P481TEJxhhugex6gqEuw/oNQCi7OXqA VASAvzdw7mLihKuWPrn8CHWtoEQhPL1ntZNMM= Received: by 10.141.43.19 with SMTP id v19mr729293rvj.115.1227118083259; Wed, 19 Nov 2008 10:08:03 -0800 (PST) Received: by 10.141.79.14 with HTTP; Wed, 19 Nov 2008 10:08:03 -0800 (PST) Message-ID: <7d6fde3d0811191008u75552bcbkbca2c5c302435d94@mail.gmail.com> Date: Wed, 19 Nov 2008 10:08:03 -0800 From: "Garrett Cooper" To: "Julian Stacey" In-Reply-To: <200811191724.mAJHOL8r062364@fire.js.berklix.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <200811191724.mAJHOL8r062364@fire.js.berklix.net> Cc: hackers@freebsd.org Subject: Re: Reccomendation for tools to use on FreeBSD for a wiki ? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 18:39:33 -0000 On Wed, Nov 19, 2008 at 9:24 AM, Julian Stacey wrote: > Hi hackers, > Maybe Some of you might suggest some software I might install, Wiki I guess. ? > I got zero response from ports@, I could use some reccomendations please. > PS From http://wiki.freebsd.org/HelpContents I tried > cd /usr/ports/www ; vi *iki*/pkg-descr > or is /usr/ports/www/moinmoin the way to go ? > Thanks. > ----------- > > Subject: Reccomendation for ports for web based club events forthcoming diary ? > > Can anyone reccomend some ports to install on a FreeBSD web server, > for a club of mostly non technical people, to support: > - All club members can add events to a forthcoming calendar, > - All club members can request server to prepare a listing > of next next upcoming events, to download (probably in PDF, > or perhaps tbl to a pipe or ? > - A list of moderators can delete fake events from robots & the malicious. > - Preferably moderators should not themselves be capable of > deleting logged event submission, but only capable of deleting > events formatted to the ouput printable programme sheet. (To > autopsy for suspect rogue moderators) > - I guess first entry criteria might be a fuzzy picture for human > to decode password from). 2nd might be mail return for confirm password, > - & 3rd, A majordomo (later mailman) maintained list of club members & > moderators etc is available for automated validation. > - I hope there will be some packages available, > http & probably wiki based etc, that will come close enough ? > I'm hoping this has been done often enough that people can suggest > names of ports already existing ? If not I dont mind creating a > port if I have to, but dont want to write something from scratch. > > PS > - - I've had apache up for years, but no wiki yet, so if any tips, > shout please, even if just RTFM URL=.... :-) > - - Web based forums I don't care about, but others may, so I suppose if some > software does & does not support web forums, it'd be good to know. > > Suggestions welcome please ! Thanks in advance. > > Cheers, > Julian Julian, FWIW, ports@ or questions@ would be better lists than hackers@. Thanks, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 18:44:10 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 33DCB1065670 for ; Wed, 19 Nov 2008 18:44:10 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA10.westchester.pa.mail.comcast.net (qmta10.westchester.pa.mail.comcast.net [76.96.62.17]) by mx1.freebsd.org (Postfix) with ESMTP id BA68C8FC0C for ; Wed, 19 Nov 2008 18:44:08 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA11.westchester.pa.mail.comcast.net ([76.96.62.36]) by QMTA10.westchester.pa.mail.comcast.net with comcast id h30b1a00D0mv7h05A6jwXg; Wed, 19 Nov 2008 18:43:56 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA11.westchester.pa.mail.comcast.net with comcast id h6k51a00Y2P6wsM3X6k6Sj; Wed, 19 Nov 2008 18:44:07 +0000 X-Authority-Analysis: v=1.0 c=1 a=qRabNtexEUMA:10 a=A98fTAjLwwsA:10 a=6I5d2MoRAAAA:8 a=QycZ5dHgAAAA:8 a=LKayIM6UJvR0i7dSoocA:9 a=Z0DVVqFUF3i1Og1CtvgA:7 a=KgWru--jC7dn1vWB9NnYr0r4H0oA:4 a=EoioJ0NPDVgA:10 a=uftxnXm4Q1MA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 6401B33C1C; Wed, 19 Nov 2008 10:44:05 -0800 (PST) Date: Wed, 19 Nov 2008 10:44:05 -0800 From: Jeremy Chadwick To: Garrett Cooper Message-ID: <20081119184405.GA4751@icarus.home.lan> References: <200811191724.mAJHOL8r062364@fire.js.berklix.net> <7d6fde3d0811191008u75552bcbkbca2c5c302435d94@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <7d6fde3d0811191008u75552bcbkbca2c5c302435d94@mail.gmail.com> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: hackers@freebsd.org, Julian Stacey Subject: Re: Reccomendation for tools to use on FreeBSD for a wiki ? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 18:44:10 -0000 On Wed, Nov 19, 2008 at 10:08:03AM -0800, Garrett Cooper wrote: > On Wed, Nov 19, 2008 at 9:24 AM, Julian Stacey wrote: > > Hi hackers, > > Maybe Some of you might suggest some software I might install, Wiki I guess. ? > > I got zero response from ports@, I could use some reccomendations please. > > PS From http://wiki.freebsd.org/HelpContents I tried > > cd /usr/ports/www ; vi *iki*/pkg-descr > > or is /usr/ports/www/moinmoin the way to go ? > > Thanks. > > ----------- > > > > Subject: Reccomendation for ports for web based club events forthcoming diary ? > > > > Can anyone reccomend some ports to install on a FreeBSD web server, > > for a club of mostly non technical people, to support: > > - All club members can add events to a forthcoming calendar, > > - All club members can request server to prepare a listing > > of next next upcoming events, to download (probably in PDF, > > or perhaps tbl to a pipe or ? > > - A list of moderators can delete fake events from robots & the malicious. > > - Preferably moderators should not themselves be capable of > > deleting logged event submission, but only capable of deleting > > events formatted to the ouput printable programme sheet. (To > > autopsy for suspect rogue moderators) > > - I guess first entry criteria might be a fuzzy picture for human > > to decode password from). 2nd might be mail return for confirm password, > > - & 3rd, A majordomo (later mailman) maintained list of club members & > > moderators etc is available for automated validation. > > - I hope there will be some packages available, > > http & probably wiki based etc, that will come close enough ? > > I'm hoping this has been done often enough that people can suggest > > names of ports already existing ? If not I dont mind creating a > > port if I have to, but dont want to write something from scratch. > > > > PS > > - - I've had apache up for years, but no wiki yet, so if any tips, > > shout please, even if just RTFM URL=.... :-) > > - - Web based forums I don't care about, but others may, so I suppose if some > > software does & does not support web forums, it'd be good to know. > > > > Suggestions welcome please ! Thanks in advance. > > > > Cheers, > > Julian > > Julian, > FWIW, ports@ or questions@ would be better lists than hackers@. He asked this on -ports only 2 days ago and received no response. So he appears to be going from list to list hoping someone will answer him. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 19:14:45 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 02C301065670 for ; Wed, 19 Nov 2008 19:14:45 +0000 (UTC) (envelope-from llc2w@virginia.edu) Received: from fork9.mail.virginia.edu (fork9.mail.Virginia.EDU [128.143.2.179]) by mx1.freebsd.org (Postfix) with ESMTP id C37D58FC21 for ; Wed, 19 Nov 2008 19:14:44 +0000 (UTC) (envelope-from llc2w@virginia.edu) Received: from localhost (localhost [127.0.0.1]) by fork9.mail.virginia.edu (Postfix) with ESMTP id A905D1F51F0 for ; Wed, 19 Nov 2008 13:49:39 -0500 (EST) Received: from fork9.mail.virginia.edu ([127.0.0.1]) by localhost (fork9.mail.virginia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 20494-05 for ; Wed, 19 Nov 2008 13:49:39 -0500 (EST) Received: from rv-out-0708.google.com (rv-out-0708.google.com [209.85.198.251]) by fork9.mail.virginia.edu (Postfix) with ESMTP id 640401F51E9 for ; Wed, 19 Nov 2008 13:49:39 -0500 (EST) Received: by rv-out-0708.google.com with SMTP id b17so73987rvf.36 for ; Wed, 19 Nov 2008 10:49:39 -0800 (PST) Received: by 10.140.204.7 with SMTP id b7mr748996rvg.98.1227120579224; Wed, 19 Nov 2008 10:49:39 -0800 (PST) Received: by 10.141.76.6 with HTTP; Wed, 19 Nov 2008 10:49:39 -0800 (PST) Message-ID: <792298050811191049y1cc01679h9271c9decd2109b7@mail.gmail.com> Date: Wed, 19 Nov 2008 13:49:39 -0500 From: "L Campbell" To: "Julian Stacey" In-Reply-To: <200811191724.mAJHOL8r062364@fire.js.berklix.net> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <200811191724.mAJHOL8r062364@fire.js.berklix.net> X-UVA-Virus-Scanned: by amavisd-new at fork9.mail.virginia.edu Cc: hackers@freebsd.org Subject: Re: Reccomendation for tools to use on FreeBSD for a wiki ? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 19:14:45 -0000 On Wed, Nov 19, 2008 at 12:24 PM, Julian Stacey wrote: > > Hi hackers, > Maybe Some of you might suggest some software I might install, Wiki I guess. ? > I got zero response from ports@, I could use some reccomendations please. > > - - I've had apache up for years, but no wiki yet, so if any tips, > shout please, even if just RTFM URL=.... :-) http://en.wikipedia.org/wiki/List_of_wiki_software http://en.wikipedia.org/wiki/Comparison_of_wiki_software From owner-freebsd-hackers@FreeBSD.ORG Wed Nov 19 22:18:26 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C852B106564A for ; Wed, 19 Nov 2008 22:18:26 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from flat.berklix.org (flat.berklix.org [83.236.223.115]) by mx1.freebsd.org (Postfix) with ESMTP id 55E2D8FC08 for ; Wed, 19 Nov 2008 22:18:25 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from js.berklix.net (p549A6C95.dip.t-dialin.net [84.154.108.149]) (authenticated bits=0) by flat.berklix.org (8.13.8/8.13.8) with ESMTP id mAJMINPr035062; Wed, 19 Nov 2008 23:18:24 +0100 (CET) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by js.berklix.net (8.13.8/8.13.8) with ESMTP id mAJMIQc7056894; Wed, 19 Nov 2008 23:18:26 +0100 (CET) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (localhost [127.0.0.1]) by fire.js.berklix.net (8.13.8/8.13.8) with ESMTP id mAJMIG1t066653; Wed, 19 Nov 2008 23:18:21 +0100 (CET) (envelope-from jhs@fire.js.berklix.net) Message-Id: <200811192218.mAJMIG1t066653@fire.js.berklix.net> To: "L Campbell" From: "Julian Stacey" Organization: http://berklix.com BSD Unix Linux Consultancy, Munich Germany User-agent: EXMH on FreeBSD http://berklix.com/free/ X-URL: http://berklix.com In-reply-to: Your message "Wed, 19 Nov 2008 13:49:39 EST." <792298050811191049y1cc01679h9271c9decd2109b7@mail.gmail.com> Date: Wed, 19 Nov 2008 23:18:16 +0100 Sender: jhs@berklix.org Cc: hackers@freebsd.org Subject: Re: Reccomendation for tools to use on FreeBSD for a wiki ? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 19 Nov 2008 22:18:26 -0000 > > - - I've had apache up for years, but no wiki yet, so if any tips, > > shout please, even if just RTFM URL=.... :-) > > http://en.wikipedia.org/wiki/List_of_wiki_software > http://en.wikipedia.org/wiki/Comparison_of_wiki_software Great ! Thanks a lot ! Cheers, Julian -- Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com Mail plain ASCII text. HTML & Base64 text are spam. www.asciiribbon.org From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 01:46:27 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 386E81065674 for ; Thu, 20 Nov 2008 01:46:27 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from hercules.mthelicon.com (hercules.mthelicon.com [IPv6:2001:49f0:2023::2]) by mx1.freebsd.org (Postfix) with ESMTP id 01D718FC12 for ; Thu, 20 Nov 2008 01:46:26 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from PegaPegII (93-152-14-233.daisydsl.managedbroadband.co.uk [93.152.14.233]) (authenticated bits=0) by hercules.mthelicon.com (8.14.3/8.14.2) with ESMTP id mAK1kOrX032296 for ; Thu, 20 Nov 2008 01:46:25 GMT (envelope-from ken@mthelicon.com) Message-ID: From: "Pegasus Mc Cleaft" To: Date: Thu, 20 Nov 2008 01:46:31 -0000 Organization: Feathers MIME-Version: 1.0 X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Windows Mail 6.0.6001.18000 X-MimeOLE: Produced By Microsoft MimeOLE V6.0.6001.18049 X-Antivirus: avast! (VPS 081119-0, 19/11/2008), Outbound message X-Antivirus-Status: Clean Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Pegasus Mc Cleaft List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 01:46:27 -0000 Hi everyone,=20 I am having difficulties rebuilding the world after some patches = were made today. I was wondering if anyone else is experiencing the same = troubles? ld -static -N --gc-sections -nostdlib -m elf_i386_fbsd -Ttext 0x0 -o = gptzfsboot.out = /usr/obj/usr/src/sys/boot/i386/gptzfsboot/../btx/lib/crt0.o zfsboot.o = sio.o gptzfsboot.o ld: gptzfsboot.o: No such file: No such file or directory *** Error code 1 Stop in /usr/src/sys/boot/i386/gptzfsboot. *** Error code 1 Stop in /usr/src/sys/boot/i386. *** Error code 1 Stop in /usr/src/sys/boot. *** Error code 1 Stop in /usr/src/sys. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. feathers# From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 06:39:41 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6EC621065677; Thu, 20 Nov 2008 06:39:41 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from mail36.syd.optusnet.com.au (mail36.syd.optusnet.com.au [211.29.133.76]) by mx1.freebsd.org (Postfix) with ESMTP id 036E58FC12; Thu, 20 Nov 2008 06:39:40 +0000 (UTC) (envelope-from peterjeremy@optushome.com.au) Received: from server.vk2pj.dyndns.org (c122-106-215-175.belrs3.nsw.optusnet.com.au [122.106.215.175]) by mail36.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id mAK6dbNO000699 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 20 Nov 2008 17:39:39 +1100 X-Bogosity: Ham, spamicity=0.000000 Received: from server.vk2pj.dyndns.org (localhost.vk2pj.dyndns.org [127.0.0.1]) by server.vk2pj.dyndns.org (8.14.3/8.14.3) with ESMTP id mAK6daEU047000; Thu, 20 Nov 2008 17:39:37 +1100 (EST) (envelope-from peter@server.vk2pj.dyndns.org) Received: (from peter@localhost) by server.vk2pj.dyndns.org (8.14.3/8.14.3/Submit) id mAK6daLu046999; Thu, 20 Nov 2008 17:39:36 +1100 (EST) (envelope-from peter) Date: Thu, 20 Nov 2008 17:39:36 +1100 From: Peter Jeremy To: Jeremy Chadwick Message-ID: <20081120063936.GU51761@server.vk2pj.dyndns.org> References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> <20081119104731.GA83366@icarus.home.lan> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="oOpJzULQ70+PGW7h" Content-Disposition: inline In-Reply-To: <20081119104731.GA83366@icarus.home.lan> X-PGP-Key: http://members.optusnet.com.au/peterjeremy/pubkey.asc User-Agent: Mutt/1.5.18 (2008-05-17) Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 06:39:41 -0000 --oOpJzULQ70+PGW7h Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2008-Nov-19 02:47:31 -0800, Jeremy Chadwick wrote: >There's a known "issue" with the kernel message buffer though: it's not >NULL'd out upon reboot. This is deliberate. If the system panics, stuff that was in the message buffer (and might not be on disk) can be read when the system reboots. If there is no crashdump, this might be the only record of what happened. > Meaning, in some cases (depends on the BIOS or >system), the kernel message buffer from single-user mode is retained >even after a reboot! A user can then do "dmesg" and see all the nifty >stuff you've done during single-user, which could include unencrypted >passwords if mergemaster was tinkering with passwd/master.passwd, etc.. There shouldn't be unencrypted passwords, though there might be encrypted passwords visible. >Rink Springer created a patch where the kernel message buffer will start >with NULL to keep this from happening, but it needs to be made into a >loader.conf tunable. I hope that never gets committed - it will make debugging kernel problems much harder. There is already a kern.msgbuf_clear sysctl and maybe people who are concerned about msgbuf leakage need to learn to use it. --=20 Peter Jeremy Please excuse any delays as the result of my ISP's inability to implement an MTA that is either RFC2821-compliant or matches their claimed behaviour. --oOpJzULQ70+PGW7h Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkklBigACgkQ/opHv/APuIfe7gCgwE65CL/NlY1YY3rY/WYN5FcM aYMAnRTfUD4o8FPXAjDX5jNaLj00iOlN =z8z3 -----END PGP SIGNATURE----- --oOpJzULQ70+PGW7h-- From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 07:08:23 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 363D61065673 for ; Thu, 20 Nov 2008 07:08:23 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA10.emeryville.ca.mail.comcast.net (qmta10.emeryville.ca.mail.comcast.net [76.96.30.17]) by mx1.freebsd.org (Postfix) with ESMTP id 1A1818FC1C for ; Thu, 20 Nov 2008 07:08:22 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA13.emeryville.ca.mail.comcast.net ([76.96.30.52]) by QMTA10.emeryville.ca.mail.comcast.net with comcast id hHXv1a00917UAYkAAK8Nzh; Thu, 20 Nov 2008 07:08:22 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA13.emeryville.ca.mail.comcast.net with comcast id hK8M1a00C2P6wsM8ZK8NkK; Thu, 20 Nov 2008 07:08:22 +0000 X-Authority-Analysis: v=1.0 c=1 a=NTqVaNuko5sA:10 a=QycZ5dHgAAAA:8 a=7ySiKpwm5Gyf5ejhsGsA:9 a=lKoVJt_BkARlFga_UG0A:7 a=fpa3h0kaXFS_iEoRmwBJBBKNTN0A:4 a=EoioJ0NPDVgA:10 a=SV7veod9ZcQA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id B8B5A33C1C; Wed, 19 Nov 2008 23:08:21 -0800 (PST) Date: Wed, 19 Nov 2008 23:08:21 -0800 From: Jeremy Chadwick To: Peter Jeremy Message-ID: <20081120070820.GA19307@icarus.home.lan> References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> <20081119104731.GA83366@icarus.home.lan> <20081120063936.GU51761@server.vk2pj.dyndns.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20081120063936.GU51761@server.vk2pj.dyndns.org> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 07:08:23 -0000 On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote: > On 2008-Nov-19 02:47:31 -0800, Jeremy Chadwick wrote: > >There's a known "issue" with the kernel message buffer though: it's not > >NULL'd out upon reboot. > > This is deliberate. If the system panics, stuff that was in the > message buffer (and might not be on disk) can be read when the system > reboots. If there is no crashdump, this might be the only record of > what happened. That doesn't sound deliberate at all -- it sounds like a quirk that people (you?) are relying on. I do not think any piece of the FreeBSD system (e.g. savecore, etc.) relies on this behaviour. You're under the mentality that the information is *always* available after a panic/reboot -- it isn't. I have 4 different Supermicro motherboards (all from different years) which will "most of the time" lose the msgbuf after rebooting from single-user -- but sometimes the msgbuf is retained. And no, bad hardware is not responsible for the randomness of the problem. I think it's been discussed in the past how/why this can happen. It has to do with what each BIOS manufacturer chooses to do with some parts of memory during start-up. I'm sure the "Quick Boot" (e.g. no extensive memory test, which really doesn't test anything these days) option plays a role, and that option is enabled by default on all motherboards I've used in the past 10 years. > > Meaning, in some cases (depends on the BIOS or > >system), the kernel message buffer from single-user mode is retained > >even after a reboot! A user can then do "dmesg" and see all the nifty > >stuff you've done during single-user, which could include unencrypted > >passwords if mergemaster was tinkering with passwd/master.passwd, etc.. > > There shouldn't be unencrypted passwords, though there might be encrypted > passwords visible. Sorry, that's what I meant. The point is that a lot of things can go on in single-user mode which can/will disclose information or data in files which users do not have access to. Once the system is rebooted, a non-root user can do "dmesg -a" and see this buffer, getting access to data he/she normally does not have access to. Do you and I agree that this is in fact a security risk/problem? > >Rink Springer created a patch where the kernel message buffer will start > >with NULL to keep this from happening, but it needs to be made into a > >loader.conf tunable. > > I hope that never gets committed - it will make debugging kernel > problems much harder. There is already a kern.msgbuf_clear sysctl and > maybe people who are concerned about msgbuf leakage need to learn to > use it. And this sysctl is only usable *after* the kernel loads, which means you lose all of the messages shown from the time the kernel loads to the time the sysctl is set (e.g. hardware detected/configured). This is even less acceptable, IMHO. I would like to see Rink's patch committed, as long as the loader tunable defaults to *off* (e.g. current/historic behaviour). I'll also ask Rink to chime in here with his thoughts/opinions. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 07:13:05 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1634C1065687 for ; Thu, 20 Nov 2008 07:13:05 +0000 (UTC) (envelope-from kientzle@freebsd.org) Received: from kientzle.com (kientzle.com [66.166.149.50]) by mx1.freebsd.org (Postfix) with ESMTP id CF7828FC0C for ; Thu, 20 Nov 2008 07:13:04 +0000 (UTC) (envelope-from kientzle@freebsd.org) Received: from [10.123.2.178] (p53.kientzle.com [66.166.149.53]) by kientzle.com (8.12.9/8.12.9) with ESMTP id mAK7D3tv027473; Wed, 19 Nov 2008 23:13:04 -0800 (PST) (envelope-from kientzle@freebsd.org) Message-ID: <49250DFA.2050208@freebsd.org> Date: Wed, 19 Nov 2008 23:12:58 -0800 From: Tim Kientzle User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20060422 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Nick Hibma References: <200811190842.59377.nick@van-laarhoven.org> In-Reply-To: <200811190842.59377.nick@van-laarhoven.org> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD Hackers Mailing List Subject: Re: Unicode USB strings conversion X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 07:13:05 -0000 Nick Hibma wrote: > In the USB code (and I bet it is the same in the USB4BSD code) unicode > characters in strings are converted in a very crude way to ASCII. As I have > a user on the line who sees rubbish in his logs and when using > usbctl/usbdevs/etc., I bet this is the problem. > > I'd like to try and fix this problem by using libkern/libiconv. > > 1) Is this the right approach to convert UTF8 to printable string in the > kernel? > > 2) Is this needed at all in the short term future? I remember seeing > attempts at making the kernel use UTF8. > > 3) Does anyone know of a good example in the code without me having to hunt > through the kernel to find it? > > For reference: The code that needs replacing is: > > usbd_get_string(): > > s = buf; > n = size / 2 - 1; > for (i = 0; i < n && i < len - 1; i++) { > c = UGETW(us.bString[i]); > /* Convert from Unicode, handle buggy strings. */ > if ((c & 0xff00) == 0) > *s++ = c; > else if ((c & 0x00ff) == 0 && swap) > *s++ = c >> 8; > else > *s++ = '?'; > } > *s++ = 0; > > I haven't got the USB specs handy, but I believe that this is a simple way > of converting LE and BE UTF8 to ASCII. First, get your terminology straight. It looks like UGETW() is returning 16-bit Unicode code points. That would be UTF-16, not UTF-8. UTF-8 is a popular multibyte encoding which uses 1 to 4 bytes per character. ASCII values (less than 128) get preserved, anything else gets encoded. There are two problems with UTF-16: First is determining the byte order. Second is that nobody displays UTF-16 directly. (Well, almost nobody.) The code above is fine if you're sure you're getting ASCII (it looks at each character and guesses the byte order) but is otherwise pretty lame. You didn't show the code that set the 'swap' variable. If you really want legible output, your best option by far is to really convert it to UTF8 and emit that. That still preserves ASCII, but gives a chance of viewing non-ASCII in a suitable terminal program. (And there are even a couple of folks looking into UTF8 support for syscons.) The basic UTF-16 to UTF-8 conversion is pretty simple: if (c < 0x7f) { *s++ = c; } else if (c < 0x7ff) { *s++ = 0xc0 | ((c >> 6) & 0x1f); *s++ = 0x80 | (c & 0x3f); } else if (c < 0xffff) { *s++ = 0xe0 | ((c >> 12) & 0x0f); *s++ = 0x80 | ((c >> 6) & 0x3f); *s++ = 0x80 | (c & 0x3f); } else { *s++ = 0xf0 | ((c >> 18) & 0x07); *s++ = 0x80 | ((c >> 12) & 0x3f); *s++ = 0x80 | ((c >> 6) & 0x3f); *s++ = 0x80 | (c & 0x3f); } This assumes that 'c' is a UTF-16 Unicode character in native byte order. If you really don't know the byte order, you'll need to find some way to guess. One way to guess is to assume that ASCII characters are common, in which case, you'll see things with the high order byte 0. In some environments, a "Byte-order mark" is used as the first character. This is character 0xFEFF. (The byte-swapped 0xFFFE is illegal, so if you see that, you know you've got the wrong byte order.) Good luck! Tim From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 07:48:37 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A97581065672 for ; Thu, 20 Nov 2008 07:48:37 +0000 (UTC) (envelope-from neldredge@math.ucsd.edu) Received: from euclid.ucsd.edu (euclid.ucsd.edu [132.239.145.52]) by mx1.freebsd.org (Postfix) with ESMTP id 8862F8FC0A for ; Thu, 20 Nov 2008 07:48:37 +0000 (UTC) (envelope-from neldredge@math.ucsd.edu) Received: from zeno.ucsd.edu (zeno.ucsd.edu [132.239.145.22]) by euclid.ucsd.edu (8.11.7p3+Sun/8.11.7) with ESMTP id mAK7mb625932; Wed, 19 Nov 2008 23:48:37 -0800 (PST) Received: from localhost (neldredg@localhost) by zeno.ucsd.edu (8.11.7p3+Sun/8.11.7) with ESMTP id mAK7mam23561; Wed, 19 Nov 2008 23:48:37 -0800 (PST) X-Authentication-Warning: zeno.ucsd.edu: neldredg owned process doing -bs Date: Wed, 19 Nov 2008 23:48:36 -0800 (PST) From: Nate Eldredge X-X-Sender: neldredg@zeno.ucsd.edu To: Jeremy Chadwick In-Reply-To: <20081120070820.GA19307@icarus.home.lan> Message-ID: References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> <20081119104731.GA83366@icarus.home.lan> <20081120063936.GU51761@server.vk2pj.dyndns.org> <20081120070820.GA19307@icarus.home.lan> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 07:48:37 -0000 On Wed, 19 Nov 2008, Jeremy Chadwick wrote: > On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote: >> I hope that never gets committed - it will make debugging kernel >> problems much harder. There is already a kern.msgbuf_clear sysctl and >> maybe people who are concerned about msgbuf leakage need to learn to >> use it. > > And this sysctl is only usable *after* the kernel loads, which means > you lose all of the messages shown from the time the kernel loads to > the time the sysctl is set (e.g. hardware detected/configured). This is > even less acceptable, IMHO. But surely you can arrange that the contents are written out to /var/log/messages first? E.g. a sequence like - mount /var - write buffer contents via syslogd - clear buffer via sysctl - allow user logins This way the buffer is cleared before any unprivileged users get to do anything. No kernel changes needed, just a little tweaking of the init scripts at most. If you should have a crash and suspect there is useful data in the buffer, you can boot to single-user mode (avoiding the clear) and retrieve it manually. Seems like this should make everyone happy. -- Nate Eldredge neldredge@math.ucsd.edu From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 07:54:49 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0424A1065670 for ; Thu, 20 Nov 2008 07:54:49 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.16.84]) by mx1.freebsd.org (Postfix) with ESMTP id B03B58FC1A for ; Thu, 20 Nov 2008 07:54:48 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from pampa.cs.huji.ac.il ([132.65.80.32]) by kabab.cs.huji.ac.il with esmtp id 1L341h-000IuJ-NP; Thu, 20 Nov 2008 09:32:33 +0200 X-Mailer: exmh version 2.7.2 01/07/2005 with nmh-1.2 To: "Julian Stacey" In-reply-to: <200811192218.mAJMIG1t066653@fire.js.berklix.net> References: <200811192218.mAJMIG1t066653@fire.js.berklix.net> Comments: In-reply-to "Julian Stacey" message dated "Wed, 19 Nov 2008 23:18:16 +0100." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Thu, 20 Nov 2008 09:32:33 +0200 From: Danny Braniss Message-ID: Cc: hackers@freebsd.org Subject: Re: Reccomendation for tools to use on FreeBSD for a wiki ? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 07:54:49 -0000 > > > - - I've had apache up for years, but no wiki yet, so if any tips, > > > shout please, even if just RTFM URL=.... :-) > > > > http://en.wikipedia.org/wiki/List_of_wiki_software > > http://en.wikipedia.org/wiki/Comparison_of_wiki_software > > Great ! Thanks a lot ! Will you tell us which one you selected? danny > > Cheers, > Julian > -- > Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com > Mail plain ASCII text. HTML & Base64 text are spam. www.asciiribbon.org > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 09:53:09 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 81DE8106564A; Thu, 20 Nov 2008 09:53:09 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id 0EE548FC08; Thu, 20 Nov 2008 09:53:09 +0000 (UTC) (envelope-from des@des.no) Received: from ds4.des.no (des.no [84.49.246.2]) by smtp.des.no (Postfix) with ESMTP id 0BDF56D43F; Thu, 20 Nov 2008 09:53:08 +0000 (UTC) Received: by ds4.des.no (Postfix, from userid 1001) id DF381844A1; Thu, 20 Nov 2008 10:53:07 +0100 (CET) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Jeremy Chadwick References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> <20081119104731.GA83366@icarus.home.lan> <20081120063936.GU51761@server.vk2pj.dyndns.org> <20081120070820.GA19307@icarus.home.lan> Date: Thu, 20 Nov 2008 10:53:07 +0100 In-Reply-To: <20081120070820.GA19307@icarus.home.lan> (Jeremy Chadwick's message of "Wed, 19 Nov 2008 23:08:21 -0800") Message-ID: <86r656oha4.fsf@ds4.des.no> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 09:53:09 -0000 Jeremy Chadwick writes: > Peter Jeremy writes: > > This is deliberate. If the system panics, stuff that was in the > > message buffer (and might not be on disk) can be read when the > > system reboots. If there is no crashdump, this might be the only > > record of what happened. > That doesn't sound deliberate at all -- it sounds like a quirk that > people (you?) are relying on. No, it is deliberate. Just because you don't like it doesn't mean we're morons. > You're under the mentality that the information is *always* available > after a panic/reboot -- it isn't. I have 4 different Supermicro > motherboards (all from different years) which will "most of the time" > lose the msgbuf after rebooting from single-user -- but sometimes the > msgbuf is retained. And no, bad hardware is not responsible for the > randomness of the problem. We know there are systems where it doesn't work. That doesn't mean it's not useful when it *does* work. There are also systems where it works reliably, including most SoC and SFF systems. > I think it's been discussed in the past how/why this can happen. It has > to do with what each BIOS manufacturer chooses to do with some parts of > memory during start-up. Mostly whether memory remains powered-on through the reset process. Speaking only of i386 / amd64 systems, there are several ways to reboot a computer: - Return to real mode and call the BIOS reboot subroutine. This will perform a cold boot (memory is cleared) or a warm boot (memory should not be cleared, but the BIOS may do so anyway) depending on the value stored at a specific location in memory. - On systems with an i8042 keyboard controller, one of the controller's output lines is usually wired to the CPU's reset pin. Writing a specific value to one of the keyboard controller's control registers causes it to pull that pin low. - Triple fault: set up an empty interrupt descriptor table and trigger an interrupt (e.g. divide by zero). The CPU will fail to invoke the corresponding interrupt descriptor, causing a double fault interrupt, which will fail to execute, causing a CPU reset. The latter two techniques can be used (and *have* been used) to switch back from protected mode to real mode, because they are faster than the documented method. Memory is *not* cleared, and the CPU will start executing whatever code is stored at 0xfffffff0 in real memory; this is normally a far jump into the BIOS reboot subroutine, so if you don't pull any tricks (e.g. jump to your own code that does whatever it was you needed to do in real mode, then return to protected mode), they are equivalent to the first technique. - ACPI reset: store the value specified by RESET_VALUE in the FADT into the register specified by RESET_REG in the FADT. According to the ACPI spec, this results in a cold boot. However, this part of the spec is optional, so not all motherboards support it. FreeBSD will only use ACPI reset if the hw.acpi.handle_reboot sysctl is not zero, which it is by default (mostly, if I recall correctly, because ACPI reset is unreliable). DES --=20 Dag-Erling Sm=C3=B8rgrav - des@des.no From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 10:03:15 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CAAF51065670 for ; Thu, 20 Nov 2008 10:03:15 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA06.emeryville.ca.mail.comcast.net (qmta06.emeryville.ca.mail.comcast.net [76.96.30.56]) by mx1.freebsd.org (Postfix) with ESMTP id ABABD8FC16 for ; Thu, 20 Nov 2008 10:03:15 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA13.emeryville.ca.mail.comcast.net ([76.96.30.52]) by QMTA06.emeryville.ca.mail.comcast.net with comcast id hN2U1a00117UAYkA6N3FrX; Thu, 20 Nov 2008 10:03:15 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA13.emeryville.ca.mail.comcast.net with comcast id hN3E1a0062P6wsM8ZN3Fr4; Thu, 20 Nov 2008 10:03:15 +0000 X-Authority-Analysis: v=1.0 c=1 a=NTqVaNuko5sA:10 a=QycZ5dHgAAAA:8 a=HZahj6u9mvrA2wFbLdIA:9 a=-nwF6JlQsMgHF_aUBBwA:7 a=qZ4zffk0aSq9YKyGt1g3O94mfPIA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id AA4B733C1C; Thu, 20 Nov 2008 02:03:14 -0800 (PST) Date: Thu, 20 Nov 2008 02:03:14 -0800 From: Jeremy Chadwick To: Nate Eldredge Message-ID: <20081120100314.GA22639@icarus.home.lan> References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> <20081119104731.GA83366@icarus.home.lan> <20081120063936.GU51761@server.vk2pj.dyndns.org> <20081120070820.GA19307@icarus.home.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 10:03:15 -0000 On Wed, Nov 19, 2008 at 11:48:36PM -0800, Nate Eldredge wrote: > On Wed, 19 Nov 2008, Jeremy Chadwick wrote: > >> On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote: > >>> I hope that never gets committed - it will make debugging kernel >>> problems much harder. There is already a kern.msgbuf_clear sysctl and >>> maybe people who are concerned about msgbuf leakage need to learn to >>> use it. >> >> And this sysctl is only usable *after* the kernel loads, which means >> you lose all of the messages shown from the time the kernel loads to >> the time the sysctl is set (e.g. hardware detected/configured). This is >> even less acceptable, IMHO. > > But surely you can arrange that the contents are written out to > /var/log/messages first? > > E.g. a sequence like > > - mount /var > - write buffer contents via syslogd > - clear buffer via sysctl > - allow user logins This has two problems, but I'm probably missing something: 1) See my original post, re: users of our systems use "dmesg" to find out what the status of the system is. By "status" I don't mean "from the point the kernel finished to now", I literally mean they *expect* to see the kernel device messages and all that jazz. No, I'm not making this up, nor am I arguing just to hear myself talk (despite popular belief). I can bring these users into the discussion if people feel it would be useful. 2) I don't understand how this would work (meaning, technically and literally: I do not understand). How do messages like "CPU: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz (2992.52-MHz K8-class CPU)" get written to syslog when syslogd isn't even running (or any filesystems) mounted at that time? There must be some magic involved there (since syslog == libc, not syscall) when syslogd starts, but I don't know how it works. > This way the buffer is cleared before any unprivileged users get to do > anything. No kernel changes needed, just a little tweaking of the init > scripts at most. > > If you should have a crash and suspect there is useful data in the > buffer, you can boot to single-user mode (avoiding the clear) and > retrieve it manually. > > Seems like this should make everyone happy. What I'm not understanding is the resistance towards Rink's patch, assuming the tunable defaults to disabled/off. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 10:06:03 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9D69C1065673 for ; Thu, 20 Nov 2008 10:06:03 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA04.westchester.pa.mail.comcast.net (qmta04.westchester.pa.mail.comcast.net [76.96.62.40]) by mx1.freebsd.org (Postfix) with ESMTP id 2A27A8FC1B for ; Thu, 20 Nov 2008 10:06:02 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA06.westchester.pa.mail.comcast.net ([76.96.62.51]) by QMTA04.westchester.pa.mail.comcast.net with comcast id hN5N1a00R16LCl054N61Wz; Thu, 20 Nov 2008 10:06:02 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA06.westchester.pa.mail.comcast.net with comcast id hN601a00A2P6wsM3SN61zG; Thu, 20 Nov 2008 10:06:01 +0000 X-Authority-Analysis: v=1.0 c=1 a=NTqVaNuko5sA:10 a=QycZ5dHgAAAA:8 a=RN_Y_efyUq0J-Pz98lUA:9 a=nerD5Tmr-U0gCS-Ae8eLVvtEzCsA:4 a=EoioJ0NPDVgA:10 a=SV7veod9ZcQA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 63C4233C1C; Thu, 20 Nov 2008 02:06:00 -0800 (PST) Date: Thu, 20 Nov 2008 02:06:00 -0800 From: Jeremy Chadwick To: Dag-Erling =?iso-8859-1?Q?Sm=F8rgrav?= Message-ID: <20081120100600.GB22639@icarus.home.lan> References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> <20081119104731.GA83366@icarus.home.lan> <20081120063936.GU51761@server.vk2pj.dyndns.org> <20081120070820.GA19307@icarus.home.lan> <86r656oha4.fsf@ds4.des.no> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <86r656oha4.fsf@ds4.des.no> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 10:06:03 -0000 On Thu, Nov 20, 2008 at 10:53:07AM +0100, Dag-Erling Smørgrav wrote: > Jeremy Chadwick writes: > > Peter Jeremy writes: > > > This is deliberate. If the system panics, stuff that was in the > > > message buffer (and might not be on disk) can be read when the > > > system reboots. If there is no crashdump, this might be the only > > > record of what happened. > > That doesn't sound deliberate at all -- it sounds like a quirk that > > people (you?) are relying on. > > No, it is deliberate. Just because you don't like it doesn't mean we're > morons. I said nothing about liking/disliking it, nor did I namecall or condescend. Thanks for being a complete prick, des. Jesus christ... -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 10:42:41 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0A1821065674; Thu, 20 Nov 2008 10:42:41 +0000 (UTC) (envelope-from neldredge@math.ucsd.edu) Received: from euclid.ucsd.edu (euclid.ucsd.edu [132.239.145.52]) by mx1.freebsd.org (Postfix) with ESMTP id 88D8B8FC13; Thu, 20 Nov 2008 10:42:40 +0000 (UTC) (envelope-from neldredge@math.ucsd.edu) Received: from zeno.ucsd.edu (zeno.ucsd.edu [132.239.145.22]) by euclid.ucsd.edu (8.11.7p3+Sun/8.11.7) with ESMTP id mAKAgd611162; Thu, 20 Nov 2008 02:42:39 -0800 (PST) Received: from localhost (neldredg@localhost) by zeno.ucsd.edu (8.11.7p3+Sun/8.11.7) with ESMTP id mAKAgdS23759; Thu, 20 Nov 2008 02:42:39 -0800 (PST) X-Authentication-Warning: zeno.ucsd.edu: neldredg owned process doing -bs Date: Thu, 20 Nov 2008 02:42:38 -0800 (PST) From: Nate Eldredge X-X-Sender: neldredg@zeno.ucsd.edu To: Jeremy Chadwick In-Reply-To: <20081120100314.GA22639@icarus.home.lan> Message-ID: References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> <20081119104731.GA83366@icarus.home.lan> <20081120063936.GU51761@server.vk2pj.dyndns.org> <20081120070820.GA19307@icarus.home.lan> <20081120100314.GA22639@icarus.home.lan> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD Hackers Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 10:42:41 -0000 On Thu, 20 Nov 2008, Jeremy Chadwick wrote: > On Wed, Nov 19, 2008 at 11:48:36PM -0800, Nate Eldredge wrote: >> On Wed, 19 Nov 2008, Jeremy Chadwick wrote: >> >>> On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote: >> >>>> I hope that never gets committed - it will make debugging kernel >>>> problems much harder. There is already a kern.msgbuf_clear sysctl and >>>> maybe people who are concerned about msgbuf leakage need to learn to >>>> use it. >>> >>> And this sysctl is only usable *after* the kernel loads, which means >>> you lose all of the messages shown from the time the kernel loads to >>> the time the sysctl is set (e.g. hardware detected/configured). This is >>> even less acceptable, IMHO. >> >> But surely you can arrange that the contents are written out to >> /var/log/messages first? >> >> E.g. a sequence like >> >> - mount /var >> - write buffer contents via syslogd >> - clear buffer via sysctl >> - allow user logins > > This has two problems, but I'm probably missing something: > > 1) See my original post, re: users of our systems use "dmesg" to find > out what the status of the system is. By "status" I don't mean "from > the point the kernel finished to now", I literally mean they *expect* > to see the kernel device messages and all that jazz. No, I'm not > making this up, nor am I arguing just to hear myself talk (despite > popular belief). I can bring these users into the discussion if people > feel it would be useful. I forgot about that point. I can sympathize with those users; I feel the same way. It's a good way to learn about a system as a mere user (since usually sysadmins don't remember or bother to disable it). However, in my experience dmesg isn't really the best thing for that purpose; the kernel message buffer tends to get wiped out once the system has been up for a while. (It fills with ipfw logs, ethernet link state changes, etc.) Maybe a better approach would be to point them to /var/log/messages or whichever log file stores them permanently. Or, better yet, do some syslogd magic to make a logfile that can be appropriately readable but doesn't have any overly sensitive messages directed there (e.g. kernel yes, sshd no). > 2) I don't understand how this would work (meaning, technically and > literally: I do not understand). How do messages like "CPU: Intel(R) > Core(TM)2 Duo CPU E8400 @ 3.00GHz (2992.52-MHz K8-class CPU)" get > written to syslog when syslogd isn't even running (or any filesystems) > mounted at that time? There must be some magic involved there (since > syslog == libc, not syscall) when syslogd starts, but I don't know > how it works. I think you're conflating a couple of things, and I also explained my idea poorly. As I understand it (from memory, which is a little vague), syslogd gets messages from two places: from the kernel via /dev/klog, and from other processes via a Unix domain socket in /var/run. These messages then get sent to the appropriate log files. The syslog(3) function of libc just connects and writes the message to the Unix domain socket. If syslogd isn't running to listen on that socket, syslog(3) won't work very well. Now /dev/klog should be a direct line to the kernel's message buffer. So when syslogd starts and reads /dev/klog for the first time, it will get everything that's accumulated so far, including the earliest boot messages. It should then write them to the appropriate log files. This already works, which is why /var/log/messages contains the kernel copyright message, etc. My idea is, after syslogd does this, but before the system goes multi-user, you should clear the kernel buffer. Early boot messages are already in the log files, so they won't be lost. Maybe the best thing would be to build this functionality into syslogd itself, to minimize the possibility of losing messages due to a race. >> This way the buffer is cleared before any unprivileged users get to do >> anything. No kernel changes needed, just a little tweaking of the init >> scripts at most. >> >> If you should have a crash and suspect there is useful data in the >> buffer, you can boot to single-user mode (avoiding the clear) and >> retrieve it manually. >> >> Seems like this should make everyone happy. > > What I'm not understanding is the resistance towards Rink's patch, > assuming the tunable defaults to disabled/off. It seems reasonable to me. The only catch I can see is that if you have a crash and you want to look at the message buffer after rebooting, you'll have to remember to stop at the loader prompt and turn off that tunable. Which might be easy to forget in the heat of the moment. -- Nate Eldredge neldredge@math.ucsd.edu From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 13:18:25 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F12A11065673 for ; Thu, 20 Nov 2008 13:18:25 +0000 (UTC) (envelope-from caelian@gmail.com) Received: from ug-out-1314.google.com (ug-out-1314.google.com [66.249.92.175]) by mx1.freebsd.org (Postfix) with ESMTP id 7AC2E8FC0A for ; Thu, 20 Nov 2008 13:18:25 +0000 (UTC) (envelope-from caelian@gmail.com) Received: by ug-out-1314.google.com with SMTP id 30so266315ugs.39 for ; Thu, 20 Nov 2008 05:18:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:cc:subject :message-id:in-reply-to:references:x-mailer:mime-version :content-type:content-transfer-encoding; bh=LsPLoiaS7f+gmZBzNH4ui2Vc4w99TM47bu/YwIw3QZs=; b=S/VgZMVpsb/fXx3EdKilb0TECDGD9aQ2g/Y0W8wyrDoK3dcEV3VWeyorH9hWu5zNEU ahwLLNgcn9F88DynP71M6Q7zVmAbgxabC2sCuck2KEv44NxrM7pb8mzqCrp/QgG0PJJP Om04y55vvVpgVzeW7z2vkLe4Cht4d9YItt//k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:in-reply-to:references:x-mailer :mime-version:content-type:content-transfer-encoding; b=fLqHOSPzrIJpASBnHiwNVYpkHKrmFpl9EKiDBEp60dcAoX8uJdDzprhJyLV3Bt092t VlDXbgN0+uAYsIxAv4E6yABHHO6rZVIK5vWAjzKhqkUWkBQi08ZZA7UbYZk0UN0Dt8Zm N6ElylQ/Z9XhbHYgdlKQbpUupTiM0B1ybiUow= Received: by 10.103.240.5 with SMTP id s5mr848188mur.133.1227185323160; Thu, 20 Nov 2008 04:48:43 -0800 (PST) Received: from nebuchadnezzar ([134.106.200.99]) by mx.google.com with ESMTPS id w5sm2954587mue.10.2008.11.20.04.48.42 (version=SSLv3 cipher=RC4-MD5); Thu, 20 Nov 2008 04:48:42 -0800 (PST) Date: Thu, 20 Nov 2008 13:48:36 +0100 From: Pascal Hofstee To: Pegasus Mc Cleaft Message-ID: <20081120134836.2870a827@nebuchadnezzar> In-Reply-To: References: X-Mailer: Claws Mail 3.5.0 (GTK+ 2.14.4; x86_64-pc-linux-gnu) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: hackers@freebsd.org Subject: Re: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 13:18:26 -0000 On Thu, 20 Nov 2008 01:46:31 -0000 "Pegasus Mc Cleaft" wrote: > Hi everyone, > > I am having difficulties rebuilding the world after some patches > were made today. I was wondering if anyone else is experiencing the > same troubles? > > ld -static -N --gc-sections -nostdlib -m elf_i386_fbsd -Ttext 0x0 -o > gptzfsboot.out /usr/obj/usr/src/sys/boot/i386/gptzfsboot/../btx/lib/crt0.o > zfsboot.o sio.o gptzfsboot.o ld: gptzfsboot.o: No such file: No such > file or directory *** Error code 1 > > Stop in /usr/src/sys/boot/i386/gptzfsboot. > *** Error code 1 I am experiencing the exact same problem with a fresh svn checkout -- Pascal Hofstee From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 14:17:07 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 104B41065674 for ; Thu, 20 Nov 2008 14:17:07 +0000 (UTC) (envelope-from keramida@ceid.upatras.gr) Received: from igloo.linux.gr (igloo.linux.gr [62.1.205.36]) by mx1.freebsd.org (Postfix) with ESMTP id 51DE58FC17 for ; Thu, 20 Nov 2008 14:17:05 +0000 (UTC) (envelope-from keramida@ceid.upatras.gr) Received: from kobe.laptop (adsl63-61.kln.forthnet.gr [77.49.190.61]) (authenticated bits=128) by igloo.linux.gr (8.14.3/8.14.3/Debian-5) with ESMTP id mAKE1jI7017797 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Thu, 20 Nov 2008 16:01:51 +0200 Received: from kobe.laptop (kobe.laptop [127.0.0.1]) by kobe.laptop (8.14.3/8.14.3) with ESMTP id mAKE1jxd002462; Thu, 20 Nov 2008 16:01:45 +0200 (EET) (envelope-from keramida@ceid.upatras.gr) Received: (from keramida@localhost) by kobe.laptop (8.14.3/8.14.3/Submit) id mAKE1ieC002461; Thu, 20 Nov 2008 16:01:44 +0200 (EET) (envelope-from keramida@ceid.upatras.gr) From: Giorgos Keramidas To: "Julian Stacey" In-Reply-To: <200811191724.mAJHOL8r062364@fire.js.berklix.net> (Julian Stacey's message of "Wed, 19 Nov 2008 18:24:21 +0100") Date: Thu, 20 Nov 2008 14:39:43 +0200 Message-ID: <8763miy3jk.fsf@kobe.laptop> References: <200811191724.mAJHOL8r062364@fire.js.berklix.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-MailScanner-ID: mAKE1jI7017797 X-Hellug-MailScanner: Found to be clean X-Hellug-MailScanner-SpamCheck: not spam, SpamAssassin (not cached, score=-3.859, required 5, autolearn=not spam, ALL_TRUSTED -1.80, AWL 0.54, BAYES_00 -2.60) X-Hellug-MailScanner-From: keramida@ceid.upatras.gr X-Spam-Status: No Cc: hackers@freebsd.org Subject: Re: Reccomendation for tools to use on FreeBSD for a wiki ? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 14:17:07 -0000 On Wed, 19 Nov 2008 18:24:21 +0100, "Julian Stacey" wrote: > Hi hackers, > Maybe Some of you might suggest some software I might install, Wiki I guess. ? > I got zero response from ports@, I could use some reccomendations please. > PS From http://wiki.freebsd.org/HelpContents I tried > cd /usr/ports/www ; vi *iki*/pkg-descr > or is /usr/ports/www/moinmoin the way to go ? > Thanks. > ----------- > > Subject: Reccomendation for ports for web based club events > forthcoming diary ? > > Can anyone reccomend some ports to install on a FreeBSD web server, > for a club of mostly non technical people, to support: > - All club members can add events to a forthcoming calendar, > - All club members can request server to prepare a listing > of next next upcoming events, to download (probably in PDF, > or perhaps tbl to a pipe or ? > - A list of moderators can delete fake events from robots & the malicious. > - Preferably moderators should not themselves be capable of > deleting logged event submission, but only capable of deleting > events formatted to the ouput printable programme sheet. (To > autopsy for suspect rogue moderators) > - I guess first entry criteria might be a fuzzy picture for human > to decode password from). 2nd might be mail return for confirm password, > - & 3rd, A majordomo (later mailman) maintained list of club members & > moderators etc is available for automated validation. > - I hope there will be some packages available, > http & probably wiki based etc, that will come close enough ? Hi Julian, I have been working with `OddMuse' in the EmacsWiki[1] as a user and as an admin/moderator in some installations of my own. The "UI" of the wiki is pretty simple, and it does have a very low level of requirements for becoming a `wiki editor', so it may be a good choice for a Wiki where non-technical people produce a lot of the content. OddMuse does have a relatively _unique_ way of treating Wiki content and may require a bit of Perl hackery to configure captchas, but I like the fact that it is basically a relatively small `wiki core' that is fairly trivial to extend by writing Perl modules. See for more details about the OddMuse wiki engine. Wikipedia has a list of other Wiki software at http://en.wikipedia.org/wiki/List_of_wiki_software that may also be useful. From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 15:39:01 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1D4431065672; Thu, 20 Nov 2008 15:39:01 +0000 (UTC) (envelope-from kevin@your.org) Received: from tokyo01.jp.mail.your.org (tokyo01.jp.mail.your.org [204.9.54.5]) by mx1.freebsd.org (Postfix) with ESMTP id BBA668FC16; Thu, 20 Nov 2008 15:39:00 +0000 (UTC) (envelope-from kevin@your.org) Received: from tokyo01.jp.mail.your.org (localhost.your.org [127.0.0.1]) by tokyo01.jp.mail.your.org (Postfix) with ESMTP id 2C7F02AD5627; Thu, 20 Nov 2008 15:21:50 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=your.org; h=message-id :from:to:in-reply-to:content-type:content-transfer-encoding :mime-version:subject:date:references; s=selector1; bh=HQXqCfnVb OADsu/twmXYbw4deV0=; b=TmRGBXoCK1kMx5WBuRREgx/XBvpApbkODS8ZmkaMB VvB0iM7dMskEADF/Yc9g7Q7GNbv4NbtJf2cO1NJzeoAZh9ubET0KaIcU7Vq5lW7C P+eFVxLyMLvPhfiMkKfFzIcQ6r/xi0XTrwkf2TQN9aRA6MqvCs5fHRMqlDHEWgfQ 1k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=your.org; h=message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references; q=dns; s=selector1; b=Kxl7EUYdjfKgF3jI mneQsThJfTZtuln8bRBOMizmYCpIMjHRg/SOn8U3ISGIsDDE7LEp3kSCcdmprGzd wqDiJS0QALVI5ZUZHv7tp+AaABcZ4HRZPz7yC3TzO0sIlJwAGVOPlZDNaXOkvzia bNAT4DjK04ErfHEbbshMASL6Rnw= Received: from mail.your.org (server3-a.your.org [64.202.112.67]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by tokyo01.jp.mail.your.org (Postfix) with ESMTPS id B60402AD5534; Thu, 20 Nov 2008 15:21:49 +0000 (UTC) Received: from [216.14.99.244] (unknown [216.14.99.244]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.your.org (Postfix) with ESMTPSA id CA31CA0A423; Thu, 20 Nov 2008 15:21:37 +0000 (UTC) Message-Id: From: Kevin Day To: Jeremy Chadwick , FreeBSD Hackers In-Reply-To: <61AFAC99-50A3-40BC-8EF0-809FB78C3B49@dragondata.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 20 Nov 2008 09:21:47 -0600 References: <20081028081154.GQ6808@hoeg.nl> <20081118213410.GA81783@hoeg.nl> <20081118214919.GM83287@bunrab.catwhisker.org> <7d6fde3d0811190202p4f6d8941h3932b70b8fe1a93a@mail.gmail.com> <20081119104731.GA83366@icarus.home.lan> <20081120063936.GU51761@server.vk2pj.dyndns.org> <20081120070820.GA19307@icarus.home.lan> <20081120100314.GA22639@icarus.home.lan> <61AFAC99-50A3-40BC-8EF0-809FB78C3B49@dragondata.com> X-Mailer: Apple Mail (2.929.2) Cc: Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 15:39:01 -0000 On Nov 20, 2008, at 4:03 AM, Jeremy Chadwick wrote: > > This has two problems, but I'm probably missing something: > > 1) See my original post, re: users of our systems use "dmesg" to find > out what the status of the system is. By "status" I don't mean "from > the point the kernel finished to now", I literally mean they *expect* > to see the kernel device messages and all that jazz. No, I'm not > making this up, nor am I arguing just to hear myself talk (despite > popular belief). I can bring these users into the discussion if > people > feel it would be useful. Sorry for jumping in late, but... cat /var/run/dmesg.boot Is that acceptable? I know it depends on what end users want, but some of my old hosting customers really just wanted to see the specs of the box and nothing else. Making dmesg a shell script that just cats that file satisfied everyone who asked. Also: > On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote: >> On 2008-Nov-19 02:47:31 -0800, Jeremy Chadwick >> wrote: >>> There's a known "issue" with the kernel message buffer though: >>> it's not >>> NULL'd out upon reboot. >> >> This is deliberate. If the system panics, stuff that was in the >> message buffer (and might not be on disk) can be read when the system >> reboots. If there is no crashdump, this might be the only record of >> what happened. > > That doesn't sound deliberate at all -- it sounds like a quirk that > people (you?) are relying on. I do not think any piece of the FreeBSD > system (e.g. savecore, etc.) relies on this behaviour. > > You're under the mentality that the information is *always* available > after a panic/reboot -- it isn't. I have 4 different Supermicro > motherboards (all from different years) which will "most of the time" > lose the msgbuf after rebooting from single-user -- but sometimes the > msgbuf is retained. And no, bad hardware is not responsible for the > randomness of the problem. > > I think it's been discussed in the past how/why this can happen. It > has > to do with what each BIOS manufacturer chooses to do with some parts > of > memory during start-up. I'm sure the "Quick Boot" (e.g. no extensive > memory test, which really doesn't test anything these days) option > plays > a role, and that option is enabled by default on all motherboards I've > used in the past 10 years. I've been involved with a few embedded systems, some BSD based some not. In a few cases we've used custom BIOSes on the motherboard. At least one BIOS SDK specifically describes this as a feature. What is exposed to the end user as "Quick Boot" is actually several options that the motherboard designer/BIOS configurer can select. One of which is specifying which chunks of memory should be preserved after a reboot, up to "memory tests should be as non-destructive as possible". While you can't *rely* on it, with careful use of atomic writes and state checking you can pick up where you left off after a reboot on an embedded device that has no long-term storage if it was a warm boot. Or, gathering crash dumps and sending them off to the network. Here, the dmesg buffer is a simple ring buffer in the kernel. The start/end pointers and contents of the ring buffer are deliberately not cleared after a reboot in FreeBSD to at least make the information available if the BIOS didn't clobber it. This can be extremely useful in those "a box on the other side of the world keeps rebooting with no panic", if you can tell the BIOS to skip the memory check. In one case I even (ab)used some extra video ram on the motherboard as a dmesg buffer since the video bios didn't wipe it on boot, but the system's bios insisted on doing a full memory test each time. If you have a BIOS that's sometimes but not always wiping the buffer, it's probably because a few bits are being lost while the motherboard turns the DRAM refresh off during the reboot. Some DIMMS can handle no refresh for tens of seconds, some start popping bit errors rather quickly. Take a look at sys/kern/subr_msgbuf.c:msgbuf_reinit. There's a magic number it looks for as well as a checksum on the whole buffer that's updated after every write. If anything changes, the kernel throws out the whole buffer and starts fresh. If you boot with "-v" you'll probably see "msgbuf cksum mismatch". While I don't think any of the shipping FreeBSD tools rely on this behavior, I know I tried submitting a patch back in the FreeBSD-2.2(?) days to fix that "overlooked uninitialized buffer" and got educated by jkh pretty quickly. :) From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 17:00:11 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 88F951065673 for ; Thu, 20 Nov 2008 17:00:11 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.freebsd.org (Postfix) with ESMTP id 52AD08FC19 for ; Thu, 20 Nov 2008 17:00:10 +0000 (UTC) (envelope-from fjwcash@gmail.com) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id 665621A000B0C for ; Thu, 20 Nov 2008 08:31:49 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at smtp.sd73.bc.ca Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id CkPFgl8zIa0M for ; Thu, 20 Nov 2008 08:31:47 -0800 (PST) Received: from coal (unknown [192.168.0.10]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 2C1C91A000B3E for ; Thu, 20 Nov 2008 08:31:47 -0800 (PST) From: Freddie Cash To: freebsd-hackers@freebsd.org Date: Thu, 20 Nov 2008 08:31:46 -0800 User-Agent: KMail/1.9.9 References: <20081120100314.GA22639@icarus.home.lan> In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811200831.47062.fjwcash@gmail.com> Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 17:00:11 -0000 On November 20, 2008 02:42 am Nate Eldredge wrote: > On Thu, 20 Nov 2008, Jeremy Chadwick wrote: > > On Wed, Nov 19, 2008 at 11:48:36PM -0800, Nate Eldredge wrote: > >> On Wed, 19 Nov 2008, Jeremy Chadwick wrote: > >>> On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote: > >>>> I hope that never gets committed - it will make debugging kernel > >>>> problems much harder. There is already a kern.msgbuf_clear sysctl > >>>> and maybe people who are concerned about msgbuf leakage need to > >>>> learn to use it. > >>> > >>> And this sysctl is only usable *after* the kernel loads, which > >>> means you lose all of the messages shown from the time the kernel > >>> loads to the time the sysctl is set (e.g. hardware > >>> detected/configured). This is even less acceptable, IMHO. > >> > >> But surely you can arrange that the contents are written out to > >> /var/log/messages first? > >> > >> E.g. a sequence like > >> > >> - mount /var > >> - write buffer contents via syslogd > >> - clear buffer via sysctl > >> - allow user logins > > > > This has two problems, but I'm probably missing something: > > > > 1) See my original post, re: users of our systems use "dmesg" to find > > out what the status of the system is. By "status" I don't mean "from > > the point the kernel finished to now", I literally mean they *expect* > > to see the kernel device messages and all that jazz. No, I'm not > > making this up, nor am I arguing just to hear myself talk (despite > > popular belief). I can bring these users into the discussion if > > people feel it would be useful. > > I forgot about that point. I can sympathize with those users; I > feel the same way. It's a good way to learn about a system as a > mere user (since usually sysadmins don't remember or bother to > disable it). > > However, in my experience dmesg isn't really the best thing for that > purpose; the kernel message buffer tends to get wiped out once the > system has been up for a while. (It fills with ipfw logs, ethernet > link state changes, etc.) > > Maybe a better approach would be to point them to /var/log/messages > or whichever log file stores them permanently. I think what you are looking for is /var/run/dmesg.boot, which stores just the dmesg info from the initial boot. Nothing gets logged to this after the boot is complete. This file has been a life saver quite a few times since I discovered it, and is something I really miss when working with mis-behaving Linux systems. -- Freddie Cash fjwcash@gmail.com From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 17:44:12 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3998B1065672 for ; Thu, 20 Nov 2008 17:44:12 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from flat.berklix.org (flat.berklix.org [83.236.223.115]) by mx1.freebsd.org (Postfix) with ESMTP id B53F18FC1B for ; Thu, 20 Nov 2008 17:44:11 +0000 (UTC) (envelope-from jhs@berklix.org) Received: from js.berklix.net (p549A53C2.dip.t-dialin.net [84.154.83.194]) (authenticated bits=0) by flat.berklix.org (8.13.8/8.13.8) with ESMTP id mAKHhjYp053798; Thu, 20 Nov 2008 18:43:46 +0100 (CET) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by js.berklix.net (8.13.8/8.13.8) with ESMTP id mAKHhYg5063046; Thu, 20 Nov 2008 18:43:34 +0100 (CET) (envelope-from jhs@berklix.org) Received: from fire.js.berklix.net (localhost [127.0.0.1]) by fire.js.berklix.net (8.13.8/8.13.8) with ESMTP id mAKHhOE4012470; Thu, 20 Nov 2008 18:43:29 +0100 (CET) (envelope-from jhs@fire.js.berklix.net) Message-Id: <200811201743.mAKHhOE4012470@fire.js.berklix.net> To: Danny Braniss From: "Julian Stacey" Organization: http://berklix.com BSD Unix Linux Consultancy, Munich Germany User-agent: EXMH on FreeBSD http://berklix.com/free/ X-URL: http://berklix.com In-reply-to: Your message "Thu, 20 Nov 2008 09:32:33 +0200." Date: Thu, 20 Nov 2008 18:43:24 +0100 Sender: jhs@berklix.org Cc: hackers@freebsd.org Subject: Re: Reccomendation for tools to use on FreeBSD for a wiki ? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 17:44:12 -0000 Hi, > Will you tell us which one you selected? Happy to, when I know which & why, likely it'll be a while before that. Just an unpaid hobby, not spending 8 hours/day on selection/install tuning. Whether then I'll remember to post, or you'll want to remind me, we'll see :-) PS I started with /usr/ports/www/moinmoin as that's what wiki.freebs.org uses, & then I seitched to CGI not FCGI option as it sounded easier. Then I saw post by Giogios & need to think about that. Thanks Julian -- Julian Stacey: BSDUnixLinux C Prog Admin SysEng Consult Munich www.berklix.com Mail plain ASCII text. HTML & Base64 text are spam. www.asciiribbon.org From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 18:57:55 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C9DF6106564A for ; Thu, 20 Nov 2008 18:57:55 +0000 (UTC) (envelope-from olivier@gid0.org) Received: from rn-out-0910.google.com (rn-out-0910.google.com [64.233.170.187]) by mx1.freebsd.org (Postfix) with ESMTP id 856008FC0A for ; Thu, 20 Nov 2008 18:57:55 +0000 (UTC) (envelope-from olivier@gid0.org) Received: by rn-out-0910.google.com with SMTP id j71so512966rne.12 for ; Thu, 20 Nov 2008 10:57:54 -0800 (PST) Received: by 10.143.3.4 with SMTP id f4mr1281553wfi.146.1227207473605; Thu, 20 Nov 2008 10:57:53 -0800 (PST) Received: by 10.142.179.14 with HTTP; Thu, 20 Nov 2008 10:57:53 -0800 (PST) Message-ID: <367b2c980811201057y4e44e0ehb227d37702d98c43@mail.gmail.com> Date: Thu, 20 Nov 2008 19:57:53 +0100 From: "Olivier SMEDTS" To: "Pascal Hofstee" In-Reply-To: <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081120134836.2870a827@nebuchadnezzar> <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> Cc: hackers@freebsd.org, Pegasus Mc Cleaft Subject: Re: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 18:57:55 -0000 What is your MACHINE_ARCH ? Mine is amd64, I think there's a problem with the conditional in sys/boot/i386/gptzfsboot/Makefile. ld doesn't need gptzfsboot.o on i386. Olivier 2008/11/20 Olivier SMEDTS : > 2008/11/20 Pascal Hofstee : >> On Thu, 20 Nov 2008 01:46:31 -0000 >> "Pegasus Mc Cleaft" wrote: >> >>> Hi everyone, >>> >>> I am having difficulties rebuilding the world after some patches >>> were made today. I was wondering if anyone else is experiencing the >>> same troubles? >>> >>> ld -static -N --gc-sections -nostdlib -m elf_i386_fbsd -Ttext 0x0 -o >>> gptzfsboot.out /usr/obj/usr/src/sys/boot/i386/gptzfsboot/../btx/lib/crt0.o >>> zfsboot.o sio.o gptzfsboot.o ld: gptzfsboot.o: No such file: No such >>> file or directory *** Error code 1 >>> >>> Stop in /usr/src/sys/boot/i386/gptzfsboot. >>> *** Error code 1 >> >> I am experiencing the exact same problem with a fresh svn checkout > > Just my "me too". > I did not experience the problem 24 hours ago (after ZFS version 13 > update and zfsboot import). > >> >> -- >> Pascal Hofstee >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >> > > > > -- > Olivier Smedts _ > ASCII ribbon campaign ( ) > e-mail: olivier@gid0.org - against HTML email & vCards X > www: http://www.gid0.org - against proprietary attachments / \ > > "Il y a seulement 10 sortes de gens dans le monde : > ceux qui comprennent le binaire, > et ceux qui ne le comprennent pas." > -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: olivier@gid0.org - against HTML email & vCards X www: http://www.gid0.org - against proprietary attachments / \ "Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas." From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 19:05:14 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 86AB3106564A for ; Thu, 20 Nov 2008 19:05:14 +0000 (UTC) (envelope-from olivier@gid0.org) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.169]) by mx1.freebsd.org (Postfix) with ESMTP id 62E448FC19 for ; Thu, 20 Nov 2008 19:05:14 +0000 (UTC) (envelope-from olivier@gid0.org) Received: by wf-out-1314.google.com with SMTP id 24so640366wfg.7 for ; Thu, 20 Nov 2008 11:05:13 -0800 (PST) Received: by 10.142.223.20 with SMTP id v20mr1285662wfg.7.1227206302900; Thu, 20 Nov 2008 10:38:22 -0800 (PST) Received: by 10.142.179.14 with HTTP; Thu, 20 Nov 2008 10:38:22 -0800 (PST) Message-ID: <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> Date: Thu, 20 Nov 2008 19:38:22 +0100 From: "Olivier SMEDTS" To: "Pascal Hofstee" In-Reply-To: <20081120134836.2870a827@nebuchadnezzar> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081120134836.2870a827@nebuchadnezzar> Cc: hackers@freebsd.org, Pegasus Mc Cleaft Subject: Re: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 19:05:14 -0000 2008/11/20 Pascal Hofstee : > On Thu, 20 Nov 2008 01:46:31 -0000 > "Pegasus Mc Cleaft" wrote: > >> Hi everyone, >> >> I am having difficulties rebuilding the world after some patches >> were made today. I was wondering if anyone else is experiencing the >> same troubles? >> >> ld -static -N --gc-sections -nostdlib -m elf_i386_fbsd -Ttext 0x0 -o >> gptzfsboot.out /usr/obj/usr/src/sys/boot/i386/gptzfsboot/../btx/lib/crt0.o >> zfsboot.o sio.o gptzfsboot.o ld: gptzfsboot.o: No such file: No such >> file or directory *** Error code 1 >> >> Stop in /usr/src/sys/boot/i386/gptzfsboot. >> *** Error code 1 > > I am experiencing the exact same problem with a fresh svn checkout Just my "me too". I did not experience the problem 24 hours ago (after ZFS version 13 update and zfsboot import). > > -- > Pascal Hofstee > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: olivier@gid0.org - against HTML email & vCards X www: http://www.gid0.org - against proprietary attachments / \ "Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas." From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 19:07:09 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B01361065675 for ; Thu, 20 Nov 2008 19:07:09 +0000 (UTC) (envelope-from olivier@gid0.org) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.168]) by mx1.freebsd.org (Postfix) with ESMTP id 8AF7E8FC17 for ; Thu, 20 Nov 2008 19:07:09 +0000 (UTC) (envelope-from olivier@gid0.org) Received: by wf-out-1314.google.com with SMTP id 24so641088wfg.7 for ; Thu, 20 Nov 2008 11:07:08 -0800 (PST) Received: by 10.142.213.9 with SMTP id l9mr1284165wfg.206.1227208027857; Thu, 20 Nov 2008 11:07:07 -0800 (PST) Received: by 10.142.179.14 with HTTP; Thu, 20 Nov 2008 11:07:07 -0800 (PST) Message-ID: <367b2c980811201107x7fc859b8yeee0816a37eae470@mail.gmail.com> Date: Thu, 20 Nov 2008 20:07:07 +0100 From: "Olivier SMEDTS" To: "Pascal Hofstee" In-Reply-To: <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081120134836.2870a827@nebuchadnezzar> <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> Cc: hackers@freebsd.org, Pegasus Mc Cleaft , current@freebsd.org Subject: Re: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 19:07:09 -0000 2008/11/20 Olivier SMEDTS : > 2008/11/20 Pascal Hofstee : >> On Thu, 20 Nov 2008 01:46:31 -0000 >> "Pegasus Mc Cleaft" wrote: >> >>> Hi everyone, >>> >>> I am having difficulties rebuilding the world after some patches >>> were made today. I was wondering if anyone else is experiencing the >>> same troubles? >>> >>> ld -static -N --gc-sections -nostdlib -m elf_i386_fbsd -Ttext 0x0 -o >>> gptzfsboot.out /usr/obj/usr/src/sys/boot/i386/gptzfsboot/../btx/lib/crt0.o >>> zfsboot.o sio.o gptzfsboot.o ld: gptzfsboot.o: No such file: No such >>> file or directory *** Error code 1 >>> >>> Stop in /usr/src/sys/boot/i386/gptzfsboot. >>> *** Error code 1 >> >> I am experiencing the exact same problem with a fresh svn checkout > > Just my "me too". > I did not experience the problem 24 hours ago (after ZFS version 13 > update and zfsboot import). That's it. Seems to work with the following patch : --- sys/boot/i386/gptzfsboot/Makefile.orig 2008-11-20 19:58:45.000000000 +0100 +++ sys/boot/i386/gptzfsboot/Makefile 2008-11-20 20:01:53.000000000 +0100 @@ -65,7 +65,7 @@ zfsboot.o: ${.CURDIR}/../../zfs/zfsimpl.c .if ${MACHINE_ARCH} == "amd64" -beforedepend gptzfsboot.o: machine +beforedepend gptzfsboot.bin: machine CLEANFILES+= machine machine: ln -sf ${.CURDIR}/../../../i386/include machine I've cc'ed current@ because HEAD is broken on amd64 for now. Cheers, Olivier > >> >> -- >> Pascal Hofstee >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >> > > > > -- > Olivier Smedts _ > ASCII ribbon campaign ( ) > e-mail: olivier@gid0.org - against HTML email & vCards X > www: http://www.gid0.org - against proprietary attachments / \ > > "Il y a seulement 10 sortes de gens dans le monde : > ceux qui comprennent le binaire, > et ceux qui ne le comprennent pas." > -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: olivier@gid0.org - against HTML email & vCards X www: http://www.gid0.org - against proprietary attachments / \ "Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas." From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 19:41:15 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0E5CD106564A for ; Thu, 20 Nov 2008 19:41:14 +0000 (UTC) (envelope-from olivier@gid0.org) Received: from yx-out-2324.google.com (yx-out-2324.google.com [74.125.44.29]) by mx1.freebsd.org (Postfix) with ESMTP id 8D0F08FC0C for ; Thu, 20 Nov 2008 19:41:14 +0000 (UTC) (envelope-from olivier@gid0.org) Received: by yx-out-2324.google.com with SMTP id 8so284625yxb.13 for ; Thu, 20 Nov 2008 11:41:13 -0800 (PST) Received: by 10.142.44.11 with SMTP id r11mr1293638wfr.249.1227210072376; Thu, 20 Nov 2008 11:41:12 -0800 (PST) Received: by 10.142.179.14 with HTTP; Thu, 20 Nov 2008 11:41:11 -0800 (PST) Message-ID: <367b2c980811201141j42977204ne6052000a0d095ab@mail.gmail.com> Date: Thu, 20 Nov 2008 20:41:11 +0100 From: "Olivier SMEDTS" To: "Pascal Hofstee" In-Reply-To: <367b2c980811201107x7fc859b8yeee0816a37eae470@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081120134836.2870a827@nebuchadnezzar> <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> <367b2c980811201107x7fc859b8yeee0816a37eae470@mail.gmail.com> Cc: hackers@freebsd.org, Pegasus Mc Cleaft , current@freebsd.org Subject: Re: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 19:41:15 -0000 2008/11/20 Olivier SMEDTS : > 2008/11/20 Olivier SMEDTS : >> 2008/11/20 Pascal Hofstee : >>> On Thu, 20 Nov 2008 01:46:31 -0000 >>> "Pegasus Mc Cleaft" wrote: >>> >>>> Hi everyone, >>>> >>>> I am having difficulties rebuilding the world after some patches >>>> were made today. I was wondering if anyone else is experiencing the >>>> same troubles? >>>> >>>> ld -static -N --gc-sections -nostdlib -m elf_i386_fbsd -Ttext 0x0 -o >>>> gptzfsboot.out /usr/obj/usr/src/sys/boot/i386/gptzfsboot/../btx/lib/crt0.o >>>> zfsboot.o sio.o gptzfsboot.o ld: gptzfsboot.o: No such file: No such >>>> file or directory *** Error code 1 >>>> >>>> Stop in /usr/src/sys/boot/i386/gptzfsboot. >>>> *** Error code 1 >>> >>> I am experiencing the exact same problem with a fresh svn checkout >> >> Just my "me too". >> I did not experience the problem 24 hours ago (after ZFS version 13 >> update and zfsboot import). > > That's it. Seems to work with the following patch : > > --- sys/boot/i386/gptzfsboot/Makefile.orig 2008-11-20 > 19:58:45.000000000 +0100 > +++ sys/boot/i386/gptzfsboot/Makefile 2008-11-20 20:01:53.000000000 +0100 > @@ -65,7 +65,7 @@ > zfsboot.o: ${.CURDIR}/../../zfs/zfsimpl.c > > .if ${MACHINE_ARCH} == "amd64" > -beforedepend gptzfsboot.o: machine > +beforedepend gptzfsboot.bin: machine > CLEANFILES+= machine > machine: > ln -sf ${.CURDIR}/../../../i386/include machine Sorry for replying again to my own post :) The patch is crap, in fact it just breaks the already broken conditional. At least I can buildworld on amd64 now (I don't use the recently introduced gptzfsboot). Makefile experts ? > > I've cc'ed current@ because HEAD is broken on amd64 for now. > > Cheers, > > Olivier > > >> >>> >>> -- >>> Pascal Hofstee >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >>> >> >> >> >> -- >> Olivier Smedts _ >> ASCII ribbon campaign ( ) >> e-mail: olivier@gid0.org - against HTML email & vCards X >> www: http://www.gid0.org - against proprietary attachments / \ >> >> "Il y a seulement 10 sortes de gens dans le monde : >> ceux qui comprennent le binaire, >> et ceux qui ne le comprennent pas." >> > > > > -- > Olivier Smedts _ > ASCII ribbon campaign ( ) > e-mail: olivier@gid0.org - against HTML email & vCards X > www: http://www.gid0.org - against proprietary attachments / \ > > "Il y a seulement 10 sortes de gens dans le monde : > ceux qui comprennent le binaire, > et ceux qui ne le comprennent pas." > -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: olivier@gid0.org - against HTML email & vCards X www: http://www.gid0.org - against proprietary attachments / \ "Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas." From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 19:49:09 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 489DA1065670 for ; Thu, 20 Nov 2008 19:49:09 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from hercules.mthelicon.com (hercules.mthelicon.com [IPv6:2001:49f0:2023::2]) by mx1.freebsd.org (Postfix) with ESMTP id 0DF628FC20 for ; Thu, 20 Nov 2008 19:49:08 +0000 (UTC) (envelope-from ken@mthelicon.com) Received: from feathers.peganest.com ([IPv6:2001:4d48:ad51:32:21b:21ff:fe1c:3ce]) (authenticated bits=0) by hercules.mthelicon.com (8.14.3/8.14.2) with ESMTP id mAKJn7wh037057 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Thu, 20 Nov 2008 19:49:08 GMT (envelope-from ken@mthelicon.com) From: Pegasus Mc Cleaft Organization: Feathers To: "Olivier SMEDTS" Date: Thu, 20 Nov 2008 19:49:06 +0000 User-Agent: KMail/1.10.1 (FreeBSD/8.0-CURRENT; KDE/4.1.1; amd64; ; ) References: <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> <367b2c980811201057y4e44e0ehb227d37702d98c43@mail.gmail.com> In-Reply-To: <367b2c980811201057y4e44e0ehb227d37702d98c43@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200811201949.06286.ken@mthelicon.com> Cc: hackers@freebsd.org, Pascal Hofstee Subject: Re: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 19:49:09 -0000 On Thursday 20 November 2008 18:57:53 Olivier SMEDTS wrote: > What is your MACHINE_ARCH ? > Mine is amd64, I think there's a problem with the conditional in > sys/boot/i386/gptzfsboot/Makefile. > ld doesn't need gptzfsboot.o on i386. > > Olivier > > 2008/11/20 Olivier SMEDTS : > > 2008/11/20 Pascal Hofstee : > >> On Thu, 20 Nov 2008 01:46:31 -0000 > >> > >> "Pegasus Mc Cleaft" wrote: > >>> Hi everyone, > >>> > >>> I am having difficulties rebuilding the world after some patches > >>> were made today. I was wondering if anyone else is experiencing the > >>> same troubles? Hi Oliver, My machine is an Core2 Quad running under AMD64. (CPUTYPE?=core2) Thanks for replying. It puts my mind to ease because I was thinking it was a problem I created (I recently moved the /usr/src directory into a seperate zfs filing system) Peg From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 20:36:15 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5CFD61065672 for ; Thu, 20 Nov 2008 20:36:15 +0000 (UTC) (envelope-from zozo@q.gid0.org) Received: from postfix1-g20.free.fr (postfix1-g20.free.fr [212.27.60.42]) by mx1.freebsd.org (Postfix) with ESMTP id E1FB88FC1D for ; Thu, 20 Nov 2008 20:36:14 +0000 (UTC) (envelope-from zozo@q.gid0.org) Received: from smtp3-g19.free.fr (smtp3-g19.free.fr [212.27.42.29]) by postfix1-g20.free.fr (Postfix) with ESMTP id 8222A2DF7761 for ; Thu, 20 Nov 2008 21:13:51 +0100 (CET) Received: from smtp3-g19.free.fr (localhost.localdomain [127.0.0.1]) by smtp3-g19.free.fr (Postfix) with ESMTP id 02F2217C811; Thu, 20 Nov 2008 21:13:48 +0100 (CET) Received: from q.gid0.org (s.gid0.org [88.163.116.140]) by smtp3-g19.free.fr (Postfix) with ESMTP id 84FC617C8E1; Thu, 20 Nov 2008 21:13:41 +0100 (CET) Received: (from zozo@localhost) by q.gid0.org (8.14.3/8.14.3/Submit) id mAKKDbFG077333; Thu, 20 Nov 2008 21:13:37 +0100 (CET) (envelope-from zozo) Date: Thu, 20 Nov 2008 21:13:37 +0100 From: Olivier SMEDTS To: Pegasus Mc Cleaft Message-ID: <20081120201336.GA66837@q.gid0.org> References: <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> <367b2c980811201057y4e44e0ehb227d37702d98c43@mail.gmail.com> <200811201949.06286.ken@mthelicon.com> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="9jxsPFA5p3P2qPhR" Content-Disposition: inline In-Reply-To: <200811201949.06286.ken@mthelicon.com> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: hackers@freebsd.org, current@freebsd.org, Pascal Hofstee Subject: Re: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 20:36:15 -0000 --9jxsPFA5p3P2qPhR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Thu, Nov 20, 2008 at 07:49:06PM +0000, Pegasus Mc Cleaft wrote: > On Thursday 20 November 2008 18:57:53 Olivier SMEDTS wrote: > > What is your MACHINE_ARCH ? > > Mine is amd64, I think there's a problem with the conditional in > > sys/boot/i386/gptzfsboot/Makefile. > > ld doesn't need gptzfsboot.o on i386. Now I think I've got it : All the '.if ${MACHINE_ARCH} == "amd64"' which replace the amd64 machine link with an i386 one are useless on 7.0 and -CURRENT since rev. 1.17 of sys/boot/efi/libefi/Makefile. This file already takes care of replacing MACHINE_ARCH. And I don't think zfs*boot will be in 6-STABLE. You can apply the following patch in sys/boot/i386. I'll submit a PR if it's not committed before. Cheers, Olivier > > > > Olivier > > > > 2008/11/20 Olivier SMEDTS : > > > 2008/11/20 Pascal Hofstee : > > >> On Thu, 20 Nov 2008 01:46:31 -0000 > > >> > > >> "Pegasus Mc Cleaft" wrote: > > >>> Hi everyone, > > >>> > > >>> I am having difficulties rebuilding the world after some patches > > >>> were made today. I was wondering if anyone else is experiencing the > > >>> same troubles? > > > > Hi Oliver, > My machine is an Core2 Quad running under AMD64. (CPUTYPE?=core2) > > Thanks for replying. It puts my mind to ease because I was thinking it was a > problem I created (I recently moved the /usr/src directory into a seperate zfs > filing system) > > Peg -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: olivier@gid0.org - against HTML email & vCards X www: http://www.gid0.org - against proprietary attachments / \ "Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas." --9jxsPFA5p3P2qPhR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline; filename=patch --- boot2/Makefile.orig 2008-11-20 20:56:31.000000000 +0100 +++ boot2/Makefile 2008-11-20 20:56:42.000000000 +0100 @@ -94,11 +94,4 @@ ORG1=`printf "%d" ${ORG1}` \ REL1=`printf "%d" ${REL1}` > ${.TARGET} -.if ${MACHINE_ARCH} == "amd64" -beforedepend boot2.s: machine -CLEANFILES+= machine -machine: - ln -sf ${.CURDIR}/../../../i386/include machine -.endif - .include --- gptboot/Makefile.orig 2008-11-20 20:50:34.000000000 +0100 +++ gptboot/Makefile 2008-11-20 20:50:40.000000000 +0100 @@ -67,11 +67,4 @@ gptboot.o: ${.CURDIR}/../../common/ufsread.c -.if ${MACHINE_ARCH} == "amd64" -beforedepend gptboot.o: machine -CLEANFILES+= machine -machine: - ln -sf ${.CURDIR}/../../../i386/include machine -.endif - .include --- libfirewire/Makefile.orig 2008-11-20 20:56:07.000000000 +0100 +++ libfirewire/Makefile 2008-11-20 20:56:18.000000000 +0100 @@ -16,15 +16,4 @@ CFLAGS+= -Wformat -Wall -.if ${MACHINE_ARCH} == "amd64" -CLEANFILES+= machine -machine: - ln -sf ${.CURDIR}/../../../i386/include machine -.endif - .include - -.if ${MACHINE_ARCH} == "amd64" -beforedepend ${OBJS}: machine -.endif - --- libi386/Makefile.orig 2008-11-20 20:55:38.000000000 +0100 +++ libi386/Makefile 2008-11-20 20:55:55.000000000 +0100 @@ -45,14 +45,4 @@ # the location of libstand CFLAGS+= -I${.CURDIR}/../../../../lib/libstand/ -.if ${MACHINE_ARCH} == "amd64" -CLEANFILES+= machine -machine: - ln -sf ${.CURDIR}/../../../i386/include machine -.endif - .include - -.if ${MACHINE_ARCH} == "amd64" -beforedepend ${OBJS}: machine -.endif --- loader/Makefile.orig 2008-11-20 20:54:43.000000000 +0100 +++ loader/Makefile 2008-11-20 20:54:58.000000000 +0100 @@ -110,10 +110,3 @@ LDADD= ${LIBFICL} ${LIBFIREWIRE} ${LIBZFS} ${LIBI386} -lstand .include - -.if ${MACHINE_ARCH} == "amd64" -beforedepend ${OBJS}: machine -CLEANFILES+= machine -machine: - ln -sf ${.CURDIR}/../../../i386/include machine -.endif --- zfsboot/Makefile.orig 2008-11-20 20:54:18.000000000 +0100 +++ zfsboot/Makefile 2008-11-20 20:54:27.000000000 +0100 @@ -98,11 +98,4 @@ ORG1=`printf "%d" ${ORG1}` \ REL1=`printf "%d" ${REL1}` > ${.TARGET} -.if ${MACHINE_ARCH} == "amd64" -beforedepend zfsboot.s: machine -CLEANFILES+= machine -machine: - ln -sf ${.CURDIR}/../../../i386/include machine -.endif - .include --- gptzfsboot/Makefile.orig 2008-11-20 19:58:45.000000000 +0100 +++ gptzfsboot/Makefile 2008-11-20 20:50:25.000000000 +0100 @@ -64,11 +64,4 @@ zfsboot.o: ${.CURDIR}/../../zfs/zfsimpl.c -.if ${MACHINE_ARCH} == "amd64" -beforedepend gptzfsboot.o: machine -CLEANFILES+= machine -machine: - ln -sf ${.CURDIR}/../../../i386/include machine -.endif - .include --9jxsPFA5p3P2qPhR-- From owner-freebsd-hackers@FreeBSD.ORG Thu Nov 20 21:52:01 2008 Return-Path: Delivered-To: hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F3E3A1065678 for ; Thu, 20 Nov 2008 21:52:00 +0000 (UTC) (envelope-from olivier@gid0.org) Received: from wf-out-1314.google.com (wf-out-1314.google.com [209.85.200.175]) by mx1.freebsd.org (Postfix) with ESMTP id CEEDF8FC1B for ; Thu, 20 Nov 2008 21:52:00 +0000 (UTC) (envelope-from olivier@gid0.org) Received: by wf-out-1314.google.com with SMTP id 24so701134wfg.7 for ; Thu, 20 Nov 2008 13:52:00 -0800 (PST) Received: by 10.142.48.14 with SMTP id v14mr1348855wfv.284.1227217919611; Thu, 20 Nov 2008 13:51:59 -0800 (PST) Received: by 10.142.179.14 with HTTP; Thu, 20 Nov 2008 13:51:59 -0800 (PST) Message-ID: <367b2c980811201351q3e920fdex5b377ceb8dc0fad3@mail.gmail.com> Date: Thu, 20 Nov 2008 22:51:59 +0100 From: "Olivier SMEDTS" To: "Pegasus Mc Cleaft" In-Reply-To: <20081120201336.GA66837@q.gid0.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <367b2c980811201038s7d2ae03bnf36a6630f36bc188@mail.gmail.com> <367b2c980811201057y4e44e0ehb227d37702d98c43@mail.gmail.com> <200811201949.06286.ken@mthelicon.com> <20081120201336.GA66837@q.gid0.org> Cc: hackers@freebsd.org, current@freebsd.org, Pascal Hofstee Subject: Re: build problems with gptzfsboot (AMD64) 8.0-CURRENT X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Nov 2008 21:52:01 -0000 2008/11/20 Olivier SMEDTS : > On Thu, Nov 20, 2008 at 07:49:06PM +0000, Pegasus Mc Cleaft wrote: >> On Thursday 20 November 2008 18:57:53 Olivier SMEDTS wrote: >> > What is your MACHINE_ARCH ? >> > Mine is amd64, I think there's a problem with the conditional in >> > sys/boot/i386/gptzfsboot/Makefile. >> > ld doesn't need gptzfsboot.o on i386. > > Now I think I've got it : > > All the '.if ${MACHINE_ARCH} == "amd64"' which replace the amd64 machine > link with an i386 one are useless on 7.0 and -CURRENT since rev. 1.17 of > sys/boot/efi/libefi/Makefile. This file already takes care of replacing > MACHINE_ARCH. And I don't think zfs*boot will be in 6-STABLE. Wow, still not good... I was too enthusiastic while waiting for a fresh buildworld to finish. It worked without cleaning though (buildworld without patch then patch then make clean in sys/boot/i386 then finish buildworld without cleaning). Must have missed something. I give up for today, I think I really must sleep :) > > You can apply the following patch in sys/boot/i386. I'll submit a PR if > it's not committed before. > > Cheers, > Olivier > > >> > >> > Olivier >> > >> > 2008/11/20 Olivier SMEDTS : >> > > 2008/11/20 Pascal Hofstee : >> > >> On Thu, 20 Nov 2008 01:46:31 -0000 >> > >> >> > >> "Pegasus Mc Cleaft" wrote: >> > >>> Hi everyone, >> > >>> >> > >>> I am having difficulties rebuilding the world after some patches >> > >>> were made today. I was wondering if anyone else is experiencing the >> > >>> same troubles? >> >> >> >> Hi Oliver, >> My machine is an Core2 Quad running under AMD64. (CPUTYPE?=core2) >> >> Thanks for replying. It puts my mind to ease because I was thinking it was a >> problem I created (I recently moved the /usr/src directory into a seperate zfs >> filing system) >> >> Peg -- Olivier Smedts _ ASCII ribbon campaign ( ) e-mail: olivier@gid0.org - against HTML email & vCards X www: http://www.gid0.org - against proprietary attachments / \ "Il y a seulement 10 sortes de gens dans le monde : ceux qui comprennent le binaire, et ceux qui ne le comprennent pas." From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 01:54:26 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 798C81065674 for ; Sat, 22 Nov 2008 01:54:26 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.237]) by mx1.freebsd.org (Postfix) with ESMTP id 298978FC08 for ; Sat, 22 Nov 2008 01:54:26 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so1167207rvf.43 for ; Fri, 21 Nov 2008 17:54:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=AsXdT8q04Ap/5cNTnIuX4X4k2/Aru5MbztXX7l5VwY4=; b=Up79uEEPFLNIlp7/pBH5fbZJT5sfxR6Nfp17l8Hm6+lk1ClBLQVexai/QJ69Qc2I5f l1oELbBHfWickOP5GBIrtVQRj+tuWFFRjl4fNU7ZbTwmRiwjSdUt0PcAG5z/Yjmf9VoM +SFSFRDQHnk9omc3OHcSWWCkyxXD/DEFLU1DI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=Nj94ermIIYkj93iEQXRTSHZdp3ZLE2VMebcu7FPpD1VfkNApOUlNqz5Iig/EVpYb8H djL3/93svMQg1hMyzF7ndOFItIPn4C73KYOgrYVz1bb9JhKyJV//MX3REyxwJLZ/2BgJ ssYUA1MS+dA8L+zibt6e2hgSsXMlckYckjyF4= Received: by 10.141.29.14 with SMTP id g14mr617318rvj.150.1227318865550; Fri, 21 Nov 2008 17:54:25 -0800 (PST) Received: by 10.141.79.14 with HTTP; Fri, 21 Nov 2008 17:54:25 -0800 (PST) Message-ID: <7d6fde3d0811211754s220cc980l1a43109155c7013f@mail.gmail.com> Date: Fri, 21 Nov 2008 17:54:25 -0800 From: "Garrett Cooper" To: "Freddie Cash" In-Reply-To: <200811200831.47062.fjwcash@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20081120100314.GA22639@icarus.home.lan> <200811200831.47062.fjwcash@gmail.com> Cc: freebsd-hackers@freebsd.org Subject: Re: [Testers wanted] /dev/console cleanups X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 01:54:26 -0000 On Thu, Nov 20, 2008 at 8:31 AM, Freddie Cash wrote: > On November 20, 2008 02:42 am Nate Eldredge wrote: >> On Thu, 20 Nov 2008, Jeremy Chadwick wrote: >> > On Wed, Nov 19, 2008 at 11:48:36PM -0800, Nate Eldredge wrote: >> >> On Wed, 19 Nov 2008, Jeremy Chadwick wrote: >> >>> On Thu, Nov 20, 2008 at 05:39:36PM +1100, Peter Jeremy wrote: >> >>>> I hope that never gets committed - it will make debugging kernel >> >>>> problems much harder. There is already a kern.msgbuf_clear sysctl >> >>>> and maybe people who are concerned about msgbuf leakage need to >> >>>> learn to use it. >> >>> >> >>> And this sysctl is only usable *after* the kernel loads, which >> >>> means you lose all of the messages shown from the time the kernel >> >>> loads to the time the sysctl is set (e.g. hardware >> >>> detected/configured). This is even less acceptable, IMHO. >> >> >> >> But surely you can arrange that the contents are written out to >> >> /var/log/messages first? >> >> >> >> E.g. a sequence like >> >> >> >> - mount /var >> >> - write buffer contents via syslogd >> >> - clear buffer via sysctl >> >> - allow user logins >> > >> > This has two problems, but I'm probably missing something: >> > >> > 1) See my original post, re: users of our systems use "dmesg" to find >> > out what the status of the system is. By "status" I don't mean "from >> > the point the kernel finished to now", I literally mean they *expect* >> > to see the kernel device messages and all that jazz. No, I'm not >> > making this up, nor am I arguing just to hear myself talk (despite >> > popular belief). I can bring these users into the discussion if >> > people feel it would be useful. >> >> I forgot about that point. I can sympathize with those users; I >> feel the same way. It's a good way to learn about a system as a >> mere user (since usually sysadmins don't remember or bother to >> disable it). >> >> However, in my experience dmesg isn't really the best thing for that >> purpose; the kernel message buffer tends to get wiped out once the >> system has been up for a while. (It fills with ipfw logs, ethernet >> link state changes, etc.) >> >> Maybe a better approach would be to point them to /var/log/messages >> or whichever log file stores them permanently. > > I think what you are looking for is /var/run/dmesg.boot, which stores just > the dmesg info from the initial boot. Nothing gets logged to this after > the boot is complete. This file has been a life saver quite a few times > since I discovered it, and is something I really miss when working with > mis-behaving Linux systems. > > -- > Freddie Cash > fjwcash@gmail.com [gcooper@optimus ~]$ grep -rs dmesg.boot /usr/src/ /usr/src/contrib/ntp/scripts/freq_adj.in: open(DM, "/var/run/dmesg.boot"); /usr/src/etc/defaults/rc.conf:dmesg_enable="YES" # Save dmesg(8) to /var/run/dmesg.boot /usr/src/etc/rc.d/dmesg:dmesg_file="/var/run/dmesg.boot" /usr/src/sbin/dmesg/dmesg.8:.Bl -tag -width ".Pa /var/run/dmesg.boot" -compact /usr/src/sbin/dmesg/dmesg.8:.It Pa /var/run/dmesg.boot [gcooper@optimus ~]$ /etc/rc.d/dmesg does this. -Garrett From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 11:01:19 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B94E81065672 for ; Sat, 22 Nov 2008 11:01:19 +0000 (UTC) (envelope-from kuku@kukulies.org) Received: from werkwelt.de (post.werkwelt.de [91.194.85.74]) by mx1.freebsd.org (Postfix) with ESMTP id 51F638FC16 for ; Sat, 22 Nov 2008 11:01:18 +0000 (UTC) (envelope-from kuku@kukulies.org) Received: from [88.78.221.91] (account kuku@kukulies.org HELO [192.168.2.101]) by werkwelt.de (CommuniGate Pro SMTP 5.0.13) with ESMTPSA id 6462703 for freebsd-hackers@freebsd.org; Sat, 22 Nov 2008 12:01:00 +0100 Message-ID: <4927E659.3010602@kukulies.org> Date: Sat, 22 Nov 2008 12:00:41 +0100 From: Christoph Kukulies User-Agent: Thunderbird 2.0.0.18 (Windows/20081105) MIME-Version: 1.0 To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit Subject: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 11:01:19 -0000 Since the underlying OS of Mac OS is FreeBSD I'm wondering whether itr is possible to mount a .dmg file as it is used in Apple software distribution for the Mac OS. I would like to install an Apple iPhone configuration utility on my FreeBSD box (iPhoneConfigurationUtility.dmg). It consists of a web application that is supposedly capable of doing updates of Apple iPhones through a web service. (good for company wide distribution of address book information and other data that iPhones can hold). -- Christoph Kukulies From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 12:55:40 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 25C5B1065674 for ; Sat, 22 Nov 2008 12:55:40 +0000 (UTC) (envelope-from onemda@gmail.com) Received: from mail-gx0-f12.google.com (mail-gx0-f12.google.com [209.85.217.12]) by mx1.freebsd.org (Postfix) with ESMTP id B59148FC14 for ; Sat, 22 Nov 2008 12:55:39 +0000 (UTC) (envelope-from onemda@gmail.com) Received: by gxk5 with SMTP id 5so219577gxk.19 for ; Sat, 22 Nov 2008 04:55:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=9UqTBBsmyDCeJFPzf7ux48kIB0QzMB2RcI0X7VnaRX0=; b=SMtpSEXiwNOz0e76mrWMmzc2xwYnL5otfoVgsiKQG2KkuFDXb+SO6oTRTcQ4aUaMNy 15/ehI5NBBXPU09LN9hpI6eAE+hTtIWEX8yka4xYxIqZbTT4V6zFcBzeCc+hOr7UFRgO eWdXDRpn05zNRz2ZIILBvmnvZH1qdVHXzh7AI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=TR3u0+KghXJYjyc+J3u0LK8UlHEdzfCuOrSh1VcdesOiVBH5povh4tpPMkBnA8WtH4 4iXGFp9Wv0EDq6da1jTn/SVHL1V3xqlKzOKFJEG7XUlC5jiiMbcl2ZrewPqz+LYSnZTS G+fWhAWwncgS/apok7vx0NcaoclBc2G+Xc0zg= Received: by 10.231.16.75 with SMTP id n11mr31613iba.45.1227358538147; Sat, 22 Nov 2008 04:55:38 -0800 (PST) Received: by 10.231.11.7 with HTTP; Sat, 22 Nov 2008 04:55:38 -0800 (PST) Message-ID: <3a142e750811220455u1fe2cc48sb25a1911a6bfe351@mail.gmail.com> Date: Sat, 22 Nov 2008 13:55:38 +0100 From: "Paul B. Mahol" To: "Christoph Kukulies" In-Reply-To: <4927E659.3010602@kukulies.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <4927E659.3010602@kukulies.org> Cc: freebsd-hackers@freebsd.org Subject: Re: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 12:55:40 -0000 On 11/22/08, Christoph Kukulies wrote: > Since the underlying OS of Mac OS is FreeBSD Wrong. > I'm wondering whether itr is possible to mount a > .dmg file as it is used in Apple software distribution for the Mac OS. I > would like to install an > Apple iPhone configuration utility on my FreeBSD box > (iPhoneConfigurationUtility.dmg). It consists of a > web application that is supposedly capable of doing updates of Apple > iPhones through a web service. > (good for company wide distribution of address book information and > other data that iPhones can hold). Currently not always possible - depends which actual fs is stored in .dmg file. Some time ago there was utility in development which allowed mounting of hfs+ on FreeBSD. There is dmg2iso (but it is not in ports ....) -- Paul From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 13:58:16 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DFA861065672 for ; Sat, 22 Nov 2008 13:58:16 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id 94E2D8FC16 for ; Sat, 22 Nov 2008 13:58:16 +0000 (UTC) (envelope-from des@des.no) Received: from ds4.des.no (des.no [84.49.246.2]) by smtp.des.no (Postfix) with ESMTP id 8B6F76D43F; Sat, 22 Nov 2008 13:58:15 +0000 (UTC) Received: by ds4.des.no (Postfix, from userid 1001) id 6D0708448F; Sat, 22 Nov 2008 14:58:15 +0100 (CET) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Christoph Kukulies References: <4927E659.3010602@kukulies.org> Date: Sat, 22 Nov 2008 14:58:15 +0100 In-Reply-To: <4927E659.3010602@kukulies.org> (Christoph Kukulies's message of "Sat, 22 Nov 2008 12:00:41 +0100") Message-ID: <863ahjc16w.fsf@ds4.des.no> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-hackers@freebsd.org Subject: Re: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 13:58:17 -0000 Christoph Kukulies writes: > Since the underlying OS of Mac OS is FreeBSD It isn't, as someone else pointed out, and hence... > I'm wondering whether itr is possible to mount a .dmg file as it is > used in Apple software distribution for the Mac OS. I would like to > install an Apple iPhone configuration utility on my FreeBSD box > (iPhoneConfigurationUtility.dmg). ...Mac OS applications won't run on FreeBSD, so there's no point in even trying. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@des.no From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 14:02:31 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 615CD1065670 for ; Sat, 22 Nov 2008 14:02:31 +0000 (UTC) (envelope-from kuku@kukulies.org) Received: from werkwelt.de (post.werkwelt.de [91.194.85.74]) by mx1.freebsd.org (Postfix) with ESMTP id EB5E18FC0A for ; Sat, 22 Nov 2008 14:02:30 +0000 (UTC) (envelope-from kuku@kukulies.org) Received: from [88.78.221.91] (account kuku@kukulies.org HELO [192.168.2.101]) by werkwelt.de (CommuniGate Pro SMTP 5.0.13) with ESMTPSA id 6462746; Sat, 22 Nov 2008 15:02:06 +0100 Message-ID: <492810C8.6010109@kukulies.org> Date: Sat, 22 Nov 2008 15:01:44 +0100 From: Christoph Kukulies User-Agent: Thunderbird 2.0.0.18 (Windows/20081105) MIME-Version: 1.0 To: =?UTF-8?B?RGFnLUVybGluZyBTbcO4cmdyYXY=?= References: <4927E659.3010602@kukulies.org> <863ahjc16w.fsf@ds4.des.no> In-Reply-To: <863ahjc16w.fsf@ds4.des.no> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org Subject: Re: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 14:02:31 -0000 Dag-Erling Smørgrav schrieb: > Christoph Kukulies writes: > >> Since the underlying OS of Mac OS is FreeBSD >> > > It isn't, as someone else pointed out, and hence... > > Always thought that at some point in time it was derived from an earlier version of FreeBSD (4.x) >> I'm wondering whether itr is possible to mount a .dmg file as it is >> used in Apple software distribution for the Mac OS. I would like to >> install an Apple iPhone configuration utility on my FreeBSD box >> (iPhoneConfigurationUtility.dmg). >> > > ...Mac OS applications won't run on FreeBSD, so there's no point in even > trying. > It may be some java stuff. I'm not sure though since I didn't peek into the dmg-file yet. > DES > Thanks anyway, Christoph From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 14:36:25 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 286251065670 for ; Sat, 22 Nov 2008 14:36:25 +0000 (UTC) (envelope-from erikt@midgard.homeip.net) Received: from ch-smtp02.sth.basefarm.net (ch-smtp02.sth.basefarm.net [80.76.149.213]) by mx1.freebsd.org (Postfix) with ESMTP id CBCC38FC18 for ; Sat, 22 Nov 2008 14:36:24 +0000 (UTC) (envelope-from erikt@midgard.homeip.net) Received: from c83-255-48-78.bredband.comhem.se ([83.255.48.78]:54058 helo=falcon.midgard.homeip.net) by ch-smtp02.sth.basefarm.net with esmtp (Exim 4.68) (envelope-from ) id 1L3tax-0000uc-8q for freebsd-hackers@freebsd.org; Sat, 22 Nov 2008 15:36:23 +0100 Received: (qmail 80781 invoked from network); 22 Nov 2008 15:36:20 +0100 Received: from owl.midgard.homeip.net (10.1.5.7) by falcon.midgard.homeip.net with ESMTP; 22 Nov 2008 15:36:20 +0100 Received: (qmail 88306 invoked by uid 1001); 22 Nov 2008 15:36:20 +0100 Date: Sat, 22 Nov 2008 15:36:20 +0100 From: Erik Trulsson To: Christoph Kukulies Message-ID: <20081122143620.GA88245@owl.midgard.homeip.net> References: <4927E659.3010602@kukulies.org> <863ahjc16w.fsf@ds4.des.no> <492810C8.6010109@kukulies.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: <492810C8.6010109@kukulies.org> User-Agent: Mutt/1.5.18 (2008-05-17) X-Originating-IP: 83.255.48.78 X-Scan-Result: No virus found in message 1L3tax-0000uc-8q. X-Scan-Signature: ch-smtp02.sth.basefarm.net 1L3tax-0000uc-8q 7d8251500d1716a5f04c4c5eb59bd9d7 Cc: Dag-Erling =?iso-8859-1?Q?Sm=F8rgrav?= , freebsd-hackers@freebsd.org Subject: Re: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 14:36:25 -0000 On Sat, Nov 22, 2008 at 03:01:44PM +0100, Christoph Kukulies wrote: > Dag-Erling Sm=F8rgrav schrieb: > > Christoph Kukulies writes: > > =20 > >> Since the underlying OS of Mac OS is FreeBSD > >> =20 > > > > It isn't, as someone else pointed out, and hence... > > > > =20 > Always thought that at some point in time it was derived from an earlier= =20 > version of FreeBSD (4.x) Parts of it was derived from FreeBSD (mainly userland stuff.) Other parts of MacOS X (including the kernel) was mainly derived from Mach,= =20 and some parts were of course written by Apple themselves (or taken from other places.) So, even though it is in part derived from FreeBSD, you should not expect any sort of binary compatibility between them. --=20 Erik Trulsson ertr1013@student.uu.se From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 15:58:59 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BFC72106564A for ; Sat, 22 Nov 2008 15:58:59 +0000 (UTC) (envelope-from ap@bnc.net) Received: from mailomat.net (mailomat.net [81.20.89.254]) by mx1.freebsd.org (Postfix) with ESMTP id 29CAD8FC16 for ; Sat, 22 Nov 2008 15:58:58 +0000 (UTC) (envelope-from ap@bnc.net) X-Mailomat-SpamCatcher-Score: 2 [X] X-Mailomat-Cloudmark-Score: 0.000000 [] Received: from [194.39.192.125] (account bnc-mail@mailrelay.mailomat.net HELO bnc.net) by mailomat.net (CommuniGate Pro SMTP 5.2.8) with ESMTPSA id 48497506; Sat, 22 Nov 2008 15:58:57 +0100 X-Junk-Score: 2 [X] X-SpamCatcher-Score: 2 [X] Received: from [194.39.192.126] (account ap HELO [194.39.194.83]) by bnc.net (CommuniGate Pro SMTP 5.2.8) with ESMTPSA id 3352990; Sat, 22 Nov 2008 15:58:56 +0100 Message-Id: <89C78BA8-5133-4B84-B893-D7826233B54B@bnc.net> From: Achim Patzner To: Christoph Kukulies In-Reply-To: <492810C8.6010109@kukulies.org> Content-Type: multipart/signed; boundary=Apple-Mail-8--49365435; micalg=sha1; protocol="application/pkcs7-signature" Mime-Version: 1.0 (Apple Message framework v929.2) Date: Sat, 22 Nov 2008 15:58:57 +0100 References: <4927E659.3010602@kukulies.org> <863ahjc16w.fsf@ds4.des.no> <492810C8.6010109@kukulies.org> X-Mailer: Apple Mail (2.929.2) X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-hackers Subject: Re: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 15:58:59 -0000 --Apple-Mail-8--49365435 Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Am 22.11.2008 um 15:01 schrieb Christoph Kukulies: >>> I would like to >>> install an Apple iPhone configuration utility on my FreeBSD box >>> (iPhoneConfigurationUtility.dmg). >> ...Mac OS applications won't run on FreeBSD, so there's no point in >> even >> trying. > It may be some java stuff. It is not. It's a Cocoa application. > I'm not sure I am. Achim --Apple-Mail-8--49365435-- From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 16:05:49 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ACD1A1065679 for ; Sat, 22 Nov 2008 16:05:49 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id 670BF8FC12 for ; Sat, 22 Nov 2008 16:05:49 +0000 (UTC) (envelope-from des@des.no) Received: from ds4.des.no (des.no [84.49.246.2]) by smtp.des.no (Postfix) with ESMTP id 931166D43F; Sat, 22 Nov 2008 16:05:47 +0000 (UTC) Received: by ds4.des.no (Postfix, from userid 1001) id 6FFA58448F; Sat, 22 Nov 2008 17:05:47 +0100 (CET) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Erik Trulsson References: <4927E659.3010602@kukulies.org> <863ahjc16w.fsf@ds4.des.no> <492810C8.6010109@kukulies.org> <20081122143620.GA88245@owl.midgard.homeip.net> Date: Sat, 22 Nov 2008 17:05:47 +0100 In-Reply-To: <20081122143620.GA88245@owl.midgard.homeip.net> (Erik Trulsson's message of "Sat, 22 Nov 2008 15:36:20 +0100") Message-ID: <86y6zbagpw.fsf@ds4.des.no> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-hackers@freebsd.org, Christoph Kukulies Subject: Re: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 16:05:49 -0000 Erik Trulsson writes: > Parts of it was derived from FreeBSD (mainly userland stuff.) Other > parts of MacOS X (including the kernel) was mainly derived from Mach, > and some parts were of course written by Apple themselves (or taken > from other places.) You got it almost entirely wrong... There are significant amounts of FreeBSD code in the Mac OS X kernel (the network stack, the VFS layer, several file systems, access control, security auditing and more). Mach provides only IPC, scheduling and virtual memory, IIRC. The rest of the kernel (including all device drivers) is proprietary Apple code. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@des.no From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 22:06:41 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8E7FA106567C for ; Sat, 22 Nov 2008 22:06:41 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.228]) by mx1.freebsd.org (Postfix) with ESMTP id 6DCE78FC0C for ; Sat, 22 Nov 2008 22:06:41 +0000 (UTC) (envelope-from yanefbsd@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so1451642rvf.43 for ; Sat, 22 Nov 2008 14:06:41 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=2o/C2Tss1bCaseLJpjxdw5eLsWvs/Dq++/oVKuNHBmY=; b=yBv4p64kcEUg4H2IWwPm1QDUHtAl1lO9bPSCYKbAMwIThzK9/gd/2DmKNF0uFXrY/g CWLXZ+jRp18/o4OqAOfnICZSyycUeu6fYOYcsQKlqHpER6P4R2qpQyqHtp4fPYFYHcLI GatFQQ605zhD7AGyjQVWODxdhM1k9nDDPYVM4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=i0bloLXtyzLljPi9M+ycV+pUCjwOCQ0+NQi0Bs4a/EAJ3ok0dHCSDIBaXWEiP924A9 beq015XsrpFe5Z3pxj8mTPiMPukrladqU27erbflxSODUGFQAEa24V89i36b6DxTzIK2 2z9tLzBJDZHEDLFqKmO3D3eGVOEEZDCP+qA34= Received: by 10.141.106.14 with SMTP id i14mr1035749rvm.27.1227391599850; Sat, 22 Nov 2008 14:06:39 -0800 (PST) Received: by 10.140.158.13 with HTTP; Sat, 22 Nov 2008 14:06:39 -0800 (PST) Message-ID: <7d6fde3d0811221406u38de767fnd22175518b8502bf@mail.gmail.com> Date: Sat, 22 Nov 2008 14:06:39 -0800 From: "Garrett Cooper" To: "Christoph Kukulies" In-Reply-To: <4927E659.3010602@kukulies.org> MIME-Version: 1.0 Content-Type: text/plain; charset=WINDOWS-1252 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <4927E659.3010602@kukulies.org> Cc: freebsd-hackers@freebsd.org Subject: Re: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 22:06:41 -0000 On Sat, Nov 22, 2008 at 3:00 AM, Christoph Kukulies wro= te: > Since the underlying OS of Mac OS is FreeBSD I'm wondering whether itr is > possible to mount a > .dmg file as it is used in Apple software distribution for the Mac OS. I > would like to install an > Apple iPhone configuration utility on my FreeBSD box > (iPhoneConfigurationUtility.dmg). It consists of a > web application that is supposedly capable of doing updates of Apple iPho= nes > through a web service. > (good for company wide distribution of address book information and other > data that iPhones can hold). > > -- > Christoph Kukulies As everyone else has pointed out, FreeBSD !=3D OSX. I think that was the whole point of the Darwin logo (a platypus with Beastie's horns on it: ). If you watch the "BSD is Dying" presentation, you'll laugh when you see the reference to OSX as well: http://video.google.com/videoplay?docid=3D7833143728685685343 :). You have two choices: 1. Buy an Xserve loaded with OSX: http://shop.apple.com/ . 2. Compile and maintain your own copy of Apple's version of Darwin: http://opensource.apple.com/ . FYI, according to the Apple folks OSX is based off FreeBSD 5 (not sure which minor version): [Quote -- http://opensource.apple.com]: This fully-conformant UNIX operating system=97built on Mach 3.0 and FreeBSD 5=97bundles over a hundred of the most popular Open Source products. [/Quote] Cheers, -Garrett From owner-freebsd-hackers@FreeBSD.ORG Sat Nov 22 22:23:34 2008 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 02232106564A for ; Sat, 22 Nov 2008 22:23:34 +0000 (UTC) (envelope-from erikt@midgard.homeip.net) Received: from ch-smtp01.sth.basefarm.net (ch-smtp01.sth.basefarm.net [80.76.149.212]) by mx1.freebsd.org (Postfix) with ESMTP id 903108FC13 for ; Sat, 22 Nov 2008 22:23:33 +0000 (UTC) (envelope-from erikt@midgard.homeip.net) Received: from c83-255-48-78.bredband.comhem.se ([83.255.48.78]:63618 helo=falcon.midgard.homeip.net) by ch-smtp01.sth.basefarm.net with esmtp (Exim 4.68) (envelope-from ) id 1L40sw-0001vB-5z for freebsd-hackers@freebsd.org; Sat, 22 Nov 2008 23:23:32 +0100 Received: (qmail 83202 invoked from network); 22 Nov 2008 23:23:24 +0100 Received: from owl.midgard.homeip.net (10.1.5.7) by falcon.midgard.homeip.net with ESMTP; 22 Nov 2008 23:23:24 +0100 Received: (qmail 92659 invoked by uid 1001); 22 Nov 2008 23:23:24 +0100 Date: Sat, 22 Nov 2008 23:23:24 +0100 From: Erik Trulsson To: Garrett Cooper Message-ID: <20081122222324.GA92500@owl.midgard.homeip.net> References: <4927E659.3010602@kukulies.org> <7d6fde3d0811221406u38de767fnd22175518b8502bf@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <7d6fde3d0811221406u38de767fnd22175518b8502bf@mail.gmail.com> User-Agent: Mutt/1.5.18 (2008-05-17) X-Originating-IP: 83.255.48.78 X-Scan-Result: No virus found in message 1L40sw-0001vB-5z. X-Scan-Signature: ch-smtp01.sth.basefarm.net 1L40sw-0001vB-5z 85de3b712e6dfc6adf56a57de6781f5a Cc: freebsd-hackers@freebsd.org, Christoph Kukulies Subject: Re: mounting Mac OS .dmg files? X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Nov 2008 22:23:34 -0000 On Sat, Nov 22, 2008 at 02:06:39PM -0800, Garrett Cooper wrote: > On Sat, Nov 22, 2008 at 3:00 AM, Christoph Kukulies wrote: > > Since the underlying OS of Mac OS is FreeBSD I'm wondering whether itr is > > possible to mount a > > .dmg file as it is used in Apple software distribution for the Mac OS. I > > would like to install an > > Apple iPhone configuration utility on my FreeBSD box > > (iPhoneConfigurationUtility.dmg). It consists of a > > web application that is supposedly capable of doing updates of Apple iPhones > > through a web service. > > (good for company wide distribution of address book information and other > > data that iPhones can hold). > > > > -- > > Christoph Kukulies > > As everyone else has pointed out, FreeBSD != OSX. I think that was the > whole point of the Darwin logo (a platypus with Beastie's horns on it: > ). If you watch the > "BSD is Dying" presentation, you'll laugh when you see the reference > to OSX as well: > http://video.google.com/videoplay?docid=7833143728685685343 :). > > You have two choices: > 1. Buy an Xserve loaded with OSX: http://shop.apple.com/ . > 2. Compile and maintain your own copy of Apple's version of Darwin: > http://opensource.apple.com/ . > > FYI, according to the Apple folks OSX is based off FreeBSD 5 (not sure > which minor version): > > [Quote -- http://opensource.apple.com]: > This fully-conformant UNIX operating system?built on Mach 3.0 and > FreeBSD 5?bundles over a hundred of the most popular Open Source > products. > [/Quote] Which version of FreeBSD was used in OSX will almost certainly depend on which version of MacOS X you look at. It is quite possible that the latest version of OSX uses code from FreeBSD 5.x, but I guarantee that the first release of OSX did not. (This is easily seen from the fact the MacOS X 10.0 was first released in March 2001. The latest FreeBSD release at that time was 4.2 (released in November 2000.) FreeBSD 5.0 was not released until January 2003.) -- Erik Trulsson ertr1013@student.uu.se