From owner-freebsd-hackers@FreeBSD.ORG Mon Sep 2 08:49:39 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id D212FC1E;
Mon, 2 Sep 2013 08:49:39 +0000 (UTC)
(envelope-from mavbsd@gmail.com)
Received: from mail-bk0-x22b.google.com (mail-bk0-x22b.google.com
[IPv6:2a00:1450:4008:c01::22b])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id D14CA283A;
Mon, 2 Sep 2013 08:49:38 +0000 (UTC)
Received: by mail-bk0-f43.google.com with SMTP id mz13so1423112bkb.16
for <multiple recipients>; Mon, 02 Sep 2013 01:49:37 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=sender:message-id:date:from:user-agent:mime-version:to:subject
:references:in-reply-to:content-type:content-transfer-encoding;
bh=2NdJTP8xy/tghqvhT0eqh0KJKUr9tGy7D+crGKM1GIY=;
b=dKSlxcmStpiRbVyDOmmOlKsD6ruXFiUKuXOJqnBTxRrBK3pUDKyYHW0OncjxVyavQE
ymt70Y5gpagtjMNX2k0bD8zdteYVASadji67T46/14NnA7LZjzBS1HJdWin8BKTnrZOv
qANR7zVGc+q1uBxDGohlm5OAt2V5VMTuCEqZVuP5/CILpislCQwEvRmVT6ZwNsCbzgGh
wSdA5WRfuSSVEJ+OL8DilROTVVxA9HZ8zqqrtGz74YoAx8d4Fo1U1WtUXPo3H6oi1dFP
N7ImHW63gKhaOXr22ie4ttVcGxNDdNLhqO/aeHzbfss57P8SCzlU4IffaTOZjlEYaw7D
eCtw==
X-Received: by 10.204.199.132 with SMTP id es4mr623140bkb.28.1378111776996;
Mon, 02 Sep 2013 01:49:36 -0700 (PDT)
Received: from mavbook.mavhome.dp.ua ([37.229.21.195])
by mx.google.com with ESMTPSA id jt14sm1918024bkb.0.1969.12.31.16.00.00
(version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
Mon, 02 Sep 2013 01:49:36 -0700 (PDT)
Sender: Alexander Motin <mavbsd@gmail.com>
Message-ID: <5224511D.4090503@FreeBSD.org>
Date: Mon, 02 Sep 2013 11:49:33 +0300
From: Alexander Motin <mav@FreeBSD.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130616 Thunderbird/17.0.6
MIME-Version: 1.0
To: FreeBSD SCSI <freebsd-scsi@freebsd.org>, freebsd-hackers@FreeBSD.org,
freebsd-geom@FreeBSD.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>
Subject: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <520D4ADB.50209@FreeBSD.org>
In-Reply-To: <520D4ADB.50209@FreeBSD.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 02 Sep 2013 08:49:39 -0000
Hi.
I would like to invite more people to review and test my patches for
improving CAM and GEOM scalability, that for last six months you could
see developing in project/camlock SVN branch. Full diff of that branch
against present head (r255131) can be found here:
http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch
Heavy CAM changes there were focused on reducing scope of SIM lock to
only protecting SIM internals, but not CAM core. That allows many times
reduce lock congestion, especially on heavily parallel request
submission with GEOM changes below. More detailed description of changes
you could see here earlier:
http://docs.freebsd.org/cgi/mid.cgi?520D4ADB.50209
GEOM changes were focused on avoiding switching to GEOM up/down threads
in relatively simple setups where respective classes don't require it
(and were explicitly marked so). That allows save on context switches
and on systems with several HBAs and disks talk to them concurrently
(that is where CAM locking changes are handy). Such classes were
modified to support it: DEV, DISK, LABEL, MULTIPATH, NOP, PART, RAID
(partially), STRIPE, ZERO, VFS, ZFS::VDEV, ZFS::ZVOL and some others.
Requests to/from other classes will be queued to GEOM threads same as
before.
Together that allows to double block subsystem performance on high (at
least 100-200K) IOPS benchmarks, allowing to reach up to a million total
IOPS, while keeping full compatibility with all major ABIs/KBIs.
Since we are already in 10.0 release process and changes are quite big,
my plan is to wait and commit them to head branch after the freeze end,
and then merge to stable/10. I hope the release process will go on
schedule to not delay this work for another six months.
This work is sponsored by iXsystems, Inc.
--
Alexander Motin
From owner-freebsd-hackers@FreeBSD.ORG Mon Sep 2 19:59:58 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id E5C45DF3
for <hackers@freebsd.org>; Mon, 2 Sep 2013 19:59:58 +0000 (UTC)
(envelope-from yuri@rawbw.com)
Received: from shell0.rawbw.com (shell0.rawbw.com [198.144.192.45])
by mx1.freebsd.org (Postfix) with ESMTP id B770F2ECB
for <hackers@freebsd.org>; Mon, 2 Sep 2013 19:59:58 +0000 (UTC)
Received: from eagle.yuri.org (stunnel@localhost [127.0.0.1])
(authenticated bits=0)
by shell0.rawbw.com (8.14.4/8.14.4) with ESMTP id r82Jxvad060297
for <hackers@freebsd.org>; Mon, 2 Sep 2013 12:59:57 -0700 (PDT)
(envelope-from yuri@rawbw.com)
Message-ID: <5224EE3D.10303@rawbw.com>
Date: Mon, 02 Sep 2013 12:59:57 -0700
From: Yuri <yuri@rawbw.com>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130822 Thunderbird/17.0.8
MIME-Version: 1.0
To: FreeBSD Hackers <hackers@freebsd.org>
Subject: kgdb 'next' command crashes kernel during inter-VM kernel debugging
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 02 Sep 2013 19:59:59 -0000
I am trying to debug kernel in one VBox VM from another VBox VM using
this howto:
http://census-labs.com/news/2009/01/19/freebsd-kernel-debugging with the
exception that on the target VM hint.uart.0.flags="0x90" is set instead.
It works, stops at breakpoints, etc. However, kgdb command "n" (next)
causes target to reboot.
Device /dev/cuau0 is used for the serial port. On the host it goes
through the local socket /tmp/com_1
All with FreeBSD 10 (trunk) amd64, virtualbox 4.2.16
Yuri
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 12:14:36 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 0985036C;
Tue, 3 Sep 2013 12:14:36 +0000 (UTC)
(envelope-from mailist@yandex.com)
Received: from forward14.mail.yandex.net (forward14.mail.yandex.net
[IPv6:2a02:6b8:0:801::4])
by mx1.freebsd.org (Postfix) with ESMTP id 8896A20BF;
Tue, 3 Sep 2013 12:14:35 +0000 (UTC)
Received: from web15j.yandex.ru (web15j.yandex.ru [5.45.198.56])
by forward14.mail.yandex.net (Yandex) with ESMTP id 47D781981EA5;
Tue, 3 Sep 2013 16:14:23 +0400 (MSK)
Received: from 127.0.0.1 (localhost [127.0.0.1])
by web15j.yandex.ru (Yandex) with ESMTP id E04FF1C41018;
Tue, 3 Sep 2013 16:14:22 +0400 (MSK)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yandex.com; s=mail;
t=1378210463; bh=2qMpzlU/lwTd4yCvkTjhW5BhLvp2sP/ax7ftOZVwg1U=;
h=From:To:Subject:Date;
b=gEFah+9MmPpNYfVX705WxVpiTFNMCBg6QmvZn+x3d/xtaiCUkXRrU3bsqlFGya4ws
MgfpJIdrlFM8Xbow9ycVYSaHAjXlH9Y4Dx642y8YDqu5n9AWJVsEVWQG5BBZmn7YT4
dHWl1sICrWR19+DHsp6KrQX0KHpI0sMZ/xzAqkbE=
Received: from 78.161.188.194.dynamic.ttnet.com.tr
(78.161.188.194.dynamic.ttnet.com.tr [78.161.188.194]) by web15j.yandex.ru
with HTTP; Tue, 03 Sep 2013 16:14:22 +0400
From: =?utf-8?B?RW1yZSDDh2FtYWxhbg==?= <mailist@yandex.com>
Envelope-From: mailist@yandex.com.tr
To: freebsd-hackers@freebsd.org, FreeBSD quest <freebsd-questions@freebsd.org>
Subject: Zfs encryption property for freebsd 8.3
MIME-Version: 1.0
Message-Id: <226721378210462@web15j.yandex.ru>
X-Mailer: Yamail [ http://yandex.ru ] 5.0
Date: Tue, 03 Sep 2013 15:14:22 +0300
Content-Transfer-Encoding: 7bit
Content-Type: text/plain
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 12:14:36 -0000
Hi,
I want to encrypt some disk on my server with Zfs encryption property but it is not available.
Are there anybody have got an experience about this?
[url]http://docs.oracle.com/cd/E23824_01/html/821-1448/gkkih.html#scrolltoc[/url]
[url]http://www.oracle.com/technetwork/articles/servers-storage-admin/manage-zfs-encryption-1715034.html[/url]
These are good explanations but I got an error and output shows all property;
----------------------------------------------------
[root@HP ~]# zpool status
pool: output
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
output ONLINE 0 0 0
ad0s1e ONLINE 0 0 0
errors: No known data errors
[root@HP ~]# zfs create -o encryption=on output/home
cannot create 'output/home': invalid property 'encryption'
[root@HP ~]# zfs get encryption
bad property list: invalid property 'encryption'
usage:
get [-rHp] [-d max] [-o "all" | field[,...]] [-t type[,...]] [-s source[,...]]
<"all" | property[,...]> [filesystem|volume|snapshot] ...
The following properties are supported:
PROPERTY EDIT INHERIT VALUES
available NO NO <size>
clones NO NO <dataset>[,...]
compressratio NO NO <1.00x or higher if compressed>
creation NO NO <date>
defer_destroy NO NO yes | no
mounted NO NO yes | no
origin NO NO <snapshot>
refcompressratio NO NO <1.00x or higher if compressed>
referenced NO NO <size>
type NO NO filesystem | volume | snapshot
used NO NO <size>
usedbychildren NO NO <size>
usedbydataset NO NO <size>
usedbyrefreservation NO NO <size>
usedbysnapshots NO NO <size>
userrefs NO NO <count>
written NO NO <size>
aclinherit YES YES discard | noallow | restricted | passthrough | passthrough-x
aclmode YES YES discard | groupmask | passthrough | restricted
atime YES YES on | off
canmount YES NO on | off | noauto
casesensitivity NO YES sensitive | insensitive | mixed
checksum YES YES on | off | fletcher2 | fletcher4 | sha256
compression YES YES on | off | lzjb | gzip | gzip-[1-9] | zle
copies YES YES 1 | 2 | 3
dedup YES YES on | off | verify | sha256[,verify]
devices YES YES on | off
exec YES YES on | off
jailed YES YES on | off
logbias YES YES latency | throughput
mlslabel YES YES <sensitivity label>
mountpoint YES YES <path> | legacy | none
nbmand YES YES on | off
normalization NO YES none | formC | formD | formKC | formKD
primarycache YES YES all | none | metadata
quota YES NO <size> | none
readonly YES YES on | off
recordsize YES YES 512 to 128k, power of 2
refquota YES NO <size> | none
refreservation YES NO <size> | none
reservation YES NO <size> | none
secondarycache YES YES all | none | metadata
setuid YES YES on | off
sharenfs YES YES on | off | share(1M) options
sharesmb YES YES on | off | sharemgr(1M) options
snapdir YES YES hidden | visible
sync YES YES standard | always | disabled
utf8only NO YES on | off
version YES NO 1 | 2 | 3 | 4 | 5 | current
volblocksize NO YES 512 to 128k, power of 2
volsize YES NO <size>
vscan YES YES on | off
xattr YES YES on | off
userused@... NO NO <size>
groupused@... NO NO <size>
userquota@... YES NO <size> | none
groupquota@... YES NO <size> | none
written@<snap> NO NO <size>
Sizes are specified in bytes with standard units such as K, M, G, etc.
User-defined properties can be specified by using a name containing a colon (:).
The {user|group}{used|quota}@ properties must be appended with
a user or group specifier of one of these forms:
POSIX name (eg: "matt")
POSIX id (eg: "126829")
SMB name@domain (eg: "matt@sun")
SMB SID (eg: "S-1-234-567-89")
[root@HP ~]#
-----------------------------
How can I use or add encryption property to FreeBsd 8.3?
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 12:19:19 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 3C08F5DF
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 12:19:19 +0000 (UTC)
(envelope-from florent@peterschmitt.fr)
Received: from peterschmitt.fr (peterschmitt.fr [5.135.177.31])
by mx1.freebsd.org (Postfix) with ESMTP id 046FE211D
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 12:19:18 +0000 (UTC)
Received: from [172.29.180.39] (unknown [194.214.114.46])
by peterschmitt.fr (Postfix) with ESMTPSA id E09E36529
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 14:19:09 +0200 (CEST)
Message-ID: <5225D49B.2080807@peterschmitt.fr>
Date: Tue, 03 Sep 2013 14:22:51 +0200
From: Florent Peterschmitt <florent@peterschmitt.fr>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
rv:17.0) Gecko/20130821 Icedove/17.0.8
MIME-Version: 1.0
To: freebsd-hackers@freebsd.org
Subject: Re: Zfs encryption property for freebsd 8.3
References: <226721378210462@web15j.yandex.ru>
In-Reply-To: <226721378210462@web15j.yandex.ru>
X-Enigmail-Version: 1.5.1
Content-Type: multipart/signed; micalg=pgp-sha1;
protocol="application/pgp-signature";
boundary="----enig2SVKTDDPHMNMSIPXLDUGF"
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 12:19:19 -0000
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
------enig2SVKTDDPHMNMSIPXLDUGF
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Le 03/09/2013 14:14, Emre =C7amalan a =E9crit :
> Hi,=20
> I want to encrypt some disk on my server with Zfs encryption property b=
ut it is not available.
"That would require ZFS v30. As far as I am aware Oracle has not
released the code under CDDL."
=46rom http://forums.freebsd.org/showthread.php?t=3D30036
So you can use ZFS pools on GELI volumes, it can be a good start. I not
play with it.
--=20
Florent Peterschmitt | Please:
florent@peterschmitt.fr | * Avoid HTML/RTF in E-mail.
+33 (0)6 64 33 97 92 | * Send PDF for documents.
http://florent.peterschmitt.fr | * Trim your quotations. Really.
Proudly powered by Open Source | Thank you :)
------enig2SVKTDDPHMNMSIPXLDUGF
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.14 (GNU/Linux)
Comment: Using GnuPG with Icedove - http://www.enigmail.net/
iQIcBAEBAgAGBQJSJdSbAAoJEFr01BkajbiBGh0P+gNQh57YtlLyAdo2qRNbtylm
8hxLZnqkBJLUX1gV9qd4440+L0wWbkSH5C0nMTLdZjqiJ83xIQJ4YtFs1pE4Qngz
gwExMVyMuZ88GhEgeVOX6oC5NFTukuQh9Ec7zerMXSSfdaQyfZ9eD399p2K7qN7k
CoXTfN30hNLqoykWJQhfCLCNYf+jZhrbVmFyNv7axrXKxTsLerQ0QyTzNVYZhixL
YzrqB4Sz1FADZTDRBoID4UVWQbid/VFGxscsVVikKcfe0vgbu+l3om6QrYiwtCLu
VweLSA/y7Y2d7a0vVFAaacTl+ashitpG7xPlhGAY7x80aPzTSeDyZbLP0GsgW4BQ
ZuROXqRSjV0PGr6yU/vcvb56qocys4WT2Es6Lzr2XkCVk5xeSvAqJrsEPUymQ21t
4yXCYRzogItPg5k7JJ9/LvpHhBbwMCFSCAHiaHwsXIYtbKTTbD+KvppuX3hFIZ+x
t508XyOkLxtCQG/OWtDdIk4Uw6SOaknDawRHSt9PL5LDuTgp6hB7ErLYuBz9w0gy
6w53S9EhB+7DNzJr7vD1SJaspKwGLbHz5QB/bqZJQtQmf8pzNbhVguMHnTzj5VfZ
OyJz9Ej5nPl9rr6VksUmG9EaNrU4gbF5kIgwKTnje6+ioN6q83vaFLo0y8juNWTz
VwRIcDP/SzBUVNzQupe0
=eV4B
-----END PGP SIGNATURE-----
------enig2SVKTDDPHMNMSIPXLDUGF--
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 13:42:53 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@FreeBSD.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id A9170611;
Tue, 3 Sep 2013 13:42:53 +0000 (UTC) (envelope-from jlh@FreeBSD.org)
Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 6EB032D3C;
Tue, 3 Sep 2013 13:42:53 +0000 (UTC)
Received: by caravan.chchile.org (Postfix, from userid 1000)
id 75F99C0761; Tue, 3 Sep 2013 13:42:51 +0000 (UTC)
Date: Tue, 3 Sep 2013 15:42:51 +0200
From: Jeremie Le Hen <jlh@FreeBSD.org>
To: Alexander Motin <mav@FreeBSD.org>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
Message-ID: <20130903134251.GB43281@caravan.chchile.org>
Mail-Followup-To: Alexander Motin <mav@FreeBSD.org>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>,
freebsd-hackers@FreeBSD.org, freebsd-geom@FreeBSD.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>
References: <520D4ADB.50209@FreeBSD.org>
<5224511D.4090503@FreeBSD.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <5224511D.4090503@FreeBSD.org>
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: FreeBSD SCSI <freebsd-scsi@freebsd.org>, freebsd-geom@FreeBSD.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-hackers@FreeBSD.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 13:42:53 -0000
On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote:
> Hi.
>
> I would like to invite more people to review and test my patches for
> improving CAM and GEOM scalability, that for last six months you could
> see developing in project/camlock SVN branch. Full diff of that branch
> against present head (r255131) can be found here:
> http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch
I'm building my kernel right now.
--
Jeremie Le Hen
Scientists say the world is made up of Protons, Neutrons and Electrons.
They forgot to mention Morons.
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 14:53:34 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 24F52BD9
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 14:53:34 +0000 (UTC)
(envelope-from asomers@gmail.com)
Received: from mail-qc0-x22b.google.com (mail-qc0-x22b.google.com
[IPv6:2607:f8b0:400d:c01::22b])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id DA5122317
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 14:53:33 +0000 (UTC)
Received: by mail-qc0-f171.google.com with SMTP id n1so3107072qcw.2
for <freebsd-hackers@freebsd.org>; Tue, 03 Sep 2013 07:53:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:sender:in-reply-to:references:date:message-id:subject
:from:to:cc:content-type:content-transfer-encoding;
bh=5GcDqogBsonxgUwPyzoQtV46rtdvrBz8mS3gFHYr8vI=;
b=b2t2ShSKaG+yGGkGlnQwcKvuhPcoptzINlOovVOJtILaHk+2NSbx8LXlRLj3tyIAzt
tszswJuEk+W0f08cJeEkP3DuD5uOokvdJWxU7Sw2iBazzMIaZXH9sW8SF389ym3y/nNG
oTPtdd1V1SkVR+PC4we/pmPhq1wrIN1XFY7qTc7hLjF/OKRHJEm7QQD1NFKPzoj3mf8+
1z4W7XYaJfml4XpVy9hbTWWrc3nhx+hRKAHSVYygqdRlm9PUxJHT55Il8hIWHH2sMgZF
3a0FVIV/5S6qZHn8bmCAGePUCK0is7xZuLRrjsG1czxBc8FvV+N3TsDjBHkZyUUKots7
URzA==
MIME-Version: 1.0
X-Received: by 10.224.122.195 with SMTP id m3mr1364739qar.9.1378220012936;
Tue, 03 Sep 2013 07:53:32 -0700 (PDT)
Sender: asomers@gmail.com
Received: by 10.49.39.101 with HTTP; Tue, 3 Sep 2013 07:53:32 -0700 (PDT)
In-Reply-To: <5225D49B.2080807@peterschmitt.fr>
References: <226721378210462@web15j.yandex.ru>
<5225D49B.2080807@peterschmitt.fr>
Date: Tue, 3 Sep 2013 08:53:32 -0600
X-Google-Sender-Auth: y92iJ1ToW6OAs5rXQu62t_nLHbM
Message-ID: <CAOtMX2hdbY52Wh=B=ByrX7BM+-hHNnbtKG9S_uMBCLT5pEE-gw@mail.gmail.com>
Subject: Re: Zfs encryption property for freebsd 8.3
From: Alan Somers <asomers@freebsd.org>
To: Florent Peterschmitt <florent@peterschmitt.fr>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Cc: freebsd-hackers@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 14:53:34 -0000
On Tue, Sep 3, 2013 at 6:22 AM, Florent Peterschmitt
<florent@peterschmitt.fr> wrote:
> Le 03/09/2013 14:14, Emre =C7amalan a =E9crit :
>> Hi,
>> I want to encrypt some disk on my server with Zfs encryption property bu=
t it is not available.
>
> "That would require ZFS v30. As far as I am aware Oracle has not
> released the code under CDDL."
Oracle's ZFS encryption is crap anyway. It works at the filesystem
level, not the pool level, so a lot of metadata is in plaintext; I
don't remember how much exactly. It's also highly vulnerable to
watermarking attacks.
>
> From http://forums.freebsd.org/showthread.php?t=3D30036
>
> So you can use ZFS pools on GELI volumes, it can be a good start. I not
> play with it.
GELI is full-disk encryption. It's far superior to ZFS encryption.
>
> --
> Florent Peterschmitt | Please:
> florent@peterschmitt.fr | * Avoid HTML/RTF in E-mail.
> +33 (0)6 64 33 97 92 | * Send PDF for documents.
> http://florent.peterschmitt.fr | * Trim your quotations. Really.
> Proudly powered by Open Source | Thank you :)
>
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 14:58:17 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 404F4DE3
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 14:58:17 +0000 (UTC)
(envelope-from florent@peterschmitt.fr)
Received: from peterschmitt.fr (peterschmitt.fr [5.135.177.31])
by mx1.freebsd.org (Postfix) with ESMTP id 069662358
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 14:58:17 +0000 (UTC)
Received: from [172.29.180.39] (unknown [194.214.114.46])
by peterschmitt.fr (Postfix) with ESMTPSA id C0D726736
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 16:58:13 +0200 (CEST)
Message-ID: <5225F9E3.4000101@peterschmitt.fr>
Date: Tue, 03 Sep 2013 17:01:55 +0200
From: Florent Peterschmitt <florent@peterschmitt.fr>
User-Agent: Mozilla/5.0 (X11; Linux x86_64;
rv:17.0) Gecko/20130821 Icedove/17.0.8
MIME-Version: 1.0
To: freebsd-hackers@freebsd.org
Subject: Re: Zfs encryption property for freebsd 8.3
References: <226721378210462@web15j.yandex.ru>
<5225D49B.2080807@peterschmitt.fr>
<CAOtMX2hdbY52Wh=B=ByrX7BM+-hHNnbtKG9S_uMBCLT5pEE-gw@mail.gmail.com>
In-Reply-To: <CAOtMX2hdbY52Wh=B=ByrX7BM+-hHNnbtKG9S_uMBCLT5pEE-gw@mail.gmail.com>
X-Enigmail-Version: 1.5.1
Content-Type: multipart/signed; micalg=pgp-sha1;
protocol="application/pgp-signature";
boundary="----enig2DRWFLJIARQSGUVEONUCK"
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 14:58:17 -0000
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
------enig2DRWFLJIARQSGUVEONUCK
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Le 03/09/2013 16:53, Alan Somers a =E9crit :
> GELI is full-disk encryption. It's far superior to ZFS encryption.
Yup, but is there a possibility to encrypt a ZFS volume (not a whole
pool) with a separate GELI partition?
Also, in-ZFS encryption would be a nice thing if it could work like an
LVM/LUKS where each logical LVM volume can be encrypted or not and have
its own crypt key.
I saw that Illumos has ZFS encrytion in the TODO list.
--=20
Florent Peterschmitt | Please:
florent@peterschmitt.fr | * Avoid HTML/RTF in E-mail.
+33 (0)6 64 33 97 92 | * Send PDF for documents.
http://florent.peterschmitt.fr | * Trim your quotations. Really.
Proudly powered by Open Source | Thank you :)
------enig2DRWFLJIARQSGUVEONUCK
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.14 (GNU/Linux)
Comment: Using GnuPG with Icedove - http://www.enigmail.net/
iQIbBAEBAgAGBQJSJfnjAAoJEFr01BkajbiBCvoP93U6FGySZEIZ9aUI1+903cUT
/S7NeIwaCd+eoH2GxpX/niSF8BjiK4ToUrsmmeAOkj7Uu/AZHRxwT7iz+P6svEQQ
Nqg3UVdb2Pj27Tu/O12IaTE21h0USA95/O7V4Tsy+4rpcxTkfQN+MArznrkGCsjq
SXFeFBbiHzuus4Cpl0U3IbSuNqdBHhVategU/GHKfvkBGNboieMiARgNkU5ly5Z6
c/ZuOi3SLnVk8EH2mlHhcNFS7S6o6yRWARaz9HUrLnHXUWGvLnsmcs9B/zl8AcnM
JhjCay9p9xbA1mbpScvCszaHx4Ngg3uXchdVWRvykRYyd8xRVIE0fDTn2mYrGd5n
GAUcaZiq2+qk06ghWPm6foxNZzg0fUrQc1MwV0fCNEIaRP0m+TTZu715KUepux/E
LNejAWIk+qD08oZ6033rrWuN+wNts0/2PrwdVkcGsJY7tfkri9gkOHen7E6scRcF
OYA29K23H0x4JlB7efvKWVFQCVuS066Ci61uELF+8mxwiHhZII37hz1VWhS3Qc0y
cb45N6bFJ1dKlEbmuYRSLgRomBWNGrFODFxabjEprMJ8ULP00iUUYFEARoSzlX1t
NR4FeJtcoMNQ9tjvg0nxRr60jxUZAG4Q+qVz814sRc7r0ZaYVZqTidq/ViF01Bo5
zC2R5g8GS184ojHsXvE=
=2raA
-----END PGP SIGNATURE-----
------enig2DRWFLJIARQSGUVEONUCK--
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 16:20:06 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 24FD7C05
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 16:20:06 +0000 (UTC)
(envelope-from asomers@gmail.com)
Received: from mail-qa0-x233.google.com (mail-qa0-x233.google.com
[IPv6:2607:f8b0:400d:c00::233])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id DB9E328BD
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 16:20:05 +0000 (UTC)
Received: by mail-qa0-f51.google.com with SMTP id bv4so1400498qab.3
for <freebsd-hackers@freebsd.org>; Tue, 03 Sep 2013 09:20:05 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:sender:in-reply-to:references:date:message-id:subject
:from:to:cc:content-type:content-transfer-encoding;
bh=5YiBa43sincJofJb5i+QtekDEGxDN0la1ylhgm1V/xw=;
b=CAhzfcxgJw8P0005YVs9ttmH7cbutPfY10XIGL0RfpEAi6qM/DdrPWw8dBNbEvGnGg
ZSqhq7k32ukrVWUGe+uKftFxt8OFvxlNRKC4LhwPcmrghhg3qeoOz/IJsmHSns4QyBid
+7ejZc0gbQky0TxVgafXrlSLypKpCU1JkaPsFx2mK7RJCKml6Dqs3N2lfBKGDpSFkRgY
cg/nJbXRBmh1mwNbrxSXPZ48kTwcWqBQL5sNpbonBgMVO1EYzw9e3RtEz6fInAOfaRul
uHA5G/2vnuhh1TRfHusi6Ngv8aJnt9EVG5zMCdgdwZvIUlK2VGFH2qDBnHmUqzm0Gs0H
eRZA==
MIME-Version: 1.0
X-Received: by 10.224.23.134 with SMTP id r6mr1833287qab.34.1378225205077;
Tue, 03 Sep 2013 09:20:05 -0700 (PDT)
Sender: asomers@gmail.com
Received: by 10.49.39.101 with HTTP; Tue, 3 Sep 2013 09:20:05 -0700 (PDT)
In-Reply-To: <5225F9E3.4000101@peterschmitt.fr>
References: <226721378210462@web15j.yandex.ru>
<5225D49B.2080807@peterschmitt.fr>
<CAOtMX2hdbY52Wh=B=ByrX7BM+-hHNnbtKG9S_uMBCLT5pEE-gw@mail.gmail.com>
<5225F9E3.4000101@peterschmitt.fr>
Date: Tue, 3 Sep 2013 10:20:05 -0600
X-Google-Sender-Auth: wS-Wr16hxBKttJf-HQeCf4fgt-w
Message-ID: <CAOtMX2ivt6muEiH0RDh_Q2HpN+S2LMLQ8seqQV7QLi22Xf0JRA@mail.gmail.com>
Subject: Re: Zfs encryption property for freebsd 8.3
From: Alan Somers <asomers@freebsd.org>
To: Florent Peterschmitt <florent@peterschmitt.fr>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Cc: freebsd-hackers@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 16:20:06 -0000
On Tue, Sep 3, 2013 at 9:01 AM, Florent Peterschmitt
<florent@peterschmitt.fr> wrote:
> Le 03/09/2013 16:53, Alan Somers a =E9crit :
>> GELI is full-disk encryption. It's far superior to ZFS encryption.
>
> Yup, but is there a possibility to encrypt a ZFS volume (not a whole
> pool) with a separate GELI partition?
You mean encrypt a zvol with GELI and put a file system on that? I
suppose that would work, but I bet that it would be slow.
>
> Also, in-ZFS encryption would be a nice thing if it could work like an
> LVM/LUKS where each logical LVM volume can be encrypted or not and have
> its own crypt key.
My understanding is that this is exactly how Oracle's ZFS encryption
works. Each ZFS filesystem can have its own key, or be in plaintext.
Every cryptosystem involves a tradeoff between security and
convenience, and ZFS encryption goes fairly hard toward convenience.
In particular, Oracle decided that encrypted files must be
deduplicatable. A necessary result is that they are trivially
vulnerable to watermarking attacks.
https://blogs.oracle.com/darren/entry/zfs_encryption_what_is_on
>
> I saw that Illumos has ZFS encrytion in the TODO list.
>
> --
> Florent Peterschmitt | Please:
> florent@peterschmitt.fr | * Avoid HTML/RTF in E-mail.
> +33 (0)6 64 33 97 92 | * Send PDF for documents.
> http://florent.peterschmitt.fr | * Trim your quotations. Really.
> Proudly powered by Open Source | Thank you :)
>
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 18:10:34 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 86D92F92;
Tue, 3 Sep 2013 18:10:34 +0000 (UTC)
(envelope-from outbackdingo@gmail.com)
Received: from mail-pa0-x22e.google.com (mail-pa0-x22e.google.com
[IPv6:2607:f8b0:400e:c03::22e])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 4B33527EB;
Tue, 3 Sep 2013 18:10:34 +0000 (UTC)
Received: by mail-pa0-f46.google.com with SMTP id fa1so6747736pad.19
for <multiple recipients>; Tue, 03 Sep 2013 11:10:34 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type; bh=U6aTzULoJOmotb6EDysMmZrEOn4yEnc/RZxCGfXH28Y=;
b=EeqOVeGgn3Pye1lgfkID5C11E+cuH7lE6Qkben4dI6lros8b7PNodUfLnVLW8Sn7r/
j6JrNrE7i5WGzpCg5U/XT6lH4d6V3Dz3KQzjnOorjwqybRG7AF+FFnGiqxapJc/+vsZD
fqx5WhzsYIluohp9r9EDVoaaiXnazTxdB9M9SaHdIVmklFFfWOKndwccxCn7km77HS1z
dE6Nv6+v2HWKru+SiwPqLUiRHW4Rw52fkd6LSwq1mm14WJO0W4X65qupGSyTxBgx7FXB
R8TDtPBlG0Ml/LH0d0kAEnImMzIYXoNnBaB558jbA8jYLefRSD5FkknLeljpdkld6ZY3
zTFg==
MIME-Version: 1.0
X-Received: by 10.68.76.101 with SMTP id j5mr32863063pbw.67.1378231832471;
Tue, 03 Sep 2013 11:10:32 -0700 (PDT)
Received: by 10.66.126.141 with HTTP; Tue, 3 Sep 2013 11:10:32 -0700 (PDT)
In-Reply-To: <20130903134251.GB43281@caravan.chchile.org>
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
Date: Tue, 3 Sep 2013 14:10:32 -0400
Message-ID: <CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
From: Outback Dingo <outbackdingo@gmail.com>
To: Alexander Motin <mav@freebsd.org>, FreeBSD SCSI <freebsd-scsi@freebsd.org>,
freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.14
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 18:10:34 -0000
On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen <jlh@freebsd.org> wrote:
> On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote:
> > Hi.
> >
> > I would like to invite more people to review and test my patches for
> > improving CAM and GEOM scalability, that for last six months you could
> > see developing in project/camlock SVN branch. Full diff of that branch
> > against present head (r255131) can be found here:
> > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch
>
> I'm building my kernel right now.
>
>
Can anyone confirm how well tested/stable this patch set might be?? if
theres positive input i have a zoo of dev machines i could load it on, to
help further it.
Just checking to see how widely its been tested,
> --
> Jeremie Le Hen
>
> Scientists say the world is made up of Protons, Neutrons and Electrons.
> They forgot to mention Morons.
> _______________________________________________
> freebsd-current@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-current
> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"
>
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 19:08:37 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id A0604652;
Tue, 3 Sep 2013 19:08:37 +0000 (UTC) (envelope-from jhb@freebsd.org)
Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 66DA42FC2;
Tue, 3 Sep 2013 19:08:37 +0000 (UTC)
Received: from jhbbsd.localnet (unknown [209.249.190.124])
by bigwig.baldwin.cx (Postfix) with ESMTPSA id 21196B990;
Tue, 3 Sep 2013 15:08:36 -0400 (EDT)
From: John Baldwin <jhb@freebsd.org>
To: freebsd-fs@freebsd.org
Subject: Re: Call fo comments - raising vfs.ufs.dirhash_reclaimage?
Date: Tue, 3 Sep 2013 15:07:32 -0400
User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p28; KDE/4.5.5; amd64; ; )
References: <kvkvi7$iv7$1@ger.gmane.org> <20130828181228.0d3618dd@ernst.home>
<CAF-QHFU80YC3W-k+TKM=y3JiVYi=1fp5CJjbCCk1y0VKXzcRQg@mail.gmail.com>
In-Reply-To: <CAF-QHFU80YC3W-k+TKM=y3JiVYi=1fp5CJjbCCk1y0VKXzcRQg@mail.gmail.com>
MIME-Version: 1.0
Content-Type: Text/Plain;
charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
Message-Id: <201309031507.33098.jhb@freebsd.org>
X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7
(bigwig.baldwin.cx); Tue, 03 Sep 2013 15:08:36 -0400 (EDT)
Cc: freebsd-hackers <freebsd-hackers@freebsd.org>,
Ivan Voras <ivoras@freebsd.org>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 19:08:37 -0000
On Wednesday, August 28, 2013 12:40:15 pm Ivan Voras wrote:
> On 28 August 2013 18:12, Gary Jennejohn <gljennjohn@googlemail.com> wrote:
>
> > So, if I understand this correctly, a normal desktop user won't
> > notice any real change, except that buildworld might get faster,
> > and big servers will benefit?
>
> Basically, yes, but read on...
>
> > But could this negatively impact small, embedded systems, which
> > usually have only small memory footprints? Although I suppose
> > one could argue that they usually don't have large numbers of
> > files cached in memory at any given time.
>
> Unless I'm wrong, the only pathological case coming from this change
> would be the following sequence of events:
>
> 1) Memory is scarce [*]
> 2) There's a sudden surge of requests for a huge number of different directories
> 3) There's an urgent lowmem event which is observed by dirhash, which
> attempts to free memory but is prevented in doing so for the next 60
> seconds because all entries are young (the idea behind dirhash being
> that if a directory is accessed, it will probably soon be accessed
> again - think "ls" then "fopen", so we won't evict him until
> reclaimage seconds)
> 4) the kernel runs out of memory, game over.
Just to play devil's advocate, the only way your change can benefit is
if:
1) Memory is scarce thus triggering a lowmem event
2) There are requests for a huge number of directories that haven't been
accessed in over 5 seconds.
That is to say, what your change does is increase the relative importance
of dirhash memory relative to other memory in the machine when the machine
is under memory pressure. If the machine is not under memory pressure then
the lowmem handler will not be triggered and your change will never matter.
Keep in mind that if pagedaemon is able to keep up, the lowmem event handler
will not be called. This handler only triggers when you are really low on
memory and trying to allocate it faster than pagedaemon can reclaim free
pages. In that sort of environment you generally want caches to return
pages sooner rather than later.
What would perhaps be better than a hardcoded reclaim age would be to use
an LRU-type approach and perhaps set a target percent to reclaim. That is,
suppose you were to reclaim the oldest 10% of hashes on each lowmem call
(and make the '10%' the tunable value). Then you will always make some amount
of progress in a low memory situation (and if the situation remains dire you
will eventually empty the entire cache), but the effective maximum age will
be more dynamic. Right now if you haven't touched UFS in 5 seconds it
throws the entire thing out on the first lowmem event. The LRU-approach would
only throw the oldest 10% out on the first call, but eventually throw it all out
if the situation remains dire.
--
John Baldwin
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 20:23:26 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id DFA7A898;
Tue, 3 Sep 2013 20:23:26 +0000 (UTC) (envelope-from jhb@freebsd.org)
Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id AD4CF26A3;
Tue, 3 Sep 2013 20:23:26 +0000 (UTC)
Received: from jhbbsd.localnet (unknown [209.249.190.124])
by bigwig.baldwin.cx (Postfix) with ESMTPSA id 8B9DCB924;
Tue, 3 Sep 2013 16:23:24 -0400 (EDT)
From: John Baldwin <jhb@freebsd.org>
To: freebsd-hackers@freebsd.org
Subject: Re: About CPU cores numbering an processor affinity
Date: Tue, 3 Sep 2013 15:24:18 -0400
User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p28; KDE/4.5.5; amd64; ; )
References: <1D21F5BC-63CD-4B33-9286-6687E62FDB15@gmail.com>
In-Reply-To: <1D21F5BC-63CD-4B33-9286-6687E62FDB15@gmail.com>
MIME-Version: 1.0
Content-Type: Text/Plain;
charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
Message-Id: <201309031524.18162.jhb@freebsd.org>
X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7
(bigwig.baldwin.cx); Tue, 03 Sep 2013 16:23:24 -0400 (EDT)
Cc: hackers@freebsd.org, Dmitry Sivachenko <trtrmitya@gmail.com>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 20:23:26 -0000
On Friday, August 23, 2013 9:23:51 am Dmitry Sivachenko wrote:
> Hello!
>
> I am using FreeBSD-9-STABLE on the following hardware:
>
> FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
> FreeBSD/SMP: 2 package(s) x 6 core(s) x 2 SMT threads
>
> So I have 2 physical CPUs with 6 core each.
>
> # cpuset -g
> pid -1 mask: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17,
18, 19, 20, 21, 22, 23
>
>
> So each of 24 cores are numbered 0..23.
>
> 1) In what particular order are these cores numbered? Can I assume that
0..11 correspond to 1st physical CPU and 12..23 to second? How SMT threads
are numbered within each core?
Yes, the numbering is "grouped" so that you have each package as a contiguous
block. Each core is a contiguous block as well, so SMT threads are adjacent
to each other.
> Should I use "-x" option of cpuset for that purpose (to bind irq 260 and 261
in my example)?
Yes, cpuset -x.
--
John Baldwin
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 20:39:13 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 5C770F0D
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 20:39:13 +0000 (UTC)
(envelope-from kim@westryn.net)
Received: from mail3.westryn.net (mail3.westryn.net [72.28.112.3])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 3F07027C9
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 20:39:12 +0000 (UTC)
Received: from frost.westryn.net (204.16.225.169.westryn.net [204.16.225.169])
(using TLSv1 with cipher AES128-SHA (128/128 bits))
(No client certificate requested)
by mail3.westryn.net (Postfix) with ESMTPSA id 7628173A2D
for <freebsd-hackers@freebsd.org>; Tue, 3 Sep 2013 15:29:08 -0500 (CDT)
From: Kim Shrier <kim@westryn.net>
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Subject: booting FreeBSD on Apple Mac mini with GPT disk partition
Message-Id: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net>
Date: Tue, 3 Sep 2013 14:29:04 -0600
To: FreeBSD Hackers <freebsd-hackers@freebsd.org>
Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\))
X-Mailer: Apple Mail (2.1508)
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 20:39:13 -0000
Does anyone know if work on booting FreeBSD on modern Apple hardware
was ever completed? I have looked on the wiki, forums, and email =
archives
but I don't see anything definitive.
I would like to have a GPT partitioned disk with a freebsd-boot, =
freebsd-swap,
and multiple freebsd-ufs partitions on a new Mac mini. Any pointers =
would be
appreciated.
Thanks,
Kim
--
Kim Shrier - kim@westryn.net
Shrier and Deihl, Westryn Internet Services
Internet Software Development and Hosting
Remote Unix Admin, Security
http://www.westryn.net/
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 21:31:50 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 4E646654;
Tue, 3 Sep 2013 21:31:50 +0000 (UTC) (envelope-from jlh@FreeBSD.org)
Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 117E72BCE;
Tue, 3 Sep 2013 21:31:50 +0000 (UTC)
Received: by caravan.chchile.org (Postfix, from userid 1000)
id DF286C0961; Tue, 3 Sep 2013 21:24:26 +0000 (UTC)
Date: Tue, 3 Sep 2013 23:24:26 +0200
From: Jeremie Le Hen <jlh@FreeBSD.org>
To: Outback Dingo <outbackdingo@gmail.com>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
Message-ID: <20130903212426.GC43281@caravan.chchile.org>
Mail-Followup-To: Outback Dingo <outbackdingo@gmail.com>,
Alexander Motin <mav@freebsd.org>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>,
freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: FreeBSD SCSI <freebsd-scsi@freebsd.org>, Alexander Motin <mav@freebsd.org>,
freebsd-geom@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-hackers@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 21:31:50 -0000
On Tue, Sep 03, 2013 at 02:10:32PM -0400, Outback Dingo wrote:
> On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen <jlh@freebsd.org> wrote:
>
> > On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote:
> > > Hi.
> > >
> > > I would like to invite more people to review and test my patches for
> > > improving CAM and GEOM scalability, that for last six months you could
> > > see developing in project/camlock SVN branch. Full diff of that branch
> > > against present head (r255131) can be found here:
> > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch
> >
> > I'm building my kernel right now.
> >
> >
> Can anyone confirm how well tested/stable this patch set might be?? if
> theres positive input i have a zoo of dev machines i could load it on, to
> help further it.
> Just checking to see how widely its been tested,
Very stable so far. I'm doing a make -j 4 buildworld in parallel of a
periodic security run. This has been running for hours without failure.
--
Jeremie Le Hen
Scientists say the world is made up of Protons, Neutrons and Electrons.
They forgot to mention Morons.
From owner-freebsd-hackers@FreeBSD.ORG Tue Sep 3 21:48:59 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id CF592D11;
Tue, 3 Sep 2013 21:48:59 +0000 (UTC)
(envelope-from cochard@gmail.com)
Received: from mail-vc0-x22e.google.com (mail-vc0-x22e.google.com
[IPv6:2607:f8b0:400c:c03::22e])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 429CF2CE8;
Tue, 3 Sep 2013 21:48:59 +0000 (UTC)
Received: by mail-vc0-f174.google.com with SMTP id gd11so4411172vcb.33
for <multiple recipients>; Tue, 03 Sep 2013 14:48:58 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:sender:in-reply-to:references:from:date:message-id
:subject:to:cc:content-type:content-transfer-encoding;
bh=CBjXK0KDjfW54LD0Yc8Pdr2jYxRu1lPETfc0cnr1Bmc=;
b=FpG2g3+gqV/sAGRekCamqW+S4AgnWmAAHYsDfwV8PYuMp25Pc7l2Yj+j91pf0Su4uu
IcIMAh5gvovMC46lw2aukJBCDj1MjgqvYC2GeSY6J41OtF+hYB7wkZSc8i9PDQsSNh6B
fhRzJWFFp7LJnLLlPIinShJjc/G+61lF9CMUhK9JFnOuEhrFEL7SLmpWfV3yILsWC8JZ
NwrbWss4RjzGjROVy8/XNbhPsnib7Omewe9X8HWyV4caAokWoo35QCqTo76g3swbhmxi
0lEMbkNMFQoiMzNlmN7qQdc9UFKTaDAe5CmeVHNtXsUpNP+dZKHzfhX9vZLFWJMHbGws
Cp5Q==
X-Received: by 10.220.199.5 with SMTP id eq5mr30028964vcb.16.1378244938366;
Tue, 03 Sep 2013 14:48:58 -0700 (PDT)
MIME-Version: 1.0
Sender: cochard@gmail.com
Received: by 10.58.221.9 with HTTP; Tue, 3 Sep 2013 14:48:38 -0700 (PDT)
In-Reply-To: <CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= <olivier@cochard.me>
Date: Tue, 3 Sep 2013 23:48:38 +0200
X-Google-Sender-Auth: aEdoOoFc0E9sVrPag-3cJJNc85Q
Message-ID: <CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
To: Outback Dingo <outbackdingo@gmail.com>
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable
Cc: FreeBSD SCSI <freebsd-scsi@freebsd.org>, Alexander Motin <mav@freebsd.org>,
freebsd-geom@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-hackers@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 03 Sep 2013 21:48:59 -0000
On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo <outbackdingo@gmail.com> wrot=
e:
> Can anyone confirm how well tested/stable this patch set might be?? if
> theres positive input i have a zoo of dev machines i could load it on, to
> help further it.
> Just checking to see how widely its been tested,
I've installed this patch on 3 differents machines there status after
about 12hours:
- SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big
zraid (LSI MegaSAS Gen2 controller): Used for generating package with
poudriere=85 no probleme since;
- HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in
gmirror: Used for generating package with poudriere too=85 no probleme
since;
- HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second
hardrive (where fbsd is installed): It crash just after the message
"GEOM: new disk ada1" during boot
screenshot of the crash screen:
http://goo.gl/tW1VIx
A little more information:
addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3
/usr/src/sys/geom/geom_io.c:129
Regards,
Olivier
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 00:31:57 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 8F70EAC0;
Wed, 4 Sep 2013 00:31:57 +0000 (UTC)
(envelope-from outbackdingo@gmail.com)
Received: from mail-oa0-x235.google.com (mail-oa0-x235.google.com
[IPv6:2607:f8b0:4003:c02::235])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 21888294D;
Wed, 4 Sep 2013 00:31:57 +0000 (UTC)
Received: by mail-oa0-f53.google.com with SMTP id k18so7551333oag.40
for <multiple recipients>; Tue, 03 Sep 2013 17:31:56 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:cc:content-type;
bh=TId/rHSlvsa6OMpmrl6Hypdr+azDGQF6VQU75p4pbAo=;
b=N9O4AbJbWm2zaYqkUExEK3TP0U5H2bZNKkcXKTW8ovzbRua0M90ILPnYT2RXTRSSrP
zgIeARpfG96nx5/c0ngFPNngf7WinJkrThKkPi8d58Wzs0x+jIdUBmxEQ4nrzeZrRvvf
UKnXqv/PydLKWaj7jUNpIvwIBumxj05SixTVz4+0yfPVJvret7XoojZvWbTw5Fs5llVf
d696ivBUI6xN4pUpTRbc0gZzMQV/iFFm2WA4RrG5A7hbJ1EnmcHd1xHpFAGnQtXm8OOR
hvTefxsIdmH4X5TeIcsNFZFUWWJIhYxRrmIFF3HooL2uwbJKEVpzdtk1ShdE90zlWzI/
sNrA==
MIME-Version: 1.0
X-Received: by 10.60.52.244 with SMTP id w20mr128413oeo.30.1378254716439; Tue,
03 Sep 2013 17:31:56 -0700 (PDT)
Received: by 10.76.114.227 with HTTP; Tue, 3 Sep 2013 17:31:56 -0700 (PDT)
In-Reply-To: <CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
Date: Tue, 3 Sep 2013 20:31:56 -0400
Message-ID: <CAKYr3zzYzxU6_3obsiM5_h1GdqT3erJZ1jNdYap3C335aSwc9g@mail.gmail.com>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
From: Outback Dingo <outbackdingo@gmail.com>
To: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= <olivier@cochard.me>
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.14
Cc: FreeBSD SCSI <freebsd-scsi@freebsd.org>, Alexander Motin <mav@freebsd.org>,
freebsd-geom@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-hackers@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 00:31:57 -0000
On Tue, Sep 3, 2013 at 5:48 PM, Olivier Cochard-Labb=E9 <olivier@cochard.me=
>wrote:
> On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo <outbackdingo@gmail.com>
> wrote:
> > Can anyone confirm how well tested/stable this patch set might be?? if
> > theres positive input i have a zoo of dev machines i could load it on, =
to
> > help further it.
> > Just checking to see how widely its been tested,
>
> I've installed this patch on 3 differents machines there status after
> about 12hours:
> - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big
> zraid (LSI MegaSAS Gen2 controller): Used for generating package with
> poudriere=85 no probleme since;
> - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in
> gmirror: Used for generating package with poudriere too=85 no probleme
> since;
> - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second
> hardrive (where fbsd is installed): It crash just after the message
> "GEOM: new disk ada1" during boot
>
> screenshot of the crash screen:
> http://goo.gl/tW1VIx
>
> A little more information:
> addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3
> /usr/src/sys/geom/geom_io.c:129
>
> Regards,
>
> Olivier
>
Be nice if it was backported to 9/stable..... not sure how feasible it is
though... patch fails in a few places.....
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 05:24:49 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 0A1FEFC1;
Wed, 4 Sep 2013 05:24:49 +0000 (UTC) (envelope-from jlh@FreeBSD.org)
Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id C33F32E6C;
Wed, 4 Sep 2013 05:24:48 +0000 (UTC)
Received: by caravan.chchile.org (Postfix, from userid 1000)
id EAEB2C0A95; Wed, 4 Sep 2013 05:24:46 +0000 (UTC)
Date: Wed, 4 Sep 2013 07:24:46 +0200
From: Jeremie Le Hen <jlh@FreeBSD.org>
To: Outback Dingo <outbackdingo@gmail.com>, Alexander Motin <mav@freebsd.org>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>,
freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
Message-ID: <20130904052446.GD43281@caravan.chchile.org>
Mail-Followup-To: Outback Dingo <outbackdingo@gmail.com>,
Alexander Motin <mav@freebsd.org>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>,
freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<20130903212426.GC43281@caravan.chchile.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <20130903212426.GC43281@caravan.chchile.org>
User-Agent: Mutt/1.5.21 (2010-09-15)
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 05:24:49 -0000
On Tue, Sep 03, 2013 at 11:24:26PM +0200, Jeremie Le Hen wrote:
> On Tue, Sep 03, 2013 at 02:10:32PM -0400, Outback Dingo wrote:
> > On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen <jlh@freebsd.org> wrote:
> >
> > > On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote:
> > > > Hi.
> > > >
> > > > I would like to invite more people to review and test my patches for
> > > > improving CAM and GEOM scalability, that for last six months you could
> > > > see developing in project/camlock SVN branch. Full diff of that branch
> > > > against present head (r255131) can be found here:
> > > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch
> > >
> > > I'm building my kernel right now.
> > >
> > >
> > Can anyone confirm how well tested/stable this patch set might be?? if
> > theres positive input i have a zoo of dev machines i could load it on, to
> > help further it.
> > Just checking to see how widely its been tested,
>
> Very stable so far. I'm doing a make -j 4 buildworld in parallel of a
> periodic security run. This has been running for hours without failure.
FWIW, I have 4 drives total, distributed in 2 zpool containing 2
mirrored zdev each.
--
Jeremie Le Hen
Scientists say the world is made up of Protons, Neutrons and Electrons.
They forgot to mention Morons.
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 07:01:10 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 8FFDD7C1;
Wed, 4 Sep 2013 07:01:10 +0000 (UTC)
(envelope-from mavbsd@gmail.com)
Received: from mail-wg0-x233.google.com (mail-wg0-x233.google.com
[IPv6:2a00:1450:400c:c00::233])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 9DA8C28C1;
Wed, 4 Sep 2013 07:01:09 +0000 (UTC)
Received: by mail-wg0-f51.google.com with SMTP id a12so2264428wgh.18
for <multiple recipients>; Wed, 04 Sep 2013 00:01:08 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject
:references:in-reply-to:content-type:content-transfer-encoding;
bh=qQcQ3lQg5yW+MrAD8YAtILdaaJNlfmGx3bzF9F7m8w4=;
b=q8BByWIwrdXM0K8ttL7/CYbzTbXgtwpUKxUd5p0FbZVX2X9XpDwckinfdQuHvyrBUY
nRy6UzUA1z/Zcr4TamS6QIfLFesAEaP2U4PhFAXGEBSAZovv++c+xBCE9aXc/ItIjdcg
/0vhg42kSaV0JcI7uY1boJ8qr0hL8jyc7+gn3J8SaLGwgzP70UagttzyHZ7iPe9EGmRi
PHG8OioZTgzu7P/TZA4Y/yKO7AAtgZyGP9s9ZU4wOAmww5/6AD/twLjYA+Bb7TlMi4mk
Qfg8zOuneoPIQrJQoT7BsOpaJ4h4zEdJCmGmbwTr+lHJF569lSfAvRBY36ifozGjD7zy
h2nw==
X-Received: by 10.180.75.16 with SMTP id y16mr767253wiv.59.1378278067954;
Wed, 04 Sep 2013 00:01:07 -0700 (PDT)
Received: from mavbook.mavhome.dp.ua ([37.229.21.195])
by mx.google.com with ESMTPSA id mw9sm1595508wic.4.1969.12.31.16.00.00
(version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
Wed, 04 Sep 2013 00:01:06 -0700 (PDT)
Sender: Alexander Motin <mavbsd@gmail.com>
Message-ID: <5226DAB0.1060303@FreeBSD.org>
Date: Wed, 04 Sep 2013 10:01:04 +0300
From: Alexander Motin <mav@FreeBSD.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130616 Thunderbird/17.0.6
MIME-Version: 1.0
To: =?windows-1252?Q?Olivier_Cochard-Labb=E9?= <olivier@cochard.me>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
In-Reply-To: <CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 8bit
Cc: Outback Dingo <outbackdingo@gmail.com>, freebsd-geom@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-hackers@freebsd.org, FreeBSD SCSI <freebsd-scsi@freebsd.org>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 07:01:10 -0000
On 04.09.2013 00:48, Olivier Cochard-Labbé wrote:
> On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo <outbackdingo@gmail.com> wrote:
>> Can anyone confirm how well tested/stable this patch set might be?? if
>> theres positive input i have a zoo of dev machines i could load it on, to
>> help further it.
>> Just checking to see how widely its been tested,
>
> I've installed this patch on 3 differents machines there status after
> about 12hours:
> - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big
> zraid (LSI MegaSAS Gen2 controller): Used for generating package with
> poudriere… no probleme since;
> - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in
> gmirror: Used for generating package with poudriere too… no probleme
> since;
I've forgot to mention, but GEOM direct dispatch is now active only on
x86 because GET_STACK_USAGE macro now defined only there and I wanted to
stay on a safe side. On other archs GEOM works in old queued way.
Somebody should port that small macro to other archs. But that is still
interesting data point. Thanks.
> - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second
> hardrive (where fbsd is installed): It crash just after the message
> "GEOM: new disk ada1" during boot
>
> screenshot of the crash screen:
> http://goo.gl/tW1VIx
>
> A little more information:
> addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3
> /usr/src/sys/geom/geom_io.c:129
Unfortunately I can't reproduce that and have not enough clues. It may
be specific to some GEOM class. Could you describe/show all GEOM
topology, file systems, etc. you have there?
gpart show
sysctl kern.geom.confxml
...
Thank you!
--
Alexander Motin
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 07:50:31 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 9347CCD8
for <freebsd-hackers@freebsd.org>; Wed, 4 Sep 2013 07:50:31 +0000 (UTC)
(envelope-from benjamin.villain@gmail.com)
Received: from mail-we0-x22b.google.com (mail-we0-x22b.google.com
[IPv6:2a00:1450:400c:c03::22b])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 2AE9A2B22
for <freebsd-hackers@freebsd.org>; Wed, 4 Sep 2013 07:50:31 +0000 (UTC)
Received: by mail-we0-f171.google.com with SMTP id p57so5637056wes.2
for <freebsd-hackers@freebsd.org>; Wed, 04 Sep 2013 00:50:29 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:content-type; bh=IKyO2EqbSPO6N27reCgqkqiXp9zIyJILDQyHB4apH+w=;
b=BTTsSCoHNy5Z52mVAtqBjLZB2PBQh+0SHkkcmVeq9+8PKi1v7GvLImGyysvjvd2Ob6
RHCtq8f7HeOqBHetJZ9oUkXfDtEJfOiS/aQ1GkQrfG17KRpQcwQfoUOayNLa2FpOkXKO
TW3pJwMy/BDqzETLxE2EiLJpJqGDAGAFF1HZMKQthtiW/cLbnkx8NS9wfuaYYP2AKqNa
x1UGxXAL4GzaN/qNXtOzu0yOmF0Vmuzm46OfOhXkDdONOyHmzxNIpGM/zTui5mZvFaSg
1Qh1TY3l9H/B1XC3I5KDFpklDlqzZlARIhqSj6FptRoY1KiD9U2kEnK0lNZVqSEJXO+F
Zy5w==
MIME-Version: 1.0
X-Received: by 10.180.188.202 with SMTP id gc10mr1044155wic.3.1378281029508;
Wed, 04 Sep 2013 00:50:29 -0700 (PDT)
Received: by 10.194.2.129 with HTTP; Wed, 4 Sep 2013 00:50:29 -0700 (PDT)
In-Reply-To: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net>
References: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net>
Date: Wed, 4 Sep 2013 09:50:29 +0200
Message-ID: <CAHx+AbxbPKP2gKsCKOrtWc3Uo9uJR9SyWs_nNV5w0M-zNhBong@mail.gmail.com>
Subject: Re: booting FreeBSD on Apple Mac mini with GPT disk partition
From: Benjamin VILLAIN <benjamin.villain@gmail.com>
To: Kim Shrier <kim@westryn.net>, freebsd-hackers@freebsd.org
Content-Type: text/plain; charset=ISO-8859-1
X-Content-Filtered-By: Mailman/MimeDel 2.1.14
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 07:50:31 -0000
Hi Kim,
I had some trouble bootin FreeBSD on my macbook pro last year. It seems
that you have to boot FreeBSD in BIOS mode (UEFI bootloader is not
available yet on amd64) and this can only be achieved on the SATA hard
drive (not an external one).
I don't know how are you trying to boot it but it should work (this link
could help https://wiki.freebsd.org/AppleMacbook).
Regards,
--
Ben
On Tue, Sep 3, 2013 at 10:29 PM, Kim Shrier <kim@westryn.net> wrote:
> Does anyone know if work on booting FreeBSD on modern Apple hardware
> was ever completed? I have looked on the wiki, forums, and email archives
> but I don't see anything definitive.
>
> I would like to have a GPT partitioned disk with a freebsd-boot,
> freebsd-swap,
> and multiple freebsd-ufs partitions on a new Mac mini. Any pointers would
> be
> appreciated.
>
> Thanks,
> Kim
> --
> Kim Shrier - kim@westryn.net
> Shrier and Deihl, Westryn Internet Services
> Internet Software Development and Hosting
> Remote Unix Admin, Security
> http://www.westryn.net/
>
> _______________________________________________
> freebsd-hackers@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"
>
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 09:39:04 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 545D2522
for <freebsd-hackers@freebsd.org>; Wed, 4 Sep 2013 09:39:04 +0000 (UTC)
(envelope-from vince@unsane.co.uk)
Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net
[IPv6:2001:470:1f08:110::2])
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id DECDB2322
for <freebsd-hackers@freebsd.org>; Wed, 4 Sep 2013 09:39:03 +0000 (UTC)
Received: from vhoffman.lon.namesco.net (lon.namesco.net [195.7.254.102])
(authenticated bits=0)
by unsane.co.uk (8.14.7/8.14.6) with ESMTP id r849cx8F046461
(version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO);
Wed, 4 Sep 2013 10:39:01 +0100 (BST)
(envelope-from vince@unsane.co.uk)
Message-ID: <5226FFB3.3050407@unsane.co.uk>
Date: Wed, 04 Sep 2013 10:38:59 +0100
From: Vincent Hoffman <vince@unsane.co.uk>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
rv:17.0) Gecko/20130801 Thunderbird/17.0.8
MIME-Version: 1.0
To: Kim Shrier <kim@westryn.net>
Subject: Re: booting FreeBSD on Apple Mac mini with GPT disk partition
References: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net>
In-Reply-To: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net>
X-Enigmail-Version: 1.5.2
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Cc: FreeBSD Hackers <freebsd-hackers@freebsd.org>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 09:39:04 -0000
On 03/09/2013 21:29, Kim Shrier wrote:
> Does anyone know if work on booting FreeBSD on modern Apple hardware
> was ever completed? I have looked on the wiki, forums, and email archives
> but I don't see anything definitive.
>
> I would like to have a GPT partitioned disk with a freebsd-boot, freebsd-swap,
> and multiple freebsd-ufs partitions on a new Mac mini. Any pointers would be
> appreciated.
I believe efi boot is almost done https://wiki.freebsd.org/UEFI
I haven't tested yet although I may sometime soon as it would be nice to
have my macbook dual boot without having to use bootcamp.
Vince
>
> Thanks,
> Kim
> --
> Kim Shrier - kim@westryn.net
> Shrier and Deihl, Westryn Internet Services
> Internet Software Development and Hosting
> Remote Unix Admin, Security
> http://www.westryn.net/
>
> _______________________________________________
> freebsd-hackers@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 12:45:46 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 9B0D06B2;
Wed, 4 Sep 2013 12:45:46 +0000 (UTC)
(envelope-from nwhitehorn@freebsd.org)
Received: from smtpauth4.wiscmail.wisc.edu (wmauth4.doit.wisc.edu
[144.92.197.145]) (using TLSv1 with cipher RC4-MD5 (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 6CD8D2023;
Wed, 4 Sep 2013 12:45:46 +0000 (UTC)
MIME-version: 1.0
Content-transfer-encoding: 8BIT
Content-type: text/plain; charset=windows-1252; format=flowed
Received: from avs-daemon.smtpauth4.wiscmail.wisc.edu by
smtpauth4.wiscmail.wisc.edu
(Oracle Communications Messaging Server 7u4-27.01(7.0.4.27.0) 64bit (built Aug
30 2012)) id <0MSL00100PMPTB00@smtpauth4.wiscmail.wisc.edu>; Wed,
04 Sep 2013 07:45:38 -0500 (CDT)
X-Spam-PmxInfo: Server=avs-4, Version=6.0.3.2322014,
Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2013.9.4.123619,
SenderIP=0.0.0.0
X-Spam-Report: AuthenticatedSender=yes, SenderIP=0.0.0.0
Received: from comporellon.tachypleus.net
(adsl-76-208-67-185.dsl.mdsnwi.sbcglobal.net [76.208.67.185])
by smtpauth4.wiscmail.wisc.edu
(Oracle Communications Messaging Server 7u4-27.01(7.0.4.27.0) 64bit (built Aug
30 2012)) with ESMTPSA id <0MSL0024HQ41OI20@smtpauth4.wiscmail.wisc.edu>; Wed,
04 Sep 2013 07:45:38 -0500 (CDT)
Message-id: <52272B6F.9060308@freebsd.org>
Date: Wed, 04 Sep 2013 07:45:35 -0500
From: Nathan Whitehorn <nwhitehorn@freebsd.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130810
Thunderbird/17.0.8
To: Alexander Motin <mav@FreeBSD.org>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org>
In-reply-to: <5226DAB0.1060303@FreeBSD.org>
Cc: freebsd-geom@freebsd.org, freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>,
=?windows-1252?Q?Olivier_Cochard-Labb=E9?= <olivier@cochard.me>,
Outback Dingo <outbackdingo@gmail.com>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 12:45:46 -0000
On 09/04/13 02:01, Alexander Motin wrote:
> On 04.09.2013 00:48, Olivier Cochard-Labbé wrote:
>> On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo
>> <outbackdingo@gmail.com> wrote:
>>> Can anyone confirm how well tested/stable this patch set might be?? if
>>> theres positive input i have a zoo of dev machines i could load it
>>> on, to
>>> help further it.
>>> Just checking to see how widely its been tested,
>>
>> I've installed this patch on 3 differents machines there status after
>> about 12hours:
>> - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big
>> zraid (LSI MegaSAS Gen2 controller): Used for generating package with
>> poudriere… no probleme since;
>> - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in
>> gmirror: Used for generating package with poudriere too… no probleme
>> since;
>
> I've forgot to mention, but GEOM direct dispatch is now active only on
> x86 because GET_STACK_USAGE macro now defined only there and I wanted
> to stay on a safe side. On other archs GEOM works in old queued way.
> Somebody should port that small macro to other archs. But that is
> still interesting data point. Thanks.
Could you describe what this macro is supposed to do so that we can do
the porting work?
-Nathan
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 13:20:43 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id DB979543;
Wed, 4 Sep 2013 13:20:43 +0000 (UTC)
(envelope-from rysto32@gmail.com)
Received: from mail-oa0-x230.google.com (mail-oa0-x230.google.com
[IPv6:2607:f8b0:4003:c02::230])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 63677232C;
Wed, 4 Sep 2013 13:20:43 +0000 (UTC)
Received: by mail-oa0-f48.google.com with SMTP id o17so336172oag.7
for <multiple recipients>; Wed, 04 Sep 2013 06:20:42 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:in-reply-to:references:date:message-id:subject:from:to
:cc:content-type;
bh=uHQmwWU2MeBmE/1UIl47yFWFen4/AkTbDSQbsQhd/98=;
b=enzMJG+Q9dZrdLHyb1h7LtN5bwcG03+y9VX9vqViqefI8Xfn4TWYmYwfAcF+qlPajc
aRSfaiptbvyhvaBXy13j6fU3S8qgkA1ZiASZo8QW9xy1vfyntiguHgwsrg1rVQwoWZg0
jB94flQsMzViMSro/7HDhKwJZLEZvUQQfS/9sYmYkhxI5jZGBXOa4BQKDzWES1QGbwpf
Oizz1P9WubWSrm92QtGsBkWB+HM2QdrYZQ75nCe/9u5j22q8bnkt57oAlQVtK5DjVh3h
jOLiw/gTkx0IcWI8U/NIR79vbuBXa3nQiFrHMZU7uPRKg/gaSpIggGd7i6mi5HduGSY6
/2AQ==
MIME-Version: 1.0
X-Received: by 10.182.73.136 with SMTP id l8mr2102864obv.53.1378300842725;
Wed, 04 Sep 2013 06:20:42 -0700 (PDT)
Received: by 10.76.68.38 with HTTP; Wed, 4 Sep 2013 06:20:42 -0700 (PDT)
In-Reply-To: <52272B6F.9060308@freebsd.org>
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org>
Date: Wed, 4 Sep 2013 09:20:42 -0400
Message-ID: <CAFMmRNzkL+uOsC=2Cq_S4Zm5fkmrQRNYcKfijA8yyYcxvLaXPQ@mail.gmail.com>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
From: Ryan Stone <rysto32@gmail.com>
To: Nathan Whitehorn <nwhitehorn@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
Cc: freebsd-geom@freebsd.org,
"freebsd-hackers@freebsd.org" <freebsd-hackers@freebsd.org>,
Alexander Motin <mav@freebsd.org>,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
Outback Dingo <outbackdingo@gmail.com>,
=?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= <olivier@cochard.me>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 13:20:44 -0000
On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn <nwhitehorn@freebsd.org> wrote:
> Could you describe what this macro is supposed to do so that we can do the
> porting work?
> -Nathan
#define GET_STACK_USAGE(total, used)
GET_STACK_USAGE sets the variable passed in total to the total amount
of stack space available to the current thread. used is set to the
amount of stack space currently used (this does not have to have
byte-precision). Netgraph uses this to decide when to stop recursing
and instead defer to a work queue (to prevent stack overflow). I
presume that Alexander is using it in a similar way. It looks like
the amd64 version could be ported to other architectures quite easily
if you were to account for stacks that grow up and stacks that grow
down:
http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup
/* Get the current kernel thread stack usage. */
#define GET_STACK_USAGE(total, used) do { \
struct thread *td = curthread; \
(total) = td->td_kstack_pages * PAGE_SIZE; \
(used) = (char *)td->td_kstack + \
td->td_kstack_pages * PAGE_SIZE - \
(char *)&td; \
} while (0)
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 13:29:36 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 5C9FFA0B;
Wed, 4 Sep 2013 13:29:36 +0000 (UTC)
(envelope-from mavbsd@gmail.com)
Received: from mail-bk0-x236.google.com (mail-bk0-x236.google.com
[IPv6:2a00:1450:4008:c01::236])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 311752412;
Wed, 4 Sep 2013 13:29:34 +0000 (UTC)
Received: by mail-bk0-f54.google.com with SMTP id mz12so167341bkb.41
for <multiple recipients>; Wed, 04 Sep 2013 06:29:33 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject
:references:in-reply-to:content-type:content-transfer-encoding;
bh=KjWIzi+zzjy5EixOq84YnmeCwO5/zYJUl+xwaZAS7cg=;
b=0wsCwn3GAC/ztaUAyTioLu8wt7jKdQkNpoOBKxI/fIxljCYeuc8fS7HSV/3AfYAiSJ
nkcBy+X5TCHq8Qx4Vd8y2f/UGyUu5GXtOpu6H++c/hhoqnd3ulD1V0kyCFTFJu+o27mK
CKfHvsuCNeUapbd/ry9rs829ItCJMdu3jUQrvq9dpbCZCfr79CRp+JXHrFM5Cz4TPYpI
yqqtOFs51qPuwJ//NLlz8gF6D6xDhu6m1jeUfet2chJUAoTEUa7EZlfuL1zAmTTspHLo
us5pLyZb6qWMBdEBR42rmbqV51Bw58/dJh40ko038vjbqhznKhY3yKY9pt2W9HRvmJJU
1Wqg==
X-Received: by 10.205.22.71 with SMTP id qv7mr2518681bkb.20.1378301373128;
Wed, 04 Sep 2013 06:29:33 -0700 (PDT)
Received: from mavbook.mavhome.dp.ua ([37.229.21.195])
by mx.google.com with ESMTPSA id 14sm6560105bkl.17.1969.12.31.16.00.00
(version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
Wed, 04 Sep 2013 06:29:32 -0700 (PDT)
Sender: Alexander Motin <mavbsd@gmail.com>
Message-ID: <522735B9.1070403@FreeBSD.org>
Date: Wed, 04 Sep 2013 16:29:29 +0300
From: Alexander Motin <mav@FreeBSD.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130616 Thunderbird/17.0.6
MIME-Version: 1.0
To: Nathan Whitehorn <nwhitehorn@freebsd.org>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org>
In-Reply-To: <52272B6F.9060308@freebsd.org>
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 8bit
Cc: freebsd-geom@freebsd.org, freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>,
=?windows-1252?Q?Olivier_Cochard-Labb=E9?= <olivier@cochard.me>,
Outback Dingo <outbackdingo@gmail.com>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 13:29:36 -0000
On 04.09.2013 15:45, Nathan Whitehorn wrote:
> On 09/04/13 02:01, Alexander Motin wrote:
>> On 04.09.2013 00:48, Olivier Cochard-Labbé wrote:
>>> On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo
>>> <outbackdingo@gmail.com> wrote:
>>>> Can anyone confirm how well tested/stable this patch set might be?? if
>>>> theres positive input i have a zoo of dev machines i could load it
>>>> on, to
>>>> help further it.
>>>> Just checking to see how widely its been tested,
>>>
>>> I've installed this patch on 3 differents machines there status after
>>> about 12hours:
>>> - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big
>>> zraid (LSI MegaSAS Gen2 controller): Used for generating package with
>>> poudriere… no probleme since;
>>> - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in
>>> gmirror: Used for generating package with poudriere too… no probleme
>>> since;
>>
>> I've forgot to mention, but GEOM direct dispatch is now active only on
>> x86 because GET_STACK_USAGE macro now defined only there and I wanted
>> to stay on a safe side. On other archs GEOM works in old queued way.
>> Somebody should port that small macro to other archs. But that is
>> still interesting data point. Thanks.
>
> Could you describe what this macro is supposed to do so that we can do
> the porting work?
It supposed to report total and used stack sizes for current thread. I
suppose that it will be equal for the most archs, but better somebody
familiar with each one looked on it. The macro itself is not new. It is
for years used in Netgraph for equivalent purpose.
--
Alexander Motin
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 14:34:09 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 23331F09;
Wed, 4 Sep 2013 14:34:09 +0000 (UTC)
(envelope-from nwhitehorn@freebsd.org)
Received: from mail.icecube.wisc.edu (trout.icecube.wisc.edu [128.104.255.119])
by mx1.freebsd.org (Postfix) with ESMTP id D9331284D;
Wed, 4 Sep 2013 14:34:08 +0000 (UTC)
Received: from localhost (localhost.localdomain [127.0.0.1])
by mail.icecube.wisc.edu (Postfix) with ESMTP id 50CBE5838C;
Wed, 4 Sep 2013 09:11:29 -0500 (CDT)
X-Virus-Scanned: amavisd-new at icecube.wisc.edu
Received: from mail.icecube.wisc.edu ([127.0.0.1])
by localhost (trout.icecube.wisc.edu [127.0.0.1]) (amavisd-new, port 10030)
with ESMTP id F6OyxvU8mfj5; Wed, 4 Sep 2013 09:11:29 -0500 (CDT)
Received: from terminus.icecube.wisc.edu (terminus.icecube.wisc.edu
[172.16.223.97])
by mail.icecube.wisc.edu (Postfix) with ESMTP id 3115758388;
Wed, 4 Sep 2013 09:11:29 -0500 (CDT)
Message-ID: <52273F90.7020303@freebsd.org>
Date: Wed, 04 Sep 2013 09:11:28 -0500
From: Nathan Whitehorn <nwhitehorn@freebsd.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130809 Thunderbird/17.0.8
MIME-Version: 1.0
To: Ryan Stone <rysto32@gmail.com>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org>
<CAFMmRNzkL+uOsC=2Cq_S4Zm5fkmrQRNYcKfijA8yyYcxvLaXPQ@mail.gmail.com>
In-Reply-To: <CAFMmRNzkL+uOsC=2Cq_S4Zm5fkmrQRNYcKfijA8yyYcxvLaXPQ@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: freebsd-geom@freebsd.org,
"freebsd-hackers@freebsd.org" <freebsd-hackers@freebsd.org>,
Alexander Motin <mav@freebsd.org>,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>,
=?ISO-8859-1?Q?Olivier_Cochard?= =?ISO-8859-1?Q?-Labb=E9?=
<olivier@cochard.me>, Outback Dingo <outbackdingo@gmail.com>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 14:34:09 -0000
On 09/04/13 08:20, Ryan Stone wrote:
> On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn <nwhitehorn@freebsd.org> wrote:
>> Could you describe what this macro is supposed to do so that we can do the
>> porting work?
>> -Nathan
> #define GET_STACK_USAGE(total, used)
>
> GET_STACK_USAGE sets the variable passed in total to the total amount
> of stack space available to the current thread. used is set to the
> amount of stack space currently used (this does not have to have
> byte-precision). Netgraph uses this to decide when to stop recursing
> and instead defer to a work queue (to prevent stack overflow). I
> presume that Alexander is using it in a similar way. It looks like
> the amd64 version could be ported to other architectures quite easily
> if you were to account for stacks that grow up and stacks that grow
> down:
>
> http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup
>
> /* Get the current kernel thread stack usage. */
> #define GET_STACK_USAGE(total, used) do { \
> struct thread *td = curthread; \
> (total) = td->td_kstack_pages * PAGE_SIZE; \
> (used) = (char *)td->td_kstack + \
> td->td_kstack_pages * PAGE_SIZE - \
> (char *)&td; \
> } while (0)
> _______________________________________________
> freebsd-hackers@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"
I think that should be MI for us anyway. I'm not aware of any
architectures FreeBSD supports with stacks that grow up. I'll give it a
test on PPC.
-Nathan
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 16:07:51 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 2BC56248;
Wed, 4 Sep 2013 16:07:51 +0000 (UTC) (envelope-from jhb@freebsd.org)
Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id EA3DA2E7C;
Wed, 4 Sep 2013 16:07:50 +0000 (UTC)
Received: from jhbbsd.localnet (unknown [209.249.190.124])
by bigwig.baldwin.cx (Postfix) with ESMTPSA id 99108B941;
Wed, 4 Sep 2013 12:07:49 -0400 (EDT)
From: John Baldwin <jhb@freebsd.org>
To: freebsd-current@freebsd.org
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
Date: Wed, 4 Sep 2013 12:00:55 -0400
User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p28; KDE/4.5.5; amd64; ; )
References: <520D4ADB.50209@FreeBSD.org>
<CAFMmRNzkL+uOsC=2Cq_S4Zm5fkmrQRNYcKfijA8yyYcxvLaXPQ@mail.gmail.com>
<52273F90.7020303@freebsd.org>
In-Reply-To: <52273F90.7020303@freebsd.org>
MIME-Version: 1.0
Content-Type: Text/Plain;
charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
Message-Id: <201309041200.56024.jhb@freebsd.org>
X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7
(bigwig.baldwin.cx); Wed, 04 Sep 2013 12:07:49 -0400 (EDT)
Cc: freebsd-geom@freebsd.org,
"freebsd-hackers@freebsd.org" <freebsd-hackers@freebsd.org>,
Alexander Motin <mav@freebsd.org>, Nathan Whitehorn <nwhitehorn@freebsd.org>,
Outback Dingo <outbackdingo@gmail.com>, Olivier
=?iso-8859-1?q?Cochard-Labb=E9?= <olivier@cochard.me>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>, Ryan Stone <rysto32@gmail.com>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 16:07:51 -0000
On Wednesday, September 04, 2013 10:11:28 am Nathan Whitehorn wrote:
> On 09/04/13 08:20, Ryan Stone wrote:
> > On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn <nwhitehorn@freebsd.org>
wrote:
> >> Could you describe what this macro is supposed to do so that we can do
the
> >> porting work?
> >> -Nathan
> > #define GET_STACK_USAGE(total, used)
> >
> > GET_STACK_USAGE sets the variable passed in total to the total amount
> > of stack space available to the current thread. used is set to the
> > amount of stack space currently used (this does not have to have
> > byte-precision). Netgraph uses this to decide when to stop recursing
> > and instead defer to a work queue (to prevent stack overflow). I
> > presume that Alexander is using it in a similar way. It looks like
> > the amd64 version could be ported to other architectures quite easily
> > if you were to account for stacks that grow up and stacks that grow
> > down:
> >
> >
http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup
> >
> > /* Get the current kernel thread stack usage. */
> > #define GET_STACK_USAGE(total, used) do { \
> > struct thread *td = curthread; \
> > (total) = td->td_kstack_pages * PAGE_SIZE; \
> > (used) = (char *)td->td_kstack + \
> > td->td_kstack_pages * PAGE_SIZE - \
> > (char *)&td; \
> > } while (0)
> > _______________________________________________
> > freebsd-hackers@freebsd.org mailing list
> > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
> > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"
>
> I think that should be MI for us anyway. I'm not aware of any
> architectures FreeBSD supports with stacks that grow up. I'll give it a
> test on PPC.
ia64 has the double stack thingie where the register stack spills into a stack
that grows up rather than down. Not sure how sparc64 window spills are
handled either.
--
John Baldwin
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 16:31:42 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 4A9B1A7D;
Wed, 4 Sep 2013 16:31:42 +0000 (UTC)
(envelope-from cochard@gmail.com)
Received: from mail-ve0-x233.google.com (mail-ve0-x233.google.com
[IPv6:2607:f8b0:400c:c01::233])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id C5B36208D;
Wed, 4 Sep 2013 16:31:41 +0000 (UTC)
Received: by mail-ve0-f179.google.com with SMTP id c13so355336vea.24
for <multiple recipients>; Wed, 04 Sep 2013 09:31:41 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:sender:in-reply-to:references:from:date:message-id
:subject:to:cc:content-type;
bh=XKa27OKDe9ewp7I9s+bvP097LtkA+VxHI3Fh9yDbWCk=;
b=frtCXDU6t24rPHRkOrb2X2Aa1jhUxb6+6DY9/2xktyww57uJ0CqenvLPxKmQqKP61f
bTFyYtzsLCOOVf2Z2HjuJBSFUn+9ShEL5zUGpFgNSztb5D2wxvG4JukPoSS6pAMTqo1I
Zj5BM1KsLooN5a01V0pN/XHskzazNgIMaiM3PsKT0HEE0K4y4CsOC6MZMgLtozgQ3Hfy
8aoPvQpbmDV0R8W5V88Kw+IFErJObBeibb9NErqbpTsCwMDpxbGBDETduRyqlBZTlyF7
vxkpip8oeFjY3o/XugpsSg/tuMh0LAw7MepfePTD4QOSiDlZ72JhDo+kWSQKvpEWkrEG
OomQ==
X-Received: by 10.58.197.5 with SMTP id iq5mr849761vec.30.1378312300764; Wed,
04 Sep 2013 09:31:40 -0700 (PDT)
MIME-Version: 1.0
Sender: cochard@gmail.com
Received: by 10.58.221.9 with HTTP; Wed, 4 Sep 2013 09:31:20 -0700 (PDT)
In-Reply-To: <5226DAB0.1060303@FreeBSD.org>
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org>
From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= <olivier@cochard.me>
Date: Wed, 4 Sep 2013 18:31:20 +0200
X-Google-Sender-Auth: JDxTeJui3sHLgm5FliEs0nhysPc
Message-ID: <CA+q+TcoKg-FuuKt_L9W8rGc_ZEv9XOteq=x6N+VT9_mUhRJDHQ@mail.gmail.com>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
To: Alexander Motin <mav@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
Cc: freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 16:31:42 -0000
On Wed, Sep 4, 2013 at 9:01 AM, Alexander Motin <mav@freebsd.org> wrote:
>
>> - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second
>> hardrive (where fbsd is installed): It crash just after the message
>> "GEOM: new disk ada1" during boot
>>
>> screenshot of the crash screen:
>> http://goo.gl/tW1VIx
>>
>> A little more information:
>> addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3
>> /usr/src/sys/geom/geom_io.c:129
>
>
> Unfortunately I can't reproduce that and have not enough clues. It may be
> specific to some GEOM class. Could you describe/show all GEOM topology, file
> systems, etc. you have there?
> gpart show
> sysctl kern.geom.confxml
> ...
Here are:
- ada0: internal laptop hard-drive
- ada1: the hard-drive that replace my DVD reader (partition 2: /boot
in clear, partition 3: geli encrypted partition)
=> There is no special boot-loader, I manually select the hard-drive during
Hardware:
ahci0: <Intel Cougar Point AHCI SATA controller> port
0x4088-0x408f,0x4094-0x4097,0x4080-0x4087,0x4090-0x4093,0x4040-0x405f
mem 0xd4827000-0xd48277ff irq 19 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <TOSHIBA MK3261GSYN MH000C> ATA-8 SATA 2.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 305245MB (625142448 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <WDC WD5000BPKT-00PK4T0 01.01A01> ATA-8 SATA 2.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C)
ada1: quirks=0x1<4K>
ada1: Previously was known as ad6
Regarding partition:
root@laptop:/root # gpart show
=> 63 625142385 ada0 MBR (298G)
63 1985 - free - (992k)
2048 31457280 1 ntfs (15G)
31459328 4194304 2 ntfs [active] (2.0G)
35653632 589486768 3 ntfs (281G)
625140400 2048 - free - (1.0M)
=> 34 976773101 ada1 GPT (465G)
34 6 - free - (3.0k)
40 128 1 freebsd-boot (64k)
168 4194304 2 freebsd-ufs (2.0G)
4194472 972578656 3 freebsd-ufs (463G)
976773128 7 - free - (3.5k)
And here is the long output of geom configuration:
root@laptop:/root # sysctl kern.geom.confxml
kern.geom.confxml: <mesh>
<class id="0xffffffff81314720">
<name>FD</name>
</class>
<class id="0xffffffff812b6408">
<name>RAID</name>
</class>
<class id="0xffffffff812b3ae8">
<name>DEV</name>
<geom id="0xfffff800104e9700">
<class ref="0xffffffff812b3ae8"/>
<name>ada1p3.eli</name>
<rank>4</rank>
<consumer id="0xfffff80010579d00">
<geom ref="0xfffff800104e9700"/>
<provider ref="0xfffff800105be400"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104ea700">
<class ref="0xffffffff812b3ae8"/>
<name>gpt/boot</name>
<rank>4</rank>
<consumer id="0xfffff80010579d80">
<geom ref="0xfffff800104ea700"/>
<provider ref="0xfffff800104ea500"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104e1400">
<class ref="0xffffffff812b3ae8"/>
<name>gptid/1c841adf-3cde-11e2-8cfc-a0b3cc295ab2</name>
<rank>4</rank>
<consumer id="0xfffff80010530780">
<geom ref="0xfffff800104e1400"/>
<provider ref="0xfffff800104eaa00"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104eae00">
<class ref="0xffffffff812b3ae8"/>
<name>ada1p3</name>
<rank>3</rank>
<consumer id="0xfffff8001048dd00">
<geom ref="0xfffff800104eae00"/>
<provider ref="0xfffff800104ead00"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104eb100">
<class ref="0xffffffff812b3ae8"/>
<name>ada1p2</name>
<rank>3</rank>
<consumer id="0xfffff8001049de80">
<geom ref="0xfffff800104eb100"/>
<provider ref="0xfffff800104eb000"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104eb700">
<class ref="0xffffffff812b3ae8"/>
<name>ada1p1</name>
<rank>3</rank>
<consumer id="0xfffff8001049df00">
<geom ref="0xfffff800104eb700"/>
<provider ref="0xfffff800104eb200"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104d8100">
<class ref="0xffffffff812b3ae8"/>
<name>ntfs/System</name>
<rank>4</rank>
<consumer id="0xfffff8001049e080">
<geom ref="0xfffff800104d8100"/>
<provider ref="0xfffff800104d8000"/>
<mode>r1w1e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104d8300">
<class ref="0xffffffff812b3ae8"/>
<name>ntfs/BDEDrive</name>
<rank>4</rank>
<consumer id="0xfffff8001049e100">
<geom ref="0xfffff800104d8300"/>
<provider ref="0xfffff800104d8200"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff80010459c00">
<class ref="0xffffffff812b3ae8"/>
<name>ntfs/Recovery</name>
<rank>4</rank>
<consumer id="0xfffff8001048df00">
<geom ref="0xfffff80010459c00"/>
<provider ref="0xfffff800104d8400"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff80010459e00">
<class ref="0xffffffff812b3ae8"/>
<name>ada1</name>
<rank>2</rank>
<consumer id="0xfffff8001048e000">
<geom ref="0xfffff80010459e00"/>
<provider ref="0xfffff80010459d00"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104d8800">
<class ref="0xffffffff812b3ae8"/>
<name>ada0s3</name>
<rank>3</rank>
<consumer id="0xfffff8001044c900">
<geom ref="0xfffff800104d8800"/>
<provider ref="0xfffff800104d8700"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff800104e1a00">
<class ref="0xffffffff812b3ae8"/>
<name>ada0s2</name>
<rank>3</rank>
<consumer id="0xfffff8001044c980">
<geom ref="0xfffff800104e1a00"/>
<provider ref="0xfffff800104d8900"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff8000e026c00">
<class ref="0xffffffff812b3ae8"/>
<name>ada0s1</name>
<rank>3</rank>
<consumer id="0xfffff8001044ca00">
<geom ref="0xfffff8000e026c00"/>
<provider ref="0xfffff800104d8b00"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
<geom id="0xfffff8000e1d6400">
<class ref="0xffffffff812b3ae8"/>
<name>ada0</name>
<rank>2</rank>
<consumer id="0xfffff8001044de00">
<geom ref="0xfffff8000e1d6400"/>
<provider ref="0xfffff8000e1d6000"/>
<mode>r0w0e0</mode>
</consumer>
</geom>
</class>
<class id="0xffffffff81716268">
<name>ELI</name>
<geom id="0xfffff800104e9900">
<class ref="0xffffffff81716268"/>
<name>ada1p3.eli</name>
<rank>3</rank>
<config>
<KeysTotal>928</KeysTotal> <KeysAllocated>928</KeysAllocated>
<Flags>BOOT</Flags>
<UsedKey>0</UsedKey>
<Version>6</Version>
<Crypto>hardware</Crypto>
<KeyLength>256</KeyLength>
<EncryptionAlgorithm>AES-XTS</EncryptionAlgorithm>
<State>ACTIVE</State>
</config>
<consumer id="0xfffff80010530f00">
<geom ref="0xfffff800104e9900"/>
<provider ref="0xfffff800104ead00"/>
<mode>r1w1e1</mode>
<config>
</config>
</consumer>
<provider id="0xfffff800105be400">
<geom ref="0xfffff800104e9900"/>
<mode>r1w1e1</mode>
<name>ada1p3.eli</name>
<mediasize>497960271360</mediasize>
<sectorsize>512</sectorsize>
<stripesize>0</stripesize>
<stripeoffset>0</stripeoffset>
<config>
</config>
</provider>
</geom>
</class>
<class id="0xffffffff812b5548">
<name>PART</name>
<geom id="0xfffff800104e1700">
<class ref="0xffffffff812b5548"/>
<name>ada1</name>
<rank>2</rank>
<config>
<scheme>GPT</scheme>
<entries>128</entries>
<first>34</first>
<last>976773134</last>
<fwsectors>63</fwsectors>
<fwheads>16</fwheads>
<state>OK</state>
<modified>false</modified>
</config>
<consumer id="0xfffff8001049e200">
<geom ref="0xfffff800104e1700"/>
<provider ref="0xfffff80010459d00"/>
<mode>r2w2e5</mode>
<config>
</config>
</consumer>
<provider id="0xfffff800104ead00">
<geom ref="0xfffff800104e1700"/>
<mode>r1w1e1</mode>
<name>ada1p3</name>
<mediasize>497960271872</mediasize>
<sectorsize>512</sectorsize>
<stripesize>4096</stripesize>
<stripeoffset>0</stripeoffset>
<config>
<start>4194472</start>
<end>976773127</end>
<index>3</index>
<type>freebsd-ufs</type>
<offset>2147569664</offset>
<length>497960271872</length>
<label>root</label>
<rawtype>516e7cb6-6ecf-11d6-8ff8-00022d09712b</rawtype>
<rawuuid>c8e5c3ff-3cde-11e2-8cfc-a0b3cc295ab2</rawuuid>
</config>
</provider>
<provider id="0xfffff800104eb000">
<geom ref="0xfffff800104e1700"/>
<mode>r1w1e2</mode>
<name>ada1p2</name>
<mediasize>2147483648</mediasize>
<sectorsize>512</sectorsize>
<stripesize>4096</stripesize>
<stripeoffset>0</stripeoffset>
<config>
<start>168</start>
<end>4194471</end>
<index>2</index>
<type>freebsd-ufs</type>
<offset>86016</offset>
<length>2147483648</length>
<label>boot</label>
<rawtype>516e7cb6-6ecf-11d6-8ff8-00022d09712b</rawtype>
<rawuuid>874bc9a6-3cde-11e2-8cfc-a0b3cc295ab2</rawuuid>
</config>
</provider>
<provider id="0xfffff800104eb200">
<geom ref="0xfffff800104e1700"/>
<mode>r0w0e0</mode>
<name>ada1p1</name>
<mediasize>65536</mediasize>
<sectorsize>512</sectorsize>
<stripesize>4096</stripesize>
<stripeoffset>0</stripeoffset>
<config>
<start>40</start>
<end>167</end>
<index>1</index>
<type>freebsd-boot</type>
<offset>20480</offset>
<length>65536</length>
<label></label>
<rawtype>83bd6b9d-7f41-11dc-be0b-001560b84f0f</rawtype>
<rawuuid>1c841adf-3cde-11e2-8cfc-a0b3cc295ab2</rawuuid>
</config>
</provider>
</geom>
<geom id="0xfffff8001045a200">
<class ref="0xffffffff812b5548"/>
<name>ada0</name>
<rank>2</rank>
<config>
<scheme>MBR</scheme>
<entries>4</entries>
<first>63</first>
<last>625142447</last>
<fwsectors>63</fwsectors>
<fwheads>16</fwheads>
<state>OK</state>
<modified>false</modified>
</config>
<consumer id="0xfffff8001044cb80">
<geom ref="0xfffff8001045a200"/>
<provider ref="0xfffff8000e1d6000"/>
<mode>r1w1e2</mode>
<config>
</config>
</consumer>
<provider id="0xfffff800104d8700">
<geom ref="0xfffff8001045a200"/>
<mode>r1w1e1</mode>
<name>ada0s3</name>
<mediasize>301817225216</mediasize>
<sectorsize>512</sectorsize>
<stripesize>0</stripesize>
<stripeoffset>1074790400</stripeoffset>
<config>
<start>35653632</start>
<end>625140399</end>
<index>3</index>
<type>ntfs</type>
<offset>18254659584</offset>
<length>301817225216</length>
<rawtype>7</rawtype>
</config>
</provider>
<provider id="0xfffff800104d8900">
<geom ref="0xfffff8001045a200"/>
<mode>r0w0e0</mode>
<name>ada0s2</name>
<mediasize>2147483648</mediasize>
<sectorsize>512</sectorsize>
<stripesize>0</stripesize>
<stripeoffset>3222274048</stripeoffset>
<config>
<start>31459328</start>
<end>35653631</end>
<index>2</index>
<type>ntfs</type>
<offset>16107175936</offset>
<length>2147483648</length>
<rawtype>7</rawtype>
<attrib>active</attrib>
</config>
</provider>
<provider id="0xfffff800104d8b00">
<geom ref="0xfffff8001045a200"/>
<mode>r0w0e0</mode>
<name>ada0s1</name>
<mediasize>16106127360</mediasize>
<sectorsize>512</sectorsize>
<stripesize>0</stripesize>
<stripeoffset>1048576</stripeoffset>
<config>
<start>2048</start>
<end>31459327</end>
<index>1</index>
<type>ntfs</type>
<offset>1048576</offset>
<length>16106127360</length>
<rawtype>7</rawtype>
</config>
</provider>
</geom>
</class>
<class id="0xffffffff812b4768">
<name>LABEL</name>
<geom id="0xfffff800104ea600">
<class ref="0xffffffff812b4768"/>
<name>ada1p2</name>
<rank>3</rank>
<config>
</config>
<consumer id="0xfffff8001048db80">
<geom ref="0xfffff800104ea600"/>
<provider ref="0xfffff800104eb000"/>
<mode>r1w1e2</mode>
<config>
</config>
</consumer>
<provider id="0xfffff800104ea500">
<geom ref="0xfffff800104ea600"/>
<mode>r1w1e1</mode>
<name>gpt/boot</name>
<mediasize>2147483648</mediasize>
<sectorsize>512</sectorsize>
<stripesize>4096</stripesize>
<stripeoffset>0</stripeoffset>
<config>
<index>0</index>
<length>2147483648</length>
<seclength>4194304</seclength>
<offset>0</offset>
<secoffset>0</secoffset>
</config>
</provider>
</geom>
<geom id="0xfffff800104e1000">
<class ref="0xffffffff812b4768"/>
<name>ada1p1</name>
<rank>3</rank>
<config>
</config>
<consumer id="0xfffff8001048dc80">
<geom ref="0xfffff800104e1000"/>
<provider ref="0xfffff800104eb200"/>
<mode>r0w0e0</mode>
<config>
</config>
</consumer>
<provider id="0xfffff800104eaa00">
<geom ref="0xfffff800104e1000"/>
<mode>r0w0e0</mode>
<name>gptid/1c841adf-3cde-11e2-8cfc-a0b3cc295ab2</name>
<mediasize>65536</mediasize>
<sectorsize>512</sectorsize>
<stripesize>4096</stripesize>
<stripeoffset>0</stripeoffset>
<config>
<index>0</index>
<length>65536</length>
<seclength>128</seclength>
<offset>0</offset>
<secoffset>0</secoffset>
</config>
</provider>
</geom>
<geom id="0xfffff80010459900">
<class ref="0xffffffff812b4768"/>
<name>ada0s3</name>
<rank>3</rank>
<config>
</config>
<consumer id="0xfffff8001047d300">
<geom ref="0xfffff80010459900"/>
<provider ref="0xfffff800104d8700"/>
<mode>r1w1e1</mode>
<config>
</config>
</consumer>
<provider id="0xfffff800104d8000">
<geom ref="0xfffff80010459900"/>
<mode>r1w1e0</mode>
<name>ntfs/System</name>
<mediasize>301817225216</mediasize>
<sectorsize>512</sectorsize>
<stripesize>0</stripesize>
<stripeoffset>1074790400</stripeoffset>
<config>
<index>0</index>
<length>301817225216</length>
<seclength>589486768</seclength>
<offset>0</offset>
<secoffset>0</secoffset>
</config>
</provider>
</geom>
<geom id="0xfffff800104e1900">
<class ref="0xffffffff812b4768"/>
<name>ada0s2</name>
<rank>3</rank>
<config>
</config>
<consumer id="0xfffff8001047d380">
<geom ref="0xfffff800104e1900"/>
<provider ref="0xfffff800104d8900"/>
<mode>r0w0e0</mode>
<config>
</config>
</consumer>
<provider id="0xfffff800104d8200">
<geom ref="0xfffff800104e1900"/>
<mode>r0w0e0</mode>
<name>ntfs/BDEDrive</name>
<mediasize>2147483648</mediasize>
<sectorsize>512</sectorsize>
<stripesize>0</stripesize>
<stripeoffset>3222274048</stripeoffset>
<config>
<index>0</index>
<length>2147483648</length>
<seclength>4194304</seclength>
<offset>0</offset>
<secoffset>0</secoffset>
</config>
</provider>
</geom>
<geom id="0xfffff80010459b00">
<class ref="0xffffffff812b4768"/>
<name>ada0s1</name>
<rank>3</rank>
<config>
</config>
<consumer id="0xfffff8001047d480">
<geom ref="0xfffff80010459b00"/>
<provider ref="0xfffff800104d8b00"/>
<mode>r0w0e0</mode>
<config>
</config>
</consumer>
<provider id="0xfffff800104d8400">
<geom ref="0xfffff80010459b00"/>
<mode>r0w0e0</mode>
<name>ntfs/Recovery</name>
<mediasize>16106127360</mediasize>
<sectorsize>512</sectorsize>
<stripesize>0</stripesize>
<stripeoffset>1048576</stripeoffset>
<config>
<index>0</index>
<length>16106127360</length>
<seclength>31457280</seclength>
<offset>0</offset>
<secoffset>0</secoffset>
</config>
</provider>
</geom>
</class>
<class id="0xffffffff813067a8">
<name>SWAP</name>
</class>
<class id="0xffffffff812b4588">
<name>VFS</name>
<geom id="0xfffff800104dfc00">
<class ref="0xffffffff812b4588"/>
<name>ffs.gpt/boot</name>
<rank>4</rank>
<consumer id="0xfffff8001048dc00">
<geom ref="0xfffff800104dfc00"/>
<provider ref="0xfffff800104ea500"/>
<mode>r1w1e1</mode>
</consumer>
</geom>
<geom id="0xfffff800105f4e00">
<class ref="0xffffffff812b4588"/>
<name>ffs.ada1p3.eli</name>
<rank>4</rank>
<consumer id="0xfffff80010581100">
<geom ref="0xfffff800105f4e00"/>
<provider ref="0xfffff800105be400"/>
<mode>r1w1e1</mode>
</consumer>
</geom>
</class>
<class id="0xffffffff8124a8a0">
<name>MD</name>
</class>
<class id="0xffffffff812b3db0">
<name>DISK</name>
<geom id="0xfffff800104d8500">
<class ref="0xffffffff812b3db0"/>
<name>ada1</name>
<rank>1</rank>
<config>
</config>
<provider id="0xfffff80010459d00">
<geom ref="0xfffff800104d8500"/>
<mode>r2w2e5</mode>
<name>ada1</name>
<mediasize>500107862016</mediasize>
<sectorsize>512</sectorsize>
<stripesize>4096</stripesize>
<stripeoffset>0</stripeoffset>
<config>
<fwheads>16</fwheads>
<fwsectors>63</fwsectors>
<ident>WD-WX81A1179372</ident>
<lunid>50014ee601049a6a</lunid>
<descr>WDC WD5000BPKT-00PK4T0</descr>
</config>
</provider>
</geom>
<geom id="0xfffff8000e1d6100">
<class ref="0xffffffff812b3db0"/>
<name>ada0</name>
<rank>1</rank>
<config>
</config>
<provider id="0xfffff8000e1d6000">
<geom ref="0xfffff8000e1d6100"/>
<mode>r1w1e2</mode>
<name>ada0</name>
<mediasize>320072933376</mediasize>
<sectorsize>512</sectorsize>
<stripesize>0</stripesize>
<stripeoffset>0</stripeoffset>
<config>
<fwheads>16</fwheads>
<fwsectors>63</fwsectors>
<ident>82JRT2VVT</ident>
<lunid>5000039431d04c9c</lunid>
<descr>TOSHIBA MK3261GSYN</descr>
</config>
</provider>
</geom>
</class>
</mesh>
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 17:53:00 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 19F2CA49
for <freebsd-hackers@freebsd.org>; Wed, 4 Sep 2013 17:53:00 +0000 (UTC)
(envelope-from kim@westryn.net)
Received: from mail3.westryn.net (mail3.westryn.net [72.28.112.3])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id EE62E2792
for <freebsd-hackers@freebsd.org>; Wed, 4 Sep 2013 17:52:59 +0000 (UTC)
Received: from frost.westryn.net (204.16.225.169.westryn.net [204.16.225.169])
(using TLSv1 with cipher AES128-SHA (128/128 bits))
(No client certificate requested)
by mail3.westryn.net (Postfix) with ESMTPSA id 49BC273A51;
Wed, 4 Sep 2013 12:52:58 -0500 (CDT)
Content-Type: text/plain; charset=iso-8859-1
Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\))
Subject: Re: booting FreeBSD on Apple Mac mini with GPT disk partition
From: Kim Shrier <kim@westryn.net>
In-Reply-To: <5226FFB3.3050407@unsane.co.uk>
Date: Wed, 4 Sep 2013 11:52:57 -0600
Content-Transfer-Encoding: quoted-printable
Message-Id: <E1322D2B-5270-4C42-A8CA-E5514EAF785B@westryn.net>
References: <1EB0CEFA-6A7E-4666-BCE3-4158AFEEA047@westryn.net>
<5226FFB3.3050407@unsane.co.uk>
To: Vincent Hoffman <vince@unsane.co.uk>
X-Mailer: Apple Mail (2.1508)
Cc: FreeBSD Hackers <freebsd-hackers@freebsd.org>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 17:53:00 -0000
On Sep 4, 2013, at 3:38 AM, Vincent Hoffman <vince@unsane.co.uk> wrote:
> On 03/09/2013 21:29, Kim Shrier wrote:
>> Does anyone know if work on booting FreeBSD on modern Apple hardware
>> was ever completed? I have looked on the wiki, forums, and email =
archives
>> but I don't see anything definitive.
>>=20
>> I would like to have a GPT partitioned disk with a freebsd-boot, =
freebsd-swap,
>> and multiple freebsd-ufs partitions on a new Mac mini. Any pointers =
would be
>> appreciated.
> I believe efi boot is almost done https://wiki.freebsd.org/UEFI
>=20
> I haven't tested yet although I may sometime soon as it would be nice =
to
> have my macbook dual boot without having to use bootcamp.
>=20
> Vince
I seem to remember that the EFI code on a mac will only boot from an =
HFS+
partition if the disk is partitioned using GPT. It will boot from a MBR =
partitioned
disk but only after waiting about 45 seconds before trying the MBR boot. =
I
would like to avoid this delay.
Is this (still) true?
Kim
From owner-freebsd-hackers@FreeBSD.ORG Wed Sep 4 21:30:01 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 6C004C61;
Wed, 4 Sep 2013 21:30:01 +0000 (UTC)
(envelope-from nwhitehorn@freebsd.org)
Received: from mail.icecube.wisc.edu (trout.icecube.wisc.edu [128.104.255.119])
by mx1.freebsd.org (Postfix) with ESMTP id 304392742;
Wed, 4 Sep 2013 21:30:00 +0000 (UTC)
Received: from localhost (localhost.localdomain [127.0.0.1])
by mail.icecube.wisc.edu (Postfix) with ESMTP id D4DB958385;
Wed, 4 Sep 2013 16:29:59 -0500 (CDT)
X-Virus-Scanned: amavisd-new at icecube.wisc.edu
Received: from mail.icecube.wisc.edu ([127.0.0.1])
by localhost (trout.icecube.wisc.edu [127.0.0.1]) (amavisd-new, port 10030)
with ESMTP id C7+Tce5PvWx0; Wed, 4 Sep 2013 16:29:59 -0500 (CDT)
Received: from terminus.icecube.wisc.edu (terminus.icecube.wisc.edu
[172.16.223.97])
by mail.icecube.wisc.edu (Postfix) with ESMTP id A953E58384;
Wed, 4 Sep 2013 16:29:59 -0500 (CDT)
Message-ID: <5227A657.4010701@freebsd.org>
Date: Wed, 04 Sep 2013 16:29:59 -0500
From: Nathan Whitehorn <nwhitehorn@freebsd.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130809 Thunderbird/17.0.8
MIME-Version: 1.0
To: John Baldwin <jhb@freebsd.org>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <520D4ADB.50209@FreeBSD.org>
<CAFMmRNzkL+uOsC=2Cq_S4Zm5fkmrQRNYcKfijA8yyYcxvLaXPQ@mail.gmail.com>
<52273F90.7020303@freebsd.org> <201309041200.56024.jhb@freebsd.org>
In-Reply-To: <201309041200.56024.jhb@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: freebsd-geom@freebsd.org,
"freebsd-hackers@freebsd.org" <freebsd-hackers@freebsd.org>,
Alexander Motin <mav@freebsd.org>, freebsd-current@freebsd.org,
Outback Dingo <outbackdingo@gmail.com>,
=?ISO-8859-1?Q?Olivier_Cochard-Labb=E9?= <olivier@cochard.me>,
FreeBSD SCSI <freebsd-scsi@freebsd.org>, Ryan Stone <rysto32@gmail.com>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 Sep 2013 21:30:01 -0000
On 09/04/13 11:00, John Baldwin wrote:
> On Wednesday, September 04, 2013 10:11:28 am Nathan Whitehorn wrote:
>> On 09/04/13 08:20, Ryan Stone wrote:
>>> On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn <nwhitehorn@freebsd.org>
> wrote:
>>>> Could you describe what this macro is supposed to do so that we can do
> the
>>>> porting work?
>>>> -Nathan
>>> #define GET_STACK_USAGE(total, used)
>>>
>>> GET_STACK_USAGE sets the variable passed in total to the total amount
>>> of stack space available to the current thread. used is set to the
>>> amount of stack space currently used (this does not have to have
>>> byte-precision). Netgraph uses this to decide when to stop recursing
>>> and instead defer to a work queue (to prevent stack overflow). I
>>> presume that Alexander is using it in a similar way. It looks like
>>> the amd64 version could be ported to other architectures quite easily
>>> if you were to account for stacks that grow up and stacks that grow
>>> down:
>>>
>>>
> http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup
>>> /* Get the current kernel thread stack usage. */
>>> #define GET_STACK_USAGE(total, used) do { \
>>> struct thread *td = curthread; \
>>> (total) = td->td_kstack_pages * PAGE_SIZE; \
>>> (used) = (char *)td->td_kstack + \
>>> td->td_kstack_pages * PAGE_SIZE - \
>>> (char *)&td; \
>>> } while (0)
>>> _______________________________________________
>>> freebsd-hackers@freebsd.org mailing list
>>> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers
>>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"
>> I think that should be MI for us anyway. I'm not aware of any
>> architectures FreeBSD supports with stacks that grow up. I'll give it a
>> test on PPC.
> ia64 has the double stack thingie where the register stack spills into a stack
> that grows up rather than down. Not sure how sparc64 window spills are
> handled either.
>
Ah, very well. That's weird. Should be fine for PPC, however.
-Nathan
From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 5 12:40:52 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 4A5114E1;
Thu, 5 Sep 2013 12:40:52 +0000 (UTC)
(envelope-from mavbsd@gmail.com)
Received: from mail-bk0-x230.google.com (mail-bk0-x230.google.com
[IPv6:2a00:1450:4008:c01::230])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id B12292B1C;
Thu, 5 Sep 2013 12:40:51 +0000 (UTC)
Received: by mail-bk0-f48.google.com with SMTP id my13so720689bkb.35
for <multiple recipients>; Thu, 05 Sep 2013 05:40:49 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=sender:message-id:date:from:user-agent:mime-version:to:subject
:content-type:content-transfer-encoding;
bh=8Z3kcvelwxokhY3nBr3uMzq9VZsLTGH5NrWXxMd5fKY=;
b=jElfaW8h/9NoTien/GZ6ue1dgyR6DFdPuI4tloJZGHxYulkd4ooNwB8cCm5ZpyS/zC
041akRXQNjWEuXZTF8JqYQB7KHBAuWoZpZH5hfiSu/gDAZAjn35XjIGF4/6v/AI25JTz
agoCIbVK6jk7wJxAwmD2jn+/D1XBsGYyJ43ctqBDsanjzBnIHQUSdNzNC24tBGGX7rXk
YCVyBA6L5Cex9IVzvL341l+FNt4m0Xv1flLB6giZOW89mk+pMyjIhzUIzBCggNCHQ//1
ZlRlZPU56qRYcCsMk6QvqbfLMpBgBfz4EZDqpYX3G37nY5zW11/f4CfGDX2AQrDzy5r8
IoBg==
X-Received: by 10.204.121.201 with SMTP id i9mr7215543bkr.13.1378384849200;
Thu, 05 Sep 2013 05:40:49 -0700 (PDT)
Received: from mavbook.mavhome.dp.ua ([37.229.21.195])
by mx.google.com with ESMTPSA id pn6sm7928380bkb.14.1969.12.31.16.00.00
(version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
Thu, 05 Sep 2013 05:40:48 -0700 (PDT)
Sender: Alexander Motin <mavbsd@gmail.com>
Message-ID: <52287BCD.4090507@FreeBSD.org>
Date: Thu, 05 Sep 2013 15:40:45 +0300
From: Alexander Motin <mav@FreeBSD.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130616 Thunderbird/17.0.6
MIME-Version: 1.0
To: hackers@freebsd.org
Subject: Again about pbuf_mtx
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 05 Sep 2013 12:40:52 -0000
Hi.
Some may remember that not so long ago I complained about high lock
congestion on pbuf_mtx. At that time switching the mutex to padalign
reduced the problem. But now after improving scalability in CAM and GEOM
and doing more then half million IOPS on 32-core system I again heavily
hit that problem -- hwpmc shows about 30% of CPU time spent on that
mutex spinning and another 30% of time spent on attempt of threads to go
to sleep on that mutex and getting more collisions there.
Trying to mitigate that I've made a patch
(http://people.freebsd.org/~mav/pcpu_pbuf.patch) to split single queue
of pbufs into several. That definitely cost some amount of KVA and
memory, but on my tests it fixes problem redically, removing any
measurable congestion there. The patch is not complete and don't even
boot on i386 now, but I would like to hear opinions about the approach,
or may be some better propositions.
Another patch I've made
(http://people.freebsd.org/~mav/si_threadcount.patch) removes lock
acquisition from dev_relthread() by using atomics for reference
counting. That fixes another congestion I see. This patch looks fine to
me and the only congestion I see after that is on HBA driver locks, but
may be I am missing something?
Thank you.
--
Alexander Motin
From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 5 21:38:34 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 353CA329;
Thu, 5 Sep 2013 21:38:34 +0000 (UTC)
(envelope-from mavbsd@gmail.com)
Received: from mail-ea0-x232.google.com (mail-ea0-x232.google.com
[IPv6:2a00:1450:4013:c01::232])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 7485B222B;
Thu, 5 Sep 2013 21:38:33 +0000 (UTC)
Received: by mail-ea0-f178.google.com with SMTP id a15so1197367eae.9
for <multiple recipients>; Thu, 05 Sep 2013 14:38:32 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject
:references:in-reply-to:content-type:content-transfer-encoding;
bh=3Y3SU3hKjDRY9H37gbwWoI8b4zarwRXFW/n36mXoO7U=;
b=W7K8LaPDCt9ZOe92QDuADwEsPQTebnHLgMx0eOUkD4V8aI0vvaCiA+nUaIyMIOeOIJ
YHdmezZ7x8gIhI8nv3yuBEJDpsA3UXTMZry+1xrLitZP5Ij+7BU0QuoEgyE+6QdaELtc
Q1Nx7sTyuYv0wEhv9V+Va/dpd/6OAqQ8mmj0wVGpSsaCMsF5a5ZGkKxoeLmEJ4oEaFlP
Kc43YK2D+6EdKpQF66+/tWgczYtYXRSxoUHYwElxYydMc502+137x3HVDm4qtprwslnZ
s5qRpmhLojmTUiumYHphkqb28j+zgqyF1i7Xzz0tPrFJso9L4S9wxrcJzrXpH6RYJCvT
+I+g==
X-Received: by 10.14.194.131 with SMTP id m3mr16631075een.45.1378417111929;
Thu, 05 Sep 2013 14:38:31 -0700 (PDT)
Received: from mavbook.mavhome.dp.ua ([37.229.21.195])
by mx.google.com with ESMTPSA id p5sm52041532eeg.5.1969.12.31.16.00.00
(version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
Thu, 05 Sep 2013 14:38:31 -0700 (PDT)
Sender: Alexander Motin <mavbsd@gmail.com>
Message-ID: <5228F9D4.3060008@FreeBSD.org>
Date: Fri, 06 Sep 2013 00:38:28 +0300
From: Alexander Motin <mav@FreeBSD.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130616 Thunderbird/17.0.6
MIME-Version: 1.0
To: =?ISO-8859-1?Q?Olivier_Cochard-Labb=E9?= <olivier@cochard.me>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org>
<CA+q+TcoKg-FuuKt_L9W8rGc_ZEv9XOteq=x6N+VT9_mUhRJDHQ@mail.gmail.com>
In-Reply-To: <CA+q+TcoKg-FuuKt_L9W8rGc_ZEv9XOteq=x6N+VT9_mUhRJDHQ@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
Cc: freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 05 Sep 2013 21:38:34 -0000
On 04.09.2013 19:31, Olivier Cochard-Labbé wrote:
> On Wed, Sep 4, 2013 at 9:01 AM, Alexander Motin <mav@freebsd.org> wrote:
>>
>>> - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second
>>> hardrive (where fbsd is installed): It crash just after the message
>>> "GEOM: new disk ada1" during boot
>>>
>>> screenshot of the crash screen:
>>> http://goo.gl/tW1VIx
>>>
>>> A little more information:
>>> addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3
>>> /usr/src/sys/geom/geom_io.c:129
>>
>>
>> Unfortunately I can't reproduce that and have not enough clues. It may be
>> specific to some GEOM class. Could you describe/show all GEOM topology, file
>> systems, etc. you have there?
>> gpart show
>> sysctl kern.geom.confxml
I've found and fixed possible double request completion, that could
cause such symptoms if happened. Updated patch located as usual:
http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch
--
Alexander Motin
From owner-freebsd-hackers@FreeBSD.ORG Thu Sep 5 22:46:48 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 855C3F7F;
Thu, 5 Sep 2013 22:46:48 +0000 (UTC)
(envelope-from cochard@gmail.com)
Received: from mail-vb0-x22c.google.com (mail-vb0-x22c.google.com
[IPv6:2607:f8b0:400c:c02::22c])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 0B40E25B5;
Thu, 5 Sep 2013 22:46:47 +0000 (UTC)
Received: by mail-vb0-f44.google.com with SMTP id e13so1681328vbg.3
for <multiple recipients>; Thu, 05 Sep 2013 15:46:47 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:sender:in-reply-to:references:from:date:message-id
:subject:to:cc:content-type;
bh=L2hqyhZpJ0JBn0q3kben8PMpNbwje0O2svVsBJ5vTpE=;
b=nzK6rYk2L4RcR7ljW4QbvDcIgHfIkvHsxVkrEBmUPG7yI37hQWZuVK05BGyKeGBume
9oBL1UY4yJH1nOFaAZdOfgdDi6gOSoqMM1KeJa1mfK+Ry7SkH3LyZgfKu0C1yBwVpv0G
D/8uJN8tYzRTIG/N6QsT7JNw0yfZ41IQKrEWY3vJ5OQB49ziJbjrNbPrEGLhwvGPiJg1
3hAO1ZkathFDFvBQJcKHmVFv58HIObDyUZUGJA+BWEqd14khc6VwOmuX1eZjT9y6TAd4
QKjjmmoJCRB1OenyIACt8uRD3yZGz2DeOmNuQP5s7UQbOszwGmxi1ngsqd0IRFfiwjVj
wi1Q==
X-Received: by 10.58.161.116 with SMTP id xr20mr10096802veb.2.1378421207130;
Thu, 05 Sep 2013 15:46:47 -0700 (PDT)
MIME-Version: 1.0
Sender: cochard@gmail.com
Received: by 10.58.221.9 with HTTP; Thu, 5 Sep 2013 15:46:27 -0700 (PDT)
In-Reply-To: <5228F9D4.3060008@FreeBSD.org>
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org>
<CA+q+TcoKg-FuuKt_L9W8rGc_ZEv9XOteq=x6N+VT9_mUhRJDHQ@mail.gmail.com>
<5228F9D4.3060008@FreeBSD.org>
From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= <olivier@cochard.me>
Date: Fri, 6 Sep 2013 00:46:27 +0200
X-Google-Sender-Auth: rZXJ1jxqZ-x9zPiDTbRRsZzCApI
Message-ID: <CA+q+TcrW+73JeUw9nxTcCdXTu578n25n_E_2Z9FDB1RGZ0_5cg@mail.gmail.com>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
To: Alexander Motin <mav@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
Cc: freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 05 Sep 2013 22:46:48 -0000
On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin <mav@freebsd.org> wrote:
> I've found and fixed possible double request completion, that could cause
> such symptoms if happened. Updated patch located as usual:
> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch
>
Good catch!
this new patch (applied to r255188) fix the problem on my laptop.
Thanks,
Olivier
From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 08:06:36 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 1080020C;
Fri, 6 Sep 2013 08:06:36 +0000 (UTC) (envelope-from jlh@FreeBSD.org)
Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id C56A8248C;
Fri, 6 Sep 2013 08:06:35 +0000 (UTC)
Received: by caravan.chchile.org (Postfix, from userid 1000)
id 35EF6C1B79; Fri, 6 Sep 2013 08:06:28 +0000 (UTC)
Date: Fri, 6 Sep 2013 10:06:28 +0200
From: Jeremie Le Hen <jlh@FreeBSD.org>
To: Olivier =?iso-8859-1?Q?Cochard-Labb=E9?= <olivier@cochard.me>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
Message-ID: <20130906080627.GH43281@caravan.chchile.org>
Mail-Followup-To: Olivier =?iso-8859-1?Q?Cochard-Labb=E9?=
<olivier@cochard.me>,
Alexander Motin <mav@freebsd.org>, freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org>
<CA+q+TcoKg-FuuKt_L9W8rGc_ZEv9XOteq=x6N+VT9_mUhRJDHQ@mail.gmail.com>
<5228F9D4.3060008@FreeBSD.org>
<CA+q+TcrW+73JeUw9nxTcCdXTu578n25n_E_2Z9FDB1RGZ0_5cg@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <CA+q+TcrW+73JeUw9nxTcCdXTu578n25n_E_2Z9FDB1RGZ0_5cg@mail.gmail.com>
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: freebsd-hackers@freebsd.org, Alexander Motin <mav@freebsd.org>,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Sep 2013 08:06:36 -0000
On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote:
> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin <mav@freebsd.org> wrote:
> > I've found and fixed possible double request completion, that could cause
> > such symptoms if happened. Updated patch located as usual:
> > http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch
> >
>
> Good catch!
> this new patch (applied to r255188) fix the problem on my laptop.
With this new one I cannot boot any more (I also updated the source
tree). This is a hand transcripted version:
Trying to mount root from zfs:zroot/root []...
panic: Batch flag already set
cpuid = 1
KDB: stack backtrace:
db_trace_self_wrapper()
kdb_backtrace()
vpanic()
kassert_panic()
xpt_batch_start()
ata_interrupt()
softclock_call_cc()
softclock()
ithread_loop()
fork_exit()
fork_trampoline()
--
Jeremie Le Hen
Scientists say the world is made up of Protons, Neutrons and Electrons.
They forgot to mention Morons.
From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 08:11:25 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id E3367533;
Fri, 6 Sep 2013 08:11:24 +0000 (UTC)
(envelope-from mavbsd@gmail.com)
Received: from mail-ea0-x233.google.com (mail-ea0-x233.google.com
[IPv6:2a00:1450:4013:c01::233])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 09FA1254D;
Fri, 6 Sep 2013 08:11:23 +0000 (UTC)
Received: by mail-ea0-f179.google.com with SMTP id b10so1403847eae.38
for <multiple recipients>; Fri, 06 Sep 2013 01:11:22 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject
:references:in-reply-to:content-type:content-transfer-encoding;
bh=MENZEmMr0sUVxdAq0usDknkzf7eJArKcNpbmmkCSdyk=;
b=TC67HJEukz882fT6ifYtGLcpNr6Z6pFEvYsPUfmbffJ6SUJQdUL6DkHWyBYQvfnK25
S0xgvF10pZCHR9x+YQh3TxJZleGby8gr4rQk94lvdrD+E293WgMv1h/h22y5GV0K7/lG
SAcabzqpCbHrAnU4ZiyyqTITN5ADVgYaIYg/4fYT3SjpDc7089ghUFoOtRFuyfJz6pKI
Wg34jloD75h4r3jij0kcx2kaBUXI5jORvUUMvHRgvL3Wq5B0mC33lLaVOxwqpBYu6C7c
euSRDrnQBmYTkG03Gmn9smo3hSaxbVdAfQtZnJxp/XMShgC80mNjRoC/Yg9N5SxDzXcl
TiGg==
X-Received: by 10.15.102.71 with SMTP id bq47mr1268106eeb.66.1378455082304;
Fri, 06 Sep 2013 01:11:22 -0700 (PDT)
Received: from mavbook.mavhome.dp.ua ([37.229.21.195])
by mx.google.com with ESMTPSA id z12sm2105616eev.6.1969.12.31.16.00.00
(version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
Fri, 06 Sep 2013 01:11:21 -0700 (PDT)
Sender: Alexander Motin <mavbsd@gmail.com>
Message-ID: <52298E27.60200@FreeBSD.org>
Date: Fri, 06 Sep 2013 11:11:19 +0300
From: Alexander Motin <mav@FreeBSD.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130616 Thunderbird/17.0.6
MIME-Version: 1.0
To: hackers@freebsd.org
Subject: Re: Again about pbuf_mtx
References: <52287BCD.4090507@FreeBSD.org>
In-Reply-To: <52287BCD.4090507@FreeBSD.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: Jeff Roberson <jeff@freebsd.org>, Andriy Gapon <avg@freebsd.org>
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Sep 2013 08:11:25 -0000
On 05.09.2013 15:40, Alexander Motin wrote:
> Some may remember that not so long ago I complained about high lock
> congestion on pbuf_mtx. At that time switching the mutex to padalign
> reduced the problem. But now after improving scalability in CAM and GEOM
> and doing more then half million IOPS on 32-core system I again heavily
> hit that problem -- hwpmc shows about 30% of CPU time spent on that
> mutex spinning and another 30% of time spent on attempt of threads to go
> to sleep on that mutex and getting more collisions there.
>
> Trying to mitigate that I've made a patch
> (http://people.freebsd.org/~mav/pcpu_pbuf.patch) to split single queue
> of pbufs into several. That definitely cost some amount of KVA and
> memory, but on my tests it fixes problem redically, removing any
> measurable congestion there. The patch is not complete and don't even
> boot on i386 now, but I would like to hear opinions about the approach,
> or may be some better propositions.
On kib@ proposition I've tried to reimplement that patch using vmem(9).
Code indeed looks much better (at least looked before workarounds):
http://people.freebsd.org/~mav/pbuf_vmem.patch
and it works fast, but I have found number of problems:
- now we have only 256 (or even less) pbufs and UMA used by vmem for
quick caches tend to allocate up to 256 items per CPU and never release
them back. I've partially workarounded that by passing fake MAGIC_SIZE
value to vmem and down to UMA as size to make initial bucket sizes
smaller, but that is a hack and not always sufficient since size may
grow on congestion and again never shrink back.
- UMA panics with "uma_zalloc: Bucket pointer mangled." if I am giving
vmem zero as valid pointer. I've workarounded that by adding an offset
to the value, but I think that assertion in UMA should be removed if we
are going to use it for abstract values now.
> Another patch I've made
> (http://people.freebsd.org/~mav/si_threadcount.patch) removes lock
> acquisition from dev_relthread() by using atomics for reference
> counting. That fixes another congestion I see. This patch looks fine to
> me and the only congestion I see after that is on HBA driver locks, but
> may be I am missing something?
--
Alexander Motin
From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 08:29:18 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 1F04722D;
Fri, 6 Sep 2013 08:29:18 +0000 (UTC)
(envelope-from mavbsd@gmail.com)
Received: from mail-wi0-x233.google.com (mail-wi0-x233.google.com
[IPv6:2a00:1450:400c:c05::233])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 3C2BC277F;
Fri, 6 Sep 2013 08:29:17 +0000 (UTC)
Received: by mail-wi0-f179.google.com with SMTP id hm2so548715wib.6
for <multiple recipients>; Fri, 06 Sep 2013 01:29:15 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject
:references:in-reply-to:content-type:content-transfer-encoding;
bh=cKvvmgI4MFZXDvTnnY59FeR0s1d1wz4lMm26SQGf0GA=;
b=o5ccwrrEuDeiW02qIeTQ6XnFRpVWxSOvENLrYvAxtBCntauuGYvzJ5Kawq6Cip7cHj
KTYEFxt21sjAI20m6psQjR/iAETpGKUHgUt6rHvq2i7Gf1Ktkb5vDH/Mdnvik6qzQetu
zWxsoTzF47FlRRkv1QJPFKUgf+PjPbvI527zoNJ5Nim2nbRPRlkpbMiYu9cW8GZVrcly
OWCvw/RKcHx2ZQjDE8gLIOGI3U2KvJAs0khy1ABKa1qtTb8nQXYLl1FjaJCm8T/So4+a
eCLG/1gRFmJkyHF3WXMobqxVo+74DfeHBTuBFeey4wOYwV1YaaFAGkikPa3GrLaXH16j
cTLA==
X-Received: by 10.194.86.5 with SMTP id l5mr531403wjz.45.1378456155424;
Fri, 06 Sep 2013 01:29:15 -0700 (PDT)
Received: from mavbook.mavhome.dp.ua ([37.229.21.195])
by mx.google.com with ESMTPSA id e5sm4368184wiy.2.1969.12.31.16.00.00
(version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
Fri, 06 Sep 2013 01:29:14 -0700 (PDT)
Sender: Alexander Motin <mavbsd@gmail.com>
Message-ID: <52299257.10704@FreeBSD.org>
Date: Fri, 06 Sep 2013 11:29:11 +0300
From: Alexander Motin <mav@FreeBSD.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130616 Thunderbird/17.0.6
MIME-Version: 1.0
To: Jeremie Le Hen <jlh@FreeBSD.org>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org>
<CA+q+TcoKg-FuuKt_L9W8rGc_ZEv9XOteq=x6N+VT9_mUhRJDHQ@mail.gmail.com>
<5228F9D4.3060008@FreeBSD.org>
<CA+q+TcrW+73JeUw9nxTcCdXTu578n25n_E_2Z9FDB1RGZ0_5cg@mail.gmail.com>
<20130906080627.GH43281@caravan.chchile.org>
In-Reply-To: <20130906080627.GH43281@caravan.chchile.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
Cc: freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Sep 2013 08:29:18 -0000
On 06.09.2013 11:06, Jeremie Le Hen wrote:
> On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote:
>> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin <mav@freebsd.org> wrote:
>>> I've found and fixed possible double request completion, that could cause
>>> such symptoms if happened. Updated patch located as usual:
>>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch
>>>
> With this new one I cannot boot any more (I also updated the source
> tree). This is a hand transcripted version:
>
> Trying to mount root from zfs:zroot/root []...
> panic: Batch flag already set
> cpuid = 1
> KDB: stack backtrace:
> db_trace_self_wrapper()
> kdb_backtrace()
> vpanic()
> kassert_panic()
> xpt_batch_start()
> ata_interrupt()
> softclock_call_cc()
> softclock()
> ithread_loop()
> fork_exit()
> fork_trampoline()
Thank you for the report. I see my fault. It is probably specific to
ata(4) driver only. I've workarounded that in new patch version, but
probably that area needs some rethinking.
http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch
--
Alexander Motin
From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 18:26:54 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 57A36CEE
for <freebsd-hackers@freebsd.org>; Fri, 6 Sep 2013 18:26:54 +0000 (UTC)
(envelope-from freebsd@dreamchaser.org)
Received: from nightmare.dreamchaser.org (nightmare.dreamchaser.org
[12.32.44.142])
(using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 1E8FC2532
for <freebsd-hackers@freebsd.org>; Fri, 6 Sep 2013 18:26:53 +0000 (UTC)
Received: from breakaway.dreamchaser.org (breakaway.dreamchaser.org.
[12.32.36.73])
by nightmare.dreamchaser.org (8.13.6/8.13.6) with ESMTP id r86IQi6k045797
for <freebsd-hackers@freebsd.org>; Fri, 6 Sep 2013 12:26:44 -0600 (MDT)
(envelope-from freebsd@dreamchaser.org)
Message-ID: <522A1E64.3030907@dreamchaser.org>
Date: Fri, 06 Sep 2013 12:26:44 -0600
From: Gary Aitken <freebsd@dreamchaser.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130730 Thunderbird/17.0.7
MIME-Version: 1.0
To: FreeBSD Mailing List <freebsd-hackers@freebsd.org>
Subject: need hint about build environment screwup
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.0.2
(nightmare.dreamchaser.org [12.32.36.65]);
Fri, 06 Sep 2013 12:26:45 -0600 (MDT)
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
Reply-To: freebsd@dreamchaser.org
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Sep 2013 18:26:54 -0000
In trying to build
/usr/ports/sysutils/lsof
I get the following:
In file included from /usr/include/_ctype.h:94,
from /usr/include/ctype.h:46,
from lsof.h:49,
from dmnt.c:39:
/usr/include/runetype.h:92: error: expected '=', ',', ';', 'asm' or '__attribute__' before 'const'
/usr/include/runetype.h: In function '__getCurrentRuneLocale':
/usr/include/runetype.h:96: error: '_ThreadRuneLocale' undeclared (first use in this function)
/usr/include/runetype.h:96: error: (Each undeclared identifier is reported only once
/usr/include/runetype.h:96: error: for each function it appears in.)
I'm running 9.1 RELEASE on an amd64 with a recently updated ports tree,
and recently upgraded to using pkgng
/etc/make.conf contains
WITH_PKGNG=yes
I suspect something is wrong with the build environment, but haven't a clue.
I'm trying to avoid rebuilding everything, and would like to find out what's
screwed up.
Since lsof basically doesn't depend on anything else, I'm baffled as to
what got messed up.
Can someone give me a hint?
Thanks,
Gary
From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 23:02:38 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 981DB16B;
Fri, 6 Sep 2013 23:02:38 +0000 (UTC) (envelope-from jlh@FreeBSD.org)
Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136])
(using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 5C51E2121;
Fri, 6 Sep 2013 23:02:38 +0000 (UTC)
Received: by caravan.chchile.org (Postfix, from userid 1000)
id 38BB0C1EE3; Fri, 6 Sep 2013 23:02:36 +0000 (UTC)
Date: Sat, 7 Sep 2013 01:02:36 +0200
From: Jeremie Le Hen <jlh@FreeBSD.org>
To: Alexander Motin <mav@FreeBSD.org>
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
Message-ID: <20130906230236.GI43281@caravan.chchile.org>
Mail-Followup-To: Alexander Motin <mav@FreeBSD.org>,
freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
References: <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org>
<CA+q+TcoKg-FuuKt_L9W8rGc_ZEv9XOteq=x6N+VT9_mUhRJDHQ@mail.gmail.com>
<5228F9D4.3060008@FreeBSD.org>
<CA+q+TcrW+73JeUw9nxTcCdXTu578n25n_E_2Z9FDB1RGZ0_5cg@mail.gmail.com>
<20130906080627.GH43281@caravan.chchile.org>
<52299257.10704@FreeBSD.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <52299257.10704@FreeBSD.org>
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Sep 2013 23:02:38 -0000
On Fri, Sep 06, 2013 at 11:29:11AM +0300, Alexander Motin wrote:
> On 06.09.2013 11:06, Jeremie Le Hen wrote:
> > On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote:
> >> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin <mav@freebsd.org> wrote:
> >>> I've found and fixed possible double request completion, that could cause
> >>> such symptoms if happened. Updated patch located as usual:
> >>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch
> >>>
> > With this new one I cannot boot any more (I also updated the source
> > tree). This is a hand transcripted version:
> >
> > Trying to mount root from zfs:zroot/root []...
> > panic: Batch flag already set
> > cpuid = 1
> > KDB: stack backtrace:
> > db_trace_self_wrapper()
> > kdb_backtrace()
> > vpanic()
> > kassert_panic()
> > xpt_batch_start()
> > ata_interrupt()
> > softclock_call_cc()
> > softclock()
> > ithread_loop()
> > fork_exit()
> > fork_trampoline()
>
> Thank you for the report. I see my fault. It is probably specific to
> ata(4) driver only. I've workarounded that in new patch version, but
> probably that area needs some rethinking.
>
> http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch
I'm not sure you needed a confirmation, but it boots. Thanks :).
I didn't quite understand the thread; is direct dispatch enabled for
amd64? ISTR you said only i386 but someone else posted the macro for
amd64.
--
Jeremie Le Hen
Scientists say the world is made up of Protons, Neutrons and Electrons.
They forgot to mention Morons.
From owner-freebsd-hackers@FreeBSD.ORG Fri Sep 6 23:49:57 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
[IPv6:2001:1900:2254:206a::19:1])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id 647BAD1;
Fri, 6 Sep 2013 23:49:57 +0000 (UTC)
(envelope-from shrikanth07@gmail.com)
Received: from mail-vc0-x22c.google.com (mail-vc0-x22c.google.com
[IPv6:2607:f8b0:400c:c03::22c])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 1808327E7;
Fri, 6 Sep 2013 23:49:57 +0000 (UTC)
Received: by mail-vc0-f172.google.com with SMTP id m17so2616780vca.17
for <multiple recipients>; Fri, 06 Sep 2013 16:49:56 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=mime-version:date:message-id:subject:from:to:content-type;
bh=nx9j1tPvNPZKopY+Lr9A0v33BXahgpY9iygPVsigij0=;
b=znnNyS1LzAP8pQfiPYrqbQRfsq/cnHAXzpjziqo3V5L4OFF2L+Iy+QYpi+pX+8gLQH
sGWomN9OSaCSSxXOZ7BtrJd0BkPokXT+MrnavjYACAhdB/9/suyw0rzO1I3NXURxHdFL
TJYeHn5BqdCK5K1WIw2W6KTdQZUhYmzPhCBsLKx3TZZzzq1y7rcZ2TM2hztTey4jkqJx
Xl7RLerwkaUd8M/KgYBvVZnPdukcjquJ5gbWOV/IHSgeXWRm0Lgx0AW7gvcPiQhFSdQk
poZdBwk82nk5EfdcQlcvTEceQnZJg4fFGFcWlit2P+izLD87F+nN+0FoiI5pMbBeztti
PSng==
MIME-Version: 1.0
X-Received: by 10.58.198.13 with SMTP id iy13mr4799048vec.11.1378511396144;
Fri, 06 Sep 2013 16:49:56 -0700 (PDT)
Received: by 10.59.1.70 with HTTP; Fri, 6 Sep 2013 16:49:56 -0700 (PDT)
Date: Fri, 6 Sep 2013 16:49:56 -0700
Message-ID: <CAEOAkMXKjNN=_dGRQSzhHK85KD4sMHK7g9f_Cj8qCgJ2gGXKPQ@mail.gmail.com>
Subject: Glitch in ctfconvert
From: Shrikanth Kamath <shrikanth07@gmail.com>
To: freebsd-hackers@freebsd.org, freebsd-dtrace@freebsd.org
Content-Type: text/plain; charset=ISO-8859-1
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 06 Sep 2013 23:49:57 -0000
There is a glitch with ctfconvert builds the .SUNW_ctf section. It affects
debugging the kernel modules with FBT provider of DTrace.
I observe that the CTF sections built for the kernel modules have a
problem if module symtab stripped or if the symbol table has symbols
reordered. This messes up the FBT probes and shows wrong function name against a
set of arguments.
I presume the ctf mapping of a function to its arguments is done this way after
looking at ctfdump code.
func_name from symtab arguments dump from ctf_data_t
^ ^
|___symidx____ctfdump_____________|
The detais are fetched from two different places. So when ctfconvert is run the
function arguments are mapped with a particular symbol order.
Post the linker stage the symbols may get reordered. Or if a strip utility is
run the symtab may be removed completely.
When first ctfconvert is run on module.kld
symbol_X (idx 1) <-> [args set a in ctf_data_t]
symbol_Y (idx 2) <-> [args set b in ctf_data_t]
if symbols get re-arranged post the linker stage
symbol_Y (idx 1) <-> [args set a in ctf_data_t]
symbol_X (idx 2) <-> [args set b in ctf_data_t]
which means symbol_Y now has args set of symbol_X
Or if 'strip' is run it has totally junk shown against symbol_Y and symbol_X.
Overall this affects when we do a Function Boundary Tracing on the functions to
inspect arguments.
From owner-freebsd-hackers@FreeBSD.ORG Sat Sep 7 06:32:52 2013
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
(using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
(No client certificate requested)
by hub.freebsd.org (Postfix) with ESMTP id DE5F96B2;
Sat, 7 Sep 2013 06:32:51 +0000 (UTC)
(envelope-from mavbsd@gmail.com)
Received: from mail-ee0-x22c.google.com (mail-ee0-x22c.google.com
[IPv6:2a00:1450:4013:c00::22c])
(using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
(No client certificate requested)
by mx1.freebsd.org (Postfix) with ESMTPS id 2B15D2DED;
Sat, 7 Sep 2013 06:32:51 +0000 (UTC)
Received: by mail-ee0-f44.google.com with SMTP id b47so2030518eek.3
for <multiple recipients>; Fri, 06 Sep 2013 23:32:48 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
h=sender:message-id:date:from:user-agent:mime-version:to:subject
:references:in-reply-to:content-type:content-transfer-encoding;
bh=ilD9VCbquphj1dYzFxmCe9bvhxnFO5x39Z+sK2ZQYyc=;
b=QG21UhYVc6fS3I1DtG2lispuOFkJAHmGsBe8l2vshkVr1YO4aWaD22pXiPLM0kCxZ7
8ANziza/TDXJyqWx1/AxUCzeGzvLcl//C04L0EdjqhbUE6MyOUjeCEQa56mFfYcVFGc+
hl/mUU1NklX3q0vTmgPv0FRd14FTrHEeDNSU0gjqkWUFPbIOJ8fzIMO3ya6DnJspUMXA
mGEgOm3UEsx300oUisAtYb5kK3Xq+xHC5yOcupeulRa62VM+h/bJVYhOHjFnuXYpjYO4
lWHlGSXs3iftT5iIQEduNFp4xMDOn+FoV6ShN31B/CJoo6bP2z+WyUGGctmThFYA0+aL
Wfag==
X-Received: by 10.14.8.72 with SMTP id 48mr10508882eeq.25.1378535568549;
Fri, 06 Sep 2013 23:32:48 -0700 (PDT)
Received: from mavbook.mavhome.dp.ua ([37.229.21.195])
by mx.google.com with ESMTPSA id r48sm2188473eev.14.1969.12.31.16.00.00
(version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128);
Fri, 06 Sep 2013 23:32:47 -0700 (PDT)
Sender: Alexander Motin <mavbsd@gmail.com>
Message-ID: <522AC88D.4070005@FreeBSD.org>
Date: Sat, 07 Sep 2013 09:32:45 +0300
From: Alexander Motin <mav@FreeBSD.org>
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64;
rv:17.0) Gecko/20130616 Thunderbird/17.0.6
MIME-Version: 1.0
To: freebsd-hackers@freebsd.org,
"freebsd-current@freebsd.org" <freebsd-current@freebsd.org>,
freebsd-geom@freebsd.org
Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking
References: <5224511D.4090503@FreeBSD.org>
<20130903134251.GB43281@caravan.chchile.org>
<CAKYr3zwjQ9K1c5smZXTESa3T5UnchYaipYQCS2OAJOUFyPBGww@mail.gmail.com>
<CA+q+TcoeHDbkCOXvBjbbzOKCbb7RLYqG0jn9bHNn_CZgLGarLg@mail.gmail.com>
<5226DAB0.1060303@FreeBSD.org>
<CA+q+TcoKg-FuuKt_L9W8rGc_ZEv9XOteq=x6N+VT9_mUhRJDHQ@mail.gmail.com>
<5228F9D4.3060008@FreeBSD.org>
<CA+q+TcrW+73JeUw9nxTcCdXTu578n25n_E_2Z9FDB1RGZ0_5cg@mail.gmail.com>
<20130906080627.GH43281@caravan.chchile.org> <52299257.10704@FreeBSD.org>
<20130906230236.GI43281@caravan.chchile.org>
In-Reply-To: <20130906230236.GI43281@caravan.chchile.org>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8bit
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 07 Sep 2013 06:32:52 -0000
On 07.09.2013 02:02, Jeremie Le Hen wrote:
> On Fri, Sep 06, 2013 at 11:29:11AM +0300, Alexander Motin wrote:
>> On 06.09.2013 11:06, Jeremie Le Hen wrote:
>>> On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote:
>>>> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin <mav@freebsd.org> wrote:
>>>>> I've found and fixed possible double request completion, that could cause
>>>>> such symptoms if happened. Updated patch located as usual:
>>>>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch
>>>>>
>>> With this new one I cannot boot any more (I also updated the source
>>> tree). This is a hand transcripted version:
>>>
>>> Trying to mount root from zfs:zroot/root []...
>>> panic: Batch flag already set
>>> cpuid = 1
>>> KDB: stack backtrace:
>>> db_trace_self_wrapper()
>>> kdb_backtrace()
>>> vpanic()
>>> kassert_panic()
>>> xpt_batch_start()
>>> ata_interrupt()
>>> softclock_call_cc()
>>> softclock()
>>> ithread_loop()
>>> fork_exit()
>>> fork_trampoline()
>>
>> Thank you for the report. I see my fault. It is probably specific to
>> ata(4) driver only. I've workarounded that in new patch version, but
>> probably that area needs some rethinking.
>>
>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch
>
> I'm not sure you needed a confirmation, but it boots. Thanks :).
>
> I didn't quite understand the thread; is direct dispatch enabled for
> amd64? ISTR you said only i386 but someone else posted the macro for
> amd64.
Yes, it is enabled for amd64. I've said x86, meaning both i386 and amd64.
--
Alexander Motin