From owner-freebsd-geom@FreeBSD.ORG Mon Sep 2 08:49:39 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id D212FC1E; Mon, 2 Sep 2013 08:49:39 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-bk0-x22b.google.com (mail-bk0-x22b.google.com [IPv6:2a00:1450:4008:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D14CA283A; Mon, 2 Sep 2013 08:49:38 +0000 (UTC) Received: by mail-bk0-f43.google.com with SMTP id mz13so1423112bkb.16 for ; Mon, 02 Sep 2013 01:49:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=2NdJTP8xy/tghqvhT0eqh0KJKUr9tGy7D+crGKM1GIY=; b=dKSlxcmStpiRbVyDOmmOlKsD6ruXFiUKuXOJqnBTxRrBK3pUDKyYHW0OncjxVyavQE ymt70Y5gpagtjMNX2k0bD8zdteYVASadji67T46/14NnA7LZjzBS1HJdWin8BKTnrZOv qANR7zVGc+q1uBxDGohlm5OAt2V5VMTuCEqZVuP5/CILpislCQwEvRmVT6ZwNsCbzgGh wSdA5WRfuSSVEJ+OL8DilROTVVxA9HZ8zqqrtGz74YoAx8d4Fo1U1WtUXPo3H6oi1dFP N7ImHW63gKhaOXr22ie4ttVcGxNDdNLhqO/aeHzbfss57P8SCzlU4IffaTOZjlEYaw7D eCtw== X-Received: by 10.204.199.132 with SMTP id es4mr623140bkb.28.1378111776996; Mon, 02 Sep 2013 01:49:36 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id jt14sm1918024bkb.0.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 02 Sep 2013 01:49:36 -0700 (PDT) Sender: Alexander Motin Message-ID: <5224511D.4090503@FreeBSD.org> Date: Mon, 02 Sep 2013 11:49:33 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: FreeBSD SCSI , freebsd-hackers@FreeBSD.org, freebsd-geom@FreeBSD.org, "freebsd-current@freebsd.org" Subject: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> In-Reply-To: <520D4ADB.50209@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Sep 2013 08:49:39 -0000 Hi. I would like to invite more people to review and test my patches for improving CAM and GEOM scalability, that for last six months you could see developing in project/camlock SVN branch. Full diff of that branch against present head (r255131) can be found here: http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch Heavy CAM changes there were focused on reducing scope of SIM lock to only protecting SIM internals, but not CAM core. That allows many times reduce lock congestion, especially on heavily parallel request submission with GEOM changes below. More detailed description of changes you could see here earlier: http://docs.freebsd.org/cgi/mid.cgi?520D4ADB.50209 GEOM changes were focused on avoiding switching to GEOM up/down threads in relatively simple setups where respective classes don't require it (and were explicitly marked so). That allows save on context switches and on systems with several HBAs and disks talk to them concurrently (that is where CAM locking changes are handy). Such classes were modified to support it: DEV, DISK, LABEL, MULTIPATH, NOP, PART, RAID (partially), STRIPE, ZERO, VFS, ZFS::VDEV, ZFS::ZVOL and some others. Requests to/from other classes will be queued to GEOM threads same as before. Together that allows to double block subsystem performance on high (at least 100-200K) IOPS benchmarks, allowing to reach up to a million total IOPS, while keeping full compatibility with all major ABIs/KBIs. Since we are already in 10.0 release process and changes are quite big, my plan is to wait and commit them to head branch after the freeze end, and then merge to stable/10. I hope the release process will go on schedule to not delay this work for another six months. This work is sponsored by iXsystems, Inc. -- Alexander Motin From owner-freebsd-geom@FreeBSD.ORG Mon Sep 2 11:06:44 2013 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 74470F3 for ; Mon, 2 Sep 2013 11:06:44 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 61F6F239F for ; Mon, 2 Sep 2013 11:06:44 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id r82B6iMX016010 for ; Mon, 2 Sep 2013 11:06:44 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id r82B6hMN016008 for freebsd-geom@FreeBSD.org; Mon, 2 Sep 2013 11:06:43 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 2 Sep 2013 11:06:43 GMT Message-Id: <201309021106.r82B6hMN016008@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Subject: Current problem reports assigned to freebsd-geom@FreeBSD.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 02 Sep 2013 11:06:44 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/181704 geom [geom] ggatec crash the system when I write something o kern/179889 geom [geli] geli stopped work after updating RELEASE 9.* so o kern/178684 geom gpart(8) cannot get my GEOM tree o kern/178359 geom [geom] [patch] geom_eli: support external metadata o kern/176744 geom [geom] [patch] BIO_FLUSH not recorded by devstats o kern/170038 geom [geom] geom_mirror always starts degraded after reboot o kern/169539 geom [geom] [patch] fix ability to run gmirror on MSI MegaR a bin/169077 geom bsdinstall(8) does not use partition labels in /etc/fs f kern/165745 geom [geom] geom_multipath page fault on removed drive o kern/165428 geom [glabel][patch] Add xfs support to glabel o kern/164254 geom [geom] gjournal not stopping on GPT partitions o kern/164252 geom [geom] gjournal overflow o kern/164143 geom [geom] Partition table not recognized after upgrade R8 a kern/163020 geom [geli] [patch] enable the Camellia-XTS on GEOM ELI o kern/162690 geom [geom] gpart label changes only take effect after a re o kern/162010 geom [geli] panic: Provider's error should be set (error=0) o kern/161979 geom [geom] glabel doesn't update after newfs, and glabel s o bin/161807 geom [patch] add option for explicitly specifying metadata o kern/161752 geom [geom] glabel(8) doesn't get gpt label change o bin/161677 geom gpart(8) Probably bug in gptboot o kern/160409 geom [geli] failed to attach provider f kern/159595 geom [geom] [panic] panic on gmirror unload in vbox [regres f kern/159414 geom [isp] isp(4)+gmultipath(8) : removing active fiber pat p kern/158398 geom [headers] [patch] includes o kern/158197 geom [geom] geom_cache with size>1000 leads to panics o kern/157879 geom [libgeom] [regression] ABI change without version bump o kern/157863 geom [geli] kbdmux prevents geli passwords from being enter o kern/157739 geom [geom] GPT labels with geom_multipath o kern/157724 geom [geom] gpart(8) 'add' command must preserve gap for sc o kern/157723 geom [geom] GEOM should not process 'c' (raw) partitions fo o kern/157108 geom [gjournal] dumpon(8) fails on gjournal providers o kern/155994 geom [geom] Long "Suspend time" when reading large files fr o bin/154570 geom [patch] gvinum(8) can't be built as part of the kernel o kern/154226 geom [geom] GEOM label does not change when you modify them o kern/150858 geom [geom] [geom_label] [patch] glabel(8) is not compatibl o kern/150626 geom [geom] [gjournal] gjournal(8) destroys label o kern/150555 geom [geom] gjournal unusable on GPT partitions o kern/150334 geom [geom] [udf] [patch] geom label does not support UDF o kern/149762 geom volume labels with rogue characters o bin/149215 geom [panic] [geom_part] gpart(8): Delete linux's slice via o kern/147667 geom [gmirror] Booting with one component of a gmirror, the o kern/145818 geom [geom] geom_stat_open showing cached information for n o kern/145042 geom [geom] System stops booting after printing message "GE o kern/143455 geom gstripe(8) in RELENG_8 (31st Jan 2010) broken o kern/142563 geom [geom] [hang] ioctl freeze in zpool o kern/141740 geom [geom] gjournal(8): g_journal_destroy concurrent error o kern/140352 geom [geom] gjournal + glabel not working o kern/135898 geom [geom] Severe filesystem corruption - large files or l o kern/134113 geom [geli] Problem setting secondary GELI key o kern/133931 geom [geli] [request] intentionally wrong password to destr o bin/132845 geom [geom] [patch] ggated(8) does not close files opened a o bin/131415 geom [geli] keystrokes are unregulary sent to Geli when typ o kern/131353 geom [geom] gjournal(8) kernel lock o kern/129674 geom [geom] gjournal root did not mount on boot o kern/129645 geom gjournal(8): GEOM_JOURNAL causes system to fail to boo o kern/129245 geom [geom] gcache is more suitable for suffix based provid o kern/127420 geom [geom] [gjournal] [panic] Journal overflow on gmirrore o kern/124973 geom [gjournal] [patch] boot order affects geom_journal con o kern/124969 geom gvinum(8): gvinum raid5 plex does not detect missing s o kern/123962 geom [panic] [gjournal] gjournal (455Gb data, 8Gb journal), o kern/123122 geom [geom] GEOM / gjournal kernel lock o kern/122738 geom [geom] gmirror list "losts consumers" after gmirror de o kern/122067 geom [geom] [panic] Geom crashed during boot o kern/121364 geom [gmirror] Removing all providers create a "zombie" mir o kern/120091 geom [geom] [geli] [gjournal] geli does not prompt for pass o kern/115856 geom [geli] ZFS thought it was degraded when it should have o kern/115547 geom [geom] [patch] [request] let GEOM Eli get password fro o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113419 geom [geom] geom fox multipathing not failing back o kern/107707 geom [geom] [patch] [request] add new class geom_xbox360 to o kern/94632 geom [geom] Kernel output resets input while GELI asks for o kern/90582 geom [geom] [panic] Restore cause panic string (ffs_blkfree o bin/90093 geom fdisk(8) incapable of altering in-core geometry o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o bin/86388 geom [geom] [geom_part] periodic(8) daily should backup gpa o kern/84556 geom [geom] [panic] GBDE-encrypted swap causes panic at shu o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/79035 geom [vinum] gvinum unable to create a striped set of mirro o bin/78131 geom gbde(8) "destroy" not working. 79 problems total. From owner-freebsd-geom@FreeBSD.ORG Tue Sep 3 13:42:53 2013 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id A9170611; Tue, 3 Sep 2013 13:42:53 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6EB032D3C; Tue, 3 Sep 2013 13:42:53 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id 75F99C0761; Tue, 3 Sep 2013 13:42:51 +0000 (UTC) Date: Tue, 3 Sep 2013 15:42:51 +0200 From: Jeremie Le Hen To: Alexander Motin Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130903134251.GB43281@caravan.chchile.org> Mail-Followup-To: Alexander Motin , FreeBSD SCSI , freebsd-hackers@FreeBSD.org, freebsd-geom@FreeBSD.org, "freebsd-current@freebsd.org" References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5224511D.4090503@FreeBSD.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: FreeBSD SCSI , freebsd-geom@FreeBSD.org, "freebsd-current@freebsd.org" , freebsd-hackers@FreeBSD.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 13:42:53 -0000 On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote: > Hi. > > I would like to invite more people to review and test my patches for > improving CAM and GEOM scalability, that for last six months you could > see developing in project/camlock SVN branch. Full diff of that branch > against present head (r255131) can be found here: > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch I'm building my kernel right now. -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-geom@FreeBSD.ORG Tue Sep 3 18:10:34 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 86D92F92; Tue, 3 Sep 2013 18:10:34 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-pa0-x22e.google.com (mail-pa0-x22e.google.com [IPv6:2607:f8b0:400e:c03::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4B33527EB; Tue, 3 Sep 2013 18:10:34 +0000 (UTC) Received: by mail-pa0-f46.google.com with SMTP id fa1so6747736pad.19 for ; Tue, 03 Sep 2013 11:10:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=U6aTzULoJOmotb6EDysMmZrEOn4yEnc/RZxCGfXH28Y=; b=EeqOVeGgn3Pye1lgfkID5C11E+cuH7lE6Qkben4dI6lros8b7PNodUfLnVLW8Sn7r/ j6JrNrE7i5WGzpCg5U/XT6lH4d6V3Dz3KQzjnOorjwqybRG7AF+FFnGiqxapJc/+vsZD fqx5WhzsYIluohp9r9EDVoaaiXnazTxdB9M9SaHdIVmklFFfWOKndwccxCn7km77HS1z dE6Nv6+v2HWKru+SiwPqLUiRHW4Rw52fkd6LSwq1mm14WJO0W4X65qupGSyTxBgx7FXB R8TDtPBlG0Ml/LH0d0kAEnImMzIYXoNnBaB558jbA8jYLefRSD5FkknLeljpdkld6ZY3 zTFg== MIME-Version: 1.0 X-Received: by 10.68.76.101 with SMTP id j5mr32863063pbw.67.1378231832471; Tue, 03 Sep 2013 11:10:32 -0700 (PDT) Received: by 10.66.126.141 with HTTP; Tue, 3 Sep 2013 11:10:32 -0700 (PDT) In-Reply-To: <20130903134251.GB43281@caravan.chchile.org> References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> Date: Tue, 3 Sep 2013 14:10:32 -0400 Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking From: Outback Dingo To: Alexander Motin , FreeBSD SCSI , freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 18:10:34 -0000 On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen wrote: > On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote: > > Hi. > > > > I would like to invite more people to review and test my patches for > > improving CAM and GEOM scalability, that for last six months you could > > see developing in project/camlock SVN branch. Full diff of that branch > > against present head (r255131) can be found here: > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch > > I'm building my kernel right now. > > Can anyone confirm how well tested/stable this patch set might be?? if theres positive input i have a zoo of dev machines i could load it on, to help further it. Just checking to see how widely its been tested, > -- > Jeremie Le Hen > > Scientists say the world is made up of Protons, Neutrons and Electrons. > They forgot to mention Morons. > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > From owner-freebsd-geom@FreeBSD.ORG Tue Sep 3 21:31:50 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 4E646654; Tue, 3 Sep 2013 21:31:50 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 117E72BCE; Tue, 3 Sep 2013 21:31:50 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id DF286C0961; Tue, 3 Sep 2013 21:24:26 +0000 (UTC) Date: Tue, 3 Sep 2013 23:24:26 +0200 From: Jeremie Le Hen To: Outback Dingo Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130903212426.GC43281@caravan.chchile.org> Mail-Followup-To: Outback Dingo , Alexander Motin , FreeBSD SCSI , freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: FreeBSD SCSI , Alexander Motin , freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" , freebsd-hackers@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 21:31:50 -0000 On Tue, Sep 03, 2013 at 02:10:32PM -0400, Outback Dingo wrote: > On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen wrote: > > > On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote: > > > Hi. > > > > > > I would like to invite more people to review and test my patches for > > > improving CAM and GEOM scalability, that for last six months you could > > > see developing in project/camlock SVN branch. Full diff of that branch > > > against present head (r255131) can be found here: > > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch > > > > I'm building my kernel right now. > > > > > Can anyone confirm how well tested/stable this patch set might be?? if > theres positive input i have a zoo of dev machines i could load it on, to > help further it. > Just checking to see how widely its been tested, Very stable so far. I'm doing a make -j 4 buildworld in parallel of a periodic security run. This has been running for hours without failure. -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-geom@FreeBSD.ORG Tue Sep 3 21:48:59 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id CF592D11; Tue, 3 Sep 2013 21:48:59 +0000 (UTC) (envelope-from cochard@gmail.com) Received: from mail-vc0-x22e.google.com (mail-vc0-x22e.google.com [IPv6:2607:f8b0:400c:c03::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 429CF2CE8; Tue, 3 Sep 2013 21:48:59 +0000 (UTC) Received: by mail-vc0-f174.google.com with SMTP id gd11so4411172vcb.33 for ; Tue, 03 Sep 2013 14:48:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-type:content-transfer-encoding; bh=CBjXK0KDjfW54LD0Yc8Pdr2jYxRu1lPETfc0cnr1Bmc=; b=FpG2g3+gqV/sAGRekCamqW+S4AgnWmAAHYsDfwV8PYuMp25Pc7l2Yj+j91pf0Su4uu IcIMAh5gvovMC46lw2aukJBCDj1MjgqvYC2GeSY6J41OtF+hYB7wkZSc8i9PDQsSNh6B fhRzJWFFp7LJnLLlPIinShJjc/G+61lF9CMUhK9JFnOuEhrFEL7SLmpWfV3yILsWC8JZ NwrbWss4RjzGjROVy8/XNbhPsnib7Omewe9X8HWyV4caAokWoo35QCqTo76g3swbhmxi 0lEMbkNMFQoiMzNlmN7qQdc9UFKTaDAe5CmeVHNtXsUpNP+dZKHzfhX9vZLFWJMHbGws Cp5Q== X-Received: by 10.220.199.5 with SMTP id eq5mr30028964vcb.16.1378244938366; Tue, 03 Sep 2013 14:48:58 -0700 (PDT) MIME-Version: 1.0 Sender: cochard@gmail.com Received: by 10.58.221.9 with HTTP; Tue, 3 Sep 2013 14:48:38 -0700 (PDT) In-Reply-To: References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= Date: Tue, 3 Sep 2013 23:48:38 +0200 X-Google-Sender-Auth: aEdoOoFc0E9sVrPag-3cJJNc85Q Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking To: Outback Dingo Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD SCSI , Alexander Motin , freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" , freebsd-hackers@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Sep 2013 21:48:59 -0000 On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo wrot= e: > Can anyone confirm how well tested/stable this patch set might be?? if > theres positive input i have a zoo of dev machines i could load it on, to > help further it. > Just checking to see how widely its been tested, I've installed this patch on 3 differents machines there status after about 12hours: - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big zraid (LSI MegaSAS Gen2 controller): Used for generating package with poudriere=85 no probleme since; - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in gmirror: Used for generating package with poudriere too=85 no probleme since; - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second hardrive (where fbsd is installed): It crash just after the message "GEOM: new disk ada1" during boot screenshot of the crash screen: http://goo.gl/tW1VIx A little more information: addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 /usr/src/sys/geom/geom_io.c:129 Regards, Olivier From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 00:31:57 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 8F70EAC0; Wed, 4 Sep 2013 00:31:57 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from mail-oa0-x235.google.com (mail-oa0-x235.google.com [IPv6:2607:f8b0:4003:c02::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 21888294D; Wed, 4 Sep 2013 00:31:57 +0000 (UTC) Received: by mail-oa0-f53.google.com with SMTP id k18so7551333oag.40 for ; Tue, 03 Sep 2013 17:31:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=TId/rHSlvsa6OMpmrl6Hypdr+azDGQF6VQU75p4pbAo=; b=N9O4AbJbWm2zaYqkUExEK3TP0U5H2bZNKkcXKTW8ovzbRua0M90ILPnYT2RXTRSSrP zgIeARpfG96nx5/c0ngFPNngf7WinJkrThKkPi8d58Wzs0x+jIdUBmxEQ4nrzeZrRvvf UKnXqv/PydLKWaj7jUNpIvwIBumxj05SixTVz4+0yfPVJvret7XoojZvWbTw5Fs5llVf d696ivBUI6xN4pUpTRbc0gZzMQV/iFFm2WA4RrG5A7hbJ1EnmcHd1xHpFAGnQtXm8OOR hvTefxsIdmH4X5TeIcsNFZFUWWJIhYxRrmIFF3HooL2uwbJKEVpzdtk1ShdE90zlWzI/ sNrA== MIME-Version: 1.0 X-Received: by 10.60.52.244 with SMTP id w20mr128413oeo.30.1378254716439; Tue, 03 Sep 2013 17:31:56 -0700 (PDT) Received: by 10.76.114.227 with HTTP; Tue, 3 Sep 2013 17:31:56 -0700 (PDT) In-Reply-To: References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> Date: Tue, 3 Sep 2013 20:31:56 -0400 Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking From: Outback Dingo To: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.14 Cc: FreeBSD SCSI , Alexander Motin , freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" , freebsd-hackers@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 00:31:57 -0000 On Tue, Sep 3, 2013 at 5:48 PM, Olivier Cochard-Labb=E9 wrote: > On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo > wrote: > > Can anyone confirm how well tested/stable this patch set might be?? if > > theres positive input i have a zoo of dev machines i could load it on, = to > > help further it. > > Just checking to see how widely its been tested, > > I've installed this patch on 3 differents machines there status after > about 12hours: > - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big > zraid (LSI MegaSAS Gen2 controller): Used for generating package with > poudriere=85 no probleme since; > - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in > gmirror: Used for generating package with poudriere too=85 no probleme > since; > - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second > hardrive (where fbsd is installed): It crash just after the message > "GEOM: new disk ada1" during boot > > screenshot of the crash screen: > http://goo.gl/tW1VIx > > A little more information: > addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 > /usr/src/sys/geom/geom_io.c:129 > > Regards, > > Olivier > Be nice if it was backported to 9/stable..... not sure how feasible it is though... patch fails in a few places..... From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 05:24:49 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 0A1FEFC1; Wed, 4 Sep 2013 05:24:49 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C33F32E6C; Wed, 4 Sep 2013 05:24:48 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id EAEB2C0A95; Wed, 4 Sep 2013 05:24:46 +0000 (UTC) Date: Wed, 4 Sep 2013 07:24:46 +0200 From: Jeremie Le Hen To: Outback Dingo , Alexander Motin , FreeBSD SCSI , freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130904052446.GD43281@caravan.chchile.org> Mail-Followup-To: Outback Dingo , Alexander Motin , FreeBSD SCSI , freebsd-hackers@freebsd.org, freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <20130903212426.GC43281@caravan.chchile.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20130903212426.GC43281@caravan.chchile.org> User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 05:24:49 -0000 On Tue, Sep 03, 2013 at 11:24:26PM +0200, Jeremie Le Hen wrote: > On Tue, Sep 03, 2013 at 02:10:32PM -0400, Outback Dingo wrote: > > On Tue, Sep 3, 2013 at 9:42 AM, Jeremie Le Hen wrote: > > > > > On Mon, Sep 02, 2013 at 11:49:33AM +0300, Alexander Motin wrote: > > > > Hi. > > > > > > > > I would like to invite more people to review and test my patches for > > > > improving CAM and GEOM scalability, that for last six months you could > > > > see developing in project/camlock SVN branch. Full diff of that branch > > > > against present head (r255131) can be found here: > > > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130902.patch > > > > > > I'm building my kernel right now. > > > > > > > > Can anyone confirm how well tested/stable this patch set might be?? if > > theres positive input i have a zoo of dev machines i could load it on, to > > help further it. > > Just checking to see how widely its been tested, > > Very stable so far. I'm doing a make -j 4 buildworld in parallel of a > periodic security run. This has been running for hours without failure. FWIW, I have 4 drives total, distributed in 2 zpool containing 2 mirrored zdev each. -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 07:01:10 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 8FFDD7C1; Wed, 4 Sep 2013 07:01:10 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-wg0-x233.google.com (mail-wg0-x233.google.com [IPv6:2a00:1450:400c:c00::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9DA8C28C1; Wed, 4 Sep 2013 07:01:09 +0000 (UTC) Received: by mail-wg0-f51.google.com with SMTP id a12so2264428wgh.18 for ; Wed, 04 Sep 2013 00:01:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=qQcQ3lQg5yW+MrAD8YAtILdaaJNlfmGx3bzF9F7m8w4=; b=q8BByWIwrdXM0K8ttL7/CYbzTbXgtwpUKxUd5p0FbZVX2X9XpDwckinfdQuHvyrBUY nRy6UzUA1z/Zcr4TamS6QIfLFesAEaP2U4PhFAXGEBSAZovv++c+xBCE9aXc/ItIjdcg /0vhg42kSaV0JcI7uY1boJ8qr0hL8jyc7+gn3J8SaLGwgzP70UagttzyHZ7iPe9EGmRi PHG8OioZTgzu7P/TZA4Y/yKO7AAtgZyGP9s9ZU4wOAmww5/6AD/twLjYA+Bb7TlMi4mk Qfg8zOuneoPIQrJQoT7BsOpaJ4h4zEdJCmGmbwTr+lHJF569lSfAvRBY36ifozGjD7zy h2nw== X-Received: by 10.180.75.16 with SMTP id y16mr767253wiv.59.1378278067954; Wed, 04 Sep 2013 00:01:07 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id mw9sm1595508wic.4.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 04 Sep 2013 00:01:06 -0700 (PDT) Sender: Alexander Motin Message-ID: <5226DAB0.1060303@FreeBSD.org> Date: Wed, 04 Sep 2013 10:01:04 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: =?windows-1252?Q?Olivier_Cochard-Labb=E9?= Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Cc: Outback Dingo , freebsd-geom@freebsd.org, "freebsd-current@freebsd.org" , freebsd-hackers@freebsd.org, FreeBSD SCSI X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 07:01:10 -0000 On 04.09.2013 00:48, Olivier Cochard-Labbé wrote: > On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo wrote: >> Can anyone confirm how well tested/stable this patch set might be?? if >> theres positive input i have a zoo of dev machines i could load it on, to >> help further it. >> Just checking to see how widely its been tested, > > I've installed this patch on 3 differents machines there status after > about 12hours: > - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big > zraid (LSI MegaSAS Gen2 controller): Used for generating package with > poudriere… no probleme since; > - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in > gmirror: Used for generating package with poudriere too… no probleme > since; I've forgot to mention, but GEOM direct dispatch is now active only on x86 because GET_STACK_USAGE macro now defined only there and I wanted to stay on a safe side. On other archs GEOM works in old queued way. Somebody should port that small macro to other archs. But that is still interesting data point. Thanks. > - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second > hardrive (where fbsd is installed): It crash just after the message > "GEOM: new disk ada1" during boot > > screenshot of the crash screen: > http://goo.gl/tW1VIx > > A little more information: > addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 > /usr/src/sys/geom/geom_io.c:129 Unfortunately I can't reproduce that and have not enough clues. It may be specific to some GEOM class. Could you describe/show all GEOM topology, file systems, etc. you have there? gpart show sysctl kern.geom.confxml ... Thank you! -- Alexander Motin From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 12:45:46 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 9B0D06B2; Wed, 4 Sep 2013 12:45:46 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Received: from smtpauth4.wiscmail.wisc.edu (wmauth4.doit.wisc.edu [144.92.197.145]) (using TLSv1 with cipher RC4-MD5 (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6CD8D2023; Wed, 4 Sep 2013 12:45:46 +0000 (UTC) MIME-version: 1.0 Content-transfer-encoding: 8BIT Content-type: text/plain; charset=windows-1252; format=flowed Received: from avs-daemon.smtpauth4.wiscmail.wisc.edu by smtpauth4.wiscmail.wisc.edu (Oracle Communications Messaging Server 7u4-27.01(7.0.4.27.0) 64bit (built Aug 30 2012)) id <0MSL00100PMPTB00@smtpauth4.wiscmail.wisc.edu>; Wed, 04 Sep 2013 07:45:38 -0500 (CDT) X-Spam-PmxInfo: Server=avs-4, Version=6.0.3.2322014, Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2013.9.4.123619, SenderIP=0.0.0.0 X-Spam-Report: AuthenticatedSender=yes, SenderIP=0.0.0.0 Received: from comporellon.tachypleus.net (adsl-76-208-67-185.dsl.mdsnwi.sbcglobal.net [76.208.67.185]) by smtpauth4.wiscmail.wisc.edu (Oracle Communications Messaging Server 7u4-27.01(7.0.4.27.0) 64bit (built Aug 30 2012)) with ESMTPSA id <0MSL0024HQ41OI20@smtpauth4.wiscmail.wisc.edu>; Wed, 04 Sep 2013 07:45:38 -0500 (CDT) Message-id: <52272B6F.9060308@freebsd.org> Date: Wed, 04 Sep 2013 07:45:35 -0500 From: Nathan Whitehorn User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130810 Thunderbird/17.0.8 To: Alexander Motin Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> In-reply-to: <5226DAB0.1060303@FreeBSD.org> Cc: freebsd-geom@freebsd.org, freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , FreeBSD SCSI , =?windows-1252?Q?Olivier_Cochard-Labb=E9?= , Outback Dingo X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 12:45:46 -0000 On 09/04/13 02:01, Alexander Motin wrote: > On 04.09.2013 00:48, Olivier Cochard-Labbé wrote: >> On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo >> wrote: >>> Can anyone confirm how well tested/stable this patch set might be?? if >>> theres positive input i have a zoo of dev machines i could load it >>> on, to >>> help further it. >>> Just checking to see how widely its been tested, >> >> I've installed this patch on 3 differents machines there status after >> about 12hours: >> - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big >> zraid (LSI MegaSAS Gen2 controller): Used for generating package with >> poudriere… no probleme since; >> - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in >> gmirror: Used for generating package with poudriere too… no probleme >> since; > > I've forgot to mention, but GEOM direct dispatch is now active only on > x86 because GET_STACK_USAGE macro now defined only there and I wanted > to stay on a safe side. On other archs GEOM works in old queued way. > Somebody should port that small macro to other archs. But that is > still interesting data point. Thanks. Could you describe what this macro is supposed to do so that we can do the porting work? -Nathan From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 13:20:43 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id DB979543; Wed, 4 Sep 2013 13:20:43 +0000 (UTC) (envelope-from rysto32@gmail.com) Received: from mail-oa0-x230.google.com (mail-oa0-x230.google.com [IPv6:2607:f8b0:4003:c02::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 63677232C; Wed, 4 Sep 2013 13:20:43 +0000 (UTC) Received: by mail-oa0-f48.google.com with SMTP id o17so336172oag.7 for ; Wed, 04 Sep 2013 06:20:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=uHQmwWU2MeBmE/1UIl47yFWFen4/AkTbDSQbsQhd/98=; b=enzMJG+Q9dZrdLHyb1h7LtN5bwcG03+y9VX9vqViqefI8Xfn4TWYmYwfAcF+qlPajc aRSfaiptbvyhvaBXy13j6fU3S8qgkA1ZiASZo8QW9xy1vfyntiguHgwsrg1rVQwoWZg0 jB94flQsMzViMSro/7HDhKwJZLEZvUQQfS/9sYmYkhxI5jZGBXOa4BQKDzWES1QGbwpf Oizz1P9WubWSrm92QtGsBkWB+HM2QdrYZQ75nCe/9u5j22q8bnkt57oAlQVtK5DjVh3h jOLiw/gTkx0IcWI8U/NIR79vbuBXa3nQiFrHMZU7uPRKg/gaSpIggGd7i6mi5HduGSY6 /2AQ== MIME-Version: 1.0 X-Received: by 10.182.73.136 with SMTP id l8mr2102864obv.53.1378300842725; Wed, 04 Sep 2013 06:20:42 -0700 (PDT) Received: by 10.76.68.38 with HTTP; Wed, 4 Sep 2013 06:20:42 -0700 (PDT) In-Reply-To: <52272B6F.9060308@freebsd.org> References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org> Date: Wed, 4 Sep 2013 09:20:42 -0400 Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking From: Ryan Stone To: Nathan Whitehorn Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-geom@freebsd.org, "freebsd-hackers@freebsd.org" , Alexander Motin , "freebsd-current@freebsd.org" , Outback Dingo , =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= , FreeBSD SCSI X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 13:20:44 -0000 On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn wrote: > Could you describe what this macro is supposed to do so that we can do the > porting work? > -Nathan #define GET_STACK_USAGE(total, used) GET_STACK_USAGE sets the variable passed in total to the total amount of stack space available to the current thread. used is set to the amount of stack space currently used (this does not have to have byte-precision). Netgraph uses this to decide when to stop recursing and instead defer to a work queue (to prevent stack overflow). I presume that Alexander is using it in a similar way. It looks like the amd64 version could be ported to other architectures quite easily if you were to account for stacks that grow up and stacks that grow down: http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup /* Get the current kernel thread stack usage. */ #define GET_STACK_USAGE(total, used) do { \ struct thread *td = curthread; \ (total) = td->td_kstack_pages * PAGE_SIZE; \ (used) = (char *)td->td_kstack + \ td->td_kstack_pages * PAGE_SIZE - \ (char *)&td; \ } while (0) From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 13:29:36 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 5C9FFA0B; Wed, 4 Sep 2013 13:29:36 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-bk0-x236.google.com (mail-bk0-x236.google.com [IPv6:2a00:1450:4008:c01::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 311752412; Wed, 4 Sep 2013 13:29:34 +0000 (UTC) Received: by mail-bk0-f54.google.com with SMTP id mz12so167341bkb.41 for ; Wed, 04 Sep 2013 06:29:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=KjWIzi+zzjy5EixOq84YnmeCwO5/zYJUl+xwaZAS7cg=; b=0wsCwn3GAC/ztaUAyTioLu8wt7jKdQkNpoOBKxI/fIxljCYeuc8fS7HSV/3AfYAiSJ nkcBy+X5TCHq8Qx4Vd8y2f/UGyUu5GXtOpu6H++c/hhoqnd3ulD1V0kyCFTFJu+o27mK CKfHvsuCNeUapbd/ry9rs829ItCJMdu3jUQrvq9dpbCZCfr79CRp+JXHrFM5Cz4TPYpI yqqtOFs51qPuwJ//NLlz8gF6D6xDhu6m1jeUfet2chJUAoTEUa7EZlfuL1zAmTTspHLo us5pLyZb6qWMBdEBR42rmbqV51Bw58/dJh40ko038vjbqhznKhY3yKY9pt2W9HRvmJJU 1Wqg== X-Received: by 10.205.22.71 with SMTP id qv7mr2518681bkb.20.1378301373128; Wed, 04 Sep 2013 06:29:33 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id 14sm6560105bkl.17.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 04 Sep 2013 06:29:32 -0700 (PDT) Sender: Alexander Motin Message-ID: <522735B9.1070403@FreeBSD.org> Date: Wed, 04 Sep 2013 16:29:29 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: Nathan Whitehorn Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org> In-Reply-To: <52272B6F.9060308@freebsd.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-geom@freebsd.org, freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , FreeBSD SCSI , =?windows-1252?Q?Olivier_Cochard-Labb=E9?= , Outback Dingo X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 13:29:36 -0000 On 04.09.2013 15:45, Nathan Whitehorn wrote: > On 09/04/13 02:01, Alexander Motin wrote: >> On 04.09.2013 00:48, Olivier Cochard-Labbé wrote: >>> On Tue, Sep 3, 2013 at 8:10 PM, Outback Dingo >>> wrote: >>>> Can anyone confirm how well tested/stable this patch set might be?? if >>>> theres positive input i have a zoo of dev machines i could load it >>>> on, to >>>> help further it. >>>> Just checking to see how widely its been tested, >>> >>> I've installed this patch on 3 differents machines there status after >>> about 12hours: >>> - SUN FIRE X4170 M2 (amd64: r255178) with 6 SAS harddrives in one big >>> zraid (LSI MegaSAS Gen2 controller): Used for generating package with >>> poudriere… no probleme since; >>> - HAL/Fujitsu SPARC64-V (sparc64: r255178) with two SCSI-3 disks in >>> gmirror: Used for generating package with poudriere too… no probleme >>> since; >> >> I've forgot to mention, but GEOM direct dispatch is now active only on >> x86 because GET_STACK_USAGE macro now defined only there and I wanted >> to stay on a safe side. On other archs GEOM works in old queued way. >> Somebody should port that small macro to other archs. But that is >> still interesting data point. Thanks. > > Could you describe what this macro is supposed to do so that we can do > the porting work? It supposed to report total and used stack sizes for current thread. I suppose that it will be equal for the most archs, but better somebody familiar with each one looked on it. The macro itself is not new. It is for years used in Netgraph for equivalent purpose. -- Alexander Motin From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 14:34:09 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 23331F09; Wed, 4 Sep 2013 14:34:09 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Received: from mail.icecube.wisc.edu (trout.icecube.wisc.edu [128.104.255.119]) by mx1.freebsd.org (Postfix) with ESMTP id D9331284D; Wed, 4 Sep 2013 14:34:08 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.icecube.wisc.edu (Postfix) with ESMTP id 50CBE5838C; Wed, 4 Sep 2013 09:11:29 -0500 (CDT) X-Virus-Scanned: amavisd-new at icecube.wisc.edu Received: from mail.icecube.wisc.edu ([127.0.0.1]) by localhost (trout.icecube.wisc.edu [127.0.0.1]) (amavisd-new, port 10030) with ESMTP id F6OyxvU8mfj5; Wed, 4 Sep 2013 09:11:29 -0500 (CDT) Received: from terminus.icecube.wisc.edu (terminus.icecube.wisc.edu [172.16.223.97]) by mail.icecube.wisc.edu (Postfix) with ESMTP id 3115758388; Wed, 4 Sep 2013 09:11:29 -0500 (CDT) Message-ID: <52273F90.7020303@freebsd.org> Date: Wed, 04 Sep 2013 09:11:28 -0500 From: Nathan Whitehorn User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130809 Thunderbird/17.0.8 MIME-Version: 1.0 To: Ryan Stone Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <52272B6F.9060308@freebsd.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org, "freebsd-hackers@freebsd.org" , Alexander Motin , "freebsd-current@freebsd.org" , FreeBSD SCSI , =?ISO-8859-1?Q?Olivier_Cochard?= =?ISO-8859-1?Q?-Labb=E9?= , Outback Dingo X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 14:34:09 -0000 On 09/04/13 08:20, Ryan Stone wrote: > On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn wrote: >> Could you describe what this macro is supposed to do so that we can do the >> porting work? >> -Nathan > #define GET_STACK_USAGE(total, used) > > GET_STACK_USAGE sets the variable passed in total to the total amount > of stack space available to the current thread. used is set to the > amount of stack space currently used (this does not have to have > byte-precision). Netgraph uses this to decide when to stop recursing > and instead defer to a work queue (to prevent stack overflow). I > presume that Alexander is using it in a similar way. It looks like > the amd64 version could be ported to other architectures quite easily > if you were to account for stacks that grow up and stacks that grow > down: > > http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup > > /* Get the current kernel thread stack usage. */ > #define GET_STACK_USAGE(total, used) do { \ > struct thread *td = curthread; \ > (total) = td->td_kstack_pages * PAGE_SIZE; \ > (used) = (char *)td->td_kstack + \ > td->td_kstack_pages * PAGE_SIZE - \ > (char *)&td; \ > } while (0) > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" I think that should be MI for us anyway. I'm not aware of any architectures FreeBSD supports with stacks that grow up. I'll give it a test on PPC. -Nathan From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 16:07:51 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 2BC56248; Wed, 4 Sep 2013 16:07:51 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id EA3DA2E7C; Wed, 4 Sep 2013 16:07:50 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 99108B941; Wed, 4 Sep 2013 12:07:49 -0400 (EDT) From: John Baldwin To: freebsd-current@freebsd.org Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Date: Wed, 4 Sep 2013 12:00:55 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p28; KDE/4.5.5; amd64; ; ) References: <520D4ADB.50209@FreeBSD.org> <52273F90.7020303@freebsd.org> In-Reply-To: <52273F90.7020303@freebsd.org> MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201309041200.56024.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 04 Sep 2013 12:07:49 -0400 (EDT) Cc: freebsd-geom@freebsd.org, "freebsd-hackers@freebsd.org" , Alexander Motin , Nathan Whitehorn , Outback Dingo , Olivier =?iso-8859-1?q?Cochard-Labb=E9?= , FreeBSD SCSI , Ryan Stone X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 16:07:51 -0000 On Wednesday, September 04, 2013 10:11:28 am Nathan Whitehorn wrote: > On 09/04/13 08:20, Ryan Stone wrote: > > On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn wrote: > >> Could you describe what this macro is supposed to do so that we can do the > >> porting work? > >> -Nathan > > #define GET_STACK_USAGE(total, used) > > > > GET_STACK_USAGE sets the variable passed in total to the total amount > > of stack space available to the current thread. used is set to the > > amount of stack space currently used (this does not have to have > > byte-precision). Netgraph uses this to decide when to stop recursing > > and instead defer to a work queue (to prevent stack overflow). I > > presume that Alexander is using it in a similar way. It looks like > > the amd64 version could be ported to other architectures quite easily > > if you were to account for stacks that grow up and stacks that grow > > down: > > > > http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup > > > > /* Get the current kernel thread stack usage. */ > > #define GET_STACK_USAGE(total, used) do { \ > > struct thread *td = curthread; \ > > (total) = td->td_kstack_pages * PAGE_SIZE; \ > > (used) = (char *)td->td_kstack + \ > > td->td_kstack_pages * PAGE_SIZE - \ > > (char *)&td; \ > > } while (0) > > _______________________________________________ > > freebsd-hackers@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > > I think that should be MI for us anyway. I'm not aware of any > architectures FreeBSD supports with stacks that grow up. I'll give it a > test on PPC. ia64 has the double stack thingie where the register stack spills into a stack that grows up rather than down. Not sure how sparc64 window spills are handled either. -- John Baldwin From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 16:31:42 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 4A9B1A7D; Wed, 4 Sep 2013 16:31:42 +0000 (UTC) (envelope-from cochard@gmail.com) Received: from mail-ve0-x233.google.com (mail-ve0-x233.google.com [IPv6:2607:f8b0:400c:c01::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C5B36208D; Wed, 4 Sep 2013 16:31:41 +0000 (UTC) Received: by mail-ve0-f179.google.com with SMTP id c13so355336vea.24 for ; Wed, 04 Sep 2013 09:31:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-type; bh=XKa27OKDe9ewp7I9s+bvP097LtkA+VxHI3Fh9yDbWCk=; b=frtCXDU6t24rPHRkOrb2X2Aa1jhUxb6+6DY9/2xktyww57uJ0CqenvLPxKmQqKP61f bTFyYtzsLCOOVf2Z2HjuJBSFUn+9ShEL5zUGpFgNSztb5D2wxvG4JukPoSS6pAMTqo1I Zj5BM1KsLooN5a01V0pN/XHskzazNgIMaiM3PsKT0HEE0K4y4CsOC6MZMgLtozgQ3Hfy 8aoPvQpbmDV0R8W5V88Kw+IFErJObBeibb9NErqbpTsCwMDpxbGBDETduRyqlBZTlyF7 vxkpip8oeFjY3o/XugpsSg/tuMh0LAw7MepfePTD4QOSiDlZ72JhDo+kWSQKvpEWkrEG OomQ== X-Received: by 10.58.197.5 with SMTP id iq5mr849761vec.30.1378312300764; Wed, 04 Sep 2013 09:31:40 -0700 (PDT) MIME-Version: 1.0 Sender: cochard@gmail.com Received: by 10.58.221.9 with HTTP; Wed, 4 Sep 2013 09:31:20 -0700 (PDT) In-Reply-To: <5226DAB0.1060303@FreeBSD.org> References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= Date: Wed, 4 Sep 2013 18:31:20 +0200 X-Google-Sender-Auth: JDxTeJui3sHLgm5FliEs0nhysPc Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 16:31:42 -0000 On Wed, Sep 4, 2013 at 9:01 AM, Alexander Motin wrote: > >> - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second >> hardrive (where fbsd is installed): It crash just after the message >> "GEOM: new disk ada1" during boot >> >> screenshot of the crash screen: >> http://goo.gl/tW1VIx >> >> A little more information: >> addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 >> /usr/src/sys/geom/geom_io.c:129 > > > Unfortunately I can't reproduce that and have not enough clues. It may be > specific to some GEOM class. Could you describe/show all GEOM topology, file > systems, etc. you have there? > gpart show > sysctl kern.geom.confxml > ... Here are: - ada0: internal laptop hard-drive - ada1: the hard-drive that replace my DVD reader (partition 2: /boot in clear, partition 3: geli encrypted partition) => There is no special boot-loader, I manually select the hard-drive during Hardware: ahci0: port 0x4088-0x408f,0x4094-0x4097,0x4080-0x4087,0x4090-0x4093,0x4040-0x405f mem 0xd4827000-0xd48277ff irq 19 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada0: Command Queueing enabled ada0: 305245MB (625142448 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA-8 SATA 2.x device ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada1: quirks=0x1<4K> ada1: Previously was known as ad6 Regarding partition: root@laptop:/root # gpart show => 63 625142385 ada0 MBR (298G) 63 1985 - free - (992k) 2048 31457280 1 ntfs (15G) 31459328 4194304 2 ntfs [active] (2.0G) 35653632 589486768 3 ntfs (281G) 625140400 2048 - free - (1.0M) => 34 976773101 ada1 GPT (465G) 34 6 - free - (3.0k) 40 128 1 freebsd-boot (64k) 168 4194304 2 freebsd-ufs (2.0G) 4194472 972578656 3 freebsd-ufs (463G) 976773128 7 - free - (3.5k) And here is the long output of geom configuration: root@laptop:/root # sysctl kern.geom.confxml kern.geom.confxml: FD RAID DEV ada1p3.eli 4 r0w0e0 gpt/boot 4 r0w0e0 gptid/1c841adf-3cde-11e2-8cfc-a0b3cc295ab2 4 r0w0e0 ada1p3 3 r0w0e0 ada1p2 3 r0w0e0 ada1p1 3 r0w0e0 ntfs/System 4 r1w1e0 ntfs/BDEDrive 4 r0w0e0 ntfs/Recovery 4 r0w0e0 ada1 2 r0w0e0 ada0s3 3 r0w0e0 ada0s2 3 r0w0e0 ada0s1 3 r0w0e0 ada0 2 r0w0e0 ELI ada1p3.eli 3 928 928 BOOT 0 6 hardware 256 AES-XTS ACTIVE r1w1e1 r1w1e1 ada1p3.eli 497960271360 512 0 0 PART ada1 2 GPT 128 34 976773134 63 16 OK false r2w2e5 r1w1e1 ada1p3 497960271872 512 4096 0 4194472 976773127 3 freebsd-ufs 2147569664 497960271872 516e7cb6-6ecf-11d6-8ff8-00022d09712b c8e5c3ff-3cde-11e2-8cfc-a0b3cc295ab2 r1w1e2 ada1p2 2147483648 512 4096 0 168 4194471 2 freebsd-ufs 86016 2147483648 516e7cb6-6ecf-11d6-8ff8-00022d09712b 874bc9a6-3cde-11e2-8cfc-a0b3cc295ab2 r0w0e0 ada1p1 65536 512 4096 0 40 167 1 freebsd-boot 20480 65536 83bd6b9d-7f41-11dc-be0b-001560b84f0f 1c841adf-3cde-11e2-8cfc-a0b3cc295ab2 ada0 2 MBR 4 63 625142447 63 16 OK false r1w1e2 r1w1e1 ada0s3 301817225216 512 0 1074790400 35653632 625140399 3 ntfs 18254659584 301817225216 7 r0w0e0 ada0s2 2147483648 512 0 3222274048 31459328 35653631 2 ntfs 16107175936 2147483648 7 active r0w0e0 ada0s1 16106127360 512 0 1048576 2048 31459327 1 ntfs 1048576 16106127360 7 LABEL ada1p2 3 r1w1e2 r1w1e1 gpt/boot 2147483648 512 4096 0 0 2147483648 4194304 0 0 ada1p1 3 r0w0e0 r0w0e0 gptid/1c841adf-3cde-11e2-8cfc-a0b3cc295ab2 65536 512 4096 0 0 65536 128 0 0 ada0s3 3 r1w1e1 r1w1e0 ntfs/System 301817225216 512 0 1074790400 0 301817225216 589486768 0 0 ada0s2 3 r0w0e0 r0w0e0 ntfs/BDEDrive 2147483648 512 0 3222274048 0 2147483648 4194304 0 0 ada0s1 3 r0w0e0 r0w0e0 ntfs/Recovery 16106127360 512 0 1048576 0 16106127360 31457280 0 0 SWAP VFS ffs.gpt/boot 4 r1w1e1 ffs.ada1p3.eli 4 r1w1e1 MD DISK ada1 1 r2w2e5 ada1 500107862016 512 4096 0 16 63 WD-WX81A1179372 50014ee601049a6a WDC WD5000BPKT-00PK4T0 ada0 1 r1w1e2 ada0 320072933376 512 0 0 16 63 82JRT2VVT 5000039431d04c9c TOSHIBA MK3261GSYN From owner-freebsd-geom@FreeBSD.ORG Wed Sep 4 21:30:01 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 6C004C61; Wed, 4 Sep 2013 21:30:01 +0000 (UTC) (envelope-from nwhitehorn@freebsd.org) Received: from mail.icecube.wisc.edu (trout.icecube.wisc.edu [128.104.255.119]) by mx1.freebsd.org (Postfix) with ESMTP id 304392742; Wed, 4 Sep 2013 21:30:00 +0000 (UTC) Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.icecube.wisc.edu (Postfix) with ESMTP id D4DB958385; Wed, 4 Sep 2013 16:29:59 -0500 (CDT) X-Virus-Scanned: amavisd-new at icecube.wisc.edu Received: from mail.icecube.wisc.edu ([127.0.0.1]) by localhost (trout.icecube.wisc.edu [127.0.0.1]) (amavisd-new, port 10030) with ESMTP id C7+Tce5PvWx0; Wed, 4 Sep 2013 16:29:59 -0500 (CDT) Received: from terminus.icecube.wisc.edu (terminus.icecube.wisc.edu [172.16.223.97]) by mail.icecube.wisc.edu (Postfix) with ESMTP id A953E58384; Wed, 4 Sep 2013 16:29:59 -0500 (CDT) Message-ID: <5227A657.4010701@freebsd.org> Date: Wed, 04 Sep 2013 16:29:59 -0500 From: Nathan Whitehorn User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130809 Thunderbird/17.0.8 MIME-Version: 1.0 To: John Baldwin Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <52273F90.7020303@freebsd.org> <201309041200.56024.jhb@freebsd.org> In-Reply-To: <201309041200.56024.jhb@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org, "freebsd-hackers@freebsd.org" , Alexander Motin , freebsd-current@freebsd.org, Outback Dingo , =?ISO-8859-1?Q?Olivier_Cochard-Labb=E9?= , FreeBSD SCSI , Ryan Stone X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Sep 2013 21:30:01 -0000 On 09/04/13 11:00, John Baldwin wrote: > On Wednesday, September 04, 2013 10:11:28 am Nathan Whitehorn wrote: >> On 09/04/13 08:20, Ryan Stone wrote: >>> On Wed, Sep 4, 2013 at 8:45 AM, Nathan Whitehorn > wrote: >>>> Could you describe what this macro is supposed to do so that we can do > the >>>> porting work? >>>> -Nathan >>> #define GET_STACK_USAGE(total, used) >>> >>> GET_STACK_USAGE sets the variable passed in total to the total amount >>> of stack space available to the current thread. used is set to the >>> amount of stack space currently used (this does not have to have >>> byte-precision). Netgraph uses this to decide when to stop recursing >>> and instead defer to a work queue (to prevent stack overflow). I >>> presume that Alexander is using it in a similar way. It looks like >>> the amd64 version could be ported to other architectures quite easily >>> if you were to account for stacks that grow up and stacks that grow >>> down: >>> >>> > http://svnweb.freebsd.org/base/head/sys/amd64/include/proc.h?revision=233291&view=markup >>> /* Get the current kernel thread stack usage. */ >>> #define GET_STACK_USAGE(total, used) do { \ >>> struct thread *td = curthread; \ >>> (total) = td->td_kstack_pages * PAGE_SIZE; \ >>> (used) = (char *)td->td_kstack + \ >>> td->td_kstack_pages * PAGE_SIZE - \ >>> (char *)&td; \ >>> } while (0) >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" >> I think that should be MI for us anyway. I'm not aware of any >> architectures FreeBSD supports with stacks that grow up. I'll give it a >> test on PPC. > ia64 has the double stack thingie where the register stack spills into a stack > that grows up rather than down. Not sure how sparc64 window spills are > handled either. > Ah, very well. That's weird. Should be fine for PPC, however. -Nathan From owner-freebsd-geom@FreeBSD.ORG Thu Sep 5 21:38:34 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 353CA329; Thu, 5 Sep 2013 21:38:34 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-ea0-x232.google.com (mail-ea0-x232.google.com [IPv6:2a00:1450:4013:c01::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 7485B222B; Thu, 5 Sep 2013 21:38:33 +0000 (UTC) Received: by mail-ea0-f178.google.com with SMTP id a15so1197367eae.9 for ; Thu, 05 Sep 2013 14:38:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=3Y3SU3hKjDRY9H37gbwWoI8b4zarwRXFW/n36mXoO7U=; b=W7K8LaPDCt9ZOe92QDuADwEsPQTebnHLgMx0eOUkD4V8aI0vvaCiA+nUaIyMIOeOIJ YHdmezZ7x8gIhI8nv3yuBEJDpsA3UXTMZry+1xrLitZP5Ij+7BU0QuoEgyE+6QdaELtc Q1Nx7sTyuYv0wEhv9V+Va/dpd/6OAqQ8mmj0wVGpSsaCMsF5a5ZGkKxoeLmEJ4oEaFlP Kc43YK2D+6EdKpQF66+/tWgczYtYXRSxoUHYwElxYydMc502+137x3HVDm4qtprwslnZ s5qRpmhLojmTUiumYHphkqb28j+zgqyF1i7Xzz0tPrFJso9L4S9wxrcJzrXpH6RYJCvT +I+g== X-Received: by 10.14.194.131 with SMTP id m3mr16631075een.45.1378417111929; Thu, 05 Sep 2013 14:38:31 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id p5sm52041532eeg.5.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 05 Sep 2013 14:38:31 -0700 (PDT) Sender: Alexander Motin Message-ID: <5228F9D4.3060008@FreeBSD.org> Date: Fri, 06 Sep 2013 00:38:28 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: =?ISO-8859-1?Q?Olivier_Cochard-Labb=E9?= Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Sep 2013 21:38:34 -0000 On 04.09.2013 19:31, Olivier Cochard-Labbé wrote: > On Wed, Sep 4, 2013 at 9:01 AM, Alexander Motin wrote: >> >>> - HP EliteBook 8460p (amd64: r255188) with DVD replaced by a second >>> hardrive (where fbsd is installed): It crash just after the message >>> "GEOM: new disk ada1" during boot >>> >>> screenshot of the crash screen: >>> http://goo.gl/tW1VIx >>> >>> A little more information: >>> addr2line -e /boot/kernel/kernel.symbols 0xffffffff8083abd3 >>> /usr/src/sys/geom/geom_io.c:129 >> >> >> Unfortunately I can't reproduce that and have not enough clues. It may be >> specific to some GEOM class. Could you describe/show all GEOM topology, file >> systems, etc. you have there? >> gpart show >> sysctl kern.geom.confxml I've found and fixed possible double request completion, that could cause such symptoms if happened. Updated patch located as usual: http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch -- Alexander Motin From owner-freebsd-geom@FreeBSD.ORG Thu Sep 5 22:46:48 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 855C3F7F; Thu, 5 Sep 2013 22:46:48 +0000 (UTC) (envelope-from cochard@gmail.com) Received: from mail-vb0-x22c.google.com (mail-vb0-x22c.google.com [IPv6:2607:f8b0:400c:c02::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 0B40E25B5; Thu, 5 Sep 2013 22:46:47 +0000 (UTC) Received: by mail-vb0-f44.google.com with SMTP id e13so1681328vbg.3 for ; Thu, 05 Sep 2013 15:46:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc:content-type; bh=L2hqyhZpJ0JBn0q3kben8PMpNbwje0O2svVsBJ5vTpE=; b=nzK6rYk2L4RcR7ljW4QbvDcIgHfIkvHsxVkrEBmUPG7yI37hQWZuVK05BGyKeGBume 9oBL1UY4yJH1nOFaAZdOfgdDi6gOSoqMM1KeJa1mfK+Ry7SkH3LyZgfKu0C1yBwVpv0G D/8uJN8tYzRTIG/N6QsT7JNw0yfZ41IQKrEWY3vJ5OQB49ziJbjrNbPrEGLhwvGPiJg1 3hAO1ZkathFDFvBQJcKHmVFv58HIObDyUZUGJA+BWEqd14khc6VwOmuX1eZjT9y6TAd4 QKjjmmoJCRB1OenyIACt8uRD3yZGz2DeOmNuQP5s7UQbOszwGmxi1ngsqd0IRFfiwjVj wi1Q== X-Received: by 10.58.161.116 with SMTP id xr20mr10096802veb.2.1378421207130; Thu, 05 Sep 2013 15:46:47 -0700 (PDT) MIME-Version: 1.0 Sender: cochard@gmail.com Received: by 10.58.221.9 with HTTP; Thu, 5 Sep 2013 15:46:27 -0700 (PDT) In-Reply-To: <5228F9D4.3060008@FreeBSD.org> References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> From: =?ISO-8859-1?Q?Olivier_Cochard=2DLabb=E9?= Date: Fri, 6 Sep 2013 00:46:27 +0200 X-Google-Sender-Auth: rZXJ1jxqZ-x9zPiDTbRRsZzCApI Message-ID: Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking To: Alexander Motin Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Sep 2013 22:46:48 -0000 On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: > I've found and fixed possible double request completion, that could cause > such symptoms if happened. Updated patch located as usual: > http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch > Good catch! this new patch (applied to r255188) fix the problem on my laptop. Thanks, Olivier From owner-freebsd-geom@FreeBSD.ORG Fri Sep 6 08:06:36 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 1080020C; Fri, 6 Sep 2013 08:06:36 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C56A8248C; Fri, 6 Sep 2013 08:06:35 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id 35EF6C1B79; Fri, 6 Sep 2013 08:06:28 +0000 (UTC) Date: Fri, 6 Sep 2013 10:06:28 +0200 From: Jeremie Le Hen To: Olivier =?iso-8859-1?Q?Cochard-Labb=E9?= Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130906080627.GH43281@caravan.chchile.org> Mail-Followup-To: Olivier =?iso-8859-1?Q?Cochard-Labb=E9?= , Alexander Motin , freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-hackers@freebsd.org, Alexander Motin , "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 08:06:36 -0000 On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote: > On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: > > I've found and fixed possible double request completion, that could cause > > such symptoms if happened. Updated patch located as usual: > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch > > > > Good catch! > this new patch (applied to r255188) fix the problem on my laptop. With this new one I cannot boot any more (I also updated the source tree). This is a hand transcripted version: Trying to mount root from zfs:zroot/root []... panic: Batch flag already set cpuid = 1 KDB: stack backtrace: db_trace_self_wrapper() kdb_backtrace() vpanic() kassert_panic() xpt_batch_start() ata_interrupt() softclock_call_cc() softclock() ithread_loop() fork_exit() fork_trampoline() -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-geom@FreeBSD.ORG Fri Sep 6 08:29:18 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 1F04722D; Fri, 6 Sep 2013 08:29:18 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-wi0-x233.google.com (mail-wi0-x233.google.com [IPv6:2a00:1450:400c:c05::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3C2BC277F; Fri, 6 Sep 2013 08:29:17 +0000 (UTC) Received: by mail-wi0-f179.google.com with SMTP id hm2so548715wib.6 for ; Fri, 06 Sep 2013 01:29:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=cKvvmgI4MFZXDvTnnY59FeR0s1d1wz4lMm26SQGf0GA=; b=o5ccwrrEuDeiW02qIeTQ6XnFRpVWxSOvENLrYvAxtBCntauuGYvzJ5Kawq6Cip7cHj KTYEFxt21sjAI20m6psQjR/iAETpGKUHgUt6rHvq2i7Gf1Ktkb5vDH/Mdnvik6qzQetu zWxsoTzF47FlRRkv1QJPFKUgf+PjPbvI527zoNJ5Nim2nbRPRlkpbMiYu9cW8GZVrcly OWCvw/RKcHx2ZQjDE8gLIOGI3U2KvJAs0khy1ABKa1qtTb8nQXYLl1FjaJCm8T/So4+a eCLG/1gRFmJkyHF3WXMobqxVo+74DfeHBTuBFeey4wOYwV1YaaFAGkikPa3GrLaXH16j cTLA== X-Received: by 10.194.86.5 with SMTP id l5mr531403wjz.45.1378456155424; Fri, 06 Sep 2013 01:29:15 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id e5sm4368184wiy.2.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 06 Sep 2013 01:29:14 -0700 (PDT) Sender: Alexander Motin Message-ID: <52299257.10704@FreeBSD.org> Date: Fri, 06 Sep 2013 11:29:11 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: Jeremie Le Hen Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <520D4ADB.50209@FreeBSD.org> <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> <20130906080627.GH43281@caravan.chchile.org> In-Reply-To: <20130906080627.GH43281@caravan.chchile.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 08:29:18 -0000 On 06.09.2013 11:06, Jeremie Le Hen wrote: > On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote: >> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: >>> I've found and fixed possible double request completion, that could cause >>> such symptoms if happened. Updated patch located as usual: >>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch >>> > With this new one I cannot boot any more (I also updated the source > tree). This is a hand transcripted version: > > Trying to mount root from zfs:zroot/root []... > panic: Batch flag already set > cpuid = 1 > KDB: stack backtrace: > db_trace_self_wrapper() > kdb_backtrace() > vpanic() > kassert_panic() > xpt_batch_start() > ata_interrupt() > softclock_call_cc() > softclock() > ithread_loop() > fork_exit() > fork_trampoline() Thank you for the report. I see my fault. It is probably specific to ata(4) driver only. I've workarounded that in new patch version, but probably that area needs some rethinking. http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch -- Alexander Motin From owner-freebsd-geom@FreeBSD.ORG Fri Sep 6 23:02:38 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 981DB16B; Fri, 6 Sep 2013 23:02:38 +0000 (UTC) (envelope-from jlh@FreeBSD.org) Received: from caravan.chchile.org (caravan.chchile.org [178.32.125.136]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 5C51E2121; Fri, 6 Sep 2013 23:02:38 +0000 (UTC) Received: by caravan.chchile.org (Postfix, from userid 1000) id 38BB0C1EE3; Fri, 6 Sep 2013 23:02:36 +0000 (UTC) Date: Sat, 7 Sep 2013 01:02:36 +0200 From: Jeremie Le Hen To: Alexander Motin Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking Message-ID: <20130906230236.GI43281@caravan.chchile.org> Mail-Followup-To: Alexander Motin , freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org References: <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> <20130906080627.GH43281@caravan.chchile.org> <52299257.10704@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <52299257.10704@FreeBSD.org> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Sep 2013 23:02:38 -0000 On Fri, Sep 06, 2013 at 11:29:11AM +0300, Alexander Motin wrote: > On 06.09.2013 11:06, Jeremie Le Hen wrote: > > On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote: > >> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: > >>> I've found and fixed possible double request completion, that could cause > >>> such symptoms if happened. Updated patch located as usual: > >>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch > >>> > > With this new one I cannot boot any more (I also updated the source > > tree). This is a hand transcripted version: > > > > Trying to mount root from zfs:zroot/root []... > > panic: Batch flag already set > > cpuid = 1 > > KDB: stack backtrace: > > db_trace_self_wrapper() > > kdb_backtrace() > > vpanic() > > kassert_panic() > > xpt_batch_start() > > ata_interrupt() > > softclock_call_cc() > > softclock() > > ithread_loop() > > fork_exit() > > fork_trampoline() > > Thank you for the report. I see my fault. It is probably specific to > ata(4) driver only. I've workarounded that in new patch version, but > probably that area needs some rethinking. > > http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch I'm not sure you needed a confirmation, but it boots. Thanks :). I didn't quite understand the thread; is direct dispatch enabled for amd64? ISTR you said only i386 but someone else posted the macro for amd64. -- Jeremie Le Hen Scientists say the world is made up of Protons, Neutrons and Electrons. They forgot to mention Morons. From owner-freebsd-geom@FreeBSD.ORG Sat Sep 7 00:54:45 2013 Return-Path: Delivered-To: freebsd-geom@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 9389D2E3; Sat, 7 Sep 2013 00:54:45 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 668BD2D2B; Sat, 7 Sep 2013 00:54:45 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id r870sjtE095732; Sat, 7 Sep 2013 00:54:45 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id r870sjiw095670; Sat, 7 Sep 2013 00:54:45 GMT (envelope-from linimon) Date: Sat, 7 Sep 2013 00:54:45 GMT Message-Id: <201309070054.r870sjiw095670@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-geom@FreeBSD.org From: linimon@FreeBSD.org Subject: Re: kern/181900: [geom] [patch] Line breaks missing in geli's kern.geom.confxml entries X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Sep 2013 00:54:45 -0000 Old Synopsis: [patch] Line breaks missing in geli's kern.geom.confxml entries New Synopsis: [geom] [patch] Line breaks missing in geli's kern.geom.confxml entries Responsible-Changed-From-To: freebsd-bugs->freebsd-geom Responsible-Changed-By: linimon Responsible-Changed-When: Sat Sep 7 00:54:31 UTC 2013 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=181900 From owner-freebsd-geom@FreeBSD.ORG Sat Sep 7 06:32:52 2013 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id DE5F96B2; Sat, 7 Sep 2013 06:32:51 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-ee0-x22c.google.com (mail-ee0-x22c.google.com [IPv6:2a00:1450:4013:c00::22c]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 2B15D2DED; Sat, 7 Sep 2013 06:32:51 +0000 (UTC) Received: by mail-ee0-f44.google.com with SMTP id b47so2030518eek.3 for ; Fri, 06 Sep 2013 23:32:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=ilD9VCbquphj1dYzFxmCe9bvhxnFO5x39Z+sK2ZQYyc=; b=QG21UhYVc6fS3I1DtG2lispuOFkJAHmGsBe8l2vshkVr1YO4aWaD22pXiPLM0kCxZ7 8ANziza/TDXJyqWx1/AxUCzeGzvLcl//C04L0EdjqhbUE6MyOUjeCEQa56mFfYcVFGc+ hl/mUU1NklX3q0vTmgPv0FRd14FTrHEeDNSU0gjqkWUFPbIOJ8fzIMO3ya6DnJspUMXA mGEgOm3UEsx300oUisAtYb5kK3Xq+xHC5yOcupeulRa62VM+h/bJVYhOHjFnuXYpjYO4 lWHlGSXs3iftT5iIQEduNFp4xMDOn+FoV6ShN31B/CJoo6bP2z+WyUGGctmThFYA0+aL Wfag== X-Received: by 10.14.8.72 with SMTP id 48mr10508882eeq.25.1378535568549; Fri, 06 Sep 2013 23:32:48 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([37.229.21.195]) by mx.google.com with ESMTPSA id r48sm2188473eev.14.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 06 Sep 2013 23:32:47 -0700 (PDT) Sender: Alexander Motin Message-ID: <522AC88D.4070005@FreeBSD.org> Date: Sat, 07 Sep 2013 09:32:45 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130616 Thunderbird/17.0.6 MIME-Version: 1.0 To: freebsd-hackers@freebsd.org, "freebsd-current@freebsd.org" , freebsd-geom@freebsd.org Subject: Re: [RFC][CFT] GEOM direct dispatch and fine-grained CAM locking References: <5224511D.4090503@FreeBSD.org> <20130903134251.GB43281@caravan.chchile.org> <5226DAB0.1060303@FreeBSD.org> <5228F9D4.3060008@FreeBSD.org> <20130906080627.GH43281@caravan.chchile.org> <52299257.10704@FreeBSD.org> <20130906230236.GI43281@caravan.chchile.org> In-Reply-To: <20130906230236.GI43281@caravan.chchile.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Sep 2013 06:32:52 -0000 On 07.09.2013 02:02, Jeremie Le Hen wrote: > On Fri, Sep 06, 2013 at 11:29:11AM +0300, Alexander Motin wrote: >> On 06.09.2013 11:06, Jeremie Le Hen wrote: >>> On Fri, Sep 06, 2013 at 12:46:27AM +0200, Olivier Cochard-Labbé wrote: >>>> On Thu, Sep 5, 2013 at 11:38 PM, Alexander Motin wrote: >>>>> I've found and fixed possible double request completion, that could cause >>>>> such symptoms if happened. Updated patch located as usual: >>>>> http://people.freebsd.org/~mav/camlock_patches/camlock_20130905.patch >>>>> >>> With this new one I cannot boot any more (I also updated the source >>> tree). This is a hand transcripted version: >>> >>> Trying to mount root from zfs:zroot/root []... >>> panic: Batch flag already set >>> cpuid = 1 >>> KDB: stack backtrace: >>> db_trace_self_wrapper() >>> kdb_backtrace() >>> vpanic() >>> kassert_panic() >>> xpt_batch_start() >>> ata_interrupt() >>> softclock_call_cc() >>> softclock() >>> ithread_loop() >>> fork_exit() >>> fork_trampoline() >> >> Thank you for the report. I see my fault. It is probably specific to >> ata(4) driver only. I've workarounded that in new patch version, but >> probably that area needs some rethinking. >> >> http://people.freebsd.org/~mav/camlock_patches/camlock_20130906.patch > > I'm not sure you needed a confirmation, but it boots. Thanks :). > > I didn't quite understand the thread; is direct dispatch enabled for > amd64? ISTR you said only i386 but someone else posted the macro for > amd64. Yes, it is enabled for amd64. I've said x86, meaning both i386 and amd64. -- Alexander Motin