From owner-freebsd-net@FreeBSD.ORG Fri Oct 21 06:40:46 2005 Return-Path: X-Original-To: freebsd-net@FreeBSD.org Delivered-To: freebsd-net@FreeBSD.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9ADD416A41F; Fri, 21 Oct 2005 06:40:46 +0000 (GMT) (envelope-from glebius@FreeBSD.org) Received: from cell.sick.ru (cell.sick.ru [217.72.144.68]) by mx1.FreeBSD.org (Postfix) with ESMTP id A86EA43D4C; Fri, 21 Oct 2005 06:40:45 +0000 (GMT) (envelope-from glebius@FreeBSD.org) Received: from cell.sick.ru (glebius@localhost [127.0.0.1]) by cell.sick.ru (8.13.3/8.13.3) with ESMTP id j9L6eTaC015742 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 21 Oct 2005 10:40:29 +0400 (MSD) (envelope-from glebius@FreeBSD.org) Received: (from glebius@localhost) by cell.sick.ru (8.13.3/8.13.1/Submit) id j9L6eT8P015741; Fri, 21 Oct 2005 10:40:29 +0400 (MSD) (envelope-from glebius@FreeBSD.org) X-Authentication-Warning: cell.sick.ru: glebius set sender to glebius@FreeBSD.org using -f Date: Fri, 21 Oct 2005 10:40:28 +0400 From: Gleb Smirnoff To: Yar Tikhiy Message-ID: <20051021064028.GZ59364@cell.sick.ru> Mail-Followup-To: Gleb Smirnoff , Yar Tikhiy , freebsd-net@FreeBSD.org, ru@FreeBSD.org, Andrew Thompson References: <20051019102559.GA45909@heff.fud.org.nz> <20051020070054.GZ59364@cell.sick.ru> <20051020085721.GC27114@comp.chem.msu.su> <20051021053033.GW59364@cell.sick.ru> <20051021060654.GC69814@comp.chem.msu.su> Mime-Version: 1.0 Content-Type: text/plain; charset=koi8-r Content-Disposition: inline In-Reply-To: <20051021060654.GC69814@comp.chem.msu.su> User-Agent: Mutt/1.5.6i Cc: freebsd-net@FreeBSD.org, ru@FreeBSD.org, Andrew Thompson Subject: Re: vlan patch X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Oct 2005 06:40:46 -0000 On Fri, Oct 21, 2005 at 10:06:55AM +0400, Yar Tikhiy wrote: Y> On Fri, Oct 21, 2005 at 09:30:33AM +0400, Gleb Smirnoff wrote: Y> > On Thu, Oct 20, 2005 at 12:57:21PM +0400, Yar Tikhiy wrote: Y> > Y> The hash code consists of literally a couple of #define's. And the Y> > Y> difference between ng_vlan(4) and vlan(4) is that each ng_vlan node Y> > Y> gets its own instance of the hash table. OTOH, in vlan(4) we need Y> > Y> to decide if the hash table will be per parent interface or a single Y> > Y> global instance. In the latter case we could hash by a combination Y> > Y> of the VLAN tag and parent's ifindex. Perhaps this approach will Y> > Y> yield more CPU cache hits during hash table lookups. In addition, Y> > Y> it will be thriftier in using memory. Locking the global hash table Y> > Y> should not be an issue as we can use an sx lock in this case for Y> > Y> optimal read access. Y> > Y> > The sx lock is slow. We'd better use per interface hash, and thus Y> > get locking instantly, with per-vlan lock. In other case, we will Y> > acquire per-vlan lock + the sx lock on every packet. The sx lock Y> > actually means mtx_lock+mtx_unlock, thus we will make 3 mutex Y> > operations instead of one. Y> Y> OK, let's forget about sx locks. However, a per-interface hash is Y> associated with a _physical_ interface, hence we must find the vlan Y> to lock using the hash first. If there were a physical interface Y> lock held by its driver in each case, it could protect the hash as Y> well. Can we rely on this? Oops. When speaking about per-vlan lock, I really meant per-trunk lock. Or are you going to implement per-vlan lock? Is this going to be a benefit? Since all packets on trunk are serialized by NIC driver, can there be any benefit in creating a mutex per vlan interface, not per vlan trunk? -- Totus tuus, Glebius. GLEBIUS-RIPN GLEB-RIPE