Date: Mon, 25 Feb 2008 14:36:30 -1000 (HST) From: Jeff Roberson <jroberson@chesapeake.net> To: Alfred Perlstein <alfred@freebsd.org> Cc: Brooks Davis <brooks@freebsd.org>, Andrew Gallatin <gallatin@cs.duke.edu>, Daniel Eischen <deischen@freebsd.org>, arch@freebsd.org, Robert Watson <rwatson@freebsd.org>, David Xu <davidxu@freebsd.org> Subject: Re: cpuset and affinity implementation Message-ID: <20080225143222.B920@desktop> In-Reply-To: <20080225231747.GT99258@elvis.mu.org> References: <20080220175532.Q920@desktop> <20080220213253.A920@desktop> <20080221092011.J52922@fledge.watson.org> <20080222121253.N920@desktop> <20080222231245.GA28788@lor.one-eyed-alien.net> <20080222134923.M920@desktop> <20080223194047.GB38485@lor.one-eyed-alien.net> <20080223111659.K920@desktop> <20080223213507.GD39699@lor.one-eyed-alien.net> <20080224001902.J920@desktop> <20080225231747.GT99258@elvis.mu.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, 25 Feb 2008, Alfred Perlstein wrote: > * Jeff Roberson <jroberson@chesapeake.net> [080224 02:39] wrote: >> Please see: >> http://people.freebsd.org/~jeff/cpuset.diff >> >> This is unfortunately intertwined with ULE's new CPU selection algorithm >> so that code is in the patch as well. Otherwise, this includes a simple, >> ugly userland tool called cpuset and all of the kernel support required. >> I have tested this by creating sets and subsets and modifying their cpu >> masks under load. I'm able to dynamically reprovision without issue. >> >> This doesn't have support for jails but the infrastructure is there. It >> also fails to modify sets if it would leave threads without a valid cpu >> to run on. I have not implemented a force option but it will be trivial >> to do so. The initial cpu set is also created before we know all_cpus so >> it's faked up with all cpus set for now. >> >> I mostly want people to look at the interface in cpuset.h and make sure >> they agree with it before I start polishing to commit. I'm fairly happy >> with the way the syscall api looks now. The code itself ended up being >> much more complicated than I'd hoped due to locking considerations. Try >> not to look at cpuset_setproc() ;). > > > Jeff, this is very cool. I do have one issue though: > > + * A thread may not be assigned to a a group seperate from other threads in > + * the process. This is to remove ambiguity when the setid is queried with > + * a pid argument. There is no other technical limitation. > > Am I understanding things correctly such that within a process there > can only be one "set"? > > If so this restricts some of the benifits you get with sets and > binding. > > An example would be some sort of system with multiple CPUs where some > are assigned specifically for pseudo-realtime processing and others are for > general control things such as cli, stats, etc. > > In our case we would like to be able to run some threads on specific > cpu sets, and other threads to be run anywhere on the control CPUs. > > Can this be done with this API? Individual threads can be bound to any cpu or group of cpus within the set. So if you just make a set that includes all cpus in the system you can then bind your realtime threads to specific cpus and the other threads to the remainder. You will have to specifically bind each thread however. The reason individual threads can't be assigned to groups is because cpuset_getid() for a pid wouldn't make sense then and I expect administrators to be mostly interested in managing groups of processes. It's really two different goals that are being served by this api. You can think of the sets as more of an administrative tool. While the private thread mask is a tool for the application programmer. It just so happens that it was convenient under the hood to have it all managed in the same way. Thanks, Jeff > > -Alfred >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20080225143222.B920>