From owner-freebsd-mips@FreeBSD.ORG Tue Apr 20 13:10:08 2010 Return-Path: Delivered-To: freebsd-mips@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BDC431065670; Tue, 20 Apr 2010 13:10:08 +0000 (UTC) (envelope-from rrs@lakerest.net) Received: from lakerest.net (unknown [IPv6:2001:240:585:2:213:d4ff:fef3:2d8d]) by mx1.freebsd.org (Postfix) with ESMTP id 5380D8FC16; Tue, 20 Apr 2010 13:10:08 +0000 (UTC) Received: from [192.168.2.112] (pool-173-67-91-86.snfcca.dsl-w.verizon.net [173.67.91.86]) (authenticated bits=0) by lakerest.net (8.14.3/8.14.3) with ESMTP id o3KDA2S5051035 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT); Tue, 20 Apr 2010 09:10:05 -0400 (EDT) (envelope-from rrs@lakerest.net) Message-Id: From: Randall Stewart To: Rui Paulo In-Reply-To: Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v936) Date: Tue, 20 Apr 2010 06:09:57 -0700 References: <544BD79C-24C0-4015-AE04-F7F8D70CF537@freebsd.org> <3BCD65EB-B997-449D-864C-CA24C7B19026@freebsd.org> <6BDB3874-D779-45A6-ABAE-4C331D78A189@lakerest.net> <7BEFA3F5-97AE-477C-9DD3-EF1C4B7DCEB0@freebsd.org> X-Mailer: Apple Mail (2.936) Cc: freebsd-mips@freebsd.org Subject: Re: SMP support for XLR processors. X-BeenThere: freebsd-mips@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting FreeBSD to MIPS List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Apr 2010 13:10:08 -0000 Rui: I don't see this at all either... hmm I wonder why.. I am getting up and running (thanks JC).. I will launch a buildworld -j16 before heading to work ;-) R On Apr 20, 2010, at 3:33 AM, Rui Paulo wrote: > On 20 Apr 2010, at 11:05, Rui Paulo wrote: > >> On 20 Apr 2010, at 10:52, C. Jayachandran wrote: >> >>> On Mon, Apr 19, 2010 at 7:27 PM, C. Jayachandran >>> wrote: >>>> I have a possible cause for the panic with invariants - we should >>>> not >>>> schedule the msgring threads unless the smp is completely up. I >>>> guess >>>> we start getting message ring interrupts on before the message ring >>>> threads can be scheduled. I am trying out some changes for this - >>>> will send you a patch if this fixes it. >>> >>> I've attached a patch that should fix the issue. The cause was the >>> way >>> message ring threads are started on individual cores and the way >>> interrupts are enabled in the core. I've moved starting message >>> ring >>> threads on other cpus to be a SYSINIT after SMP is started. I'd >>> thought originally that it was due to some clash with the changes in >>> HEAD - but looks like I was completely off-track there. >>> >>> Please let me know if you don't get multi-user with 32 cpus with >>> this >>> patch. There is still the original hang in buildworld, but that >>> should >>> be a bug elsewhere >>> >>> I have a copy at http://sites.google.com/site/cjayachandran/files >>> too >> >> This works perfectly, thanks! > > On further inspection, I noticed that the load avg is now 7. > > last pid: 1613; load averages: 6.99, 6.97, 6.08 up > 0+00:30:11 10:32:48 > 108 processes: 40 running, 24 sleeping, 44 waiting > CPU: 0.0% user, 0.0% nice, 21.9% system, 0.0% interrupt, 78.1% idle > Mem: 8444K Active, 6028K Inact, 37M Wired, 308K Cache, 6800K Buf, > 3190M Free > Swap: > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU > COMMAND > 10 root 32 171 ki31 0G 0G CPU0 0 263:26 2500.00% > idle > 17 root 1 -16 - 0K 0G CPU12 2 0:00 100.00% > msg_intr12 > 15 root 1 -16 - 0K 0G CPU4 2 0:00 100.00% > msg_intr4 > 16 root 1 -16 - 0K 0G CPU8 2 0:00 100.00% > msg_intr8 > 20 root 1 -16 - 0K 0G CPU24 1 0:00 100.00% > msg_intr24 > 19 root 1 -16 - 0K 0G CPU20 1 0:00 100.00% > msg_intr20 > 21 root 1 -16 - 0K 0G CPU28 1 0:00 100.00% > msg_intr28 > 18 root 1 -16 - 0K 0G CPU16 1 0:00 100.00% > msg_intr16 > > What are these msg_intrXX kprocs doing? > > Regards, > -- > Rui Paulo > > ------------------------------ Randall Stewart 803-317-4952 (cell) 803-345-0391(direct)