From owner-freebsd-amd64@FreeBSD.ORG Mon Mar 16 20:11:30 2015 Return-Path: Delivered-To: freebsd-amd64@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BDBE9DB7 for ; Mon, 16 Mar 2015 20:11:30 +0000 (UTC) Received: from resqmta-ch2-04v.sys.comcast.net (resqmta-ch2-04v.sys.comcast.net [IPv6:2001:558:fe21:29:69:252:207:36]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (Client CN "Bizanga Labs SMTP Client Certificate", Issuer "Bizanga Labs CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7E104D29 for ; Mon, 16 Mar 2015 20:11:30 +0000 (UTC) Received: from resomta-ch2-07v.sys.comcast.net ([69.252.207.103]) by resqmta-ch2-04v.sys.comcast.net with comcast id 4LB11q0012EPM3101LBULY; Mon, 16 Mar 2015 20:11:28 +0000 Received: from resmail-ch2-217v.sys.comcast.net ([162.150.48.251]) by resomta-ch2-07v.sys.comcast.net with comcast id 4LBU1q00E5RAVJS01LBUTu; Mon, 16 Mar 2015 20:11:28 +0000 Date: Mon, 16 Mar 2015 20:11:27 +0000 (UTC) From: rondzierwa@comcast.net To: freebsd-amd64@freebsd.org Message-ID: <1346086351.8355778.1426536687864.JavaMail.zimbra@comcast.net> In-Reply-To: <1164871717.8339660.1426535837845.JavaMail.zimbra@comcast.net> Subject: sun x4500 and smp MIME-Version: 1.0 X-Originating-IP: [::ffff:50.241.136.195] X-Mailer: Zimbra 8.0.7_GA_6031 (ZimbraWebClient - FF28 (Win)/8.0.7_GA_6031) Thread-Topic: sun x4500 and smp Thread-Index: LXDxIGWr/ZrH27sKLb9CZr6M639Ezg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20140121; t=1426536688; bh=D3khnm3yGPpfaWtZ/n3rjf9hF+oThJIr/wTZhdCzu6g=; h=Received:Received:Date:From:To:Message-ID:Subject:MIME-Version: Content-Type; b=B3ZRNyuUUTdQe8sppBVohhj9DExjdrxBXB6outXAjO5lUbf9uld4P4bNNO1k4v0IH y5m8pkGrN+ZqCEcnnKwlKZwgHe4v0ul1M0MjV1XpNuzINDUArPHpn/gyE8W4+/V9Rx fjXblECBGWBm+xE4ce8Du8gPnNx4rgR31AG5ntr7WdvpGwgo/jzUzolJ50urGWWW9L rHnNaS14hlrQrnXDRSgGAQI2mZYU0rwDQMoSfZX+hIVqAZsCTkmoeN3ilWdVsa6hhE aFSzgD3wN4zQXi60V3Bf8GwGpF14xTCDcjZihz2C8qXW+jfMWHOlftR+CF38skFP64 yiFAt4zbyiAlQ== Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 20:11:30 -0000 I am using a sunfire x4500 (thumper) with a pair of dual-core opteron 290 processors, running 10.1-RELEASE to serve up zfs filesystems via nfs and samba. The system reboots periodically when under load. I cannot find anything in any of the system logs that would account for why it rebooted, it just goes away for a while and comes back in a few minutes. Out of desperation, I tried disabling all but one of the processors. (hint.lapic.x.disabled=1 where x == 1, 2 and 3). Oddly enough the system doesn't reboot anymore. Is there any known issues about SMP not working on a sunfire x4500? I have searched the mail archives and haven't found anything useful. thanks in advance for any help or suggestions. ron. From owner-freebsd-amd64@FreeBSD.ORG Tue Mar 17 02:19:29 2015 Return-Path: Delivered-To: freebsd-amd64@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 10942BDD for ; Tue, 17 Mar 2015 02:19:29 +0000 (UTC) Received: from alogt.com (alogt.com [69.36.191.58]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DD32AB8D for ; Tue, 17 Mar 2015 02:19:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=alogt.com; s=default; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References:In-Reply-To:Message-ID:Subject:Cc:To:From:Date; bh=x4KsDB/gx2H56pg4sZNN3mye6EJVvm2co+UwjEIMnp0=; b=PAuI4qAUnU0HVNKThhJNw5WsLtNBBNpt8wTyDqNHinaZ2Xifh6kUSi1RRH1mcA18K2oGt4zZf7dXTYMY5Mw00oyzXx0t2qUHjOkjVii0z3hj082Yv2Rky6nwbXifgZl5nca/cUZNewFEHXQ9LdLqbRYRGzJAdjy3u7YcyfPPu3Q=; Received: from [114.121.162.10] (port=44848 helo=B85M-HD3-0.alogt.com) by sl-508-2.slc.westdc.net with esmtpsa (TLSv1.2:AES128-GCM-SHA256:128) (Exim 4.85) (envelope-from ) id 1YXh6H-0038Nq-5P; Mon, 16 Mar 2015 20:19:22 -0600 Date: Tue, 17 Mar 2015 10:19:06 +0800 From: Erich Dollansky To: rondzierwa@comcast.net Subject: Re: sun x4500 and smp Message-ID: <20150317101906.3e58020c@B85M-HD3-0.alogt.com> In-Reply-To: <1346086351.8355778.1426536687864.JavaMail.zimbra@comcast.net> References: <1164871717.8339660.1426535837845.JavaMail.zimbra@comcast.net> <1346086351.8355778.1426536687864.JavaMail.zimbra@comcast.net> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - sl-508-2.slc.westdc.net X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - alogt.com X-Get-Message-Sender-Via: sl-508-2.slc.westdc.net: authenticated_id: erichsfreebsdlist@alogt.com X-Source: X-Source-Args: X-Source-Dir: Cc: freebsd-amd64@freebsd.org X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Mar 2015 02:19:29 -0000 Hi, On Mon, 16 Mar 2015 20:11:27 +0000 (UTC) rondzierwa@comcast.net wrote: > Out of desperation, I tried disabling all but one of the processors. > (hint.lapic.x.disabled=1 where x == 1, 2 and 3). Oddly enough the > system doesn't reboot anymore. doesn't it matter which CPU is still running? Could also try to enable just one core in each cpu? Erich From owner-freebsd-amd64@FreeBSD.ORG Tue Mar 17 08:40:43 2015 Return-Path: Delivered-To: freebsd-amd64@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 983CED80 for ; Tue, 17 Mar 2015 08:40:43 +0000 (UTC) Received: from fr-exchange.activnetworks.com (fr-exchange.activnetworks.com [62.210.235.130]) by mx1.freebsd.org (Postfix) with ESMTP id 3A2DA88E for ; Tue, 17 Mar 2015 08:40:42 +0000 (UTC) Received: from rn.activnetworks.com ([192.168.1.100] RDNS failed) by fr-exchange.activnetworks.com with Microsoft SMTPSVC(6.0.3790.4675); Tue, 17 Mar 2015 09:21:02 +0100 Message-ID: <5507E845.40701@activnetworks.com> Date: Tue, 17 Mar 2015 09:39:33 +0100 From: Remy Nonnenmacher User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: rondzierwa@comcast.net, freebsd-amd64@freebsd.org Subject: Re: sun x4500 and smp References: <1346086351.8355778.1426536687864.JavaMail.zimbra@comcast.net> In-Reply-To: <1346086351.8355778.1426536687864.JavaMail.zimbra@comcast.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 17 Mar 2015 08:21:02.0959 (UTC) FILETIME=[4EA03FF0:01D0608B] X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Mar 2015 08:40:43 -0000 Hi Ron, Fighted the same problem on mine. It seems to be a problem of interrupts dynamic routing on those old good opterons. I fixed it by sticking all interrupts to processor 0 (cpuset -l 0 -x ..). Since then, it works without any trouble. On 03/16/15 21:11, rondzierwa@comcast.net wrote: > I am using a sunfire x4500 (thumper) with a pair of dual-core opteron 290 processors, running 10.1-RELEASE to serve up zfs filesystems via nfs and samba. > > The system reboots periodically when under load. I cannot find anything in any of the system logs that would account for why it rebooted, it just goes away for a while and comes back in a few minutes. > > Out of desperation, I tried disabling all but one of the processors. (hint.lapic.x.disabled=1 where x == 1, 2 and 3). Oddly enough the system doesn't reboot anymore. > > Is there any known issues about SMP not working on a sunfire x4500? I have searched the mail archives and haven't found anything useful. > > thanks in advance for any help or suggestions. > ron. > > _______________________________________________ > freebsd-amd64@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-amd64 > To unsubscribe, send any mail to "freebsd-amd64-unsubscribe@freebsd.org" > From owner-freebsd-amd64@FreeBSD.ORG Fri Mar 20 17:00:44 2015 Return-Path: Delivered-To: freebsd-amd64@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9E8C0344 for ; Fri, 20 Mar 2015 17:00:44 +0000 (UTC) Received: from resqmta-ch2-07v.sys.comcast.net (resqmta-ch2-07v.sys.comcast.net [IPv6:2001:558:fe21:29:69:252:207:39]) (using TLSv1.2 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (Client CN "Bizanga Labs SMTP Client Certificate", Issuer "Bizanga Labs CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 512A88E4 for ; Fri, 20 Mar 2015 17:00:44 +0000 (UTC) Received: from resomta-ch2-01v.sys.comcast.net ([69.252.207.97]) by resqmta-ch2-07v.sys.comcast.net with comcast id 5t021q00226dK1R01t0i3h; Fri, 20 Mar 2015 17:00:42 +0000 Received: from resmail-ch2-217v.sys.comcast.net ([162.150.48.251]) by resomta-ch2-01v.sys.comcast.net with comcast id 5t0i1q0085RAVJS01t0iZu; Fri, 20 Mar 2015 17:00:42 +0000 Date: Fri, 20 Mar 2015 17:00:42 +0000 (UTC) From: rondzierwa@comcast.net To: Remy Nonnenmacher Message-ID: <1492043232.11922576.1426870841994.JavaMail.zimbra@comcast.net> In-Reply-To: <5507E845.40701@activnetworks.com> References: <1346086351.8355778.1426536687864.JavaMail.zimbra@comcast.net> <5507E845.40701@activnetworks.com> Subject: Re: sun x4500 and smp MIME-Version: 1.0 X-Originating-IP: [::ffff:50.241.136.195] X-Mailer: Zimbra 8.0.7_GA_6031 (ZimbraWebClient - FF28 (Win)/8.0.7_GA_6031) Thread-Topic: sun x4500 and smp Thread-Index: 9zhG3yk94xTKaBd1JLy+lVbC5GbiPg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcast.net; s=q20140121; t=1426870842; bh=ddlhzs8hCg9NzLZq0p5mn7oc2uKsD9C63k69Zl8I5u8=; h=Received:Received:Date:From:To:Message-ID:Subject:MIME-Version: Content-Type; b=aRnHZEusnwuduODLq/dl4jMmwWv8yTZUKVIFn1yxUQ+9K87XuRcaENXRmxwevFZJV UXeSssAdN852p+k6Toj9G++mt1/MtuKte9BVFM6M3GYGon/9zGHwOnedGZpqeatXey BcfgcjdDo7mEYhDBvJMypMlojQvYB5INs1pu609BLuKLp/Pgrh0YVgdWHNITTXS0HB J3o2MLTc40vZBkM7fvKX6NoJ2FqF9R7Dy4uPQqmS3al9wEq/MM6bJg4aaZLNGPBZwN gqiYif61xgmQjUMCO5of3wxyBTpG4JdQ2CZ7qWZW4U2xfpuHmvBbT8fMtl261voaNH wfziJPKg8xB4g== Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-amd64@freebsd.org X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 17:00:44 -0000 Thank you Remy! Your recommendation solved the problem. Its been running for over a day now without a single hiccup. thanks also to everyone else who took time to respond with help and suggestions. At the risk of being a bother, were you able to get all four ethernet devices working? on mine, only the first two are working. the other two get errors on ioport allocation. em2: mem 0xfdbe0000-0xfdbfffff irq 61 at device 1.0 on pci8 em2: 0x40 bytes of rid 0x20 res 4 failed (0, 0xffffffffffffffff). em2: Unable to allocate bus resource: ioport em2: Allocation of PCI resources failed device_attach: em2 attach returned 6 em2: mem 0xfdbc0000-0xfdbdffff irq 62 at device 1.1 on pci8 em2: 0x40 bytes of rid 0x20 res 4 failed (0, 0xffffffffffffffff). em2: Unable to allocate bus resource: ioport em2: Allocation of PCI resources failed device_attach: em2 attach returned 6 ron. ----- Original Message ----- From: "Remy Nonnenmacher" To: rondzierwa@comcast.net, freebsd-amd64@freebsd.org Sent: Tuesday, March 17, 2015 4:39:33 AM Subject: Re: sun x4500 and smp Hi Ron, Fighted the same problem on mine. It seems to be a problem of interrupts dynamic routing on those old good opterons. I fixed it by sticking all interrupts to processor 0 (cpuset -l 0 -x ..). Since then, it works without any trouble. On 03/16/15 21:11, rondzierwa@comcast.net wrote: > I am using a sunfire x4500 (thumper) with a pair of dual-core opteron 290 processors, running 10.1-RELEASE to serve up zfs filesystems via nfs and samba. > > The system reboots periodically when under load. I cannot find anything in any of the system logs that would account for why it rebooted, it just goes away for a while and comes back in a few minutes. > > Out of desperation, I tried disabling all but one of the processors. (hint.lapic.x.disabled=1 where x == 1, 2 and 3). Oddly enough the system doesn't reboot anymore. > > Is there any known issues about SMP not working on a sunfire x4500? I have searched the mail archives and haven't found anything useful. > > thanks in advance for any help or suggestions. > ron. > > _______________________________________________ > freebsd-amd64@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-amd64 > To unsubscribe, send any mail to "freebsd-amd64-unsubscribe@freebsd.org" > From owner-freebsd-amd64@FreeBSD.ORG Fri Mar 20 17:15:13 2015 Return-Path: Delivered-To: freebsd-amd64@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3AD53672 for ; Fri, 20 Mar 2015 17:15:13 +0000 (UTC) Received: from fr-exchange.activnetworks.com (fr-exchange.activnetworks.com [62.210.235.130]) by mx1.freebsd.org (Postfix) with ESMTP id CDE43A9A for ; Fri, 20 Mar 2015 17:15:12 +0000 (UTC) Received: from rn.activnetworks.com ([192.168.1.100] RDNS failed) by fr-exchange.activnetworks.com with Microsoft SMTPSVC(6.0.3790.4675); Fri, 20 Mar 2015 17:56:28 +0100 Message-ID: <550C5599.3080308@activnetworks.com> Date: Fri, 20 Mar 2015 18:15:05 +0100 From: Remy Nonnenmacher User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: rondzierwa@comcast.net Subject: Re: sun x4500 and smp References: <1346086351.8355778.1426536687864.JavaMail.zimbra@comcast.net> <5507E845.40701@activnetworks.com> <1492043232.11922576.1426870841994.JavaMail.zimbra@comcast.net> In-Reply-To: <1492043232.11922576.1426870841994.JavaMail.zimbra@comcast.net> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-OriginalArrivalTime: 20 Mar 2015 16:56:28.0019 (UTC) FILETIME=[CEA32C30:01D0632E] Cc: freebsd-amd64@freebsd.org X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 17:15:13 -0000 On 03/20/15 18:00, rondzierwa@comcast.net wrote: > Thank you Remy! Your recommendation solved the problem. Its been > running for over a day now without a single hiccup. > > thanks also to everyone else who took time to respond with help and > suggestions. > > I also noticed after some experiencing that you may try to restrict the stickiness only to the 8 marvell chips and let the other relocate dynamically but I haven't completed all the tests so I keep bounding to cpu0. BTW, the solution was engraved on an old parchmail in the list and, as for you, it took me weeks to unearth it.... > > At the risk of being a bother, were you able to get all four ethernet > devices working? on mine, only the first two are working. the other > two get errors on ioport allocation. > I confirm only two over the four interfaces are usable. Have not looked farther. > em2: mem > 0xfdbe0000-0xfdbfffff irq 61 at device 1.0 on pci8 > em2: 0x40 bytes of rid 0x20 res 4 failed (0, 0xffffffffffffffff). > em2: Unable to allocate bus resource: ioport > em2: Allocation of PCI resources failed > device_attach: em2 attach returned 6 > em2: mem > 0xfdbc0000-0xfdbdffff irq 62 at device 1.1 on pci8 > em2: 0x40 bytes of rid 0x20 res 4 failed (0, 0xffffffffffffffff). > em2: Unable to allocate bus resource: ioport > em2: Allocation of PCI resources failed > device_attach: em2 attach returned 6 > > > ron. > > > ------------------------------------------------------------------------ > *From: *"Remy Nonnenmacher" > *To: *rondzierwa@comcast.net, freebsd-amd64@freebsd.org > *Sent: *Tuesday, March 17, 2015 4:39:33 AM > *Subject: *Re: sun x4500 and smp > > Hi Ron, > > Fighted the same problem on mine. It seems to be a problem of interrupts > dynamic routing on those old good opterons. > > I fixed it by sticking all interrupts to processor 0 (cpuset -l 0 -x > ..). Since then, it works without any trouble. > > > On 03/16/15 21:11, rondzierwa@comcast.net wrote: > > I am using a sunfire x4500 (thumper) with a pair of dual-core opteron > 290 processors, running 10.1-RELEASE to serve up zfs filesystems via nfs > and samba. > > > > The system reboots periodically when under load. I cannot find > anything in any of the system logs that would account for why it > rebooted, it just goes away for a while and comes back in a few minutes. > > > > Out of desperation, I tried disabling all but one of the processors. > (hint.lapic.x.disabled=1 where x == 1, 2 and 3). Oddly enough the system > doesn't reboot anymore. > > > > Is there any known issues about SMP not working on a sunfire x4500? I > have searched the mail archives and haven't found anything useful. > > > > thanks in advance for any help or suggestions. > > ron. > > > > _______________________________________________ > > freebsd-amd64@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-amd64 > > To unsubscribe, send any mail to "freebsd-amd64-unsubscribe@freebsd.org" > > >