From owner-freebsd-stable@freebsd.org Wed Feb 8 15:27:02 2017 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 42B75CD6A1F for ; Wed, 8 Feb 2017 15:27:02 +0000 (UTC) (envelope-from thenomad@gmail.com) Received: from mail-pf0-x230.google.com (mail-pf0-x230.google.com [IPv6:2607:f8b0:400e:c00::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 11B801D8A for ; Wed, 8 Feb 2017 15:27:02 +0000 (UTC) (envelope-from thenomad@gmail.com) Received: by mail-pf0-x230.google.com with SMTP id y143so43087752pfb.0 for ; Wed, 08 Feb 2017 07:27:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=aPvcwXfZSpH6dcSQHtVUWNzuMWJqueTvEpwSxPb/tW0=; b=lEkzIi70xxTFeS2RpFhRqUb+zcir6VeyeVVy7o+f6MbSfv9sGXxoIW0Joxu8tCCSLf MkbYXU31dstJtH7fFkcqk8wDGtFu3EeZA1aItNhehn6Ikn2LwYIVTMKJ9p5fHmIdNj88 wv+AbPQsaV/tgjfjvn9WGCSDSt3iszSx8iLQXyK0n5QOHpxHG5xjHrYvjRYKceV3FED1 kL+M38kjIhr2Am0jpIaT5ogBlGvOkLrrH++nn+FSFSuMnEtlqZ0POBHYO2p+Nr0EUcUd xOZvka6exvoRsSjTElGei9b1ZbQhHuzpCIL8l8yP2LDwi6Z+Lg2mNArhy6J8YBvwsTsm utYg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=aPvcwXfZSpH6dcSQHtVUWNzuMWJqueTvEpwSxPb/tW0=; b=lE4d36S0tddBUnVl/7swaQbyvYemp0GFTLLR4J4+3pQJ41dEhbRKUiLlZ9juBL2Fb0 YAVgCxUKF2jlLuOqlRB0Cg8o3hd4ilVEyffcPaMPrP/NqOq3/W7jfNy+n31wkB1J2hqx oiSvCy5qsxBj7srobZs7cb4w3wc6BvSoMei4Qcju8V+v4ZUEpYx2G+p9AK8jsLdUvN9X zmVGcKItVPJ0HcUDVL+A2Orn2+eEJ5sXeahp9uuEYjjXsV/XRXK5u8kZbnhjVG5lP3fH /btc0n2tgyDlB2lYofZgW3AImjsgrSAnGmnCIrH5tGLFJjZlpX7qXAYQ3W1zSGMQA9LF aPNA== X-Gm-Message-State: AIkVDXLh2rDIy8KnklhtM3vYx8X9ajn/4FnjFjLFvRcxOf9lDOwuCa+M84eStJovLq0d2w== X-Received: by 10.99.123.68 with SMTP id k4mr27846555pgn.101.1486567620851; Wed, 08 Feb 2017 07:27:00 -0800 (PST) Received: from vanyel.castle.org (castle.org. [216.161.253.119]) by smtp.gmail.com with ESMTPSA id i10sm21354928pgd.37.2017.02.08.07.26.57 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 08 Feb 2017 07:26:58 -0800 (PST) Sender: Lee Damon Subject: Re: FBSD 10.3 + ZFS + Sun x4500 = utter lock up. To: Ronald Klop , freebsd-stable@freebsd.org References: <44ecebcb-fb48-d828-7f08-47a981b732d2@castle.org> From: Lee Damon Message-ID: <38e07a28-8a46-12fc-377f-cca225681a6f@castle.org> Date: Wed, 8 Feb 2017 07:26:56 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 15:27:02 -0000 On 2/8/17 05:53 , Ronald Klop wrote: > ... > Any reason not to try 11? I don't know if it fixes anything, but it > would be a nice data point for comparison. I'll probably give that a try shortly but given the problem was seen in previous releases I'm not optimistic. I'm only in that location on Monday and Tuesday so can't try anything until next week. > Ronald. > > > On Tue, 07 Feb 2017 22:44:01 +0100, Lee Damon wrote: > >> FreeBSD [redacted] 10.3-STABLE FreeBSD 10.3-STABLE #2 r313008: Tue Jan >> 31 01:50:49 PST 2017 lvd@[redacted]:/usr/obj/usr/src/sys/GENERIC >> amd64 >> >> I'm trying to get FBSD 10.3 working on a Sun x4500 (don't ask) for use >> as a ZFS-based backup server. However, whenever any amount of data is >> put into a zpool and then zpool scrub is run the host locks up hard. On >> reboot it complains that a "Hyper transport sync flood occurred". >> >> I found >> https://lists.freebsd.org/pipermail/freebsd-stable/2012-January/065542.html >> >> which seems to match but when I try the cpuset command mentioned there I >> get an error: >> >> ; sudo cpuset -c -l 0 -x 58 >> cpuset: setaffinity: Invalid argument >> >> Looks like the -c was invalid. After removing that I was informed -x 58 >> wasn't valid. Sure enough, there's no mpt0 or IRQ 58 on the host: >> >> ; vmstat -i >> interrupt total rate >> irq17: ohci2 8578 2 >> irq18: ohci3 473 0 >> irq19: ohci0 ohci1+ 4924 1 >> irq24: mvs0 457 0 >> irq32: mvs1 453 0 >> irq38: mvs2 451 0 >> irq46: mvs3 8063 1 >> irq52: em0 152354 35 >> irq53: em1 140 0 >> irq68: mvs4 450 0 >> irq76: mvs5 454 0 >> cpu0:timer 208311 48 >> cpu1:timer 98318 23 >> cpu2:timer 105704 24 >> cpu3:timer 106202 24 >> Total 695332 162 >> >> Looking around with some help from #freebsd on efnet I found mvs0-5 >> which are connected to the Marvel drive controllers on the host. I then >> used >> ; sudo cpuset -l 0 -x ## >> where I replaced ## with 24, 32, 38, 46, 68, and 76. >> >> After rebuilding the zpool I started writing to it. It took a lot less >> time to crash - I didn't even need to run zpool scrub - but instead of >> completely locking up it just rebooted. I did not see reference to the >> hyper transport problem while watching it boot but given the poor >> performance of the serial console I can't be 100% sure it wasn't there. >> >> So now I turn here to ask for guidance. Is anyone currently successfully >> running 10.x on a x4500 and if so, how are you doing it? If not, how can >> I get this working? >> >> thanks, >> nomad >> _______________________________________________ >> freebsd-stable@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"