From owner-freebsd-stable@freebsd.org Wed Apr 25 13:39:10 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0A860FA6597 for ; Wed, 25 Apr 2018 13:39:10 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [IPv6:2607:f3e0:80:80::2]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 82C6669475; Wed, 25 Apr 2018 13:39:09 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (lava.sentex.ca [IPv6:2607:f3e0:0:5::11]) by smarthost2.sentex.ca (8.15.2/8.15.2) with ESMTPS id w3PDd8Wi043700 (version=TLSv1 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Wed, 25 Apr 2018 09:39:08 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [192.168.43.26] (saphire3.sentex.ca [192.168.43.26]) by lava.sentex.ca (8.15.2/8.15.2) with ESMTP id w3PDd6if065703; Wed, 25 Apr 2018 09:39:06 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: Ryzen issues on FreeBSD ? (with sort of workaround) To: Don Lewis Cc: Pete French , nimrodl@gmail.com, eric@vangyzen.net, freebsd-stable@freebsd.org, freebsd@hda3.com, avg@freebsd.org References: <59b435cf-f4fb-0cc8-3bd0-0765ac0592da@sentex.net> <84898b9f-991c-420a-3ebd-f8c4ad9915e1@ingresso.co.uk> From: Mike Tancsa Openpgp: preference=signencrypt Organization: Sentex Communications Message-ID: <3bb5fef2-381c-8e1b-21dc-6b8687fb6c1e@sentex.net> Date: Wed, 25 Apr 2018 09:39:06 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.78 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2018 13:39:10 -0000 On 4/24/2018 8:04 PM, Don Lewis wrote: >> >> I was able to lock it up with vbox. bhyve was just a little easier to >> script and also I figured would be good to get VBox out of the mix in >> case it was something specific to VBox. I dont recall if I tried it >> with SMT disabled. Regardless, on Intel based systems I ran these tests >> for 72hrs straight without issue. I can sort of believe hardware issue >> or flaky motherboard BIOSes (2 ASUS MBs, 1 MSI MB, 3 Ryzen chips), but >> the fact that two server class MBs from SuperMicro along with an Epyc >> chip also does the same thing makes me think something specific to >> FreeBSD and this class of AMD CPU :( > > It would be interesting to test other AMD CPUs. I think AMD and Intel > have some differences in the virtualization implementations. I dont have any Opterons handy unfortunately. However, I have a feeling its not so much due to virtualization, as I am pretty sure I had a crash when I wasnt doing any VM testing as well. Peter Grehan speculated it might have something to do with a lot of IPIs being generated. Are there any non VM workloads that will generate many IPIs ? ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 x203 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada