From owner-freebsd-cloud@freebsd.org Wed Nov 8 00:47:31 2017 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59B63E692AB for ; Wed, 8 Nov 2017 00:47:31 +0000 (UTC) (envelope-from 0100015f991887de-8d9baeb9-0182-435d-876c-3c3863b05ac5-000000@amazonses.com) Received: from a8-237.smtp-out.amazonses.com (a8-237.smtp-out.amazonses.com [54.240.8.237]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 20B377C5EF for ; Wed, 8 Nov 2017 00:47:30 +0000 (UTC) (envelope-from 0100015f991887de-8d9baeb9-0182-435d-876c-3c3863b05ac5-000000@amazonses.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=ae7m2yrxjw65l2cqdpjxuucyrvy564tn; d=tarsnap.com; t=1510102043; h=Subject:To:References:Cc:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; bh=r+42T5mwdWpKbXGwzQhozxJ3FHIZhhF9QqvIANEzuD8=; b=ILyhF5rfDtkyQblCPSYsubgydiTwUJ9k0Kmd47cxkVTnKsEeBrDEa4qROAIEEg5n 3ayj9qcaHV4j0vUS54/asR/IhhNh0R6hooQP9E6W01a80A82DCI90JYnYCazQ09gSju 0ouGrDNnWL6hauE+LkUp74lT05YVLQ/EHcVbbtTI= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=224i4yxa5dv7c2xz3womw6peuasteono; d=amazonses.com; t=1510102043; h=Subject:To:References:Cc:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding:Feedback-ID; bh=r+42T5mwdWpKbXGwzQhozxJ3FHIZhhF9QqvIANEzuD8=; b=gcdQnLQ2dUhqT1g4UBviN6jXj8JSCkih/RH55DdYrAcRWT4eb9e6lQaXYVbN2hq/ lLmbbrDs0PZtApfTtuIZFUBjw7CvgvWJo3xbvJ0TYsWFDnKeH/rWPcqEI4PlBjqMfCB yFuF6G0oH5u9d/JUChnu8AsHx0N7nS7Sg8f8Q6k0= Subject: Re: AWS c5.class unsupported? To: Rafal Lukawiecki , Pete Wright References: <22772d45-812b-4592-87b7-7e9bafcc86f7@email.android.com> <53A5CAA0-B37C-4BAE-A42A-338C04D9612E@rafal.net> Cc: freebsd-cloud@freebsd.org From: Colin Percival Message-ID: <0100015f991887de-8d9baeb9-0182-435d-876c-3c3863b05ac5-000000@email.amazonses.com> Date: Wed, 8 Nov 2017 00:47:23 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 In-Reply-To: <53A5CAA0-B37C-4BAE-A42A-338C04D9612E@rafal.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-SES-Outgoing: 2017.11.08-54.240.8.237 Feedback-ID: 1.us-east-1.Lv9FVjaNvvR5llaqfLoOVbo2VxOELl7cjN0AOyXnPlk=:AmazonSES X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Nov 2017 00:47:31 -0000 On 11/07/17 16:38, Rafal Lukawiecki wrote: > Ah, that explains the reason I have been seeing failed instance launches. Metadata (user-data) scripts have been occasionally *not* running when the cloudconfig run. Actually no -- the problem I'm aware of has nothing to do with user-data scripts and should not affect instance launching. I wouldn't be surprised if some instance launches are failing due to capacity issues though -- EC2 often has such problems when they launch a new instance family. The problem I'm tracking with C5 relates to disk hotplug: If you add an EBS volume, FreeBSD will not notice it until you run 'devctl rescan pci0', and if you remove an EBS volume FreeBSD will panic. Warner is working on fixing the "hotunplug" path in the nvme driver in order to correct the panic; we were hoping to have it fixed in HEAD before C5 was launched, but I thought we had a few weeks left. If you have a good test case for user-data script problems, please let me know (off-list). Given how much new hardware and software there is in the C5 instances I wouldn't be surprised if there are a few bugs lurking, and I'm sure my contacts at EC2 will be happy to receive reports. (FWIW, C5 not being available in the Marketplace images is probably just a case of the Marketplace taking a while to get up to speed; I marked those images as "make these available on all new instances". But I'll probably go in and disable C5 for now due to the disk attach/detach issues.) -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid