From owner-freebsd-hackers@freebsd.org Tue Apr 2 20:10:31 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0EE3D1572060 for ; Tue, 2 Apr 2019 20:10:31 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from webmail5.jnielsen.net (webmail5.jnielsen.net [69.87.218.172]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "webmail2.jnielsen.net", Issuer "freebsdsolutions.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id DFDFD75E15 for ; Tue, 2 Apr 2019 20:10:27 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from [10.3.135.14] (50-207-240-162-static.hfc.comcastbusiness.net [50.207.240.162]) (authenticated bits=0) by webmail5.jnielsen.net (8.15.2/8.15.2) with ESMTPSA id x32JvxNA048529 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Tue, 2 Apr 2019 13:58:02 -0600 (MDT) (envelope-from lists@jnielsen.net) X-Authentication-Warning: webmail5.jnielsen.net: Host 50-207-240-162-static.hfc.comcastbusiness.net [50.207.240.162] claimed to be [10.3.135.14] From: John Nielsen Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: online resizing NVME drives? Message-Id: <8F7034DD-AA3A-44DF-86D2-34FB6BF60FD7@jnielsen.net> Date: Tue, 2 Apr 2019 13:57:58 -0600 To: freebsd-hackers@freebsd.org X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: DFDFD75E15 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of lists@jnielsen.net designates 69.87.218.172 as permitted sender) smtp.mailfrom=lists@jnielsen.net X-Spamd-Result: default: False [-1.30 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.97)[-0.966,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.85)[-0.854,0]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MX_GOOD(-0.01)[mx0.freebsdsolutions.net,mx1.freebsdsolutions.net,mx2.freebsdsolutions.net,mx3.freebsdsolutions.net]; NEURAL_HAM_SHORT(-0.70)[-0.698,0]; TO_DN_NONE(0.00)[]; IP_SCORE(0.03)[asn: 6364(0.19), country: US(-0.06)]; DMARC_NA(0.00)[jnielsen.net]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:6364, ipnet:69.87.218.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Apr 2019 20:10:31 -0000 Hi all- Obviously this wouldn't make sense for physical NVME hardware, but when = running on e.g. bhyve or AWS EC2 it's nice to be able to resize volumes = and filesystems without needing to reboot the (virtual) system. I'm = pretty sure that's do-able with SCSI, AHCI SATA and virtio-block devices = but I don't see a way to do it with NVME. Am I missing something or do = we need to implement something along the lines of "nvmecontrol rescan"? I'm experimenting with FreeBSD 12.0-RELEASE on a c5n.large AWS ec2 = instance. Like most (all?) of the c5 instance types the disks are all = presented as NVME devices even if they are actually backed by EBS. I = started one instance with a 10GB root volume but then decided I wanted = to make it bigger. I grew the volume on the AWS side no problem. When I = did so I got this kernel message: nvme0: async event occurred (type 0x2, info 0x00, page 0x00) Thereafter running "nvmecontrol devlist" correctly showed the increased = size of the parent device: # nvmecontrol devlist nvme0: Amazon Elastic Block Store nvme0ns1 (25600MB) However I couldn't see a way to update the size of the nvd0 block device = without rebooting. Pointers appreciated. Thanks! JN