From owner-freebsd-bugs@freebsd.org Mon Sep 9 12:25:54 2019 Return-Path: Delivered-To: freebsd-bugs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E2110D0713 for ; Mon, 9 Sep 2019 12:25:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 46RnSf5dF5z3QSx for ; Mon, 9 Sep 2019 12:25:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C11DDD0712; Mon, 9 Sep 2019 12:25:54 +0000 (UTC) Delivered-To: bugs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C0E18D0711 for ; Mon, 9 Sep 2019 12:25:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46RnSf4kprz3QSw for ; Mon, 9 Sep 2019 12:25:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7ABF2D8DF for ; Mon, 9 Sep 2019 12:25:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x89CPsC1032569 for ; Mon, 9 Sep 2019 12:25:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x89CPsIp032568 for bugs@FreeBSD.org; Mon, 9 Sep 2019 12:25:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 240442] Upgrade from 11Stable to 12Stable - dying jail requires host reboot Date: Mon, 09 Sep 2019 12:25:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: dewaynegeraghty@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Sep 2019 12:25:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D240442 Bug ID: 240442 Summary: Upgrade from 11Stable to 12Stable - dying jail requires host reboot Product: Base System Version: 12.0-STABLE Hardware: amd64 OS: Any Status: New Severity: Affects Some People Priority: --- Component: bin Assignee: bugs@FreeBSD.org Reporter: dewaynegeraghty@gmail.com Environment: amd64 on Xeon board. Long running 11.3Stable updated to 12Stab= le ~# uname -a FreeBSD hathor 12.0-STABLE FreeBSD 12.0-STABLE #0 r351834M: Sat Sep 7 17:2= 0:37 AEST 2019=20=20=20=20 root@hathor:/usr/obj/prod/120101/D/K8/smallblocks/src/amd64.amd64/sys/hqdev= -amd64-smp-vga amd64 Prior to the upgrade to 12Stable we built and tested 11.3Stable the day pri= or, everything was ok; only a few additions to the kernel config were applied (= eg MAC_NTPD), otherwise unchanged. Summary: System is regularly updated from svnlite source (every 4-6 weeks) throughout the 11. series. The system was updated to 12Stable over the weekend. The system comprises multiple jailed environments including two i386 and a couple of amd64 jails. The i386 jails have a common base. Everything was working, until, the upgra= de: Start jails - ok.=20=20 Stop jails - ok. Restart jails - not ok. Further testing all (i386 and amd64)'s are caught = in a dying state. Host reboot required. Details The test machine is quite dated and we used exec.poststop=3D"umount -aF /etc/fstab.$name; umount $path/dev"; which, subsequent to reading Jamie's r349180 (that test is later) the probl= em remains We'll stop and start the jail, the jail.conf was slightly modified between tests. # jail -vr b3 b3: run command in jail: /bin/sh /etc/rc.shutdown b3: sent SIGTERM to: 1026 b3: removed b3: run command: /bin/sh -c umount -aF /etc/fstab.b3; umount /usr/jails/b3/= dev jail: b3: mount.devfs: /usr/jails/b3/dev: not a mount point jail: b3: mount.fstab: /usr/jails/b3/pd/pd1: not a mount point jail: b3: mount.fstab: /usr/jails/b3/var/squid: not a mount point jail: b3: mount.fstab: /usr/jails/b3/var/mailctl: not a mount point jail: b3: mount.fstab: /usr/jails/b3/var/maildir: not a mount point jail: b3: mount.fstab: /usr/jails/b3/fifo: not a mount point jail: b3: mount.fstab: /usr/jails/b3/tmp: not a mount point jail: b3: mount.fstab: /usr/jails/b3/usr/ports: not a mount point jail: b3: mount.fstab: /usr/jails/b3/distfiles: not a mount point jail: b3: mount.fstab: /usr/jails/b3/packages: not a mount point jail: b3: mount.fstab: /usr/jails/b3/bj: not a mount point Rerun of jail removal after deleting the following historical workaround fr= om jail.conf exec.poststop=3D"umount -aF /etc/fstab.$name; umount $path/dev"; ~# jail -vr b3 b3: run command in jail: /bin/sh /etc/rc.shutdown b3: sent SIGTERM to: 26278 b3: removed b3: run command: /sbin/umount /usr/jails/b3/dev b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/pd/pd1 b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/var/squid b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/var/mailctl b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/var/maildir b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/fifo b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/tmp b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/usr/ports b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/distfiles b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/packages b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/bj Now to (attempt to) restart the jail # jail -vc b3 b3: run command: /sbin/mount -t nullfs -o rw /usr/jails/bj1 /usr/jails/b3/bj b3: run command: /sbin/mount -t nullfs -o ro /pd9/packages /usr/jails/b3/packages b3: run command: /sbin/mount -t nullfs -o ro /pd9/usr/distfiles /usr/jails/b3/distfiles b3: run command: /sbin/mount -t nullfs -o ro /usr/ports /usr/jails/b3/usr/p= orts b3: run command: /sbin/mount -t nullfs -o rw,noatime /tmp/b3 /usr/jails/b3/= tmp b3: run command: /sbin/mount -t nullfs -o rw,noatime /m/b3/fifo /usr/jails/b3/fifo b3: run command: /sbin/mount -t nullfs -o rw,noatime /pd6/mail/maildir /usr/jails/b3/var/maildir b3: run command: /sbin/mount -t nullfs -o rw /pd6/mail/mailctl /usr/jails/b3/var/mailctl b3: run command: /sbin/mount -t nullfs -o rw,noatime /pd6/squid /usr/jails/b3/var/squid b3: run command: /sbin/mount -t nullfs -o rw,noatime /pd1 /usr/jails/b3/pd/= pd1 b3: run command: /sbin/mount -t devfs -oruleset=3D6 . /usr/jails/b3/dev b3: jail_set(JAIL_CREATE) name=3Db3 host.hostname=3Db3.hs path=3D/usr/jails= /b3 children.max=3D0 securelevel=3D3 enforce_statfs=3D1 jid=3D3 persist ip4.addr=3D10.0.7.91,10.0.5.91,127.0.5.91 devfs_ruleset=3D6 sysvmsg=3Dnew s= ysvsem=3Dnew sysvshm=3Dnew allow.raw_sockets allow.chflags host.hostuuid=3D00000000-0000-0000-0003-000000000003 host.hostid=3D3: File = exists jail: b3: jail 3 already exists b3: run command: /sbin/umount /usr/jails/b3/dev b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/pd/pd1 b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/var/squid b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/var/mailctl b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/var/maildir b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/fifo b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/tmp b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/usr/ports b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/distfiles b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/packages b3: run command: /sbin/umount -ft nullfs /usr/jails/b3/bj ~# Can anyone reproduce by upgrading from 11Stable to 12Stable from source? --=20 You are receiving this mail because: You are the assignee for the bug.=