From owner-freebsd-stable@FreeBSD.ORG Wed Apr 11 17:00:22 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 09B9C106566C for ; Wed, 11 Apr 2012 17:00:21 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id 63ED88FC0C for ; Wed, 11 Apr 2012 17:00:21 +0000 (UTC) Received: by lbbgj3 with SMTP id gj3so1137793lbb.13 for ; Wed, 11 Apr 2012 10:00:19 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:in-reply-to:references:date :message-id:subject:from:to:content-type:content-transfer-encoding :x-gm-message-state; bh=Ot622ZFixG6HFt34ND7F59HnqL+h/NA16UWJnzKEsXs=; b=TS25hjSW28+yPRy0IfALqRzwFaiie4vynEVGa9+6b3Y4Lbv+UUPkXthWAWqyKTqceO vJ7gvoCoUeAbl5GJHzScFZU3BsjupLO+5tIADT1eLmXdZPmIUBJLR1kJlI/CHvMD7VJl G9sFpV47xLwFDzS1CsmPZ/Sm+cyM61t3erCadJzkZp2JMnVGRtzR6HD5cLflOoftr9yf oyzjhbM2fDsLxV13ZGAvZEUrWZCznTZoh8HFqnZR/dndKpLpmCzX9fq7VeScWfvzq0Lq btYJyxtxq5bj1pjrYIewwEJLgrewRNkHdgGvCDKuGBeOOF+19TcRmqo3W9eRn+9QTx3P ZaoA== MIME-Version: 1.0 Received: by 10.112.26.73 with SMTP id j9mr3285338lbg.21.1334163619385; Wed, 11 Apr 2012 10:00:19 -0700 (PDT) Received: by 10.112.54.41 with HTTP; Wed, 11 Apr 2012 10:00:19 -0700 (PDT) X-Originating-IP: [209.66.78.50] In-Reply-To: References: Date: Wed, 11 Apr 2012 13:00:19 -0400 Message-ID: From: Mark Saad To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQkimtSUoXbeSJAxAu2M64U6Gk0DKUOkYrL+MPMrYgD58SGoN995SNLhN3q/pNM83sJSs68l Subject: Re: Panic after converting Softupdates to journaled softupdates X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Apr 2012 17:00:22 -0000 On Wed, Apr 11, 2012 at 11:20 AM, Mark Saad wrote: > Hell All > =C2=A0I wanted to share this with you before sending a pr . I did not fin= d > anything that matched it and I wanted to see if I did something wrong > procedurally . > > I upgraded a 7.4-RELEASE amd64 box to 9.0-STABLE sources from > yesterday 10 Apr 2012. > > Every thing worked well. I was able to boot and run off 9.0-STABLE my > apps worked ; So I wanted to =C2=A0swap out soft updates for journaed sof= t > updates. > > The box used 3 UFS slices that were glabled. Note root and var had > softupdates but > /usr/local/mysql/data did not > > > # Device =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Mountpoin= t =C2=A0 =C2=A0 =C2=A0FStype =C2=A0Options =C2=A0 =C2=A0 =C2=A0 =C2=A0 Dump= =C2=A0 =C2=A0Pass# > /dev/label/rootfs =C2=A0 =C2=A0 =C2=A0 / =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 ufs =C2=A0 =C2=A0 rw =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A01 =C2=A0 =C2=A0 =C2=A0 1 > /dev/label/var =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0/var =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0ufs =C2=A0 =C2=A0 rw =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A02 =C2=A0 =C2=A0 =C2=A0 2 > /dev/label/SWAP =C2=A0 =C2=A0 =C2=A0 =C2=A0 none =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0swap =C2=A0 =C2=A0sw =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 0 > /dev/label/data =C2=A0 =C2=A0 =C2=A0 =C2=A0 /usr/local/mysql/data =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 ufs =C2=A0 =C2=A0 rw > =C2=A0 =C2=A0 =C2=A0 =C2=A0 2 =C2=A0 =C2=A0 =C2=A0 2 > > > Here is what I did to convert them. > > --------- > > # tunefs -n disable / > tunefs: soft updates cleared > tunefs: file system reloaded > # tunefs -n disable /var > tunefs: soft updates cleared > # fsck -y / > ** /dev/label/rootfs > ** Last Mounted on / > ** Root file system > ** Phase 1 - Check Blocks and Sizes > ** Phase 2 - Check Pathnames > ** Phase 3 - Check Connectivity > ** Phase 4 - Check Reference Counts > ** Phase 5 - Check Cyl groups > 271768 files, 4336411 used, 59997908 free (136692 frags, 7482652 > blocks, 0.2% fragmentation) > > ***** FILE SYSTEM IS CLEAN ***** > # fsck -y /var > ** /dev/label/var > ** Last Mounted on /var > ** Phase 1 - Check Blocks and Sizes > ** Phase 2 - Check Pathnames > ** Phase 3 - Check Connectivity > ** Phase 4 - Check Reference Counts > ** Phase 5 - Check Cyl groups > 24792 files, 141287 used, 3919776 free (1232 frags, 489818 blocks, > 0.0% fragmentation) > > ***** FILE SYSTEM IS CLEAN ***** > > # fsck -y /usr/local/mysql/data > ** /dev/label/data > ** Last Mounted on /usr/local/mysql/data > ** Phase 1 - Check Blocks and Sizes > ** Phase 2 - Check Pathnames > ** Phase 3 - Check Connectivity > ** Phase 4 - Check Reference Counts > ** Phase 5 - Check Cyl groups > 89528 files, 18246873 used, 51166840 free (59080 frags, 6388470 > blocks, 0.1% fragmentation) > > ***** FILE SYSTEM IS CLEAN ***** > > # tunefs -j enable / > Using inode 7 in cg 0 for 33554432 byte journal > tunefs: soft updates journaling set > tunefs: file system reloaded > # tunefs -j enable /var > Using inode 4 in cg 0 for 33554432 byte journal > tunefs: soft updates journaling set > # tunefs -j enable /usr/local/mysql/data > Using inode 425 in cg 0 for 33554432 byte journal > tunefs: soft updates journaling set > # reboot > Apr 11 11:08:58 init: single user shell terminated. > Waiting (max 60 seconds) for system process `vnlru' to stop...done > Waiting (max 60 seconds) for system process `bufdaemon' to stop...done > Waiting (max 60 seconds) for system process `syncer' to stop... > Syncing disks, vnodes remaining...0 0 0 0 0 0 0 0 0 0 done > All buffers synced. > panic: /: ffs_sync: modification on read-only filesystem > cpuid =3D 0 > KDB: stack backtrace: > #0 0xffffffff808c283e at kdb_backtrace+0x5e > #1 0xffffffff8088d017 at panic+0x187 > #2 0xffffffff80abc51d at ffs_sync+0x50d > #3 0xffffffff809303e1 at vfs_write_suspend+0x111 > #4 0xffffffff80abcbd8 at ffs_unmount+0x3f8 > #5 0xffffffff8091b2ce at dounmount+0x26e > #6 0xffffffff80921ea2 at vfs_unmountall+0x42 > #7 0xffffffff8088ce30 at kern_reboot+0x7a0 > #8 0xffffffff8088d19c at sys_reboot+0x6c > #9 0xffffffff80b77260 at amd64_syscall+0x500 > #10 0xffffffff80b62257 at Xfast_syscall+0xf7 > Uptime: 6m38s > Automatic reboot in 15 seconds - press a key on the console to abort > > > Now the box locked up hard and It would not reboot automatically. > > I am waiting to see if I can get a coredump after it comes back up. I > have walk over an kick it over manually now. > > So does anyone have any insight into what happened here ? > > -- > mark saad | nonesuch@longcount.org short follow up , savecore did not work no dump was saved to swap. Also there was no apparent impact from this crash other then the need to power cycle the box. So far su+j appears to be working. I will stress the disks a bit more and pull the power to see if it actually works later. --=20 mark saad | nonesuch@longcount.org