From owner-freebsd-hardware@FreeBSD.ORG Wed Aug 8 10:28:51 2012 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2B2741065670 for ; Wed, 8 Aug 2012 10:28:51 +0000 (UTC) (envelope-from gkontos.mail@gmail.com) Received: from mail-vc0-f182.google.com (mail-vc0-f182.google.com [209.85.220.182]) by mx1.freebsd.org (Postfix) with ESMTP id D46748FC12 for ; Wed, 8 Aug 2012 10:28:50 +0000 (UTC) Received: by vcbgb22 with SMTP id gb22so708331vcb.13 for ; Wed, 08 Aug 2012 03:28:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=ITVSNVh6w2jAMklejbRmFJfxo3+YPZIkS/g7NwptDAI=; b=e1COqBPA7PYHW1KhYxXJpkdaWvATa8g1qgCQANt3jwRX0FI/2nmzCyqkpKlKNCGRHw xDq7JvwsVBxoOCo7/uZT62P4T0NErodv0MU19PABFJ5Xk+Hzhbnp4PmhYOInSSRio36L ZxN/VRg6UQ5Xmk/7S6obPD0izRsy/2lJ8wV549paBgpb/AMQEZftY8G/0ABMuq280Pp6 D0aryljV2eaiTC3nar8HtWO7mVxMMP2aQShHcZLk+NZeifIRRkB6U+8v9npoupXjiDgc W0j8IkjObWNOKfw5NYSs9Q1RoosNr3LrnsWCEy7qGOzRAwW8ZdI4PKE2Cd0X+BexL8cQ JKmg== MIME-Version: 1.0 Received: by 10.220.152.67 with SMTP id f3mr13534462vcw.19.1344421728834; Wed, 08 Aug 2012 03:28:48 -0700 (PDT) Received: by 10.220.87.85 with HTTP; Wed, 8 Aug 2012 03:28:48 -0700 (PDT) In-Reply-To: References: Date: Wed, 8 Aug 2012 13:28:48 +0300 Message-ID: From: George Kontostanos To: freebsd-hardware@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Subject: LSI 9240-4i 4K alignment X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Aug 2012 10:28:51 -0000 Hi all, We have a server with a LSI 9240-4i controller configured in JBOD with 4 SATA disks. Running FreeBSD 9.1-Beta1: Relevant dmesg: FreeBSD 9.1-BETA1 #0: Thu Jul 12 09:38:51 UTC 2012 root@farrell.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 CPU: Intel(R) Xeon(R) CPU E31230 @ 3.20GHz (3200.09-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206a7 Family = 6 Model = 2a Stepping = 7 Features=0xbfebfbff Features2=0x1fbae3ff AMD Features=0x28100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 17179869184 (16384 MB) avail memory = 16471670784 (15708 MB) ... mfi0: port 0xe000-0xe0ff mem 0xf7a60000-0xf7a63fff,0xf7a00000-0xf7a3ffff irq 16 at device 0.0 on pci1 mfi0: Using MSI mfi0: Megaraid SAS driver Ver 4.23 ... mfi0: 321 (397672301s/0x0020/info) - Shutdown command received from host mfi0: 322 (boot + 3s/0x0020/info) - Firmware initialization started (PCI ID 0073/1000/9241/1000) mfi0: 323 (boot + 3s/0x0020/info) - Firmware version 2.130.354-1664 mfi0: 324 (boot + 3s/0x0020/info) - Firmware initialization started (PCI ID 0073/1000/9241/1000) mfi0: 325 (boot + 3s/0x0020/info) - Firmware version 2.130.354-1664 mfi0: 326 (boot + 5s/0x0020/info) - Package version 20.10.1-0107 mfi0: 327 (boot + 5s/0x0020/info) - Board Revision 03A mfi0: 328 (boot + 25s/0x0002/info) - Inserted: PD 04(e0xff/s3) ... mfisyspd0 on mfi0 mfisyspd0: 1907729MB (3907029168 sectors) SYSPD volume mfisyspd0: SYSPD volume attached mfisyspd1 on mfi0 mfisyspd1: 1907729MB (3907029168 sectors) SYSPD volume mfisyspd1: SYSPD volume attached mfisyspd2 on mfi0 mfisyspd2: 1907729MB (3907029168 sectors) SYSPD volume mfisyspd2: SYSPD volume attached mfisyspd3 on mfi0 mfisyspd3: 1907729MB (3907029168 sectors) SYSPD volume mfisyspd3: SYSPD volume attached ... mfi0: 329 (boot + 25s/0x0002/info) - Inserted: PD 04(e0xff/s3) Info: enclPd=ffff, scsiType=0, portMap=00, sasAddr=4433221100000000,0000000000000000 mfi0: 330 (boot + 25s/0x0002/info) - Inserted: PD 05(e0xff/s1) mfi0: 331 (boot + 25s/0x0002/info) - Inserted: PD 05(e0xff/s1) Info: enclPd=ffff, scsiType=0, portMap=02, sasAddr=4433221102000000,0000000000000000 mfi0: 332 (boot + 25s/0x0002/info) - Inserted: PD 06(e0xff/s2) mfi0: 333 (boot + 25s/0x0002/info) - Inserted: PD 06(e0xff/s2) Info: enclPd=ffff, scsiType=0, portMap=03, sasAddr=4433221101000000,0000000000000000 mfi0: 334 (boot + 25s/0x0002/info) - Inserted: PD 07(e0xff/s0) mfi0: 335 (boot + 25s/0x0002/info) - Inserted: PD 07(e0xff/s0) Info: enclPd=ffff, scsiType=0, portMap=01, sasAddr=4433221103000000,0000000000000000 mfi0: 336 (397672376s/0x0020/info) - Time established as 08/07/12 16:32:56; (28 seconds since power on) The problem: When trying to create a RaidZ pool using gpart and perform a 4K alignment using gnop, we get the follwoing error immediately after exporting the pool and destroying the .nop devices: id: 8043746387654554958 state: FAULTED status: One or more devices contains corrupted data. action: The pool cannot be imported due to damaged devices or data. The pool may be active on another system, but can be imported using the '-f' flag. see: http://illumos.org/msg/ZFS-8000-5E config: Pool FAULTED corrupted data raidz1-0 ONLINE 13283347160590042564 UNAVAIL corrupted data 16981727992215676534 UNAVAIL corrupted data 6607570030658834339 UNAVAIL corrupted data 3435463242860701988 UNAVAIL corrupted data When we use glabel for the same purpose with the combination of gnop, the pool imports fine. Any suggestions?