Date: Wed, 3 Oct 2012 16:52:03 -0700 From: Chuck Tuffli <ctuffli@gmail.com> To: Nikolay Denev <ndenev@gmail.com> Cc: "freebsd-stable@freebsd.org" <freebsd-stable@freebsd.org> Subject: Re: CAM Target Layer and Linux (continued) Message-ID: <CAKAYmMJ-szasN1voXfenxTdBdoqJmvr2hf2nrW8EVW4CKYJQeg@mail.gmail.com> In-Reply-To: <11028C2E-9DB0-4B71-A7B1-98160D5AEA93@gmail.com> References: <72A4B763-D36B-4912-8C20-7373A0562EA1@gmail.com> <11028C2E-9DB0-4B71-A7B1-98160D5AEA93@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Oct 2, 2012 at 3:03 AM, Nikolay Denev <ndenev@gmail.com> wrote: > > On Sep 27, 2012, at 6:33 PM, Nikolay Denev <ndenev@gmail.com> wrote: > >> Hi All, >> >> With the help of Chuck Tuffli, I'm now able to use CTL to export a zvol over FC to a Linux host: >> >> LUN Backend Size (Blocks) BS Serial Number Device ID >> 0 block 4185915392 512 FBSDZFS001 ORA_ASM_01 >> lun_type=0 >> num_threads=14 >> file=/dev/zvol/tank/oracle_asm_01 >> 1 block 4185915392 512 FBSDZFS002 ORA_ASM_02 >> lun_type=0 >> num_threads=14 >> file=/dev/zvol/tank/oracle_asm_02 >> 2 block 4185915392 512 FBSDZFS003 ORA_ASM_03 >> lun_type=0 >> num_threads=14 >> file=/dev/zvol/tank/oracle_asm_03 >> 3 block 4185915392 512 FBSDZFS004 ORA_ASM_04 >> lun_type=0 >> num_threads=14 >> file=/dev/zvol/tank/oracle_asm_04 >> >> Then we ran some tests using Oracle's ORION benchmark tool from the Linux host. >> We ran one test which passed successfully, >> then I've just disabled zfs prefetch -> "vfs.zfs.prefetch_disable=1" >> and rerun the test, which failed due to this error. >> >> On the FreeBSD side: >> >> (0:3:0:1): READ(10). CDB: 28 0 84 f9 58 0 0 4 0 0 >> (0:3:0:1): Tag: 0x116220, Type: 1 >> (0:3:0:1): CTL Status: SCSI Error >> (0:3:0:1): SCSI Status: Check Condition >> (0:3:0:1): SCSI sense: NOT READY asc:4b,0 (Data phase error) ... > After a whole day of orion tests without problems, we started an Oracle ASM instance from the Linux host and > again got an error, this time it was WRITE error : > > (0:3:0:3): WRITE(10). CDB: 2a 0 1 5b 10 0 0 4 0 0 > (0:3:0:3): Tag: 0x110940, Type: 1 > (0:3:0:3): CTL Status: SCSI Error > (0:3:0:3): SCSI Status: Check Condition > (0:3:0:3): SCSI sense: NOT READY asc:4b,0 (Data phase error) > > I've tried to track down this "Data phase error" in the CTL code and it looks like it is something related to the isp(4) driver: This would have been my first guess if there had been something in the logs from isp, but since there wasn't, it's hard to tell. I been running orion for ~3hrs now with a different FC driver + an analyzer but haven't seen this problem. Would it be possible to stick some prints in default clause of the ctlfedone() to confirm if this is front or back end problem? Especially interesting would be the value of done_ccb->ccb_h.status. ---chuck
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAKAYmMJ-szasN1voXfenxTdBdoqJmvr2hf2nrW8EVW4CKYJQeg>