Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 23 Nov 2012 14:39:20 +0100
From:      Harald Schmalzbauer <h.schmalzbauer@omnilan.de>
To:        freebsd-stable@freebsd.org
Subject:   cam SCSI negotiation issues (mpt in that case), only 3.300MB/s transfers
Message-ID:  <50AF7C88.5000507@omnilan.de>

next in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 2440 and 3156)
--------------enigB0B45BCFAF65A50E5FAEB580
Content-Type: text/plain; charset=ISO-8859-15
Content-Transfer-Encoding: quoted-printable

 Hello,

I have a LSI20320IE, wich is a LSI1030 (U320-SCSI, supported by MPT)
behind an PCI-X-PCIe bridge. I'm using that for two tape drives: LTO-3
and DAT72.
My (solved, see below) first problem was, that passthrough of that HBA
with ESXi5.0 didn't work.
As soon as mpt was kldloaded, there was a heavy interrupt storm detected
(>100k irq/s) and throttling occured. No matter what IRQ it was assigend
and no matter if it was shared or not. The dmesg output hasn't shown any
info about MSI usage, so I told ESXi to use legacy interrupts in host
mode instead of msi. Didn't help anything.

After I verified that this passthrough configuration works well on other
OS, I tried out some things and
found out that    hint.mpt.0.msi_enable=3D"1"
solves the interrupt storm problem, although dmesg output still is
exactly the same:
    mpt0: <LSILogic 1030 Ultra4 Adapter> port 0x4000-0x40ff mem
0xd6440000-0xd645ffff,0xd6420000-0xd643ffff irq 18 at device 0.0 on pci3
    mpt0: MPI Version=3D1.2.15.0
Btw, I'm still curious what the sysctl "hw.mpt.0.role" means? With my
LSI1030 it's "3", an onther 1068, it's "1"

Now after I got passthrough working, I first tried to saturate my LTO-3.
With the help of mbuffer (zfs send -R DATASET/filesystem@totape |
mbuffer -s 1m -t -m 500M -P 80 -f -o /dev/nsa1) I saw 60-120MB/s
transfer rates, avaeraging at 100MB/s at moderate interrupt load (~1k).
So for so fine.
But there are problems with the DAT72 drive.
The SCSI negotiation seems to fail:
sa0 at mpt0 bus 0 scbus3 target 0 lun 0
sa0: <SEAGATE DAT    DAT72-052 A16K> Removable Sequential Access SCSI-3
device
sa0: 3.300MB/s transfers

Now I read here
http://lists.freebsd.org/pipermail/freebsd-current/2006-May/063603.html
that this may be just cosmetic, but in my case I can't get more than
~3MB/s to/from the tape.
Once again I changed the controller to another guest OS and got 5,5MB/s
avarage write transfer rate with ntbakup (wich is sensible for the
gained compression ratio).
lsiutil.exe shows negotiation parameters with 80MB/s (40MT/s 16bit),
which correponds to the drive's interface.
Back in FreeBSD, I had no luck using "camcontrol negotiate sa0 -R 40" to
alter the negotiation parameters.
It always shows 3,300MB/s and seems to reflect reality.

I'd higly appreciate any help, since I have no idea how this could be
fixed. Slot-constraints  limit my choice of SCSI-HBAs to PCIe ones...

Thnaks,

-Harry



--------------enigB0B45BCFAF65A50E5FAEB580
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.18 (FreeBSD)

iEYEARECAAYFAlCvfI4ACgkQLDqVQ9VXb8jmYwCeKHeC3InXbDb5ZVGVABSMEUA+
B5AAoNBubMK/HPmrOTvLzwYC/B0McvHp
=QY5l
-----END PGP SIGNATURE-----

--------------enigB0B45BCFAF65A50E5FAEB580--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?50AF7C88.5000507>