Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 29 Apr 2016 22:21:03 +0100
From:      Justin Clift <justin@postgresql.org>
To:        Jason Bacon <bacon4000@gmail.com>
Cc:        freebsd-infiniband@freebsd.org
Subject:   Re: Initial ISO's ready for testing FreeNAS 9.10 with Mellanox cards
Message-ID:  <FAB31910-0FDA-481D-95D0-EAD112CFEFB9@postgresql.org>
In-Reply-To: <0567682d-eaa4-332c-d6e6-f267f113f089@gmail.com>
References:  <65B3A04E-53D0-49CB-8DE0-FDE0D8F66B26@postgresql.org> <571E2BA5.5080500@gmail.com> <157d89e5f246d88cb08fa43f2fbf690e@postgresql.org> <0567682d-eaa4-332c-d6e6-f267f113f089@gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Ahhhhh.  =46rom memory, the IPoIB ISO is using one of the earlier kernel =
config's
I knocked up... and ... er... I think I disabled a bunch of the disk =
device
controllers in that.

Oops. *facepalm* :(

I'll make a point to re-enable things for the next ISO (likely =
tomorrow).  I've
just been putting time into writing up docs for a different project =
today &
yesterday, thus the lack of recent update.

+ Justin


On 29 Apr 2016, at 22:09, Jason Bacon <bacon4000@gmail.com> wrote:
> Unfortunately, the installer (ipoib image) is failing on our PowerEdge =
R730XD.
>=20
> Abbreviated output below:
>=20
> active set on mfid0
> No handlers could be found for logger "freenaOS.Configuration"
> Traceback
>    freenas-install, line 56
>        if installer.GetPackages() !=3D True
>    Instaler.py, line 857
>        pkgFile =3D self._conf.FindPackageFile(pkg, =
handler=3Dget_file_handler)
>    Configuration.py, line 1109
>        intr_ok =3D True
>    Configuration.py, line 638
>        raise url_exc
> urllib2.URLError: urlopen error errno 8 hostname nor servname =
provided, or not known
> installation on mfid0 has failed
>=20
> This happens about 10 seconds after selecting a boot disk and hitting =
OK.  It didn't get to network configuration or anything else, so the =
urlopen error seems odd.
>=20
> Note, however, that I was also unable to install FreeBSD with UFS on =
this system due to the use of the MFI RAID driver.  FreeBSD is on the =
cusp of moving from MFI to MRSAS, so very new LSI controllers aren't =
supported by MFI, which is still the default. If I install with ZFS, it =
manages to limp through the installation, but RAID performance is =
terrible with the MFI driver.  After switching to MRSAS, performance is =
very good.
>=20
> Cheers,
>=20
>    Jason
>=20
> On 04/25/16 09:46, Justin Clift wrote:
>> Awesome, please do. :)
>>=20
>> Noticed your post on the FreeNAS forum about this as well, so I've =
posted info there too.  The post is in moderation though, so hopefully =
someone will approve it and others will test it too. :)
>>=20
>> As a side note, I've been able to do basic interoperability testing =
of the Ethernet mode ISO FreeNAS build with a Windows client (also =
running ConnectX card).  Trying the same thing in IPoIB mode isn't =
working though.  Seems like driver problems on the Windows side. :(
>>=20
>> Currently seeking assistance with that through the Mellanox Community =
forum (don't laugh... I'm not a Windows guy! :>). It's probably just =
something simple.  Hopefully. ;)
>>=20
>> + Justin
>>=20
>>=20
>> On 2016-04-25 15:37, Jason Bacon wrote:
>>> Justin,
>>>=20
>>> This is *exactly* what I'm interested in doing right now.  In fact, =
I
>>> had been exploring how to do a FreeNAS build with IB support. Thanks
>>> a million for providing the ISOs.
>>>=20
>>> I can test with Infinihost and ConnectX-3.
>>>=20
>>>    Jason
>>>=20
>>> On 04/25/16 09:03, Justin Clift wrote:
>>>> This is semi-off-topic, but hoping it's closely enough related that =
I'll
>>>> be forgiven. :)
>>>>=20
>>>> If anyone has time/interest to try out FreeNAS 9.10 (based on =
FreeBSD
>>>> 10.3) - with Mellanox Infiniband card drivers baked in, there are =
two
>>>> ISO's here for testing:
>>>>=20
>>>>   https://github.com/justinclift/freenas-infiniband=E2=80=8B
>>>>=20
>>>> One ISO is for native Infiniband mode (forcing IPoIB mode for the =
cards):
>>>>=20
>>>> =
https://github.com/justinclift/freenas-infiniband/releases/tag/FreeNAS-IB-=
9.10-alpha1
>>>>=20
>>>> The other ISO is for native Ethernet mode:
>>>>=20
>>>> =
https://github.com/justinclift/freenas-infiniband/releases/tag/FreeNAS-IB-=
EN-9.10-alpha1v10
>>>>=20
>>>> InfiniHost through to ConnectX-3 cards should all work for the IB =
mode
>>>> one.  ConnectX through ConnectX-3 should work for the Ethernet mode =
one.
>>>>=20
>>>> And yeah, it would be better to have just one ISO.  There is a =
weird
>>>> kernel panic bug I'm trying to track down first (triggered when =
switched
>>>> modes), that needs fixing before that can happen.
>>>>=20
>>>> All feedback is hugely encouraged and welcome. :)
>>>>=20
>>>> Regards and best wishes,
>>>>=20
>>>> Justin Clift
>>>>=20
>>>> --=20
>>>> "My grandfather once told me that there are two kinds of people: =
those
>>>> who work and those who take the credit. He told me to try to be in =
the
>>>> first group; there was less competition there."
>>>> - Indira Gandhi
>>>>=20
>>>> _______________________________________________
>>>> freebsd-infiniband@freebsd.org mailing list
>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-infiniband
>>>> To unsubscribe, send any mail to =
"freebsd-infiniband-unsubscribe@freebsd.org"
>>=20
>=20

--
"My grandfather once told me that there are two kinds of people: those
who work and those who take the credit. He told me to try to be in the
first group; there was less competition there."
- Indira Gandhi




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?FAB31910-0FDA-481D-95D0-EAD112CFEFB9>