Date: Tue, 24 Dec 2013 14:15:58 -0800 From: Dennis Glatting <freebsd@pki2.com> To: iamatt <iamatt@gmail.com> Cc: FreeBSD Mailing List <freebsd-questions@freebsd.org> Subject: Re: InfiniBand in 10.0? Message-ID: <1387923358.71651.122.camel@btw.pki2.com> In-Reply-To: <CAEeRwNU1nM%2BueRz-yAAOf0XNZMJ8ZqFYNAH8ZsFX_jqy33A-dw@mail.gmail.com> References: <1387915155.71651.118.camel@btw.pki2.com> <CAEeRwNXsxT_pbqOOF3tfHSecjFzRqqb6tgxZVc5nwMWqoyBOxw@mail.gmail.com> <1387920273.71651.119.camel@btw.pki2.com> <CAEeRwNU1nM%2BueRz-yAAOf0XNZMJ8ZqFYNAH8ZsFX_jqy33A-dw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, 2013-12-24 at 15:46 -0600, iamatt wrote: > A good batch of mellanox cables. Melanic had a bad run of FDR early > in the year. Most FDR centers have been plagued with them. Even the > back end of our DDN lustres has had issues. They typically do not > just fail but downgrade to QDR rate. > Ah. I though they were stripping the technology InfinBand. > On Dec 24, 2013 3:24 PM, "Dennis Glatting" <freebsd@pki2.com> wrote: > On Tue, 2013-12-24 at 14:43 -0600, iamatt wrote: > > Not sure if I would even bother with running IB on BSD. We > have enough > > problems just getting things stable with Linux and mellanox > ofed . Add all > > of the documented build problems with the mellanox FDR > cables and recalls > > and you are guaranteed a nightmare. TACC, navy, and almost > every center I > > am aware of has replaced all or most or some of their FDR, > including us. > > > > Replaced them with what? > > > > As far as cards go it's all mellanox. Qlogic lost the game, > still dealing > > with a 12800 qlogic switch which is a total nightmare. > Stick with > > mellanox. Different vendors used to make their own fabric > managers in the > > early time of IB but now its best to stick with open ibd. > > > > FreeBSD and IB gives me the chills just thinking about it. > > On Dec 24, 2013 1:59 PM, "Dennis Glatting" > <freebsd@pki2.com> wrote: > > > > > > > > This site appears dated: > > > > > > https://wiki.freebsd.org/InfiniBand > > > > > > I have a couple of questions. > > > > > > 1) Under 10.0-RC2, is InfiniBand a part of GENERIC or did > I still have > > > to modify the conf as specified in the wiki? I don't see > any of the > > > options from the wiki in 10.0-RC2 GENERIC. > > > > > > 2) Any recommendation on cards? What works, what doesn't? > > > > > > 3) What things to watch out for? > > > > > > > > > Thanks. > > > > > > > > > > > > > > > _______________________________________________ > > > freebsd-questions@freebsd.org mailing list > > > > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > > > To unsubscribe, send any mail to " > > > freebsd-questions-unsubscribe@freebsd.org" > > > > > _______________________________________________ > > freebsd-questions@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > > To unsubscribe, send any mail to > "freebsd-questions-unsubscribe@freebsd.org" > >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1387923358.71651.122.camel>