From owner-freebsd-net@FreeBSD.ORG Tue Jun 10 15:06:38 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8CA19DDE for ; Tue, 10 Jun 2014 15:06:38 +0000 (UTC) Received: from mail-ie0-x234.google.com (mail-ie0-x234.google.com [IPv6:2607:f8b0:4001:c03::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 579E92FE6 for ; Tue, 10 Jun 2014 15:06:38 +0000 (UTC) Received: by mail-ie0-f180.google.com with SMTP id at20so6838944iec.25 for ; Tue, 10 Jun 2014 08:06:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=E+N0oGZZuy4APN3VHO8hh8EVmgdO2UMnT8IxMORv3XU=; b=MqznJbmPmOE5coLiL0JRP67PeKsM+9raDSPNdlNSgErLpB5Q0eLvPlJeAS+/yJkm5A tTcglz3Ul2snA7QzrZlteCgzq7GISeh3KIT1ElyHwfGeYywF+VB86Xp8rSHVRhEB23Zu enR+7kYlYVLjES9ValthaNjYoNvWyzwMDjjVI3c67zdC4Ntj1vIATMDziVrtzGqcZidJ Gs9lrZW2TyaTQOzmEJq77eXdsTZ9QzH3N6V+WuZcWaxZSOHjcEiqYlECbviIYv64kQMI B6dIrmhJjUvEMruLk1DwmMcW9GzIajChLCQ7a52h0AujBf7R7rgRd6Rc32WHtb0oFiqu glvw== X-Received: by 10.50.50.141 with SMTP id c13mr28637301igo.0.1402412797487; Tue, 10 Jun 2014 08:06:37 -0700 (PDT) Received: from [10.1.68.236] (gs-sv-1-49-ac1.gsfc.nasa.gov. [198.119.56.43]) by mx.google.com with ESMTPSA id mh1sm9910531igb.20.2014.06.10.08.06.36 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 10 Jun 2014 08:06:36 -0700 (PDT) Message-ID: <53971EFB.50107@gmail.com> Date: Tue, 10 Jun 2014 11:06:35 -0400 From: John Jasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.5.0 MIME-Version: 1.0 To: freebsd-net@freebsd.org Subject: recommendations on supported 40GbE adapters? X-Enigmail-Version: 1.6 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Jun 2014 15:06:38 -0000 Hello -- frequent listener, first time caller. If this should be redirected to another freebsd-* mailing list, please let me know. I've been experimenting with multiple dual port Mellanox adapters in a system, to see if the entire solution would be suitable for a router replacement project I'm doing. In general, I've been impressed with the Mellanox drivers and their responsiveness, however, I have encountered a few issues where the cards seem to 'fall asleep' or, when I'm playing with the sysctl settings for the mlxen drivers, I panic the kernel. Of course, before I finish spec'ing out a solution to be purchased, I should solicit real-world feedback on the available 40GbE adapters and drivers. >From what I've gleaned, Mellanox, Emulex, and Chelsio all support the development of FreeBSD drivers for their 40GbE cards. Are there any other vendors I should be considering? If anyone else has tried 40GbE cards, I am most interested in your experiences -- especially in stability, performance and performance tuning. Thanks in advance! -- John Jasen (jjasen@gmail.com)