From owner-freebsd-isp@FreeBSD.ORG Thu Jul 12 03:43:15 2012 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 33452106566C; Thu, 12 Jul 2012 03:43:15 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-we0-f182.google.com (mail-we0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 3A57A8FC0A; Thu, 12 Jul 2012 03:43:14 +0000 (UTC) Received: by weyx56 with SMTP id x56so1736663wey.13 for ; Wed, 11 Jul 2012 20:43:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=0NrhpCgkcuTKBje9LzoGx58zGA0FpKbgrrelbyYP63E=; b=B5LDv4j4oUZUZe5owDi3/776qHWNbnR1NBDS9FlklYgY54u34g4idbRcaxwlBntMAs llvv0UfkkiDyMAKD1U3Ujj11WGex4rJR2sztbc4F/+HwUH7CqnaMFk8iDtLGX/JaqdUj paCncL0V1yFBUzav/QCJ4guwVrJEuaOJM28FJQLugv2Tf7F14SDZOLZsEl9DgX3zPica kuJvCBxNaxdDyttEfOkSSLNhrnFT/JIWdsE+2vnKKhu8vunNzlKwsoSqaRLdTByfGV1N uKHG/LlZ8Ef0EQf50p1W0M/rwE1097YJ9FHvZb8t2kIa3AYItQtzkW/Lf8Z//CH8nKpe 3L0A== MIME-Version: 1.0 Received: by 10.180.78.99 with SMTP id a3mr52169001wix.15.1342064592894; Wed, 11 Jul 2012 20:43:12 -0700 (PDT) Received: by 10.223.88.217 with HTTP; Wed, 11 Jul 2012 20:43:12 -0700 (PDT) In-Reply-To: References: Date: Wed, 11 Jul 2012 20:43:12 -0700 Message-ID: From: Kevin Oberman To: Sami Halabi Content-Type: text/plain; charset=UTF-8 Cc: Luigi Rizzo , freebsd-net@freebsd.org, Alexander Motin , freebsd-isp@freebsd.org, Jack Vogel , "Bjoern A. Zeeb" , freebsd-performance@freebsd.org Subject: Re: ating 100Gbit transfer rate X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 03:43:15 -0000 On Wed, Jul 11, 2012 at 1:31 PM, Sami Halabi wrote: > Hi, > > We have several boxes using 10G cards and using most of the bandwidth. > as a future vision i would like to ask if someone ever combined hardware > with freebsd/linux to saturate 100Gbit of traffic. > what hardware (server, NICs, platform) and software do you recommend that > would allow me to acheive my goal? > > Is it possible with servers ? or i need dedicated hardware > (cisco/juniper/other?) if dedicated hardware needed, i would be glad to > hear from your experience what do you recommend in terms of performance and > price. I don't know of any 100GE hardware for any PC, but I may be a bit behind on the times. The way we saturate a 100GE with a FreeBSD (or Linux) system is using a 10G transmission stream and loop the data stream over the net using MPLS. Works quite well, though no end system ever sees more than about 9.9G, the routers do. We are using Alcatel-Lucent routers at this time for our national test network. It is available for research by educational, commercial and research organizations for a little longer as a federally funded testbed for 100G research. When the funding for that project runs out, most of the hardware will be re-purposed and will no longer be available for research. gnn@ mentioned it about a year ago and suggested that some FreeBSD people might want to submit proposals, but I sw no responses. We have tested with Juniper and they will work, too. All 100G hardware is just a mite pricey, though it has dropped tremendously over the past year and a half and I expect it will continue to do so. -- R. Kevin Oberman, Network Engineer E-mail: kob6558@gmail.com