From owner-freebsd-net@FreeBSD.ORG Thu Sep 6 22:03:46 2007 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F29FD16A418 for ; Thu, 6 Sep 2007 22:03:46 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from noop.in-addr.com (unknown [IPv6:2001:5c0:8fff:fffe::214d]) by mx1.freebsd.org (Postfix) with ESMTP id BB45113C45E for ; Thu, 6 Sep 2007 22:03:46 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from gjp by noop.in-addr.com with local (Exim 4.54 (FreeBSD)) id 1ITPRx-000GzF-Ha; Thu, 06 Sep 2007 18:03:45 -0400 Date: Thu, 6 Sep 2007 18:03:45 -0400 From: Gary Palmer To: Kirc Gover Message-ID: <20070906220345.GB8194@in-addr.com> Mail-Followup-To: Kirc Gover , freebsd-net@freebsd.org References: <695994.81567.qm@web44811.mail.sp1.yahoo.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <695994.81567.qm@web44811.mail.sp1.yahoo.com> Cc: freebsd-net@freebsd.org Subject: Re: OS choice for an edge router X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Sep 2007 22:03:47 -0000 On Fri, Sep 07, 2007 at 03:06:54AM +1000, Kirc Gover wrote: > We are in the stage of planning and research for a commercial development of an edge router that will be based mostly on OpenSource software. I would like to solicit for information and recommendation if FreeBSD is a suitable OS. The router is expected to withstand forwarding of sustained traffic from 10Mbps to 1Gbps and maybe more than that. Are there any known limitations of FreeBSD in terms of architecture and performance? Can I just take out a FreeBSD as is and put it with the hardware without any specific or major refinements in its code? I'm very much concerned with its capability in forwarding heavy sustained traffic. Packet loss should be at minimum and critical userland processes should working normally even under heavy load. Are there any known specific limitations of FreeBSD? I have browsed through the archives and found a lot of hangups, deadlocks and freeze issues. What is the usual or minimum hardware requirement? Is soekris box enough, or dual core or ASIC > based platforms? I'm aware that there are so many FreeBSD based routers and network based devices in the market. Is this a way to go over realtime and embedded OS such as VxWorks and others (mostly commercial) without putting the licensing cost in picture? I really appreciate any help, suggestions and recommendations. More power to FreeBSD! Kirc, There are two factors to consider: - bus architecture (PCI, PCI-X, PCI-Express, etc) will dictate the maximum throughput in bits/sec. Allow some overhead for bus arbitration activities, and remember that the packet crosses the bus twice, once on the inbound leg and once on the outbound leg. - Host CPU (and perhaps to a limited extent the interface cards used) will dictate the packets per second (PPS) Most commercial routers run out of packets per second (in real-world situations, not lab mockups) long before the theoretical maximum throughput is achieved. Thinks like ICMP ping packets and TCP RST packets are small (less than 100 bytes usually) but normally take as much CPU to process & route as a 1500 byte (or larger) packet. The more you put in the processing path (e.g. packet filters, complex routing tables) the more you reduce the PPS. Gary