From owner-freebsd-net@FreeBSD.ORG Mon Oct 11 16:39:19 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7A4B41065693 for ; Mon, 11 Oct 2010 16:39:19 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id 2F8A88FC20 for ; Mon, 11 Oct 2010 16:39:18 +0000 (UTC) Received: by yxe42 with SMTP id 42so886243yxe.13 for ; Mon, 11 Oct 2010 09:39:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:date:from:to:cc:subject :message-id:mail-followup-to:references:mime-version:content-type :content-disposition:in-reply-to:user-agent; bh=BcGxtAnw0MOtkwnlemTitwlDrsW5bFQXNYLr/HAMKrQ=; b=BT0p+QtNDJqce8mx6F+XsgB7RpuzAcTvRqHos6k98BKgaJNZWnnfB7SzfEU/v36yBx 5qzPLxFDysimstnzvnma2WIFV09u2YgbS9OsXVanUSbiSYkH6W++XYO89YLEbLEnzf3T zI8AtINXSgUMI4JnICMsjwkbQUnSNrSoqnF+c= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=date:from:to:cc:subject:message-id:mail-followup-to:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; b=v76mD+rjzOCGzfJhJqHJeQdpByukGGgodiXEvCKhZ89q22Xt2VkacDrILn5ilULFtS uCSc4IgnOb74EFFOj/fYSSqH4+E8z7oJsaWytGFbvRE+8sGI/Tx2y2oCLqU0HDdpFncf MSzG76W1xWJTbAfElGVRfsm69LjwHrVedwlpM= Received: by 10.42.159.134 with SMTP id l6mr1811647icx.173.1286813496628; Mon, 11 Oct 2010 09:11:36 -0700 (PDT) Received: from itx (c-67-174-240-133.hsd1.ca.comcast.net [67.174.240.133]) by mx.google.com with ESMTPS id 8sm34641iba.4.2010.10.11.09.11.33 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 11 Oct 2010 09:11:34 -0700 (PDT) Date: Mon, 11 Oct 2010 09:11:28 -0700 From: Navdeep Parhar To: Bill Desjardins Message-ID: <20101011161128.GA6026@itx> Mail-Followup-To: Bill Desjardins , freebsd-net@freebsd.org References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.20 (2009-06-14) Cc: freebsd-net@freebsd.org Subject: Re: [cxgb] Chelsio T304 quad gig pcie adapter TSO disabled X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Oct 2010 16:39:19 -0000 On Mon, Oct 11, 2010 at 12:56:55AM -0400, Bill Desjardins wrote: > Hi All, > > I have a couple Chelsio T304 quad gigabit nics that are going into > iscsi servers. I got these for the TOE capabilities, but I found in > the cxgb driver code that it is explicitly disabled for > 2 port nics > (line 1036 : /usr/src/sys/dev/cxgb/cxgb_main.c) . The current cxgb > driver is based on the chelsio 7.8.0 firmware (11/25/09), but chelsio > is up to 7.11.0 (07/20/10). I had updated the firmware using cxgbtool > to 7.11, but received complaints from the driver to 'upgrade' to > 7.8.0, which I did. > > my question is, is if the cxgb driver is being worked on to update to > latest chelsio firmware and/or fix TSO for the quad port cards? I > don't have the programming skill's to assist with that side of things, > but I can easily provide a remote spare machine with a serial console > for development and testing if its helpful. Hello Bill, TSO is not supported on the T304 (not even with the 7.11.0 firmware). This is a 4 x gigabit card and you'll be able to max it out in either direction without TSO. > cxgbc0: Insufficient clusters and/or jumbo buffers. > ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^???? ^^ this indicates you need to bump up the number of clusters and jumbos. Do so in /boot/loader.conf if you load if_cxgb early, or in /etc/sysctl.conf if you load it after the system has booted up: /boot/loader.conf: kern.ipc.nmbclusters=262144 /etc/sysctl.conf: kern.ipc.nmbclusters=262144 kern.ipc.nmbjumbo9=262144 kern.ipc.nmbjumbo16=262144 Regards, Navdeep