From owner-svn-src-all@freebsd.org Sun Mar 13 08:15:27 2016 Return-Path: Delivered-To: svn-src-all@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A3E0AA92E5C; Sun, 13 Mar 2016 08:15:27 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-pf0-x22f.google.com (mail-pf0-x22f.google.com [IPv6:2607:f8b0:400e:c00::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 75A76793; Sun, 13 Mar 2016 08:15:27 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: by mail-pf0-x22f.google.com with SMTP id u190so84180291pfb.3; Sun, 13 Mar 2016 00:15:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:mail-followup-to :references:mime-version:content-disposition:in-reply-to:user-agent; bh=4L3pggeTLC48/luQVrWJPjdjnIspfZ4kxMU6Jw0/+pI=; b=L9KWdVj5hJCqTbklUW0IVbwS7doWXJa+MGFkCP2rLObr2o7SoMcTvFEGG+v9LTZEwT K+CHj3DWZF3d8Iy+Tyj28TBV2w49sl2QVRBKpOep/evG8dRGyZAKo00ryf22frS3+yAu ZkA2K0A8R3ebvb/rg4Frh3dbWNSmOY+SS5PM1aelcA9WGZ8n8c0G1mJLo4rqMGsSTnpm 07kDUn0VWYl8p05R5ML9cbk1/XTtURPXcyWM2MdKkhIJIbApP2g/GXKgMwuzLAXbPNU/ IcC+4+GyoVXS/Fat291YTwMGSPVF3rH/QVZrkmgVemHqy2BgEdK19BB/uep/AbfhJeVG oUjQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :mail-followup-to:references:mime-version:content-disposition :in-reply-to:user-agent; bh=4L3pggeTLC48/luQVrWJPjdjnIspfZ4kxMU6Jw0/+pI=; b=JoOOmWpvfQoKYfowsrkt8G10ckccxL1p5fE468fOwdBBblqJ2Xqvbi0ZJ1laRWXoOz gP6CvTRhbw3vX/Xfeozs7szjsK3pyu4T11gDZmkm/yfLwOHcFK3gjMMVnbLG/++WQU6D F1qCVmrVzqx+EimOJF2M1Gg3ZGrwqLV9AqdnKZWrRQnVXFmlP41G7pplESF3x0ZPAngm 466cv2uM63PMi4g2INnox66Gw8L9ENscUt7ClzgRDnbS9DhHigPzkjLACnnAWlXsPdjF AAabm+cHTf/VL3N9ldE843jSAJFVumln4ix5MzXQisI+djD0Ac1EQzQrmVNwRabD0kS3 mOjQ== X-Gm-Message-State: AD7BkJLlHyTiYVsXh4T1v9bh1Gzdt93oCY1Y1owQ4b8u02iBEvNkg0SZyoPwpl5LjTFNZA== X-Received: by 10.98.75.138 with SMTP id d10mr21061844pfj.108.1457856926927; Sun, 13 Mar 2016 00:15:26 -0800 (PST) Received: from ox ([2601:641:c000:e00:64b0:bda4:3e49:9699]) by smtp.gmail.com with ESMTPSA id ql1sm23948819pac.24.2016.03.13.00.15.25 (version=TLS1_2 cipher=AES128-SHA bits=128/128); Sun, 13 Mar 2016 00:15:25 -0800 (PST) Sender: Navdeep Parhar Date: Sun, 13 Mar 2016 00:15:18 -0800 From: Navdeep Parhar To: Slawa Olhovchenkov Cc: src-committers@freebsd.org, svn-src-all@freebsd.org, svn-src-head@freebsd.org Subject: Re: svn commit: r296689 - head/sys/dev/cxgbe Message-ID: <20160313081518.GA7325@ox> Mail-Followup-To: Slawa Olhovchenkov , src-committers@freebsd.org, svn-src-all@freebsd.org, svn-src-head@freebsd.org References: <201603112324.u2BNO5gx004444@repo.freebsd.org> <20160313011434.GD94639@zxy.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20160313011434.GD94639@zxy.spb.ru> User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: svn-src-all@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "SVN commit messages for the entire src tree \(except for " user" and " projects" \)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Mar 2016 08:15:27 -0000 On Sun, Mar 13, 2016 at 04:14:34AM +0300, Slawa Olhovchenkov wrote: > On Fri, Mar 11, 2016 at 11:24:05PM +0000, Navdeep Parhar wrote: > > > Author: np > > Date: Fri Mar 11 23:24:04 2016 > > New Revision: 296689 > > URL: https://svnweb.freebsd.org/changeset/base/296689 > > > > Log: > > cxgbe(4): sysctls to display the TOE's TCP timers. > > > > cask:~# sysctl -d dev.t5nex.0.toe > > dev.t5nex.0.toe.finwait2_timer: FINWAIT2 timer (us) > > dev.t5nex.0.toe.initial_srtt: Initial SRTT (us) > > dev.t5nex.0.toe.keepalive_intvl: Keepidle interval (us) > > dev.t5nex.0.toe.keepalive_idle: Keepidle idle timer (us) > > dev.t5nex.0.toe.persist_max: Persist timer max (us) > > dev.t5nex.0.toe.persist_min: Persist timer min (us) > > dev.t5nex.0.toe.rexmt_max: Retransmit max (us) > > dev.t5nex.0.toe.rexmt_min: Retransmit min (us) > > dev.t5nex.0.toe.dack_timer: DACK timer (us) > > dev.t5nex.0.toe.dack_tick: DACK tick (us) > > dev.t5nex.0.toe.timestamp_tick: TCP timestamp tick (us) > > dev.t5nex.0.toe.timer_tick: TP timer tick (us) > > ... > > > > cask:~# sysctl dev.t5nex.0.toe > > dev.t5nex.0.toe.finwait2_timer: 9765440 > > dev.t5nex.0.toe.initial_srtt: 244128 > > dev.t5nex.0.toe.keepalive_intvl: 73240800 > > dev.t5nex.0.toe.keepalive_idle: 7031116800 > > dev.t5nex.0.toe.persist_max: 9765440 > > dev.t5nex.0.toe.persist_min: 976544 > > dev.t5nex.0.toe.rexmt_max: 9765440 > > dev.t5nex.0.toe.rexmt_min: 244128 > > dev.t5nex.0.toe.dack_timer: 19520 > > dev.t5nex.0.toe.dack_tick: 32.768 > > dev.t5nex.0.toe.timestamp_tick: 1048.576 > > dev.t5nex.0.toe.timer_tick: 32.768 > > ... > > Can you more describe it in man? There are updates and additions to cxgbe documentation in progress, including new man pages: t4_tom(4) for the TCP offload module (aka TOE driver), cxgbei(4) for the iSCSI offload driver, and iw_cxgbe(4) for the iWARP driver. I'll get these sysctls documented in t4_tom(4). But writing decent documentation is harder than writing code and the effort is taking longer than I'd anticipated, so please be patient. > I am see this timers different from system, is this problem? What > correlations between? The kernel's TCP stack is different from the TCP implementation in the chip's silicon and they happen to use different default timers. Note that the driver requires you to explicitly load a module (t4_tom) and then enable IFCAP_TOE on the interfaces in order to use the hardware TCP offload. This opt-in model is by design and makes sure you aren't using a stack that you didn't explicitly ask for. Offloaded connections show up as "toe4/6" instead of "tcp4/6" in the output of netstat/sockstat/etc. so it's easy to tell which socket is using which stack (and which timers). Regards, Navdeep