From owner-freebsd-current@FreeBSD.ORG Tue Feb 20 01:26:58 2007 Return-Path: X-Original-To: current@freebsd.org Delivered-To: freebsd-current@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E9F45170FDA for ; Tue, 20 Feb 2007 01:26:58 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from nz-out-0506.google.com (nz-out-0506.google.com [64.233.162.231]) by mx1.freebsd.org (Postfix) with ESMTP id A139F13C467 for ; Tue, 20 Feb 2007 01:26:58 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: by nz-out-0506.google.com with SMTP id i11so2071702nzh for ; Mon, 19 Feb 2007 17:26:57 -0800 (PST) DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:date:from:to:cc:subject:message-id:reply-to:references:mime-version:content-type:content-disposition:in-reply-to:user-agent; b=LjA6Wi1A4cYHuP7L2+YVHNQtmcRzuWucXMEc6aEmCk556crcbRMJU8jdK5apv8aw71F0yM0d653gFTiDXoX1T7C3thXcCqtkZUEYE4DSszsVTIyRYJ2epICJep68eYgEOuc+GVx9dZsDgzS7v9sWDcvDpX/Yh+wx/uEd1Jo/DZM= Received: by 10.65.137.15 with SMTP id p15mr10719225qbn.1171934817334; Mon, 19 Feb 2007 17:26:57 -0800 (PST) Received: from michelle.cdnetworks.co.kr ( [211.53.35.84]) by mx.google.com with ESMTP id 12sm39474522nzn.2007.02.19.17.26.54; Mon, 19 Feb 2007 17:26:56 -0800 (PST) Received: from michelle.cdnetworks.co.kr (localhost.cdnetworks.co.kr [127.0.0.1]) by michelle.cdnetworks.co.kr (8.13.5/8.13.5) with ESMTP id l1K1OhQ9002053 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 20 Feb 2007 10:24:43 +0900 (KST) (envelope-from pyunyh@gmail.com) Received: (from yongari@localhost) by michelle.cdnetworks.co.kr (8.13.5/8.13.5/Submit) id l1K1Ohal002052; Tue, 20 Feb 2007 10:24:43 +0900 (KST) (envelope-from pyunyh@gmail.com) Date: Tue, 20 Feb 2007 10:24:43 +0900 From: Pyun YongHyeon To: Joe Marcus Clarke Message-ID: <20070220012443.GB912@cdnetworks.co.kr> References: <45D0BB41.9040505@FreeBSD.org> <20070213000922.GA62412@cdnetworks.co.kr> <1171327083.98536.5.camel@shumai.marcuscom.com> <20070213044746.GC62412@cdnetworks.co.kr> <1171344897.98536.14.camel@shumai.marcuscom.com> <20070213054802.GD62412@cdnetworks.co.kr> <45D355D9.5000805@FreeBSD.org> <20070215055918.GA4319@cdnetworks.co.kr> <45D9F303.1030302@FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <45D9F303.1030302@FreeBSD.org> User-Agent: Mutt/1.4.2.1i Cc: current@FreeBSD.org Subject: Re: Constant stream of errors on msk0 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 20 Feb 2007 01:26:59 -0000 On Mon, Feb 19, 2007 at 01:57:07PM -0500, Joe Marcus Clarke wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Pyun YongHyeon wrote: > > On Wed, Feb 14, 2007 at 01:32:57PM -0500, Joe Marcus Clarke wrote: > > > -----BEGIN PGP SIGNED MESSAGE----- > > > Hash: SHA1 > > > > > > Pyun YongHyeon wrote: > > > > On Tue, Feb 13, 2007 at 12:34:57AM -0500, Joe Marcus Clarke wrote: > > > > > On Tue, 2007-02-13 at 13:47 +0900, Pyun YongHyeon wrote: > > > > > > On Mon, Feb 12, 2007 at 07:38:03PM -0500, Joe Marcus Clarke wrote: > > > > > > > On Tue, 2007-02-13 at 09:09 +0900, Pyun YongHyeon wrote: > > > > > > > > On Mon, Feb 12, 2007 at 02:08:49PM -0500, Joe Marcus Clarke wrote: > > > > > > > > > -----BEGIN PGP SIGNED MESSAGE----- > > > > > > > > > Hash: SHA1 > > > > > > > > > > > > > > > > > > I recently upgraded my MacBook Pro from -STABLE to -CURRENT. I used to > > > > > > > > > be using the Marvell myk driver for my wired ethernet. This driver > > > > > > > > > worked fine. I'm now using the built-in msk driver, but this driver > > > > > > > > > causes the interface to report a constant stream of input errors. There > > > > > > > > > > > > > > > > Would you explain this input errors? > > > > > > > > > > > > > > netstat -i reports steadily increasing input errors (Ierrs) every time > > > > > > > packets arrive on the machine. > > > > > > > > > > > > > > > > > > > It looks like link speed/duplex mismatch. > > > > > > How about manual configuration? > > > > > > (e.g. ifconfig msk0 media 1000baseTX mediaopt full-duplex) > > > > > > > > > > That was the first thing I though of. I tried all settings from > > > > > 100BaseTX half/full to 1000BaseTX half/full to auto. The same problem > > > > > was always observed. Additionally, I turned off TSO to see if that made > > > > > any difference, and it did not. > > > > > > > > > > > > > Ok, let's see what's happending on your NIC. > > > > Try attached patch and let me know the output. > > > > > > Okay. On an otherwise idle machine, I started a regular 64-byte ping > > > (to rule out TCP), and I was getting regular packet loss (50 responses > > > were seen for 89 packets or 43.8% packet loss). Here is the debug > > > output for that time: > > > > > > Feb 14 13:22:05 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:05 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:06 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:07 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:08 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:10 gyros kernel: 0x024e2300 : 586 : 590 > > > Feb 14 13:22:13 gyros kernel: 0x00b12300 : 173 : 177 > > > Feb 14 13:22:16 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:20 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:20 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:21 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:22 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:25 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:26 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:27 gyros kernel: 0x003c2300 : 56 : 60 > > > Feb 14 13:22:28 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:28 gyros kernel: 0x003c2300 : 56 : 60 > > > Feb 14 13:22:30 gyros kernel: 0x00f32300 : 239 : 243 > > > Feb 14 13:22:30 gyros kernel: 0x003c2100 : 56 : 60 > > > Feb 14 13:22:31 gyros kernel: 0x005c2300 : 88 : 92 > > > Feb 14 13:22:32 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:33 gyros kernel: 0x003c2300 : 56 : 60 > > > Feb 14 13:22:34 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:35 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:36 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:46 gyros last message repeated 6 times > > > Feb 14 13:22:47 gyros kernel: 0x003c2300 : 56 : 60 > > > Feb 14 13:22:49 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:50 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:22:51 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:22:55 gyros last message repeated 3 times > > > Feb 14 13:22:56 gyros kernel: 0x005a2300 : 86 : 90 > > > Feb 14 13:22:58 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:23:00 gyros kernel: 0x006e2300 : 106 : 110 > > > Feb 14 13:23:00 gyros kernel: 0x00c12300 : 189 : 193 > > > Feb 14 13:23:02 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:23:03 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:23:03 gyros kernel: 0x01602300 : 348 : 352 > > > Feb 14 13:23:05 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:23:06 gyros kernel: 0x01002300 : 252 : 256 > > > Feb 14 13:23:07 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:23:08 gyros kernel: 0x003c2100 : 56 : 60 > > > Feb 14 13:23:09 gyros kernel: 0x003c2100 : 56 : 60 > > > Feb 14 13:23:09 gyros kernel: 0x003c2300 : 56 : 60 > > > Feb 14 13:23:10 gyros kernel: 0x00622100 : 94 : 98 > > > Feb 14 13:23:11 gyros kernel: 0x004a2100 : 70 : 74 > > > Feb 14 13:23:13 gyros kernel: 0x00c12300 : 189 : 193 > > > Feb 14 13:23:14 gyros kernel: 0x003e2100 : 58 : 62 > > > Feb 14 13:23:14 gyros kernel: 0x006e2300 : 106 : 110 > > > > > > Additionally, while I wasn't seeing a large number of interrupts, I > > > tried disabling MSI/MSI-X just as a test, and that had no effect. > > > Netstat-wise, I have currently received 5645 packets with 847 input > > > errors. TCP-wise, I have received 3447 TCP packets with 334 > > > out-of-order packets. > > > > > > > Hmm, this is very strange to me. > > If the packet is normal ICMP echo request packet its packet length > > on receiver side should be 98 bytes(14(ethernet hdr) + 20(IP hdr) + > > 8(icmp hdr) + 56(icmp data)). However the output shows various > > packet length ranging from 56 to 590. In addition msk(4) showed the > > received packet length differences between MAC and host and all those > > packets were VLAN tagged packet. Do you use VLAN on your environments? > > > > Assuming you've just sent non-VLAN tagged ICMP echo request packet > > it would be the result of speed/duplex mismatch. > > I moved to a switch over which I had control, and set the port to auto, > msk0 configured itself to 100BaseTX/full, and the input errors stopped. > > The current switch is an old Cisco 2924XL (10/100 port). The previous > switch was most likely a Cisco 6500 with a 10/100/1000 port (set to > auto). So the msk interface must not have liked what the 6500 was doing > negotiation wise on its gigabit port. Either that, or we have a bug in > the version of code running on that switch. > Does the other GigE work without issues on Cisco 6500? The msk(4) can have a bug with autonegotiation but I've never seen negotiation mismatches on msk(4). Whilst writing the driver I've checked speed/link negotiation against gigabit switch and directly connected GigE and I found nothing unusual. Of course, that does not necessarily mean msk(4) is perfect for link negotiation. Because you've said myk(4) works well on Cisco 6500 I have to diagnose the issue. When setting the link manually on gigabit environments, nomally one side should be master and the other the slave so how about forcing master bit on msk(4) side? #ifconfig msk0 media 1000baseTX mediaopt full-duplex link0 ^^^^^ -- Regards, Pyun YongHyeon