From owner-freebsd-net@freebsd.org Sat Sep 30 18:36:27 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A1182E2CB31 for ; Sat, 30 Sep 2017 18:36:27 +0000 (UTC) (envelope-from leeb@ratnaling.org) Received: from mail-it0-x235.google.com (mail-it0-x235.google.com [IPv6:2607:f8b0:4001:c0b::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 450BD77C2F for ; Sat, 30 Sep 2017 18:36:27 +0000 (UTC) (envelope-from leeb@ratnaling.org) Received: by mail-it0-x235.google.com with SMTP id c195so3190367itb.4 for ; Sat, 30 Sep 2017 11:36:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ratnaling-org.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=HxAIab9clItr7abKwpA3KsIM0G233ss7DKFLXH+smeI=; b=s+ck846rSfBnD3MTxCFBG1Ibyuds+OkST+NI7AiyPxaULFmlrc71+0tXbv4p0Iensv z1UyM3R83LBMEoQlk7+beKdAT6gyGf4A3AJbahiysaGDnUVvN1op+10Gkt+rXFqWAADC EcVv/E60qM+JSFFz1Y9E4q9Q6YFHAnPlqpR+RlaXZZG1dDFpyfj+XwIztiraO+TO1Tba 28ACKUTfi1GhBIbYahsaXZv4S3AZoMVMQU2TGGU9ghe/pGeZPsUMHuBnTfImJ5iYIUnf pJGJKgB2s4nnK75iumk4RKBt8iP6e43eAP4wNqwirepyGYl0gKviDdaXEQ+yb+Q+tAH7 bDDA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=HxAIab9clItr7abKwpA3KsIM0G233ss7DKFLXH+smeI=; b=HAtWl7iWO5t8EryQ8cgOMKnKqKBZiF+qSMAk+ZniunGG/7xaGQjA4I/SCywS9aP62M Zs5Tb8f1R0jdNYMIkDssi67lRvyGDovpY4EqiAbzqICI6x2sCBrBsWbal0RidYCwTjdA iH5NqU4kVQF2bxbdthOJvoPsJiZyWRBBoQMGX9RTLNGaEaJynsf/mgMwDw34Sljt1ETS DpJIIq0fcSneFVBo9y+UJRy1eRobpNH06JFxCJrFvoQdd2CSPO7U1OTH2ySZ0x/Ppj4r 0p9Nn1KnH8gDd/ExMDEr/zunP3mIOpSEzlXX1HQNTnwz4aIB3SDoapS3m4cFXHJ/WR2M t66w== X-Gm-Message-State: AHPjjUgZ+PosnI660nztR8nqjqcE4cITffy3KaQYvE5Y2e7BcmG0o9F4 cZe/DO8KeirqHZ409gqIkJyxI4mjgXKIeotODkhdVUWu X-Google-Smtp-Source: AOwi7QDVCqZM6FS38enIjwVG7KonGEQETUrKQUkKMlrCaLYYmaNXwnyM/DKmrOmoapmzN75eWe9/e39fEC8NrdACDXk= X-Received: by 10.36.74.66 with SMTP id k63mr12071063itb.133.1506796585098; Sat, 30 Sep 2017 11:36:25 -0700 (PDT) MIME-Version: 1.0 Received: by 10.79.164.14 with HTTP; Sat, 30 Sep 2017 11:36:24 -0700 (PDT) In-Reply-To: References: From: Lee Brown Date: Sat, 30 Sep 2017 11:36:24 -0700 Message-ID: Subject: Re: Problem with igb NIC on fresh 11 Install To: freebsd-net Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Sep 2017 18:36:27 -0000 It looks like the driver is not passing packets from the VLAN layer to the NIC. Switch counters verify this and netstat seems to indicate the same. Apologies for any mistakes in the text, i had to convert from an image (attached). I've tried toggling flags on the igb interface (txcsum, hwtag, etc.) and nothing makes a difference. root@rtr-net-r1: - # netstat WI igb0 Name Mtu Network Address Ipkts lerrs Idrop Opkts 0 errs Coll igb0. 1500 ac:1f:6b:14:99:20 0 0 0 0 0 0 root@rtr-net-r1: - # netstat WI vlan202 Name Mtu Network Address Ipkts lerrs Idrop Opkts Oerrs Coll vlan202 1500 ac:1f:6b:14:99:20 0 0 0 0 2679 0 vlan202 - 10.1.202.0/24 10.1.202.123 0 - - 2678 *VLAN202 at the address layer has Opkts, but at the link layer it has Oerrs.* igb show no packets and tcpdump verifies this. root@rtr-net-r1: - # ipfw -a list 65534 3940 334356 allow log ip from any to any 65535 0 0 deny ip from any to any root@rtr-net-r1: - # ifconfig igb0 igb0: flags=8c02 metric 0 mtu 1500 options=4002a8 ether ac:1f:6b:14:99:20 hwaddr ac:1f:6b:14:99:20 nd6 options=29 media: Ethernet autoselect (1000baseT ) status: active root@rtr-net-r1: - # ifconfig vlan202 vlan202: flags=8843 metric 0 mtu 1500 ether ac:1f:6b:14:99:20 inet 10.1.202.123 netmask Oxffffff00 broadcast 10.1.202.255 nd6 options=29 media: Ethernet autoselect (1000baseT ) status: active igb0@pci0:1:0:0: class=0x020000 card=0x153315d9 chip=0x15338086 rev=0x03 hdr=0x00 vendor Intel Corporation device = '1210 Gigabit Network Connection' class network subclass = ethernet bar [10] = type Memory, range 32, base 0xdf400000, size 524288, enabled bar [18] = type I/O Port, range 32, base Oxe000, size 32, enabled bar [1c] = type Memory, range 32, base Oxdf480000, size 16384, enabled cap 01[40] = powerspec 3 supports DO D3 current DO cap 05[50] = MSI supports 1 message, 64 bit, vector masks cap 11[70] = MSI-X supports 5 messages, enabled Table in map Ox1c[0x0], PBR in map Ox1c[0x2000] cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR NS link x1(x1) speed 2.5(2.5) RSPM L1(L0s/L1) ecap 0001[100] = REP 2 0 fatal 0 nonfatal 1 corrected ecap 0003[140] = Serial 1 ac1f6bffff149920 ecap 0017[1a0] = TPH Requester 1 igb1@pci0:2:0:0: class=0x020000 card=0x153315d9 chip=0x15338086 rev=0x03 hdr=0x00 vendor Intel Corporation device = '1210 Gigabit Network Connection' class network subclass = ethernet bar [10] = type Memory, range 32, base Oxdf300000, size 524288, enabled bar [18] = type I/O Port, range 32, base Oxd000, size 32, enabled bar [1c] = type Memory, range 32, base Oxdf380000, size 16384, enabled cap 01[40] = powerspec 3 supports DO D3 current DO cap 05[50] = MSI supports 1 message, 61 bit, vector masks On Fri, Sep 29, 2017 at 8:14 PM, Lee Brown wrote: > Hi, > > I've been using FreeBSD for years, so I'm familiar with the setup. > > I just got a server, supermicro motherboard, 4 intel NICs, installed the > FreeBSD-11.1-RELEASE-amd64-disc1. uname reports FreeBSD11.1-RELEASE #0 > 321309. > > Unfortunately the igb NIC's don't appear to work correctly. With no VLAN > igb0 and igb3 (the only two I tried) will transmit packets but not receive > them (switch sees the MAC, destination host sees packet). If I turn on > VLAN, then nothing is transmitted either (the switch never sees a MAC > address on the port). > > I've certified two cables, neither makes a difference. > > Occasionally the ports don't detect the cable has been removed and still > reads active instead of no carrier. > > Feels like a driver problem....any clues? Tomorrow I'll try a direct > cable into a laptop, then failing that I suppose I'll svn the latest 11.1 > source and start building a new world. > > Appreciate any help folk can provide -- lee >