From owner-freebsd-net@FreeBSD.ORG Mon Nov 24 07:06:58 2014 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 802244BC for ; Mon, 24 Nov 2014 07:06:58 +0000 (UTC) Received: from umail.aei.mpg.de (umail.aei.mpg.de [194.94.224.6]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D47A8638 for ; Mon, 24 Nov 2014 07:06:57 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by umail.aei.mpg.de (Postfix) with ESMTP id 6C31C200BB4; Mon, 24 Nov 2014 08:06:48 +0100 (CET) X-Virus-Scanned: by amavisd-new-2.6.4 (20090625) (Debian) at aei.mpg.de Received: from umail.aei.mpg.de ([127.0.0.1]) by localhost (umail.aei.mpg.de [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0wy5wcxkO9mN; Mon, 24 Nov 2014 08:06:48 +0100 (CET) Received: from mailgate.aei.mpg.de (mailgate.aei.mpg.de [194.94.224.5]) by umail.aei.mpg.de (Postfix) with ESMTP id 21F50200BB1; Mon, 24 Nov 2014 08:06:48 +0100 (CET) Received: from mailgate.aei.mpg.de (localhost [127.0.0.1]) by localhost (Postfix) with SMTP id 11FAC405889; Mon, 24 Nov 2014 08:06:48 +0100 (CET) Received: from intranet.aei.uni-hannover.de (ahin1.aei.uni-hannover.de [130.75.117.40]) by mailgate.aei.mpg.de (Postfix) with ESMTP id AF59B406AF1; Mon, 24 Nov 2014 08:06:47 +0100 (CET) Received: from arc.aei.uni-hannover.de ([10.117.15.110]) by intranet.aei.uni-hannover.de (Lotus Domino Release 8.5.3FP6HF1016) with ESMTP id 2014112408063724-20217 ; Mon, 24 Nov 2014 08:06:37 +0100 Date: Mon, 24 Nov 2014 08:06:37 +0100 From: Gerrit =?ISO-8859-1?Q?K=FChn?= To: Jack Vogel Subject: Re: igb Could not setup receive structures (again) Message-Id: <20141124080637.75dc6f55a499b88014a03a03@aei.mpg.de> In-Reply-To: References: <20141121114852.8b7d9a6c071c3e0799d5f30c@aei.mpg.de> <20141121183306.d057ff1743e2a1e04ae55f93@aei.mpg.de> Organization: Max Planck Gesellschaft X-Mailer: Sylpheed 3.4.2 (GTK+ 2.24.22; amd64-portbld-freebsd10.0) Mime-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on intranet/aei-hannover(Release 8.5.3FP6HF1016 | October 31, 2014) at 24.11.2014 08:06:37, Serialize by Router on intranet/aei-hannover(Release 8.5.3FP6HF1016 | October 31, 2014) at 24.11.2014 08:06:47, Serialize complete at 24.11.2014 08:06:47 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII X-PMX-Version: 6.0.2.2308539, Antispam-Engine: 2.7.2.2107409, Antispam-Data: 2014.11.24.65420 X-PerlMx-Spam: Gauge=IIIIIIII, Probability=8%, Report=' HTML_00_01 0.05, HTML_00_10 0.05, MIME_LOWER_CASE 0.05, BODY_SIZE_10000_PLUS 0, REFERENCES 0, __ANY_URI 0, __BOUNCE_CHALLENGE_SUBJ 0, __BOUNCE_NDR_SUBJ_EXEMPT 0, __C230066_P5 0, __CP_MEDIA_BODY 0, __CT 0, __CTE 0, __CT_TEXT_PLAIN 0, __FRAUD_BODY_WEBMAIL 0, __FRAUD_CONTACT_ADDY_B 0, __FRAUD_WEBMAIL 0, __HAS_FROM 0, __HAS_MSGID 0, __HAS_X_MAILER 0, __IN_REP_TO 0, __MIME_TEXT_ONLY 0, __MIME_VERSION 0, __REFERENCES 0, __SANE_MSGID 0, __STOCK_PHRASE_24 0, __SUBJ_ALPHA_NEGATE 0, __TO_MALFORMED_2 0, __URI_NO_PATH 0, __URI_NO_WWW 0, __URI_NS ' Cc: FreeBSD Net X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Nov 2014 07:06:58 -0000 On Fri, 21 Nov 2014 13:01:23 -0800 Jack Vogel wrote about Re: igb Could not setup receive structures (again): JV> Yes, its strange, the mbuf resources look fine. JV> Can you show the dmesg record from a boot that JV> includes the failure please? Well, the machine is in production, I cannot boot it right now. However, here is the latest dmesg from /var/run: --- Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-STABLE #5 r261710: Mon Feb 10 16:55:29 CET 2014 root@mclane.rt.aei.uni-hannover.de:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 CPU: Intel(R) Xeon(R) CPU E5-2609 v2 @ 2.50GHz (2500.05-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x306e4 Family = 0x6 Model = 0x3e Stepping = 4 Features=0xbfebfbff Features2=0x7fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 Standard Extended Features=0x281 TSC: P-state invariant, performance statistics real memory = 17196646400 (16400 MB) avail memory = 16523558912 (15758 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: < > FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard kbd1 at kbdmux0 random: initialized cryptosoft0: on motherboard aesni0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 550 Event timer "HPET1" frequency 14318180 Hz quality 440 Event timer "HPET2" frequency 14318180 Hz quality 440 Event timer "HPET3" frequency 14318180 Hz quality 440 Event timer "HPET4" frequency 14318180 Hz quality 440 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 26 at device 1.0 on pci0 pci1: on pcib1 pcib2: irq 26 at device 1.1 on pci0 pci2: on pcib2 igb0: port 0xe020-0xe03f mem 0xfbb20000-0xfbb3ffff,0xfbb44000-0xfbb47fff irq 27 at device 0.0 on pci2 igb0: Using MSIX interrupts with 5 vectors igb0: Ethernet address: 00:25:90:c5:db:56 igb0: Bound queue 0 to cpu 0 igb0: Bound queue 1 to cpu 1 igb0: Bound queue 2 to cpu 2 igb0: Bound queue 3 to cpu 3 igb1: port 0xe000-0xe01f mem 0xfbb00000-0xfbb1ffff,0xfbb40000-0xfbb43fff irq 30 at device 0.1 on pci2 igb1: Using MSIX interrupts with 5 vectors igb1: Ethernet address: 00:25:90:c5:db:57 igb1: Bound queue 0 to cpu 0 igb1: Bound queue 1 to cpu 1 igb1: Bound queue 2 to cpu 2 igb1: Bound queue 3 to cpu 3 pcib3: irq 33 at device 2.0 on pci0 pci4: on pcib3 mps0: port 0xd000-0xd0ff mem 0xfba9c000-0xfba9ffff,0xfba40000-0xfba7ffff irq 32 at device 0.0 on pci4 mps0: Firmware: 17.00.01.00, Driver: 16.00.00.00-fbsd mps0: IOCCapabilities: 1285c pcib4: irq 33 at device 2.2 on pci0 pci5: on pcib4 pcib5: irq 41 at device 3.0 on pci0 pci6: on pcib5 pcib6: mem 0xfb700000-0xfb71ffff irq 40 at device 0.0 on pci6 pci7: on pcib6 pcib7: irq 44 at device 1.0 on pci7 pci8: on pcib7 igb2: port 0xb020-0xb03f mem 0xfb5a0000-0xfb5bffff,0xfb580000-0xfb59ffff,0xfb644000-0xfb647fff irq 44 at device 0.0 on pci8 igb2: Using MSIX interrupts with 5 vectors igb2: Ethernet address: 00:25:90:c8:3a:48 igb2: Bound queue 0 to cpu 0 igb2: Bound queue 1 to cpu 1 igb2: Bound queue 2 to cpu 2 igb2: Bound queue 3 to cpu 3 igb3: port 0xb000-0xb01f mem 0xfb540000-0xfb55ffff,0xfb520000-0xfb53ffff,0xfb640000-0xfb643fff irq 45 at device 0.1 on pci8 igb3: Using MSIX interrupts with 5 vectors igb3: Ethernet address: 00:25:90:c8:3a:49 igb3: Bound queue 0 to cpu 0 igb3: Bound queue 1 to cpu 1 igb3: Bound queue 2 to cpu 2 igb3: Bound queue 3 to cpu 3 pcib8: irq 45 at device 2.0 on pci7 pci10: on pcib8 igb4: port 0xa020-0xa03f mem 0xfb3a0000-0xfb3bffff,0xfb380000-0xfb39ffff,0xfb444000-0xfb447fff irq 45 at device 0.0 on pci10 igb4: Using MSIX interrupts with 5 vectors igb4: Ethernet address: 00:25:90:c8:3a:4a igb4: Bound queue 0 to cpu 0 igb4: Bound queue 1 to cpu 1 igb4: Bound queue 2 to cpu 2 igb4: Bound queue 3 to cpu 3 igb5: port 0xa000-0xa01f mem 0xfb340000-0xfb35ffff,0xfb320000-0xfb33ffff,0xfb440000-0xfb443fff irq 46 at device 0.1 on pci10 igb5: Using MSIX interrupts with 5 vectors igb5: Ethernet address: 00:25:90:c8:3a:4b igb5: Bound queue 0 to cpu 0 igb5: Bound queue 1 to cpu 1 igb5: Bound queue 2 to cpu 2 igb5: Bound queue 3 to cpu 3 pcib9: irq 41 at device 3.2 on pci0 pci12: on pcib9 pci0: at device 4.0 (no driver attached) pci0: at device 4.1 (no driver attached) pci0: at device 4.2 (no driver attached) pci0: at device 4.3 (no driver attached) pci0: at device 4.4 (no driver attached) pci0: at device 4.5 (no driver attached) pci0: at device 4.6 (no driver attached) pci0: at device 4.7 (no driver attached) pci0: at device 5.0 (no driver attached) pci0: at device 5.2 (no driver attached) pcib10: irq 16 at device 17.0 on pci0 pci13: on pcib10 isci0: port 0xc000-0xc0ff mem 0xfa47c000-0xfa47ffff,0xfa000000-0xfa3fffff irq 16 at device 0.0 on pci13 pci0: at device 22.0 (no driver attached) pci0: at device 22.1 (no driver attached) ehci0: mem 0xfbc23000-0xfbc233ff irq 16 at device 26.0 on pci0 usbus0: EHCI version 1.0 usbus0 on ehci0 pcib11: irq 17 at device 28.0 on pci0 pci14: on pcib11 pcib12: irq 19 at device 28.7 on pci0 pci15: on pcib12 pcib13: at device 0.0 on pci15 pci16: on pcib13 pcib14: at device 0.0 on pci16 pci17: on pcib14 pcib15: at device 0.0 on pci17 pci18: on pcib15 vgapci0: mem 0xf9000000-0xf9ffffff,0xfb000000-0xfb003fff,0xfa800000-0xfaffffff irq 19 at device 0.0 on pci18 vgapci0: Boot video device pcib16: at device 1.0 on pci16 pci19: on pcib16 ehci1: mem 0xfbc22000-0xfbc223ff irq 23 at device 29.0 on pci0 usbus1: EHCI version 1.0 usbus1 on ehci1 pcib17: at device 30.0 on pci0 pci20: on pcib17 isab0: at device 31.0 on pci0 isa0: on isab0 ahci0: port 0xf050-0xf057,0xf040-0xf043,0xf030-0xf037,0xf020-0xf023,0xf000-0xf01f mem 0xfbc21000-0xfbc217ff irq 18 at device 31.2 on pci0 ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahcich4: at channel 4 on ahci0 ahcich5: at channel 5 on ahci0 ahciem0: on ahci0 pci0: at device 31.3 (no driver attached) pci0: at device 31.6 (no driver attached) pcib18: on acpi0 pci255: on pcib18 pci255: at device 8.0 (no driver attached) pci255: at device 9.0 (no driver attached) pci255: at device 10.0 (no driver attached) pci255: at device 10.1 (no driver attached) pci255: at device 10.2 (no driver attached) pci255: at device 10.3 (no driver attached) pci255: at device 11.0 (no driver attached) pci255: at device 11.3 (no driver attached) pci255: at device 12.0 (no driver attached) pci255: at device 12.1 (no driver attached) pci255: at device 13.0 (no driver attached) pci255: at device 13.1 (no driver attached) pci255: at device 14.0 (no driver attached) pci255: at device 14.1 (no driver attached) pci255: at device 15.0 (no driver attached) pci255: at device 15.1 (no driver attached) pci255: at device 15.2 (no driver attached) pci255: at device 15.3 (no driver attached) pci255: at device 15.4 (no driver attached) pci255: at device 15.5 (no driver attached) pci255: at device 16.0 (no driver attached) pci255: at device 16.1 (no driver attached) pci255: at device 16.2 (no driver attached) pci255: at device 16.3 (no driver attached) pci255: at device 16.4 (no driver attached) pci255: at device 16.5 (no driver attached) pci255: at device 16.6 (no driver attached) pci255: at device 16.7 (no driver attached) pci255: at device 19.0 (no driver attached) pci255: at device 19.1 (no driver attached) pci255: at device 19.4 (no driver attached) pci255: at device 19.5 (no driver attached) pci255: at device 22.0 (no driver attached) pci255: at device 22.1 (no driver attached) pci255: at device 22.2 (no driver attached) acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 orm0: at iomem 0xc0000-0xc7fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ppc0: cannot reserve I/O port range est0: on cpu0 p4tcc0: on cpu0 est1: on cpu1 p4tcc1: on cpu1 est2: on cpu2 p4tcc2: on cpu2 est3: on cpu3 p4tcc3: on cpu3 Timecounters tick every 1.000 msec random: unblocking device. usbus0: 480Mbps High Speed USB v2.0 usbus1: 480Mbps High Speed USB v2.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered ada0 at ahcich2 bus 0 scbus4 target 0 lun 0 ada0: ATA-7 SATA 2.x device ada0: Serial Number 99026130913030000295 ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 512bytes) ada0: 7551MB (15465744 512 byte sectors: 16H 63S/T 15343C) ada0: Previously was known as ad8 ada1 at ahcich3 bus 0 scbus5 target 0 lun 0 ada1: ATA-7 SATA 2.x device ada1: Serial Number 99026130913030000296 ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 512bytes) ada1: 7551MB (15465744 512 byte sectors: 16H 63S/T 15343C) ada1: Previously was known as ad10 ses0 at ahciem0 bus 0 scbus8 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device cd0 at ahcich5 bus 0 scbus7 target 0 lun 0 cd0: Removable CD-ROM SCSI-0 device cd0: Serial Number KY4D4CN0946 cd0: 150.000MB/s transfers (SATA 1.x, UDMA6, ATAPI 12bytes, PIO 8192bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed da5 at mps0 bus 0 scbus0 target 5 lun 0 da5: Fixed Direct Access SCSI-6 device da5: Serial Number BTDA329102LM1802GN da5: 600.000MB/s transfers da5: Command Queueing enabled da5: 171705MB (351651888 512 byte sectors: 255H 63S/T 21889C) da5: quirks=0x8<4K> da6 at mps0 bus 0 scbus0 target 6 lun 0 da6: Fixed Direct Access SCSI-6 device da6: Serial Number BTDA328500BF1802GN da6: 600.000MB/s transfers da6: Command Queueing enabled da6: 171705MB (351651888 512 byte sectors: 255H 63S/T 21889C) da6: quirks=0x8<4K> da7 at mps0 bus 0 scbus0 target 7 lun 0 da7: Fixed Direct Access SCSI-6 device da7: Serial Number BTDA3285031U1802GN da7: 600.000MB/s transfers da7: Command Queueing enabled da7: 171705MB (351651888 512 byte sectors: 255H 63S/T 21889C) da7: quirks=0x8<4K> da3 at mps0 bus 0 scbus0 target 3 lun 0 da3: Fixed Direct Access SCSI-6 device da3: Serial Number CVKI336202CG080AGN da3: 600.000MB/s transfers da3: Command Queueing enabled da3: 76319MB (156301488 512 byte sectors: 255H 63S/T 9729C) da3: quirks=0x8<4K> da0 at mps0 bus 0 scbus0 target 0 lun 0 da0: Fixed Direct Access SCSI-6 device da0: Serial Number BTDA328306M61802GN da0: 600.000MB/s transfers da0: Command Queueing enabled da0: 171705MB (351651888 512 byte sectors: 255H 63S/T 21889C) da0: quirks=0x8<4K> da1 at mps0 bus 0 scbus0 target 1 lun 0 da1: Fixed Direct Access SCSI-6 device da1: Serial Number BTDA3292018J1802GN da1: 600.000MB/s transfers da1: Command Queueing enabled da1: 171705MB (351651888 512 byte sectors: 255H 63S/T 21889C) da1: quirks=0x8<4K> da2 at mps0 bus 0 scbus0 target 2 lun 0 da2: Fixed Direct Access SCSI-6 device da2: Serial Number CVKI336202BT080AGN da2: 600.000MB/s transfers da2: Command Queueing enabled da2: 76319MB (156301488 512 byte sectors: 255H 63S/T 9729C) da2: quirks=0x8<4K> da4 at mps0 bus 0 scbus0 target 4 lun 0 da4: Fixed Direct Access SCSI-6 device da4: Serial Number BTDA328505JS1802GN da4: 600.000MB/s transfers da4: Command Queueing enabled da4: 171705MB (351651888 512 byte sectors: 255H 63S/T 21889C) da4: quirks=0x8<4K> Netvsc initializing... SMP: AP CPU #3 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! Timecounter "TSC-low" frequency 1250025326 Hz quality 1000 ugen0.2: at usbus0 uhub2: on usbus0 ugen1.2: at usbus1 uhub3: on usbus1 uhub2: 6 ports with 6 removable, self powered uhub3: 8 ports with 8 removable, self powered ugen0.3: at usbus0 ukbd0: on usbus0 kbd2 at ukbd0 ugen1.3: at usbus1 ukbd1: on usbus1 kbd3 at ukbd1 ugen1.4: at usbus1 umass0: on usbus1 umass0: SCSI over Bulk-Only; quirks = 0x4000 umass0:9:0:-1: Attached to scbus9 da8 at umass-sim0 bus 0 scbus9 target 0 lun 0 da8: Fixed Direct Access SCSI-0 device da8: Serial Number 9900210100751207 da8: 40.000MB/s transfers da8: 1960MB (4014080 512 byte sectors: 255H 63S/T 249C) da8: quirks=0x2 GEOM_STRIPE: Device swap created (id=350651771). GEOM_STRIPE: Disk da2p2 attached to swap. GEOM_MIRROR: Device mirror/boot launched (2/2). GEOM_STRIPE: Disk da3p2 attached to swap. GEOM_STRIPE: Device stripe/swap activated. GEOM_MIRROR: Device mirror/root launched (1/2). GEOM_MIRROR: Device root: rebuilding provider da3p3. GEOM_STRIPE: Cannot add disk gpt/swap1 to swap (error=17). GEOM_STRIPE: Cannot add disk gptid/b8d53ca0-67f2-11e3-93e3-002590c5db56 to swap (error=17). GEOM_STRIPE: Cannot add disk gpt/swap0 to swap (error=17). GEOM_STRIPE: Cannot add disk gptid/b521fb2f-67f2-11e3-93e3-002590c5db56 to swap (error=17). Trying to mount root from ufs:/dev/mirror/root [rw]... WARNING: / was not properly dismounted ZFS filesystem version: 5 ZFS storage pool version: features support (5000) ums0: on usbus0 ums0: 3 buttons and [XYZ] coordinates ID=0 ums1: on usbus1 ums1: 5 buttons and [XYZ] coordinates ID=1 igb0: link state changed to UP arp: 10.117.0.1 moved from 00:1a:8c:f0:14:e1 to 00:1a:8c:f0:14:e0 on igb0 --- Only 4 cores (I think I said 6 before, my bad). Trying to set mtu 9000 yields these messages: --- Nov 21 11:16:42 mclane kernel: igb1: link state changed to UP Nov 21 11:16:42 mclane devd: Executing '/etc/rc.d/dhclient quietstart igb1' Nov 21 11:17:10 mclane kernel: igb1: link state changed to DOWN Nov 21 11:17:10 mclane kernel: igb1: Could not setup receive structures Nov 21 11:17:36 mclane kernel: igb1: Could not setup receive structures --- This was using rc.conf and rc.d scripts, but I get the same messages when doing that manually with just ifconfig. cu Gerrit