From owner-freebsd-net@FreeBSD.ORG Wed Feb 13 08:52:53 2008 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1070516A420 for ; Wed, 13 Feb 2008 08:52:53 +0000 (UTC) (envelope-from kip.macy@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.180]) by mx1.freebsd.org (Postfix) with ESMTP id DAF4113C46B for ; Wed, 13 Feb 2008 08:52:52 +0000 (UTC) (envelope-from kip.macy@gmail.com) Received: by wa-out-1112.google.com with SMTP id k17so3199304waf.3 for ; Wed, 13 Feb 2008 00:52:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=Kw2Vw8uqI+4pkn88Cu3lTmlbwHz4Bt0Z8NONAvJmwxc=; b=hfWKuFbWKswipDx5a9WEb+f2I+o/D1qkrHgunHIM+hYT0rM5/T6E3pHQZMgZy9hj+iVofFRWSwjZ9HPzakzjzcXx4u7mTz13XDEUjtxLbfvHq/oi9muPL9eS9jW1DPVH0d5hQM3qB6erojAp0/t6OxMUkEnzN5vF3aeJDYmfdI4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=fUA13jEtAp5v/gIll9CG65w2LEAmtrTzkafLzSW7qX67VvpRSX/isv49+MjJEiLypW16wq/4qL6IA5UPlcN3/UrhAKYqHdglFUPnC11FXv0I8D7vNJZP6ujqrS+KVUfw105ELeOmIRAMheDt4rAFBKdNGn6SehgSsTagdJQgH40= Received: by 10.114.120.1 with SMTP id s1mr2624861wac.107.1202892772508; Wed, 13 Feb 2008 00:52:52 -0800 (PST) Received: by 10.115.22.10 with HTTP; Wed, 13 Feb 2008 00:52:52 -0800 (PST) Message-ID: Date: Wed, 13 Feb 2008 00:52:52 -0800 From: "Kip Macy" To: gnn@freebsd.org In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: Cc: current@freebsd.org, net@freebsd.org Subject: Re: Problems with Chelsio driver in CURRENT... X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Feb 2008 08:52:53 -0000 Oops sorry ... What is the output of 'sysctl dev.cxgbc.0'? -Kip On Feb 13, 2008 12:51 AM, Kip Macy wrote: > When you say a "recent kernel/world", I take it you're still running 7.0? > > -Kip > > > > > > On Feb 12, 2008 11:38 PM, wrote: > > Hi, > > > > I have two MP/Multicore Xeon boxes with CX4 based Chelsio cards in > > them. If I boot 7.0-RC1 the cards can talk to each other. If I build > > a recent kernel/world (for instance from today) I cannot ping between > > them. I have tried using GENERIC as wella as a custom kernel. > > > > kodama8# ifconfig cxgb0 > > cxgb0: flags=8843 metric 0 mtu 9000 > > options=1bb > > ether 00:07:43:05:20:68 > > inet 172.16.0.2 netmask 0xffffff00 broadcast 172.16.0.255 > > media: Ethernet 10Gbase-CX4 (autoselect ) > > status: active > > kodama8# ping 172.16.0.1 > > PING 172.16.0.1 (172.16.0.1): 56 data bytes > > ^C > > --- 172.16.0.1 ping statistics --- > > 5 packets transmitted, 0 packets received, 100.0% packet loss > > kodama8# > > > > kodama$ uname -a > > FreeBSD kodama8.neville-neil.comA 7.0-RC1 FreeBSD 7.0-RC1 #0: Mon Dec 24 10:10:07 UTC 2007 root@driscoll.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 > > kodama8# > > > > nozomi8# ifconfig cxgb0 > > cxgb0: flags=8843 metric 0 mtu 9000 > > options=1bb > > ether 00:07:43:05:20:43 > > inet 172.16.0.1 netmask 0xffffff00 broadcast 172.16.0.255 > > media: Ethernet 10Gbase-CX4 (autoselect ) > > status: active > > nozomi8# > > > > nozomi8# uname -a > > FreeBSD nozomi8.neville-neil.com 8.0-CURRENT FreeBSD 8.0-CURRENT #2: Wed Feb 13 15:47:05 JST 2008 root@nozomi8.neville-neil.com:/usr/obj/scratch/FreeBSD.HEAD/src/sys/GENERIC amd64 > > nozomi8# > > > > > > The dmesg is at the end of this mail. > > > > Thoughts? > > > > Thanks, > > George > > > > > > nozomi8# dmesg > > Copyright (c) 1992-2008 The FreeBSD Project. > > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > > The Regents of the University of California. All rights reserved. > > FreeBSD is a registered trademark of The FreeBSD Foundation. > > FreeBSD 8.0-CURRENT #2: Wed Feb 13 15:47:05 JST 2008 > > root@nozomi8.neville-neil.com:/usr/obj/scratch/FreeBSD.HEAD/src/sys/GENERIC > > WARNING: WITNESS option enabled, expect reduced performance. > > Timecounter "i8254" frequency 1193182 Hz quality 0 > > CPU: Intel(R) Xeon(R) CPU X5355 @ 2.66GHz (2666.68-MHz K8-class CPU) > > Origin = "GenuineIntel" Id = 0x6f7 Stepping = 7 > > Features=0xbfebfbff > > Features2=0x4e3bd > > AMD Features=0x20100800 > > AMD Features2=0x1 > > Cores per package: 4 > > usable memory = 8575602688 (8178 MB) > > avail memory = 8306462720 (7921 MB) > > ACPI APIC Table: > > FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs > > cpu0 (BSP): APIC ID: 0 > > cpu1 (AP): APIC ID: 1 > > cpu2 (AP): APIC ID: 2 > > cpu3 (AP): APIC ID: 3 > > cpu4 (AP): APIC ID: 4 > > cpu5 (AP): APIC ID: 5 > > cpu6 (AP): APIC ID: 6 > > cpu7 (AP): APIC ID: 7 > > ioapic0 irqs 0-23 on motherboard > > ioapic1 irqs 24-47 on motherboard > > kbd1 at kbdmux0 > > ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) > > acpi0: on motherboard > > acpi0: [ITHREAD] > > acpi0: Power Button (fixed) > > Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 > > acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 > > acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 > > Timecounter "HPET" frequency 14318180 Hz quality 900 > > cpu0: on acpi0 > > est0: on cpu0 > > est: CPU supports Enhanced Speedstep, but is not recognized. > > est: cpu_vendor GenuineIntel, msr 82a082a0600082a > > device_attach: est0 attach returned 6 > > p4tcc0: on cpu0 > > cpu1: on acpi0 > > est1: on cpu1 > > est: CPU supports Enhanced Speedstep, but is not recognized. > > est: cpu_vendor GenuineIntel, msr 82a082a0600082a > > device_attach: est1 attach returned 6 > > p4tcc1: on cpu1 > > cpu2: on acpi0 > > est2: on cpu2 > > est: CPU supports Enhanced Speedstep, but is not recognized. > > est: cpu_vendor GenuineIntel, msr 82a082a0600082a > > device_attach: est2 attach returned 6 > > p4tcc2: on cpu2 > > cpu3: on acpi0 > > est3: on cpu3 > > est: CPU supports Enhanced Speedstep, but is not recognized. > > est: cpu_vendor GenuineIntel, msr 82a082a0600082a > > device_attach: est3 attach returned 6 > > p4tcc3: on cpu3 > > cpu4: on acpi0 > > est4: on cpu4 > > est: CPU supports Enhanced Speedstep, but is not recognized. > > est: cpu_vendor GenuineIntel, msr 82a082a0600082a > > device_attach: est4 attach returned 6 > > p4tcc4: on cpu4 > > cpu5: on acpi0 > > est5: on cpu5 > > est: CPU supports Enhanced Speedstep, but is not recognized. > > est: cpu_vendor GenuineIntel, msr 82a082a0600082a > > device_attach: est5 attach returned 6 > > p4tcc5: on cpu5 > > cpu6: on acpi0 > > est6: on cpu6 > > est: CPU supports Enhanced Speedstep, but is not recognized. > > est: cpu_vendor GenuineIntel, msr 82a082a0600082a > > device_attach: est6 attach returned 6 > > p4tcc6: on cpu6 > > cpu7: on acpi0 > > est7: on cpu7 > > est: CPU supports Enhanced Speedstep, but is not recognized. > > est: cpu_vendor GenuineIntel, msr 82a082a0600082a > > device_attach: est7 attach returned 6 > > p4tcc7: on cpu7 > > pcib0: port 0xcf8-0xcff on acpi0 > > pci0: on pcib0 > > pcib1: at device 2.0 on pci0 > > pci1: on pcib1 > > pcib2: irq 16 at device 0.0 on pci1 > > pci2: on pcib2 > > pcib3: irq 16 at device 0.0 on pci2 > > pci3: on pcib3 > > pcib4: at device 0.0 on pci3 > > pci4: on pcib4 > > ahd0: port 0x2400-0x24ff,0x2000-0x20ff mem 0xd8b00000-0xd8b01fff irq 16 at device 2.0 on pci4 > > ahd0: [ITHREAD] > > aic7902: Ultra320 Wide Channel A, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs > > ahd1: port 0x2c00-0x2cff,0x2800-0x28ff mem 0xd8b02000-0xd8b03fff irq 17 at device 2.1 on pci4 > > ahd1: [ITHREAD] > > aic7902: Ultra320 Wide Channel B, SCSI Id=7, PCI-X 67-100Mhz, 512 SCBs > > pcib5: at device 0.2 on pci3 > > pci5: on pcib5 > > pcib6: irq 18 at device 2.0 on pci2 > > pci6: on pcib6 > > em0: port 0x3000-0x301f mem 0xd8a20000-0xd8a3ffff,0xd8a00000-0xd8a1ffff irq 18 at device 0.0 on pci6 > > em0: Using MSI interrupt > > em0: Ethernet address: 00:30:48:64:1e:20 > > em0: [FILTER] > > em1: port 0x3020-0x303f mem 0xd8a60000-0xd8a7ffff,0xd8a40000-0xd8a5ffff irq 19 at device 0.1 on pci6 > > em1: Using MSI interrupt > > em1: Ethernet address: 00:30:48:64:1e:21 > > em1: [FILTER] > > pcib7: at device 0.3 on pci1 > > pci7: on pcib7 > > pcib8: at device 4.0 on pci0 > > pci8: on pcib8 > > pcib9: at device 6.0 on pci0 > > pci9: on pcib9 > > pci9: at device 0.0 (no driver attached) > > pci0: at device 8.0 (no driver attached) > > pcib10: irq 17 at device 28.0 on pci0 > > pci10: on pcib10 > > uhci0: port 0x1800-0x181f irq 17 at device 29.0 on pci0 > > uhci0: [GIANT-LOCKED] > > uhci0: [ITHREAD] > > usb0: on uhci0 > > usb0: USB revision 1.0 > > uhub0: on usb0 > > uhub0: 2 ports with 2 removable, self powered > > uhci1: port 0x1820-0x183f irq 19 at device 29.1 on pci0 > > uhci1: [GIANT-LOCKED] > > uhci1: [ITHREAD] > > usb1: on uhci1 > > usb1: USB revision 1.0 > > uhub1: on usb1 > > uhub1: 2 ports with 2 removable, self powered > > uhci2: port 0x1840-0x185f irq 18 at device 29.2 on pci0 > > uhci2: [GIANT-LOCKED] > > uhci2: [ITHREAD] > > usb2: on uhci2 > > usb2: USB revision 1.0 > > uhub2: on usb2 > > uhub2: 2 ports with 2 removable, self powered > > ehci0: mem 0xd8f00000-0xd8f003ff irq 17 at device 29.7 on pci0 > > ehci0: [GIANT-LOCKED] > > ehci0: [ITHREAD] > > usb3: EHCI version 1.0 > > usb3: companion controllers, 2 ports each: usb0 usb1 usb2 > > usb3: on ehci0 > > usb3: USB revision 2.0 > > uhub3: on usb3 > > uhub3: 6 ports with 6 removable, self powered > > pcib11: at device 30.0 on pci0 > > pci11: on pcib11 > > vgapci0: port 0x4000-0x40ff mem 0xd0000000-0xd7ffffff,0xd8c00000-0xd8c0ffff irq 18 at device 1.0 on pci11 > > isab0: at device 31.0 on pci0 > > isa0: on isab0 > > atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1860-0x186f at device 31.1 on pci0 > > ata0: on atapci0 > > ata0: [ITHREAD] > > ata1: on atapci0 > > ata1: [ITHREAD] > > pci0: at device 31.3 (no driver attached) > > acpi_button0: on acpi0 > > atkbdc0: port 0x60,0x64 irq 1 on acpi0 > > atkbd0: irq 1 on atkbdc0 > > kbd0 at atkbd0 > > atkbd0: [GIANT-LOCKED] > > atkbd0: [ITHREAD] > > sio0: configured irq 4 not in bitmap of probed irqs 0 > > sio0: port may not be enabled > > sio0: configured irq 4 not in bitmap of probed irqs 0 > > sio0: port may not be enabled > > sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > > sio0: type 16550A, console > > sio0: [FILTER] > > sio1: configured irq 3 not in bitmap of probed irqs 0 > > sio1: port may not be enabled > > sio1: configured irq 3 not in bitmap of probed irqs 0 > > sio1: port may not be enabled > > sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 > > sio1: type 16550A > > sio1: [FILTER] > > fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 > > fdc0: [FILTER] > > ppc0: port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on acpi0 > > ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode > > ppc0: FIFO with 16/16/9 bytes threshold > > ppbus0: on ppc0 > > ppbus0: [ITHREAD] > > plip0: on ppbus0 > > lpt0: on ppbus0 > > lpt0: Interrupt-driven port > > ppi0: on ppbus0 > > ppc0: [GIANT-LOCKED] > > ppc0: [ITHREAD] > > orm0: at iomem 0xc0000-0xcafff on isa0 > > sc0: at flags 0x100 on isa0 > > sc0: VGA <16 virtual consoles, flags=0x100> > > vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > > Timecounters tick every 1.000 msec > > Waiting 5 seconds for SCSI devices to settle > > acd0: DVDROM at ata0-slave UDMA33 > > da0 at ahd0 bus 0 target 0 lun 0 > > da0: Fixed Direct Access SCSI-3 device > > da0: 160.000MB/s transfers (80.000MHz DT, offset 63, 16bit) > > da0: Command Queueing Enabled > > da0: 140014MB (286749488 512 byte sectors: 255H 63S/T 17849C) > > SMP: AP CPU #1 Launched! > > SMP: AP CPU #2 Launched! > > SMP: AP CPU #3 Launched! > > SMP: AP CPU #5 Launched! > > SMP: AP CPU #6 Launched! > > SMP: AP CPU #7 Launched! > > SMP: AP CPU #4 Launched! > > WARNING: WITNESS option enabled, expect reduced performance. > > lock order reversal: > > 1st 0xffffff0003426e28 devfs (devfs) @ /scratch/FreeBSD.HEAD/src/sys/kern/vfs_subr.c:2061 > > 2nd 0xffffff000348fda0 devfsmount (devfsmount) @ /scratch/FreeBSD.HEAD/src/sys/fs/devfs/devfs_vnops.c:201 > > KDB: stack backtrace: > > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > > witness_checkorder() at witness_checkorder+0x605 > > _sx_xlock() at _sx_xlock+0x52 > > devfs_allocv() at devfs_allocv+0x136 > > devfs_root() at devfs_root+0x52 > > set_rootvnode() at set_rootvnode+0x2c > > vfs_mountroot() at vfs_mountroot+0x310 > > start_init() at start_init+0x62 > > fork_exit() at fork_exit+0x12a > > fork_trampoline() at fork_trampoline+0xe > > --- trap 0, rip = 0, rsp = 0xffffffffac266d30, rbp = 0 --- > > Trying to mount root from ufs:/dev/da0s1a > > lock order reversal: > > 1st 0xffffff0003426668 ufs (ufs) @ /scratch/FreeBSD.HEAD/src/sys/kern/vfs_subr.c:2061 > > 2nd 0xffffff00034ed000 vfslock (vfslock) @ /scratch/FreeBSD.HEAD/src/sys/kern/vfs_subr.c:364 > > KDB: stack backtrace: > > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > > witness_checkorder() at witness_checkorder+0x605 > > _lockmgr() at _lockmgr+0x4e3 > > vfs_busy() at vfs_busy+0xdf > > lookup() at lookup+0x8a6 > > namei() at namei+0x2cb > > kern_unlink() at kern_unlink+0x8e > > vfs_mountroot_try() at vfs_mountroot_try+0x41f > > vfs_mountroot() at vfs_mountroot+0x3fd > > start_init() at start_init+0x62 > > fork_exit() at fork_exit+0x12a > > fork_trampoline() at fork_trampoline+0xe > > --- trap 0, rip = 0, rsp = 0xffffffffac266d30, rbp = 0 --- > > lock order reversal: > > 1st 0xffffff00010ec070 user map (user map) @ /scratch/FreeBSD.HEAD/src/sys/vm/vm_map.c:3111 > > 2nd 0xffffff0003426288 ufs (ufs) @ /scratch/FreeBSD.HEAD/src/sys/kern/vfs_subr.c:2061 > > KDB: stack backtrace: > > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > > witness_checkorder() at witness_checkorder+0x605 > > _lockmgr() at _lockmgr+0x4e3 > > ffs_lock() at ffs_lock+0x6d > > VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b > > _vn_lock() at _vn_lock+0x8b > > vget() at vget+0x125 > > vnode_pager_lock() at vnode_pager_lock+0x14a > > vm_fault() at vm_fault+0x1e5 > > trap_pfault() at trap_pfault+0x128 > > trap() at trap+0x4f2 > > calltrap() at calltrap+0x8 > > --- trap 0xc, rip = 0x400146, rsp = 0x7fffffffee80, rbp = 0x7fffffffeeb8 --- > > em1: link state changed to UP > > cxgbc0: mem 0xd8801000-0xd8801fff,0xd8000000-0xd87fffff,0xd8800000-0xd8800fff irq 18 at device 0.0 on pci9 > > cxgb0: on cxgbc0 > > cxgb0: Ethernet address: 00:07:43:05:20:43 > > Failed to allocate cluster > > Failed to allocate cluster > > Failed to allocate cluster > > Failed to allocate cluster > > cxgbc0: [ITHREAD] > > setting up interrupt for port=0 > > cxgbc0: [ITHREAD] > > setting up interrupt for port=0 > > cxgbc0: [ITHREAD] > > setting up interrupt for port=0 > > cxgbc0: [ITHREAD] > > setting up interrupt for port=0 > > cxgbc0: [ITHREAD] > > setting up interrupt for port=0 > > cxgbc0: [ITHREAD] > > setting > > up interrupt for port=0 > > cxgbc0: [ITHREAD] > > setting up interrupt for port=0 > > cxgbc0: [ITHREAD] > > setting up interrupt for port=0 > > cxgbc0: [ITHREAD] > > bind qsets > > cxgbc0: starting thread for 0 > > device_map=0x1 > > adding adapter 0xffffffff8134f000 > > cxgbc0: offload started > > offload opened > > cxgb0: link state changed to UP > > cxgbc0: enabling interrupts on port=0 > > nozomi8# > > _______________________________________________ > > freebsd-net@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-net > > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" > > >