From owner-freebsd-net@FreeBSD.ORG Sun Jun 17 19:32:25 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5D904106566C for ; Sun, 17 Jun 2012 19:32:25 +0000 (UTC) (envelope-from jfesler@gigo.com) Received: from goat.gigo.com (goat.gigo.com [IPv6:2001:470:1:18::114]) by mx1.freebsd.org (Postfix) with ESMTP id 4B6C28FC0C for ; Sun, 17 Jun 2012 19:32:25 +0000 (UTC) Received: from goat.gigo.com (goat.gigo.com [216.218.228.114]) by goat.gigo.com (Postfix) with ESMTPS id 3WFlv74TdXzTJ6 for ; Sun, 17 Jun 2012 12:32:19 -0700 (PDT) Date: Sun, 17 Jun 2012 12:32:19 -0700 (PDT) From: Jason Fesler To: freebsd-net@freebsd.org Message-ID: User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII Subject: ipfw and ipv6 mask/masklen X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Jun 2012 19:32:25 -0000 For IPv4, I see this with ipfw: addr/masklen Matches all addresses with base addr (specified as an IP address, a network number, or a hostname) and mask width of masklen bits. As an example, 1.2.3.4/25 or 1.2.3.0/25 will match all IP numbers from 1.2.3.0 to 1.2.3.127 . Does anyone have a suggestion on how to do similar for IPv6? I want to block specific Teredo/IPv4 addresses; the IPv4 address is encoded at the end. The bits in the middle are variable per connection (with the port number being part of the variable). I don't want to block out Teredo entirely (or even a specific relay entirely), as that would be overboard for my needs. So, CIDR notation prefix/length matching won't work. -- Jason Fesler, email/jabber resume: http://jfesler.com "Give a man fire, and he'll be warm for a day; set a man on fire, and he'll be warm for the rest of his life." From owner-freebsd-net@FreeBSD.ORG Mon Jun 18 04:47:29 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6B5841065677 for ; Mon, 18 Jun 2012 04:47:29 +0000 (UTC) (envelope-from egrosbein@rdtc.ru) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13::5]) by mx1.freebsd.org (Postfix) with ESMTP id BF4848FC08 for ; Mon, 18 Jun 2012 04:47:28 +0000 (UTC) Received: from eg.sd.rdtc.ru (localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.14.5/8.14.5) with ESMTP id q5I4lKCL038227; Mon, 18 Jun 2012 11:47:20 +0700 (NOVT) (envelope-from egrosbein@rdtc.ru) Message-ID: <4FDEB2D8.40007@rdtc.ru> Date: Mon, 18 Jun 2012 11:47:20 +0700 From: Eugene Grosbein User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; ru-RU; rv:1.9.2.13) Gecko/20110112 Thunderbird/3.1.7 MIME-Version: 1.0 To: Arnaud Lacombe References: <4DAD3824.7000500@frasunek.com> <20110419074056.GG34767@glebius.int.ru> <4DB47CE1.8@frasunek.com> <4DB487D2.7030104@rdtc.ru> <4DB48B76.8050101@frasunek.com> <4DB49109.3050002@frasunek.com> <20110425050548.GF34767@glebius.int.ru> <4DBBBAD8.2000705@frasunek.com> <20110513162311.GK95084@glebius.int.ru> <4DD298AD.2060905@frasunek.com> <20110517184613.GN74366@glebius.int.ru> <4FDB1D71.6050908@freebsd.lublin.pl> <4FDB2180.4030609@rdtc.ru> In-Reply-To: Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: 8bit Cc: Przemyslaw Frasunek , Andriy Gapon , freebsd-net@freebsd.org Subject: Re: mpd5/Netgraph issues after upgrading to 7.4 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 04:47:29 -0000 17.06.2012 01:13, Arnaud Lacombe пишет: > Hi, > > On Fri, Jun 15, 2012 at 7:50 AM, Eugene Grosbein wrote: >> 15.06.2012 18:33, Przemyslaw Frasunek пишет: >>> Dear All, >>> >>> unfortunately, one of my mpd5 PPPoE access servers started panicing every few >>> hours. >>> >>> I'm running recent 8.3-STABLE (as of 23th May) with WITNESS, INVARIANTS and >>> DEBUG_MEMGUARD compiled. Unfortunately, I'm unable to catch crashdump. For some >>> reason, it is not saved on dumpdev. >> >> The reason is that 8-STABLE fails to stop scheduler on panic >> that breaks writing of crashdumps. >> >> 8.3-STABLE has new sysctl kern.stop_scheduler_on_panic. >> You should set it to 1 to get crashdumps saved. >> > Is there technical reason to have the scheduler still running after panic() ? It seems no. That's just "a misfeature". Eugene Grosbein From owner-freebsd-net@FreeBSD.ORG Mon Jun 18 11:07:54 2012 Return-Path: Delivered-To: freebsd-net@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AFE8A1065673 for ; Mon, 18 Jun 2012 11:07:54 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 9640D8FC15 for ; Mon, 18 Jun 2012 11:07:54 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5IB7sYC008066 for ; Mon, 18 Jun 2012 11:07:54 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5IB7rbv008064 for freebsd-net@FreeBSD.org; Mon, 18 Jun 2012 11:07:53 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 18 Jun 2012 11:07:53 GMT Message-Id: <201206181107.q5IB7rbv008064@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-net@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-net@FreeBSD.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 11:07:54 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- p kern/168294 net [ixgbe] [patch] ixgbe driver compiled in kernel has no o kern/168246 net [em] Multiple em(4) not working with qemu o kern/168245 net [arp] [regression] Permanent ARP entry not deleted on o kern/168244 net [arp] [regression] Unable to manually remove permanent o kern/168183 net [bce] bce driver hang system o kern/168152 net [xl] Periodically, the network card xl0 stops working o kern/167947 net [setfib] [patch] arpresolve checks only the default FI o kern/167603 net [ip] IP fragment reassembly's broken: file transfer ov o kern/167500 net [em] [panic] Kernel panics in em driver o kern/167325 net [netinet] [patch] sosend sometimes return EINVAL with o kern/167202 net [igmp]: Sending multiple IGMP packets crashes kernel o kern/167059 net [tcp] [panic] System does panic in in_pcbbind() and ha o kern/166940 net [ipfilter] [panic] Double fault in kern 8.2 o kern/166550 net [netinet] [patch] Some log lines about arp do not incl o kern/166462 net [gre] gre(4) when using a tunnel source address from c o kern/166372 net [patch] ipfilter drops UDP packets with zero checksum o kern/166285 net [arp] FreeBSD v8.1 REL p8 arp: unknown hardware addres o kern/166255 net [net] [patch] It should be possible to disable "promis o kern/165963 net [panic] [ipf] ipfilter/nat NULL pointer deference o kern/165903 net mbuf leak o kern/165863 net [panic] [netinet] [patch] in_lltable_prefix_free() rac o kern/165643 net [net] [patch] Missing vnet restores in net/if_ethersub o kern/165622 net [ndis][panic][patch] Unregistered use of FPU in kernel s kern/165562 net [request] add support for Intel i350 in FreeBSD 7.4 o kern/165526 net [bxe] UDP packets checksum calculation whithin if_bxe o kern/165488 net [ppp] [panic] Fatal trap 12 jails and ppp , kernel wit o kern/165305 net [ip6] [request] Feature parity between IP_TOS and IPV6 o kern/165296 net [vlan] [patch] Fix EVL_APPLY_VLID, update EVL_APPLY_PR o kern/165181 net [igb] igb freezes after about 2 weeks of uptime o kern/165174 net [patch] [tap] allow tap(4) to keep its address on clos o kern/165152 net [ip6] Does not work through the issue of ipv6 addresse o kern/164495 net [igb] connect double head igb to switch cause system t o kern/164490 net [pfil] Incorrect IP checksum on pfil pass from ip_outp o kern/164475 net [gre] gre misses RUNNING flag after a reboot o kern/164265 net [netinet] [patch] tcp_lro_rx computes wrong checksum i o kern/163903 net [igb] "igb0:tx(0)","bpf interface lock" v2.2.5 9-STABL o kern/163481 net freebsd do not add itself to ping route packet o kern/162927 net [tun] Modem-PPP error ppp[1538]: tun0: Phase: Clearing o kern/162926 net [ipfilter] Infinite loop in ipfilter with fragmented I o kern/162558 net [dummynet] [panic] seldom dummynet panics o kern/162153 net [em] intel em driver 7.2.4 don't compile o kern/162110 net [igb] [panic] RELENG_9 panics on boot in IGB driver - o kern/162028 net [ixgbe] [patch] misplaced #endif in ixgbe.c o kern/161381 net [re] RTL8169SC - re0: PHY write failed o kern/161277 net [em] [patch] BMC cannot receive IPMI traffic after loa o kern/160873 net [igb] igb(4) from HEAD fails to build on 7-STABLE o kern/160750 net Intel PRO/1000 connection breaks under load until rebo o kern/160693 net [gif] [em] Multicast packet are not passed from GIF0 t o kern/160293 net [ieee80211] ppanic] kernel panic during network setup o kern/160206 net [gif] gifX stops working after a while (IPv6 tunnel) o kern/159817 net [udp] write UDPv4: No buffer space available (code=55) o kern/159629 net [ipsec] [panic] kernel panic with IPsec in transport m o kern/159621 net [tcp] [panic] panic: soabort: so_count o kern/159603 net [netinet] [patch] in_ifscrubprefix() - network route c o kern/159601 net [netinet] [patch] in_scrubprefix() - loopback route re o kern/159294 net [em] em watchdog timeouts o kern/159203 net [wpi] Intel 3945ABG Wireless LAN not support IBSS o kern/158930 net [bpf] BPF element leak in ifp->bpf_if->bif_dlist o kern/158726 net [ip6] [patch] ICMPv6 Router Announcement flooding limi o kern/158694 net [ix] [lagg] ix0 is not working within lagg(4) o kern/158665 net [ip6] [panic] kernel pagefault in in6_setscope() o kern/158635 net [em] TSO breaks BPF packet captures with em driver f kern/157802 net [dummynet] [panic] kernel panic in dummynet o kern/157785 net amd64 + jail + ipfw + natd = very slow outbound traffi o kern/157418 net [em] em driver lockup during boot on Supermicro X9SCM- o kern/157410 net [ip6] IPv6 Router Advertisements Cause Excessive CPU U o kern/157287 net [re] [panic] INVARIANTS panic (Memory modified after f o kern/157209 net [ip6] [patch] locking error in rip6_input() (sys/netin o kern/157200 net [network.subr] [patch] stf(4) can not communicate betw o kern/157182 net [lagg] lagg interface not working together with epair o kern/156877 net [dummynet] [panic] dummynet move_pkt() null ptr derefe o kern/156667 net [em] em0 fails to init on CURRENT after March 17 o kern/156408 net [vlan] Routing failure when using VLANs vs. Physical e o kern/156328 net [icmp]: host can ping other subnet but no have IP from o kern/156317 net [ip6] Wrong order of IPv6 NS DAD/MLD Report o kern/156283 net [ip6] [patch] nd6_ns_input - rtalloc_mpath does not re o kern/156279 net [if_bridge][divert][ipfw] unable to correctly re-injec o kern/156226 net [lagg]: failover does not announce the failover to swi o kern/156030 net [ip6] [panic] Crash in nd6_dad_start() due to null ptr o kern/155772 net ifconfig(8): ioctl (SIOCAIFADDR): File exists on direc o kern/155680 net [multicast] problems with multicast s kern/155642 net [request] Add driver for Realtek RTL8191SE/RTL8192SE W o kern/155597 net [panic] Kernel panics with "sbdrop" message o kern/155420 net [vlan] adding vlan break existent vlan o kern/155177 net [route] [panic] Panic when inject routes in kernel o kern/155030 net [igb] igb(4) DEVICE_POLLING does not work with carp(4) o kern/155010 net [msk] ntfs-3g via iscsi using msk driver cause kernel o kern/154943 net [gif] ifconfig gifX create on existing gifX clears IP s kern/154851 net [request]: Port brcm80211 driver from Linux to FreeBSD o kern/154850 net [netgraph] [patch] ng_ether fails to name nodes when t o kern/154679 net [em] Fatal trap 12: "em1 taskq" only at startup (8.1-R o kern/154600 net [tcp] [panic] Random kernel panics on tcp_output o kern/154557 net [tcp] Freeze tcp-session of the clients, if in the gat o kern/154443 net [if_bridge] Kernel module bridgestp.ko missing after u o kern/154286 net [netgraph] [panic] 8.2-PRERELEASE panic in netgraph o kern/154255 net [nfs] NFS not responding o kern/154214 net [stf] [panic] Panic when creating stf interface o kern/154185 net race condition in mb_dupcl o kern/154169 net [multicast] [ip6] Node Information Query multicast add o kern/154134 net [ip6] stuck kernel state in LISTEN on ipv6 daemon whic o kern/154091 net [netgraph] [panic] netgraph, unaligned mbuf? o conf/154062 net [vlan] [patch] change to way of auto-generatation of v o kern/153937 net [ral] ralink panics the system (amd64 freeBSDD 8.X) wh o kern/153936 net [ixgbe] [patch] MPRC workaround incorrectly applied to o kern/153816 net [ixgbe] ixgbe doesn't work properly with the Intel 10g o kern/153772 net [ixgbe] [patch] sysctls reference wrong XON/XOFF varia o kern/153497 net [netgraph] netgraph panic due to race conditions o kern/153454 net [patch] [wlan] [urtw] Support ad-hoc and hostap modes o kern/153308 net [em] em interface use 100% cpu o kern/153244 net [em] em(4) fails to send UDP to port 0xffff o kern/152893 net [netgraph] [panic] 8.2-PRERELEASE panic in netgraph o kern/152853 net [em] tftpd (and likely other udp traffic) fails over e o kern/152828 net [em] poor performance on 8.1, 8.2-PRE o kern/152569 net [net]: Multiple ppp connections and routing table prob o kern/152235 net [arp] Permanent local ARP entries are not properly upd o kern/152141 net [vlan] [patch] encapsulate vlan in ng_ether before out o kern/152036 net [libc] getifaddrs(3) returns truncated sockaddrs for n o kern/151690 net [ep] network connectivity won't work until dhclient is o kern/151681 net [nfs] NFS mount via IPv6 leads to hang on client with o kern/151593 net [igb] [panic] Kernel panic when bringing up igb networ o kern/150920 net [ixgbe][igb] Panic when packets are dropped with heade o kern/150557 net [igb] igb0: Watchdog timeout -- resetting o kern/150251 net [patch] [ixgbe] Late cable insertion broken o kern/150249 net [ixgbe] Media type detection broken o bin/150224 net ppp(8) does not reassign static IP after kill -KILL co f kern/149969 net [wlan] [ral] ralink rt2661 fails to maintain connectio o kern/149937 net [ipfilter] [patch] kernel panic in ipfilter IP fragmen o kern/149643 net [rum] device not sending proper beacon frames in ap mo o kern/149609 net [panic] reboot after adding second default route o kern/149117 net [inet] [patch] in_pcbbind: redundant test o kern/149086 net [multicast] Generic multicast join failure in 8.1 o kern/148018 net [flowtable] flowtable crashes on ia64 o kern/147912 net [boot] FreeBSD 8 Beta won't boot on Thinkpad i1300 11 o kern/147894 net [ipsec] IPv6-in-IPv4 does not work inside an ESP-only o kern/147155 net [ip6] setfb not work with ipv6 o kern/146845 net [libc] close(2) returns error 54 (connection reset by f kern/146792 net [flowtable] flowcleaner 100% cpu's core load o kern/146719 net [pf] [panic] PF or dumynet kernel panic o kern/146534 net [icmp6] wrong source address in echo reply o kern/146427 net [mwl] Additional virtual access points don't work on m f kern/146394 net [vlan] IP source address for outgoing connections o bin/146377 net [ppp] [tun] Interface doesn't clear addresses when PPP o kern/146358 net [vlan] wrong destination MAC address o kern/146165 net [wlan] [panic] Setting bssid in adhoc mode causes pani o kern/146082 net [ng_l2tp] a false invaliant check was performed in ng_ o kern/146037 net [panic] mpd + CoA = kernel panic o kern/145825 net [panic] panic: soabort: so_count o kern/145728 net [lagg] Stops working lagg between two servers. p kern/145600 net TCP/ECN behaves different to CE/CWR than ns2 reference f kern/144917 net [flowtable] [panic] flowtable crashes system [regressi o kern/144882 net MacBookPro =>4.1 does not connect to BSD in hostap wit o kern/144874 net [if_bridge] [patch] if_bridge frees mbuf after pfil ho o conf/144700 net [rc.d] async dhclient breaks stuff for too many people o kern/144616 net [nat] [panic] ip_nat panic FreeBSD 7.2 f kern/144315 net [ipfw] [panic] freebsd 8-stable reboot after add ipfw o kern/144231 net bind/connect/sendto too strict about sockaddr length o kern/143846 net [gif] bringing gif3 tunnel down causes gif0 tunnel to s kern/143673 net [stf] [request] there should be a way to support multi s kern/143666 net [ip6] [request] PMTU black hole detection not implemen o kern/143622 net [pfil] [patch] unlock pfil lock while calling firewall o kern/143593 net [ipsec] When using IPSec, tcpdump doesn't show outgoin o kern/143591 net [ral] RT2561C-based DLink card (DWL-510) fails to work o kern/143208 net [ipsec] [gif] IPSec over gif interface not working o kern/143034 net [panic] system reboots itself in tcp code [regression] o kern/142877 net [hang] network-related repeatable 8.0-STABLE hard hang o kern/142774 net Problem with outgoing connections on interface with mu o kern/142772 net [libc] lla_lookup: new lle malloc failed f kern/142518 net [em] [lagg] Problem on 8.0-STABLE with em and lagg o kern/142018 net [iwi] [patch] Possibly wrong interpretation of beacon- o kern/141861 net [wi] data garbled with WEP and wi(4) with Prism 2.5 f kern/141741 net Etherlink III NIC won't work after upgrade to FBSD 8, o kern/140742 net rum(4) Two asus-WL167G adapters cannot talk to each ot o kern/140682 net [netgraph] [panic] random panic in netgraph o kern/140634 net [vlan] destroying if_lagg interface with if_vlan membe o kern/140619 net [ifnet] [patch] refine obsolete if_var.h comments desc o kern/140346 net [wlan] High bandwidth use causes loss of wlan connecti o kern/140142 net [ip6] [panic] FreeBSD 7.2-amd64 panic w/IPv6 o kern/140066 net [bwi] install report for 8.0 RC 2 (multiple problems) o kern/139565 net [ipfilter] ipfilter ioctl SIOCDELST broken o kern/139387 net [ipsec] Wrong lenth of PF_KEY messages in promiscuous o bin/139346 net [patch] arp(8) add option to remove static entries lis o kern/139268 net [if_bridge] [patch] allow if_bridge to forward just VL p kern/139204 net [arp] DHCP server replies rejected, ARP entry lost bef o kern/139117 net [lagg] + wlan boot timing (EBUSY) o kern/139058 net [ipfilter] mbuf cluster leak on FreeBSD 7.2 o kern/138850 net [dummynet] dummynet doesn't work correctly on a bridge o kern/138782 net [panic] sbflush_internal: cc 0 || mb 0xffffff004127b00 o kern/138688 net [rum] possibly broken on 8 Beta 4 amd64: able to wpa a o kern/138678 net [lo] FreeBSD does not assign linklocal address to loop o kern/138407 net [gre] gre(4) interface does not come up after reboot o kern/138332 net [tun] [lor] ifconfig tun0 destroy causes LOR if_adata/ o kern/138266 net [panic] kernel panic when udp benchmark test used as r o kern/138177 net [ipfilter] FreeBSD crashing repeatedly in ip_nat.c:257 f kern/138029 net [bpf] [panic] periodically kernel panic and reboot o kern/137881 net [netgraph] [panic] ng_pppoe fatal trap 12 p bin/137841 net [patch] wpa_supplicant(8) cannot verify SHA256 signed p kern/137776 net [rum] panic in rum(4) driver on 8.0-BETA2 o bin/137641 net ifconfig(8): various problems with "vlan_device.vlan_i o kern/137392 net [ip] [panic] crash in ip_nat.c line 2577 o kern/137372 net [ral] FreeBSD doesn't support wireless interface from o kern/137089 net [lagg] lagg falsely triggers IPv6 duplicate address de o bin/136994 net [patch] ifconfig(8) print carp mac address o kern/136911 net [netgraph] [panic] system panic on kldload ng_bpf.ko t o kern/136618 net [pf][stf] panic on cloning interface without unit numb o kern/135502 net [periodic] Warning message raised by rtfree function i o kern/134583 net [hang] Machine with jail freezes after random amount o o kern/134531 net [route] [panic] kernel crash related to routes/zebra o kern/134157 net [dummynet] dummynet loads cpu for 100% and make a syst o kern/133969 net [dummynet] [panic] Fatal trap 12: page fault while in o kern/133968 net [dummynet] [panic] dummynet kernel panic o kern/133736 net [udp] ip_id not protected ... o kern/133595 net [panic] Kernel Panic at pcpu.h:195 o kern/133572 net [ppp] [hang] incoming PPTP connection hangs the system o kern/133490 net [bpf] [panic] 'kmem_map too small' panic on Dell r900 o kern/133235 net [netinet] [patch] Process SIOCDLIFADDR command incorre f kern/133213 net arp and sshd errors on 7.1-PRERELEASE o kern/133060 net [ipsec] [pfsync] [panic] Kernel panic with ipsec + pfs o kern/132889 net [ndis] [panic] NDIS kernel crash on load BCM4321 AGN d o conf/132851 net [patch] rc.conf(5): allow to setfib(1) for service run o kern/132734 net [ifmib] [panic] panic in net/if_mib.c o kern/132705 net [libwrap] [patch] libwrap - infinite loop if hosts.all o kern/132672 net [ndis] [panic] ndis with rt2860.sys causes kernel pani o kern/132554 net [ipl] There is no ippool start script/ipfilter magic t o kern/132354 net [nat] Getting some packages to ipnat(8) causes crash o kern/132277 net [crypto] [ipsec] poor performance using cryptodevice f o kern/131781 net [ndis] ndis keeps dropping the link o kern/131776 net [wi] driver fails to init o kern/131753 net [altq] [panic] kernel panic in hfsc_dequeue o kern/131601 net [ipfilter] [panic] 7-STABLE panic in nat_finalise (tcp o bin/131567 net [socket] [patch] Update for regression/sockets/unix_cm o bin/131365 net route(8): route add changes interpretation of network f kern/130820 net [ndis] wpa_supplicant(8) returns 'no space on device' o kern/130628 net [nfs] NFS / rpc.lockd deadlock on 7.1-R o conf/130555 net [rc.d] [patch] No good way to set ipfilter variables a o kern/130525 net [ndis] [panic] 64 bit ar5008 ndisgen-erated driver cau o kern/130311 net [wlan_xauth] [panic] hostapd restart causing kernel pa o kern/130109 net [ipfw] Can not set fib for packets originated from loc f kern/130059 net [panic] Leaking 50k mbufs/hour f kern/129719 net [nfs] [panic] Panic during shutdown, tcp_ctloutput: in o kern/129517 net [ipsec] [panic] double fault / stack overflow f kern/129508 net [carp] [panic] Kernel panic with EtherIP (may be relat o kern/129219 net [ppp] Kernel panic when using kernel mode ppp o kern/129197 net [panic] 7.0 IP stack related panic o bin/128954 net ifconfig(8) deletes valid routes o bin/128602 net [an] wpa_supplicant(8) crashes with an(4) o kern/128448 net [nfs] 6.4-RC1 Boot Fails if NFS Hostname cannot be res o bin/128295 net [patch] ifconfig(8) does not print TOE4 or TOE6 capabi o bin/128001 net wpa_supplicant(8), wlan(4), and wi(4) issues o kern/127826 net [iwi] iwi0 driver has reduced performance and connecti o kern/127815 net [gif] [patch] if_gif does not set vlan attributes from o kern/127724 net [rtalloc] rtfree: 0xc5a8f870 has 1 refs f bin/127719 net [arp] arp: Segmentation fault (core dumped) f kern/127528 net [icmp]: icmp socket receives icmp replies not owned by p kern/127360 net [socket] TOE socket options missing from sosetopt() o bin/127192 net routed(8) removes the secondary alias IP of interface f kern/127145 net [wi]: prism (wi) driver crash at bigger traffic o kern/126895 net [patch] [ral] Add antenna selection (marked as TBD) o kern/126874 net [vlan]: Zebra problem if ifconfig vlanX destroy o kern/126695 net rtfree messages and network disruption upon use of if_ o kern/126339 net [ipw] ipw driver drops the connection o kern/126075 net [inet] [patch] internet control accesses beyond end of o bin/125922 net [patch] Deadlock in arp(8) o kern/125920 net [arp] Kernel Routing Table loses Ethernet Link status o kern/125845 net [netinet] [patch] tcp_lro_rx() should make use of hard o kern/125258 net [socket] socket's SO_REUSEADDR option does not work o kern/125239 net [gre] kernel crash when using gre o kern/124341 net [ral] promiscuous mode for wireless device ral0 looses o kern/124225 net [ndis] [patch] ndis network driver sometimes loses net o kern/124160 net [libc] connect(2) function loops indefinitely o kern/124021 net [ip6] [panic] page fault in nd6_output() o kern/123968 net [rum] [panic] rum driver causes kernel panic with WPA. o kern/123892 net [tap] [patch] No buffer space available o kern/123890 net [ppp] [panic] crash & reboot on work with PPP low-spee o kern/123858 net [stf] [patch] stf not usable behind a NAT o kern/123796 net [ipf] FreeBSD 6.1+VPN+ipnat+ipf: port mapping does not o kern/123758 net [panic] panic while restarting net/freenet6 o bin/123633 net ifconfig(8) doesn't set inet and ether address in one o kern/123559 net [iwi] iwi periodically disassociates/associates [regre o bin/123465 net [ip6] route(8): route add -inet6 -interfac o kern/123463 net [ipsec] [panic] repeatable crash related to ipsec-tool o conf/123330 net [nsswitch.conf] Enabling samba wins in nsswitch.conf c o kern/123160 net [ip] Panic and reboot at sysctl kern.polling.enable=0 o kern/122989 net [swi] [panic] 6.3 kernel panic in swi1: net o kern/122954 net [lagg] IPv6 EUI64 incorrectly chosen for lagg devices f kern/122780 net [lagg] tcpdump on lagg interface during high pps wedge o kern/122685 net It is not visible passing packets in tcpdump(1) o kern/122319 net [wi] imposible to enable ad-hoc demo mode with Orinoco o kern/122290 net [netgraph] [panic] Netgraph related "kmem_map too smal o kern/122033 net [ral] [lor] Lock order reversal in ral0 at bootup ieee o bin/121895 net [patch] rtsol(8)/rtsold(8) doesn't handle managed netw s kern/121774 net [swi] [panic] 6.3 kernel panic in swi1: net o kern/121555 net [panic] Fatal trap 12: current process = 12 (swi1: net o kern/121443 net [gif] [lor] icmp6_input/nd6_lookup o kern/121437 net [vlan] Routing to layer-2 address does not work on VLA o bin/121359 net [patch] [security] ppp(8): fix local stack overflow in o kern/121257 net [tcp] TSO + natd -> slow outgoing tcp traffic o kern/121181 net [panic] Fatal trap 3: breakpoint instruction fault whi o kern/120966 net [rum] kernel panic with if_rum and WPA encryption o kern/120566 net [request]: ifconfig(8) make order of arguments more fr o kern/120304 net [netgraph] [patch] netgraph source assumes 32-bit time o kern/120266 net [udp] [panic] gnugk causes kernel panic when closing U o bin/120060 net routed(8) deletes link-level routes in the presence of o kern/119945 net [rum] [panic] rum device in hostap mode, cause kernel o kern/119791 net [nfs] UDP NFS mount of aliased IP addresses from a Sol o kern/119617 net [nfs] nfs error on wpa network when reseting/shutdown f kern/119516 net [ip6] [panic] _mtx_lock_sleep: recursed on non-recursi o kern/119432 net [arp] route add -host -iface causes arp e o kern/119225 net [wi] 7.0-RC1 no carrier with Prism 2.5 wifi card [regr o kern/118727 net [netgraph] [patch] [request] add new ng_pf module o kern/117423 net [vlan] Duplicate IP on different interfaces o bin/117339 net [patch] route(8): loading routing management commands o kern/117271 net [tap] OpenVPN TAP uses 99% CPU on releng_6 when if_tap o bin/116643 net [patch] [request] fstat(1): add INET/INET6 socket deta o kern/116185 net [iwi] if_iwi driver leads system to reboot o kern/115239 net [ipnat] panic with 'kmem_map too small' using ipnat o kern/115019 net [netgraph] ng_ether upper hook packet flow stops on ad o kern/115002 net [wi] if_wi timeout. failed allocation (busy bit). ifco o kern/114915 net [patch] [pcn] pcn (sys/pci/if_pcn.c) ethernet driver f o kern/113432 net [ucom] WARNING: attempt to net_add_domain(netgraph) af o kern/112722 net [ipsec] [udp] IP v4 udp fragmented packet reject o kern/112686 net [patm] patm driver freezes System (FreeBSD 6.2-p4) i38 o bin/112557 net [patch] ppp(8) lock file should not use symlink name o kern/112528 net [nfs] NFS over TCP under load hangs with "impossible p o kern/111537 net [inet6] [patch] ip6_input() treats mbuf cluster wrong o kern/111457 net [ral] ral(4) freeze o kern/110284 net [if_ethersubr] Invalid Assumption in SIOCSIFADDR in et o kern/110249 net [kernel] [regression] [patch] setsockopt() error regre o kern/109470 net [wi] Orinoco Classic Gold PC Card Can't Channel Hop o bin/108895 net pppd(8): PPPoE dead connections on 6.2 [regression] o kern/107944 net [wi] [patch] Forget to unlock mutex-locks o conf/107035 net [patch] bridge(8): bridge interface given in rc.conf n o kern/106444 net [netgraph] [panic] Kernel Panic on Binding to an ip to o kern/106438 net [ipf] ipfilter: keep state does not seem to allow repl o kern/106316 net [dummynet] dummynet with multipass ipfw drops packets o kern/105945 net Address can disappear from network interface s kern/105943 net Network stack may modify read-only mbuf chain copies o bin/105925 net problems with ifconfig(8) and vlan(4) [regression] o kern/104851 net [inet6] [patch] On link routes not configured when usi o kern/104751 net [netgraph] kernel panic, when getting info about my tr o kern/103191 net Unpredictable reboot o kern/103135 net [ipsec] ipsec with ipfw divert (not NAT) encodes a pac o kern/102540 net [netgraph] [patch] supporting vlan(4) by ng_fec(4) o conf/102502 net [netgraph] [patch] ifconfig name does't rename netgrap o kern/102035 net [plip] plip networking disables parallel port printing o kern/101948 net [ipf] [panic] Kernel Panic Trap No 12 Page Fault - cau o kern/100709 net [libc] getaddrinfo(3) should return TTL info o kern/100519 net [netisr] suggestion to fix suboptimal network polling o kern/98978 net [ipf] [patch] ipfilter drops OOW packets under 6.1-Rel o kern/98597 net [inet6] Bug in FreeBSD 6.1 IPv6 link-local DAD procedu o bin/98218 net wpa_supplicant(8) blacklist not working o kern/97306 net [netgraph] NG_L2TP locks after connection with failed o conf/97014 net [gif] gifconfig_gif? in rc.conf does not recognize IPv f kern/96268 net [socket] TCP socket performance drops by 3000% if pack o kern/95519 net [ral] ral0 could not map mbuf o kern/95288 net [pppd] [tty] [panic] if_ppp panic in sys/kern/tty_subr o kern/95277 net [netinet] [patch] IP Encapsulation mask_match() return o kern/95267 net packet drops periodically appear f kern/93378 net [tcp] Slow data transfer in Postfix and Cyrus IMAP (wo o kern/93019 net [ppp] ppp and tunX problems: no traffic after restarti o kern/92880 net [libc] [patch] almost rewritten inet_network(3) functi s kern/92279 net [dc] Core faults everytime I reboot, possible NIC issu o kern/91859 net [ndis] if_ndis does not work with Asus WL-138 s kern/91777 net [ipf] [patch] wrong behaviour with skip rule inside an o kern/91364 net [ral] [wep] WF-511 RT2500 Card PCI and WEP o kern/91311 net [aue] aue interface hanging o kern/87521 net [ipf] [panic] using ipfilter "auth" keyword leads to k o kern/87421 net [netgraph] [panic]: ng_ether + ng_eiface + if_bridge o kern/86871 net [tcp] [patch] allocation logic for PCBs in TIME_WAIT s o kern/86427 net [lor] Deadlock with FASTIPSEC and nat o kern/86103 net [ipf] Illegal NAT Traversal in IPFilter o kern/85780 net 'panic: bogus refcnt 0' in routing/ipv6 o bin/85445 net ifconfig(8): deprecated keyword to ifconfig inoperativ p kern/85320 net [gre] [patch] possible depletion of kernel stack in ip o bin/82975 net route change does not parse classfull network as given o kern/82881 net [netgraph] [panic] ng_fec(4) causes kernel panic after o kern/82468 net Using 64MB tcp send/recv buffers, trafficflow stops, i o bin/82185 net [patch] ndp(8) can delete the incorrect entry o kern/81095 net IPsec connection stops working if associated network i o kern/78968 net FreeBSD freezes on mbufs exhaustion (network interface o kern/78090 net [ipf] ipf filtering on bridged packets doesn't work if o kern/77341 net [ip6] problems with IPV6 implementation s kern/77195 net [ipf] [patch] ipfilter ioctl SIOCGNATL does not match o kern/75873 net Usability problem with non-RFC-compliant IP spoof prot s kern/75407 net [an] an(4): no carrier after short time a kern/71474 net [route] route lookup does not skip interfaces marked d o kern/71469 net default route to internet magically disappears with mu o kern/70904 net [ipf] ipfilter ipnat problem with h323 proxy support o kern/68889 net [panic] m_copym, length > size of mbuf chain o kern/66225 net [netgraph] [patch] extend ng_eiface(4) control message o kern/65616 net IPSEC can't detunnel GRE packets after real ESP encryp s kern/60293 net [patch] FreeBSD arp poison patch a kern/56233 net IPsec tunnel (ESP) over IPv6: MTU computation is wrong s bin/41647 net ifconfig(8) doesn't accept lladdr along with inet addr o kern/39937 net ipstealth issue a kern/38554 net [patch] changing interface ipaddress doesn't seem to w o kern/34665 net [ipf] [hang] ipfilter rcmd proxy "hangs". o kern/31940 net ip queue length too short for >500kpps o kern/31647 net [libc] socket calls can return undocumented EINVAL o kern/30186 net [libc] getaddrinfo(3) does not handle incorrect servna o kern/27474 net [ipf] [ppp] Interactive use of user PPP and ipfilter c f kern/24959 net [patch] proper TCP_NOPUSH/TCP_CORK compatibility o conf/23063 net [arp] [patch] for static ARP tables in rc.network o kern/21998 net [socket] [patch] ident only for outgoing connections o kern/5877 net [socket] sb_cc counts control data as well as data dat 404 problems total. From owner-freebsd-net@FreeBSD.ORG Mon Jun 18 13:39:17 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3DE52106564A for ; Mon, 18 Jun 2012 13:39:17 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id F01228FC0A for ; Mon, 18 Jun 2012 13:39:16 +0000 (UTC) Received: from [192.168.43.26] (pyroxene.sentex.ca [199.212.134.18]) by smarthost1.sentex.ca (8.14.5/8.14.4) with ESMTP id q5IDdDdc017690; Mon, 18 Jun 2012 09:39:13 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <4FDF2F81.6030307@sentex.net> Date: Mon, 18 Jun 2012 09:39:13 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:12.0) Gecko/20120428 Thunderbird/12.0.1 MIME-Version: 1.0 To: Przemyslaw Frasunek References: <4DB47CE1.8@frasunek.com> <4DB487D2.7030104@rdtc.ru> <4DB48B76.8050101@frasunek.com> <4DB49109.3050002@frasunek.com> <20110425050548.GF34767@glebius.int.ru> <4DBBBAD8.2000705@frasunek.com> <20110513162311.GK95084@glebius.int.ru> <4DD298AD.2060905@frasunek.com> <20110517184613.GN74366@glebius.int.ru> <4FDB1D71.6050908@freebsd.lublin.pl> <20120615203142.GW28613@glebius.int.ru> <4FDBAFD7.9020606@freebsd.lublin.pl> In-Reply-To: <4FDBAFD7.9020606@freebsd.lublin.pl> X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.72 on 64.7.153.18 Cc: freebsd-net@freebsd.org Subject: Re: mpd5/Netgraph issues after upgrading to 7.4 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 13:39:17 -0000 On 6/15/2012 5:57 PM, Przemyslaw Frasunek wrote: >> I suspect this isn't related to netgraph, but to IPv6 since prelist_remove() >> is found in netinet6/nd6_rtr.c. >> >> Several times I looked into ND code and found lots of race prone code there. >> May be some was recently fixed by bz@, but definitely not merged to stable/8. > > Thanks a lot guys. For now, I disabled IPv6 on this BRAS. Let's see if it's > going to help. Hi, Any changes in stability ? ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-net@FreeBSD.ORG Mon Jun 18 13:43:56 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2CFDB106566B for ; Mon, 18 Jun 2012 13:43:56 +0000 (UTC) (envelope-from venglin@freebsd.lublin.pl) Received: from lagoon.freebsd.lublin.pl (lagoon.freebsd.lublin.pl [IPv6:2a02:2928:a::3]) by mx1.freebsd.org (Postfix) with ESMTP id AEA5D8FC12 for ; Mon, 18 Jun 2012 13:43:55 +0000 (UTC) Received: from [IPv6:2001:1a68:f:0:b989:54f2:a4cd:9a3c] (unknown [IPv6:2001:1a68:f:0:b989:54f2:a4cd:9a3c]) by lagoon.freebsd.lublin.pl (Postfix) with ESMTPSA id B838D23945B; Mon, 18 Jun 2012 15:43:53 +0200 (CEST) Message-ID: <4FDF3097.6080701@freebsd.lublin.pl> Date: Mon, 18 Jun 2012 15:43:51 +0200 From: Przemyslaw Frasunek Organization: frasunek.com User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:12.0) Gecko/20120428 Thunderbird/12.0.1 MIME-Version: 1.0 To: Mike Tancsa References: <4DB47CE1.8@frasunek.com> <4DB487D2.7030104@rdtc.ru> <4DB48B76.8050101@frasunek.com> <4DB49109.3050002@frasunek.com> <20110425050548.GF34767@glebius.int.ru> <4DBBBAD8.2000705@frasunek.com> <20110513162311.GK95084@glebius.int.ru> <4DD298AD.2060905@frasunek.com> <20110517184613.GN74366@glebius.int.ru> <4FDB1D71.6050908@freebsd.lublin.pl> <20120615203142.GW28613@glebius.int.ru> <4FDBAFD7.9020606@freebsd.lublin.pl> <4FDF2F81.6030307@sentex.net> In-Reply-To: <4FDF2F81.6030307@sentex.net> X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=KOI8-R Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org Subject: Re: mpd5/Netgraph issues after upgrading to 7.4 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 13:43:56 -0000 >> Thanks a lot guys. For now, I disabled IPv6 on this BRAS. Let's see if it's >> going to help. > Hi, > Any changes in stability ? Hi, It's way better now. I had no crash since IPv6 is disabled. From owner-freebsd-net@FreeBSD.ORG Mon Jun 18 16:48:48 2012 Return-Path: Delivered-To: freebsd-net@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7FFAC1065674 for ; Mon, 18 Jun 2012 16:48:48 +0000 (UTC) (envelope-from randy@psg.com) Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:1::36]) by mx1.freebsd.org (Postfix) with ESMTP id 66F198FC21 for ; Mon, 18 Jun 2012 16:48:48 +0000 (UTC) Received: from localhost ([127.0.0.1] helo=rair.psg.com.psg.com) by ran.psg.com with esmtp (Exim 4.77 (FreeBSD)) (envelope-from ) id 1Sgf8A-0002ge-Ot for freebsd-net@FreeBSD.org; Mon, 18 Jun 2012 16:48:47 +0000 Date: Tue, 19 Jun 2012 01:48:45 +0900 Message-ID: From: Randy Bush To: freebsd-net User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/22.3 Mule/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII Cc: Subject: dummynet delay X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 16:48:48 -0000 add pipe 1 tcp from 147.28.2.129 to 147.28.2.133 add pipe 2 tcp from 147.28.2.133 to 147.28.2.129 pipe 1 config queue 50 delay 200ms pipe 2 config queue 50 delay 200ms is a tcp packet from 147.28.2.129 to 147.28.2.133 delayed by 200ms or 400ms, 200 for each interface? randy From owner-freebsd-net@FreeBSD.ORG Mon Jun 18 17:05:41 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0A0521065670 for ; Mon, 18 Jun 2012 17:05:41 +0000 (UTC) (envelope-from "."@babolo.ru) Received: from smtp1.babolo.ru (smtp1.babolo.ru [195.9.14.139]) by mx1.freebsd.org (Postfix) with ESMTP id 654398FC0A for ; Mon, 18 Jun 2012 17:05:40 +0000 (UTC) Received: from cicuta.babolo.ru (cicuta.babolo.ru [194.58.246.5]) by smtp1.babolo.ru (8.14.2/8.14.2) with SMTP id q5IGu1uk065550; Mon, 18 Jun 2012 20:56:01 +0400 (MSK) (envelope-from .@babolo.ru) Received: (nullmailer pid 52338 invoked by uid 136); Mon, 18 Jun 2012 16:54:17 -0000 Date: Mon, 18 Jun 2012 20:54:17 +0400 From: Aleksandr A Babaylov <.@babolo.ru> To: Randy Bush Message-ID: <20120618165417.GA52325@babolo.ru> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Cc: freebsd-net Subject: Re: dummynet delay X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 17:05:41 -0000 On Tue, Jun 19, 2012 at 01:48:45AM +0900, Randy Bush wrote: > add pipe 1 tcp from 147.28.2.129 to 147.28.2.133 > add pipe 2 tcp from 147.28.2.133 to 147.28.2.129 > pipe 1 config queue 50 delay 200ms > pipe 2 config queue 50 delay 200ms > > is a tcp packet from 147.28.2.129 to 147.28.2.133 delayed by 200ms or > 400ms, 200 for each interface? if both addresses are external, 400ms. 200 on input and 200 on output. From owner-freebsd-net@FreeBSD.ORG Mon Jun 18 20:15:41 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3B11F106567E for ; Mon, 18 Jun 2012 20:15:41 +0000 (UTC) (envelope-from luigi@onelab2.iet.unipi.it) Received: from onelab2.iet.unipi.it (onelab2.iet.unipi.it [131.114.59.238]) by mx1.freebsd.org (Postfix) with ESMTP id ED5E68FC16 for ; Mon, 18 Jun 2012 20:15:40 +0000 (UTC) Received: by onelab2.iet.unipi.it (Postfix, from userid 275) id 528A47302C; Mon, 18 Jun 2012 22:34:35 +0200 (CEST) Date: Mon, 18 Jun 2012 22:34:35 +0200 From: Luigi Rizzo To: Randy Bush Message-ID: <20120618203435.GB32782@onelab2.iet.unipi.it> References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: freebsd-net Subject: Re: dummynet delay X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 20:15:41 -0000 On Tue, Jun 19, 2012 at 01:48:45AM +0900, Randy Bush wrote: > add pipe 1 tcp from 147.28.2.129 to 147.28.2.133 > add pipe 2 tcp from 147.28.2.133 to 147.28.2.129 > pipe 1 config queue 50 delay 200ms > pipe 2 config queue 50 delay 200ms > > is a tcp packet from 147.28.2.129 to 147.28.2.133 delayed by 200ms or > 400ms, 200 for each interface? it depends on where the traffic source and destination are, and on the configuration of the firewall. See the ascii diagram near PACKET FLOW in the ipfw manpage, reproduced below. Each [block] can potentially pass the packet through a pipe. For better control on the traffic flow, I'd suggest to use the "in" and "out" keywords in ipfw rules so you do not risk that through traffic on a router is intercepted twice. ^ to upper layers V | | +----------->-----------+ ^ V [ip(6)_input] [ip(6)_output] net.inet(6).ip(6).fw.enable=1 | | ^ V [ether_demux] [ether_output_frame] net.link.ether.ipfw=1 | | +-->--[bdg_forward]-->--+ net.link.bridge.ipfw=1 ^ V | to devices | cheers luigi From owner-freebsd-net@FreeBSD.ORG Mon Jun 18 22:51:54 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 27AC4106564A for ; Mon, 18 Jun 2012 22:51:54 +0000 (UTC) (envelope-from adrian.chadd@gmail.com) Received: from mail-pz0-f54.google.com (mail-pz0-f54.google.com [209.85.210.54]) by mx1.freebsd.org (Postfix) with ESMTP id E873B8FC1B for ; Mon, 18 Jun 2012 22:51:53 +0000 (UTC) Received: by dadv36 with SMTP id v36so8077305dad.13 for ; Mon, 18 Jun 2012 15:51:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=y+VXt/JFEFLnij7I6I5svE+Y2Z2HX+UOIbqHy/oK8oU=; b=0u0Lo5c83HkOEOaFdkOrOmGq/diHxP6LcGSOTysWzQb9XHJXkwsQ0onDYMQt0oBq/S y2toB9xzt+gy9tA1ZmwogevPePX6u5T6LbJBTnZrXyU5bWKevBG63kPnuCW7qAqPIv9Y KbRMH1oJqtLzSIvTler3J96NPPGYL0d/AoLEiq9yuUw6qz5KoZasGg6W1L3XaFX5ogZn x/u6CJk9EUB9K2Wh5/9sCMRBDFsmKBICxn9E4gkcqNDHxk/4QLWDD9mLqCgpsIbuFvFO ybgdEU0aeaP3nwORvou/+Ug1OW/2BD/3ALEdCZbQ1fJm/PJZ8KjdiNpLl0PkSFrUDNOs 3+JQ== MIME-Version: 1.0 Received: by 10.68.234.35 with SMTP id ub3mr57206717pbc.8.1340059913506; Mon, 18 Jun 2012 15:51:53 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.143.91.18 with HTTP; Mon, 18 Jun 2012 15:51:53 -0700 (PDT) In-Reply-To: <4FDF3097.6080701@freebsd.lublin.pl> References: <4DB47CE1.8@frasunek.com> <4DB487D2.7030104@rdtc.ru> <4DB48B76.8050101@frasunek.com> <4DB49109.3050002@frasunek.com> <20110425050548.GF34767@glebius.int.ru> <4DBBBAD8.2000705@frasunek.com> <20110513162311.GK95084@glebius.int.ru> <4DD298AD.2060905@frasunek.com> <20110517184613.GN74366@glebius.int.ru> <4FDB1D71.6050908@freebsd.lublin.pl> <20120615203142.GW28613@glebius.int.ru> <4FDBAFD7.9020606@freebsd.lublin.pl> <4FDF2F81.6030307@sentex.net> <4FDF3097.6080701@freebsd.lublin.pl> Date: Mon, 18 Jun 2012 15:51:53 -0700 X-Google-Sender-Auth: jOPfrAW9HHVpcaB_cvXmam8JkDw Message-ID: From: Adrian Chadd To: Przemyslaw Frasunek Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-net@freebsd.org, Mike Tancsa Subject: Re: mpd5/Netgraph issues after upgrading to 7.4 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 22:51:54 -0000 Hi, Is it possible to get you to setup a test BRAS running 9-STABLE, so you can provide feedback about how stable ipv4/ipv6 PPPoE is for you? It's great that you've solved it for 7.x, and I know that bz and others know about a variety of fun issues in the networking stack that may be related to this, but the only way this will get fixed and validated is if you can help us test it out on something more recent. Are you able to do any kind of load balancing, or do you just have one BRAS? Thanks, Adrian From owner-freebsd-net@FreeBSD.ORG Tue Jun 19 00:07:11 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8A9DC106564A; Tue, 19 Jun 2012 00:07:11 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1-6.sentex.ca [IPv6:2607:f3e0:0:1::12]) by mx1.freebsd.org (Postfix) with ESMTP id 460578FC08; Tue, 19 Jun 2012 00:07:11 +0000 (UTC) Received: from [192.168.43.26] (pyroxene.sentex.ca [199.212.134.18]) by smarthost1.sentex.ca (8.14.5/8.14.4) with ESMTP id q5J07AZB071840; Mon, 18 Jun 2012 20:07:10 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <4FDFC2AD.3030805@sentex.net> Date: Mon, 18 Jun 2012 20:07:09 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:12.0) Gecko/20120428 Thunderbird/12.0.1 MIME-Version: 1.0 To: Adrian Chadd References: <4DB47CE1.8@frasunek.com> <4DB487D2.7030104@rdtc.ru> <4DB48B76.8050101@frasunek.com> <4DB49109.3050002@frasunek.com> <20110425050548.GF34767@glebius.int.ru> <4DBBBAD8.2000705@frasunek.com> <20110513162311.GK95084@glebius.int.ru> <4DD298AD.2060905@frasunek.com> <20110517184613.GN74366@glebius.int.ru> <4FDB1D71.6050908@freebsd.lublin.pl> <20120615203142.GW28613@glebius.int.ru> <4FDBAFD7.9020606@freebsd.lublin.pl> <4FDF2F81.6030307@sentex.net> <4FDF3097.6080701@freebsd.lublin.pl> In-Reply-To: X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.72 on 64.7.153.18 Cc: freebsd-net@freebsd.org Subject: Re: mpd5/Netgraph issues after upgrading to 7.4 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jun 2012 00:07:11 -0000 On 6/18/2012 6:51 PM, Adrian Chadd wrote: > Hi, > > Is it possible to get you to setup a test BRAS running 9-STABLE, so > you can provide feedback about how stable ipv4/ipv6 PPPoE is for you? I have another LNS to deploy soon and I can enable IPv6 and use RELENG9. I have in the past been able to trigger the panic after a few days of use with IPv6 enabled. Should have it up and running in a week or so. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-net@FreeBSD.ORG Tue Jun 19 18:18:07 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EF01D106564A; Tue, 19 Jun 2012 18:18:07 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (bird.sbone.de [46.4.1.90]) by mx1.freebsd.org (Postfix) with ESMTP id 946F38FC0C; Tue, 19 Jun 2012 18:18:07 +0000 (UTC) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id 7C08E25D3A85; Tue, 19 Jun 2012 18:18:00 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 51A7BBE8487; Tue, 19 Jun 2012 18:17:59 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id BLJ2RdfXVHVg; Tue, 19 Jun 2012 18:17:57 +0000 (UTC) Received: from orange-en1.sbone.de (orange-en1.sbone.de [IPv6:fde9:577b:c1a9:31:cabc:c8ff:fecf:e8e3]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 70747BE8485; Tue, 19 Jun 2012 18:17:56 +0000 (UTC) Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: "Bjoern A. Zeeb" In-Reply-To: Date: Tue, 19 Jun 2012 18:17:55 +0000 Content-Transfer-Encoding: 7bit Message-Id: <215F75FC-7265-4DDF-AA0B-90078EC8A333@lists.zabbadoz.net> References: <4DB47CE1.8@frasunek.com> <4DB487D2.7030104@rdtc.ru> <4DB48B76.8050101@frasunek.com> <4DB49109.3050002@frasunek.com> <20110425050548.GF34767@glebius.int.ru> <4DBBBAD8.2000705@frasunek.com> <20110513162311.GK95084@glebius.int.ru> <4DD298AD.2060905@frasunek.com> <20110517184613.GN74366@glebius.int.ru> <4FDB1D71.6050908@freebsd.lublin.pl> <20120615203142.GW28613@glebius.int.ru> <4FDBAFD7.9020606@freebsd.lublin.pl> <4FDF2F81.6030307@sentex.net> <4FDF3097.6080701@freebsd.lublin.pl> To: Adrian Chadd X-Mailer: Apple Mail (2.1084) Cc: Przemyslaw Frasunek , Mike Tancsa , freebsd-net@freebsd.org Subject: Re: mpd5/Netgraph issues after upgrading to 7.4 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jun 2012 18:18:08 -0000 On 18. Jun 2012, at 22:51 , Adrian Chadd wrote: > Hi, > > Is it possible to get you to setup a test BRAS running 9-STABLE, so > you can provide feedback about how stable ipv4/ipv6 PPPoE is for you? > > It's great that you've solved it for 7.x, and I know that bz and > others know about a variety of fun issues in the networking stack that > may be related to this, but the only way this will get fixed and > validated is if you can help us test it out on something more recent. And bz has already replied that the issue ahs not been fixed in 8/9/HEAD yet. Read your emails please. BTW. I can reproduce it from a shell script fairly easily if you want to work on the fix; I also have crash information for you if needed; that's not the point; I just need 24 hours. /bz -- Bjoern A. Zeeb You have to have visions! It does not matter how good you are. It matters what good you do! From owner-freebsd-net@FreeBSD.ORG Tue Jun 19 21:25:57 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D3979106564A for ; Tue, 19 Jun 2012 21:25:57 +0000 (UTC) (envelope-from venglin@freebsd.lublin.pl) Received: from lagoon.freebsd.lublin.pl (lagoon.freebsd.lublin.pl [IPv6:2a02:2928:a::3]) by mx1.freebsd.org (Postfix) with ESMTP id 5EA9D8FC12 for ; Tue, 19 Jun 2012 21:25:56 +0000 (UTC) Received: from [10.66.254.3] (mgmt.nette.pl [193.138.118.12]) by lagoon.freebsd.lublin.pl (Postfix) with ESMTPSA id E80A723947D; Tue, 19 Jun 2012 23:25:53 +0200 (CEST) Message-ID: <4FE0EE62.5070905@freebsd.lublin.pl> Date: Tue, 19 Jun 2012 23:25:54 +0200 From: Przemyslaw Frasunek Organization: frasunek.com User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:13.0) Gecko/20120614 Thunderbird/13.0.1 MIME-Version: 1.0 To: Mike Tancsa References: <4DB47CE1.8@frasunek.com> <4DB487D2.7030104@rdtc.ru> <4DB48B76.8050101@frasunek.com> <4DB49109.3050002@frasunek.com> <20110425050548.GF34767@glebius.int.ru> <4DBBBAD8.2000705@frasunek.com> <20110513162311.GK95084@glebius.int.ru> <4DD298AD.2060905@frasunek.com> <20110517184613.GN74366@glebius.int.ru> <4FDB1D71.6050908@freebsd.lublin.pl> <20120615203142.GW28613@glebius.int.ru> <4FDBAFD7.9020606@freebsd.lublin.pl> <4FDF2F81.6030307@sentex.net> <4FDF3097.6080701@freebsd.lublin.pl> In-Reply-To: <4FDF3097.6080701@freebsd.lublin.pl> X-Enigmail-Version: 1.4.2 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Cc: freebsd-net@freebsd.org Subject: Re: mpd5/Netgraph issues after upgrading to 7.4 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jun 2012 21:25:57 -0000 > It's way better now. I had no crash since IPv6 is disabled. After reenabling IPv6, the crash occurred within 6 hours. This time, crashdump was properly saved (thanks to patch suggested by Eugene). As already stated by bz, panic is definitely related to races in IPv6 code: (kgdb) bt #0 doadump () at pcpu.h:224 #1 0xffffffff80376ae3 in boot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:448 #2 0xffffffff80377017 in panic (fmt=0x1
) at /usr/src/sys/kern/kern_shutdown.c:639 #3 0xffffffff8053c380 in trap_fatal (frame=0x9, eva=Variable "eva" is not available. ) at /usr/src/sys/amd64/amd64/trap.c:848 #4 0xffffffff8053c8d1 in trap (frame=0xffffff818562c4a0) at /usr/src/sys/amd64/amd64/trap.c:600 #5 0xffffffff80523654 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:228 #6 0xffffffff804b72bd in prelist_remove (pr=0xffffff0006d3d980) at /usr/src/sys/netinet6/nd6_rtr.c:966 #7 0xffffffff804b077a in nd6_purge (ifp=0xffffff004c927800) at /usr/src/sys/netinet6/nd6.c:802 #8 0xffffffff8049d0d4 in in6_ifdetach (ifp=0xffffff004c927800) at /usr/src/sys/netinet6/in6_ifattach.c:792 #9 0xffffffff80420888 in if_detach (ifp=0xffffff004c927800) at /usr/src/sys/net/if.c:919 #10 0xffffffff8044345e in ng_iface_shutdown (node=0xffffff004c086700) at /usr/src/sys/netgraph/ng_iface.c:803 #11 0xffffffff8043ec65 in ng_rmnode (node=0xffffff004c086700, dummy1=Variable "dummy1" is not available. ) at /usr/src/sys/netgraph/ng_base.c:752 #12 0xffffffff8043f66d in ng_apply_item (node=0xffffff004c086700, item=0xffffff002407ae00, rw=1) at /usr/src/sys/netgraph/ng_base.c:2453 #13 0xffffffff804404be in ng_snd_item (item=Variable "item" is not available. ) at /usr/src/sys/netgraph/ng_base.c:2250 #14 0xffffffff8044df24 in ngc_send (so=Variable "so" is not available. ) at /usr/src/sys/netgraph/ng_socket.c:317 #15 0xffffffff803e1a97 in sosend_generic (so=0xffffff0004a71aa0, addr=0xffffff004c4d11e0, uio=0xffffff818562ca00, top=0xffffff00046ac700, control=0x0, flags=Variable "flags" is not available. ) at /usr/src/sys/kern/uipc_socket.c:1295 #16 0xffffffff803e6535 in kern_sendit (td=0xffffff000428e000, s=5, mp=0xffffff818562cad0, flags=0, control=0x0, segflg=Variable "segflg" is not available. ) at /usr/src/sys/kern/uipc_syscalls.c:785 #17 0xffffffff803e66fc in sendit (td=0xffffff000428e000, s=5, mp=0xffffff818562cad0, flags=0) at /usr/src/sys/kern/uipc_syscalls.c:717 #18 0xffffffff803e67ed in sendto (td=Variable "td" is not available. ) at /usr/src/sys/kern/uipc_syscalls.c:837 #19 0xffffffff8053bb32 in amd64_syscall (td=0xffffff000428e000, traced=0) at subr_syscall.c:114 #20 0xffffffff8052394c in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:387 (kgdb) frame 6 #6 0xffffffff804b72bd in prelist_remove (pr=0xffffff0006d3d980) at /usr/src/sys/netinet6/nd6_rtr.c:966 966 LIST_REMOVE(pr, ndpr_entry); (kgdb) list 961 return; /* notice here? */ 962 963 s = splnet(); 964 965 /* unlink ndpr_entry from nd_prefix list */ 966 LIST_REMOVE(pr, ndpr_entry); 967 968 /* free list of routers that adversed the prefix */ 969 LIST_FOREACH_SAFE(pfr, &pr->ndpr_advrtrs, pfr_entry, next) { 970 free(pfr, M_IP6NDP); (kgdb) print *pr $1 = {ndpr_ifp = 0xdeadc0dedeadc0de, ndpr_entry = { le_next = 0xdeadc0dedeadc0de, le_prev = 0xdeadc0dedeadc0de}, ndpr_prefix = {sin6_len = 222 'О©╫', sin6_family = 192 'О©╫', sin6_port = 57005, sin6_flowinfo = 3735929054, sin6_addr = {__u6_addr = { __u6_addr8 = "О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫", __u6_addr16 = {49374, 57005, 49374, 57005, 49374, 57005, 49374, 57005}, __u6_addr32 = {3735929054, 3735929054, 3735929054, 3735929054}}}, sin6_scope_id = 3735929054}, ndpr_mask = {__u6_addr = {__u6_addr8 = "О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫О©╫", __u6_addr16 = { 49374, 57005, 49374, 57005, 49374, 57005, 49374, 57005}, __u6_addr32 = {3735929054, 3735929054, 3735929054, 3735929054}}}, ndpr_vltime = 3735929054, ndpr_pltime = 3735929054, ndpr_expire = -2401050962867404578, ndpr_preferred = -2401050962867404578, ndpr_lastupdate = -2401050962867404578, ndpr_flags = {onlink = 0 '\0', autonomous = 1 '\001', reserved = 55 '7'}, ndpr_stateflags = 3735929054, ndpr_advrtrs = {lh_first = 0xdeadc0dedeadc0de}, ndpr_plen = 224 'О©╫', ndpr_refcnt = -1} From owner-freebsd-net@FreeBSD.ORG Tue Jun 19 22:51:43 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6811F106564A; Tue, 19 Jun 2012 22:51:43 +0000 (UTC) (envelope-from david.somayajulu@qlogic.com) Received: from ch1outboundpool.messaging.microsoft.com (ch1ehsobe005.messaging.microsoft.com [216.32.181.185]) by mx1.freebsd.org (Postfix) with ESMTP id E83B48FC14; Tue, 19 Jun 2012 22:51:39 +0000 (UTC) Received: from mail40-ch1-R.bigfish.com (10.43.68.225) by CH1EHSOBE018.bigfish.com (10.43.70.68) with Microsoft SMTP Server id 14.1.225.23; Tue, 19 Jun 2012 21:49:46 +0000 Received: from mail40-ch1 (localhost [127.0.0.1]) by mail40-ch1-R.bigfish.com (Postfix) with ESMTP id 62615260241; Tue, 19 Jun 2012 21:49:46 +0000 (UTC) X-Forefront-Antispam-Report: CIP:198.70.193.64; KIP:(null); UIP:(null); IPV:NLI; H:avexcashub1.qlogic.com; RD:avexcashub2.qlogic.com; EFVD:NLI X-SpamScore: -1 X-BigFish: VPS-1(zzc85fh14ffIzz1202hzz8275bh8275dhz2fh2a8h668h839hd25hf0ah) Received-SPF: pass (mail40-ch1: domain of qlogic.com designates 198.70.193.64 as permitted sender) client-ip=198.70.193.64; envelope-from=david.somayajulu@qlogic.com; helo=avexcashub1.qlogic.com ; 1.qlogic.com ; Received: from mail40-ch1 (localhost.localdomain [127.0.0.1]) by mail40-ch1 (MessageSwitch) id 134014258455577_6158; Tue, 19 Jun 2012 21:49:44 +0000 (UTC) Received: from CH1EHSMHS025.bigfish.com (snatpool2.int.messaging.microsoft.com [10.43.68.234]) by mail40-ch1.bigfish.com (Postfix) with ESMTP id 018612A0057; Tue, 19 Jun 2012 21:49:44 +0000 (UTC) Received: from avexcashub1.qlogic.com (198.70.193.64) by CH1EHSMHS025.bigfish.com (10.43.70.25) with Microsoft SMTP Server (TLS) id 14.1.225.23; Tue, 19 Jun 2012 21:49:44 +0000 Received: from avexmb1.qlogic.org ([fe80::9545:3a4f:c131:467d]) by avexcashub2.qlogic.org ([::1]) with mapi; Tue, 19 Jun 2012 14:51:04 -0700 From: David Somayajulu To: "freebsd-net@freebsd.org" Date: Tue, 19 Jun 2012 14:51:03 -0700 Thread-Topic: Setting User Priority Bits in VLAN Tag Thread-Index: Ac1OZAEE1d6L1TXMSnSA6142KcyShg== Message-ID: <75E1A2A7D185F841A975979B0906BBA67CA1230A6F@AVEXMB1.qlogic.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US MIME-Version: 1.0 X-OriginatorOrg: qlogic.com Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: "davidcs@FreeBSD.org" Subject: Setting User Priority Bits in VLAN Tag X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jun 2012 22:51:43 -0000 Hi All, How does one specify the User Priority Bits (Bits 15 - 13) in a VLAN Tag in= FreeBSD. It appears that it is not possible currently, but I am not sure. Thanks David S. ________________________________ This message and any attached documents contain information from QLogic Cor= poration or its wholly-owned subsidiaries that may be confidential. If you = are not the intended recipient, you may not read, copy, distribute, or use = this information. If you have received this transmission in error, please n= otify the sender immediately by reply e-mail and then delete this message. From owner-freebsd-net@FreeBSD.ORG Wed Jun 20 03:43:29 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4170F1065673; Wed, 20 Jun 2012 03:43:29 +0000 (UTC) (envelope-from rozhuk.im@gmail.com) Received: from mail-ee0-f54.google.com (mail-ee0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 9DA888FC19; Wed, 20 Jun 2012 03:43:25 +0000 (UTC) Received: by eeke49 with SMTP id e49so2562694eek.13 for ; Tue, 19 Jun 2012 20:43:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=reply-to:from:to:cc:references:in-reply-to:subject:date:message-id :mime-version:content-type:content-transfer-encoding:x-mailer :content-language:thread-index; bh=ka4CCen5UCMZszdSkbD2NYlIsJ/Nc+v3/sXpHcUCdNM=; b=LNhgrBZPEG52bIUqZLRekM6zxXhzCGjMQbjiv1RuW6XaN2DHY1nDoMAGvZCPp6ZGFa yOnEjwP3cQN1f6LpDXWWNiNjcuKImJhHC7cyNX6muDSEB/FKDzCfYolYvyebH/toc+VA hqGONbojJtIuW5pfJR83JndzTCeK1fqXwT9HjVJSbnM1GOXz4G2Hrleo7DK4FuvTsEW5 1f7xthZawYKS4r0Qyyx1/k72ZFsUoPP9v8bc1IlXRFbmBPPzdU2TrVfKaICndkmutEz1 dEgz/MhXq+gfoPRxOWLfN0mghn1dzj5rIYhRB7AmfToqFHWgmSdDXojVGPVZ9Bi+F+52 oEvQ== Received: by 10.14.101.78 with SMTP id a54mr4968359eeg.92.1340163804265; Tue, 19 Jun 2012 20:43:24 -0700 (PDT) Received: from rimwks1w7x64 ([2001:470:1f15:8e:cd0b:64ad:7718:dc87]) by mx.google.com with ESMTPS id y54sm84412798eef.10.2012.06.19.20.43.21 (version=SSLv3 cipher=OTHER); Tue, 19 Jun 2012 20:43:23 -0700 (PDT) From: rozhuk.im@gmail.com To: "'David Somayajulu'" , References: <75E1A2A7D185F841A975979B0906BBA67CA1230A6F@AVEXMB1.qlogic.org> In-Reply-To: <75E1A2A7D185F841A975979B0906BBA67CA1230A6F@AVEXMB1.qlogic.org> Date: Wed, 20 Jun 2012 12:43:14 +0900 Message-ID: <4fe146db.4e640e0a.5037.6f15@mx.google.com> MIME-Version: 1.0 Content-Type: text/plain; charset="US-ASCII" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 12.0 Content-Language: ru Thread-Index: Ac1OZAEE1d6L1TXMSnSA6142KcyShgAMqfSg Cc: davidcs@FreeBSD.org Subject: RE: Setting User Priority Bits in VLAN Tag X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Rozhuk.IM@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jun 2012 03:43:29 -0000 Use ng_patch > -----Original Message----- > From: owner-freebsd-net@freebsd.org [mailto:owner-freebsd- > net@freebsd.org] On Behalf Of David Somayajulu > Sent: Wednesday, June 20, 2012 6:51 AM > To: freebsd-net@freebsd.org > Cc: davidcs@FreeBSD.org > Subject: Setting User Priority Bits in VLAN Tag > > Hi All, > How does one specify the User Priority Bits (Bits 15 - 13) in a VLAN > Tag in FreeBSD. It appears that it is not possible currently, but I am > not sure. > Thanks > David S. > > ________________________________ > This message and any attached documents contain information from QLogic > Corporation or its wholly-owned subsidiaries that may be confidential. > If you are not the intended recipient, you may not read, copy, > distribute, or use this information. If you have received this > transmission in error, please notify the sender immediately by reply e- > mail and then delete this message. > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@FreeBSD.ORG Wed Jun 20 08:13:18 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 87A17106566C for ; Wed, 20 Jun 2012 08:13:18 +0000 (UTC) (envelope-from guyong1978@hotmail.com) Received: from snt0-omc2-s32.snt0.hotmail.com (snt0-omc2-s32.snt0.hotmail.com [65.55.90.107]) by mx1.freebsd.org (Postfix) with ESMTP id 58EAB8FC0C for ; Wed, 20 Jun 2012 08:13:18 +0000 (UTC) Received: from SNT112-W22 ([65.55.90.72]) by snt0-omc2-s32.snt0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Wed, 20 Jun 2012 01:12:12 -0700 Message-ID: X-Originating-IP: [194.237.142.17] From: GuYong To: Date: Wed, 20 Jun 2012 08:12:12 +0000 Importance: Normal MIME-Version: 1.0 X-OriginalArrivalTime: 20 Jun 2012 08:12:12.0604 (UTC) FILETIME=[656C7FC0:01CD4EBC] Content-Type: text/plain; charset="gb2312" Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Question about MLDv2 implemenation in Kernel X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jun 2012 08:13:18 -0000 Hi, everyone, I'm looking at the MLDv2 implemenation in kernel, and there seem to be some issues, could anyone confirm them? 1. RFC3810 clause 6.1 mentions there is a Source Retransmission Counter associated to each source, so that the merged report could contain the content that is interrupted by a new state change report BUT, I didn't see this is implemented currently! 2. Regarding the 'Older Version Querier Present timer', the code is like this:old_version_timer = (mli->mli_rv * mli->mli_qi) + mli->mli_qri; while mli->mli_qri = maxdelay, and maxdelay = ntohs(mld->mld_maxdelay). BUT, mld_maxdelay is in units of milliseconds (clause 5.1.3), I think it should be divided by 1000 before it adds to old_version_timer. 3. According to RFC, a node MUST accept and process any Query whose IP Destination Address field contains *any* of the address (unicast or multicast) assigned to the interface on which the Query arrives. BUT, I see the code only accept General Query addressed to FF02::1. Best Regards,Yong From owner-freebsd-net@FreeBSD.ORG Wed Jun 20 10:47:35 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6F1721065672 for ; Wed, 20 Jun 2012 10:47:35 +0000 (UTC) (envelope-from venkatduvvuru.ml@gmail.com) Received: from mail-ob0-f182.google.com (mail-ob0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id 355768FC0C for ; Wed, 20 Jun 2012 10:47:35 +0000 (UTC) Received: by obbun3 with SMTP id un3so913700obb.13 for ; Wed, 20 Jun 2012 03:47:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=KMp1JMLetkcIQIRdV579e38jCj9O/sP/8bsySzAHR68=; b=F/+fExoOfdMwA0CuStb5qwx4wQkyplENfd3tBxFZb8q8nyK0tRYhwoyDjdlyl1wfpq 8jLVq2mW6cL/JB6Qvnpd95RzWNfWndHBzzY7MTZn7FqT2s8UURXfdU6oIT2FaMlZxCNR /J+AFjGri5T7UPCF3ryIpZPazqOtPlU76/BlGgSWG8ZiKeXifCEX0f13BOOC6Tk31rSD U+YMBoD0lkXOZg46Di69s3pF9XEtaFFBZD0VRLDQyMTlTmmKrIJoWOCMzX4AFbwcaOar BkGNrU0vRCctstklM1N5doqBt8CBz220itRzf/Y/xnsMGi5qcjobllCYmb6hTW4M4jX2 Q1GQ== MIME-Version: 1.0 Received: by 10.50.36.227 with SMTP id t3mr4084654igj.13.1340189254454; Wed, 20 Jun 2012 03:47:34 -0700 (PDT) Received: by 10.64.77.72 with HTTP; Wed, 20 Jun 2012 03:47:34 -0700 (PDT) Date: Wed, 20 Jun 2012 16:17:34 +0530 Message-ID: From: Venkat Duvvuru To: freebsd-net@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jun 2012 10:47:35 -0000 Hi, MSI-x supports upto 2048 vectors but what I see in freebsd 8.2 is that when I use more than ~30 vectors, system becomes dead slow. Is there a limitation on number of msi vectors that can be used in 8.2? /Venkat From owner-freebsd-net@FreeBSD.ORG Wed Jun 20 14:55:05 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D719C1065672 for ; Wed, 20 Jun 2012 14:55:05 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id A965D8FC19 for ; Wed, 20 Jun 2012 14:55:05 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id AB7A5B97E; Wed, 20 Jun 2012 10:55:02 -0400 (EDT) From: John Baldwin To: freebsd-net@freebsd.org Date: Wed, 20 Jun 2012 10:54:40 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p13; KDE/4.5.5; amd64; ; ) References: In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <201206201054.40824.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Wed, 20 Jun 2012 10:55:02 -0400 (EDT) Cc: Venkat Duvvuru Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jun 2012 14:55:05 -0000 On Wednesday, June 20, 2012 6:47:34 am Venkat Duvvuru wrote: > Hi, > MSI-x supports upto 2048 vectors but what I see in freebsd 8.2 is that when > I use more than ~30 vectors, system becomes dead slow. > Is there a limitation on number of msi vectors that can be used in 8.2? FreeBSD/x86 supports roughly 191 distinct interrupts on each CPU, and each MSI-X interrupt takes up a single vector on the CPU it resides on. If you exhaust that set of vectors, then pci_alloc_msix() will fail (or return a smaller count). However, I haven't seen any issues with the system being slow with 30 vectors. Are these 30 vectors all tied to a single device, and are they evenly distributed across the available CPUs? Have you run top when the system was sluggish to see what each CPU was doing? -- John Baldwin From owner-freebsd-net@FreeBSD.ORG Wed Jun 20 21:02:22 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A8DDE1065742 for ; Wed, 20 Jun 2012 21:02:22 +0000 (UTC) (envelope-from rpaulo@FreeBSD.org) Received: from felyko.com (stark.strangled.net [IPv6:2607:f2f8:a528::3:1337:ca7]) by mx1.freebsd.org (Postfix) with ESMTP id 6EC1D8FC19 for ; Wed, 20 Jun 2012 21:02:22 +0000 (UTC) Received: from [IPv6:2620:149:4:f01:95db:5be2:ed96:7cb] (unknown [IPv6:2620:149:4:f01:95db:5be2:ed96:7cb]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by felyko.com (Postfix) with ESMTPSA id F20FC3EC3A; Wed, 20 Jun 2012 14:02:21 -0700 (PDT) Content-Type: text/plain; charset=GB2312 Mime-Version: 1.0 (Mac OS X Mail 6.0 \(1477\)) From: Rui Paulo In-Reply-To: Date: Wed, 20 Jun 2012 14:02:21 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <39BF633E-25BE-4382-A6BC-FB788566447B@FreeBSD.org> References: To: GuYong X-Mailer: Apple Mail (2.1477) Cc: freebsd-net@freebsd.org Subject: Re: Question about MLDv2 implemenation in Kernel X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jun 2012 21:02:22 -0000 Hi, On 20 Jun 2012, at 01:12, GuYong wrote: >=20 > Hi, everyone, > I'm looking at the MLDv2 implemenation in kernel, and there seem to be = some issues, could anyone confirm them? > 1. RFC3810 clause 6.1 mentions there is a Source Retransmission = Counter associated to each source, so that the merged report could = contain the content that is interrupted by a new state change report = BUT, I didn't see this is implemented currently! > 2. Regarding the 'Older Version Querier Present timer', the code is = like this:old_version_timer =3D (mli->mli_rv * mli->mli_qi) + = mli->mli_qri; > while mli->mli_qri =3D maxdelay, and maxdelay =3D = ntohs(mld->mld_maxdelay). BUT, mld_maxdelay is in units of = milliseconds (clause 5.1.3), I think it should be divided by 1000 before = it adds to old_version_timer. >=20 > 3. According to RFC, a node MUST accept and process any Query whose = IP Destination Address field contains *any* of the address (unicast or = multicast) assigned to the interface on which the Query arrives. = BUT, I see the code only accept General Query addressed to FF02::1. I kindly ask you to submit a problem report at = http://www.freebsd.org/send-pr.html so this doesn't get lost. Did you = find these issues by code inspection or when using a test suite? Do you = have any patches? Thanks, -- Rui Paulo From owner-freebsd-net@FreeBSD.ORG Wed Jun 20 21:20:15 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A5BC01065674; Wed, 20 Jun 2012 21:20:15 +0000 (UTC) (envelope-from rpaulo@felyko.com) Received: from felyko.com (stark.strangled.net [IPv6:2607:f2f8:a528::3:1337:ca7]) by mx1.freebsd.org (Postfix) with ESMTP id 864198FC14; Wed, 20 Jun 2012 21:20:15 +0000 (UTC) Received: from [IPv6:2620:149:4:f01:95db:5be2:ed96:7cb] (unknown [IPv6:2620:149:4:f01:95db:5be2:ed96:7cb]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) by felyko.com (Postfix) with ESMTPSA id E384B3EC3A; Wed, 20 Jun 2012 14:20:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=felyko.com; s=mail; t=1340227215; bh=RlTOdloEm1wnc/eoNZI7bxDEZ5EL1FFOwl4uMAVgb68=; h=Content-Type:Mime-Version:Subject:From:In-Reply-To:Date:Cc: Content-Transfer-Encoding:Message-Id:References:To; b=iKBjAEMu2oLIlTmM1nmu2AMKke1FJ4rBLA+ynv7zPo2XmhvSAIZboltudLKRxjEgF jlHwzg95/S9V2rVWZtG6HBllhoQWNwqiHJ4FDDyn2Z13Pngxw4mJpB9keOztoGWqOI I7uIMhJ33pRKBEHw1M6gM9lwy5PZ3t9hg3pkbf8A= Content-Type: text/plain; charset=GB2312 Mime-Version: 1.0 (Mac OS X Mail 6.0 \(1477\)) From: Rui Paulo In-Reply-To: Date: Wed, 20 Jun 2012 14:20:14 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <36507982-766F-4AD3-96A3-6872B9F32793@felyko.com> References: To: GuYong , bms@freebsd.org X-Mailer: Apple Mail (2.1477) Cc: freebsd-net@freebsd.org Subject: Re: Question about MLDv2 implemenation in Kernel X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jun 2012 21:20:15 -0000 On 20 Jun 2012, at 01:12, GuYong wrote: > 1. RFC3810 clause 6.1 mentions there is a Source Retransmission = Counter associated to each source, so that the merged report could = contain the content that is interrupted by a new state change report = BUT, I didn't see this is implemented currently! I think this is stored in the mli_rv variable and decremented = accordingly. > 2. Regarding the 'Older Version Querier Present timer', the code is = like this:old_version_timer =3D (mli->mli_rv * mli->mli_qi) + = mli->mli_qri; > while mli->mli_qri =3D maxdelay, and maxdelay =3D = ntohs(mld->mld_maxdelay). BUT, mld_maxdelay is in units of = milliseconds (clause 5.1.3), I think it should be divided by 1000 before = it adds to old_version_timer. I think you're right and it should be divided by MLD_TIMER_SCALE. > 3. According to RFC, a node MUST accept and process any Query whose = IP Destination Address field contains *any* of the address (unicast or = multicast) assigned to the interface on which the Query arrives. = BUT, I see the code only accept General Query addressed to FF02::1. Hmm, I disagree. Here's what the RFC says: 5.1.15. Destination Addresses for Queries In MLDv2, General Queries are sent to the link-scope all-nodes multicast address (FF02::1). Multicast Address Specific and Multicast Address and Source Specific Queries are sent with an IP destination address equal to the multicast address of interest. *However*, a node MUST accept and process any Query whose IP Destination Address field contains *any* of the addresses (unicast or multicast) assigned to the interface on which the Query arrives. This might be useful, e.g., for debugging purposes. My reading of it suggests that we are doing the right thing. We do = accept it and process it, but, like the text implies, we shouldn't take = any action. -- Rui Paulo From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 07:21:18 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 13D65106566C; Thu, 21 Jun 2012 07:21:18 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) by mx1.freebsd.org (Postfix) with ESMTP id E0B438FC0A; Thu, 21 Jun 2012 07:21:17 +0000 (UTC) Received: from JRE-MBP-2.local (c-67-180-24-15.hsd1.ca.comcast.net [67.180.24.15]) (authenticated bits=0) by vps1.elischer.org (8.14.5/8.14.5) with ESMTP id q5L6xbsQ057101 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Wed, 20 Jun 2012 23:59:37 -0700 (PDT) (envelope-from julian@freebsd.org) Message-ID: <4FE2C653.40805@freebsd.org> Date: Wed, 20 Jun 2012 23:59:31 -0700 From: Julian Elischer User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:13.0) Gecko/20120614 Thunderbird/13.0.1 MIME-Version: 1.0 To: Sami Halabi References: <4FD3224A.3080700@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org, "Alexander V. Chernikov" , freebsd-ipfw@freebsd.org Subject: Re: ipfw rules consuming CPU X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 07:21:18 -0000 On 6/9/12 4:19 AM, Sami Halabi wrote: > Hi, > all rules togther less than 80 rules.... > > how tablearg helps this? each ip & pipe (up & down) are unique... > > any other advices? also, make sure that all rules are only evaluate by packets that might actually test true.. i.e. separate out different interfaces and directions to different rules using skipto... for example skipto 2000 ip from any to any in recv xx0 skipto 3000 ip from any to any out xmit xx0 skipto 4000 ip from any to any in yy0 skipto 5000 ip from any to any out xmit yy0 if yy0 is a 10GB ethernet and there is traffic there, that traffic shouldn't be evaluating the rules that only make sense for xx0. similarly inwards traveling packets shouldn't have to evaluate outwards rules. May or may not help in your situation. you don't really give enough info. > > Sami > > On Sat, Jun 9, 2012 at 1:15 PM, Alexander V. Chernikov > wrote: >> On 09.06.2012 01:56, Sami Halabi wrote: >> >>> Hi, >>> >>> I Manage a FreeBSD server as an edge router& firewall. >>> >>> the setup has 10G interfaces (ixgbe-82599EB) and 1G interfaces(em-82571EB& >>> bce-BCM5709) connected to 10G/1G switches. >>> >>> With the following setup i get higher cpu usage: >>> bce1-upstream provider with little bandwidth, so i use pipes to limit >>> users, and subnets >>> ix0 - Internet Exchange >>> >>> some rules. >>> . >>> . >>> .from 4000 starts pipes for specefic ips bandwidth allocations >>> 04000 6210053001 5845967300616 pipe 1003 ip from 182.46.92.13 to any >>> out xmit bce1 >>> 04100 41289897537 3064110648124 pipe 1004 ip from any to 182.46.92.13 >>> in recv bce1 >>> >> You should use pipe tablearg for that. Traversing 4k rules effectively >> kills all performance. >> >> >> . >>> . >>> . >>> .7000 is the wider pipeline for the whole block >>> 07000 9127154724 4651308720315 pipe 1000 ip from 182.46.92.0/24 to >>> any out xmit bce1 >>> 07100 4837016828 458027989917 pipe 1002 ip from any to >>> 182.46.92.0/24 in recv bce1 >>> last rule default to accept... >>> >>> specefic pipes (1003-...) have limits say between 1-10Mbps, and the wider >>> pipe (1000 and 1002) has a global limit of 40MBps that should be reached >>> by >>> all other non-specefic ips, config like this: >>> #Wide >>> ipfw pipe 1000 config bw 40Mbit/s queue 200Kbytes >>> ipfw pipe 1002 config bw 40Mbit/s queue 200Kbytes >>> #specefic >>> ipfw pipe 1003 config bw 9Mbit/s queue 200Kbytes >>> ipfw pipe 1004 config bw 9Mbit/s queue 200Kbytes >>> ipfw pipe 1005 config bw 3Mbit/s queue 200Kbytes >>> ipfw pipe 1006 config bw 3Mbit/s queue 200Kbytes >>> ipfw pipe 1007 config bw 5Mbit/s queue 200Kbytes >>> ipfw pipe 1008 config bw 5Mbit/s queue 200Kbytes >>> ipfw pipe 1009 config bw 10Mbit/s queue 200Kbytes >>> ipfw pipe 1010 config bw 10Mbit/s queue 200Kbytes >>> >>> >>> with this configuration when i have lots of traffic (3-6GB) going via ix0 >>> (not necessarly the ips described above, lets say to a server in my net ip >>> 1832.46.93.4 and users behind the Internet Exchange) i see high cpu usage >>> (70-90%). >>> >>> my first test was to: ipfw add 1 allow all from any to any, and cpu usage >>> drops immediatly to 10-15%. >>> but that not why i want (i wantto keep thelimits) so I add rule right >>> before 4000 and the cpu usage drops down to 10-20%: >>> 03020 1669463072808 1493341413029803 allow ip from any to any via ix0 >>> >>> >>> Any advice why this happens? or should it be there in the first place? >>> I use FreeBSD 8.1-R-p10-amd64. >>> >>> Thanks in advance, >>> >>> >> -- >> WBR, Alexander >> > > From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 09:21:50 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E247F1065675; Thu, 21 Jun 2012 09:21:50 +0000 (UTC) (envelope-from bms@fastmail.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) by mx1.freebsd.org (Postfix) with ESMTP id A0F378FC0C; Thu, 21 Jun 2012 09:21:50 +0000 (UTC) Received: from compute5.internal (compute5.nyi.mail.srv.osa [10.202.2.45]) by gateway1.nyi.mail.srv.osa (Postfix) with ESMTP id 7819621572; Thu, 21 Jun 2012 05:21:44 -0400 (EDT) Received: from frontend2.nyi.mail.srv.osa ([10.202.2.161]) by compute5.internal (MEProxy); Thu, 21 Jun 2012 05:21:44 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=fastmail.net; h= message-id:date:from:mime-version:to:cc:subject:references :in-reply-to:content-type:content-transfer-encoding; s=mesmtp; bh=E/LyY2RSb8DzivOJIypeCEoV+3U=; b=QniyWPUPH8MCyILrSsSaFgRJDcS9 CjNggjXB4sroGrLoYdLvCk8uFsznFfYbvQygY/wh0aXWGWJMmctsDOXPPmDg8khE LdjE9rxmIu2yQ72KeQhuGcojyD13VMi/GCK7ghyJJP77Gm7fgsRg2CgnzNTVEHa0 mPm15HnCVRd7RV8= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=message-id:date:from:mime-version:to:cc :subject:references:in-reply-to:content-type :content-transfer-encoding; s=smtpout; bh=E/LyY2RSb8DzivOJIypeCE oV+3U=; b=sEDW1l0crGCpSqHHhNO6ykEK9QEqw6EpvBakxIiu07le19dyqVLIVK WHk2569ugrGglgBVjXkR9H0fl/awVBrF4SkKkneID9zwFokggkX2sPaLBLKrVP7K ljzoDKqr3usyWOHGB8oKf1M3x4qOd3a5/ErlDEo+N6TJBD8EHY5rE= X-Sasl-enc: NfOslAZmsOT7wRujZlu8RwybQbfRwKo4i7YVAcPSlcLd 1340270504 Received: from [10.34.204.179] (unknown [193.62.251.36]) by mail.messagingengine.com (Postfix) with ESMTPA id CFA904836DD; Thu, 21 Jun 2012 05:21:43 -0400 (EDT) Message-ID: <4FE2E779.9040009@fastmail.net> Date: Thu, 21 Jun 2012 10:20:57 +0100 From: Bruce Simpson User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:13.0) Gecko/20120616 Thunderbird/13.0.1 MIME-Version: 1.0 To: Rui Paulo References: <36507982-766F-4AD3-96A3-6872B9F32793@felyko.com> In-Reply-To: <36507982-766F-4AD3-96A3-6872B9F32793@felyko.com> Content-Type: text/plain; charset=GB2312 Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org, bms@freebsd.org, GuYong Subject: Re: Question about MLDv2 implemenation in Kernel X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 09:21:51 -0000 All, I'm working on something new just now,and am in a conference, but here is my 2p. On 20/06/12 22:20, Rui Paulo wrote: > On 20 Jun 2012, at 01:12, GuYong wrote: >> 1. RFC3810 clause 6.1 mentions there is a Source Retransmission Counter associated to each source, so that the merged report could contain the content that is interrupted by a new state change report BUT, I didn't see this is implemented currently! > I think this is stored in the mli_rv variable and decremented accordingly. Merging of pending state-changes is performed by mld_v2_merge_state_changes() and runs on a per-group basis for the end-station. mli_rv controls the retransmission report count. > I think you're right and it should be divided by MLD_TIMER_SCALE. ENOTIME to look into this further, but if someone sends me a working patch, I will review and commit. > My reading of it suggests that we are doing the right thing. We do > accept it and process it, but, like the text implies, we shouldn't > take any action. I concur. Bruce From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 09:47:50 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 66EAC106566C; Thu, 21 Jun 2012 09:47:50 +0000 (UTC) (envelope-from venkatduvvuru.ml@gmail.com) Received: from mail-gh0-f182.google.com (mail-gh0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 0BBAE8FC12; Thu, 21 Jun 2012 09:47:49 +0000 (UTC) Received: by ghbz22 with SMTP id z22so320745ghb.13 for ; Thu, 21 Jun 2012 02:47:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=E41q0VC+DzYfrIKGI22vyrmbFChzOMq9bV+lgc9Da5o=; b=ce4z8MVOj94CIOyRmCo0c8Hvuq1r3rTeyLsG1eoIHaxjLmecQbFSeTSx2mQYN0Ze+7 EPIlHJripWtJdO6MmXx1PKczh3NHCZzeJRnxkGDsZnKFu3Zy6w9OcYZ8NVs99sSryKZJ 9AoqCB8K+vhjbixNiqdaPdbZr+XcGI8kuQPcGKyiXTdntAGVDgCIWPg7Uez5FQksk+Nt PjiEjPHregK5XLnB20kzTKa53Lkt3nmCewFhPT6T94+6Mbq32wkGXZN4yTbqjbPWw8gZ g9Dkvsp0PSV3hCrmb4AW79Q5u8mS0g1/Suw5Q/XV3kVnnpQWEoePIV7t8FRgQIP7H4Nx +CvA== MIME-Version: 1.0 Received: by 10.50.10.164 with SMTP id j4mr6923587igb.13.1340272068404; Thu, 21 Jun 2012 02:47:48 -0700 (PDT) Received: by 10.64.77.72 with HTTP; Thu, 21 Jun 2012 02:47:48 -0700 (PDT) In-Reply-To: <201206201054.40824.jhb@freebsd.org> References: <201206201054.40824.jhb@freebsd.org> Date: Thu, 21 Jun 2012 15:17:48 +0530 Message-ID: From: Venkat Duvvuru To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 09:47:50 -0000 John - Thanks for the reply. All the CPUs are ~100% idle. I don't see any interrupt storm on any of the irqs (vmstat -i). One observation I made is that I see messages like these in dmesg ===> mem 0xfaf60000-0xfaf7ffff,0xfaf40000-0xfaf5ffff,0xfaf1c000-0xfaf1ffff irq 40 at device 0.1 on pci6 Looking at the irq value I think it is the INTx irq range which shouldn't have probably got allocated as the device is msix capable and there are vectors allocated for these devices in the range (256-380). Could this be a problem? The scenario where I am hitting this problem is a setup with 4 NICs, each NIC with two ports and each port using up 4 msix vectors. The system is fine till some ports are up but once I ifup the 5th port, the system becomes sluggish. I'm not sure whether all the 30 vectors are from a single cpu..I don't know how to get that information. /Venkat On Wed, Jun 20, 2012 at 8:24 PM, John Baldwin wrote: > On Wednesday, June 20, 2012 6:47:34 am Venkat Duvvuru wrote: > > Hi, > > MSI-x supports upto 2048 vectors but what I see in freebsd 8.2 is that > when > > I use more than ~30 vectors, system becomes dead slow. > > Is there a limitation on number of msi vectors that can be used in 8.2? > > FreeBSD/x86 supports roughly 191 distinct interrupts on each CPU, and each > MSI-X interrupt takes up a single vector on the CPU it resides on. If you > exhaust that set of vectors, then pci_alloc_msix() will fail (or return a > smaller count). However, I haven't seen any issues with the system being > slow > with 30 vectors. Are these 30 vectors all tied to a single device, and are > they evenly distributed across the available CPUs? Have you run top when > the > system was sluggish to see what each CPU was doing? > > -- > John Baldwin > From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 12:22:08 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C24E2106566C for ; Thu, 21 Jun 2012 12:22:08 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 96F258FC1C for ; Thu, 21 Jun 2012 12:22:08 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id F0108B988; Thu, 21 Jun 2012 08:22:07 -0400 (EDT) From: John Baldwin To: Venkat Duvvuru Date: Thu, 21 Jun 2012 08:16:22 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p13; KDE/4.5.5; amd64; ; ) References: <201206201054.40824.jhb@freebsd.org> In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Message-Id: <201206210816.22774.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Thu, 21 Jun 2012 08:22:08 -0400 (EDT) Cc: freebsd-net@freebsd.org Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 12:22:08 -0000 On Thursday, June 21, 2012 5:47:48 am Venkat Duvvuru wrote: > John - Thanks for the reply. > > All the CPUs are ~100% idle. I don't see any interrupt storm on any of the > irqs (vmstat -i). > > One observation I made is that I see messages like these in dmesg > > ===> mem 0xfaf60000-0xfaf7ffff,0xfaf40000-0xfaf5ffff,0xfaf1c000-0xfaf1ffff > irq 40 at device 0.1 on pci6 > > Looking at the irq value I think it is the INTx irq range which shouldn't > have probably got allocated as the device is msix capable and there are > vectors allocated for these devices in the range (256-380). > > Could this be a problem? No, that line is output before the driver's attach routine is run, so it will always show INTx IRQ value even if it isn't used. > The scenario where I am hitting this problem is a setup with 4 NICs, each > NIC with two ports and each port using up 4 msix vectors. The system is > fine till some ports are up but once I ifup the 5th port, the system > becomes sluggish. > > I'm not sure whether all the 30 vectors are from a single cpu..I don't know > how to get that information. Unfortunately there isn't an easy way. I have this gdb script which can display it from kgdb on x86: define irqs set $e = event_list->tqh_first while ($e != 0) if ($e->ie_source != 0 && $e->ie_handlers.tqh_first != 0) set $src = (struct intsrc *)$e->ie_source if ($src->is_pic->pic_enable_source == &ioapic_enable_source) set $_cpu = ((struct ioapic_intsrc *)$src)->io_cpu else if ($src->is_pic->pic_enable_source == &msi_enable_source) set $_cpu = ((struct msi_intsrc *)$src)->msi_cpu else set $_cpu = 0 end end printf "CPU %d: %s\n", $_cpu, $e->ie_fullname end set $e = $e->ie_list.tqe_next end end document irqs Dump list of IRQs with associated CPU. end However, unless the driver is using BUS_BIND_IRQ() or you are using cpuset -x, the interrupts should be round-robin assigned among CPUs. What exactly do you mean by sluggish? Trying to interact with the box over SSH is sluggish? Is there a change in RTT if you are pinging the box, is there a change in performance of TCP or UDP streams to/from the box? -- John Baldwin From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 12:23:37 2012 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2E45010656D4; Thu, 21 Jun 2012 12:23:37 +0000 (UTC) (envelope-from eugen@grosbein.pp.ru) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13::5]) by mx1.freebsd.org (Postfix) with ESMTP id 6CD6A8FC0C; Thu, 21 Jun 2012 12:23:36 +0000 (UTC) Received: from eg.sd.rdtc.ru (localhost [127.0.0.1]) by eg.sd.rdtc.ru (8.14.5/8.14.5) with ESMTP id q5LCNXPk076526; Thu, 21 Jun 2012 19:23:33 +0700 (NOVT) (envelope-from eugen@grosbein.pp.ru) Message-ID: <4FE31245.8020406@grosbein.pp.ru> Date: Thu, 21 Jun 2012 19:23:33 +0700 From: Eugene Grosbein User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; ru-RU; rv:1.9.2.13) Gecko/20110112 Thunderbird/3.1.7 MIME-Version: 1.0 To: "net@freebsd.org" References: <4FC5A9AF.1000003@rdtc.ru> <86lik9foup.fsf@kopusha.home.net> In-Reply-To: <86lik9foup.fsf@kopusha.home.net> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: Mikolaj Golub Subject: bsnmp and HOST-RESOURCES-MIB X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 12:23:37 -0000 Hi! bsnmpd(1) has /usr/lib/snmp_hostres.so module in base system for HOST-RESOURCES-MIB implementation. What should I do to make bsnmpwalk -v 2c -s comm@localhost 1.3.6.1.2.1.25.3.3.1.2 work without complaining: bsnmpwalk: Invalid OID - 1.3.6.1.2.1.25.3.3.1.2 OID parsing error - 1.3.6.1.2.1.25.3.3.1.2 And without "-n" flag, please :-) I'd like it to resolve OIDs to their names. Eugene Grosbein From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 12:50:07 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 935B4106564A; Thu, 21 Jun 2012 12:50:07 +0000 (UTC) (envelope-from venkatduvvuru.ml@gmail.com) Received: from mail-gh0-f182.google.com (mail-gh0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 2CADA8FC12; Thu, 21 Jun 2012 12:50:07 +0000 (UTC) Received: by ghbz22 with SMTP id z22so468652ghb.13 for ; Thu, 21 Jun 2012 05:50:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=nGF/DbKO67rayK6Gc+XZqykH2hiNoEXQ1Bc6uYsQtJM=; b=pH+EtTh1Tp6pCDRPCyDz/7zXUkPjB90HUGugq5Khsz0yTNldHKS3pCgc632WEsaZ9y m75FVaRzq1VzlWWhS1c/yA16r/eOFdNS0Zk4Fqpj2+N08oWhcQC+ivgI9CtN2UF0dVpr g0rjIsCOiOPmtidWeNDxwZcjYJUKuAnv6I3ovyAG8W2jHCid8y9OPlhXCTKrQy4ECSh6 npy7NFohrqgCzET/x0UobZR0wFHyo6KV9i45FT2uIfBTae10ez0edaOvW/oF7WZa4tS4 XSuTuHBnbqYKaoLw0deKqH2GeumVDOITfyQ40nJqDOC7B+l4Et9r30GwNkjvnZRT7QmX pk0A== MIME-Version: 1.0 Received: by 10.50.36.227 with SMTP id t3mr7329726igj.13.1340283006350; Thu, 21 Jun 2012 05:50:06 -0700 (PDT) Received: by 10.64.77.72 with HTTP; Thu, 21 Jun 2012 05:50:06 -0700 (PDT) In-Reply-To: <201206210816.22774.jhb@freebsd.org> References: <201206201054.40824.jhb@freebsd.org> <201206210816.22774.jhb@freebsd.org> Date: Thu, 21 Jun 2012 18:20:06 +0530 Message-ID: From: Venkat Duvvuru To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 12:50:07 -0000 While I'm able to ping to the machine..every command on the current active session is sluggish infact doesn't complete, unable to open another ssh session..an already opened ssh session doesn't react which is running "systat -vmstat"... The only thing I could do is to successfully complete "top -P" command once..even top hung for the second time. /Venkat On Thu, Jun 21, 2012 at 5:46 PM, John Baldwin wrote: > On Thursday, June 21, 2012 5:47:48 am Venkat Duvvuru wrote: > > John - Thanks for the reply. > > > > All the CPUs are ~100% idle. I don't see any interrupt storm on any of > the > > irqs (vmstat -i). > > > > One observation I made is that I see messages like these in dmesg > > > > ===> mem > 0xfaf60000-0xfaf7ffff,0xfaf40000-0xfaf5ffff,0xfaf1c000-0xfaf1ffff > > irq 40 at device 0.1 on pci6 > > > > Looking at the irq value I think it is the INTx irq range which shouldn't > > have probably got allocated as the device is msix capable and there are > > vectors allocated for these devices in the range (256-380). > > > > Could this be a problem? > > No, that line is output before the driver's attach routine is run, so it > will > always show INTx IRQ value even if it isn't used. > > > The scenario where I am hitting this problem is a setup with 4 NICs, each > > NIC with two ports and each port using up 4 msix vectors. The system is > > fine till some ports are up but once I ifup the 5th port, the system > > becomes sluggish. > > > > I'm not sure whether all the 30 vectors are from a single cpu..I don't > know > > how to get that information. > > Unfortunately there isn't an easy way. I have this gdb script which can > display it from kgdb on x86: > > define irqs > set $e = event_list->tqh_first > while ($e != 0) > if ($e->ie_source != 0 && $e->ie_handlers.tqh_first != 0) > set $src = (struct intsrc *)$e->ie_source > if ($src->is_pic->pic_enable_source == &ioapic_enable_source) > set $_cpu = ((struct ioapic_intsrc *)$src)->io_cpu > else > if ($src->is_pic->pic_enable_source == &msi_enable_source) > set $_cpu = ((struct msi_intsrc *)$src)->msi_cpu > else > set $_cpu = 0 > end > end > printf "CPU %d: %s\n", $_cpu, $e->ie_fullname > end > set $e = $e->ie_list.tqe_next > end > end > > document irqs > Dump list of IRQs with associated CPU. > end > > However, unless the driver is using BUS_BIND_IRQ() or you are using cpuset > -x, > the interrupts should be round-robin assigned among CPUs. > > What exactly do you mean by sluggish? Trying to interact with the box over > SSH is sluggish? Is there a change in RTT if you are pinging the box, is > there a change in performance of TCP or UDP streams to/from the box? > > -- > John Baldwin > From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 13:00:09 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B07A11065673; Thu, 21 Jun 2012 13:00:09 +0000 (UTC) (envelope-from venkatduvvuru.ml@gmail.com) Received: from mail-gh0-f182.google.com (mail-gh0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 38B138FC15; Thu, 21 Jun 2012 13:00:09 +0000 (UTC) Received: by ghbz22 with SMTP id z22so479681ghb.13 for ; Thu, 21 Jun 2012 06:00:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=sKtBRth/hAaIJM0D3IPHx8bD41VGC0meDhk4EPmlSis=; b=YpM8WHTY588h3/7rjRra0qcPWzLHUTMKc/SCBtl7IHPzb652Jo2OGcl6OVpmdSAHCG mZAHWNjTUMxh5SIe+JgtVvKVwWpQigHcX8L3tHiQIB8Sv/1wwRVaXA3twVQ6B2xc9vaO Z9RLOmMRKxcRV2MAYVIW57HLYKI5/uyda3BwKKZtFpsSNrTd9DMCANCGe7TYBrHSVYrA 940HZF1lqfl2PUeSlaroXUTAmy2/B95b0R4ep/+qst+pRtvS8scyb1mei9uf68KHmksG nMK/wRVDJGR2GX22KIYtSjL7wxATgSq43PvVkeD1D/rSm5DV9jl9xqy8ksamRhhjv+Hj 4GaA== MIME-Version: 1.0 Received: by 10.50.183.230 with SMTP id ep6mr7155238igc.52.1340283608505; Thu, 21 Jun 2012 06:00:08 -0700 (PDT) Received: by 10.64.77.72 with HTTP; Thu, 21 Jun 2012 06:00:08 -0700 (PDT) In-Reply-To: References: <201206201054.40824.jhb@freebsd.org> <201206210816.22774.jhb@freebsd.org> Date: Thu, 21 Jun 2012 18:30:08 +0530 Message-ID: From: Venkat Duvvuru To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 13:00:09 -0000 I suspected the hardware hence installed Linux and cross verified that Linux is working fine. /Venkat On Thu, Jun 21, 2012 at 6:20 PM, Venkat Duvvuru wrote: > While I'm able to ping to the machine..every command on the current active > session is sluggish infact doesn't complete, unable to open another ssh > session..an already opened ssh session doesn't react which is running > "systat -vmstat"... > > The only thing I could do is to successfully complete "top -P" command > once..even top hung for the second time. > > /Venkat > > > On Thu, Jun 21, 2012 at 5:46 PM, John Baldwin wrote: > >> On Thursday, June 21, 2012 5:47:48 am Venkat Duvvuru wrote: >> > John - Thanks for the reply. >> > >> > All the CPUs are ~100% idle. I don't see any interrupt storm on any of >> the >> > irqs (vmstat -i). >> > >> > One observation I made is that I see messages like these in dmesg >> > >> > ===> mem >> 0xfaf60000-0xfaf7ffff,0xfaf40000-0xfaf5ffff,0xfaf1c000-0xfaf1ffff >> > irq 40 at device 0.1 on pci6 >> > >> > Looking at the irq value I think it is the INTx irq range which >> shouldn't >> > have probably got allocated as the device is msix capable and there are >> > vectors allocated for these devices in the range (256-380). >> > >> > Could this be a problem? >> >> No, that line is output before the driver's attach routine is run, so it >> will >> always show INTx IRQ value even if it isn't used. >> >> > The scenario where I am hitting this problem is a setup with 4 NICs, >> each >> > NIC with two ports and each port using up 4 msix vectors. The system is >> > fine till some ports are up but once I ifup the 5th port, the system >> > becomes sluggish. >> > >> > I'm not sure whether all the 30 vectors are from a single cpu..I don't >> know >> > how to get that information. >> >> Unfortunately there isn't an easy way. I have this gdb script which can >> display it from kgdb on x86: >> >> define irqs >> set $e = event_list->tqh_first >> while ($e != 0) >> if ($e->ie_source != 0 && $e->ie_handlers.tqh_first != 0) >> set $src = (struct intsrc *)$e->ie_source >> if ($src->is_pic->pic_enable_source == &ioapic_enable_source) >> set $_cpu = ((struct ioapic_intsrc *)$src)->io_cpu >> else >> if ($src->is_pic->pic_enable_source == &msi_enable_source) >> set $_cpu = ((struct msi_intsrc *)$src)->msi_cpu >> else >> set $_cpu = 0 >> end >> end >> printf "CPU %d: %s\n", $_cpu, $e->ie_fullname >> end >> set $e = $e->ie_list.tqe_next >> end >> end >> >> document irqs >> Dump list of IRQs with associated CPU. >> end >> >> However, unless the driver is using BUS_BIND_IRQ() or you are using >> cpuset -x, >> the interrupts should be round-robin assigned among CPUs. >> >> What exactly do you mean by sluggish? Trying to interact with the box >> over >> SSH is sluggish? Is there a change in RTT if you are pinging the box, is >> there a change in performance of TCP or UDP streams to/from the box? >> >> -- >> John Baldwin >> > > From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 13:17:52 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BB68B106566B; Thu, 21 Jun 2012 13:17:52 +0000 (UTC) (envelope-from guyong1978@hotmail.com) Received: from snt0-omc4-s21.snt0.hotmail.com (snt0-omc4-s21.snt0.hotmail.com [65.55.90.224]) by mx1.freebsd.org (Postfix) with ESMTP id 89B498FC0A; Thu, 21 Jun 2012 13:17:52 +0000 (UTC) Received: from SNT112-W46 ([65.55.90.199]) by snt0-omc4-s21.snt0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Thu, 21 Jun 2012 06:16:45 -0700 Message-ID: X-Originating-IP: [194.237.142.17] From: GuYong To: , Date: Thu, 21 Jun 2012 13:16:44 +0000 Importance: Normal In-Reply-To: <4FE2E779.9040009@fastmail.net> References: , <36507982-766F-4AD3-96A3-6872B9F32793@felyko.com>, <4FE2E779.9040009@fastmail.net> MIME-Version: 1.0 X-OriginalArrivalTime: 21 Jun 2012 13:16:45.0827 (UTC) FILETIME=[1B86CD30:01CD4FB0] Content-Type: text/plain; charset="gb2312" Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org, bms@freebsd.org Subject: RE: Question about MLDv2 implemenation in Kernel X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 13:17:52 -0000 Hi, The issues are observed from my testing, so I'm 90% sure those issues are real. see my answers below! > Date: Thu, 21 Jun 2012 10:20:57 +0100 > From: bms@fastmail.net > To: rpaulo@felyko.com > CC: freebsd-net@freebsd.org; bms@freebsd.org; guyong1978@hotmail.com > Subject: Re: Question about MLDv2 implemenation in Kernel > > All, > > I'm working on something new just now,and am in a conference, but here > is my 2p. > > On 20/06/12 22:20, Rui Paulo wrote: > > On 20 Jun 2012, at 01:12, GuYong wrote: > >> 1. RFC3810 clause 6.1 mentions there is a Source Retransmission Counter associated to each source, so that the merged report could contain the content that is interrupted by a new state change report BUT, I didn't see this is implemented currently! > > I think this is stored in the mli_rv variable and decremented accordingly. > > Merging of pending state-changes is performed by > mld_v2_merge_state_changes() and runs on a per-group basis for the > end-station. If the new state change occurs before the first transmission of previous state change report, the two reports will be merged.But if new state change occurs after first transmisson and before retransmission of first report, the pending retransmission report is deleted from the queue. static int mld_handle_state_change( ) { .... _IF_DRAIN(&inm->in6m_scq); //deleted here!!!! retval = mld_v2_enqueue_group_record(&inm->in6m_scq, inm, 1, 0, 0, (mli->mli_flags & MLIF_USEALLOW)); } As no source retransmission counter is associated, the retransmission of previous report is missed. > > mli_rv controls the retransmission report count. > > > I think you're right and it should be divided by MLD_TIMER_SCALE. > > ENOTIME to look into this further, but if someone sends me a working > patch, I will review and commit. > > > > My reading of it suggests that we are doing the right thing. We do > > accept it and process it, but, like the text implies, we shouldn't > > take any action. > > I concur. I don't agree, although general query is usually addressed to FF02::1, but kernel should not care about the IP destination of MLDv2 query, and respond with report. I see this is how Linux does. What's more, RFC6636 metions the general query could be unicasted to host for some purpose. > > Bruce > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 13:50:31 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7A4341065670 for ; Thu, 21 Jun 2012 13:50:31 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 359138FC0A for ; Thu, 21 Jun 2012 13:50:31 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 73767B978; Thu, 21 Jun 2012 09:50:30 -0400 (EDT) From: John Baldwin To: Venkat Duvvuru Date: Thu, 21 Jun 2012 09:47:30 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p13; KDE/4.5.5; amd64; ; ) References: <201206210816.22774.jhb@freebsd.org> In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Message-Id: <201206210947.30171.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Thu, 21 Jun 2012 09:50:30 -0400 (EDT) Cc: freebsd-net@freebsd.org Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 13:50:31 -0000 On Thursday, June 21, 2012 8:50:06 am Venkat Duvvuru wrote: > While I'm able to ping to the machine..every command on the current active > session is sluggish infact doesn't complete, unable to open another ssh > session..an already opened ssh session doesn't react which is running > "systat -vmstat"... > > The only thing I could do is to successfully complete "top -P" command > once..even top hung for the second time. Hmm, is this a stock FreeBSD driver or an out-of-tree NIC driver? > /Venkat > > On Thu, Jun 21, 2012 at 5:46 PM, John Baldwin wrote: > > > On Thursday, June 21, 2012 5:47:48 am Venkat Duvvuru wrote: > > > John - Thanks for the reply. > > > > > > All the CPUs are ~100% idle. I don't see any interrupt storm on any of > > the > > > irqs (vmstat -i). > > > > > > One observation I made is that I see messages like these in dmesg > > > > > > ===> mem > > 0xfaf60000-0xfaf7ffff,0xfaf40000-0xfaf5ffff,0xfaf1c000-0xfaf1ffff > > > irq 40 at device 0.1 on pci6 > > > > > > Looking at the irq value I think it is the INTx irq range which shouldn't > > > have probably got allocated as the device is msix capable and there are > > > vectors allocated for these devices in the range (256-380). > > > > > > Could this be a problem? > > > > No, that line is output before the driver's attach routine is run, so it > > will > > always show INTx IRQ value even if it isn't used. > > > > > The scenario where I am hitting this problem is a setup with 4 NICs, each > > > NIC with two ports and each port using up 4 msix vectors. The system is > > > fine till some ports are up but once I ifup the 5th port, the system > > > becomes sluggish. > > > > > > I'm not sure whether all the 30 vectors are from a single cpu..I don't > > know > > > how to get that information. > > > > Unfortunately there isn't an easy way. I have this gdb script which can > > display it from kgdb on x86: > > > > define irqs > > set $e = event_list->tqh_first > > while ($e != 0) > > if ($e->ie_source != 0 && $e->ie_handlers.tqh_first != 0) > > set $src = (struct intsrc *)$e->ie_source > > if ($src->is_pic->pic_enable_source == &ioapic_enable_source) > > set $_cpu = ((struct ioapic_intsrc *)$src)->io_cpu > > else > > if ($src->is_pic->pic_enable_source == &msi_enable_source) > > set $_cpu = ((struct msi_intsrc *)$src)->msi_cpu > > else > > set $_cpu = 0 > > end > > end > > printf "CPU %d: %s\n", $_cpu, $e->ie_fullname > > end > > set $e = $e->ie_list.tqe_next > > end > > end > > > > document irqs > > Dump list of IRQs with associated CPU. > > end > > > > However, unless the driver is using BUS_BIND_IRQ() or you are using cpuset > > -x, > > the interrupts should be round-robin assigned among CPUs. > > > > What exactly do you mean by sluggish? Trying to interact with the box over > > SSH is sluggish? Is there a change in RTT if you are pinging the box, is > > there a change in performance of TCP or UDP streams to/from the box? > > > > -- > > John Baldwin > > > -- John Baldwin From owner-freebsd-net@FreeBSD.ORG Thu Jun 21 15:32:25 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 716B6106566B; Thu, 21 Jun 2012 15:32:25 +0000 (UTC) (envelope-from bms@fastmail.net) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) by mx1.freebsd.org (Postfix) with ESMTP id 31D1B8FC18; Thu, 21 Jun 2012 15:32:25 +0000 (UTC) Received: from compute5.internal (compute5.nyi.mail.srv.osa [10.202.2.45]) by gateway1.nyi.mail.srv.osa (Postfix) with ESMTP id B205D2110A; Thu, 21 Jun 2012 11:32:24 -0400 (EDT) Received: from frontend2.nyi.mail.srv.osa ([10.202.2.161]) by compute5.internal (MEProxy); Thu, 21 Jun 2012 11:32:24 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=fastmail.net; h= message-id:date:from:mime-version:to:cc:subject:references :in-reply-to:content-type; s=mesmtp; bh=Dr+xX0/nyQ1Ry+GpZQEwE65w 1o8=; b=CS2xPtpSaeqlk5jzqiTvhRgM2Y8xDNaIruEalZRPgjESYrpTTE38zeRZ FsMHRVDLPmMEklL3cP0+Ot+as0xh0aKLtlxRixl35L5HH+EasmM5g+yVLd/QsKLw O+NK2a2oQGUMfNDSVRECIkynwBNN0JI1aMUOR5X4QeOqIRRLhjY= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=message-id:date:from:mime-version:to:cc :subject:references:in-reply-to:content-type; s=smtpout; bh=Dr+x X0/nyQ1Ry+GpZQEwE65w1o8=; b=Ln5R+SrWmjxhMlMpcCBjjYPVLK6liJyFmxGT TOZ7juxOHDrW+nEBvV3VBVwo9j43qkWB5CJeEReSZgSfF6Rf1pQ5BJBvQsBIm8LP d20lqQ0ECoytMyVQQQZL7/wcBwmDcbuHJD7tTFS4cjizml6fW5EWZjDyGJgrri+j 1UqrCYs= X-Sasl-enc: h3f4Ct66d6lBqmJYEy7yETHsjOJZmvr5rl5xWyJAvb9t 1340292744 Received: from [10.34.204.179] (unknown [193.62.251.36]) by mail.messagingengine.com (Postfix) with ESMTPA id 012E34837EB; Thu, 21 Jun 2012 11:32:23 -0400 (EDT) Message-ID: <4FE33E58.5030106@fastmail.net> Date: Thu, 21 Jun 2012 16:31:36 +0100 From: Bruce Simpson User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:13.0) Gecko/20120616 Thunderbird/13.0.1 MIME-Version: 1.0 To: GuYong References: , <36507982-766F-4AD3-96A3-6872B9F32793@felyko.com>, <4FE2E779.9040009@fastmail.net> In-Reply-To: Content-Type: text/plain; charset=GB2312 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org, bms@freebsd.org, rpaulo@felyko.com Subject: Re: Question about MLDv2 implemenation in Kernel X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jun 2012 15:32:25 -0000 Hi, Regarding RFC 6636, I don't know anything about it. It wasn't published until last month, so MLDv2 in FreeBSD came 3 years before it. On 21/06/12 14:16, GuYong wrote: > > > My reading of it suggests that we are doing the right thing. We do > > > accept it and process it, but, like the text implies, we shouldn't > > > take any action. > > > > I concur. > > I don't agree, although general query is usually addressed to FF02::1, > but kernel should not care about the IP destination o f MLDv2 query, > and respond with report. I see this is how Linux does. > Good catch, RFC 3810 5.1.5 vs line 877: http://svnweb.freebsd.org/base/stable/8/sys/netinet6/mld6.c?revision=233201&view=markup I'm not set up to do development for FreeBSD-CURRENT just now, as my $DAYJOB project is targeted at 8.x. But I will try to make time to spin HEAD up again, and commit a patch, if someone else is willing to write and test it... Bruce From owner-freebsd-net@FreeBSD.ORG Fri Jun 22 01:40:05 2012 Return-Path: Delivered-To: freebsd-net@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 25DD81065672 for ; Fri, 22 Jun 2012 01:40:05 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id F32048FC0C for ; Fri, 22 Jun 2012 01:40:04 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q5M1e4nT064903 for ; Fri, 22 Jun 2012 01:40:04 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id q5M1e4UV064902; Fri, 22 Jun 2012 01:40:04 GMT (envelope-from gnats) Date: Fri, 22 Jun 2012 01:40:04 GMT Message-Id: <201206220140.q5M1e4UV064902@freefall.freebsd.org> To: freebsd-net@FreeBSD.org From: Mark Johnston Cc: Subject: Re: kern/155030: [igb] igb(4) DEVICE_POLLING does not work with carp(4) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Mark Johnston List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Jun 2012 01:40:05 -0000 The following reply was made to PR kern/155030; it has been noted by GNATS. From: Mark Johnston To: bug-followup@FreeBSD.org, mm@FreeBSD.org Cc: Subject: Re: kern/155030: [igb] igb(4) DEVICE_POLLING does not work with carp(4) Date: Thu, 21 Jun 2012 21:38:36 -0400 --+HP7ph2BbKc20aGI Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Another way to go is just to fix igb(4)'s polling routine to work with multiple queues. That's what I've done in the src tree at my work; the patch is attached. Can you test it and let me know if it solves your problem? If so, I'll bug jfv@ to commit it. =) Thanks, -Mark --+HP7ph2BbKc20aGI Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="igb_polling.patch" diff --git a/share/man/man4/polling.4 b/share/man/man4/polling.4 index 2c711cc..6abc37c 100644 --- a/share/man/man4/polling.4 +++ b/share/man/man4/polling.4 @@ -184,6 +184,7 @@ As of this writing, the .Xr fwe 4 , .Xr fwip 4 , .Xr fxp 4 , +.Xr igb 4 , .Xr ixgb 4 , .Xr nfe 4 , .Xr nge 4 , diff --git a/sys/dev/e1000/if_igb.c b/sys/dev/e1000/if_igb.c index cb6c63f..7a92b9a 100644 --- a/sys/dev/e1000/if_igb.c +++ b/sys/dev/e1000/if_igb.c @@ -1482,12 +1482,6 @@ igb_irq_fast(void *arg) } #ifdef DEVICE_POLLING -/********************************************************************* - * - * Legacy polling routine : if using this code you MUST be sure that - * multiqueue is not defined, ie, set igb_num_queues to 1. - * - *********************************************************************/ #if __FreeBSD_version >= 800000 #define POLL_RETURN_COUNT(a) (a) static int @@ -1498,11 +1492,12 @@ static void igb_poll(struct ifnet *ifp, enum poll_cmd cmd, int count) { struct adapter *adapter = ifp->if_softc; - struct igb_queue *que = adapter->queues; - struct tx_ring *txr = adapter->tx_rings; + struct igb_queue *que; + struct tx_ring *txr; u32 reg_icr, rx_done = 0; u32 loop = IGB_MAX_LOOP; bool more; + int i; IGB_CORE_LOCK(adapter); if ((ifp->if_drv_flags & IFF_DRV_RUNNING) == 0) { @@ -1521,20 +1516,26 @@ igb_poll(struct ifnet *ifp, enum poll_cmd cmd, int count) } IGB_CORE_UNLOCK(adapter); - igb_rxeof(que, count, &rx_done); + for (i = 0; i < adapter->num_queues; i++) { + que = &adapter->queues[i]; + txr = que->txr; + + igb_rxeof(que, count, &rx_done); - IGB_TX_LOCK(txr); - do { - more = igb_txeof(txr); - } while (loop-- && more); + IGB_TX_LOCK(txr); + do { + more = igb_txeof(txr); + } while (loop-- && more); #if __FreeBSD_version >= 800000 - if (!drbr_empty(ifp, txr->br)) - igb_mq_start_locked(ifp, txr, NULL); + if (!drbr_empty(ifp, txr->br)) + igb_mq_start_locked(ifp, txr, NULL); #else - if (!IFQ_DRV_IS_EMPTY(&ifp->if_snd)) - igb_start_locked(txr, ifp); + if (!IFQ_DRV_IS_EMPTY(&ifp->if_snd)) + igb_start_locked(txr, ifp); #endif - IGB_TX_UNLOCK(txr); + IGB_TX_UNLOCK(txr); + } + return POLL_RETURN_COUNT(rx_done); } #endif /* DEVICE_POLLING */ @@ -4846,7 +4847,7 @@ next_desc: } if (done != NULL) - *done = rxdone; + *done += rxdone; IGB_RX_UNLOCK(rxr); return ((staterr & E1000_RXD_STAT_DD) ? TRUE : FALSE); --+HP7ph2BbKc20aGI-- From owner-freebsd-net@FreeBSD.ORG Fri Jun 22 06:50:58 2012 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 44278106566B for ; Fri, 22 Jun 2012 06:50:58 +0000 (UTC) (envelope-from to.my.trociny@gmail.com) Received: from mail-lb0-f182.google.com (mail-lb0-f182.google.com [209.85.217.182]) by mx1.freebsd.org (Postfix) with ESMTP id AAF488FC08 for ; Fri, 22 Jun 2012 06:50:57 +0000 (UTC) Received: by lbon10 with SMTP id n10so3882540lbo.13 for ; Thu, 21 Jun 2012 23:50:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:to:cc:subject:organization:references:sender:date:in-reply-to :message-id:user-agent:mime-version:content-type; bh=YMmdzM/5E+eFHtI8q3cjLp3jT0KYwDZaPEuflYLM3OI=; b=nShkeFFeNicDthnYqOBwBohM/5Nkjt5FgKcDJfBHnY1b155gr0LT5jgxjs0RrIZqFS C6IGrg4Ba4CUcs09gwq9lnxRXSuREZissyLQ7OFymCaDAWIQCuXcdBbFSulIMJazAkLx SUk6a3BAFVy1phNWlqMsS4MHioazC7QHvXQceZw4OREbh2zMUokT+gZ70qYFnC/EHLhq zHnFD5gbPHF2JOaYuAqTyu3IUTiWh7RsSJxO58L47A6sNldTZgLo5YOWYyC20eo0xjIX y4Dn3C8nzTG/mAVKh5MhurlTuRXAeAJeFGODOFwc68nzksbZsVaFGBJhONygELJrdNeA hfHQ== Received: by 10.152.125.116 with SMTP id mp20mr986472lab.19.1340347851452; Thu, 21 Jun 2012 23:50:51 -0700 (PDT) Received: from localhost ([188.230.122.226]) by mx.google.com with ESMTPS id b3sm20245051lbh.6.2012.06.21.23.50.48 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 21 Jun 2012 23:50:49 -0700 (PDT) From: Mikolaj Golub To: Eugene Grosbein Organization: TOA Ukraine References: <4FC5A9AF.1000003@rdtc.ru> <86lik9foup.fsf@kopusha.home.net> <4FE31245.8020406@grosbein.pp.ru> Sender: Mikolaj Golub Date: Fri, 22 Jun 2012 09:50:46 +0300 In-Reply-To: <4FE31245.8020406@grosbein.pp.ru> (Eugene Grosbein's message of "Thu, 21 Jun 2012 19:23:33 +0700") Message-ID: <86k3yzc01l.fsf@in138.ua3> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.4 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: "net@freebsd.org" Subject: Re: bsnmp and HOST-RESOURCES-MIB X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Jun 2012 06:50:58 -0000 On Thu, 21 Jun 2012 19:23:33 +0700 Eugene Grosbein wrote: EG> Hi! EG> bsnmpd(1) has /usr/lib/snmp_hostres.so module in base system EG> for HOST-RESOURCES-MIB implementation. What should I do to make EG> bsnmpwalk -v 2c -s comm@localhost 1.3.6.1.2.1.25.3.3.1.2 EG> work without complaining: EG> bsnmpwalk: Invalid OID - 1.3.6.1.2.1.25.3.3.1.2 EG> OID parsing error - 1.3.6.1.2.1.25.3.3.1.2 EG> And without "-n" flag, please :-) EG> I'd like it to resolve OIDs to their names. I am not very familiar with bsnmptools. Experimenting, I have found such combinations working: in138:~% bsnmpwalk -v 1 -s public@localhost -i hostres_tree.def 'hrProcessorTable' hrProcessorFrwID[5] = 0.0 hrProcessorFrwID[10] = 0.0 hrProcessorLoad[5] = 7 hrProcessorLoad[10] = 5 in138:~% bsnmpget -v 1 -s public@localhost -i hostres_tree.def 'hrProcessorLoad.5' hrProcessorLoad[5] = 8 Note, you should explicitly specify hostres_tree.def (from /usr/share/snmp/defs) for bsnmptools to be able to resolve name (no idea why). Unfortunately, bsnmpwalk does not work for hrProcessorLoad: in138:~% bsnmpwalk -v 1 -s public@localhost -i hostres_tree.def 'hrProcessorLoad' bsnmpwalk: Snmp dialog - Operation timed out Athough it works for the numerical format: in138:~% bsnmpwalk -v 1 -s public@localhost '1.3.6.1.2.1.25.3.3.1.2' 1.3.6.1.2.1.25.3.3.1.2.5 = 10 1.3.6.1.2.1.25.3.3.1.2.10 = 10 in138:~% bsnmpwalk -v 1 -s public@localhost -i hostres_tree.def '1.3.6.1.2.1.25.3.3.1.2' hrProcessorLoad[5] = 10 hrProcessorLoad[10] = 6 Also, no idea why. -- Mikolaj Golub From owner-freebsd-net@FreeBSD.ORG Fri Jun 22 08:55:51 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8E38E1065897; Fri, 22 Jun 2012 08:55:51 +0000 (UTC) (envelope-from venkatduvvuru.ml@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id 31D698FC08; Fri, 22 Jun 2012 08:55:51 +0000 (UTC) Received: by yenl8 with SMTP id l8so1564993yen.13 for ; Fri, 22 Jun 2012 01:55:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=TiG4MmM/wdVnTqTGsU9r+M2skdKXosprbme5u8CyBus=; b=cJbPGfdHHBge6qD68PATfnFWLAtwv8g1NSJ5lOozAbfcm9VPs3DXCufAvIwuVj/lx5 KXBsHtvvY7oRJ/be1fSG7uleiNxuzIhFFZMMc9fnKl9XlmeHhcsVgfjdRWVBbN5BpS8j KwFFuO3+is7dR48qcT6pmKxW5o7xq47PA70luZt+qcS/2ZgwcCWBpwF33/6Umqehfcey 3hfpK65EweJMvUD0CucCgosT9suFAr6Pe4onMBORvDHNwJ3zr3GGpb6gaeiot77smcq9 /ZX2wvSfToq2CzO62uy6+mdkCZuY2ikxCqYF9xLnKSloiP0jlr2E7b3Ic6ZGpi+n2p1P 7e1g== MIME-Version: 1.0 Received: by 10.50.183.230 with SMTP id ep6mr752424igc.52.1340355350060; Fri, 22 Jun 2012 01:55:50 -0700 (PDT) Received: by 10.64.77.72 with HTTP; Fri, 22 Jun 2012 01:55:50 -0700 (PDT) In-Reply-To: <201206210947.30171.jhb@freebsd.org> References: <201206210816.22774.jhb@freebsd.org> <201206210947.30171.jhb@freebsd.org> Date: Fri, 22 Jun 2012 14:25:50 +0530 Message-ID: From: Venkat Duvvuru To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Jun 2012 08:55:51 -0000 This setup has variety of NICs, Intel's, Emulex's and all are stock drivers. /Venkat On Thu, Jun 21, 2012 at 7:17 PM, John Baldwin wrote: > On Thursday, June 21, 2012 8:50:06 am Venkat Duvvuru wrote: > > While I'm able to ping to the machine..every command on the current > active > > session is sluggish infact doesn't complete, unable to open another ssh > > session..an already opened ssh session doesn't react which is running > > "systat -vmstat"... > > > > The only thing I could do is to successfully complete "top -P" command > > once..even top hung for the second time. > > Hmm, is this a stock FreeBSD driver or an out-of-tree NIC driver? > > > /Venkat > > > > On Thu, Jun 21, 2012 at 5:46 PM, John Baldwin wrote: > > > > > On Thursday, June 21, 2012 5:47:48 am Venkat Duvvuru wrote: > > > > John - Thanks for the reply. > > > > > > > > All the CPUs are ~100% idle. I don't see any interrupt storm on any > of > > > the > > > > irqs (vmstat -i). > > > > > > > > One observation I made is that I see messages like these in dmesg > > > > > > > > ===> mem > > > 0xfaf60000-0xfaf7ffff,0xfaf40000-0xfaf5ffff,0xfaf1c000-0xfaf1ffff > > > > irq 40 at device 0.1 on pci6 > > > > > > > > Looking at the irq value I think it is the INTx irq range which > shouldn't > > > > have probably got allocated as the device is msix capable and there > are > > > > vectors allocated for these devices in the range (256-380). > > > > > > > > Could this be a problem? > > > > > > No, that line is output before the driver's attach routine is run, so > it > > > will > > > always show INTx IRQ value even if it isn't used. > > > > > > > The scenario where I am hitting this problem is a setup with 4 NICs, > each > > > > NIC with two ports and each port using up 4 msix vectors. The system > is > > > > fine till some ports are up but once I ifup the 5th port, the system > > > > becomes sluggish. > > > > > > > > I'm not sure whether all the 30 vectors are from a single cpu..I > don't > > > know > > > > how to get that information. > > > > > > Unfortunately there isn't an easy way. I have this gdb script which > can > > > display it from kgdb on x86: > > > > > > define irqs > > > set $e = event_list->tqh_first > > > while ($e != 0) > > > if ($e->ie_source != 0 && $e->ie_handlers.tqh_first != 0) > > > set $src = (struct intsrc *)$e->ie_source > > > if ($src->is_pic->pic_enable_source == > &ioapic_enable_source) > > > set $_cpu = ((struct ioapic_intsrc *)$src)->io_cpu > > > else > > > if ($src->is_pic->pic_enable_source == > &msi_enable_source) > > > set $_cpu = ((struct msi_intsrc *)$src)->msi_cpu > > > else > > > set $_cpu = 0 > > > end > > > end > > > printf "CPU %d: %s\n", $_cpu, $e->ie_fullname > > > end > > > set $e = $e->ie_list.tqe_next > > > end > > > end > > > > > > document irqs > > > Dump list of IRQs with associated CPU. > > > end > > > > > > However, unless the driver is using BUS_BIND_IRQ() or you are using > cpuset > > > -x, > > > the interrupts should be round-robin assigned among CPUs. > > > > > > What exactly do you mean by sluggish? Trying to interact with the box > over > > > SSH is sluggish? Is there a change in RTT if you are pinging the box, > is > > > there a change in performance of TCP or UDP streams to/from the box? > > > > > > -- > > > John Baldwin > > > > > > > -- > John Baldwin > From owner-freebsd-net@FreeBSD.ORG Fri Jun 22 10:25:24 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7728E1065670; Fri, 22 Jun 2012 10:25:24 +0000 (UTC) (envelope-from venkatduvvuru.ml@gmail.com) Received: from mail-gh0-f182.google.com (mail-gh0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 19F6E8FC0C; Fri, 22 Jun 2012 10:25:24 +0000 (UTC) Received: by ghbz22 with SMTP id z22so1610134ghb.13 for ; Fri, 22 Jun 2012 03:25:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=fqyE6KAUnts32RQfYn4uyaKt3Ag9QBKo/nuaDl8/ZnU=; b=nlYbahNPIUR3B/pzSbwdmCwLC5tOa37Zp/BjroKCNRfQYDn6I66a4C7bi7pJgHqRaF IjQQH3RemJMBtW4iBz7ZTRSMA3UalG2sEgSkXDrdcKUZnEjdVEnmyUISioOHyqVPVykf YdiRNO/aPEGAIpyq5gjMNzJ8tpvMvh/zJI8y1pzrV4Kg28S0Jd3DDnLCY3/XPRrl1DtJ 7F0c50lfFOd8PXwSWfF7GBhFRcwQ5KCFOgLQpkqSJQf6Pd3ZYs/+HrAg1yEYLTbWu3C6 mNbWrCqc2UVpkBLUGG36WwjITFjZ31d1WEcwWgd5iky6hSy8eoyr7khjdy4E3om4XNvQ AF1w== MIME-Version: 1.0 Received: by 10.50.41.165 with SMTP id g5mr976578igl.13.1340360723244; Fri, 22 Jun 2012 03:25:23 -0700 (PDT) Received: by 10.64.77.72 with HTTP; Fri, 22 Jun 2012 03:25:23 -0700 (PDT) In-Reply-To: References: <201206210816.22774.jhb@freebsd.org> <201206210947.30171.jhb@freebsd.org> Date: Fri, 22 Jun 2012 15:55:23 +0530 Message-ID: From: Venkat Duvvuru To: John Baldwin Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-net@freebsd.org Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Jun 2012 10:25:24 -0000 and no matter in which order I bring up the interfaces, the system becomes sluggish after the 5th interface is brought up. So doesn't look like a specific driver issue. On Fri, Jun 22, 2012 at 2:25 PM, Venkat Duvvuru wrote: > This setup has variety of NICs, Intel's, Emulex's and all are stock > drivers. > > /Venkat > > On Thu, Jun 21, 2012 at 7:17 PM, John Baldwin wrote: > >> On Thursday, June 21, 2012 8:50:06 am Venkat Duvvuru wrote: >> > While I'm able to ping to the machine..every command on the current >> active >> > session is sluggish infact doesn't complete, unable to open another ssh >> > session..an already opened ssh session doesn't react which is running >> > "systat -vmstat"... >> > >> > The only thing I could do is to successfully complete "top -P" command >> > once..even top hung for the second time. >> >> Hmm, is this a stock FreeBSD driver or an out-of-tree NIC driver? >> >> > /Venkat >> > >> > On Thu, Jun 21, 2012 at 5:46 PM, John Baldwin wrote: >> > >> > > On Thursday, June 21, 2012 5:47:48 am Venkat Duvvuru wrote: >> > > > John - Thanks for the reply. >> > > > >> > > > All the CPUs are ~100% idle. I don't see any interrupt storm on any >> of >> > > the >> > > > irqs (vmstat -i). >> > > > >> > > > One observation I made is that I see messages like these in dmesg >> > > > >> > > > ===> mem >> > > 0xfaf60000-0xfaf7ffff,0xfaf40000-0xfaf5ffff,0xfaf1c000-0xfaf1ffff >> > > > irq 40 at device 0.1 on pci6 >> > > > >> > > > Looking at the irq value I think it is the INTx irq range which >> shouldn't >> > > > have probably got allocated as the device is msix capable and there >> are >> > > > vectors allocated for these devices in the range (256-380). >> > > > >> > > > Could this be a problem? >> > > >> > > No, that line is output before the driver's attach routine is run, so >> it >> > > will >> > > always show INTx IRQ value even if it isn't used. >> > > >> > > > The scenario where I am hitting this problem is a setup with 4 >> NICs, each >> > > > NIC with two ports and each port using up 4 msix vectors. The >> system is >> > > > fine till some ports are up but once I ifup the 5th port, the system >> > > > becomes sluggish. >> > > > >> > > > I'm not sure whether all the 30 vectors are from a single cpu..I >> don't >> > > know >> > > > how to get that information. >> > > >> > > Unfortunately there isn't an easy way. I have this gdb script which >> can >> > > display it from kgdb on x86: >> > > >> > > define irqs >> > > set $e = event_list->tqh_first >> > > while ($e != 0) >> > > if ($e->ie_source != 0 && $e->ie_handlers.tqh_first != 0) >> > > set $src = (struct intsrc *)$e->ie_source >> > > if ($src->is_pic->pic_enable_source == >> &ioapic_enable_source) >> > > set $_cpu = ((struct ioapic_intsrc *)$src)->io_cpu >> > > else >> > > if ($src->is_pic->pic_enable_source == >> &msi_enable_source) >> > > set $_cpu = ((struct msi_intsrc *)$src)->msi_cpu >> > > else >> > > set $_cpu = 0 >> > > end >> > > end >> > > printf "CPU %d: %s\n", $_cpu, $e->ie_fullname >> > > end >> > > set $e = $e->ie_list.tqe_next >> > > end >> > > end >> > > >> > > document irqs >> > > Dump list of IRQs with associated CPU. >> > > end >> > > >> > > However, unless the driver is using BUS_BIND_IRQ() or you are using >> cpuset >> > > -x, >> > > the interrupts should be round-robin assigned among CPUs. >> > > >> > > What exactly do you mean by sluggish? Trying to interact with the >> box over >> > > SSH is sluggish? Is there a change in RTT if you are pinging the >> box, is >> > > there a change in performance of TCP or UDP streams to/from the box? >> > > >> > > -- >> > > John Baldwin >> > > >> > >> >> -- >> John Baldwin >> > > From owner-freebsd-net@FreeBSD.ORG Fri Jun 22 14:24:23 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D410D106564A for ; Fri, 22 Jun 2012 14:24:23 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:75::2]) by mx1.freebsd.org (Postfix) with ESMTP id 7D71B8FC15 for ; Fri, 22 Jun 2012 14:24:23 +0000 (UTC) Received: from jhbbsd.localnet (unknown [209.249.190.124]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id CED10B99F; Fri, 22 Jun 2012 10:24:22 -0400 (EDT) From: John Baldwin To: Venkat Duvvuru Date: Fri, 22 Jun 2012 10:04:08 -0400 User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p13; KDE/4.5.5; amd64; ; ) References: In-Reply-To: MIME-Version: 1.0 Content-Type: Text/Plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Message-Id: <201206221004.08538.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Fri, 22 Jun 2012 10:24:22 -0400 (EDT) Cc: freebsd-net@freebsd.org Subject: Re: MSI-X limitation in freebsd 8.2 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Jun 2012 14:24:23 -0000 On Friday, June 22, 2012 6:25:23 am Venkat Duvvuru wrote: > and no matter in which order I bring up the interfaces, the system becomes > sluggish after the 5th interface is brought up. So doesn't look like a > specific driver issue. Humm. Would it be possible to use KTR_SCHED and capture a ktr dump while it is sluggish? > On Fri, Jun 22, 2012 at 2:25 PM, Venkat Duvvuru > wrote: > > > This setup has variety of NICs, Intel's, Emulex's and all are stock > > drivers. > > > > /Venkat > > > > On Thu, Jun 21, 2012 at 7:17 PM, John Baldwin wrote: > > > >> On Thursday, June 21, 2012 8:50:06 am Venkat Duvvuru wrote: > >> > While I'm able to ping to the machine..every command on the current > >> active > >> > session is sluggish infact doesn't complete, unable to open another ssh > >> > session..an already opened ssh session doesn't react which is running > >> > "systat -vmstat"... > >> > > >> > The only thing I could do is to successfully complete "top -P" command > >> > once..even top hung for the second time. > >> > >> Hmm, is this a stock FreeBSD driver or an out-of-tree NIC driver? > >> > >> > /Venkat > >> > > >> > On Thu, Jun 21, 2012 at 5:46 PM, John Baldwin wrote: > >> > > >> > > On Thursday, June 21, 2012 5:47:48 am Venkat Duvvuru wrote: > >> > > > John - Thanks for the reply. > >> > > > > >> > > > All the CPUs are ~100% idle. I don't see any interrupt storm on any > >> of > >> > > the > >> > > > irqs (vmstat -i). > >> > > > > >> > > > One observation I made is that I see messages like these in dmesg > >> > > > > >> > > > ===> mem > >> > > 0xfaf60000-0xfaf7ffff,0xfaf40000-0xfaf5ffff,0xfaf1c000-0xfaf1ffff > >> > > > irq 40 at device 0.1 on pci6 > >> > > > > >> > > > Looking at the irq value I think it is the INTx irq range which > >> shouldn't > >> > > > have probably got allocated as the device is msix capable and there > >> are > >> > > > vectors allocated for these devices in the range (256-380). > >> > > > > >> > > > Could this be a problem? > >> > > > >> > > No, that line is output before the driver's attach routine is run, so > >> it > >> > > will > >> > > always show INTx IRQ value even if it isn't used. > >> > > > >> > > > The scenario where I am hitting this problem is a setup with 4 > >> NICs, each > >> > > > NIC with two ports and each port using up 4 msix vectors. The > >> system is > >> > > > fine till some ports are up but once I ifup the 5th port, the system > >> > > > becomes sluggish. > >> > > > > >> > > > I'm not sure whether all the 30 vectors are from a single cpu..I > >> don't > >> > > know > >> > > > how to get that information. > >> > > > >> > > Unfortunately there isn't an easy way. I have this gdb script which > >> can > >> > > display it from kgdb on x86: > >> > > > >> > > define irqs > >> > > set $e = event_list->tqh_first > >> > > while ($e != 0) > >> > > if ($e->ie_source != 0 && $e->ie_handlers.tqh_first != 0) > >> > > set $src = (struct intsrc *)$e->ie_source > >> > > if ($src->is_pic->pic_enable_source == > >> &ioapic_enable_source) > >> > > set $_cpu = ((struct ioapic_intsrc *)$src)->io_cpu > >> > > else > >> > > if ($src->is_pic->pic_enable_source == > >> &msi_enable_source) > >> > > set $_cpu = ((struct msi_intsrc *)$src)->msi_cpu > >> > > else > >> > > set $_cpu = 0 > >> > > end > >> > > end > >> > > printf "CPU %d: %s\n", $_cpu, $e->ie_fullname > >> > > end > >> > > set $e = $e->ie_list.tqe_next > >> > > end > >> > > end > >> > > > >> > > document irqs > >> > > Dump list of IRQs with associated CPU. > >> > > end > >> > > > >> > > However, unless the driver is using BUS_BIND_IRQ() or you are using > >> cpuset > >> > > -x, > >> > > the interrupts should be round-robin assigned among CPUs. > >> > > > >> > > What exactly do you mean by sluggish? Trying to interact with the > >> box over > >> > > SSH is sluggish? Is there a change in RTT if you are pinging the > >> box, is > >> > > there a change in performance of TCP or UDP streams to/from the box? > >> > > > >> > > -- > >> > > John Baldwin > >> > > > >> > > >> > >> -- > >> John Baldwin > >> > > > > > -- John Baldwin From owner-freebsd-net@FreeBSD.ORG Sat Jun 23 22:43:21 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 28E8A106577E for ; Sat, 23 Jun 2012 22:43:21 +0000 (UTC) (envelope-from sean@chittenden.org) Received: from mail01.lax1.stackjet.com (mon01.lax1.stackjet.com [174.136.104.178]) by mx1.freebsd.org (Postfix) with ESMTP id DAB5F8FC08 for ; Sat, 23 Jun 2012 22:43:20 +0000 (UTC) Received: from laptop-sean-wifi.local (173-228-12-60.dsl.dynamic.sonic.net [173.228.12.60]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: sean@chittenden.org) by mail01.lax1.stackjet.com (Postfix) with ESMTPSA id 704823E8BF6 for ; Sat, 23 Jun 2012 15:37:40 -0700 (PDT) From: Sean Chittenden Content-Type: multipart/signed; boundary="Apple-Mail=_D60888C5-8C7F-43C0-B0D9-4C3AC561096E"; protocol="application/pgp-signature"; micalg=pgp-sha1 Date: Sat, 23 Jun 2012 15:37:39 -0700 Message-Id: To: freebsd-net@freebsd.org Mime-Version: 1.0 (Apple Message framework v1278) X-Mailer: Apple Mail (2.1278) Subject: =?windows-1252?q?Interface_ref_counting_when_directly_connected_?= =?windows-1252?q?OSPF_route_withdrawn=85?= X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Jun 2012 22:43:21 -0000 --Apple-Mail=_D60888C5-8C7F-43C0-B0D9-4C3AC561096E Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I've been digging around to see if FreeBSD still had lingering issues = with OSPF and it appears so, at least in -STABLE (the following set of = posts, do a good job of describing the behavior). In February 2012, glebius@ mentioned using a chain of routes as a = possible solution tot he below problem, though it was just an idea at = the time. I'm going to be updating a production system to -CURRENT soon = for its new carp functionality (thanks to glebius@, actually), but am = curious if this issue has received any love or if I'm better off = sticking with iBGP for connected route advertisements instead. ? Thanks in advance. -sc http://forum.pfsense.org/index.php?topic=3D39995.0 http://ouliakk.blogspot.com/2011/08/using-openospfd-with-freebsd-78.html -- Sean Chittenden sean@chittenden.org --Apple-Mail=_D60888C5-8C7F-43C0-B0D9-4C3AC561096E Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.17 (Darwin) iEYEARECAAYFAk/mRTMACgkQTrydwWwuXha/CwCfX5HajsyLUjO30kNejLVPATv9 8wIAn1s4S/T+TbV1755mrUOg296xTREA =OQYo -----END PGP SIGNATURE----- --Apple-Mail=_D60888C5-8C7F-43C0-B0D9-4C3AC561096E--