Date: Sat, 21 Mar 2015 18:09:07 -0700 From: Adrian Chadd <adrian@freebsd.org> To: Miguel Clara <miguelmclara@gmail.com> Cc: freebsd-wireless@freebsd.org Subject: Re: ath0 performence issues "ar9300_Stub_GetCTSTimeout" "ar9300_Stub_GetCTSTimeout Message-ID: <CAJ-VmonrnATPDX4pFNbw6=ip7XyJ2c7P682K0xciDr8YLn%2BXMw@mail.gmail.com> In-Reply-To: <CADGo8CWBjVvvAxpXKSrr6BqOE7SBBv%2B2trcGwa6JSf1KPsAB6A@mail.gmail.com> References: <CADGo8CWitJUhU0%2BjDX59gv%2Bc-4uhpgf58=r_K%2Bfq=4acDTni8A@mail.gmail.com> <CAJ-VmonRS-ifM2YYUFn73g7xWSmpeqWYcK86h=RuYHtiRuyE%2Bg@mail.gmail.com> <CADGo8CVX50Zfypwzc-_tjcZ-ej41rmvU00N3g7Fjh9XFQyCVDA@mail.gmail.com> <CADGo8CXKQszJWgM46q8wRkMZjKSXgn9=iLqx3mUEc7htuNU1RQ@mail.gmail.com> <CAJ-VmokfdeCU528L135HKupJ0iJartBDbwjMoww_16Km8jeFrQ@mail.gmail.com> <CADGo8CUoJb_YxHHZP_z=2yEYU0=Sg_ULL4GiTPRZ1B2SLnheYA@mail.gmail.com> <CAJ-VmonXcVTa-h2T2uEoMtNbw4GnB3vZZTf9UrEC6XrPLGeiTg@mail.gmail.com> <CADGo8CXB6rK%2BCPZ9i=V48z3cTLw3Wah2w88bKVpxf4vOJPR=9Q@mail.gmail.com> <CADGo8CXZY3bzBq=MAMMDu1sJMyqScbvWj9NhYLzGnS%2Bw-VKL5Q@mail.gmail.com> <CAJ-VmokfXR8pL9P3c8C_yACLxddHW=7hFqM9YDYd6N2=pX8Wng@mail.gmail.com> <CADGo8CWbS3iSE=ssndfb_gSCxdRrx9-Ve9_nSbG6MdWmhj4a3Q@mail.gmail.com> <CADGo8CV%2BEiPXUF==c=1kMHQBxsCDmrAuj_wEiymeLu%2BaUukBrQ@mail.gmail.com> <CAJ-Vmok1xxeNrA=dX6SGgPNq5zOE_5a3_5QZgMt__u1nBV3qkw@mail.gmail.com> <CADGo8CURXQqh21SPdp%2B0BdE=7oksUMwM87PU3qKHszPd%2BMkfpA@mail.gmail.com> <CADGo8CX2hfKzA4ab7SUEFxoLzR=B5_533OzHHnAMUzHvA%2B_WuA@mail.gmail.com> <CADGo8CUO0fh=fBmZx%2BDt9wv54HOA92Yx5gKz2eUjGoG70ZMSdQ@mail.gmail.com> <CADGo8CWJFd0FoowS7O4G3yWwzbfkdmeQa=YwCt6F8yyUKZ6WCw@mail.gmail.com> <CAJ-Vmok50--g0xgHMzaWFJ0uF-T6Wxqs2A0ue2MxDRpLnvXMLA@mail.gmail.com> <CAJ-Vmok79b0U3185_ofGG8dpxqkxGod86LX_-ri%2BeVSv8rtLLw@mail.gmail.com> <CADGo8CUMzY7j6h55dscW5t0jm5Jb_yBRj56UfDei0oY1GpiWww@mail.gmail.com> <CADGo8CWDhwDfiJr=gDDvvpe7pX6ZJgUJhVxtDx6PEavSLzX7Ew@mail.gmail.com> <CADGo8CXeHiWypp3O6LT9x3aBwxHcUFGpfx0GpDJeE-OcG0YjgQ@mail.gmail.com> <CADGo8CWBjVvvAxpXKSrr6BqOE7SBBv%2B2trcGwa6JSf1KPsAB6A@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Tsfoor means that it didn't receive enough beacons before a timeout. I've fixed the messages in head but they're not important. Its doing something, like scanning or something, which is generating those messages. Do athstats 1 for a while both before and afafter it happens. Adrian On Mar 21, 2015 6:00 PM, "Miguel Clara" <miguelmclara@gmail.com> wrote: > > > On Fri, Mar 20, 2015 at 2:42 PM, Miguel Clara <miguelmclara@gmail.com> > wrote: > >> >> On Fri, Mar 20, 2015 at 2:41 PM, Miguel Clara <miguelmclara@gmail.com> >> wrote: >> >>> >>> On Fri, Mar 20, 2015 at 3:25 AM, Miguel Clara <miguelmclara@gmail.com> >>> wrote: >>> >>>> >>>> On Fri, Mar 20, 2015 at 3:20 AM, Adrian Chadd <adrian@freebsd.org> >>>> wrote: >>>> >>>>> What's the output of ifconfig -v wlan0 ? >>>>> >>>>> and run athstats 1 for a while whilst doing traffic, say speedtest, >>>>> and paste the results from there. >>>>> >>>>> >>>>> >>>>> ]# ifconfig -v wlan0 >>>> >>>> >>>> wlan0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu >>>> 1500 >>>> ether e0:06:e6:aa:bf:5b >>>> inet 10.10.50.70 netmask 0xffffff00 broadcast 10.10.50.255 >>>> nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> >>>> media: IEEE 802.11 Wireless Ethernet MCS mode 11na >>>> status: associated >>>> ssid PissnLove5G channel 48 (5240 MHz 11a ht/40-) bssid >>>> 60:a4:4c:28:13:c4 >>>> regdomain 108 country DEBUG indoor ecm authmode WPA2/802.11i >>>> -wps >>>> -tsn privacy ON deftxkey UNDEF >>>> AES-CCM 2:128-bit >>>> AES-CCM 3:128-bit powersavemode OFF powersavesleep 100 txpower >>>> 30 >>>> txpowmax 50.0 -dotd rtsthreshold 2346 fragthreshold 2346 bmiss 7 >>>> 11a ucast NONE mgmt 6 Mb/s mcast 6 Mb/s maxretry 6 >>>> 11b ucast NONE mgmt 1 Mb/s mcast 1 Mb/s maxretry 6 >>>> 11g ucast NONE mgmt 1 Mb/s mcast 1 Mb/s maxretry 6 >>>> turboA ucast NONE mgmt 6 Mb/s mcast 6 Mb/s maxretry 6 >>>> turboG ucast NONE mgmt 1 Mb/s mcast 1 Mb/s maxretry 6 >>>> sturbo ucast NONE mgmt 6 Mb/s mcast 6 Mb/s maxretry 6 >>>> 11na ucast NONE mgmt 12 MCS mcast 12 MCS maxretry 6 >>>> 11ng ucast NONE mgmt 2 MCS mcast 2 MCS maxretry 6 >>>> half ucast NONE mgmt 3 Mb/s mcast 3 Mb/s maxretry 6 >>>> quarter ucast NONE mgmt 1 Mb/s mcast 1 Mb/s maxretry 6 >>>> scanvalid 60 -bgscan bgscanintvl 300 bgscanidle 250 >>>> roam:11a rssi 7dBm rate 12 Mb/s >>>> roam:11b rssi 7dBm rate 1 Mb/s >>>> roam:11g rssi 7dBm rate 5 Mb/s >>>> roam:turboA rssi 7dBm rate 12 Mb/s >>>> roam:turboG rssi 7dBm rate 12 Mb/s >>>> roam:sturbo rssi 7dBm rate 12 Mb/s >>>> roam:11na rssi 7dBm MCS 1 >>>> roam:11ng rssi 7dBm MCS 1 >>>> roam:half rssi 7dBm rate 6 Mb/s >>>> roam:quarter rssi 7dBm rate 3 Mb/s >>>> -pureg protmode CTS ht htcompat ampdu ampdulimit 64k >>>> ampdudensity 4 >>>> amsdu shortgi htprotmode RTSCTS -puren -smps -rifs wme burst >>>> -dwds >>>> roaming MANUAL bintval 100 >>>> AC_BE cwmin 4 cwmax 10 aifs 3 txopLimit 0 -acm ack >>>> cwmin 4 cwmax 10 aifs 3 txopLimit 0 -acm >>>> AC_BK cwmin 4 cwmax 10 aifs 7 txopLimit 0 -acm ack >>>> cwmin 4 cwmax 10 aifs 7 txopLimit 0 -acm >>>> AC_VI cwmin 3 cwmax 4 aifs 2 txopLimit 94 -acm ack >>>> cwmin 3 cwmax 4 aifs 2 txopLimit 94 -acm >>>> AC_VO cwmin 2 cwmax 3 aifs 2 txopLimit 47 -acm ack >>>> cwmin 2 cwmax 3 aifs 2 txopLimit 47 -acm >>>> groups: wlan >>>> >>>> Going to recompile and I'll re-run athstats >>>> >>> >>> Hum it seems that after the recompile/reboot things are a bit better... >>> >>> [miguelc@r2d2:~ ]% speedtest >>> Retrieving speedtest.net configuration... >>> Retrieving speedtest.net server list... >>> Testing from Vodafone Portugal (89.114.40.155)... >>> Selecting best server based on latency... >>> Hosted by Vodafone PT (Porto) [16.63 km]: 22.599 ms >>> Testing download speed........................................ >>> Download: 91.17 Mbits/s >>> Testing upload speed.................................................. >>> Upload: 9.48 Mbits/s >>> [miguelc@r2d2:~ ]% speedtest >>> Retrieving speedtest.net configuration... >>> Retrieving speedtest.net server list... >>> Testing from Vodafone Portugal (89.114.40.155)... >>> Selecting best server based on latency... >>> Hosted by Vodafone PT (Porto) [16.63 km]: 5.164 ms >>> Testing download speed........................................ >>> Download: 93.21 Mbits/s >>> Testing upload speed.................................................. >>> Upload: 10.65 Mbits/s >>> >>> ########################################### >>> [ ID] Interval Transfer Bandwidth >>> [ 4] 0.00-1.01 sec 1.42 MBytes 11.8 Mbits/sec >>> [ 4] 1.01-2.00 sec 5.66 KBytes 46.7 Kbits/sec >>> [ 4] 2.00-3.00 sec 3.94 MBytes 33.1 Mbits/sec >>> [ 4] 3.00-4.00 sec 4.15 MBytes 34.8 Mbits/sec >>> [ 4] 4.00-5.00 sec 4.52 MBytes 37.9 Mbits/sec >>> [ 4] 5.00-6.00 sec 4.44 MBytes 37.3 Mbits/sec >>> [ 4] 6.00-7.00 sec 4.44 MBytes 37.3 Mbits/sec >>> [ 4] 7.00-8.00 sec 4.36 MBytes 36.6 Mbits/sec >>> [ 4] 8.00-9.00 sec 6.67 MBytes 55.9 Mbits/sec >>> [ 4] 9.00-10.00 sec 5.45 MBytes 45.7 Mbits/sec >>> - - - - - - - - - - - - - - - - - - - - - - - - - >>> [ ID] Interval Transfer Bandwidth >>> [ 4] 0.00-10.00 sec 39.4 MBytes 33.1 Mbits/sec >>> sender >>> [ 4] 0.00-10.00 sec 38.9 MBytes 32.6 Mbits/sec >>> receiver >>> >>> ( First Iperf was run on purpose in the middle of the first speedtest >>> (and while runing athstats 1) >>> [ ID] Interval Transfer Bandwidth >>> [ 4] 0.00-1.00 sec 6.20 MBytes 52.0 Mbits/sec >>> [ 4] 1.00-2.00 sec 6.46 MBytes 54.2 Mbits/sec >>> [ 4] 2.00-3.00 sec 6.55 MBytes 55.0 Mbits/sec >>> [ 4] 3.00-4.00 sec 8.64 MBytes 72.5 Mbits/sec >>> [ 4] 4.00-5.00 sec 8.50 MBytes 71.3 Mbits/sec >>> [ 4] 5.00-6.00 sec 8.81 MBytes 73.9 Mbits/sec >>> [ 4] 6.00-7.00 sec 9.24 MBytes 77.5 Mbits/sec >>> [ 4] 7.00-8.00 sec 8.87 MBytes 74.4 Mbits/sec >>> [ 4] 8.00-9.00 sec 8.68 MBytes 72.8 Mbits/sec >>> [ 4] 9.00-10.00 sec 8.94 MBytes 75.0 Mbits/sec >>> - - - - - - - - - - - - - - - - - - - - - - - - - >>> [ ID] Interval Transfer Bandwidth >>> [ 4] 0.00-10.00 sec 80.9 MBytes 67.8 Mbits/sec >>> sender >>> [ 4] 0.00-10.00 sec 80.6 MBytes 67.6 Mbits/sec >>> receiver >>> ############################################################ >>> >>> athstats ==> http://pastebin.com/zXhG6FWc >>> >>> typo: >> >>> things look better, *I've* had better results before though, but I would >>> still consider this ok if it keeps this state... >>> >> > I left the Laptop online for quite some time (almost all day) but with no > user activiy. > > I was just replying some email (as adrian might have noticed :) )and > notice the internet seemed a lot slower, and I'm back to the same reported > state in see the error messages: > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetCTSTimeout: called > ar9300_Stub_GetAntennaSwitch: called > ar9300_Stub_GetAntennaSwitch: called > ath0: ath_intr: TSFOOR > > > and speedtest results are very poor: > speedtest > Retrieving speedtest.net configuration... > Retrieving speedtest.net server list... > Testing from Vodafone Portugal (89.114.40.155)... > Selecting best server based on latency... > Hosted by Vodafone PT (Porto) [16.63 km]: 5.686 ms > Testing download speed........................................ > Download: 33.64 Mbits/s > Testing upload speed.................................................. > Upload: 6.69 Mbits/s > > I was also playing with the "Fn-F3" key was reported in the other thread > but I've done it earlier and saw no issues at the time. > > I wonder then if this as something to do with long periods of inactivity > which as the first TSFOOR is ~22pm > Mar 21 21:55:10 r2d2 kernel: ath0: ath_intr: TSFOOR > > Thats basicly ~the time I resumed the session, and by that I mean just > login back to lumina-DE - I did not use resume/suspend, as I was plaining > to be back sooner :) > > > > > >>> -a >>>>> >>>>> >>>>> On 19 March 2015 at 20:17, Adrian Chadd <adrian@freebsd.org> wrote: >>>>> > Ah, add ATH_DEBUG, AH_DEBUG and AH_DIAGAPI to your kernel and >>>>> recompile! >>>>> > >>>>> > >>>>> > -a >>>>> > >>>>> > >>>>> > On 19 March 2015 at 19:32, Miguel Clara <miguelmclara@gmail.com> >>>>> wrote: >>>>> >> >>>>> >> On Fri, Mar 20, 2015 at 2:11 AM, Miguel Clara < >>>>> miguelmclara@gmail.com> >>>>> >> wrote: >>>>> >>> >>>>> >>> >>>>> >>> On Fri, Mar 20, 2015 at 1:55 AM, Miguel Clara < >>>>> miguelmclara@gmail.com> >>>>> >>> wrote: >>>>> >>>> >>>>> >>>> >>>>> >>>> On Fri, Mar 20, 2015 at 1:18 AM, Miguel Clara < >>>>> miguelmclara@gmail.com> >>>>> >>>> wrote: >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> On Thu, Mar 19, 2015 at 9:49 PM, Adrian Chadd < >>>>> adrian@freebsd.org> >>>>> >>>>> wrote: >>>>> >>>>>> >>>>> >>>>>> Whilst running this, can you run 'athstats 1' on the freebsd >>>>> box? >>>>> >>>>>> >>>>> >>>>>> i wonder what the signal level and retransmit rates are. >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> Not sure hwo to do that... do I need ath_debug? >>>>> >>>>> >>>>> >>>>> I did found '/usr/src/tools/tools/ath/athstats' and tried to >>>>> "make" >>>>> >>>>> >>>>> >>>>> clang -O2 -pipe -DATH_DEFAULT='"ath0"' >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../common >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../../../../sys >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../../../../sys/dev/ath >>>>> >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../../../../sys/dev/ath/ath_hal >>>>> >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../../../../sys/contrib/dev/ath/ath_hal >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats -DATH_SUPPORT_ANI >>>>> -DATH_SUPPORT_TDMA >>>>> >>>>> -DATH_DEFAULT='"ath0"' -I/usr/src/tools/tools/ath/athstats >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../common >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../../../../sys >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../../../../sys/dev/ath >>>>> >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../../../../sys/dev/ath/ath_hal >>>>> >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats/../../../../sys/contrib/dev/ath/ath_hal >>>>> >>>>> -I/usr/src/tools/tools/ath/athstats -std=gnu99 -fstack-protector >>>>> >>>>> -fbracket-depth=512 -Qunused-arguments -rpath /usr/lib/private >>>>> -o athstats >>>>> >>>>> main.o athstats.o -L/usr/src/lib/libbsdstat -lbsdstat >>>>> >>>>> /usr/bin/ld: cannot find -lbsdstat >>>>> >>>>> clang: error: linker command failed with exit code 1 (use -v to >>>>> see >>>>> >>>>> invocation) >>>>> >>>>> *** Error code 1 >>>>> >>>>> >>>>> >>>>> Stop. >>>>> >>>>> make: stopped in /usr/src/tools/tools/ath/athstats >>>>> >>>>> >>>>> >>>>> I installed bsdstats but after make clean;make I still get the >>>>> same. >>>>> >>>> >>>>> >>>> >>>>> >>>> Oh wait: >>>>> >>>> -L/usr/src/lib/libbsdstat -lbsdstat >>>>> >>>> >>>>> >>>> /usr/bin/ld: cannot find -lbsdstat >>>>> >>>> >>>>> >>>> Should it look in /usr/private? >>>>> >>>> >>>>> >>>> Or maybe not... I saw this: >>>>> >>>> ###################### >>>>> >>>> commit 050d4409aa855fa1f82f6ca0dbb7e0c865c05e32 >>>>> >>>> Author: bapt <bapt@FreeBSD.org> >>>>> >>>> Date: Tue Nov 25 22:37:27 2014 +0000 >>>>> >>>> >>>>> >>>> Convert to LIBADD >>>>> >>>> >>>>> >>>> Notes: >>>>> >>>> svn path=/head/; revision=275084 >>>>> >>>> >>>>> >>>> diff --git a/tools/tools/ath/athstats/Makefile >>>>> >>>> b/tools/tools/ath/athstats/Makefile >>>>> >>>> index 8d1bfa6..a7ff43b 100644 >>>>> >>>> --- a/tools/tools/ath/athstats/Makefile >>>>> >>>> +++ b/tools/tools/ath/athstats/Makefile >>>>> >>>> @@ -23,9 +23,7 @@ CFLAGS+=-DATH_SUPPORT_TDMA >>>>> >>>> >>>>> >>>> CFLAGS.clang+= -fbracket-depth=512 >>>>> >>>> >>>>> >>>> -USEPRIVATELIB= bsdstat >>>>> >>>> - >>>>> >>>> -LDADD= ${LDBSDSTAT} >>>>> >>>> +LIBADD= bsdstat >>>>> >>>> >>>>> >>>> opt_ah.h: >>>>> >>>> echo "#define AH_DEBUG 1" > opt_ah.h >>>>> >>>> ################# >>>>> >>>> >>>>> >>>> reverting gives me this: >>>>> >>>> >>>>> >>>> [...]ib/private -rpath /usr/lib/private -o athstats main.o >>>>> athstats.o >>>>> >>>> athstats.o: In function `athstats_new': >>>>> >>>> athstats.c:(.text+0x3e): undefined reference to `bsdstat_init' >>>>> >>>> clang: error: linker command failed with exit code 1 (use -v to >>>>> see >>>>> >>>> invocation) >>>>> >>>> >>>>> >>>> If I can get around this I'd love to post those stats >>>>> >>>> >>>>> >>> >>>>> >>> Sadly I'm no C expert... I'm not even a coder but "bsdstat_init" >>>>> defiantly >>>>> >>> exists and the include bsdstat.h is in athstats.h... >>>>> >>> makes no sense (to me) :| >>>>> >>> >>>>> >> >>>>> >> In the mean time I checked out a version before bsdstat and I was >>>>> able to >>>>> >> complie, output follows >>>>> >> % sudo athstats >>>>> >> athstats: ioctl: ath0: Invalid argument <------------------ Is this >>>>> >> expected? >>>>> >> athstats: ioctl: ath0: Invalid argument >>>>> >> 990785 data frames received >>>>> >> 559194 data frames transmit >>>>> >> 7602 tx frames with an alternate rate >>>>> >> 27634 short on-chip tx retries >>>>> >> 100075 long on-chip tx retries >>>>> >> 374 tx failed 'cuz too many retries >>>>> >> 24 mib overflow interrupts >>>>> >> 3 tx linearized to cluster >>>>> >> MCS3 current transmit rate >>>>> >> 17 beacon miss interrupts >>>>> >> 31173 rx failed 'cuz of bad CRC >>>>> >> 114 rx failed 'cuz of PHY err >>>>> >> 5 OFDM restart >>>>> >> 109 CCK restart >>>>> >> 247 periodic calibrations >>>>> >> -0/+0 TDMA slot adjust (usecs, smoothed) >>>>> >> 28 rssi of last ack >>>>> >> 40 avg recv rssi >>>>> >> -96 rx noise floor >>>>> >> 614 tx frames through raw api >>>>> >> 601749 A-MPDU sub-frames received >>>>> >> 187766 Half-GI frames received >>>>> >> 443941 40MHz frames received >>>>> >> 12776 CRC errors for non-last A-MPDU subframes >>>>> >> 198 CRC errors for last subframe in an A-MPDU >>>>> >> 558554 Frames transmitted with HT Protection >>>>> >> 169 TX Timeout >>>>> >> Antenna profile: >>>>> >> [0] tx 558817 rx 36629 >>>>> >> [1] tx 0 rx 772652 >>>>> >> [2] tx 0 rx 26737 >>>>> >> [3] tx 0 rx 30276 >>>>> >> [4] tx 0 rx 28833 >>>>> >> [5] tx 0 rx 25606 >>>>> >> [6] tx 0 rx 30300 >>>>> >> [7] tx 0 rx 39752 >>>>> >> >>>>> >> >>>>> >> >>>>> >>> >>>>> >>> >>>>> >>>> >>>>> >>>>> >>>>> >>>>>> Thanks, >>>>> >>>>>> >>>>> >>>>>> >>>>> >>>>>> -a >>>>> >>>>> >>>>> >>>>> >>>>> >>>> >>>>> >>> >>>>> >> >>>>> >>>> >>>> >>> >> >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAJ-VmonrnATPDX4pFNbw6=ip7XyJ2c7P682K0xciDr8YLn%2BXMw>