Date: Tue, 11 Oct 2011 02:06:04 -0500 From: Larry Rosenman <ler@lerctr.org> To: Jack Vogel <jfvogel@gmail.com> Cc: freebsd-stable@freebsd.org, "Vogel, Jack" <jack.vogel@intel.com>, Jeremy Chadwick <freebsd@jdc.parodius.com>, John Baldwin <jhb@freebsd.org> Subject: Re: rsync corrupted MAC Message-ID: <25c4965e-fb4d-4991-ae7b-e4fe89741359@email.android.com> In-Reply-To: <b3b95bea-d2d9-48de-9bf3-206bfbfed158@email.android.com> References: <b3b95bea-d2d9-48de-9bf3-206bfbfed158@email.android.com>
next in thread | previous in thread | raw e-mail | index | archive | help
They are not local to each other. See the diagram. They are across the inte=
rnet from each other.
--
Sent from my Android phone with K-9 Mail. Please =
excuse my brevity.
Jack Vogel <jfvogel@gmail.com> wrote:
Well, for a star=
t I'd get both interfaces at the same speed, sounds like a hardware
issue o=
f some sort, cable or switch maybe?
Jack
On Mon, Oct 10, 2011 at 5:42 PM=
, Larry Rosenman <ler@lerctr.org> wrote:
On Mon, 10 Oct 2011, Jeremy Chadw=
ick wrote:
On Mon, Oct 10, 2011 at 04:15:25PM -0500, Larry Rosenman wrote:=
On 10/10/2011 3:57 PM, Louis Mamakos wrote:
On Oct 10, 2011, at 2:38 PM,=
Larry Rosenman wrote:
On 10/10/2011 10:47 AM, John Baldwin wrote:
On Sun=
day, October 09, 2011 5:06:26 pm Larry Rosenman wrote:
Any ideas on which =
side or what might be broke here?
ler/MAIL-ARCHIVE/2008/12/INBOX
Corrupted=
MAC on input.
Disconnecting: Packet corrupt
rsync: connection unexpectedly=
closed (33845045 bytes received so far)
[receiver]
rsync error: error in=
rsync protocol data stream (code 12) at io.c(605)
[receiver=3D3.0.9]
rsy=
nc: connection unexpectedly closed (1450 bytes received so far)
[generator=
]
rsync error: unexplained error (code 255) at io.c(605) [generator=3D3.0.=
9]
I've had somewhat similar issues (ssh getting corruption in its data st=
ream)
when a NIC in my netbook was corrupting packet data when it ran at 1G=
(it
worked fine at 10/100). Pyun eventually fixed the issue by applying e=
nough
workarounds (it was likely a hardware bug in the NIC's chipset). How=
ever, it
wasn't easy to debug unfortunately. :(
Any ideas on where to star=
t?
from the 8.2 box (tbh.lerctr.org in the script):
8.2->PIX->Provider->I=
nternet->Motorola SBG6580 (Time-Warner)->Trendnet TEG-160WS Gig switch->9.0=
box (borg.lerctr.org).
So, where do I start?
I'd turn off IP / TCP / UDP=
checksum offloading on your NIC if it supports it, and see if you are gett=
ing network layer checksum errors. If the IP checksum is wrong, then it ha=
ppened on the last hops between the NIC and memory or across the previous n=
etwork hop.
Good idea, but, it didn't show ANY errors on EITHER side (bo=
th are
em nics).
Next?
$ ifconfig em0
em0: flags=3D8843<UP,BROADCAST,RUNNI=
NG,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=3D2098<VLAN_MTU,VLAN=
_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC>
ether 00:30:48:2e:99:ba
ine=
t 192.147.25.65 netmask 0xffffff00 broadcast 192.147.25.255
inet6 fe=
80::230:48ff:fe2e:99ba%em0 prefixlen 64 scopeid 0x1
inet 192.147.25.=
45 netmask 0xffffff00 broadcast 192.147.25.255
inet 192.147.25.11 ne=
tmask 0xffffff00 broadcast 192.147.25.255
nd6 options=3D3<PERFORMNUD=
,ACCEPT_RTADV>
media: Ethernet autoselect (100baseTX <full-duplex>)
=
status: active
$
$ uname -a
FreeBSD thebighonker.lerctr.org 8.2-STAB=
LE FreeBSD 8.2-STABLE #45:
Sat Oct 8 10:57:43 CDT 2011
root@thebighonker.l=
erctr.org:/usr/obj/usr/src/sys/THEBIGHONKER
amd64
$
$ ifconfig em0
em0: =
flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
=
options=3D2088<VLAN_MTU,VLAN_HWCSUM,WOL_MAGIC>
ether 00:30:48:8e:=
9f:f3
inet 192.168.200.4 netmask 0xffffff00 broadcast 192.168.200.25=
5
inet6 fe80::230:48ff:fe8e:9ff3%em0 prefixlen 64 scopeid 0x1
=
nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ether=
net autoselect (1000baseT <full-duplex>)
status: active
$ uname -a
F=
reeBSD borg.lerctr.org 9.0-BETA3 FreeBSD 9.0-BETA3 #1: Sun Oct 9
10:03:42 =
CDT 2011
root@borg.lerctr.org:/usr/obj/usr/src/sys/BORG-DTRACE amd64
$
C=
an you please provide output from the following commands executed on
the ma=
chine showing the problem? The above commands show nothing
useful, other t=
han the fact that one machine is at 100/full and the
other is at 1000/full =
(I don't know your network setup). Commands:
* netstat -inbd -I em0
* sys=
ctl -a dev.em.0
* Issue command "sysctl dev.em.0.debug=3D1", then type "dme=
sg" and
provide all of the new output you will see at the bottom that
per=
tains to the NIC
If you Google this problem, you will find that the majori=
ty of the time
it's caused by NIC drivers acting oddly.
Also, I believe th=
e em(4) driver in 9.x is slightly different than on
8.x, so I'm CC'ing Jack=
Vogel here.
from 9.0:
Name Mtu Network Address I=
pkts Ierrs Idrop Ibytes Opkts Oerrs Obytes Coll Drop
em0 150=
0 <Link#1> 00:30:48:8e:9f:f3 69776975 0 0 59660392277 52592789=
0 104743924118 0 0 em0 1500 192.168.200.0 192.168.200.4 =
69759773 - - 58681934612 96397272 - 104003761109 - - em0=
1500 fe80::230:48f fe80::230:48ff:fe 0 - - 0 =
3 - 248 - -
dev.em.0.%desc: Intel(R) PRO/1000 Netw=
ork Connection 7.2.3
dev.em.0.%driver: em
dev.em.0.%location: slot=3D0 func=
tion=3D0
dev.em.0.%pnpinfo: vendor=3D0x8086 device=3D0x1096 subvendor=3D0x1=
5d9 subdevice=3D0x0000 class=3D0x020000
dev.em.0.%parent: pci6
dev.em.0.nvm=
: -1
dev.em.0.debug: -1
dev.em.0.rx_int_delay: 0
dev.em.0.tx_int_delay: 66
=
dev.em.0.rx_abs_int_delay: 66
dev.em.0.tx_abs_int_delay: 66
dev.em.0.rx_pro=
cessing_limit: 100
dev.em.0.flow_control: 3
dev.em.0.eee_control: 0
dev.em.=
0.link_irq: 0
dev.em.0.mbuf_alloc_fail: 0
dev.em.0.cluster_alloc_fail: 0
de=
v.em.0.dropped: 0
dev.em.0.tx_dma_fail: 21755
dev.em.0.rx_overruns: 0
dev.e=
m.0.watchdog_timeouts: 0
dev.em.0.device_control: 1851969
dev.em.0.rx_contr=
ol: 67141634
dev.em.0.fc_high_water: 30720
dev.em.0.fc_low_water: 29220
dev=
.em.0.queue0.txd_head: 136
dev.em.0.queue0.txd_tail: 136
dev.em.0.queue0.tx=
_irq: 0
dev.em.0.queue0.no_desc_avail: 0
dev.em.0.queue0.rxd_head: 2
dev.em=
.0.queue0.rxd_tail: 1
dev.em.0.queue0.rx_irq: 0
dev.em.0.mac_stats.excess_c=
oll: 0
dev.em.0.mac_stats.single_coll: 0
dev.em.0.mac_stats.multiple_coll: =
0
dev.em.0.mac_stats.late_coll: 0
dev.em.0.mac_stats.collision_count: 0
dev=
.em.0.mac_stats.symbol_errors: 0
dev.em.0.mac_stats.sequence_errors: 0
dev.=
em.0.mac_stats.defer_count: 0
dev.em.0.mac_stats.missed_packets: 0
dev.em.0=
.mac_stats.recv_no_buff: 0
dev.em.0.mac_stats.recv_undersize: 0
dev.em.0.ma=
c_stats.recv_fragmented: 0
dev.em.0.mac_stats.recv_oversize: 0
dev.em.0.mac=
_stats.recv_jabber: 0
dev.em.0.mac_stats.recv_errs: 0
dev.em.0.mac_stats.cr=
c_errs: 0
dev.em.0.mac_stats.alignment_errs: 0
dev.em.0.mac_stats.coll_ext_=
errs: 0
dev.em.0.mac_stats.xon_recvd: 0
dev.em.0.mac_stats.xon_txd: 0
dev.e=
m.0.mac_stats.xoff_recvd: 0
dev.em.0.mac_stats.xoff_txd: 0
dev.em.0.mac_sta=
ts.total_pkts_recvd: 69774324
dev.em.0.mac_stats.good_pkts_recvd: 69774324
=
dev.em.0.mac_stats.bcast_pkts_recvd: 28156
dev.em.0.mac_stats.mcast_pkts_re=
cvd: 1758
dev.em.0.mac_stats.rx_frames_64: 54177
dev.em.0.mac_stats.rx_fram=
es_65_127: 30157358
dev.em.0.mac_stats.rx_frames_128_255: 1092948
dev.em.0.=
mac_stats.rx_frames_256_511: 125295
dev.em.0.mac_stats.rx_frames_512_1023: =
128081
dev.em.0.mac_stats.rx_frames_1024_1522: 38216465
dev.em.0.mac_stats.=
good_octets_recvd: 59938624047
dev.em.0.mac_stats.good_octets_txd: 10661383=
6902
dev.em.0.mac_stats.total_pkts_txd: 96250538
dev.em.0.mac_stats.good_pk=
ts_txd: 96250538
dev.em.0.mac_stats.bcast_pkts_txd: 2989
dev.em.0.mac_stats=
.mcast_pkts_txd: 0
dev.em.0.mac_stats.tx_frames_64: 7551
dev.em.0.mac_stats=
.tx_frames_65_127: 26727682
dev.em.0.mac_stats.tx_frames_128_255: 227574
de=
v.em.0.mac_stats.tx_frames_256_511: 167383
dev.em.0.mac_stats.tx_frames_512=
_1023: 302141
dev.em.0.mac_stats.tx_frames_1024_1522: 68818207
dev.em.0.mac=
_stats.tso_txd: 17244234
dev.em.0.mac_stats.tso_ctx_fail: 0
dev.em.0.interr=
upts.asserts: 65945396
dev.em.0.interrupts.rx_pkt_timer: 8917
dev.em.0.inte=
rrupts.rx_abs_timer: 0
dev.em.0.interrupts.tx_pkt_timer: 1461
dev.em.0.inte=
rrupts.tx_abs_timer: 1951
dev.em.0.interrupts.tx_queue_empty: 0
dev.em.0.in=
terrupts.tx_queue_min_thresh: 0
dev.em.0.interrupts.rx_desc_min_thresh: 0
d=
ev.em.0.interrupts.rx_overrun: 0
Interface is RUNNING and INACTIVE
em0: hw=
tdh =3D 221, hw tdt =3D 221
em0: hw rdh =3D 467, hw rdt =3D 466
em0: Tx Qu=
eue Status =3D 0
em0: TX descriptors avail =3D 1024
em0: Tx Descriptors ava=
il failure =3D 0
em0: RX discarded packets =3D 0
em0: RX Next to Check =3D =
467
em0: RX Next to Refresh =3D 466
$
from 8.2:
Name Mtu Network =
Address Ipkts Ierrs Idrop Ibytes Opkts Oerrs Obyte=
s Coll Drop
em0 1500 <Link#1> 00:30:48:2e:99:ba 276150 0 =
0 42614583 285398 0 207023352 0 0 em0 1500 192.147.25.0=
/ 192.147.25.65 318062 - - 48331105 285363 - 2030262=
87 - - em0 1500 fe80::230:48f fe80::230:48ff:fe 0 - =
- 0 1 - 96 - - em0 1500 192.147.25.=
0/ 192.147.25.45 25071 - - 1782211 0 - =
0 - - em0 1500 192.147.25.0/ 192.147.25.11 38433 - =
- 2742827 0 - 0 - -
dev.em.0.%desc: Inte=
l(R) PRO/1000 Legacy Network Connection 1.0.3
dev.em.0.%driver: em
dev.em.0=
.%location: slot=3D2 function=3D0
dev.em.0.%pnpinfo: vendor=3D0x8086 device=
=3D0x1079 subvendor=3D0x15d9 subdevice=3D0x117a class=3D0x020000
dev.em.0.%=
parent: pci3
dev.em.0.nvm: -1
dev.em.0.rx_int_delay: 0
dev.em.0.tx_int_dela=
y: 66
dev.em.0.rx_abs_int_delay: 66
dev.em.0.tx_abs_int_delay: 66
dev.em.0.=
rx_processing_limit: 100
dev.em.0.flow_control: 3
dev.em.0.mbuf_alloc_fail:=
0
dev.em.0.cluster_alloc_fail: 0
dev.em.0.dropped: 0
dev.em.0.tx_dma_fail:=
0
dev.em.0.tx_desc_fail1: 0
dev.em.0.tx_desc_fail2: 0
dev.em.0.rx_overruns=
: 0
dev.em.0.watchdog_timeouts: 0
dev.em.0.device_control: 1089471041
dev.e=
m.0.rx_control: 32770
dev.em.0.fc_high_water: 47104
dev.em.0.fc_low_water: =
45604
dev.em.0.fifo_workaround: 0
dev.em.0.fifo_reset: 0
dev.em.0.txd_head:=
73
dev.em.0.txd_tail: 75
dev.em.0.rxd_head: 130
dev.em.0.rxd_tail: 129
dev=
.em.0.mac_stats.excess_coll: 0
dev.em.0.mac_stats.single_coll: 0
dev.em.0.m=
ac_stats.multiple_coll: 0
dev.em.0.mac_stats.late_coll: 0
dev.em.0.mac_stat=
s.collision_count: 0
dev.em.0.mac_stats.symbol_errors: 0
dev.em.0.mac_stats=
.sequence_errors: 0
dev.em.0.mac_stats.defer_count: 0
dev.em.0.mac_stats.mi=
ssed_packets: 0
dev.em.0.mac_stats.recv_no_buff: 0
dev.em.0.mac_stats.recv_=
undersize: 0
dev.em.0.mac_stats.recv_fragmented: 0
dev.em.0.mac_stats.recv_=
oversize: 0
dev.em.0.mac_stats.recv_jabber: 0
dev.em.0.mac_stats.recv_errs:=
0
dev.em.0.mac_stats.crc_errs: 0
dev.em.0.mac_stats.alignment_errs: 0
dev.=
em.0.mac_stats.coll_ext_errs: 0
dev.em.0.mac_stats.xon_recvd: 0
dev.em.0.ma=
c_stats.xon_txd: 0
dev.em.0.mac_stats.xoff_recvd: 0
dev.em.0.mac_stats.xoff=
_txd: 0
dev.em.0.mac_stats.total_pkts_recvd: 276318
dev.em.0.mac_stats.good=
_pkts_recvd: 276318
dev.em.0.mac_stats.bcast_pkts_recvd: 8
dev.em.0.mac_sta=
ts.mcast_pkts_recvd: 0
dev.em.0.mac_stats.rx_frames_64: 9012
dev.em.0.mac_s=
tats.rx_frames_65_127: 205540
dev.em.0.mac_stats.rx_frames_128_255: 44078
d=
ev.em.0.mac_stats.rx_frames_256_511: 3166
dev.em.0.mac_stats.rx_frames_512_=
1023: 3934
dev.em.0.mac_stats.rx_frames_1024_1522: 10588
dev.em.0.mac_stats=
.good_octets_recvd: 43761022
dev.em.0.mac_stats.good_octets_txd: 208238998
=
dev.em.0.mac_stats.total_pkts_txd: 285534
dev.em.0.mac_stats.good_pkts_txd:=
285534
dev.em.0.mac_stats.bcast_pkts_txd: 22
dev.em.0.mac_stats.mcast_pkts=
_txd: 3
dev.em.0.mac_stats.tx_frames_64: 6172
dev.em.0.mac_stats.tx_frames_=
65_127: 75983
dev.em.0.mac_stats.tx_frames_128_255: 53030
dev.em.0.mac_stat=
s.tx_frames_256_511: 23216
dev.em.0.mac_stats.tx_frames_512_1023: 1472
dev.=
em.0.mac_stats.tx_frames_1024_1522: 125661
dev.em.0.mac_stats.tso_txd: 0
de=
v.em.0.mac_stats.tso_ctx_fail: 0
$ sudo sysctl dev.em.0.debug=3D1
sysctl: =
unknown oid 'dev.em.0.debug'
$
--
Larry Rosenman http=
://www.lerctr.org/~ler
Phone: +1 512-248-2683 E-Mail: ler@l=
erctr.org
US Mail: 430 Valona Loop, Round Rock, TX 78681-3893
_____________=
__________________________________
freebsd-stable@freebsd.org mailing list
=
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, se=
nd any mail to "freebsd-stable-unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?25c4965e-fb4d-4991-ae7b-e4fe89741359>