Date: Tue, 05 Jan 1999 16:43:09 -0500 From: Robert Withrow <bwithrow@BayNetworks.COM> To: hackers@FreeBSD.ORG Cc: witr@rwwa.com, bwithrow@BayNetworks.COM Subject: 3.0-REL NFS interop problems redux Message-ID: <199901052143.VAA15097@tuva.engeast.baynetworks.com>
next in thread | raw e-mail | index | archive | help
I whined before about my problem where a specific NFS mount goes deaf on me for a period of time and then wakes up later. I said that I would sniff out the problem... Well I finally got my office set up so that I could get a sniffer to capture the session and I have that capture (about 600 packets). I've looked at it and I can see where it goes wrong, but I can't see *why* it is wrong. I'm wondering if there is an NFS hacker who can work with me on this. To recap, I'm using 3.0_REL but I have replaced the amutils with the latest beta of amutils (which fixes a number of amd-related problems in 3.0-REL). I log into a virtual console and I can access my (nfs-mounted, automounted) home directory. I then log into an XDM session and the login hangs accessing my home directory. If I switch back to the VT session I *also* hang accessing my home directory. The mount will "wake up" on the order of 10 minutes later. This problems is completely repeatable, with the caveat that it only happens *once* for every time I boot my machine. Even if I allow the mount of my home directory to time out the problem will *not* occur unless the system is re-booted. My home directory is served by a NAC box version 4.2a. I sniffed the wire as I logged into the XDM session and I see: Frame Delta T Length Dir Dest Address Source Address [lots deleted] 553 0.001 90 NA 192.32.68.39 192.32.61.8 554 0.000 182 NA 192.32.61.8 192.32.68.39 555 0.001 170 NA 192.32.68.39 192.32.61.8 556 0.000 166 NA 192.32.61.8 192.32.68.39 557 0.001 90 NA 192.32.68.39 192.32.61.8 558 0.655 849 NA 192.32.61.8 192.32.68.39 559 2.030 849 NA 192.32.61.8 192.32.68.39 560 4.050 885 NA 192.32.61.8 192.32.68.39 561 5.919 90 NA 192.32.72.6 192.32.68.39 562 0.004 90 NA 192.32.68.39 192.32.72.6 563 0.975 82 NA 192.32.61.8 192.32.68.39 And nothing much more happens until the mount wakes up. My workstation is 192.32.68.39 and the server is 192.32.61.8. The problem seems to begin with packets 558, 559, and 560. Full trace available upon request. Details of these packets follow: Frame 558 Date and Time: 04-Jan-99 00:05:43.606 Ethernet Header byte 0 Destination 00:00:a2:c3:39:74 48 bits Bay Networks Source 00:a0:24:97:82:2e 48 bits Ethertype 0x800 16 bits IP Header (Internet Protocol) byte 14 Version IP 4 bits Header Length 5 32-bit words 4 bits Precedence ROUTINE 3 bits Type of Service NORMAL_SERVICE 4 bits Unused 0 1 bits Total Length 1120 bytes 16 bits Identification 3589 16 bits Flags, Unused 0 1 bits Flags, DF bit MAY_FRAGMENT 1 bits Flags, MF bit LAST_FRAGMENT 1 bits Fragment Offset 0 * 8 octets 13 bits Time To Live 64 seconds/hops 8 bits Protocol UDP 8 bits Checksum 0x6718 16 bits Source Address 192.32.68.39 32 bits Destination Address 192.32.61.8 32 bits UDP Header byte 34 Source Port 0x34d 16 bits Destination Port 0x801 16 bits Length 1100 bytes 16 bits Checksum 0xda23 16 bits DATA byte 42 0: 176bdcd6 00000000 00000002 000186a3 .k.............. 10: 00000002 00000008 00000001 00000034 ...............4 20: 00000000 00000000 00000b0c 00000014 ................ 30: 00000008 00000014 00000000 00000038 ...............8 40: 0000008c 00000037 00000025 000000aa .......7...%.... 50: 000000cc 00000000 00000000 4b1f1a00 ............K... 60: af2ed92b 00000000 5fdc0d00 cc058023 ...+...._......# 70: 00000000 01ae0500 9c280800 00000000 .........(...... 80: 00000000 000003b8 000003b8 00000004 ................ 90: c0204427 00013000 124d4954 2d4d4147 . D'..0..MIT-MAG a0: 49432d43 4f4f4b49 452d3100 102c493e IC-COOKIE-1..,I> b0: 582b6a2f 21280d77 191b183c 18010000 X+j/!(.w...<.... c0: 1d6b797a 796c2e65 6e676561 73742e62 .kyzyl.engeast.b d0: 61796e65 74776f72 6b732e63 6f6d0001 aynetworks.com.. e0: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO f0: 4b49452d 3100102c 493e582b 6a2f2128 KIE-1..,I>X+j/!( 100: 0d77191b 183c1800 000004c0 20442600 .w...<...... D&. 110: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO 120: 4f4b4945 2d310010 07397b42 622b2626 OKIE-1...9{Bb+&& 130: 5a03084c 31176e1a 0100001c 74757661 Z..L1.n.....tuva 140: 2e656e67 65617374 2e626179 6e657477 .engeast.baynetw 150: 6f726b73 2e636f6d 00013000 124d4954 orks.com..0..MIT 160: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1. 170: 1007397b 42622b26 265a0308 4c31176e ..9{Bb+&&Z..L1.n 180: 1a000000 04c0208a 7f000131 00124d49 ...... ....1..MI 190: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1 1a0: 0010b6be 63a75d1a 03b0dbef b9d7c6ed ....c.]......... 1b0: 5b5f0100 000a7373 682d7365 72766572 [_....ssh-server 1c0: 00013100 124d4954 2d4d4147 49432d43 ..1..MIT-MAGIC-C 1d0: 4f4f4b49 452d3100 10b6be63 a75d1a03 OOKIE-1....c.].. 1e0: b0dbefb9 d7c6ed5b 5f000000 04c0208a .......[_..... . 1f0: 7f000132 00124d49 542d4d41 4749432d ...2..MIT-MAGIC- 200: 434f4f4b 49452d31 00103574 88e4473e COOKIE-1..5t..G> 210: a48fcaad 49db7962 be870100 000a7373 ....I.yb......ss 220: 682d7365 72766572 00013200 124d4954 h-server..2..MIT 230: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1. 240: 10357488 e4473ea4 8fcaad49 db7962be .5t..G>....I.yb. 250: 87000000 04c02006 fb000130 00124d49 ...... ....0..MI 260: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1 270: 00101e41 8142d1fb 8c099bc6 8edf3d35 ...A.B........=5 280: c4570100 00086465 6c6f7265 616e0001 .W....delorean.. 290: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO 2a0: 4b49452d 310010c7 61e4ada4 c7d59f4d KIE-1...a......M 2b0: 7fbee210 020ded00 000004c0 20066900 ............ .i. 2c0: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO 2d0: 4f4b4945 2d310010 ca22b5ea 9a06aa85 OKIE-1..."...... 2e0: 6f0aab8d 6dba92c0 01000005 726f6269 o...m.......robi 2f0: 6e000130 00124d49 542d4d41 4749432d n..0..MIT-MAGIC- 300: 434f4f4b 49452d31 00103458 53d66775 COOKIE-1..4XS.gu 310: 952a1b66 7c9f1a16 63d20000 0004c020 .*.f|...c...... 320: 06910001 3000c0 ....0.. Frame 559 Date and Time: 04-Jan-99 00:05:45.636 Ethernet Header byte 0 Destination 00:00:a2:c3:39:74 48 bits Bay Networks Source 00:a0:24:97:82:2e 48 bits Ethertype 0x800 16 bits IP Header (Internet Protocol) byte 14 Version IP 4 bits Header Length 5 32-bit words 4 bits Precedence ROUTINE 3 bits Type of Service NORMAL_SERVICE 4 bits Unused 0 1 bits Total Length 1120 bytes 16 bits Identification 3590 16 bits Flags, Unused 0 1 bits Flags, DF bit MAY_FRAGMENT 1 bits Flags, MF bit LAST_FRAGMENT 1 bits Fragment Offset 0 * 8 octets 13 bits Time To Live 64 seconds/hops 8 bits Protocol UDP 8 bits Checksum 0x6717 16 bits Source Address 192.32.68.39 32 bits Destination Address 192.32.61.8 32 bits UDP Header byte 34 Source Port 0x34d 16 bits Destination Port 0x801 16 bits Length 1100 bytes 16 bits Checksum 0xda23 16 bits DATA byte 42 0: 176bdcd6 00000000 00000002 000186a3 .k.............. 10: 00000002 00000008 00000001 00000034 ...............4 20: 00000000 00000000 00000b0c 00000014 ................ 30: 00000008 00000014 00000000 00000038 ...............8 40: 0000008c 00000037 00000025 000000aa .......7...%.... 50: 000000cc 00000000 00000000 4b1f1a00 ............K... 60: af2ed92b 00000000 5fdc0d00 cc058023 ...+...._......# 70: 00000000 01ae0500 9c280800 00000000 .........(...... 80: 00000000 000003b8 000003b8 00000004 ................ 90: c0204427 00013000 124d4954 2d4d4147 . D'..0..MIT-MAG a0: 49432d43 4f4f4b49 452d3100 102c493e IC-COOKIE-1..,I> b0: 582b6a2f 21280d77 191b183c 18010000 X+j/!(.w...<.... c0: 1d6b797a 796c2e65 6e676561 73742e62 .kyzyl.engeast.b d0: 61796e65 74776f72 6b732e63 6f6d0001 aynetworks.com.. e0: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO f0: 4b49452d 3100102c 493e582b 6a2f2128 KIE-1..,I>X+j/!( 100: 0d77191b 183c1800 000004c0 20442600 .w...<...... D&. 110: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO 120: 4f4b4945 2d310010 07397b42 622b2626 OKIE-1...9{Bb+&& 130: 5a03084c 31176e1a 0100001c 74757661 Z..L1.n.....tuva 140: 2e656e67 65617374 2e626179 6e657477 .engeast.baynetw 150: 6f726b73 2e636f6d 00013000 124d4954 orks.com..0..MIT 160: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1. 170: 1007397b 42622b26 265a0308 4c31176e ..9{Bb+&&Z..L1.n 180: 1a000000 04c0208a 7f000131 00124d49 ...... ....1..MI 190: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1 1a0: 0010b6be 63a75d1a 03b0dbef b9d7c6ed ....c.]......... 1b0: 5b5f0100 000a7373 682d7365 72766572 [_....ssh-server 1c0: 00013100 124d4954 2d4d4147 49432d43 ..1..MIT-MAGIC-C 1d0: 4f4f4b49 452d3100 10b6be63 a75d1a03 OOKIE-1....c.].. 1e0: b0dbefb9 d7c6ed5b 5f000000 04c0208a .......[_..... . 1f0: 7f000132 00124d49 542d4d41 4749432d ...2..MIT-MAGIC- 200: 434f4f4b 49452d31 00103574 88e4473e COOKIE-1..5t..G> 210: a48fcaad 49db7962 be870100 000a7373 ....I.yb......ss 220: 682d7365 72766572 00013200 124d4954 h-server..2..MIT 230: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1. 240: 10357488 e4473ea4 8fcaad49 db7962be .5t..G>....I.yb. 250: 87000000 04c02006 fb000130 00124d49 ...... ....0..MI 260: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1 270: 00101e41 8142d1fb 8c099bc6 8edf3d35 ...A.B........=5 280: c4570100 00086465 6c6f7265 616e0001 .W....delorean.. 290: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO 2a0: 4b49452d 310010c7 61e4ada4 c7d59f4d KIE-1...a......M 2b0: 7fbee210 020ded00 000004c0 20066900 ............ .i. 2c0: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO 2d0: 4f4b4945 2d310010 ca22b5ea 9a06aa85 OKIE-1..."...... 2e0: 6f0aab8d 6dba92c0 01000005 726f6269 o...m.......robi 2f0: 6e000130 00124d49 542d4d41 4749432d n..0..MIT-MAGIC- 300: 434f4f4b 49452d31 00103458 53d66775 COOKIE-1..4XS.gu 310: 952a1b66 7c9f1a16 63d20000 0004c020 .*.f|...c...... 320: 06910001 3000c0 ....0.. Frame 560 Date and Time: 04-Jan-99 00:05:49.686 Ethernet Header byte 0 Destination 00:00:a2:c3:39:74 48 bits Bay Networks Source 00:a0:24:97:82:2e 48 bits Ethertype 0x800 16 bits IP Header (Internet Protocol) byte 14 Version IP 4 bits Header Length 5 32-bit words 4 bits Precedence ROUTINE 3 bits Type of Service NORMAL_SERVICE 4 bits Unused 0 1 bits Total Length 1120 bytes 16 bits Identification 3591 16 bits Flags, Unused 0 1 bits Flags, DF bit MAY_FRAGMENT 1 bits Flags, MF bit LAST_FRAGMENT 1 bits Fragment Offset 0 * 8 octets 13 bits Time To Live 64 seconds/hops 8 bits Protocol UDP 8 bits Checksum 0x6716 16 bits Source Address 192.32.68.39 32 bits Destination Address 192.32.61.8 32 bits UDP Header byte 34 Source Port 0x34d 16 bits Destination Port 0x801 16 bits Length 1100 bytes 16 bits Checksum 0xda23 16 bits DATA byte 42 0: 176bdcd6 00000000 00000002 000186a3 .k.............. 10: 00000002 00000008 00000001 00000034 ...............4 20: 00000000 00000000 00000b0c 00000014 ................ 30: 00000008 00000014 00000000 00000038 ...............8 40: 0000008c 00000037 00000025 000000aa .......7...%.... 50: 000000cc 00000000 00000000 4b1f1a00 ............K... 60: af2ed92b 00000000 5fdc0d00 cc058023 ...+...._......# 70: 00000000 01ae0500 9c280800 00000000 .........(...... 80: 00000000 000003b8 000003b8 00000004 ................ 90: c0204427 00013000 124d4954 2d4d4147 . D'..0..MIT-MAG a0: 49432d43 4f4f4b49 452d3100 102c493e IC-COOKIE-1..,I> b0: 582b6a2f 21280d77 191b183c 18010000 X+j/!(.w...<.... c0: 1d6b797a 796c2e65 6e676561 73742e62 .kyzyl.engeast.b d0: 61796e65 74776f72 6b732e63 6f6d0001 aynetworks.com.. e0: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO f0: 4b49452d 3100102c 493e582b 6a2f2128 KIE-1..,I>X+j/!( 100: 0d77191b 183c1800 000004c0 20442600 .w...<...... D&. 110: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO 120: 4f4b4945 2d310010 07397b42 622b2626 OKIE-1...9{Bb+&& 130: 5a03084c 31176e1a 0100001c 74757661 Z..L1.n.....tuva 140: 2e656e67 65617374 2e626179 6e657477 .engeast.baynetw 150: 6f726b73 2e636f6d 00013000 124d4954 orks.com..0..MIT 160: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1. 170: 1007397b 42622b26 265a0308 4c31176e ..9{Bb+&&Z..L1.n 180: 1a000000 04c0208a 7f000131 00124d49 ...... ....1..MI 190: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1 1a0: 0010b6be 63a75d1a 03b0dbef b9d7c6ed ....c.]......... 1b0: 5b5f0100 000a7373 682d7365 72766572 [_....ssh-server 1c0: 00013100 124d4954 2d4d4147 49432d43 ..1..MIT-MAGIC-C 1d0: 4f4f4b49 452d3100 10b6be63 a75d1a03 OOKIE-1....c.].. 1e0: b0dbefb9 d7c6ed5b 5f000000 04c0208a .......[_..... . 1f0: 7f000132 00124d49 542d4d41 4749432d ...2..MIT-MAGIC- 200: 434f4f4b 49452d31 00103574 88e4473e COOKIE-1..5t..G> 210: a48fcaad 49db7962 be870100 000a7373 ....I.yb......ss 220: 682d7365 72766572 00013200 124d4954 h-server..2..MIT 230: 2d4d4147 49432d43 4f4f4b49 452d3100 -MAGIC-COOKIE-1. 240: 10357488 e4473ea4 8fcaad49 db7962be .5t..G>....I.yb. 250: 87000000 04c02006 fb000130 00124d49 ...... ....0..MI 260: 542d4d41 4749432d 434f4f4b 49452d31 T-MAGIC-COOKIE-1 270: 00101e41 8142d1fb 8c099bc6 8edf3d35 ...A.B........=5 280: c4570100 00086465 6c6f7265 616e0001 .W....delorean.. 290: 3000124d 49542d4d 41474943 2d434f4f 0..MIT-MAGIC-COO 2a0: 4b49452d 310010c7 61e4ada4 c7d59f4d KIE-1...a......M 2b0: 7fbee210 020ded00 000004c0 20066900 ............ .i. 2c0: 01300012 4d49542d 4d414749 432d434f .0..MIT-MAGIC-CO 2d0: 4f4b4945 2d310010 ca22b5ea 9a06aa85 OKIE-1..."...... 2e0: 6f0aab8d 6dba92c0 01000005 726f6269 o...m.......robi 2f0: 6e000130 00124d49 542d4d41 4749432d n..0..MIT-MAGIC- 300: 434f4f4b 49452d31 00103458 53d66775 COOKIE-1..4XS.gu 310: 952a1b66 7c9f1a16 63d20000 0004c020 .*.f|...c...... 320: 06910001 3000124d 49542d4d 41474943 ....0..MIT-MAGIC 330: 2d434f4f 4b49452d 3100109f 8c5f2a51 -COOKIE-1...._*Q 340: 1dc293c8 e111e018 4893cf ........H.. Frame 563 Date and Time: 04-Jan-99 00:05:56.586 Ethernet Header byte 0 Destination 00:00:a2:c3:39:74 48 bits Bay Networks Source 00:a0:24:97:82:2e 48 bits Ethertype 0x800 16 bits IP Header (Internet Protocol) byte 14 Version IP 4 bits Header Length 5 32-bit words 4 bits Precedence ROUTINE 3 bits Type of Service NORMAL_SERVICE 4 bits Unused 0 1 bits Total Length 68 bytes 16 bits Identification 3593 16 bits Flags, Unused 0 1 bits Flags, DF bit MAY_FRAGMENT 1 bits Flags, MF bit LAST_FRAGMENT 1 bits Fragment Offset 0 * 8 octets 13 bits Time To Live 64 seconds/hops 8 bits Protocol UDP 8 bits Checksum 0x6b30 16 bits Source Address 192.32.68.39 32 bits Destination Address 192.32.61.8 32 bits UDP Header byte 34 Source Port SUNRPC 16 bits Destination Port 0x801 16 bits Length 48 bytes 16 bits Checksum 0xe972 16 bits SUNRPC_HDR byte 42 Transfer Id 0x82040000 32 bits Type CALL 32 bits SUNRPC_CALL byte 50 RPC Version VERS_2 32 bits Program NFS 32 bits Version 2 32 bits Procedure 0 32 bits Flavor NONE 32 bits Length 0 bytes 32 bits Flavor NONE 32 bits Length 0 bytes 32 bits -- Robert Withrow -- (+1 978 916 8256) BWithrow@BayNetworks.com To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?199901052143.VAA15097>