Date: Sun, 12 Apr 2015 17:57:34 +0000 From: Gareth Wyn Roberts <g.w.roberts@glyndwr.ac.uk> To: "freebsd-stable@freebsd.org" <freebsd-stable@freebsd.org> Subject: msk msk0 watchdog timeout freeze hang lock stop problem Message-ID: <A861E9C3B0586445B36C4BB29ABF2DB46B2EA6F7@XCH7.wrexham.local>
next in thread | raw e-mail | index | archive | help
--_004_A861E9C3B0586445B36C4BB29ABF2DB46B2EA6F7XCH7wrexhamloca_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I've run in to problems using the msk device where initially it works well = enough to set DHCP etc. but stops/freezes as soon as any appreciable networ= k traffic occurs . There are several threads describing similar symptoms ov= er the past two years or more. I've been following several false leads but= have finally found a solution (at least it solves my problem). I'm running a standard FreeBSD 10.1-RELEASE and the NIC is detected as: mskc0: <Marvell Yukon 88E8057 Gigabit Ethernet> mem 0xfa000000-0xfa003fff i= rq 19 at device 0.0 on pci6 msk0: <Marvell Technology Group Ltd. Yukon Ultra 2 Id 0xba Rev 0x00> on msk= c0 msk0: Ethernet address: 00:13:77:e9:df:eb miibus0: <MII bus> on msk0 e1000phy0: <Marvell 88E1149 Gigabit PHY> PHY 0 on miibus0 e1000phy0: none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT= , 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-ma ster, auto, auto-flow The network worked when using the i386 release, but failed for the amd64 re= lease (as reported previously) which prompted me to disable 64-bit DMA (the= patch for this is attached below). This worked for the first kernel built= but mysteriously failed when another unrelated part of the kernel was chan= ged (a usb driver) and the kernel recompiled. So identical msk driver code= worked in one kernel but not the second! This suggested that alignment dif= ferences between the two kernels were causing the msk driver to fail. Other= s have reported varying behaviour depending on different circumstances. It transpires that changing just one value in the if_mskreg.h file solved a= ll my problems. Subsequently I have not been able to make it fail under he= avy network traffic in either 32-bit or 64-bit mode. I'm working on 10.1-RELEASE source, i.e. if_msk.c revision 262524 and if_ms= kreg.h revision 264442. Here's the patch to if_mskreg.h --- if_mskreg.h-orig 2014-11-11 20:02:58.000000000 +0000 +++ if_mskreg.h 2015-04-12 18:47:20.000000000 +0100 @@ -2179,9 +2179,11 @@ * At first I guessed 8 bytes, the size of a single descriptor, would be * required alignment constraints. But, it seems that Yukon II have 4096 * bytes boundary alignment constraints. + * And it seems that the DMA status region for the Yukon Ultra 2 (88E8057) + * requires 8192 byte alignment to prevent locking. */ #define MSK_RING_ALIGN 4096 -#define MSK_STAT_ALIGN 4096 +#define MSK_STAT_ALIGN 8192 The patches to both files which also implement a MSK_64BIT_DMA_DISABLE flag= are attached. Perhaps the developers would consider committing these as i= t may be useful for future debugging. Gareth. --_004_A861E9C3B0586445B36C4BB29ABF2DB46B2EA6F7XCH7wrexhamloca_ Content-Type: text/x-patch; name="if_mskreg.h.rev264442.diff" Content-Description: if_mskreg.h.rev264442.diff Content-Disposition: attachment; filename="if_mskreg.h.rev264442.diff"; size=603; creation-date="Sun, 12 Apr 2015 17:52:31 GMT"; modification-date="Sun, 12 Apr 2015 17:52:31 GMT" Content-Transfer-Encoding: base64 LS0tIGlmX21za3JlZy5oLW9yaWcJMjAxNC0xMS0xMSAyMDowMjo1OC4wMDAwMDAwMDAgKzAwMDAK KysrIGlmX21za3JlZy5oCTIwMTUtMDQtMTIgMTg6NDc6MjAuMDAwMDAwMDAwICswMTAwCkBAIC0y MTc5LDkgKzIxNzksMTEgQEAKICAqIEF0IGZpcnN0IEkgZ3Vlc3NlZCA4IGJ5dGVzLCB0aGUgc2l6 ZSBvZiBhIHNpbmdsZSBkZXNjcmlwdG9yLCB3b3VsZCBiZQogICogcmVxdWlyZWQgYWxpZ25tZW50 IGNvbnN0cmFpbnRzLiBCdXQsIGl0IHNlZW1zIHRoYXQgWXVrb24gSUkgaGF2ZSA0MDk2CiAgKiBi eXRlcyBib3VuZGFyeSBhbGlnbm1lbnQgY29uc3RyYWludHMuCisgKiBBbmQgaXQgc2VlbXMgdGhh dCB0aGUgRE1BIHN0YXR1cyByZWdpb24gZm9yIHRoZSBZdWtvbiBVbHRyYSAyICg4OEU4MDU3KQor ICogcmVxdWlyZXMgODE5MiBieXRlIGFsaWdubWVudCB0byBwcmV2ZW50IGxvY2tpbmcuCiAgKi8K ICNkZWZpbmUgTVNLX1JJTkdfQUxJR04JNDA5NgotI2RlZmluZQlNU0tfU1RBVF9BTElHTgk0MDk2 CisjZGVmaW5lCU1TS19TVEFUX0FMSUdOCTgxOTIKIAogLyogUnggZGVzY3JpcHRvciBkYXRhIHN0 cnVjdHVyZSAqLwogc3RydWN0IG1za19yeF9kZXNjIHsK --_004_A861E9C3B0586445B36C4BB29ABF2DB46B2EA6F7XCH7wrexhamloca_ Content-Type: text/x-patch; name="if_msk.c.rev262524.dma.diff" Content-Description: if_msk.c.rev262524.dma.diff Content-Disposition: attachment; filename="if_msk.c.rev262524.dma.diff"; size=3748; creation-date="Sun, 12 Apr 2015 17:52:52 GMT"; modification-date="Sun, 12 Apr 2015 17:52:52 GMT" Content-Transfer-Encoding: base64 LS0tIGlmX21zay5jLW9yaWcJMjAxNC0xMS0xMSAyMDowMjo1OC4wMDAwMDAwMDAgKzAwMDAKKysr IGlmX21zay5jCTIwMTUtMDQtMTIgMDI6MTU6MTIuNTUxMDA1MDAwICswMTAwCkBAIC0yMTY0LDgg KzIxNjQsOCBAQAogCWVycm9yID0gYnVzX2RtYV90YWdfY3JlYXRlKAogCQkgICAgYnVzX2dldF9k bWFfdGFnKHNjLT5tc2tfZGV2KSwJLyogcGFyZW50ICovCiAJCSAgICBNU0tfU1RBVF9BTElHTiwg MCwJCS8qIGFsaWdubWVudCwgYm91bmRhcnkgKi8KLQkJICAgIEJVU19TUEFDRV9NQVhBRERSLAkJ LyogbG93YWRkciAqLwotCQkgICAgQlVTX1NQQUNFX01BWEFERFIsCQkvKiBoaWdoYWRkciAqLwor CQkgICAgQlVTX0RNQV9UQUdfTE9XQUREUiwJLyogbG93YWRkciAqLworCQkgICAgQlVTX0RNQV9U QUdfSElHSEFERFIsCS8qIGhpZ2hhZGRyICovCiAJCSAgICBOVUxMLCBOVUxMLAkJCS8qIGZpbHRl ciwgZmlsdGVyYXJnICovCiAJCSAgICBzdGF0X3N6LAkJCS8qIG1heHNpemUgKi8KIAkJICAgIDEs CQkJCS8qIG5zZWdtZW50cyAqLwpAQCAtMjIzNSw4ICsyMjM1LDggQEAKIAllcnJvciA9IGJ1c19k bWFfdGFnX2NyZWF0ZSgKIAkJICAgIGJ1c19nZXRfZG1hX3RhZyhzY19pZi0+bXNrX2lmX2Rldiks CS8qIHBhcmVudCAqLwogCQkgICAgMSwgMCwJCQkvKiBhbGlnbm1lbnQsIGJvdW5kYXJ5ICovCi0J CSAgICBCVVNfU1BBQ0VfTUFYQUREUiwJCS8qIGxvd2FkZHIgKi8KLQkJICAgIEJVU19TUEFDRV9N QVhBRERSLAkJLyogaGlnaGFkZHIgKi8KKwkJICAgIEJVU19ETUFfVEFHX0xPV0FERFIsCS8qIGxv d2FkZHIgKi8KKwkJICAgIEJVU19ETUFfVEFHX0hJR0hBRERSLAkvKiBoaWdoYWRkciAqLwogCQkg ICAgTlVMTCwgTlVMTCwJCQkvKiBmaWx0ZXIsIGZpbHRlcmFyZyAqLwogCQkgICAgQlVTX1NQQUNF X01BWFNJWkVfMzJCSVQsCS8qIG1heHNpemUgKi8KIAkJICAgIDAsCQkJCS8qIG5zZWdtZW50cyAq LwpAQCAtMjI1Miw4ICsyMjUyLDggQEAKIAkvKiBDcmVhdGUgdGFnIGZvciBUeCByaW5nLiAqLwog CWVycm9yID0gYnVzX2RtYV90YWdfY3JlYXRlKHNjX2lmLT5tc2tfY2RhdGEubXNrX3BhcmVudF90 YWcsLyogcGFyZW50ICovCiAJCSAgICBNU0tfUklOR19BTElHTiwgMCwJCS8qIGFsaWdubWVudCwg Ym91bmRhcnkgKi8KLQkJICAgIEJVU19TUEFDRV9NQVhBRERSLAkJLyogbG93YWRkciAqLwotCQkg ICAgQlVTX1NQQUNFX01BWEFERFIsCQkvKiBoaWdoYWRkciAqLworCQkgICAgQlVTX0RNQV9UQUdf TE9XQUREUiwJLyogbG93YWRkciAqLworCQkgICAgQlVTX0RNQV9UQUdfSElHSEFERFIsCS8qIGhp Z2hhZGRyICovCiAJCSAgICBOVUxMLCBOVUxMLAkJCS8qIGZpbHRlciwgZmlsdGVyYXJnICovCiAJ CSAgICBNU0tfVFhfUklOR19TWiwJCS8qIG1heHNpemUgKi8KIAkJICAgIDEsCQkJCS8qIG5zZWdt ZW50cyAqLwpAQCAtMjI3MCw4ICsyMjcwLDggQEAKIAkvKiBDcmVhdGUgdGFnIGZvciBSeCByaW5n LiAqLwogCWVycm9yID0gYnVzX2RtYV90YWdfY3JlYXRlKHNjX2lmLT5tc2tfY2RhdGEubXNrX3Bh cmVudF90YWcsLyogcGFyZW50ICovCiAJCSAgICBNU0tfUklOR19BTElHTiwgMCwJCS8qIGFsaWdu bWVudCwgYm91bmRhcnkgKi8KLQkJICAgIEJVU19TUEFDRV9NQVhBRERSLAkJLyogbG93YWRkciAq LwotCQkgICAgQlVTX1NQQUNFX01BWEFERFIsCQkvKiBoaWdoYWRkciAqLworCQkgICAgQlVTX0RN QV9UQUdfTE9XQUREUiwJLyogbG93YWRkciAqLworCQkgICAgQlVTX0RNQV9UQUdfSElHSEFERFIs CS8qIGhpZ2hhZGRyICovCiAJCSAgICBOVUxMLCBOVUxMLAkJCS8qIGZpbHRlciwgZmlsdGVyYXJn ICovCiAJCSAgICBNU0tfUlhfUklOR19TWiwJCS8qIG1heHNpemUgKi8KIAkJICAgIDEsCQkJCS8q IG5zZWdtZW50cyAqLwpAQCAtMjI4OCw4ICsyMjg4LDggQEAKIAkvKiBDcmVhdGUgdGFnIGZvciBU eCBidWZmZXJzLiAqLwogCWVycm9yID0gYnVzX2RtYV90YWdfY3JlYXRlKHNjX2lmLT5tc2tfY2Rh dGEubXNrX3BhcmVudF90YWcsLyogcGFyZW50ICovCiAJCSAgICAxLCAwLAkJCS8qIGFsaWdubWVu dCwgYm91bmRhcnkgKi8KLQkJICAgIEJVU19TUEFDRV9NQVhBRERSLAkJLyogbG93YWRkciAqLwot CQkgICAgQlVTX1NQQUNFX01BWEFERFIsCQkvKiBoaWdoYWRkciAqLworCQkgICAgQlVTX0RNQV9U QUdfTE9XQUREUiwJLyogbG93YWRkciAqLworCQkgICAgQlVTX0RNQV9UQUdfSElHSEFERFIsCS8q IGhpZ2hhZGRyICovCiAJCSAgICBOVUxMLCBOVUxMLAkJCS8qIGZpbHRlciwgZmlsdGVyYXJnICov CiAJCSAgICBNU0tfVFNPX01BWFNJWkUsCQkvKiBtYXhzaXplICovCiAJCSAgICBNU0tfTUFYVFhT RUdTLAkJLyogbnNlZ21lbnRzICovCkBAIC0yMzEzLDggKzIzMTMsOCBAQAogCS8qIENyZWF0ZSB0 YWcgZm9yIFJ4IGJ1ZmZlcnMuICovCiAJZXJyb3IgPSBidXNfZG1hX3RhZ19jcmVhdGUoc2NfaWYt Pm1za19jZGF0YS5tc2tfcGFyZW50X3RhZywvKiBwYXJlbnQgKi8KIAkJICAgIHJ4YWxpZ24sIDAs CQkJLyogYWxpZ25tZW50LCBib3VuZGFyeSAqLwotCQkgICAgQlVTX1NQQUNFX01BWEFERFIsCQkv KiBsb3dhZGRyICovCi0JCSAgICBCVVNfU1BBQ0VfTUFYQUREUiwJCS8qIGhpZ2hhZGRyICovCisJ CSAgICBCVVNfRE1BX1RBR19MT1dBRERSLAkvKiBsb3dhZGRyICovCisJCSAgICBCVVNfRE1BX1RB R19ISUdIQUREUiwJLyogaGlnaGFkZHIgKi8KIAkJICAgIE5VTEwsIE5VTEwsCQkJLyogZmlsdGVy LCBmaWx0ZXJhcmcgKi8KIAkJICAgIE1DTEJZVEVTLAkJCS8qIG1heHNpemUgKi8KIAkJICAgIDEs CQkJCS8qIG5zZWdtZW50cyAqLwpAQCAtMjQyNCw4ICsyNDI0LDggQEAKIAkvKiBDcmVhdGUgdGFn IGZvciBqdW1ibyBSeCByaW5nLiAqLwogCWVycm9yID0gYnVzX2RtYV90YWdfY3JlYXRlKHNjX2lm LT5tc2tfY2RhdGEubXNrX3BhcmVudF90YWcsLyogcGFyZW50ICovCiAJCSAgICBNU0tfUklOR19B TElHTiwgMCwJCS8qIGFsaWdubWVudCwgYm91bmRhcnkgKi8KLQkJICAgIEJVU19TUEFDRV9NQVhB RERSLAkJLyogbG93YWRkciAqLwotCQkgICAgQlVTX1NQQUNFX01BWEFERFIsCQkvKiBoaWdoYWRk ciAqLworCQkgICAgQlVTX0RNQV9UQUdfTE9XQUREUiwJLyogbG93YWRkciAqLworCQkgICAgQlVT X0RNQV9UQUdfSElHSEFERFIsCS8qIGhpZ2hhZGRyICovCiAJCSAgICBOVUxMLCBOVUxMLAkJCS8q IGZpbHRlciwgZmlsdGVyYXJnICovCiAJCSAgICBNU0tfSlVNQk9fUlhfUklOR19TWiwJLyogbWF4 c2l6ZSAqLwogCQkgICAgMSwJCQkJLyogbnNlZ21lbnRzICovCkBAIC0yNDQ5LDggKzI0NDksOCBA QAogCS8qIENyZWF0ZSB0YWcgZm9yIGp1bWJvIFJ4IGJ1ZmZlcnMuICovCiAJZXJyb3IgPSBidXNf ZG1hX3RhZ19jcmVhdGUoc2NfaWYtPm1za19jZGF0YS5tc2tfcGFyZW50X3RhZywvKiBwYXJlbnQg Ki8KIAkJICAgIHJ4YWxpZ24sIDAsCQkJLyogYWxpZ25tZW50LCBib3VuZGFyeSAqLwotCQkgICAg QlVTX1NQQUNFX01BWEFERFIsCQkvKiBsb3dhZGRyICovCi0JCSAgICBCVVNfU1BBQ0VfTUFYQURE UiwJCS8qIGhpZ2hhZGRyICovCisJCSAgICBCVVNfRE1BX1RBR19MT1dBRERSLAkvKiBsb3dhZGRy ICovCisJCSAgICBCVVNfRE1BX1RBR19ISUdIQUREUiwJLyogaGlnaGFkZHIgKi8KIAkJICAgIE5V TEwsIE5VTEwsCQkJLyogZmlsdGVyLCBmaWx0ZXJhcmcgKi8KIAkJICAgIE1KVU05QllURVMsCQkJ LyogbWF4c2l6ZSAqLwogCQkgICAgMSwJCQkJLyogbnNlZ21lbnRzICovCg== --_004_A861E9C3B0586445B36C4BB29ABF2DB46B2EA6F7XCH7wrexhamloca_ Content-Type: text/x-patch; name="if_mskreg.h.rev264442.dma.diff" Content-Description: if_mskreg.h.rev264442.dma.diff Content-Disposition: attachment; filename="if_mskreg.h.rev264442.dma.diff"; size=1533; creation-date="Sun, 12 Apr 2015 17:53:17 GMT"; modification-date="Sun, 12 Apr 2015 17:53:17 GMT" Content-Transfer-Encoding: base64 LS0tIGlmX21za3JlZy5oLW9yaWcJMjAxNC0xMS0xMSAyMDowMjo1OC4wMDAwMDAwMDAgKzAwMDAK KysrIGlmX21za3JlZy5oCTIwMTUtMDQtMTIgMTM6MTc6MjguMDAwMDAwMDAwICswMTAwCkBAIC0y MTc5LDkgKzIxNzksMTEgQEAKICAqIEF0IGZpcnN0IEkgZ3Vlc3NlZCA4IGJ5dGVzLCB0aGUgc2l6 ZSBvZiBhIHNpbmdsZSBkZXNjcmlwdG9yLCB3b3VsZCBiZQogICogcmVxdWlyZWQgYWxpZ25tZW50 IGNvbnN0cmFpbnRzLiBCdXQsIGl0IHNlZW1zIHRoYXQgWXVrb24gSUkgaGF2ZSA0MDk2CiAgKiBi eXRlcyBib3VuZGFyeSBhbGlnbm1lbnQgY29uc3RyYWludHMuCisgKiBBbmQgaXQgc2VlbXMgdGhh dCB0aGUgRE1BIHN0YXR1cyByZWdpb24gZm9yIHRoZSBZdWtvbiBVbHRyYSAyICg4OEU4MDU3KQor ICogcmVxdWlyZXMgODE5MiBieXRlIGFsaWdubWVudCB0byBwcmV2ZW50IGxvY2tpbmcuCiAgKi8K ICNkZWZpbmUgTVNLX1JJTkdfQUxJR04JNDA5NgotI2RlZmluZQlNU0tfU1RBVF9BTElHTgk0MDk2 CisjZGVmaW5lCU1TS19TVEFUX0FMSUdOCTgxOTIKIAogLyogUnggZGVzY3JpcHRvciBkYXRhIHN0 cnVjdHVyZSAqLwogc3RydWN0IG1za19yeF9kZXNjIHsKQEAgLTIzMjcsMTUgKzIzMjksMjkgQEAK ICAqIGFsbG9jYXRlcyA1MCUgbW9yZSB0b3RhbCBUWCBidWZmZXJzIG9uIHBsYXRmb3JtcyB0aGF0 IHN1cHBvcnQgNjRiaXQKICAqIERNQS4KICAqLworI3VuZGVmIE1TS182NEJJVF9ETUFfRElTQUJM RQkJLyogRGVmaW5lIHRvIHVzZSAzMmJpdCBETUEgb24gNjRiaXQgaGFyZHdhcmUgKi8KICNpZiAo QlVTX1NQQUNFX01BWEFERFIgPiAweEZGRkZGRkZGKQorI2lmbmRlZiBNU0tfNjRCSVRfRE1BX0RJ U0FCTEUKICNkZWZpbmUJTVNLXzY0QklUX0RNQQogI2RlZmluZSBNU0tfVFhfUklOR19DTlQJCTM4 NAogI2RlZmluZSBNU0tfUlhfUklOR19DTlQJCTUxMgorI2RlZmluZSBCVVNfRE1BX1RBR19MT1dB RERSIEJVU19TUEFDRV9NQVhBRERSCisjZGVmaW5lIEJVU19ETUFfVEFHX0hJR0hBRERSIEJVU19T UEFDRV9NQVhBRERSCiAjZWxzZQogI3VuZGVmCU1TS182NEJJVF9ETUEKICNkZWZpbmUgTVNLX1RY X1JJTkdfQ05UCQkyNTYKICNkZWZpbmUgTVNLX1JYX1JJTkdfQ05UCQkyNTYKKyNkZWZpbmUgQlVT X0RNQV9UQUdfTE9XQUREUiBCVVNfU1BBQ0VfTUFYQUREUl8zMkJJVAorI2RlZmluZSBCVVNfRE1B X1RBR19ISUdIQUREUiBCVVNfU1BBQ0VfTUFYQUREUgogI2VuZGlmCisjZWxzZQorI3VuZGVmCU1T S182NEJJVF9ETUEKKyNkZWZpbmUgTVNLX1RYX1JJTkdfQ05UCQkyNTYKKyNkZWZpbmUgTVNLX1JY X1JJTkdfQ05UCQkyNTYKKyNkZWZpbmUgQlVTX0RNQV9UQUdfTE9XQUREUiBCVVNfU1BBQ0VfTUFY QUREUgorI2RlZmluZSBCVVNfRE1BX1RBR19ISUdIQUREUiBCVVNfU1BBQ0VfTUFYQUREUgorI2Vu ZGlmCisKICNkZWZpbmUJTVNLX1JYX0JVRl9BTElHTgk4CiAjZGVmaW5lIE1TS19KVU1CT19SWF9S SU5HX0NOVAlNU0tfUlhfUklOR19DTlQKICNkZWZpbmUgTVNLX01BWFRYU0VHUwkJMzUK --_004_A861E9C3B0586445B36C4BB29ABF2DB46B2EA6F7XCH7wrexhamloca_--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?A861E9C3B0586445B36C4BB29ABF2DB46B2EA6F7>