Date: Wed, 28 Jan 2009 04:21:48 +0000 From: Dmitry Marakasov <amdmi3@amdmi3.ru> To: "Arno J. Klaassen" <arno@heho.snv.jussieu.fr> Cc: freebsd-current@freebsd.org Subject: Re: Data corruption with checksum offloading enabled Message-ID: <20090128042148.GA1256@hades.panopticon> In-Reply-To: <wpy6wwiqjk.fsf@heho.snv.jussieu.fr> References: <20090123221826.GB30982@deprived.panopticon> <20090126144044.GB6054@hades.panopticon> <wphc3kj4sb.fsf@heho.snv.jussieu.fr> <20090127164617.GA93440@hades.panopticon> <wpy6wwiqjk.fsf@heho.snv.jussieu.fr>
next in thread | previous in thread | raw e-mail | index | archive | help
* Arno J. Klaassen (arno@heho.snv.jussieu.fr) wrote:
> >> [ .. ]
> >> 07aa45c8 29 20
> >>
> >> Does your corruption fulfill these characterisations as well?
> >
> > Nope, as I've written before, it's corruption of single 128 byte
> > block.
>
> ok; I didn't quite understand that; so to be clear, 128 contitguous
> bytes are corrupt ?
Correct.
> > I've deleted samples during the upgrade process, but I think I'll turn
> > *xcsum back on and do some more tests with NFS, and netcat transfers.
>
> Thanx; for me it took often hours to provoke the error
>
> I'lll test later with -current again after having set up a newe
> server
Results. Each test was ran in a clean system just after reboot (via
rc.local). I used 512MB chunks, but I guess that was not enough, as
corruption didn't show itself in all the tests. Also there seem to be
some problems with NFS on current witch need specific attention - that's
why I lost one sample due to NFS lockup and reboot, and that's why I've
used 512MB data pieces.
1. 512MB zeroes with netcat: 5/5 correct
2. 512MB zeroes with NFS: 4/4 correct (there seem to also be some NFS
lockups on -current, so I lost one sample; it's also the reason I ve
3. 512MB random bytes with NFS: 2/5 correct
also tried 512MB random bytes after 10MB via netcat and same 512MB after
that (to check for possible shifts). No corruptions here, though.
So I only have 3 corruptions. Will do more tests when I have some time.
Those reboots take quite a lot of time and need attention due to
possible NFS lockups...
For now guess is that corruption may be data from the other place
of the stream. So stream of zeroes is not affected (or is affected
with much lower possibility).
Diffs:
--- _r.0.h 2009-01-28 04:16:47.000000000 +0000
+++ _r.2.h 2009-01-28 04:16:57.000000000 +0000
@@ -72519,15 +72519,15 @@
0011b460 6f 3e 2b a2 b9 d4 5f c6 69 df 4e 38 bc 96 7f ef |o>+..._.i.N8....|
0011b470 56 55 5e 65 e3 ab 1e 4b 7c d6 1d 8a a4 51 4e d2 |VU^e...K|....QN.|
0011b480 9a 11 64 ec 39 be 86 2c 07 06 00 79 80 90 8b 70 |..d.9..,...y...p|
-0011b490 70 60 b4 97 4d 52 58 a8 e4 30 27 ce 87 90 a4 5e |p`..MRX..0'....^|
-0011b4a0 db 4a 0e 03 3a 45 84 97 60 a4 80 3f 92 36 d1 5f |.J..:E..`..?.6._|
-0011b4b0 86 90 0a c0 a7 ca 86 73 21 13 6c da 4f 8f 15 fc |.......s!.l.O...|
-0011b4c0 c7 d9 61 b5 9e ac 39 79 c5 b3 99 df 9e aa a5 84 |..a...9y........|
-0011b4d0 5d 41 6d c2 05 9d 33 7d 71 78 7e 24 2c 83 98 55 |]Am...3}qx~$,..U|
-0011b4e0 3e 86 5d 13 8c 41 36 88 93 c8 d6 8f 38 f9 fe 42 |>.]..A6.....8..B|
-0011b4f0 21 e3 ef c2 71 8d d8 87 f3 b6 9c 21 08 fe 99 8c |!...q......!....|
-0011b500 d4 84 c9 2f 68 ad a0 75 63 e9 16 7e e5 0a f0 d3 |.../h..uc..~....|
-0011b510 85 fa 39 e7 2b 3a 8a 93 58 08 29 b2 a0 0b af fc |..9.+:..X.).....|
+0011b490 70 60 af 2e 74 ba 2f 2d 46 af 18 b3 c4 93 8b b2 |p`..t./-F.......|
+0011b4a0 47 24 9f 09 4d 5b 7b dc b0 96 76 b0 b2 07 55 56 |G$..M[{...v...UV|
+0011b4b0 09 dd ad ac 8c be 92 87 83 92 02 ba b3 42 81 15 |.............B..|
+0011b4c0 49 5a 6e c5 4a b0 8a e5 c8 c2 bb e0 d8 ba f4 dc |IZn.J...........|
+0011b4d0 6d 81 19 52 87 64 6e b0 6f c7 71 0c bc 75 4b e6 |m..R.dn.o.q..uK.|
+0011b4e0 02 1f 2e 3b 18 1b e8 d2 47 bb 01 e4 ed ad ac f5 |...;....G.......|
+0011b4f0 8f 13 4c bc 8a be 5a 2e ee bd 2c 1f 1f 02 cd eb |..L...Z...,.....|
+0011b500 bd 00 8f 1b 9e fa 7f 69 4a e9 16 a1 34 2d 73 7d |.......iJ...4-s}|
+0011b510 e7 c0 39 e7 2b 3a 8a 93 58 08 29 b2 a0 0b af fc |..9.+:..X.).....|
0011b520 47 de 34 b7 99 31 80 58 52 d5 fa d0 b0 4e db 96 |G.4..1.XR....N..|
0011b530 61 49 93 a6 03 a3 06 ca 28 da 29 f3 f1 16 ac 13 |aI......(.).....|
0011b540 c3 53 6f 83 ce 15 8e 0c e3 00 09 4d ae 59 4f 67 |.So........M.YOg|
--- _r.0.h 2009-01-28 04:16:47.000000000 +0000
+++ _r.3.h 2009-01-28 04:17:06.000000000 +0000
@@ -27534,15 +27534,15 @@
0006b8d0 43 10 91 3b c6 90 77 31 55 23 f8 1a d1 aa 41 30 |C..;..w1U#....A0|
0006b8e0 0c cd cc b8 6f 4a 0c 83 16 f8 e7 dc 47 cb a1 65 |....oJ......G..e|
0006b8f0 5c f8 e5 f3 f2 b7 05 e4 cb ab a0 49 ea e3 f0 30 |\..........I...0|
-0006b900 21 ca d7 a9 10 06 57 f8 44 8b 82 36 b5 0f 03 33 |!.....W.D..6...3|
-0006b910 ba c0 ba bd a2 b1 e0 d1 a7 c5 a7 c4 d7 53 bc 80 |.............S..|
-0006b920 ea 1f 0e eb f2 aa fc 37 0e e8 67 35 65 78 65 ae |.......7..g5exe.|
-0006b930 d6 41 a2 ed dd b6 58 46 26 17 a1 aa ab b5 13 67 |.A....XF&......g|
-0006b940 de bd 6f 97 69 f1 31 10 97 25 9d fc 0b e5 34 44 |..o.i.1..%....4D|
-0006b950 83 93 87 c5 34 6b 5b ab 1f 50 49 8c fe dc 87 77 |....4k[..PI....w|
-0006b960 9d e5 b6 4d 56 11 e3 e3 55 67 6f 9d fc fe b1 9a |...MV...Ugo.....|
-0006b970 92 19 45 ba f8 4e 50 a0 ce bc a8 92 85 fe b8 c4 |..E..NP.........|
-0006b980 b1 c4 ef 2f c2 55 46 15 1e 01 f0 ff 66 22 e8 3e |.../.UF.....f".>|
+0006b900 21 ca d7 a9 10 06 57 f8 44 8b 82 36 b5 0f 03 b1 |!.....W.D..6....|
+0006b910 0d 6b c7 31 21 8a 32 41 b2 40 06 c8 8a df 4b 44 |.k.1!.2A.@....KD|
+0006b920 a1 3a 65 29 e9 60 07 63 83 03 f8 9f cd 68 e6 5c |.:e).`.c.....h.\|
+0006b930 b3 4d ab f5 d6 71 07 60 b6 d0 e6 49 9e 12 61 25 |.M...q.`...I..a%|
+0006b940 d9 07 ac e5 2b 13 e2 56 33 5c 5a f3 3a 86 d3 16 |....+..V3\Z.:...|
+0006b950 a8 47 cb 91 f6 a2 45 eb db 65 15 93 8a 44 2d 9f |.G....E..e...D-.|
+0006b960 c5 22 d4 77 30 c8 e8 b2 dd 3a 7a 06 de 98 d7 66 |.".w0....:z....f|
+0006b970 c4 50 f4 96 32 f5 96 e4 e2 b5 1a 28 62 40 c3 4a |.P..2......(b@.J|
+0006b980 d0 2e 75 4e f2 bb 7d b1 cb f9 7d 94 e0 dc da 3e |..uN..}...}....>|
0006b990 d9 f2 78 2b f4 5e 10 84 ff 0f 14 92 c4 96 03 66 |..x+.^.........f|
0006b9a0 15 ed 21 38 46 b4 06 f8 c1 e3 90 b4 47 3c 7c ff |..!8F.......G<|.|
0006b9b0 61 e5 04 20 72 1a e2 1e c7 4e 01 d2 d1 14 35 63 |a.. r....N....5c|
--- _r.0.h 2009-01-28 04:16:47.000000000 +0000
+++ _r.4.h 2009-01-28 04:17:10.000000000 +0000
@@ -220065,15 +220065,15 @@
0035ba00 37 a2 34 91 86 cf d5 ba f3 c0 69 18 17 51 c2 99 |7.4.......i..Q..|
0035ba10 64 8c e6 e1 70 eb a5 bd 19 13 26 6e 12 d8 bf b2 |d...p.....&n....|
0035ba20 1d f3 51 12 af ad 01 0b d1 3e 32 4f d0 f7 41 59 |..Q......>2O..AY|
-0035ba30 ee 60 4a 2f 81 b9 ee ff 81 1a ef 0b a5 66 6a 6a |.`J/.........fjj|
-0035ba40 58 a3 2b b2 a2 75 38 ad 92 c7 1b ec f5 51 14 79 |X.+..u8......Q.y|
-0035ba50 14 5e b9 12 c2 b6 0f ff 20 47 ed 2e bb 56 2b f7 |.^...... G...V+.|
-0035ba60 ce 10 fa 79 46 88 ed f5 88 a8 9d 1b 1f ba 3c ff |...yF.........<.|
-0035ba70 5e 59 01 3e c7 69 0d ec e9 58 49 b7 df 12 4f 59 |^Y.>.i...XI...OY|
-0035ba80 f4 12 df 36 d3 fa 99 e9 3c 96 68 81 6e 31 64 60 |...6....<.h.n1d`|
-0035ba90 07 b3 21 c7 da d8 b3 1c 7c ca 12 e9 57 ed b4 f6 |..!.....|...W...|
-0035baa0 1f e5 5c 96 ae cf 48 37 97 5b c7 9a f1 93 0f b0 |..\...H7.[......|
-0035bab0 10 d6 eb 89 33 56 75 6d 17 fc b3 a1 79 62 4c bc |....3Vum....ybL.|
+0035ba30 ee 60 4a 2f 81 b9 ee ff 81 1a d1 88 fd 5f 7f 08 |.`J/........._..|
+0035ba40 c5 8e eb 07 00 b6 d4 de 92 e2 40 ab 9d 14 eb 84 |..........@.....|
+0035ba50 4f 46 e8 12 32 39 1a 85 8c bd 01 ac 49 c9 65 6b |OF..29......I.ek|
+0035ba60 7a 3e c0 1e ca 2d e8 82 7b cf 36 69 41 df f7 ed |z>...-..{.6iA...|
+0035ba70 c2 fe e1 43 09 01 c0 07 b8 13 01 65 57 bc eb c4 |...C.......eW...|
+0035ba80 af 40 dd bb 4e b4 ef 79 d5 fa e6 18 25 5a 9a 55 |.@..N..y....%Z.U|
+0035ba90 33 89 62 d2 88 43 5f c5 b1 e1 8a 6d da 8b 5f b8 |3.b..C_....m.._.|
+0035baa0 41 bf c0 f2 42 3f 0d b8 61 b6 16 6e e9 1b 6d eb |A...B?..a..n..m.|
+0035bab0 34 8f 31 d1 8b 35 52 91 9b 56 b3 a1 79 62 4c bc |4.1..5R..V..ybL.|
0035bac0 6d a0 49 d2 f9 dd f6 53 a1 6f 35 21 ee e8 03 88 |m.I....S.o5!....|
0035bad0 cf 88 71 79 7c 23 20 a9 a2 31 a0 77 44 f3 63 95 |..qy|# ..1.wD.c.|
0035bae0 da 3e b2 c0 7c c8 59 ed bb 05 2a 12 a1 a8 4b c0 |.>..|.Y...*...K.|
--
Dmitry Marakasov . 55B5 0596 FF1E 8D84 5F56 9510 D35A 80DD F9D2 F77D
amdmi3@amdmi3.ru ..: jabber: amdmi3@jabber.ru http://www.amdmi3.ru
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20090128042148.GA1256>