Date: Tue, 21 Feb 2006 00:04:58 +0300 From: Anton Nikiforov <anton@nikiforov.ru> To: Bakul Shah <bakul@BitBlocks.com> Cc: freebsd-hardware@freebsd.org Subject: Re: LSI Trouble Message-ID: <43FA2EFA.9020603@nikiforov.ru> In-Reply-To: <200602172246.k1HMklUs034116@gate.bitblocks.com> References: <200602172246.k1HMklUs034116@gate.bitblocks.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format. --------------ms010901040902060804090308 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Bakul Shah wrote: > And TELL US WHAT WORKED (just on freebsd-hardware)! That is > your punishment for duplicate posting. Hello all Here we go, a report of getting my disks back alive :) The situation: Server got down and cannot startup claiming that NVRAM configuration differ with DISK configuration of LSI logic RAID controller and it cannot resolve it. There was no way to vew configuration on this computer, so i moved disk to another system with the same controller type. Trying to use controller's software i have found out that NVRAM contain some strange config while disks contain NO CONFIG at all. The solution steps 1. I did reconnect disks to the plain Adpatec SCSI controller. 2. After a while i have found out that disks that contaon clear FreeBSD partitions. 3. I have made dd backup of all disks. That takes a long time, and i have found out that 3 out of 6 disks cannot sync transfer at 320MBPS, but only 80. 4. After backing everything I mounted disks into /mnt and found out that disks that were RAID1 are just fine and i can acess the data with no problem. 5. RAID 5 disks contain some strange (strange for me) info - 2 140GB disks contain partition of 280GB and the third disk of this RAID5 set - only 14MB!!! FreeBSD partition and some other data. As far as i know RAID5 algorythm this is impossible - i should have 3 disks with some data, maybe even with partitions, viewable with FreeBSD fdisk. This two disks looks exactly like software RAID0. And the third one may contain parity (it contain no data that should looks like a data, i was trying to analyze it), so this will be not a RAID5 set, but RAID4 (it is strange - controller does not support RAID4 ;) ). 6. Then i have configured RAID sets exactly like it was, conntcted my data disks and was trying to boot. But controller starts to claim on disks wit ID 1,3 and 5 that they are not present in the system. And spinup time was about 20 minutes. In addition controller clamed "There is no LSI controller on the system"!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! 7. Analyzing how leds are blinking i have found out that disk with ID4 have a delay and it's led was lighting more than other's. 8. I removed this disk and the controller starts to boot with no claims. In addition it rebuilds the RAID5 set on the Hot Spare disk. Resume: 1. Looks like the block size of the RAID affect only cache and other system characteristics, but not data itself (in case i'm right with RAID5-RAID4. Otherwise i cannot understand why Strip size is available for RAID1 where it has no sence) 2. Looks like this controller claims that it is suport RAID5 while it is only RAID4. 3. While one disk become broken (and please note, that i made a backup of this disk with no problem on the different controller). the controller could claim anything! that other disks broken, that there is no controller or whatever it can claim :) So do not belive the controller messages :) This was checked on two systems with 3 controllers and the result was the same - while LSIs were claiming - Adaptec just saw disks and data. ToDo: Analyze RAID5 sets from LSI and, maybe (because i'm not a great C coder) make some tool to get data from broken RAID sets. Best regards, Anton Nikiforov --------------ms010901040902060804090308 Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIGKDCC AuEwggJKoAMCAQICAw6AYzANBgkqhkiG9w0BAQQFADBiMQswCQYDVQQGEwJaQTElMCMGA1UE ChMcVGhhd3RlIENvbnN1bHRpbmcgKFB0eSkgTHRkLjEsMCoGA1UEAxMjVGhhd3RlIFBlcnNv bmFsIEZyZWVtYWlsIElzc3VpbmcgQ0EwHhcNMDUwNDE2MTEwMzExWhcNMDYwNDE2MTEwMzEx WjBEMR8wHQYDVQQDExZUaGF3dGUgRnJlZW1haWwgTWVtYmVyMSEwHwYJKoZIhvcNAQkBFhJh bnRvbkBuaWtpZm9yb3YucnUwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDp45jI HORB4RVcbIIDMttb19fW9gb9dIX4CVBbCZSPmX+gpsYUCswB/wcqnF98LoSTIYxiY/hUrENH 5lObA+oEazWWmZQR5MQIgZViQ3H7vJ1KpaQ8tR7atUsCMudFb9Wu4jYgvFbjhYLO0cOFOfhr n99ucG5qpsXwriIbDYLT20xFvsbCk/zlMwPsIfxell+EM87MglUH5uym8LtcWVvfZgzYuNN0 1lJXF4Qs17X3y3XELuuRowdQGZQ6nNM2StTePuOL6J3piVERqhscLIpM9rjfH6nV8HM1+BW3 trgt5rWqzSfFlvxk6MF6cvz06xnE6Yw4FV63lrRzaiwm914/AgMBAAGjPzA9MA4GA1UdDwEB /wQEAwIHgDAdBgNVHREEFjAUgRJhbnRvbkBuaWtpZm9yb3YucnUwDAYDVR0TAQH/BAIwADAN BgkqhkiG9w0BAQQFAAOBgQASvk2h3CLH4S3NOw9yRfEdpHruWxov2mQvsV8qZKwjG8/661ze FmsQhAS18+6hCgK84qNrCINydH06Y5jsAGmwS8r9m+xOPxDKiehmOSsOpSVShzIfWdRx5Ni1 uFvPwH9L6czsOlw0PAQnYEv0jVbel6SA5MUWHwJ8liIGxkhi3jCCAz8wggKooAMCAQICAQ0w DQYJKoZIhvcNAQEFBQAwgdExCzAJBgNVBAYTAlpBMRUwEwYDVQQIEwxXZXN0ZXJuIENhcGUx EjAQBgNVBAcTCUNhcGUgVG93bjEaMBgGA1UEChMRVGhhd3RlIENvbnN1bHRpbmcxKDAmBgNV BAsTH0NlcnRpZmljYXRpb24gU2VydmljZXMgRGl2aXNpb24xJDAiBgNVBAMTG1RoYXd0ZSBQ ZXJzb25hbCBGcmVlbWFpbCBDQTErMCkGCSqGSIb3DQEJARYccGVyc29uYWwtZnJlZW1haWxA dGhhd3RlLmNvbTAeFw0wMzA3MTcwMDAwMDBaFw0xMzA3MTYyMzU5NTlaMGIxCzAJBgNVBAYT AlpBMSUwIwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNU aGF3dGUgUGVyc29uYWwgRnJlZW1haWwgSXNzdWluZyBDQTCBnzANBgkqhkiG9w0BAQEFAAOB jQAwgYkCgYEAxKY8VXNV+065yplaHmjAdQRwnd/p/6Me7L3N9VvyGna9fww6YfK/Uc4B1OVQ CjDXAmNaLIkVcI7dyfArhVqqP3FWy688Cwfn8R+RNiQqE88r1fOCdz0Dviv+uxg+B79AgAJk 16emu59l0cUqVIUPSAR/p7bRPGEEQB5kGXJgt/sCAwEAAaOBlDCBkTASBgNVHRMBAf8ECDAG AQH/AgEAMEMGA1UdHwQ8MDowOKA2oDSGMmh0dHA6Ly9jcmwudGhhd3RlLmNvbS9UaGF3dGVQ ZXJzb25hbEZyZWVtYWlsQ0EuY3JsMAsGA1UdDwQEAwIBBjApBgNVHREEIjAgpB4wHDEaMBgG A1UEAxMRUHJpdmF0ZUxhYmVsMi0xMzgwDQYJKoZIhvcNAQEFBQADgYEASIzRUIPqCy7MDaNm rGcPf6+svsIXoUOWlJ1/TCG4+DYfqi2fNi/A9BxQIJNwPP2t4WFiw9k6GX6EsZkbAMUaC4J0 niVQlGLH2ydxVyWN3amcOY6MIE9lX5Xa9/eH1sYITq726jTlEBpbNU1341YheILcIRk13iSx 0x1G/11fZU8xggJEMIICQAIBATBpMGIxCzAJBgNVBAYTAlpBMSUwIwYDVQQKExxUaGF3dGUg Q29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29uYWwgRnJlZW1h aWwgSXNzdWluZyBDQQIDDoBjMAkGBSsOAwIaBQCggbEwGAYJKoZIhvcNAQkDMQsGCSqGSIb3 DQEHATAcBgkqhkiG9w0BCQUxDxcNMDYwMjIwMjEwNDU4WjAjBgkqhkiG9w0BCQQxFgQUVZhI OxWFh+WXfFY73GDR/I9HAxEwUgYJKoZIhvcNAQkPMUUwQzAKBggqhkiG9w0DBzAOBggqhkiG 9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgwDQYJKoZI hvcNAQEBBQAEggEAJVymxMPzyWlwWvhh6agE8CDrNWBzIku+1zniee4n8FtucXFcFJcO5gWF pHq43Q+cMkwDJIkWv+/y1pXo6Pna0rXyNMRlXgMMDXymo2j+P45mITFiaNrG4Dhh8P17uyzY filwoBp6x/hH03nmHGsvjGWxhKpXV4DXg4Blz548Rd2pCdS0kPeZ43btPudmTyrw9oWIC9lf U/Jb7B/hgskvrFQzGeZ0+tB+4p6eaXVAK21YL+vCp6c4kKhr5k18h03j1cmt9KXPlEn67Wp0 7bABZgMgJzww22yvTPhwLd9uX7pc2RALisHy+wHH62zbckfgk3PKYR0d2Z9ksaau1WxOjAAA AAAAAA== --------------ms010901040902060804090308--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?43FA2EFA.9020603>