From owner-freebsd-stable@FreeBSD.ORG Mon Feb 7 07:50:43 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DC4E6106566B for ; Mon, 7 Feb 2011 07:50:43 +0000 (UTC) (envelope-from greg@bonett.org) Received: from bonett.org (bonett.org [66.249.7.150]) by mx1.freebsd.org (Postfix) with ESMTP id 944928FC15 for ; Mon, 7 Feb 2011 07:50:43 +0000 (UTC) Received: from [192.168.1.216] (unknown [76.91.19.169]) by bonett.org (Postfix) with ESMTPSA id 202F0124367; Mon, 7 Feb 2011 07:50:42 +0000 (UTC) From: Greg Bonett To: Jeremy Chadwick In-Reply-To: <20110207045501.GA15568@icarus.home.lan> References: <1297026074.23922.8.camel@ubuntu> <20110207045501.GA15568@icarus.home.lan> Content-Type: text/plain; charset="UTF-8" Date: Sun, 06 Feb 2011 23:50:41 -0800 Message-ID: <1297065041.754.12.camel@ubuntu> Mime-Version: 1.0 X-Mailer: Evolution 2.30.3 Content-Transfer-Encoding: 7bit Cc: freebsd-stable Subject: Re: 8.1 amd64 lockup (maybe zfs or disk related) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Feb 2011 07:50:43 -0000 Thanks for the response. I have no tunings in /boot/loader.conf according to http://wiki.freebsd.org/ZFSTuningGuide for amd64 "FreeBSD 7.2+ has improved kernel memory allocation strategy and no tuning may be necessary on systems with more than 2 GB of RAM. " I have 8GB of ram. do you think this is wrong? Handbook recommends these (but says their test system has 1gb ram): vm.kmem_size="330M" vm.kmem_size_max="330M" vfs.zfs.arc_max="40M" vfs.zfs.vdev.cache.size="5M" what do you recommend? I think the ad0: FAILURE - READ_DMA4 errors may be from a bad sata cable (or rather, a 12in sata cable connecting a drive that is one inch away) I'm ordering a new drive bay to improve this, but should a bad cable cause lockups? Thanks for your help. Here's my smartctl output: #smartctl -a /dev/ad0 smartctl 5.40 2010-10-16 r3189 [FreeBSD 8.1-RELEASE amd64] (local build) Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net === START OF INFORMATION SECTION === Model Family: Western Digital Caviar Green (Adv. Format) family Device Model: WDC WD10EARS-00Y5B1 Serial Number: WD-WCAV55616522 Firmware Version: 80.00A80 User Capacity: 1,000,204,886,016 bytes Device is: In smartctl database [for details use: -P show] ATA Version is: 8 ATA Standard is: Exact ATA specification draft version not indicated Local Time is: Sun Feb 6 23:42:17 2011 PST SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x84) Offline data collection activity was suspended by an interrupting command from host. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: (20460) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 2) minutes. Extended self-test routine recommended polling time: ( 236) minutes. Conveyance self-test routine recommended polling time: ( 5) minutes. SCT capabilities: (0x3031) SCT Status supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 16 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0 3 Spin_Up_Time 0x0027 121 121 021 Pre-fail Always - 6933 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 30 5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0 7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0 9 Power_On_Hours 0x0032 097 097 000 Old_age Always - 2664 10 Spin_Retry_Count 0x0032 100 253 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 28 192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 27 193 Load_Cycle_Count 0x0032 135 135 000 Old_age Always - 196151 194 Temperature_Celsius 0x0022 125 114 000 Old_age Always - 22 196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0 197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0 200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed without error 00% 1536 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay. On Sun, 2011-02-06 at 20:55 -0800, Jeremy Chadwick wrote: > On Sun, Feb 06, 2011 at 01:01:14PM -0800, Greg Bonett wrote: > > Hi all, > > I am experiencing hard lockup when running 8.1-RELEASE amd64. The last > > two times it has happened I was running a zpool scrub (high cpu and io > > load). /var/log/messages has some errors looking like: > > kernel: ad0: FAILURE - READ_DMA4 > > > > but these didn't seem to correspond to the exact time of the lockup. > > > > any suggestions? > > Given that you're running 8.1-RELEASE, what sort of ZFS tunings are you > using in /boot/loader.conf? Tuning is required on this version. > > The ad0 READ_DMA48 errors could indicate you have a hard disk with bad > blocks or is going bad in a different manner. Please install > ports/sysutils/smartmontools and provide output of "smartctl -a > /dev/ad0" here and I can help you determine that. >