From owner-freebsd-fs@FreeBSD.ORG Mon Oct 11 20:39:51 2010 Return-Path: Delivered-To: fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 35A8B1065674 for ; Mon, 11 Oct 2010 20:39:51 +0000 (UTC) (envelope-from to.my.trociny@gmail.com) Received: from mail-fx0-f54.google.com (mail-fx0-f54.google.com [209.85.161.54]) by mx1.freebsd.org (Postfix) with ESMTP id B7E5D8FC0C for ; Mon, 11 Oct 2010 20:39:50 +0000 (UTC) Received: by fxm12 with SMTP id 12so1073797fxm.13 for ; Mon, 11 Oct 2010 13:39:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:cc:subject:references :x-comment-to:date:in-reply-to:message-id:user-agent:mime-version :content-type; bh=PBWwzfUI+/yH4DgjpjBLtGlStyTT+bjElnH4PFEdHbc=; b=U3RMHGr26d3HS/vFwIQJNsUOhm9nAfsOM89Mmv36tL70i359KedVE1dDSxZtLX/9oc Ds+uecMS/wSFTdZbPjz1dd7QRCP0wbJY+av4pSpIqea7dsrFXeDs08Zv+FFQ2o3Ogqcp taEtEWpLtga9xh+lAAG2s/8jugN/7eWU6kiz4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:cc:subject:references:x-comment-to:date:in-reply-to :message-id:user-agent:mime-version:content-type; b=cMCf0qMsNeVgF0Bzr4JeOrPfBnI1TzmLgPpoId2R8L/1PTd9vaXdeL0AKR4ZGucXoQ CPtQNvs+gnA/9vk2Bo2zuT87PNq1R8bPbkRuZwcYBLvaCkVXz3pK+40hF5N/vVWLg8gd UWYDjXwMnvNvucmP67qdfH1w3dZnOzGJWc1rY= Received: by 10.223.121.132 with SMTP id h4mr2143911far.2.1286827864557; Mon, 11 Oct 2010 13:11:04 -0700 (PDT) Received: from localhost ([95.69.174.185]) by mx.google.com with ESMTPS id k4sm2357651faa.32.2010.10.11.13.11.02 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 11 Oct 2010 13:11:03 -0700 (PDT) From: Mikolaj Golub To: "Michael W. Lucas" References: <20101011153051.GA15699@bewilderbeast.blackhelicopters.org> X-Comment-To: Michael W. Lucas Date: Mon, 11 Oct 2010 23:11:00 +0300 In-Reply-To: <20101011153051.GA15699@bewilderbeast.blackhelicopters.org> (Michael W. Lucas's message of "Mon, 11 Oct 2010 11:30:51 -0400") Message-ID: <868w24cwx7.fsf@kopusha.home.net> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.2 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: fs@freebsd.org Subject: Re: hast crash X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Oct 2010 20:39:51 -0000 On Mon, 11 Oct 2010 11:30:51 -0400 Michael W. Lucas wrote: MWL> Hi, MWL> I upgraded my HAST cluster to 8.1-stable on 6 October 2010, and am now MWL> experiencing crashes in hastd. hastd debug output is showing: MWL> ... MWL> [DEBUG][2] [mirror] (secondary) recv: (0x8013ecc40) Got request header: WRITE(11752701952, 131072). MWL> [DEBUG][2] [mirror] (secondary) recv: (0x8013ecc40) Moving request to the disk queue. MWL> [DEBUG][2] [mirror] (secondary) disk: (0x8013ecc40) Got request: WRITE(11752701952, 131072). MWL> [DEBUG][2] [mirror] (secondary) recv: Taking free request. MWL> [DEBUG][2] [mirror] (secondary) recv: (0x8013ecbf0) Got request. MWL> [ERROR] [mirror] (secondary) Unable to receive request header: RPC version wrong. MWL> [DEBUG][1] Unable to receive event header: Socket is not connected. MWL> [DEBUG][1] Accepting connection to tcp4://0.0.0.0:8457. MWL> [INFO] Connection from tcp4://192.168.0.1:21493 to tcp4://192.168.0.2:8457. MWL> [DEBUG][2] tcp4://192.168.0.1:21493: resource=mirror MWL> [DEBUG][1] [mirror] (secondary) Initial connection from tcp4://192.168.0.1:21493. MWL> [DEBUG][1] [mirror] (secondary) Worker process exists (pid=8826), stopping it. MWL> [ERROR] [mirror] (secondary) Worker process exited ungracefully (pid=8826, exitcode=75). MWL> Assertion failed: (conn != NULL), function proto_close, file /usr/src/sbin/hastd/proto.c, line 287. This assertion has been fixed in r213579. MWL> Abort (core dumped) MWL> Both machines are running on VMWare ESXi. The second machine is a MWL> clone of the first. MWL> Any thoughts, folks? I would recommend upgrading sbin/hastd to current or wait a couple of days for MFC :-). -- Mikolaj Golub