From owner-freebsd-arm@FreeBSD.ORG  Tue Aug 20 15:13:17 2013
Return-Path: <owner-freebsd-arm@FreeBSD.ORG>
Delivered-To: arm@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTP id 593614EF;
 Tue, 20 Aug 2013 15:13:17 +0000 (UTC) (envelope-from db@db.net)
Received: from diana.db.net (unknown [IPv6:2620:64:0:1:223:7dff:fea2:c8f2])
 by mx1.freebsd.org (Postfix) with ESMTP id 41D5826B2;
 Tue, 20 Aug 2013 15:13:17 +0000 (UTC)
Received: from night.db.net (localhost [127.0.0.1])
 by diana.db.net (Postfix) with ESMTP id CFA502AA443;
 Tue, 20 Aug 2013 09:13:14 -0600 (MDT)
Received: by night.db.net (Postfix, from userid 1000)
 id 2D5C81CC20; Tue, 20 Aug 2013 10:13:02 -0500 (EST)
Date: Tue, 20 Aug 2013 10:13:02 -0500
From: Diane Bruce <db@db.net>
To: Ganbold Tsagaankhuu <ganbold@gmail.com>
Subject: Re: SSHD crash
Message-ID: <20130820151302.GA98234@night.db.net>
References: <B2BC1D2F-A270-4E37-AF0D-DABF7097F726@freebsd.org>
 <CAGtf9xPvxVKK=J-iNNNUNzQ67TV2TwiLu_Xg2podsQNSFBBLdA@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <CAGtf9xPvxVKK=J-iNNNUNzQ67TV2TwiLu_Xg2podsQNSFBBLdA@mail.gmail.com>
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: "freebsd-arm@freebsd.org" <arm@freebsd.org>
X-BeenThere: freebsd-arm@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Porting FreeBSD to the StrongARM Processor <freebsd-arm.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-arm>,
 <mailto:freebsd-arm-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-arm>
List-Post: <mailto:freebsd-arm@freebsd.org>
List-Help: <mailto:freebsd-arm-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-arm>,
 <mailto:freebsd-arm-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Aug 2013 15:13:17 -0000

On Tue, Jul 23, 2013 at 01:13:58PM +0800, Ganbold Tsagaankhuu wrote:
> On Tue, Jul 23, 2013 at 12:48 PM, Tim Kientzle <kientzle@freebsd.org> wrote:
> 
> > Hope to find time to dig into this later this week, but am seeing
> > a pretty consistent crash in sshd on BeagleBone Black with armv6:
> >
> > $ sshd -d
> > ?. connect from another machine ...
> > ?. usual connection messages, then ...
> > debug1: Local version string SSH-2.0-OpenSSH_6.2 FreeBSD-20130515
> > debug1: permanently_set_uid: 22/22 [preauth]
> > debug1: list_hostkey_types: ssh-rsa,ssh-dss,ecdsa-sha2-nistp256 [preauth]
> > debug1: SSH2_MSG_KEXINIT sent [preauth]
> > debug1: SSH2_MSG_KEXINIT received [preauth]
> > <jemalloc>: jemalloc_arena.c:380: Failed assertion: "p[i] == 0"
> >
> 
> If I'm not mistaken I've seen this recently on mips board(Routerstation
> Pro) too.
> 
> Ganbold


I've continued to poke at this.

My suspicion is this commit.

http://svnweb.freebsd.org/base?view=revision&revision=250991

The failing gdb is using jemalloc, the older revisions are using
our older malloc code. I can confirm this using gdb.

I note that sshd does not fail with ElectricFence malloc as well.

I've suggested the possibility that it is a weird locking error.
Tim and Ian also suggest memory layout problem but I think that's
now less likely.

Ian reports arm6 locking is much simpler than arm4 
Ian also reports sshd works fine with arm4 board he has.
If it is also confirmed there is a problem on mips,
I'd sure love to hear about it.

>From IRC
<cognet> it works fine with my pandaboard, with a world from 07/31

<DamnHippi> I've only tried rpi, bbw, and dreamplug

<ganbold_> db_: I noticed only once or so in routerstation pro, then didn't
+pay much attention to it

> 
> 
> >
> > This is with SVN r253514
> >
> > Completely standard build except for the vm_map.c patch.
> >
> > Tim
> >
> >

- Diane
-- 
- db@FreeBSD.org db@db.net http://www.db.net/~db