From owner-freebsd-net@freebsd.org Mon Aug 7 17:19:34 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 465DCDB7E70 for ; Mon, 7 Aug 2017 17:19:34 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wr0-x241.google.com (mail-wr0-x241.google.com [IPv6:2a00:1450:400c:c0c::241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CB5FF750D5; Mon, 7 Aug 2017 17:19:33 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wr0-x241.google.com with SMTP id y67so758569wrb.3; Mon, 07 Aug 2017 10:19:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=FRcVUsPV0/hQaeWj9voxiQOyY4und++ditfIUQm0Fzg=; b=arTcS+8UzUehWkejFzsUQe3xOY5mhx8O2ZP3eeRYB8GItTjeoE0t11A6fpl6qt2Bbn uZE4r7yBV5gXAniGHOv1FdE1KjvkzpsS3UjFk89aJsOHHBxsmNvKAvmuxtz2AShmqZWH 8nkv7J2dol7GCrQyPLrIGz9FzYhrpF0AtVhgfaY15vG+Nzf0M5Tiqw3L9MdMH3Cr0Ys5 b4braz6++WAXHRwUA0l1TTfRz/nI+dac7DaYxwoRlc1A9KMZai4jLZdaN6Oj2fMmCp+m vXUXvu4Vpov6UsDy37yteXEQHUCcx3L7KoKZw5MHXs7Py8jPNCHeSuORi5yHOTkJuaYL Gi2g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=FRcVUsPV0/hQaeWj9voxiQOyY4und++ditfIUQm0Fzg=; b=DSATewkN0pqal6ytYuHn1+gT0zhRYy60jIaB8bm92w3v69S8jVpz6oG0stq87GvnZa N3xQFR91S15FYkjJwoCrc8VgIe8KDdfYbwpMvVp0eguaCMpzbuPvP7dbYgykRCJ2aBBL hdVaLHEHcxGLo4hLWWaXh68ZV0anC6Oxoh2N+zA3abyPMpdW7Wox8BS+oXYmnfQuPXWq lNYdBwgcS2PZ/9FEqqSW3VghWMfPfHq3Yeo19wPra/tzPY2K1NZ58vLc5brLlJvt+s1O Bmo0Nrj/xohDdTCSd7A+tpEquRL9X2NU+M0Ie1QxwkB3O3D9yrrMuZFSF7kMgPNoUr7F +SKg== X-Gm-Message-State: AHYfb5iWXrva9LVev1ELR5apk62gkVO42T/KlJEks1MvL3pICQrNi+2j kONPK/fqAytKXYhCCNU= X-Received: by 10.223.134.39 with SMTP id 36mr955086wrv.244.1502126372146; Mon, 07 Aug 2017 10:19:32 -0700 (PDT) Received: from ben.home (LFbn-1-6951-179.w90-116.abo.wanadoo.fr. [90.116.132.179]) by smtp.gmail.com with ESMTPSA id d10sm11619704wmh.4.2017.08.07.10.19.30 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Mon, 07 Aug 2017 10:19:31 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: mlx4en, timer irq @100%... From: Ben RUBSON In-Reply-To: <896dd782-cb2c-0259-65d1-b00daae452de@FreeBSD.org> Date: Mon, 7 Aug 2017 19:19:29 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <0DB9F6FF-8BC9-48F5-B359-AC1905B9EB06@gmail.com> References: <72b9de84-5572-3737-b274-34d2c5cdf634@selasky.org> <91DCB96E-4C08-44C5-94E7-E7C686DEFE5F@gmail.com> <4DF74CB8-23D2-4CCF-B699-5B86DAEA65E5@gmail.com> <40602CEA-D417-4E5B-8C68-916958D49A0B@gmail.com> <9c306f10-7c05-d28d-e551-a930603aaafa@selasky.org> <896dd782-cb2c-0259-65d1-b00daae452de@FreeBSD.org> To: FreeBSD Net X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Aug 2017 17:19:34 -0000 > On 07 Aug 2017, at 18:19, Matt Joras wrote: >=20 > On 08/07/2017 09:11, Hans Petter Selasky wrote: >> Hi, >>=20 >> Try to enter "kgdb" and run: >>=20 >> thread apply all bt >>=20 >> Look for the callout function in question. >>=20 >> --HPS >>=20 > If you don't have a way to attach kgdb handy you could also break into > ddb(4) and run "alltrace". Though gdb would be more useful for an > ongoing session if we need more than the backtrace since you could > switch to that thread and investigate it directly. >=20 Hi Hans & Matt, Thank you for your answers, glad to hear from you :) So here is the full kgdb(thread apply all bt) command log : https://benrubson.github.io/kgdb.log We found the faulty thread : # procstat -ak | grep "swi4.*tcp" 12 100029 intr swi4: clock (0) tcp_tw_2msl_scan = pfslowtimo softclock_call_cc softclock intr_event_execute_handlers = ithread_loop fork_exit fork_trampoline=20 # kgdb (...) Thread 747 (Thread 100029): #0 sched_switch (td=3D0xfffff8000f337500, newtd=3D0xfffff8010e144000, = flags=3D) at /usr/src/sys/kern/sched_ule.c:1973 #1 0xfffffe1000f92d80 in ?? () #2 0xfffffe0f8f74b6e0 in ?? () #3 0xffffffff810bd274 in handleevents (now=3D, = fake=3DError accessing memory address 0xffffffffffffffcc: Bad address. ) at /usr/src/sys/kern/kern_clocksource.c:223 Previous frame inner to this frame (corrupt stack?) (...) Of course let me know if you need further info. Thank you again, Ben