From owner-freebsd-net@freebsd.org Mon Aug 7 23:52:25 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 85AA4DD0EBB for ; Mon, 7 Aug 2017 23:52:25 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: from mail-wm0-x234.google.com (mail-wm0-x234.google.com [IPv6:2a00:1450:400c:c09::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 149C263F3D for ; Mon, 7 Aug 2017 23:52:25 +0000 (UTC) (envelope-from ben.rubson@gmail.com) Received: by mail-wm0-x234.google.com with SMTP id m85so18119268wma.1 for ; Mon, 07 Aug 2017 16:52:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=z0KqqKCrWcPSUeO68YJQRqdeaJgZc6x3wWjU734apkQ=; b=hul3Br/PFzM7elpZihZnSfqTxAiYUgJ8f1Rtdx/Qvg/x3pXyXdjfgJeYtW7pXD7x6m uBRFUb09OT+f4ZJs330NxfHwyRbw7eUBFFFkMYJAFAnPSRqAgZF2L0ca4sTlU6j0/i9j LOhote2+wv3RMsyyxntjCJqGGd+GPyj+wJWRzjGJt5ymDYMTEDjCZgwugpzpOQerJ+Ds 5ZxfGvNAoXkUiS9ZnmBOoG/ikzLj3b77f0ULqGfQ7Jud0PD2AtAcT+DjNAX5CJ0Q3jLM vMqQTTLmi61lqxyIgx4CF+8r5Fb+8AbCbLeVO/z0iX/S90QwObCAGoXNNGcSVkWRpgrh DiAQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:subject:from:in-reply-to:date :content-transfer-encoding:message-id:references:to; bh=z0KqqKCrWcPSUeO68YJQRqdeaJgZc6x3wWjU734apkQ=; b=U4uFv/ut9nHCMpty+hCJ+6uxobsjO6ui116J2dndTB7bhghkfptaLodWFaJeWdWt35 jwJW3JBi4YO+92j79u/+djoRfBhGdapaT8+f1A9jDSBiF7icYJmDtv1wz6roayJXQCAv E6PQm42MzgLs826zUEzgUXbNjL7DsdyHw4fgwf16LqSyI0QiId67ZAzLxlX6jR9c+neB EuDgysxhF9lS1fGTH6XfhA9TQG+NoS9wyW1gJXqdhBwGF6+UI2UiQ85RqFn1n9PMAUJ5 otYLyycNm4x0P/R5hJu9WZY33Y895zJcRIrdseXjDA5MeNBr2YUB1mbx1djxoVE5rag+ TUOA== X-Gm-Message-State: AHYfb5jxi2mjWqJQB3KXjBcv1lPO3FFd/8RGs4QtQo4jm98eiKxK8YV/ X5zFoIiR3cjmxRjarcs= X-Received: by 10.28.99.11 with SMTP id x11mr1470912wmb.164.1502149942548; Mon, 07 Aug 2017 16:52:22 -0700 (PDT) Received: from ben.home (LFbn-1-6951-179.w90-116.abo.wanadoo.fr. [90.116.132.179]) by smtp.gmail.com with ESMTPSA id e53sm20040053wrg.68.2017.08.07.16.52.21 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Mon, 07 Aug 2017 16:52:21 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: mlx4en, timer irq @100%... From: Ben RUBSON In-Reply-To: <7f14c95d-1ef8-bf82-c469-e6566c3aba66@selasky.org> Date: Tue, 8 Aug 2017 01:52:21 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <76A5EE7E-1D2E-46B4-86F1-F219C3DCE6EA@gmail.com> References: <72b9de84-5572-3737-b274-34d2c5cdf634@selasky.org> <91DCB96E-4C08-44C5-94E7-E7C686DEFE5F@gmail.com> <4DF74CB8-23D2-4CCF-B699-5B86DAEA65E5@gmail.com> <40602CEA-D417-4E5B-8C68-916958D49A0B@gmail.com> <9c306f10-7c05-d28d-e551-a930603aaafa@selasky.org> <896dd782-cb2c-0259-65d1-b00daae452de@FreeBSD.org> <0DB9F6FF-8BC9-48F5-B359-AC1905B9EB06@gmail.com> <7f14c95d-1ef8-bf82-c469-e6566c3aba66@selasky.org> To: FreeBSD Net X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Aug 2017 23:52:25 -0000 > On 07 Aug 2017, at 19:57, Hans Petter Selasky wrote: >=20 > On 08/07/17 19:19, Ben RUBSON wrote: >>> On 07 Aug 2017, at 18:19, Matt Joras wrote: >>>=20 >>> On 08/07/2017 09:11, Hans Petter Selasky wrote: >>>> Hi, >>>>=20 >>>> Try to enter "kgdb" and run: >>>>=20 >>>> thread apply all bt >>>>=20 >>>> Look for the callout function in question. >>>>=20 >>>> --HPS >>>>=20 >>> If you don't have a way to attach kgdb handy you could also break = into >>> ddb(4) and run "alltrace". Though gdb would be more useful for an >>> ongoing session if we need more than the backtrace since you could >>> switch to that thread and investigate it directly. >>>=20 >> Hi Hans & Matt, >> Thank you for your answers, glad to hear from you :) >> So here is the full kgdb(thread apply all bt) command log : >> https://benrubson.github.io/kgdb.log >> We found the faulty thread : >> # procstat -ak | grep "swi4.*tcp" >> 12 100029 intr swi4: clock (0) tcp_tw_2msl_scan = pfslowtimo softclock_call_cc softclock intr_event_execute_handlers = ithread_loop fork_exit fork_trampoline >> # kgdb >> (...) >> Thread 747 (Thread 100029): >> #0 sched_switch (td=3D0xfffff8000f337500, newtd=3D0xfffff8010e144000, = flags=3D) at /usr/src/sys/kern/sched_ule.c:1973 >> #1 0xfffffe1000f92d80 in ?? () >> #2 0xfffffe0f8f74b6e0 in ?? () >> #3 0xffffffff810bd274 in handleevents (now=3D, = fake=3DError accessing memory address 0xffffffffffffffcc: Bad address. >> ) at /usr/src/sys/kern/kern_clocksource.c:223 >> Previous frame inner to this frame (corrupt stack?) >> (...) >> Of course let me know if you need further info. >=20 > Can you try to dump "td": >=20 > set print pretty on > thread 747 > frame 0 > print *td >=20 > It might give some more clues. Here it is : https://benrubson.github.io/td.log Thx ! Ben