From owner-freebsd-stable@freebsd.org Wed Mar 10 10:07:19 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F23EB5AB854 for ; Wed, 10 Mar 2021 10:07:19 +0000 (UTC) (envelope-from mr.xanto@gmail.com) Received: from mail-lj1-x236.google.com (mail-lj1-x236.google.com [IPv6:2a00:1450:4864:20::236]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DwSRq1hQGz4pMF for ; Wed, 10 Mar 2021 10:07:19 +0000 (UTC) (envelope-from mr.xanto@gmail.com) Received: by mail-lj1-x236.google.com with SMTP id m11so24775133lji.10 for ; Wed, 10 Mar 2021 02:07:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:message-id:to:subject:mime-version :content-transfer-encoding; bh=qZF9b+l0NsbXG1P46PaLqwo4XHlWfuKmxW5hulvdq/0=; b=s76wfsvc373W4MUTjQkvgG5TVSy7TTZfbF0JmEbAORl16FZjkO6BU1MVbwLjdRNlqD t0hbf4UvoLQ4eIE84K0nAfpyKuNszXPtcO9P0SORw+W1IEXO1MIaTK0rQHa9EgK4HI2L eUeFEzEMnOerWFixQghQpkKaC8G4Oj5oQGOKmffE59X5uaTRB5FcrIVO+SQvJaBb3pX6 Fz4C1f+CPJl2fG6SnQsUPf4J/Rm7V1XZ5eIdyXi4B6dVueBfauTZOxhZKwjM3O0ZUUpn fLjOleRuAO3M1UaBd1B8OCotJYKMovCHl8g39STGPM/mBjzjqhflIc6QSR6OQwTTNlTK ucHw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:message-id:to:subject:mime-version :content-transfer-encoding; bh=qZF9b+l0NsbXG1P46PaLqwo4XHlWfuKmxW5hulvdq/0=; b=QFCKHkvWC+z/TwLj/6X9wtRr6chtsfdLyL+6bgMEjFs8Ov4kN4iTjqKXKM6LENR2wA lV7RhH/u5UMA+bsXknu4hmOgQa9sJuu8qOPrhfz+P2z31x6kZPqCbSo/uuymxYiHwccY wWzLofHzF8lrTUT9KTKAwXH7h3G6i95lY4NMSsRlA2DO9/WFlRYTI4ucMls8t4Ux5PmN VREnXJo5eENBdY3Jo2G/rHO0jj8eL+4HkAt8SJuQCHIUbKBC7hJGYJ83rKQ5UTv4/PfW zlLkp43sIDxw5VSFgRWjqZ90SryQJ+7TZl6glze4cHNv5lN+6+00dyCqoVu2rLzNPaP9 jSOw== X-Gm-Message-State: AOAM532gpPg1LRBELAzh6nWaRhIh3VQZG/R5I3jBV9x7bS4JgX/2sdSk hFacnFkG+tLqHm2RdaU2QZXxxzArdbI= X-Google-Smtp-Source: ABdhPJyDt16NPNxc9MYcxFSagJFk8wx3IkgIU6+cdkLhjCsTl34sU/ZDBhTv1OpbeAu7sMh63RVqjg== X-Received: by 2002:a2e:535a:: with SMTP id t26mr1317652ljd.503.1615370837072; Wed, 10 Mar 2021 02:07:17 -0800 (PST) Received: from [192.168.70.66] ([37.235.174.147]) by smtp.gmail.com with ESMTPSA id h24sm1263047ljg.77.2021.03.10.02.07.15 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 10 Mar 2021 02:07:16 -0800 (PST) Date: Wed, 10 Mar 2021 13:07:15 +0300 From: Mamontov Roman Message-ID: <1903978782.20210310130715@gmail.com> To: FreeBSD-STABLE Mailing List Subject: Troubles with netdump(4) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DwSRq1hQGz4pMF X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=s76wfsvc; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of mrxanto@gmail.com designates 2a00:1450:4864:20::236 as permitted sender) smtp.mailfrom=mrxanto@gmail.com X-Spamd-Result: default: False [-3.99 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RECEIVED_SPAMHAUS_PBL(0.00)[37.235.174.147:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[2a00:1450:4864:20::236:from]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.99)[-0.992]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[2a00:1450:4864:20::236:from:127.0.2.255]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::236:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Mar 2021 10:07:20 -0000 Hello. I try to use netdump(4) option for transmitting kernel dumps to a remote server. When I caused a kernel panic by sysctl debug.kdb.panic I found, that netdumping to remote server happens very slow: systat -ifstat on remote side show speed around 5KB/s. On netdump-client side I have: root@host-1:/home/roman # uname -mv FreeBSD 12.2-STABLE GENERIC amd64 root@host-1:/home/roman # root@host-1:/home/roman # dumpon -l em0 root@host-1:/home/roman # cat /etc/rc.local #!/bin/sh /sbin/dumpon -c 192.168.7.11 -s 192.168.7.12 em0 root@host-1:/home/roman # ifconfig em0 em0: flags=8943 metric 0 mtu 1500 options=81209b inet 192.168.7.11 netmask 0xffffff00 broadcast 192.168.7.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 root@solution:/home/roman # On netdumpd-side: root@host-2:/home/roman # uname -mv FreeBSD 12.2-STABLE GENERIC i386 root@host-2:/home/roman # ifconfig em0 em0: flags=8843 metric 0 mtu 1500 options=81209b inet 192.168.7.12 netmask 0xffffff00 broadcast 192.168.7.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 root@solution-old:/home/roman # Both (host-1 and host-2) have the same stable/12 revision: # cat /usr/src/.gituprevision stable/12:879039312 # When I try test network bandwith between host-1 and host-2 with iperf3, I see next results: root@host-1:/home/roman # iperf3 -u -b 0 -c 192.168.7.12 Connecting to host 192.168.7.12, port 5201 [ 5] local 192.168.7.11 port 37112 connected to 192.168.7.12 port 5201 [ ID] Interval Transfer Bitrate Total Datagrams [ 5] 0.00-1.00 sec 346 MBytes 2.90 Gbits/sec 248710 [ 5] 1.00-2.00 sec 345 MBytes 2.89 Gbits/sec 247750 [ 5] 2.00-3.00 sec 345 MBytes 2.90 Gbits/sec 247990 [ 5] 3.00-4.00 sec 331 MBytes 2.78 Gbits/sec 238020 [ 5] 4.00-5.00 sec 262 MBytes 2.20 Gbits/sec 188260 [ 5] 5.00-6.00 sec 345 MBytes 2.89 Gbits/sec 247560 [ 5] 6.00-7.00 sec 345 MBytes 2.89 Gbits/sec 247660 [ 5] 7.00-8.00 sec 345 MBytes 2.90 Gbits/sec 247980 [ 5] 8.00-9.00 sec 342 MBytes 2.87 Gbits/sec 245760 [ 5] 9.00-10.00 sec 344 MBytes 2.88 Gbits/sec 246830 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Jitter Lost/Total Datagrams [ 5] 0.00-10.00 sec 3.27 GBytes 2.81 Gbits/sec 0.000 ms 0/2406520 (0%) sender [ 5] 0.00-10.07 sec 0.00 Bytes 0.00 bits/sec 0.000 ms 0/0 (0%) receiver iperf Done. root@host-1:/home/roman # Capturing traffic between host-1 and host-2 not show anything criminal (as I understand). Next I try netdumping to another FreeBSD-host (virtual machine on VMWare hypervisor): root@host-3:~ # uname -mv FreeBSD 12.2-STABLE r369412 GENERIC amd64 root@host-3:~ # ifconfig em0 em0: flags=8843 metric 0 mtu 1500 options=81009b inet 192.168.7.18 netmask 0xffffff00 broadcast 192.168.7.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 root@host-3:~ # And netdumping to this host are still slow (~the same 5KB/s). Next step another FreeBSD-host (virtual machine on VirtualBox hypevisor): root@host-4:~ # uname -mv FreeBSD 12.2-STABLE r369412 GENERIC amd64 root@host-4:~ # ifconfig em0 em0: flags=8843 metric 0 mtu 1500 options=81009b inet 192.168.7.19 netmask 0xffffff00 broadcast 192.168.7.255 media: Ethernet autoselect (1000baseT ) status: active nd6 options=29 root@host-4:~ # Both (host-3 and host-4) are installed from FreeBSD-12.2-STABLE-amd64-20210304-r369412-bootonly.iso When I caused a kernel panic by sysctl debug.kdb.panic on host-4, netdumping to host-3 show the same 5 KB/s. Is there an particularity in netdump, that can't transmitting crash dumps over network faster than 5KB/s? Or this is a "feature" of my test-suite?