From owner-freebsd-net@freebsd.org Sun Sep 6 21:00:27 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 16C453DD8C5 for ; Sun, 6 Sep 2020 21:00:27 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bl3hp5TdGz4Sm1 for ; Sun, 6 Sep 2020 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id BC0763DD922; Sun, 6 Sep 2020 21:00:26 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BBC1F3DD987 for ; Sun, 6 Sep 2020 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bl3hp408Sz4Sxc for ; Sun, 6 Sep 2020 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 69B9E1492D for ; Sun, 6 Sep 2020 21:00:26 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 086L0Qpl022147 for ; Sun, 6 Sep 2020 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 086L0Qjo022146 for net@FreeBSD.org; Sun, 6 Sep 2020 21:00:26 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202009062100.086L0Qjo022146@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: net@FreeBSD.org Subject: Problem reports for net@FreeBSD.org that need special attention Date: Sun, 6 Sep 2020 21:00:26 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Sep 2020 21:00:27 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 221146 | [ixgbe] Problem with second laggport In Progress | 235700 | oce(4) driver causes fatal trap 12 on boot with e New | 204438 | setsockopt() handling of kern.ipc.maxsockbuf limi New | 213410 | [carp] service netif restart causes hang only whe Open | 7556 | ppp: sl_compress_init() will fail if called anyth Open | 187835 | ngctl(8) strange behavior when adding more than 5 Open | 193452 | Dell PowerEdge 210 II -- Kernel panic bce (broadc Open | 194453 | dummynet(4): pipe config bw parameter limited to Open | 200319 | Bridge+CARP crashes/freezes Open | 202510 | [CARP] advertisements sourced from CARP IP cause Open | 207261 | netmap: Doesn't do TX sync with kqueue Open | 217978 | dhclient: Support supersede statement for option Open | 222273 | igb(4): Kernel panic (fatal trap 12) due to netwo Open | 225438 | panic in6_unlink_ifa() due to race Open | 227720 | Kernel panic in ppp server Open | 230807 | if_alc(4): Driver not working for Killer Networki Open | 235524 | igb(4): Ethernet interface loses active link stat Open | 236888 | ppp daemon: Allow MTU to be overridden for PPPoE Open | 236983 | bnxt(4) VLAN not operational unless explicit "ifc Open | 237072 | netgraph(4): performance issue [on HardenedBSD]? Open | 237840 | Removed dummynet dependency on ipfw Open | 238324 | Add XG-C100C/AQtion AQC107 10GbE NIC driver Open | 240530 | netgraph/ng_source: Allow ng_source to inject int Open | 240944 | em(4): Crash with Intel 82571EB NIC with AMD Pile Open | 240969 | netinet6: Neighbour reachability detection broken Open | 241106 | tun/ppp: panic: vm_fault: fault on nofault entry Open | 241162 | Panic in closefp() triggered by nginx (uwsgi with Open | 243463 | ix0: Watchdog timeout Open | 244066 | divert: Add sysctls for divert socket send and re Open | 244706 | panic: NULL dereference inside __mtx_lock_sleep() Open | 118111 | rc: network.subr Add MAC address based interface 31 problems total for which you should take action. From owner-freebsd-net@freebsd.org Mon Sep 7 13:38:54 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5512C3C9E9A for ; Mon, 7 Sep 2020 13:38:54 +0000 (UTC) (envelope-from intui-quicksupport@firstkldme.com) Received: from rdns0.firstkldme.com (hwsrv-773798.hostwindsdns.com [104.168.190.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BlTrs5n1lz46N1 for ; Mon, 7 Sep 2020 13:38:53 +0000 (UTC) (envelope-from intui-quicksupport@firstkldme.com) From: Intuit To: freebsd-net@freebsd.org Subject: Your New Intuit Account Date: 07 Sep 2020 06:38:43 -0700 Message-ID: <20200907063843.68412ED99AC82200@firstkldme.com> X-Rspamd-Queue-Id: 4BlTrs5n1lz46N1 X-Spamd-Bar: ++++++ X-Spamd-Result: default: False [6.08 / 15.00]; ARC_NA(0.00)[]; R_DKIM_ALLOW(0.00)[firstkldme.com:s=default]; FROM_HAS_DN(0.00)[]; HFILTER_HOSTNAME_2(1.00)[hwsrv-773798.hostwindsdns.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(0.00)[+mx]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_MEDIUM(1.04)[1.036]; RCPT_COUNT_ONE(0.00)[1]; BAD_REP_POLICIES(0.10)[]; RBL_VIRUSFREE_BOTNET(2.00)[104.168.190.35:from]; NEURAL_SPAM_SHORT(0.73)[0.732]; DKIM_TRACE(0.00)[firstkldme.com:+]; DMARC_POLICY_ALLOW(0.00)[firstkldme.com,reject]; NEURAL_SPAM_LONG(1.02)[1.016]; MIME_HTML_ONLY(0.20)[]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:~]; ASN(0.00)[asn:54290, ipnet:104.168.128.0/17, country:US]; MID_RHS_MATCH_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-Spam: Yes MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Sep 2020 13:38:54 -0000 From owner-freebsd-net@freebsd.org Mon Sep 7 17:39:50 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9B35D3D0C4B for ; Mon, 7 Sep 2020 17:39:50 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: from mail-ot1-x32d.google.com (mail-ot1-x32d.google.com [IPv6:2607:f8b0:4864:20::32d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BlbBs4rshz4Rx7 for ; Mon, 7 Sep 2020 17:39:49 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: by mail-ot1-x32d.google.com with SMTP id e23so12827412otk.7 for ; Mon, 07 Sep 2020 10:39:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=mn5BLO01mkHmV6z9VYSsjvBp4E6tfbAX8RjEeFsBsrI=; b=rSOud1MGbDf1urUO06QDMsUNc+vcPtYDjd4cQbvGEWOIFjAl2V9E6fH3ZScjet2wol ewGCy/ODHXODqK+d8QddmUKKpCcw/WIr9TucaL3euas9qwSBNAtOzSsLiMjxecmdc8UD I8dqH/gFgdTyP79Dh1WVncYZOSkPmZBKwYn4f2/P/D6TT3VyAheRan/0OyLQjSN8wDsM U8a7BtfrN5pZ0Y+xM3i4OrnzShsm2ei4rF4u2SVp8PrkC9C0+DWAjPMruamvyLaozeuL 9C8hS2hgTiTXbR8EqfJURTtiJ1Ub7NXCp/7WIInbJbGu3A9VO/Kz5Zu+pX9CZvqDf7tP dNdA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=mn5BLO01mkHmV6z9VYSsjvBp4E6tfbAX8RjEeFsBsrI=; b=MVV3TesVAPQXjAb5CsTWEgXKPzopHRrbL0/qi2lSvJPsBOMyLJzmSDykJFe3uaMXpE lZ0q30KX/CJX1fa0Rg9VDRXwBTZlx0iNDqqSPtH3PApc1t7ftZgsNg9mDQwbRkfzho1F QMHPeh6fL/TShItOcEGFvel0LGj0wVU/GWDIrBoqXz+r1sOMNbsxGLd7aXJ8YByqm8EU AzONP57Hf5z3kJ+Pkl8RIraGtXYGCfPm0KfVotLiWlbwjD4IRJVP0MtBXSwjHKjlDdFW qevw48prb9VHzx1HLBakuIn8e/ynW2z/rsc85YTHZSd8MJdLHSTWrJ1tlqQMWxPGg18d npvQ== X-Gm-Message-State: AOAM533H0nWpKcneHEG26Fr+8svdIa1lVgbjmbUDPAa/dkWHXGTSuDwi TnEmVYquMDiPhmaxhqYzSs3t3teQp6LY7CBtwGrb91O6Nx4= X-Google-Smtp-Source: ABdhPJzO+EREx0lPE4UvTABZc8EcOnO9m3OMFEG3BNRBGAepN08f2sAxZpxm8ruXwjkQuxGIEjSH66UTo7D2RO+aU78= X-Received: by 2002:a05:6830:1e0a:: with SMTP id s10mr14198555otr.95.1599500387985; Mon, 07 Sep 2020 10:39:47 -0700 (PDT) MIME-Version: 1.0 From: Rajesh Kumar Date: Mon, 7 Sep 2020 23:09:36 +0530 Message-ID: Subject: 10G Network interface not reaching wire speed on Receive path with single thread iperf run To: freebsd-net@freebsd.org X-Rspamd-Queue-Id: 4BlbBs4rshz4Rx7 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=rSOud1MG; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rajfbsd@gmail.com designates 2607:f8b0:4864:20::32d as permitted sender) smtp.mailfrom=rajfbsd@gmail.com X-Spamd-Result: default: False [-3.27 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.948]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.05)[-1.047]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::32d:from]; NEURAL_HAM_SHORT(-0.27)[-0.274]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Sep 2020 17:39:50 -0000 Hi FreeBSD team, I am writing a network driver using the iflib framework and using the "iperf" tool for performance testing. 1) 10G link with 9000 MTU: Seeing line-rate numbers on both Tx and Rx path. 2) 10G link with 1500 MTU. Seeing line-rate numbers on Tx path, but low numbers on Rx path. Base issue seems to be that Rx buffers are not getting re-filled fast enough. With low thread count, I see higher CPU utilization and lower throughput. But with a higher number of threads, I could see better throughput and lesser cpu utilization. iperf with 1 Thread: CPU Utilization is 80% - 95% - Throughput is ~4Gbps. iperf with 2 Thread: CPU Utilization is 80% - 90% - Throughput is ~7.5Gbps. iperf with 4 Thread: CPU Utilization is 40% - 75% - Throughput is ~9Gbps. iperf with 8 Thread: CPU Utilization is 30% - 70% - Throughput is ~9.2Gbps. So, something is causing CPU utilization higher with lesser thread, which kind of leads to Rx buffers not getting filled up faster and hence the performance numbers drop. From a code perspective, I couldn't see any evident CPU consuming operations in the Rx path. It's plain hardware descriptors reading/processing. Anyway we can debug to find what is causing more CPU utilization (with lesser threads) in my case? Any clues on debugging this issue? Thanks, Rajesh. From owner-freebsd-net@freebsd.org Mon Sep 7 20:48:42 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5EB043D64DE for ; Mon, 7 Sep 2020 20:48:42 +0000 (UTC) (envelope-from SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info) Received: from mail.sermon-archive.info (sermon-archive.info [71.177.216.148]) by mx1.freebsd.org (Postfix) with ESMTP id 4BlgNn2DJ4z3T0W for ; Mon, 7 Sep 2020 20:48:41 +0000 (UTC) (envelope-from SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info) Received: from [10.0.1.251] (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4BlgNd5w2Sz2fjQV for ; Mon, 7 Sep 2020 13:48:33 -0700 (PDT) From: Doug Hardie Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.15\)) Subject: Address Differences between UDP and SCTP Message-Id: <6A9D0A4B-F35C-4012-A868-5450D60EC13B@mail.sermon-archive.info> Date: Mon, 7 Sep 2020 13:48:33 -0700 To: freebsd-net@freebsd.org X-Mailer: Apple Mail (2.3445.104.15) X-Virus-Scanned: clamav-milter 0.101.4 at mail X-Virus-Status: Clean X-Rspamd-Queue-Id: 4BlgNn2DJ4z3T0W X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info designates 71.177.216.148 as permitted sender) smtp.mailfrom=SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info X-Spamd-Result: default: False [-0.64 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.46)[-0.460]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.71)[-0.713]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; R_SPF_ALLOW(-0.20)[+ip4:71.177.216.148]; NEURAL_HAM_SHORT(-0.06)[-0.063]; FORGED_SENDER(0.30)[bc979@lafn.org,SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5650, ipnet:71.177.216.0/23, country:US]; FROM_NEQ_ENVFROM(0.00)[bc979@lafn.org,SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info]; MAILMAN_DEST(0.00)[freebsd-net]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Sep 2020 20:48:42 -0000 I was quite surprised to discover that the sockaddr structure returned = from recv_fd and recvfrom handle IPv4 addresses differently when using = an INET6 socket. I don't know if this was intended, or a side effect. = I started using SCTP because of the need for accessing multi-homed = servers. Some would be on IPv6 and others on IPv4. SCTP handles that = nicely if you use an INET6 socket. When a transaction is received, if = it is to an IPv4 address, then the returned sockaddr will have a = inet_family of IPv4 and the IPv4 structure. If it was sent to an IPv6 = address, then the inet6_family is used. A simple test of the family = tells you which address format was provided and the address is in IPv4 = or IPv6 format accordingly. However, A new site needed to be added and it is behind a NAT router. = The problem with SCTP is that most (possibly all) NAT routers only work = with TCP and UDP. They will not port forward SCTP. So I have no way to = get through to the machine. So I added code to check for that situation = and use UDP instead. This will work because I don't thing it is at all = likely that a machine behind NAT can be multi-homed. However, the code to obtain the remote IP address failed miserably. It = turns out that if you have v6only set to 1, you will never see the IPv4 = packets. If you set it to 0, then you get the packets, but the sockaddr = format with UDP is different than that for SCTP. If it is an IPv6 = address, everything is the same. However, if it is an IPv4 address, = then the family remains IPv6, and the address is in sin6_addr and it is = in the format ::ffff:n.n.n.n. This makes it interesting as I need to = obtain the IPv4 address as part of the verification process that the = transaction is authorized. Was this difference intended, or is it likely to change in the future? -- Doug From owner-freebsd-net@freebsd.org Mon Sep 7 20:57:33 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CB9663D6B82 for ; Mon, 7 Sep 2020 20:57:33 +0000 (UTC) (envelope-from Michael.Tuexen@lurchi.franken.de) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Blgb03G8Fz3Td7 for ; Mon, 7 Sep 2020 20:57:32 +0000 (UTC) (envelope-from Michael.Tuexen@lurchi.franken.de) Received: from [IPv6:2a02:8109:1140:c3d:5c2f:20ab:3172:1e8f] (unknown [IPv6:2a02:8109:1140:c3d:5c2f:20ab:3172:1e8f]) (Authenticated sender: lurchi) by mail-n.franken.de (Postfix) with ESMTPSA id 34A0475EEA3E8; Mon, 7 Sep 2020 22:57:22 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: Address Differences between UDP and SCTP From: Michael Tuexen In-Reply-To: <6A9D0A4B-F35C-4012-A868-5450D60EC13B@mail.sermon-archive.info> Date: Mon, 7 Sep 2020 22:57:21 +0200 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <7CF5C0CF-A173-4253-9F93-70199578A8F7@lurchi.franken.de> References: <6A9D0A4B-F35C-4012-A868-5450D60EC13B@mail.sermon-archive.info> To: Doug Hardie X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4Blgb03G8Fz3Td7 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of Michael.Tuexen@lurchi.franken.de has no SPF policy when checking 2001:638:a02:a001:20e:cff:fe4a:feaa) smtp.mailfrom=Michael.Tuexen@lurchi.franken.de X-Spamd-Result: default: False [-0.70 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.93)[-0.931]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[franken.de]; ARC_NA(0.00)[]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.31)[-0.315]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-0.85)[-0.852]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Sep 2020 20:57:33 -0000 > On 7. Sep 2020, at 22:48, Doug Hardie wrote: >=20 > I was quite surprised to discover that the sockaddr structure returned = from recv_fd and recvfrom handle IPv4 addresses differently when using = an INET6 socket. I don't know if this was intended, or a side effect. = I started using SCTP because of the need for accessing multi-homed = servers. Some would be on IPv6 and others on IPv4. SCTP handles that = nicely if you use an INET6 socket. When a transaction is received, if = it is to an IPv4 address, then the returned sockaddr will have a = inet_family of IPv4 and the IPv4 structure. If it was sent to an IPv6 = address, then the inet6_family is used. A simple test of the family = tells you which address format was provided and the address is in IPv4 = or IPv6 format accordingly. >=20 > However, A new site needed to be added and it is behind a NAT router. = The problem with SCTP is that most (possibly all) NAT routers only work = with TCP and UDP. They will not port forward SCTP. So I have no way to = get through to the machine. So I added code to check for that situation = and use UDP instead. This will work because I don't thing it is at all = likely that a machine behind NAT can be multi-homed. Would using SCTP/UDP/IPv[46] be an option? It is supported by the = FreeBSD kernel. See https://tools.ietf.org/html/rfc6951#section-6 for the socket API for = it. >=20 > However, the code to obtain the remote IP address failed miserably. = It turns out that if you have v6only set to 1, you will never see the = IPv4 packets. If you set it to 0, then you get the packets, but the = sockaddr format with UDP is different than that for SCTP. If it is an = IPv6 address, everything is the same. However, if it is an IPv4 = address, then the family remains IPv6, and the address is in sin6_addr = and it is in the format ::ffff:n.n.n.n. This makes it interesting as I = need to obtain the IPv4 address as part of the verification process that = the transaction is authorized. For UDP and TCP you always get IPv6 addresses on AF_INET6 sockets. If = you are actually using IPv4, IPv4-mapped IPv6 addresses are used. For = SCTP you an choose if you want IPv4-mapped IPv6 addresses or IPv4 = address. It is controlled by the socket option specified in = https://tools.ietf.org/html/rfc6458#section-8.1.15 >=20 > Was this difference intended, or is it likely to change in the future? I think it is intended. Best regards Michael >=20 > -- Doug >=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" From owner-freebsd-net@freebsd.org Mon Sep 7 23:41:45 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A0DFC3D9AB9 for ; Mon, 7 Sep 2020 23:41:45 +0000 (UTC) (envelope-from SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info) Received: from mail.sermon-archive.info (sermon-archive.info [71.177.216.148]) by mx1.freebsd.org (Postfix) with ESMTP id 4BllDS6pfjz3dLh for ; Mon, 7 Sep 2020 23:41:44 +0000 (UTC) (envelope-from SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info) Received: from [10.0.1.251] (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4BllDQ2k75z2fjRl; Mon, 7 Sep 2020 16:41:42 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.15\)) Subject: Re: Address Differences between UDP and SCTP From: Doug Hardie In-Reply-To: <7CF5C0CF-A173-4253-9F93-70199578A8F7@lurchi.franken.de> Date: Mon, 7 Sep 2020 16:41:42 -0700 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <6A9D0A4B-F35C-4012-A868-5450D60EC13B@mail.sermon-archive.info> <7CF5C0CF-A173-4253-9F93-70199578A8F7@lurchi.franken.de> To: Michael Tuexen X-Mailer: Apple Mail (2.3445.104.15) X-Virus-Scanned: clamav-milter 0.101.4 at mail X-Virus-Status: Clean X-Rspamd-Queue-Id: 4BllDS6pfjz3dLh X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info designates 71.177.216.148 as permitted sender) smtp.mailfrom=SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info X-Spamd-Result: default: False [-1.58 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.980]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:71.177.216.148]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; NEURAL_HAM_LONG(-1.00)[-0.999]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.20)[-0.202]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[bc979@lafn.org,SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:5650, ipnet:71.177.216.0/23, country:US]; FROM_NEQ_ENVFROM(0.00)[bc979@lafn.org,SRS0=UtRB=CQ=mail.sermon-archive.info=doug@sermon-archive.info]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Sep 2020 23:41:45 -0000 > On 7 September 2020, at 13:57, Michael Tuexen = wrote: >=20 >> On 7. Sep 2020, at 22:48, Doug Hardie wrote: >>=20 >> I was quite surprised to discover that the sockaddr structure = returned from recv_fd and recvfrom handle IPv4 addresses differently = when using an INET6 socket. I don't know if this was intended, or a = side effect. I started using SCTP because of the need for accessing = multi-homed servers. Some would be on IPv6 and others on IPv4. SCTP = handles that nicely if you use an INET6 socket. When a transaction is = received, if it is to an IPv4 address, then the returned sockaddr will = have a inet_family of IPv4 and the IPv4 structure. If it was sent to an = IPv6 address, then the inet6_family is used. A simple test of the = family tells you which address format was provided and the address is in = IPv4 or IPv6 format accordingly. >>=20 >> However, A new site needed to be added and it is behind a NAT router. = The problem with SCTP is that most (possibly all) NAT routers only work = with TCP and UDP. They will not port forward SCTP. So I have no way to = get through to the machine. So I added code to check for that situation = and use UDP instead. This will work because I don't thing it is at all = likely that a machine behind NAT can be multi-homed. > Would using SCTP/UDP/IPv[46] be an option? It is supported by the = FreeBSD kernel. > See https://tools.ietf.org/html/rfc6951#section-6 for the socket API = for it. Perhaps I am not understanding this completely, but I believe that it = requires UDP encapsulation which is mostly user land code. Thus there = would be two implementations of SCTP in the system. I don't think that = is the best approach. >>=20 >> However, the code to obtain the remote IP address failed miserably. = It turns out that if you have v6only set to 1, you will never see the = IPv4 packets. If you set it to 0, then you get the packets, but the = sockaddr format with UDP is different than that for SCTP. If it is an = IPv6 address, everything is the same. However, if it is an IPv4 = address, then the family remains IPv6, and the address is in sin6_addr = and it is in the format ::ffff:n.n.n.n. This makes it interesting as I = need to obtain the IPv4 address as part of the verification process that = the transaction is authorized. > For UDP and TCP you always get IPv6 addresses on AF_INET6 sockets. If = you are actually using IPv4, IPv4-mapped IPv6 addresses are used. For = SCTP you an choose if you want IPv4-mapped IPv6 addresses or IPv4 = address. It is controlled by > the socket option specified in = https://tools.ietf.org/html/rfc6458#section-8.1.15 That would simplify my code so I am going to implement it. Thanks. >>=20 >> Was this difference intended, or is it likely to change in the = future? > I think it is intended. I had a feeling that would be the case, but I would think consistency = would be more helpful to those using the services. >=20 > Best regards > Michael -- Doug From owner-freebsd-net@freebsd.org Tue Sep 8 00:18:04 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 40F3D3DA4F8 for ; Tue, 8 Sep 2020 00:18:04 +0000 (UTC) (envelope-from SRS0=v5e9=CR=mail.sermon-archive.info=doug@sermon-archive.info) Received: from mail.sermon-archive.info (sermon-archive.info [71.177.216.148]) by mx1.freebsd.org (Postfix) with ESMTP id 4Blm2M3dcLz3fbW for ; Tue, 8 Sep 2020 00:18:03 +0000 (UTC) (envelope-from SRS0=v5e9=CR=mail.sermon-archive.info=doug@sermon-archive.info) Received: from [10.0.1.251] (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4Blm2L5BBHz2fjTp; Mon, 7 Sep 2020 17:18:02 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.15\)) Subject: Re: Address Differences between UDP and SCTP From: Doug Hardie In-Reply-To: <7CF5C0CF-A173-4253-9F93-70199578A8F7@lurchi.franken.de> Date: Mon, 7 Sep 2020 17:18:02 -0700 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <6DB5BF95-F7D8-4933-8633-644A553E8C75@mail.sermon-archive.info> References: <6A9D0A4B-F35C-4012-A868-5450D60EC13B@mail.sermon-archive.info> <7CF5C0CF-A173-4253-9F93-70199578A8F7@lurchi.franken.de> To: Michael Tuexen X-Mailer: Apple Mail (2.3445.104.15) X-Virus-Scanned: clamav-milter 0.101.4 at mail X-Virus-Status: Clean X-Rspamd-Queue-Id: 4Blm2M3dcLz3fbW X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=v5e9=CR=mail.sermon-archive.info=doug@sermon-archive.info designates 71.177.216.148 as permitted sender) smtp.mailfrom=SRS0=v5e9=CR=mail.sermon-archive.info=doug@sermon-archive.info X-Spamd-Result: default: False [-1.58 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.982]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:71.177.216.148:c]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; NEURAL_HAM_LONG(-1.00)[-0.998]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.20)[-0.197]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[bc979@lafn.org,SRS0=v5e9=CR=mail.sermon-archive.info=doug@sermon-archive.info]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:5650, ipnet:71.177.216.0/23, country:US]; FROM_NEQ_ENVFROM(0.00)[bc979@lafn.org,SRS0=v5e9=CR=mail.sermon-archive.info=doug@sermon-archive.info]; MAILMAN_DEST(0.00)[freebsd-net]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2020 00:18:04 -0000 > On 7 September 2020, at 13:57, Michael Tuexen = wrote: >=20 > For UDP and TCP you always get IPv6 addresses on AF_INET6 sockets. If = you are actually using IPv4, IPv4-mapped IPv6 addresses are used. For = SCTP you an choose if you want IPv4-mapped IPv6 addresses or IPv4 = address. It is controlled by > the socket option specified in = https://tools.ietf.org/html/rfc6458#section-8.1.15 I used: optval =3D 1; rc =3D setsockopt (recv_fd, IPPROTO_IPV6, = SCTP_I_WANT_MAPPED_V4_ADDR, &optval, sizeof(optval)); FreeBSD 12.1. Result was "Operation not supported" -- Doug From owner-freebsd-net@freebsd.org Tue Sep 8 05:50:45 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 88C693E41DE for ; Tue, 8 Sep 2020 05:50:45 +0000 (UTC) (envelope-from Michael.Tuexen@lurchi.franken.de) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BlvQD1tRlz4Hnf for ; Tue, 8 Sep 2020 05:50:43 +0000 (UTC) (envelope-from Michael.Tuexen@lurchi.franken.de) Received: from [IPv6:2a02:8109:1140:c3d:b8e0:2901:13c2:2133] (unknown [IPv6:2a02:8109:1140:c3d:b8e0:2901:13c2:2133]) (Authenticated sender: lurchi) by mail-n.franken.de (Postfix) with ESMTPSA id 7B7F676DF3D51; Tue, 8 Sep 2020 07:50:38 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: Address Differences between UDP and SCTP From: Michael Tuexen In-Reply-To: Date: Tue, 8 Sep 2020 07:50:37 +0200 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <6A9D0A4B-F35C-4012-A868-5450D60EC13B@mail.sermon-archive.info> <7CF5C0CF-A173-4253-9F93-70199578A8F7@lurchi.franken.de> To: Doug Hardie X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4BlvQD1tRlz4Hnf X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of Michael.Tuexen@lurchi.franken.de has no SPF policy when checking 2001:638:a02:a001:20e:cff:fe4a:feaa) smtp.mailfrom=Michael.Tuexen@lurchi.franken.de X-Spamd-Result: default: False [-0.34 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.93)[-0.931]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[franken.de]; ARC_NA(0.00)[]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.04)[0.040]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-0.85)[-0.851]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2020 05:50:45 -0000 > On 8. Sep 2020, at 01:41, Doug Hardie wrote: >=20 >> On 7 September 2020, at 13:57, Michael Tuexen = wrote: >>=20 >>> On 7. Sep 2020, at 22:48, Doug Hardie wrote: >>>=20 >>> I was quite surprised to discover that the sockaddr structure = returned from recv_fd and recvfrom handle IPv4 addresses differently = when using an INET6 socket. I don't know if this was intended, or a = side effect. I started using SCTP because of the need for accessing = multi-homed servers. Some would be on IPv6 and others on IPv4. SCTP = handles that nicely if you use an INET6 socket. When a transaction is = received, if it is to an IPv4 address, then the returned sockaddr will = have a inet_family of IPv4 and the IPv4 structure. If it was sent to an = IPv6 address, then the inet6_family is used. A simple test of the = family tells you which address format was provided and the address is in = IPv4 or IPv6 format accordingly. >>>=20 >>> However, A new site needed to be added and it is behind a NAT = router. The problem with SCTP is that most (possibly all) NAT routers = only work with TCP and UDP. They will not port forward SCTP. So I have = no way to get through to the machine. So I added code to check for that = situation and use UDP instead. This will work because I don't thing it = is at all likely that a machine behind NAT can be multi-homed. >> Would using SCTP/UDP/IPv[46] be an option? It is supported by the = FreeBSD kernel. >> See https://tools.ietf.org/html/rfc6951#section-6 for the socket API = for it. >=20 > Perhaps I am not understanding this completely, but I believe that it = requires UDP encapsulation which is mostly user land code. Thus there = would be two implementations of SCTP in the system. I don't think that = is the best approach. No, the UDP encapsulation/decapsulation is done by the kernel. On = FreeBSD you have only a single stack. You can even have a single association where some paths are using UDP = encapsulation, some are not. For the server side, the only thing you need to do is to enable it = hostwide by setting sudo sysctl -w net.inet.sctp.udp_tunneling_port=3D9899 or putting net.inet.sctp.udp_tunneling_port=3D9899 in /etc/sysctl.conf On the client side you need to use the socket option defined in https://tools.ietf.org/html/rfc6951#section-6.1 See https://github.com/nplab/tsctp/blob/master/tsctp.c#L477 for an example. >=20 >>>=20 >>> However, the code to obtain the remote IP address failed miserably. = It turns out that if you have v6only set to 1, you will never see the = IPv4 packets. If you set it to 0, then you get the packets, but the = sockaddr format with UDP is different than that for SCTP. If it is an = IPv6 address, everything is the same. However, if it is an IPv4 = address, then the family remains IPv6, and the address is in sin6_addr = and it is in the format ::ffff:n.n.n.n. This makes it interesting as I = need to obtain the IPv4 address as part of the verification process that = the transaction is authorized. >> For UDP and TCP you always get IPv6 addresses on AF_INET6 sockets. If = you are actually using IPv4, IPv4-mapped IPv6 addresses are used. For = SCTP you an choose if you want IPv4-mapped IPv6 addresses or IPv4 = address. It is controlled by >> the socket option specified in = https://tools.ietf.org/html/rfc6458#section-8.1.15 >=20 > That would simplify my code so I am going to implement it. Thanks. >=20 >>>=20 >>> Was this difference intended, or is it likely to change in the = future? >> I think it is intended. >=20 > I had a feeling that would be the case, but I would think consistency = would be more helpful to those using the services. You mean to switch the default for SCTP_I_WANT_MAPPED_V4_ADDR to false? Best regards Michael >=20 >>=20 >> Best regards >> Michael >=20 > -- Doug >=20 >=20 From owner-freebsd-net@freebsd.org Tue Sep 8 05:52:25 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DE3093E4682 for ; Tue, 8 Sep 2020 05:52:25 +0000 (UTC) (envelope-from Michael.Tuexen@lurchi.franken.de) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BlvS84DSYz4Hxc for ; Tue, 8 Sep 2020 05:52:24 +0000 (UTC) (envelope-from Michael.Tuexen@lurchi.franken.de) Received: from [IPv6:2a02:8109:1140:c3d:b8e0:2901:13c2:2133] (unknown [IPv6:2a02:8109:1140:c3d:b8e0:2901:13c2:2133]) (Authenticated sender: lurchi) by mail-n.franken.de (Postfix) with ESMTPSA id 393DF76DF3D51; Tue, 8 Sep 2020 07:52:21 +0200 (CEST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: Address Differences between UDP and SCTP From: Michael Tuexen In-Reply-To: <6DB5BF95-F7D8-4933-8633-644A553E8C75@mail.sermon-archive.info> Date: Tue, 8 Sep 2020 07:52:20 +0200 Cc: freebsd-net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <5FDFA318-A3F3-4BAA-9413-33D0FE961717@lurchi.franken.de> References: <6A9D0A4B-F35C-4012-A868-5450D60EC13B@mail.sermon-archive.info> <7CF5C0CF-A173-4253-9F93-70199578A8F7@lurchi.franken.de> <6DB5BF95-F7D8-4933-8633-644A553E8C75@mail.sermon-archive.info> To: Doug Hardie X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Queue-Id: 4BlvS84DSYz4Hxc X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of Michael.Tuexen@lurchi.franken.de has no SPF policy when checking 193.175.24.27) smtp.mailfrom=Michael.Tuexen@lurchi.franken.de X-Spamd-Result: default: False [-0.80 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.98)[-0.980]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[franken.de]; ARC_NA(0.00)[]; AUTH_NA(1.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.22)[-0.224]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_MEDIUM(-0.89)[-0.892]; R_SPF_NA(0.00)[no SPF record]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net]; RCVD_IN_DNSWL_LOW(-0.10)[193.175.24.27:from] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2020 05:52:25 -0000 > On 8. Sep 2020, at 02:18, Doug Hardie wrote: >=20 >=20 >> On 7 September 2020, at 13:57, Michael Tuexen = wrote: >>=20 >> For UDP and TCP you always get IPv6 addresses on AF_INET6 sockets. If = you are actually using IPv4, IPv4-mapped IPv6 addresses are used. For = SCTP you an choose if you want IPv4-mapped IPv6 addresses or IPv4 = address. It is controlled by >> the socket option specified in = https://tools.ietf.org/html/rfc6458#section-8.1.15 >=20 > I used: >=20 > optval =3D 1; > rc =3D setsockopt (recv_fd, IPPROTO_IPV6, = SCTP_I_WANT_MAPPED_V4_ADDR, > &optval, sizeof(optval)); >=20 > FreeBSD 12.1. Result was "Operation not supported" It is an IPPROTO_SCTP level socket option. So you need to use rc =3D setsockopt (recv_fd, IPPROTO_SCTP, = SCTP_I_WANT_MAPPED_V4_ADDR, &optval, sizeof(optval)); Best regards Michael >=20 > -- Doug >=20 From owner-freebsd-net@freebsd.org Tue Sep 8 13:23:25 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D2A733C9019 for ; Tue, 8 Sep 2020 13:23:25 +0000 (UTC) (envelope-from SRS0=b0HP=CR=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bm5SY19Hhz3VqB for ; Tue, 8 Sep 2020 13:23:24 +0000 (UTC) (envelope-from SRS0=b0HP=CR=perdition.city=julien@bebif.be) Received: from x1 (unknown [77.109.102.38]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id AE89D1D4FC26; Tue, 8 Sep 2020 15:23:17 +0200 (CEST) Date: Tue, 8 Sep 2020 15:23:14 +0200 From: Julien Cigar To: Michael Gmelin , freebsd-net@freebsd.org Subject: Re: CARP over VLAN over LAGG Message-ID: <20200908132314.2txabgcuz4wmsq7n@x1> Mail-Followup-To: Michael Gmelin , freebsd-net@freebsd.org References: <20200831083705.pvrjk4srdohlxklf@x1> <8A98D287-4202-493B-8515-4377740B126A@grem.de> <20200901081323.amsc55h5xnikbycu@x1> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20200901081323.amsc55h5xnikbycu@x1> X-Rspamd-Queue-Id: 4Bm5SY19Hhz3VqB X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=b0HP=CR=perdition.city=julien@bebif.be designates 193.191.208.90 as permitted sender) smtp.mailfrom=SRS0=b0HP=CR=perdition.city=julien@bebif.be X-Spamd-Result: default: False [-1.86 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.961]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-0.96)[-0.958]; MIME_GOOD(-0.10)[text/plain]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_NA(0.00)[perdition.city]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.54)[-0.538]; RCPT_COUNT_TWO(0.00)[2]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=b0HP=CR=perdition.city=julien@bebif.be]; RCVD_NO_TLS_LAST(0.10)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=b0HP=CR=perdition.city=julien@bebif.be]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2020 13:23:25 -0000 On Tue, Sep 01, 2020 at 10:13:23AM +0200, Julien Cigar wrote: > On Mon, Aug 31, 2020 at 01:55:52PM +0200, Michael Gmelin wrote: > > > > > > > On 31. Aug 2020, at 10:37, Julien Cigar wrote: > > > > > > On Fri, Aug 28, 2020 at 04:52:01PM +0200, Julien Cigar wrote: > > >> Hello, > > >> > > >> I have a "highly available" router/firewall with the following > > >> configuration (1). Those are plugged in two 2930F (with VSF) using LACP. > > >> It works well, except that I have some weird issues with the CARP > > >> demotion counter when I'm unplugging some interfaces involved in the > > >> lagg/carp setup, for example if I unplug/replug igb0 and igb1 in this > > >> case: > > >> > > >> (dmesg): > > >> igb0: link state changed to DOWN > > >> igb1: link state changed to DOWN > > >> carp: demoted by 240 to 240 (send error 50 on vlan11) > > >> carp: 11@vlan11: MASTER -> BACKUP (more frequent advertisement received) > > >> vlan11: deletion failed: 3 > > >> igb1: link state changed to UP > > >> igb0: link state changed to UP > > >> > > >> then the CARP status stays to BACKUP unless I demote the CARP demotion > > >> counter manually with: sudo sysctl net.inet.carp.demotion=-240: > > >> > > >> (dmesg): > > >> carp: demoted by -240 to 0 (sysctl) > > >> carp: 11@vlan11: BACKUP -> MASTER (preempting a slower master) > > >> > > >> I guess this is because it takes some time for lagg/lacp to converge and > > >> thus carp thinks that there is a problematic condition as it experiences > > >> problems with sending announcements.. > > >> > > >> What it the best way to handle this? > > > > > > I'm wondering if setting net.inet.carp.senderr_demotion_factor to "0" > > > could be a solution? Are there any downsides of setting this to "0" > > > instead of "240"? > > > > > > > Sharing your pf.conf from both hosts could be helpful analyzing the issue. > > Here is my pf.conf (it's the same on both host): > https://gist.github.com/silenius/b758851f03c28ef8caaa53cfe381c455 > > However, I don't think pf is the issue here, the problem is that there > is a slight delay when LAGG/LACP converge and thus CARP increase the > demotion counter by net.inet.carp.senderr_demotion_factor (240). I can confirm that after setting net.inet.carp.senderr_demotion_factor=0 (instead of 240) it works as expected. > > > > > -m > > > > > > -- > Julien Cigar > Belgian Biodiversity Platform (http://www.biodiversity.be) > PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 > No trees were killed in the creation of this message. > However, many electrons were terribly inconvenienced. > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" -- Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. From owner-freebsd-net@freebsd.org Tue Sep 8 13:38:24 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B66B83C99BA for ; Tue, 8 Sep 2020 13:38:24 +0000 (UTC) (envelope-from freebsd@grem.de) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits)) (Client CN "mail.evolve.de", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bm5nq57tpz3Wfh for ; Tue, 8 Sep 2020 13:38:23 +0000 (UTC) (envelope-from freebsd@grem.de) Received: by mail.evolve.de (OpenSMTPD) with ESMTP id b412a9f9; Tue, 8 Sep 2020 13:38:15 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=grem.de; h=content-type :content-transfer-encoding:mime-version:subject:from:in-reply-to :date:cc:message-id:references:to; s=20180501; bh=LKcZQ14AkSk+xk 16r+ukHxq65/w=; b=BjsmdQSAP6HuIpGIjhJxID1ZSNdtYaIrzAMGKfnk1TsHPa CrcQi9s5I1ppH07Kh0JFFWv1/8spt7GiFG6ntzYNaG1Pjzs46AXwJbPUrCJsFw7Z 3TXtg/hZ4+iYWg5isrqA8QkeQivFo8dUI1017Cg2KLnL59leL0PwmJHa2ZaUi/+Z XjvJddlepHnGlR5RyWN2ad9Uzg5D2s7BXOhhqXu3Oujq161VrlmJV8ePS7nCRk6w igzU0cQppsPLRysiD+Fz/nc7eaRoe3BFvSJH43oP2ifHBJrcbT+0taxBE0gGaLcN hnheQAbUYi6CvWcvmSGEm1QUxc5asZT/J+mgpPug== DomainKey-Signature: a=rsa-sha1; c=nofws; d=grem.de; h=content-type :content-transfer-encoding:mime-version:subject:from:in-reply-to :date:cc:message-id:references:to; q=dns; s=20180501; b=OPi9eSoD vSEC62nUj7Khv/ZRPcOTT8Y0dry0NZE9pxEi0qBsKS65IHvvz1Xgc0VMoW/QJgLr iLavlmZiV3QuzHVvLBI3ufVuDX++KTx0KJsbuh1Q2dGsds/QWQ02eUpx3okSg0/R 6RwltNnAttOWLTn76m1NWOXdYNRH1JP7A873RVyKeXh9arTQvfFpLFMfnertuBwZ VOkChctI7xEucYJkvjO3i+ExgATjCZRpLWs9XecRVE2kdk+5yHcyKaPoSXBkx7r5 hMXmstenAQhZwitwa9mofobKUFxB1Kx5R16HySZ4I+e5VRO4erqSRAY1yokml7eq DOqpztYznT8jDQ== Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 7422ddcc (TLSv1.2:ECDHE-RSA-CHACHA20-POLY1305:256:NO); Tue, 8 Sep 2020 13:38:14 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) Subject: Re: CARP over VLAN over LAGG From: Michael Gmelin In-Reply-To: <20200908132314.2txabgcuz4wmsq7n@x1> Date: Tue, 8 Sep 2020 15:38:14 +0200 Cc: freebsd-net@freebsd.org Message-Id: References: <20200908132314.2txabgcuz4wmsq7n@x1> To: Julien Cigar X-Mailer: iPhone Mail (17H35) X-Rspamd-Queue-Id: 4Bm5nq57tpz3Wfh X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=grem.de header.s=20180501 header.b=BjsmdQSA; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd@grem.de designates 213.239.217.29 as permitted sender) smtp.mailfrom=freebsd@grem.de X-Spamd-Result: default: False [-2.48 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[grem.de:s=20180501]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:213.239.217.29/32]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grem.de]; NEURAL_HAM_LONG(-0.98)[-0.979]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[grem.de:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.52)[-0.524]; NEURAL_HAM_MEDIUM(-0.98)[-0.981]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2020 13:38:24 -0000 > On 8. Sep 2020, at 15:23, Julien Cigar wrote: >=20 > =EF=BB=BFOn Tue, Sep 01, 2020 at 10:13:23AM +0200, Julien Cigar wrote: >>> On Mon, Aug 31, 2020 at 01:55:52PM +0200, Michael Gmelin wrote: >>>=20 >>>=20 >>>> On 31. Aug 2020, at 10:37, Julien Cigar wrote: >>>>=20 >>>> =EF=BB=BFOn Fri, Aug 28, 2020 at 04:52:01PM +0200, Julien Cigar wrote: >>>>> Hello, >>>>>=20 >>>>> I have a "highly available" router/firewall with the following >>>>> configuration (1). Those are plugged in two 2930F (with VSF) using LAC= P. >>>>> It works well, except that I have some weird issues with the CARP=20 >>>>> demotion counter when I'm unplugging some interfaces involved in the=20= >>>>> lagg/carp setup, for example if I unplug/replug igb0 and igb1 in this=20= >>>>> case: >>>>>=20 >>>>> (dmesg): >>>>> igb0: link state changed to DOWN >>>>> igb1: link state changed to DOWN >>>>> carp: demoted by 240 to 240 (send error 50 on vlan11) >>>>> carp: 11@vlan11: MASTER -> BACKUP (more frequent advertisement receive= d) >>>>> vlan11: deletion failed: 3 >>>>> igb1: link state changed to UP >>>>> igb0: link state changed to UP >>>>>=20 >>>>> then the CARP status stays to BACKUP unless I demote the CARP demotion= >>>>> counter manually with: sudo sysctl net.inet.carp.demotion=3D-240: >>>>>=20 >>>>> (dmesg): >>>>> carp: demoted by -240 to 0 (sysctl) >>>>> carp: 11@vlan11: BACKUP -> MASTER (preempting a slower master) >>>>>=20 >>>>> I guess this is because it takes some time for lagg/lacp to converge a= nd >>>>> thus carp thinks that there is a problematic condition as it experienc= es >>>>> problems with sending announcements.. >>>>>=20 >>>>> What it the best way to handle this? >>>>=20 >>>> I'm wondering if setting net.inet.carp.senderr_demotion_factor to "0" >>>> could be a solution? Are there any downsides of setting this to "0" >>>> instead of "240"? >>>>=20 >>>=20 >>> Sharing your pf.conf from both hosts could be helpful analyzing the issu= e. >>=20 >> Here is my pf.conf (it's the same on both host): >> https://gist.github.com/silenius/b758851f03c28ef8caaa53cfe381c455 >>=20 >> However, I don't think pf is the issue here, the problem is that there >> is a slight delay when LAGG/LACP converge and thus CARP increase the >> demotion counter by net.inet.carp.senderr_demotion_factor (240). >=20 > I can confirm that after setting net.inet.carp.senderr_demotion_factor=3D0= > (instead of 240) it works as expected. >=20 Cool, thanks for posting the solution. I don=E2=80=99t think I ever used CAR= P with lagg (usually I had redundant firewalls with CARP and servers using l= agg connected to both of them). Cheers, Michael >>=20 >>>=20 >>> -m >>>=20 >>>=20 >>=20 >> --=20 >> Julien Cigar >> Belgian Biodiversity Platform (http://www.biodiversity.be) >> PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 >> No trees were killed in the creation of this message. >> However, many electrons were terribly inconvenienced. >> _______________________________________________ >> freebsd-net@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-net >> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >=20 > --=20 > Julien Cigar > Belgian Biodiversity Platform (http://www.biodiversity.be) > PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 > No trees were killed in the creation of this message. > However, many electrons were terribly inconvenienced. From owner-freebsd-net@freebsd.org Tue Sep 8 14:46:39 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4EA3B3CBDAA for ; Tue, 8 Sep 2020 14:46:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bm7Jb1Qb9z3bRD for ; Tue, 8 Sep 2020 14:46:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 30C3B3CBC21; Tue, 8 Sep 2020 14:46:39 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 308C53CBD14 for ; Tue, 8 Sep 2020 14:46:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bm7Jb0QdXz3bXF for ; Tue, 8 Sep 2020 14:46:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E585011BF4 for ; Tue, 8 Sep 2020 14:46:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 088EkcuE056590 for ; Tue, 8 Sep 2020 14:46:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 088EkcGS056589 for net@FreeBSD.org; Tue, 8 Sep 2020 14:46:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 245103] [patch] [ipv6] IPv6: update v6 temporary address lifetime according to rfc4941bis Date: Tue, 08 Sep 2020 14:46:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: ipv6, needs-qa, patch, standards X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: bz@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2020 14:46:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245103 Bjoern A. Zeeb changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bz@FreeBSD.org |net@FreeBSD.org --- Comment #4 from Bjoern A. Zeeb --- If this hasn't happened, can someone please update this? I have to punt on this. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Tue Sep 8 17:40:28 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 701553D0F72 for ; Tue, 8 Sep 2020 17:40:28 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: from mail-ot1-x343.google.com (mail-ot1-x343.google.com [IPv6:2607:f8b0:4864:20::343]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmC976x9wz45XL for ; Tue, 8 Sep 2020 17:40:27 +0000 (UTC) (envelope-from rajfbsd@gmail.com) Received: by mail-ot1-x343.google.com with SMTP id o6so4302822ota.2 for ; Tue, 08 Sep 2020 10:40:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=YXSzTz7Ce5diga/y8Ybhi21oIFc42lA4IxXFuoJWNFc=; b=HBZe3WkNeCqG1JLbIubSb4vm5x2oParN47pjPVltplYGZhW6fMacrJ2XQl/3pQJAMZ V6KN6SDfA0lRSvcfijkZiBnPyRPXHXFwS69pzDs9H8Kf9qiLUjSZg5GB36dysTH/tMkm +QypODe72L7W2w63/tudC6zLX8jzHrW2N3Ia5sAcABqWVULyJD9sOyLfCMHgvdiKICFO a0x3KbOHAyOKOjT3sw83Lmv9/phBAhjMa36UoV0LjRrL55PcRRKuUgs++q8AkaLzD7+C PZt/4VyTMN41G0rWTur1gbmMyaZGo5E6Vm+wEYEfd8LBS/n8JIWIpXUA9iCqZsFqCeR6 83tw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=YXSzTz7Ce5diga/y8Ybhi21oIFc42lA4IxXFuoJWNFc=; b=b7pCnE+4RrtnryTjceVoqF8rDcq1VKTWtApfBalyD1xd8r5p7g+jRCvu1igepSaScA uzq6vFnLx5yvoFo8yBITsIVakRf7dvpJwbqB2HFJP9tUP0Dwd+9Y5/q4KCBR90CQyCDR QU3YHj39f38YkHjPfaG9Xitruz2wcdx405gWeuLj98KNvxvAcROzRfMjhMtksWfj/pf8 pvZIz71x5expJDEB+odQgwk6rIBQeTs7MpeW38XxlWzthBTx++rZfl1QdC8mb+brzyMx 41Y5LOY9nHkkllASadpV+RWuF4BcFCXHEA1yYbRaurVJ0DXmegc9mvkIltcCg6umJo64 DkUw== X-Gm-Message-State: AOAM532JeU0Sx6S3VaC3/jTR3VtNUURKLWLwBB59MYThMMRgfv+/kKe2 jiKcjdfEXaWgpq0E1ovOAv9dN++LoLokbXDfmLW4LTUX X-Google-Smtp-Source: ABdhPJwNEzd73vSeFZbWwFwcP6Ok9yve8LBaGb+OHJfyQOk+gC5KvqgY3wRYydQltSluDC9GPtgmbAIQkDY7bTo5vYs= X-Received: by 2002:a05:6830:1e0a:: with SMTP id s10mr110628otr.95.1599586826715; Tue, 08 Sep 2020 10:40:26 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Rajesh Kumar Date: Tue, 8 Sep 2020 23:10:14 +0530 Message-ID: Subject: Re: 10G Network interface not reaching wire speed on Receive path with single thread iperf run To: freebsd-net@freebsd.org X-Rspamd-Queue-Id: 4BmC976x9wz45XL X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=HBZe3WkN; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rajfbsd@gmail.com designates 2607:f8b0:4864:20::343 as permitted sender) smtp.mailfrom=rajfbsd@gmail.com X-Spamd-Result: default: False [-3.28 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.97)[-0.972]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.993]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::343:from]; NEURAL_HAM_SHORT(-0.32)[-0.315]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2020 17:40:28 -0000 Hi Guys, Has anyone got a chance to look into this? Any clues? Thanks, Rajesh. On Mon, Sep 7, 2020 at 11:33 PM Rajesh Kumar wrote: > Hi Michael, > > We use Interrupts for Rx packets. Whereas we poll for the link status. > > Thanks, > Rajesh. > > On Mon, Sep 7, 2020 at 11:17 PM Michael Sierchio > wrote: > >> Are you using device polling or interrupts on the interface? >> >> On Mon, Sep 7, 2020 at 10:40 AM Rajesh Kumar wrote: >> >>> Hi FreeBSD team, >>> >>> I am writing a network driver using the iflib framework and using the >>> "iperf" tool for performance testing. >>> >>> 1) 10G link with 9000 MTU: Seeing line-rate numbers on both Tx and Rx >>> path. >>> 2) 10G link with 1500 MTU. Seeing line-rate numbers on Tx path, but low >>> numbers on Rx path. >>> >>> Base issue seems to be that Rx buffers are not getting re-filled fast >>> enough. With low thread count, I see higher CPU utilization and lower >>> throughput. But with a higher number of threads, I could see better >>> throughput and lesser cpu utilization. >>> >>> iperf with 1 Thread: CPU Utilization is 80% - 95% - Throughput is ~4Gbp= s. >>> iperf with 2 Thread: CPU Utilization is 80% - 90% - Throughput is >>> ~7.5Gbps. >>> iperf with 4 Thread: CPU Utilization is 40% - 75% - Throughput is ~9Gbp= s. >>> iperf with 8 Thread: CPU Utilization is 30% - 70% - Throughput is >>> ~9.2Gbps. >>> >>> So, something is causing CPU utilization higher with lesser thread, whi= ch >>> kind of leads to Rx buffers not getting filled up faster and hence the >>> performance numbers drop. From a code perspective, I couldn't see any >>> evident CPU consuming operations in the Rx path. It's plain hardware >>> descriptors reading/processing. >>> >>> Anyway we can debug to find what is causing more CPU utilization (with >>> lesser threads) in my case? Any clues on debugging this issue? >>> >>> Thanks, >>> Rajesh. >>> _______________________________________________ >>> freebsd-net@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-net >>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >>> >> >> >> -- >> >> "Well," Brahm=C4=81 said, "even after ten thousand explanations, a fool = is no >> wiser, but an intelligent person requires only two thousand five hundred= ." >> >> - The Mah=C4=81bh=C4=81rata >> > From owner-freebsd-net@freebsd.org Tue Sep 8 20:58:39 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F05533D7A32 for ; Tue, 8 Sep 2020 20:58:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4BmHYq67VHz4S9F for ; Tue, 8 Sep 2020 20:58:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D28043D7752; Tue, 8 Sep 2020 20:58:39 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D24E63D787A for ; Tue, 8 Sep 2020 20:58:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmHYq5L4gz4S4f for ; Tue, 8 Sep 2020 20:58:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9B36C167B3 for ; Tue, 8 Sep 2020 20:58:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 088KwdYA092825 for ; Tue, 8 Sep 2020 20:58:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 088KwdtS092824 for net@FreeBSD.org; Tue, 8 Sep 2020 20:58:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 249191] RSS code in IGB driver is never compiled. Date: Tue, 08 Sep 2020 20:58:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: IntelNetworking X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Sep 2020 20:58:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249191 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |net@FreeBSD.org Keywords| |IntelNetworking --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Sep 9 05:23:57 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A524C3E4E1E for ; Wed, 9 Sep 2020 05:23:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BmVms3xjqz3V6N for ; Wed, 9 Sep 2020 05:23:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 876573E4E1D; Wed, 9 Sep 2020 05:23:57 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 872E33E4BFB for ; Wed, 9 Sep 2020 05:23:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmVms33wDz3V8k for ; Wed, 9 Sep 2020 05:23:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4CD431CC80 for ; Wed, 9 Sep 2020 05:23:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0895Nvqc076173 for ; Wed, 9 Sep 2020 05:23:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0895NvUU076172 for net@FreeBSD.org; Wed, 9 Sep 2020 05:23:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 226217] if_qlxgb (QLogic cLOM8214) not working for me when configured via netif Date: Wed, 09 Sep 2020 05:23:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: lwhsu@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 05:23:57 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D226217 Li-Wen Hsu changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |lwhsu@FreeBSD.org See Also| |https://github.com/freebsd/ | |freebsd/pull/429 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Wed Sep 9 14:43:01 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5B2373D2ABB for ; Wed, 9 Sep 2020 14:43:01 +0000 (UTC) (envelope-from diego.abelenda@gmail.com) Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bml9w4vRJz4LJM for ; Wed, 9 Sep 2020 14:43:00 +0000 (UTC) (envelope-from diego.abelenda@gmail.com) Received: by mail-ej1-x629.google.com with SMTP id j11so3980794ejk.0 for ; Wed, 09 Sep 2020 07:43:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:subject:message-id:mime-version; bh=+t27QAJ0WQOCFkRM/pGv40+wXNcgXdz5KNuHswR3G1c=; b=DilwuRq9TGD+6UOLCLNsvmSaI3ROi3qZxr4dpALq5RHDc9LbFOClyFlBCFUmd46xUI pu+7VoPUR0mwtyx0mrKi/rNWCeVWpffxskSBbv2O5hha/+7e3gXwe3nqdMpjxghTT4fD Ybr5bB8JrLzH3tJfhkMe1VwUjwv9GJ6C0TaLX1aRWm+6jmIl2XpMfCO6Tj3LPOl4/gqJ SPARmSbA5FfAhhreKIl2YFSPbvMEhY9EW06/daLr8j5dHoi55aumI0IgNWBauzIRnDHX bvwA36XUBmtjzzr1v5FbC/36S3s2yDfPlfBvpxxyJjEVBoMdwOEbV4z5HUmKyGIFpwiL L6DQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:subject:message-id:mime-version; bh=+t27QAJ0WQOCFkRM/pGv40+wXNcgXdz5KNuHswR3G1c=; b=mTv00wLQc30TTqkVHdRVJgWfW72qls5Bi6IYe8IZRyke+jBmLys6HdUluwXIHJ7YPn Jdlok693nTXBtY/cWC6FcvxzAAKJ9uMeTbs2rIu1DPiqfMHR5ZwdDIjUOFNayQBwpP9C s22u2hCKWeIa5HSWOJ9onU7tTbUukITqUEDQzldyfecKKOAthVIFZjlqyMNaP4qrWcfj LBRFBCA1rXdPWcYyGWbGn6HVzfCoaSeGRdgL7/lb6Fr4lcu++9NLt/qwuwm+BCxXxU/o zX+esx4engOyT3P1B++dZvDOukRjShttU26xKRGhTeVjVlYEJWRDJPLWnx2EuWyWsphY orLQ== X-Gm-Message-State: AOAM530+qF+j2SmAMSsA6LvWlzjaa6iIKbqr1YMNCnV3Avrn79oRD5kK Lx8p+pgp29Z6BU+Oa79HD7FFyJOGKSM= X-Google-Smtp-Source: ABdhPJy/feIkAEyvje234GTthn0Ql2dHnTsy1ff2CWpazxR+M9OVqdSfbrcMSPldWiAtpdAzEI2NvA== X-Received: by 2002:a17:906:f246:: with SMTP id gy6mr3897778ejb.373.1599662578646; Wed, 09 Sep 2020 07:42:58 -0700 (PDT) Received: from debian (72.199.5.85.dynamic.wline.res.cust.swisscom.ch. [85.5.199.72]) by smtp.gmail.com with ESMTPSA id c5sm2599278edt.24.2020.09.09.07.42.57 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 09 Sep 2020 07:42:57 -0700 (PDT) Date: Wed, 9 Sep 2020 16:42:54 +0200 From: Abelenda Diego To: freebsd-net@freebsd.org Subject: IP "routing" issue Message-ID: <20200909164254.5e7e3891@debian> X-Mailer: Claws Mail 3.17.6 (GTK+ 2.24.32; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/Tx/j76suhfJfH.8BB.lXdTV"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Rspamd-Queue-Id: 4Bml9w4vRJz4LJM X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=DilwuRq9; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of diegoabelenda@gmail.com designates 2a00:1450:4864:20::629 as permitted sender) smtp.mailfrom=diegoabelenda@gmail.com X-Spamd-Result: default: False [-1.92 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RECEIVED_SPAMHAUS_PBL(0.00)[85.5.199.72:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.992]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.02)[-1.017]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_SHORT(0.69)[0.694]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::629:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 14:43:01 -0000 --Sig_/Tx/j76suhfJfH.8BB.lXdTV Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Hello, I've got a FreeBSD installation in a DataCenter that provided me with a sin= gle address IPv4 with an upstream gateway (cidr is fine the upstream gateway wo= rks everything is nice and running). I use this machine for Masquerading an pri= vate infrastructure. Now I need other machines with public IPv4 and when I requested the additio= nal IPv4 to the DataCenter, they gave me a bunch of /32 addresses saying that my previous IPv4 MUST be configured as next-hop on their side. =46rom my understanding in FreeBSD the route command is unable to perform this kind of configuration where you tell that the IPv4 /32 is available without next-hop (no via) on a specific link. I know the linux "ip route add $IP dev $LINK" configures this, but I cannot seem to map this knowledge to FreeBSD. Is it possible to perform this very special setup with any command on FreeB= SD? If yes what is that command? Best regards, Diego Abelenda --Sig_/Tx/j76suhfJfH.8BB.lXdTV Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEhLBEGh6nN5+aat9KomT4UAfkGfgFAl9Y6e4ACgkQomT4UAfk GfjLrBAAmYjv1BfWLzB64v7E1+MiyMm9rFvcIsCututEFtZST94CdShtM3WFjvMn eTbLGia4ePHXh753wCxYo9RmhCjX7ZSRdIHJsEe+8zk1iJ4XAP5gCqdpS2tHJzta 9jrfcznmfSbM9tnsbu72mrRu3f88N3SZb8HnSdNJS8thAcfxCb3CCBbUK3SJvQyV bWgL1PfmzvLFFYedSpC4r8TC9s6VZX4FlZwPMlABpdmixW0MbtH+Jn99M0S1y+Iz DocbEPkttfbBUEKraV3KbqDI4jhcEZtIsfR6sPhkOUOvKyBFP21x5kgQezp8aFH9 cUfMLZLiHbL6ZA1sj0iNWsTwj0TxsLS7GX/Zki80AFsRKBi0vAk5xXVQbFUBii6F xXdK4DIDf34158vE/E//4pJC7K/qsYeAapQMayh8+70tsG3Q8Z8vmiIQXQ3m/caB RrffxS5+GpGhZEUgxDQDtl9d5YDGlab09Hid53RZV2kZoOZTMhPnkAXhAa0N1frd +/HkcI5VikL/9I+Yi0Q6Rk489xnPqYly1drg3sngMCDh38z5t4+NFegZFDxrV0Ks lqcRUsqnZ/SAs2adiqVu9uTttMZpuxyFDCgRsyAtEC1ukfv5Jm+ouR7VYUmILETM V0HrpemASJDnjiH1HORPzoQbMDDyOTLtWkjU7iUQMuzhRi/x1B8= =I2qr -----END PGP SIGNATURE----- --Sig_/Tx/j76suhfJfH.8BB.lXdTV-- From owner-freebsd-net@freebsd.org Wed Sep 9 14:49:12 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 77ED53D2E5F for ; Wed, 9 Sep 2020 14:49:12 +0000 (UTC) (envelope-from cristian.cardoso11@gmail.com) Received: from mail-ej1-x634.google.com (mail-ej1-x634.google.com [IPv6:2a00:1450:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmlK31SjQz4M09 for ; Wed, 9 Sep 2020 14:49:10 +0000 (UTC) (envelope-from cristian.cardoso11@gmail.com) Received: by mail-ej1-x634.google.com with SMTP id e23so3985057eja.3 for ; Wed, 09 Sep 2020 07:49:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=DOJnm4O0X/px4T3q7IlKQ3jmtPF0AGoe1Nca0NUFcXE=; b=XDInrFA/JZJ8YmK6xLC86SlZNvhRsrrhDCEMKChVYmAibbj0jHQ9fqAvSkyVQM3wWe F+0JZsNU2L0UHWauUohKHqzpWBiT5NVWYUWEzgy18HdZyQxtSh1t0yIh4/s5mr3eKTDT 7+qnwxt8sxgiYVHt/uT+ZudlEEyu5YhNJG++M7ijvbPPBXWImHrPz/9flUTWgGNCiBT0 AunocTpcA+J5+HNNtaS4/I+F3O9hF9irNZlZrY+zjruZt7od0nNKGfo+sx3t2xsejp/b d+tyZAtfoTQo9IDE+ippubHc1EqHgX3sIpB5bzd8ojI/DxL+9ZYgt1yQHh/d5uuW1mqA WLgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=DOJnm4O0X/px4T3q7IlKQ3jmtPF0AGoe1Nca0NUFcXE=; b=MCeOZVjWWiJv59bCSLfj7NTcPFz0AehVd959YBwXfG6vJGdmwgueLPjlXqEXmbcmfT FhoWcCHDjOE+CN3Uwl0t8lH0fIKZHEXoMXlBmqHWXI/RA37vYxAfa0yWPeBUyIA3oL1k xX0LN+ZVsuiA39t6b6Sm8shW+wrTYRpNCXkr3PkjfyQOeOHfRv5IE5fIfphCLTTNkOt/ r/9iQMmAwaqVk3XR5NG1XzVIzH6dUKJFbkHsCzB7qX3MJxRZL9ZsaGc3kYB3iM9/P79L G20uGchP55jQHo7+iHtOkF3jAWxv2qwbcdnWES6gEyo1rgmDxNSK4R7oVQcIu1oC+PEi y4pg== X-Gm-Message-State: AOAM531ebEgT7EnbBjiYQua4Quwcdi5dH28h6aum6C+muU3n+kzZ3J2Q dlKceBItncSoW73bsbRWZrumG8DYY8+pizAscZbKThRzZafW X-Google-Smtp-Source: ABdhPJwXQUxXHwZ/M60OCEgynTerSDuh7K87djnDBrenclIKcxCfZizqfcuTf1CEy+vQbsBOUQL3iygzLsy6yYvFv/s= X-Received: by 2002:a17:906:8508:: with SMTP id i8mr4228392ejx.390.1599662949264; Wed, 09 Sep 2020 07:49:09 -0700 (PDT) MIME-Version: 1.0 References: <20200909164254.5e7e3891@debian> In-Reply-To: <20200909164254.5e7e3891@debian> From: Cristian Cardoso Date: Wed, 9 Sep 2020 11:48:58 -0300 Message-ID: Subject: Re: IP "routing" issue To: Abelenda Diego Cc: freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4BmlK31SjQz4M09 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=XDInrFA/; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of cristiancardoso11@gmail.com designates 2a00:1450:4864:20::634 as permitted sender) smtp.mailfrom=cristiancardoso11@gmail.com X-Spamd-Result: default: False [-2.81 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.02)[-1.024]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.20)[0.198]; NEURAL_HAM_LONG(-0.98)[-0.984]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::634:from]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 14:49:12 -0000 Hi The equivalent command in FreeBSD for the ip route is the route, follow manpage https://www.freebsd.org/cgi/man.cgi?route Em qua., 9 de set. de 2020 =C3=A0s 11:43, Abelenda Diego escreveu: > > Hello, > > I've got a FreeBSD installation in a DataCenter that provided me with a s= ingle > address IPv4 with an upstream gateway (cidr is fine the upstream gateway = works > everything is nice and running). I use this machine for Masquerading an p= rivate > infrastructure. > > Now I need other machines with public IPv4 and when I requested the addit= ional > IPv4 to the DataCenter, they gave me a bunch of /32 addresses saying that > my previous IPv4 MUST be configured as next-hop on their side. > From my understanding in FreeBSD the route command is unable to perform t= his > kind of configuration where you tell that the IPv4 /32 is available witho= ut > next-hop (no via) on a specific link. I know the linux "ip route add $IP = dev > $LINK" configures this, but I cannot seem to map this knowledge to FreeBS= D. > > Is it possible to perform this very special setup with any command on Fre= eBSD? > If yes what is that command? > > Best regards, > Diego Abelenda From owner-freebsd-net@freebsd.org Wed Sep 9 15:03:13 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F287E3D2F65 for ; Wed, 9 Sep 2020 15:03:13 +0000 (UTC) (envelope-from diego.abelenda@gmail.com) Received: from mail-ej1-x62b.google.com (mail-ej1-x62b.google.com [IPv6:2a00:1450:4864:20::62b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmldF1Slhz4MkG for ; Wed, 9 Sep 2020 15:03:12 +0000 (UTC) (envelope-from diego.abelenda@gmail.com) Received: by mail-ej1-x62b.google.com with SMTP id nw23so4045537ejb.4 for ; Wed, 09 Sep 2020 08:03:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:in-reply-to:references :mime-version; bh=Zz1SjRhp/0Xoq77gMsrcDIsqfXiwMopwO89b2DGyVQ0=; b=cq6Pqo7Ink/NRyhCuVIEDm43EhvAsiCAhSEQMn4r0U7ZrzfYymcDBLspARhj9q9wvP mV6s6pVLoi95rlFLEa6IGfAza0wHB5KMr92zaSEbCkLxaQYfoDmrgt8SuPNxF0Qj6aKK TKli35c/sKAV8DLTr6XTmi3lYbA9VKve1h4Ij3JdY5FbwY5UNq0X4FPJbq11FLmEvcXC 7iHJm3HKMc+oEoE/VLAPVIgYZJlU9KaCxh67vb/twtafk+EnwJF+hc3GmyjozT+AEYGi A94xpIDzGWz0KwlFC+hQAr35FGlVctiSnApJuHNh0aQ9MQNB4g4oxRNdm8U0CYtl+7gI 7JPQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:mime-version; bh=Zz1SjRhp/0Xoq77gMsrcDIsqfXiwMopwO89b2DGyVQ0=; b=dH84cCHVRfESguHJBcwUOYIl44f5qX2Qcx3jP/vmFuraU7SaFqZhwXNSsOrWaQnvDt ZYEsziNRsgl0OnLh+2wKEGo5aZP/2mWTJobErLpkm56bL3PLocrvCStQyq63iI6yImhh XM112kxSBlDTBPP7ETn1+X2gSAuEDLeXpC9v5Y8WOVUrYc/IHHID44KkfekG4gaPi12F JCqPD8DjV86nj5h4io7Fp9aezST6tjAkQpylRYG6zFRBxXRXTCAPGL4wAGwr/uKgTViE GFwRptmUV8X9hIh7nc+mGcxXhoAqCRiOuw9PgIAkZH9Zcu9GVgEbpfuRfXSldqbvLfeM 6ceQ== X-Gm-Message-State: AOAM530RWX3umOKVC7XbOF5g5SLOQptMyzEi030gO7d9pLHDAkSVZI/g DeVC4NdE4ie2RVFJ0+bS+wQ= X-Google-Smtp-Source: ABdhPJzC/TRgkTOgAmWicorCcP3E1AHQwlmG7SWZHiGjobX+b4K4+OyWyy0Jf5hmpZt/4BcT0sz6DQ== X-Received: by 2002:a17:906:2dc1:: with SMTP id h1mr4002808eji.436.1599663791161; Wed, 09 Sep 2020 08:03:11 -0700 (PDT) Received: from debian (72.199.5.85.dynamic.wline.res.cust.swisscom.ch. [85.5.199.72]) by smtp.gmail.com with ESMTPSA id s21sm2668870edw.23.2020.09.09.08.03.10 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 09 Sep 2020 08:03:10 -0700 (PDT) Date: Wed, 9 Sep 2020 17:03:05 +0200 From: Abelenda Diego To: Cristian Cardoso Cc: freebsd-net@freebsd.org Subject: Re: IP "routing" issue Message-ID: <20200909170305.3f8610c7@debian> In-Reply-To: References: <20200909164254.5e7e3891@debian> X-Mailer: Claws Mail 3.17.6 (GTK+ 2.24.32; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/JEJm3K3pUBY2+N5BPa8Uijp"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Rspamd-Queue-Id: 4BmldF1Slhz4MkG X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=cq6Pqo7I; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of diegoabelenda@gmail.com designates 2a00:1450:4864:20::62b as permitted sender) smtp.mailfrom=diegoabelenda@gmail.com X-Spamd-Result: default: False [-2.24 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.02)[-1.022]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RECEIVED_SPAMHAUS_PBL(0.00)[85.5.199.72:received]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.37)[0.366]; NEURAL_HAM_LONG(-0.99)[-0.988]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62b:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 15:03:14 -0000 --Sig_/JEJm3K3pUBY2+N5BPa8Uijp Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hello Cristian, Thank you for your pointer, however if I quote part of my question: > From my understanding in FreeBSD the route command is unable to perform t= his > kind of configuration where you tell that the IPv4 /32 is available witho= ut > next-hop (no via) on a specific link. I imply there that I read the man, tried quite a few things with the "route" command and could not get anything out of it. Best regards, Diego Abelenda On Wed, 9 Sep 2020 11:48:58 -0300 Cristian Cardoso wrote: > Hi > The equivalent command in FreeBSD for the ip route is the route, > follow manpage https://www.freebsd.org/cgi/man.cgi?route >=20 > Em qua., 9 de set. de 2020 =C3=A0s 11:43, Abelenda Diego > escreveu: > > > > Hello, > > > > I've got a FreeBSD installation in a DataCenter that provided me with a > > single address IPv4 with an upstream gateway (cidr is fine the upstream > > gateway works everything is nice and running). I use this machine for > > Masquerading an private infrastructure. > > > > Now I need other machines with public IPv4 and when I requested the > > additional IPv4 to the DataCenter, they gave me a bunch of /32 addresses > > saying that my previous IPv4 MUST be configured as next-hop on their si= de. > > From my understanding in FreeBSD the route command is unable to perform= this > > kind of configuration where you tell that the IPv4 /32 is available wit= hout > > next-hop (no via) on a specific link. I know the linux "ip route add $I= P dev > > $LINK" configures this, but I cannot seem to map this knowledge to Free= BSD. > > > > Is it possible to perform this very special setup with any command on > > FreeBSD? If yes what is that command? > > > > Best regards, > > Diego Abelenda =20 --Sig_/JEJm3K3pUBY2+N5BPa8Uijp Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEhLBEGh6nN5+aat9KomT4UAfkGfgFAl9Y7qkACgkQomT4UAfk Gfh0oA/9Evbwlb38+g8jYhdgq+gSiZSnIYEDbnek/fbCtp4gtEZLKJ8op9G8+E/3 BMdnpJSKgXpJeueGVESAiNOaxssolkNNm1FcZt78dnbr641SJPFBRgprdAG8wXJD eWxzEN5C8mR8rqslRPr43+nEojwF0QXnfnt/RChSTBgUz9KrxGYlBsq03Yf3nUAU YQNhN2QRBBdIsItEFXTPYy7EYMdbRH8HCNQ/jbDzDe1HXheCJZyA36KSbGv4R08I o6BcdjQQzpL9TzZFczxzfJlxPVBCfnYxdbJqgNo90V9BaFyFTmBAUK6veX2IkBjO 1VkmaiaiB530V+JVRTRjmGe7kNT/YpwEhxU3WYmiyM3V5Y4CvvOiEG53OK44kfLT 6dKgoa4VYOkjO5amNL6cyJ0Annapmx6TeT8RI+oTL5SMEMfnjrh3y3kOWEoked1S NiC/zMTjbyQ/h5gwf6PDzTgmnokidmqjpCudzyL4cOj/9cog8mUuDEIxOla+iFMJ Q0+sjeos4DqvVhgSznOgO8+6hYVcQhH/et3H2Jnv1DbpXLDDCR7fgSyHIVUJlfk8 ZVl5EXRUBLlivyaUH1Xnp9HJOwP45JRxMU75zrvTpOWVKzyCt+x0iKxS06ck8/JI SFrdmlbMAdLzJzD3s2xQWOYwG8epjMJgkWy7+31oxGqfLNmmJEU= =/vXA -----END PGP SIGNATURE----- --Sig_/JEJm3K3pUBY2+N5BPa8Uijp-- From owner-freebsd-net@freebsd.org Wed Sep 9 15:35:59 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 071953D41AB for ; Wed, 9 Sep 2020 15:35:59 +0000 (UTC) (envelope-from kisscoolandthegangbang@hotmail.fr) Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01olkn080e.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe02::80e]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmmM15X5Sz4PJG for ; Wed, 9 Sep 2020 15:35:57 +0000 (UTC) (envelope-from kisscoolandthegangbang@hotmail.fr) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=a0aja0jdDGmoQ0wwbw1Zy3bIFn8Z3DBC4NUJOMNrLq9nPs2KeTQBWgu/Uq4snWo+6pIl7yNIq53XxLex/j6fhm79i8UUMjO12uyFSQc2eJ3kbkXi0VYcARnO1XG8EQPE8u1DOw9vkj5Sm8zbU/UjhdaU3/cyouav5h8+HwFJ8aqx7mSXcf128lAdtIR9VkEBLs60Gf/MXPI1ofQ7A9geHLEWttULONRv9vfvAT12PNnYDenNdh2wV3j5tfzgAMHUlWbDbxS4OXwPHBetw+zTZ+EObo9ZiH+dVGqYWYsoHb0YsK946KdgNcRpK88rMqkjbN2P//WxLYUgzDZD9gb7MQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=T/9m3MHiL8o/90Hdjyvjju5UWCt6ALHCWv2zZmyxY8M=; b=R8ELQjTj8tCXS7A3INxbULMycGXXUJL9jXa21pU+cdIHCDp0oXocNvMpQc93PRDjrKLihA6LYD4beP1B6Xpggz020lgXQYjQieVhbxroA4AXHQX/QyiESC385jqu71hYm6XAxDNMS3tA5ThBpUl6udWR3NCU7tEr5jWD4OXoSfButvqKf1sQA0v5Z4PgBQQi6X51su0TuFI7HLkGpmJaRYUJSULKQ7GPbMtj5/FcyIx9FzlobpIlnk3wN6Vbk3ciD68iPvpqnEMhZlXdIKLscmbbQ4uJPB2p2s1SAumEB482gPTfPQGhqkpxkMT5UJGI4TXWRVy7IpDbpLyYYAiAdQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none Received: from DB5EUR01FT064.eop-EUR01.prod.protection.outlook.com (2a01:111:e400:7e1a::42) by DB5EUR01HT171.eop-EUR01.prod.protection.outlook.com (2a01:111:e400:7e1a::299) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16; Wed, 9 Sep 2020 15:35:55 +0000 Received: from VE1PR03MB5629.eurprd03.prod.outlook.com (2a01:111:e400:7e1a::45) by DB5EUR01FT064.mail.protection.outlook.com (2a01:111:e400:7e1a::339) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16 via Frontend Transport; Wed, 9 Sep 2020 15:35:55 +0000 X-IncomingTopHeaderMarker: OriginalChecksum:C71EA9C692F150ACFD1087835474CD4496CB8AFE9F646839D80B2A3014DBD5A4; UpperCasedChecksum:FBA8C6CE4B3A3EFF436DEEE1EACF3E978EF04303894FD8F0FF25F56BE53E3471; SizeAsReceived:3760; Count:48 Received: from VE1PR03MB5629.eurprd03.prod.outlook.com ([fe80::503d:80ba:aa8b:f71d]) by VE1PR03MB5629.eurprd03.prod.outlook.com ([fe80::503d:80ba:aa8b:f71d%2]) with mapi id 15.20.3370.016; Wed, 9 Sep 2020 15:35:54 +0000 Date: Wed, 9 Sep 2020 17:35:45 +0200 From: kaycee gb To: freebsd-net@freebsd.org Subject: Re: IP "routing" issue Message-ID: In-Reply-To: <20200909164254.5e7e3891@debian> References: <20200909164254.5e7e3891@debian> X-Mailer: Claws Mail 3.17.4 (GTK+ 2.24.31; x86_64-slackware-linux-gnu) Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: AM0PR06CA0112.eurprd06.prod.outlook.com (2603:10a6:208:ab::17) To VE1PR03MB5629.eurprd03.prod.outlook.com (2603:10a6:803:11e::30) X-Microsoft-Original-Message-ID: <20200909173545.37a6b6c7@slackstro.home.lan> MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from mail.lacabanedeladmin.trickip.net (93.1.37.139) by AM0PR06CA0112.eurprd06.prod.outlook.com (2603:10a6:208:ab::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16 via Frontend Transport; Wed, 9 Sep 2020 15:35:54 +0000 Received: from slackstro.home.lan ([172.16.93.19]) (authenticated bits=0) by mail.lacabanedeladmin.trickip.net (8.15.2/8.15.2) with ESMTPSA id 089FZ8Ox090681 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NO) for ; Wed, 9 Sep 2020 17:35:50 +0200 (CEST) (envelope-from kisscoolandthegangbang@hotmail.fr) X-Mailer: Claws Mail 3.17.4 (GTK+ 2.24.31; x86_64-slackware-linux-gnu) X-Microsoft-Original-Message-ID: <20200909173545.37a6b6c7@slackstro.home.lan> X-TMN: [MZRNGGL2+HiVM0lnVkkXXNeL/E+6u/2Y] X-MS-PublicTrafficType: Email X-IncomingHeaderCount: 48 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-Correlation-Id: 1f69dc03-3309-4636-3597-08d854d60a3b X-MS-TrafficTypeDiagnostic: DB5EUR01HT171: X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: cOtzJFRN5HHgKeTU34tNDUDiPO+OPRSQLQNZ9b+iDjV26i0eUCU6bD4T5jTrNaLb3i22mBBtflt3nizgloIksCOr702IB0GEKNyVr4HwFvv/J/WX3/8sZjbosPuCOm8TRi7oVDJyKGdY+OyYk8/PwuQyqRWqDtgoX1bfTwNEue4tm5JRPIC6AHvmAdbm8aRY X-MS-Exchange-AntiSpam-MessageData: OUjP+CtRHmHL4nwdedhZtIrMt8LpU3pAXhTppdqCtb5mWlFPB0Re/ZAiMav1y3fKMjEwh9zanHVuQPVkgsVR15jgvnnuiMy8tvcansl+dldYOvJzn2l5jADDjpNBXBoP36zHsoRbDNOVn5yuqdNDuw== X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1f69dc03-3309-4636-3597-08d854d60a3b X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Sep 2020 15:35:54.7050 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-CrossTenant-AuthSource: DB5EUR01FT064.eop-EUR01.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: Internet X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5EUR01HT171 X-Rspamd-Queue-Id: 4BmmM15X5Sz4PJG X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=hotmail.fr; spf=pass (mx1.freebsd.org: domain of kisscoolandthegangbang@hotmail.fr designates 2a01:111:f400:fe02::80e as permitted sender) smtp.mailfrom=kisscoolandthegangbang@hotmail.fr X-Spamd-Result: default: False [-4.52 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_ENVFROM(0.00)[hotmail.fr]; RCVD_COUNT_FIVE(0.00)[6]; RECEIVED_SPAMHAUS_PBL(0.00)[93.1.37.139:received]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[hotmail.fr]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-0.97)[-0.973]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; NEURAL_HAM_SHORT(-0.75)[-0.746]; DMARC_POLICY_ALLOW(-0.50)[hotmail.fr,none]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 15:35:59 -0000 Le Wed, 9 Sep 2020 16:42:54 +0200, Abelenda Diego a =E9crit : > Hello, >=20 > I've got a FreeBSD installation in a DataCenter that provided me with a s= ingle > address IPv4 with an upstream gateway (cidr is fine the upstream gateway = works > everything is nice and running). I use this machine for Masquerading an > private infrastructure. >=20 > Now I need other machines with public IPv4 and when I requested the addit= ional > IPv4 to the DataCenter, they gave me a bunch of /32 addresses saying that > my previous IPv4 MUST be configured as next-hop on their side. > From my understanding in FreeBSD the route command is unable to perform t= his > kind of configuration where you tell that the IPv4 /32 is available witho= ut > next-hop (no via) on a specific link. I know the linux "ip route add $IP = dev > $LINK" configures this, but I cannot seem to map this knowledge to FreeBS= D. >=20 > Is it possible to perform this very special setup with any command on Fre= eBSD? > If yes what is that command? >=20 > Best regards, > Diego Abelenda Hi, Do the other machines have a private address ? Is it a problem if they have= one ?=20 If it is possible, you can route via this private address on your FreeBSD installation to the new one and assign a public/32 to the last. Alternatively to doing routing like above, if you have a firewall enabled o= n the first machine, you can do address forwarding between the first and the new = one.=20 And last, maybe with something like -iface from "route" you can achieve wha= t you want.=20 K. From owner-freebsd-net@freebsd.org Wed Sep 9 15:44:33 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8EA1C3D4533 for ; Wed, 9 Sep 2020 15:44:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BmmXx3DmTz4Q9C for ; Wed, 9 Sep 2020 15:44:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6EF6A3D4532; Wed, 9 Sep 2020 15:44:33 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6EC1B3D482E for ; Wed, 9 Sep 2020 15:44:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmmXx1HKWz4Q6d for ; Wed, 9 Sep 2020 15:44:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 1092623E23 for ; Wed, 9 Sep 2020 15:44:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 089FiWp1060319 for ; Wed, 9 Sep 2020 15:44:32 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 089FiWgn060318 for net@FreeBSD.org; Wed, 9 Sep 2020 15:44:32 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 245152] urndis(4) Inseego/Novatel Wireless MiFi 8800/8000 as urndis0 4g/LTE RNDIS fails to tether Date: Wed, 09 Sep 2020 15:44:31 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: lwhsu@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 15:44:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245152 --- Comment #10 from Li-Wen Hsu --- (In reply to rootless from comment #9) hi, the patch looks fine, and can you confirm that the ue0 is working? --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Wed Sep 9 17:15:39 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 251463D687D for ; Wed, 9 Sep 2020 17:15:39 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmpZ16v8yz4W1p for ; Wed, 9 Sep 2020 17:15:37 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id 089HFKhO052182 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 9 Sep 2020 17:15:23 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: freebsd-net@freebsd.org Received: from [10.58.0.10] (dadv@dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.16.1/8.16.1) with ESMTPS id 089HFNTm021479 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Thu, 10 Sep 2020 00:15:23 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: IP "routing" issue To: Abelenda Diego , freebsd-net@freebsd.org References: <20200909164254.5e7e3891@debian> From: Eugene Grosbein Message-ID: <2bba0bee-df34-f0d5-53d6-0190a58b21ec@grosbein.net> Date: Thu, 10 Sep 2020 00:15:20 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <20200909164254.5e7e3891@debian> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.3 required=5.0 tests=BAYES_00,LOCAL_FROM, NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains * -1.6 NICE_REPLY_A Looks like a legit reply (A) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 4BmpZ16v8yz4W1p X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-2.47 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[eugen]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.990]; NEURAL_HAM_LONG(-0.97)[-0.967]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.41)[-0.414]; FREEMAIL_TO(0.00)[gmail.com,freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 17:15:39 -0000 09.09.2020 21:42, Abelenda Diego wrote: > I've got a FreeBSD installation in a DataCenter that provided me with a single > address IPv4 with an upstream gateway (cidr is fine the upstream gateway works > everything is nice and running). I use this machine for Masquerading an private > infrastructure. > > Now I need other machines with public IPv4 and when I requested the additional > IPv4 to the DataCenter, they gave me a bunch of /32 addresses saying that > my previous IPv4 MUST be configured as next-hop on their side. > From my understanding in FreeBSD the route command is unable to perform this > kind of configuration where you tell that the IPv4 /32 is available without > next-hop (no via) on a specific link. I know the linux "ip route add $IP dev > $LINK" configures this, but I cannot seem to map this knowledge to FreeBSD. > > Is it possible to perform this very special setup with any command on FreeBSD? > If yes what is that command? This setup is not special and FreeBSD can do it, of course. route add 1.1.1.1/32 2.2.2.2 route add 1.1.2.1/32 -iface vtnet0 In this example 2.2.2.2 plays role of your old public IP and 1.1.X.X are for new addresses routed via 2.2.2.2 or directly to interface vtnet0. And there is rc.conf settings "static_routes" to create such setup: static_routes="host1 host2 host3" route_host1="1.1.1.1/32 2.2.2.2" route_host2="1.1.2.1/32 -iface vtnet0" This is documented with route(8) and rc.conf(5) manual pages. In case of P2P interface such variants have no real difference other than used way to specify outgoing interface: by next-hop address or by interface name. P2P interface may have no address assigned for remote side. In case of Ethernet-link interface the difference is related to underlying ARP protocol cache, will it be asked for MAC address of specified next-hop or directly for MAC address of target like 1.1.2.1. From owner-freebsd-net@freebsd.org Wed Sep 9 17:43:37 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F35B73D7230 for ; Wed, 9 Sep 2020 17:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BmqBK68Jkz4XYC for ; Wed, 9 Sep 2020 17:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D30ED3D722F; Wed, 9 Sep 2020 17:43:37 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D2DA83D69BB for ; Wed, 9 Sep 2020 17:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmqBK5Kq9z4XVb for ; Wed, 9 Sep 2020 17:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9AA1324B7D for ; Wed, 9 Sep 2020 17:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 089HhbFY015069 for ; Wed, 9 Sep 2020 17:43:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 089Hhb4F015068 for net@FreeBSD.org; Wed, 9 Sep 2020 17:43:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 245152] urndis(4) Inseego/Novatel Wireless MiFi 8800/8000 as urndis0 4g/LTE RNDIS fails to tether Date: Wed, 09 Sep 2020 17:43:37 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: rootless@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 17:43:38 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245152 --- Comment #11 from rootless@gmail.com --- (In reply to Li-Wen Hsu from comment #10) I can confirm that it works when this patch is applied. It has been working with my device without a problem since I submitted the patch. I know others are using it successfully in OpnSense too. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Sep 10 16:54:08 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 19F393DDAD1 for ; Thu, 10 Sep 2020 16:54:08 +0000 (UTC) (envelope-from diego.abelenda@gmail.com) Received: from mail-ej1-x636.google.com (mail-ej1-x636.google.com [IPv6:2a00:1450:4864:20::636]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnQ2l2fWWz4K0Q for ; Thu, 10 Sep 2020 16:54:07 +0000 (UTC) (envelope-from diego.abelenda@gmail.com) Received: by mail-ej1-x636.google.com with SMTP id o8so9715230ejb.10 for ; Thu, 10 Sep 2020 09:54:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:in-reply-to:references :mime-version; bh=vD0g8QeaYtcyIxQ6053ZQLwMlOjo2b7M67YdBhHpHsk=; b=Sy49HoqAseZJEvf7PMQDlderAnK/64gGdKme8NN5dnNqowNLsh4tU+G6IjEOafsQx3 tFnfwljEk/7dZvvYRnTvZmSgVdO06mJnhD3cUzmW48CVxMOCGMxOt5Pqxc/nPJH5swAQ nXJx86eNUXntFHeLWQKnX0Lvy9M5ChhhiDz8v4SVDBkdyi38LVnvmJ/RnkPwVJPJIGcu tzNnmYT8SPtxONJoY37IrwwdSU/fk7ctgWyklWkzEkPPyl06ACbL/sAI7sX90ijOGEnp 16Ze/5x3ZntGgIb5yruHB7xSH67E2yh1VnY1WdpqbqbphcZd8Pt84uoNyuqbZ/Fkrdos L+vQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:mime-version; bh=vD0g8QeaYtcyIxQ6053ZQLwMlOjo2b7M67YdBhHpHsk=; b=RaWzDmD3kJQwBmuoSx09b2GcSHuwIIBeYFA0V8eEMImoAp5Xxj+Yj00Icaj0J1tjlJ 5wAGMHzNGkHB1PyYOu0nObHDSLEvYVueJLFDDL2aBLP52j8c6SSHKSYFUWBADk+ZgX7h 1eTYXGqBsZpmvln2kCJrKUJiTOeALdSJILLN3CAWfQg3wWA3PB750dLBcsG7nRhuvePr J4t1mpcxecV/DV7vFPtSLyAL22ijq80ox4wPXNqoJk1v+XoeEJt+zU7DsZci2Qn19yc0 VgPWHmtLywJkX1xT6CXOpx+FV1nKu0yGYsU6JlW1VZBCBDTSO+3eU+ykYHueh3Lu/qMc xQHw== X-Gm-Message-State: AOAM532DApV0EOb8IuN/sFWzVrbU0UwVo7WJnO2bVwbia9vE544Uv17D FEPu3EyFF8WgJWFfLd6vL0QlP40F8ZE= X-Google-Smtp-Source: ABdhPJyK3V8Jo+4kiC5U+MM47hqJEDH+u2fufDRdQuz3v4L37DKxPNKoM1e2yE7AdcRQkdxz3tTLmg== X-Received: by 2002:a17:906:ca4f:: with SMTP id jx15mr9642608ejb.454.1599756845293; Thu, 10 Sep 2020 09:54:05 -0700 (PDT) Received: from debian (72.199.5.85.dynamic.wline.res.cust.swisscom.ch. [85.5.199.72]) by smtp.gmail.com with ESMTPSA id t6sm8222989ejc.40.2020.09.10.09.54.04 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 10 Sep 2020 09:54:04 -0700 (PDT) Date: Thu, 10 Sep 2020 18:54:00 +0200 From: Abelenda Diego To: kaycee gb Cc: freebsd-net@freebsd.org Subject: Re: IP "routing" issue Message-ID: <20200910185400.593a8ce2@debian> In-Reply-To: References: <20200909164254.5e7e3891@debian> X-Mailer: Claws Mail 3.17.6 (GTK+ 2.24.32; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/rSIssGkG0.YGV=Q1AVVY660"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Rspamd-Queue-Id: 4BnQ2l2fWWz4K0Q X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Sy49HoqA; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of diegoabelenda@gmail.com designates 2a00:1450:4864:20::636 as permitted sender) smtp.mailfrom=diegoabelenda@gmail.com X-Spamd-Result: default: False [-2.38 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[hotmail.fr]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.955]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RECEIVED_SPAMHAUS_PBL(0.00)[85.5.199.72:received]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.16)[0.162]; NEURAL_HAM_LONG(-0.98)[-0.985]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::636:from]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Sep 2020 16:54:08 -0000 --Sig_/rSIssGkG0.YGV=Q1AVVY660 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hello, Thank you for pointing route "-iface" however I can't seem to manage what I want. When I use: "route add -host $IP_NOT_IN_SUBNET -iface bce0" I get "netstat -rn" to say someting like: Internet: Destination Gateway Flags Netif Expire default $UPSTREAM_GW UGS bce0 10.0.0.1 link#7 UHS lo0 $IP_NO_IN_SUBNET $MAC_ADDRESS_OF_BCE0 UHS bce0 Which seem somehow appropriate, so I try to ping $IP_NOT_IN_SUBNET and I ge= t: root@opnsense2:~ # ping $IP_NOT_IN_SUBNET PING $IP_NOT_IN_SUBNET ($IP_NOT_IN_SUBNET): 56 data bytes 36 bytes from $UPSTREAM_GW: Redirect Host(New addr: $PUBLIC_IP_OF_BCE0). Which doesn't seem appropriate at all wrt the routing table... Did I use "route add" wrong? Also I want to keep the setup simple, going through private IPs on the publ= ic VLAN of the datacenter might get me in trouble with them, and using othe= r VLANs for that will be a pain. Best regards, Diego Abelenda On Wed, 9 Sep 2020 17:35:45 +0200 kaycee gb wrote: > Le Wed, 9 Sep 2020 16:42:54 +0200, > Abelenda Diego a =C3=A9crit : >=20 > > Hello, > >=20 > > I've got a FreeBSD installation in a DataCenter that provided me with a > > single address IPv4 with an upstream gateway (cidr is fine the upstream > > gateway works everything is nice and running). I use this machine for > > Masquerading an private infrastructure. > >=20 > > Now I need other machines with public IPv4 and when I requested the > > additional IPv4 to the DataCenter, they gave me a bunch of /32 addresses > > saying that my previous IPv4 MUST be configured as next-hop on their si= de. > > From my understanding in FreeBSD the route command is unable to perform= this > > kind of configuration where you tell that the IPv4 /32 is available wit= hout > > next-hop (no via) on a specific link. I know the linux "ip route add $I= P dev > > $LINK" configures this, but I cannot seem to map this knowledge to Free= BSD. > >=20 > > Is it possible to perform this very special setup with any command on > > FreeBSD? If yes what is that command? > >=20 > > Best regards, > > Diego Abelenda =20 >=20 > Hi, >=20 > Do the other machines have a private address ? Is it a problem if they ha= ve > one ?=20 > If it is possible, you can route via this private address on your FreeBSD > installation to the new one and assign a public/32 to the last. >=20 > Alternatively to doing routing like above, if you have a firewall enabled= on > the first machine, you can do address forwarding between the first and the > new one.=20 >=20 > And last, maybe with something like -iface from "route" you can achieve w= hat > you want.=20 >=20 > K. > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" --Sig_/rSIssGkG0.YGV=Q1AVVY660 Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEhLBEGh6nN5+aat9KomT4UAfkGfgFAl9aWigACgkQomT4UAfk GfhHjxAAgGjAFo1KmLydR2NllqZOikChu0bG/2T7dCgg7s1Qfw2ndTVWDkGOY/Kg kfajr4pZj7LIq2Or7Z2vmkjK1dAZLdgsoXP8p9yEFhtGkhGoLw4qRsL9YJ1UQDpR GdjKtbDqq0xgLfKzHFnAOF2Iv7hfAhi2Rzgmtxkp4OQDmiAmFp+B/j/B5ndgaf1u xf1i1HfmAGZRVZebt1WLChRdpQHERW2EwIOflQ4XOnDg1wxsVknd0kTobwMCkTpX Q6SIBxk/qXIPouUS8GprHRdGJeuJYO92GCNk1Nrlztrw1v+p4+JbkCHzPQ7lleVn 1lb6z3zxrSND/jOMtL6Xg1mIIywFTcGiHbojSlPfH+UJM4IZgopXRe7HvBGlC+HR GM5IpW7vwhd8b6jAUGZid581Z/n5n+Ni6dTXLpvgpB4XiiD52lO+he3zUVPGBZes TJCrnKEUSyeTG8a2ilBQXkCDTFpFKOteu13zAOdw2o4lQw2cj9mYeZUCycnnNJlo To61v66qpu39G4AfH09zMikI9FhQ5flJqFGOtXgBv+9gdlQ2LrYTwiGG8U2kycz7 eT52I7lyqbSSK0UMr1wWdU4bZKgUyrWKAyin4vcmE25m38Uypoda0L8a9lLEXadg a5liQGA2RUsIAg03SujF0V3I8ibI4vohn3LAZ0hSP5q3MqaPgwI= =dYqQ -----END PGP SIGNATURE----- --Sig_/rSIssGkG0.YGV=Q1AVVY660-- From owner-freebsd-net@freebsd.org Thu Sep 10 17:20:41 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 156B23DEBD6 for ; Thu, 10 Sep 2020 17:20:41 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnQdM6RFkz4M5d for ; Thu, 10 Sep 2020 17:20:39 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id 08AHKNe5075064 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 10 Sep 2020 17:20:24 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: kisscoolandthegangbang@hotmail.fr Received: from [10.58.0.10] (dadv@dadvw [10.58.0.10]) by eg.sd.rdtc.ru (8.16.1/8.16.1) with ESMTPS id 08AHKN0Y033333 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Fri, 11 Sep 2020 00:20:23 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: IP "routing" issue To: Abelenda Diego , kaycee gb References: <20200909164254.5e7e3891@debian> <20200910185400.593a8ce2@debian> Cc: freebsd-net@freebsd.org From: Eugene Grosbein Message-ID: Date: Fri, 11 Sep 2020 00:20:20 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <20200910185400.593a8ce2@debian> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-3.3 required=5.0 tests=BAYES_00,LOCAL_FROM, NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS autolearn=ham autolearn_force=no version=3.4.2 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 SPF_HELO_NONE SPF: HELO does not publish an SPF Record * -0.0 SPF_PASS SPF: sender matches SPF record * 2.6 LOCAL_FROM From my domains * -3.6 NICE_REPLY_A Looks like a legit reply (A) X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on hz.grosbein.net X-Rspamd-Queue-Id: 4BnQdM6RFkz4M5d X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism not recognized by this client) smtp.mailfrom=eugen@grosbein.net X-Spamd-Result: default: False [-2.08 / 15.00]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[eugen]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-0.88)[-0.880]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[grosbein.net]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; NEURAL_HAM_SHORT(-0.19)[-0.193]; NEURAL_HAM_MEDIUM(-0.91)[-0.907]; FREEMAIL_TO(0.00)[gmail.com,hotmail.fr]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Sep 2020 17:20:41 -0000 10.09.2020 23:54, Abelenda Diego wrote: > Thank you for pointing route "-iface" however I can't seem to manage what I > want. > > When I use: > "route add -host $IP_NOT_IN_SUBNET -iface bce0" > > I get "netstat -rn" to say someting like: > > Internet: > Destination Gateway Flags Netif Expire > default $UPSTREAM_GW UGS bce0 > 10.0.0.1 link#7 UHS lo0 > $IP_NO_IN_SUBNET $MAC_ADDRESS_OF_BCE0 UHS bce0 > > > Which seem somehow appropriate, so I try to ping $IP_NOT_IN_SUBNET and I get: > > root@opnsense2:~ # ping $IP_NOT_IN_SUBNET > PING $IP_NOT_IN_SUBNET ($IP_NOT_IN_SUBNET): 56 data bytes > 36 bytes from $UPSTREAM_GW: Redirect Host(New addr: $PUBLIC_IP_OF_BCE0). > > Which doesn't seem appropriate at all wrt the routing table... Such route means that an attempt to send any packet to the IP in question results in broadcast ARP query for destination IP sent out of bce0. It seems your upstream has arp proxy enabled, so it sends ARP reply with its MAC address making your host send IP packet to $UPSTREAM_GW, but its routing table points back to your $PUBLIC_IP_OF_BCE0, hence redirection is generated. You should not use "-iface bce0" but right interface name pointing to host having target IP address. And if your own host has it, you do not need to add any route at all, but assign additional IP as alias to bce0. From owner-freebsd-net@freebsd.org Thu Sep 10 17:56:10 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 475CD3DFB05 for ; Thu, 10 Sep 2020 17:56:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BnRQL1FCvz4Q5s for ; Thu, 10 Sep 2020 17:56:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2A3FA3DFD92; Thu, 10 Sep 2020 17:56:10 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2A07F3DFB04 for ; Thu, 10 Sep 2020 17:56:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnRQL0GgRz4Q5r for ; Thu, 10 Sep 2020 17:56:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id E058C16C19 for ; Thu, 10 Sep 2020 17:56:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08AHu9Om069990 for ; Thu, 10 Sep 2020 17:56:09 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08AHu9jk069989 for net@FreeBSD.org; Thu, 10 Sep 2020 17:56:09 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 245152] urndis(4) Inseego/Novatel Wireless MiFi 8800/8000 as urndis0 4g/LTE RNDIS fails to tether Date: Thu, 10 Sep 2020 17:56:10 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: hselasky@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Sep 2020 17:56:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245152 Hans Petter Selasky changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |hselasky@FreeBSD.org --- Comment #12 from Hans Petter Selasky --- Go ahead. Don't forget to MFC to 11 and 12. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Thu Sep 10 18:28:25 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7BF853E0A73 for ; Thu, 10 Sep 2020 18:28:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4BnS7Y2kJLz4Spp for ; Thu, 10 Sep 2020 18:28:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 5D7D03E09F5; Thu, 10 Sep 2020 18:28:25 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5D47C3E0C07 for ; Thu, 10 Sep 2020 18:28:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnS7Y1q7lz4Spn for ; Thu, 10 Sep 2020 18:28:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 21C5A16E5F for ; Thu, 10 Sep 2020 18:28:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08AISPII003151 for ; Thu, 10 Sep 2020 18:28:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08AISPGh003150 for net@FreeBSD.org; Thu, 10 Sep 2020 18:28:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 245152] urndis(4) Inseego/Novatel Wireless MiFi 8800/8000 as urndis0 4g/LTE RNDIS fails to tether Date: Thu, 10 Sep 2020 18:28:25 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: usb@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Sep 2020 18:28:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245152 --- Comment #13 from commit-hook@FreeBSD.org --- A commit references this bug: Author: lwhsu Date: Thu Sep 10 18:27:52 UTC 2020 New revision: 365606 URL: https://svnweb.freebsd.org/changeset/base/365606 Log: urndis(4): Add support of Inseego/Novatel Wireless MiFi 8800/8000 PR: 245152 Submitted by: rootless@gmail.com Reviewed by: hselasky MFC after: 3 days Changes: head/sys/dev/usb/net/if_urndis.c --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Fri Sep 11 08:01:33 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5C98F3D1537 for ; Fri, 11 Sep 2020 08:01:33 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bnp9n0gQzz40XH for ; Fri, 11 Sep 2020 08:01:33 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: by mailman.nyi.freebsd.org (Postfix) id 16BCF3D1169; Fri, 11 Sep 2020 08:01:33 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 165C03D1376; Fri, 11 Sep 2020 08:01:33 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bnp9m12vbz40ht; Fri, 11 Sep 2020 08:01:32 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 83599AD8; Fri, 11 Sep 2020 03:47:44 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Fri, 11 Sep 2020 03:47:44 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mm.st; h=to:from :subject:message-id:date:mime-version:content-type :content-transfer-encoding; s=fm1; bh=MVoAlHM9vyv1hjXPOOTC6enCaC sDz6jaxaqyDDiHkxg=; b=SzhbqLDN/4YhJcn4iFgdizVH51pkhrxIfc3vCX8OSn iVqnX/8Opj4NyKX7ljmI9YXmLVJoTBDnViYRcPrfITaXM+0J9Imbd9hphTGg0bFS eLcJVrgmjO2hSZqYsxGQeX7vlerB/eSy6DXve3V/hCGcSXA2FiR3BnRmhsa/nS4B +rqpH+z9gDNqts2BPNdMoMp6El5xpDBY5SUnM/OCPWFc8y6ZbAbFZFhQ8Fgb7p7M VW3nIWKTT6xndc/mUQ8jPsg0ZK7oj5rmLS/J2ii+2h+I2Im1lLiy6QuzlPB+TUb0 g5wcXeUtaI/SdVceixGfujCFAn9G5gz9FNsU3dyUrteg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:message-id:mime-version:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=MVoAlH M9vyv1hjXPOOTC6enCaCsDz6jaxaqyDDiHkxg=; b=YzOWQKL4KgHRTiQ6EPh11Y LF+bkNepglUeZF3ueB2rIswq2TlZdyefVUG5nNOUcBzCEqDOFE5BPznw6m2xd+Wv 0zrOrC2P2GVx6z3m0U0Y7EFiHMgVXUe3CnR+z9xgXFncdPsrZZpi1u4j9+ZMl4Mv E0q+PyuTmty+duU8mHhmyCpI+MN4YtMxj/kDWwtdVztjiLYnNcLjF900XzjhKaC4 /8TiY9bEpYCtWb03JVs+AIsWeDeYdVqZWLSMqIeCjYfB3MPrehaNpwIsMcZySYlR clj4aor40laHraqC0rHFqJx/sdj3c4zCHzJ7Pklq5du4OmeyX8E16HSr0l0/eRAg == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudehkedguddvhecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepvffhuffkffgfgggtgfesthejre dttdefjeenucfhrhhomhepgihtohhuqhhhsehmmhdrshhtnecuggftrfgrthhtvghrnhep hfdtfeeihedtgedtheekvefggeefieeviedufeevtdejueffueeuvedugedtudfgnecukf hppeeluddrvdegtddruddvgedrudeltdenucfuphgrmhfkphfpvghtfihorhhkpeeluddr vdegtddruddvgedrudeltdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmh grihhlfhhrohhmpeigthhouhhqhhesmhhmrdhsth X-ME-Proxy: Received: from mercury.lan (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id 5C9B1328005E; Fri, 11 Sep 2020 03:47:43 -0400 (EDT) To: current@freebsd.org, net@freebsd.org From: xtouqh@mm.st Subject: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited Message-ID: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> Date: Fri, 11 Sep 2020 10:47:41 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bnp9m12vbz40ht X-Spamd-Bar: ++++++++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=mm.st header.s=fm1 header.b=SzhbqLDN; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=YzOWQKL4; dmarc=pass (policy=none) header.from=mm.st; spf=pass (mx1.freebsd.org: domain of xtouqh@mm.st designates 64.147.123.25 as permitted sender) smtp.mailfrom=xtouqh@mm.st X-Spamd-Result: default: False [10.76 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[64.147.123.25:from]; R_SPF_ALLOW(0.00)[+ip4:64.147.123.25:c]; FREEMAIL_FROM(0.00)[mm.st]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[mm.st:+,messagingengine.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(0.00)[mm.st,none]; NEURAL_HAM_SHORT(-0.06)[-0.062]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.25:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[mm.st]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(5.00)[91.240.124.190:received]; R_DKIM_ALLOW(0.00)[mm.st:s=fm1,messagingengine.com:s=fm3]; FROM_EQ_ENVFROM(0.00)[]; RECEIVED_SPAMHAUS_CSS(4.00)[91.240.124.190:received]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_MEDIUM(0.93)[0.927]; BAD_REP_POLICIES(0.10)[]; NEURAL_SPAM_LONG(1.00)[0.998]; FROM_NO_DN(0.00)[]; GREYLIST(0.00)[pass,body]; MAILMAN_DEST(0.00)[current,net] X-Spam: Yes X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 08:01:33 -0000 Updating from latest CURRENT snapshot (FreeBSD-13.0-CURRENT-amd64-20200910-1544934ffb2) to r365620 broke the bridges with igb (I350-T2) for me. Booting to kernel.old and/or commenting the entries in rc.conf helps. rc.conf: ---- cloned_interfaces="bridge0 bridge1 tap0 tap1 tap2 tap3" ifconfig_em0="inet ..." ifconfig_igb0="up" ifconfig_igb1="up" ifconfig_bridge0="addm igb0 addm tap0 addm tap1" ifconfig_bridge1="addm igb1 addm tap2 addm tap3" ---- NICs (em0 is on-board, igb0/igb1 is addon I350-T2 card): ---- em0: mem 0x92d00000-0x92d1ffff at device 31.6 numa-domain 0 on pci0 em0: Using 1024 TX descriptors and 1024 RX descriptors em0: Using an MSI interrupt em0: Ethernet address: e0:d5:5e:6c:aa:36 em0: netmap queues/slots: TX 1/1024, RX 1/1024 igb0: mem 0xfbb00000-0xfbbfffff,0xfbc84000-0xfbc87fff at device 0.0 numa-domain 0 on pci16 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: Using 8 RX queues 8 TX queues igb0: Using MSI-X interrupts with 9 vectors igb0: Ethernet address: a0:36:9f:0a:cf:42 igb0: netmap queues/slots: TX 8/1024, RX 8/1024 igb1: mem 0xfba00000-0xfbafffff,0xfbc80000-0xfbc83fff at device 0.1 numa-domain 0 on pci16 igb1: Using 1024 TX descriptors and 1024 RX descriptors igb1: Using 8 RX queues 8 TX queues igb1: Using MSI-X interrupts with 9 vectors igb1: Ethernet address: a0:36:9f:0a:cf:43 igb1: netmap queues/slots: TX 8/1024, RX 8/1024 ---- panic: ---- panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited cpuid = 16 time = 1599808542 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01ba658c40 vpanic() at vpanic+0x182/frame 0xfffffe01ba658c90 panic() at panic+0x43/frame 0xfffffe01ba658cf0 sleepq_add() at sleepq_add+0x359/frame 0xfffffe01ba658d40 _sleep() at _sleep+0x20c/frame 0xfffffe01ba658df0 pause_sbt() at pause_sbt+0xfe/frame 0xfffffe01ba658e20 e1000_reset_hw_82580() at e1000_reset_hw_82580+0x1c8/frame 0xfffffe01ba658e60 em_if_stop() at em_if_stop+0x1b/frame 0xfffffe01ba658e80 iflib_stop() at iflib_stop+0xbd/frame 0xfffffe01ba658ed0 iflib_if_ioctl() at iflib_if_ioctl+0x397/frame 0xfffffe01ba658f40 bridge_mutecaps() at bridge_mutecaps+0x145/frame 0xfffffe01ba658fb0 bridge_ioctl_add() at bridge_ioctl_add+0x468/frame 0xfffffe01ba659000 bridge_ioctl() at bridge_ioctl+0x32b/frame 0xfffffe01ba6590d0 in_control() at in_control+0x322/frame 0xfffffe01ba659180 ifioctl() at ifioctl+0x3e8/frame 0xfffffe01ba659250 kern_ioctl() at kern_ioctl+0x28e/frame 0xfffffe01ba6592c0 sys_ioctl() at sys_ioctl+0x127/frame 0xfffffe01ba659390 amd64_syscall() at amd64_syscall+0x140/frame 0xfffffe01ba6594b0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ba6594b0 --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8004b4aba, rsp = 0x7fffffffe2b8, rbp = 0x7fffffffe360 --- Uptime: 14s Dumping 3794 out of 97961 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% ---- From owner-freebsd-net@freebsd.org Fri Sep 11 11:56:16 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4763B3D6968 for ; Fri, 11 Sep 2020 11:56:16 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BnvNc0HCrz4Dwm for ; Fri, 11 Sep 2020 11:56:16 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: by mailman.nyi.freebsd.org (Postfix) id 07AB93D69B8; Fri, 11 Sep 2020 11:56:16 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 072CA3D6B28; Fri, 11 Sep 2020 11:56:16 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from wout1-smtp.messagingengine.com (wout1-smtp.messagingengine.com [64.147.123.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnvNb2hRPz4DhZ; Fri, 11 Sep 2020 11:56:15 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 97515CA9; Fri, 11 Sep 2020 07:48:06 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Fri, 11 Sep 2020 07:48:06 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mm.st; h=subject :from:to:references:cc:message-id:date:mime-version:in-reply-to :content-type:content-transfer-encoding; s=fm1; bh=jZX9LdTvIspy8 6FPie8Tl1jPaRtHCXzzVTrTTov0tME=; b=gFTaaRsm7lghl4M0v3uQMJEVDefdL U8p2Q7NVOhly34HCBD/1YFhaup1SciNRxErQ+p9GdAULuHKwubvM278GD6YvJJFR /0CQ0O1ZGsntX1y4wOd5XyhsJYEQby5V0Yhi2al8O7DamLBOsOtdGoyNJs6CJL+M qmEvfPtUr8C8ZK9D3k+RyWMNyDMzV6m3XPXpMOFhl8bEZDINBJLvwhQ8W5vcVide pUtfRd8974kuk0iwhjFwJ4ScZsfGTlJS1JnhELAczD0Qc0cNUxfkAu9x/um+LzZN lpEMKP2hQYWDyXfgoGFiqyncO+vDdIqu0oalc4XONPHdV1tZj9Xyr3HeQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=jZX9LdTvIspy86FPie8Tl1jPaRtHCXzzVTrTTov0t ME=; b=SeHutgVcpJ9GreNPYUCp8prs+nFHCZHQ4qz+poyjTc2ACUGxeIeG/GP8d nAKznxbLNcYZn1uKr7RQjnGOb8W7SgCHkSJdbsxz6hcS9xk85GYEhVN1270e6O9m X64FA4B5R8v0EY4zXHsXfLykRpSpU0Uwy4BeaYgQv53nVnkqKgBaNd9bJBPg4gzY n8PJ8E03eYWcXty7o6O3etben42s+/2iA24N4bav37Kq5Z0tXHCYSD+fkYSy+RRQ FMa7Br6FPzwQA/86UhR2V4dvwVEKaphtmZGByMh890be8GENhfu4ewXimkEBOED+ 0RHIUaQ9MVrTwsIE6xj5OQxz2OWXQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudehledggeejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefuhffvfhfkffgfgggjtgfgsehtke ertddtfeejnecuhfhrohhmpeigthhouhhqhhesmhhmrdhsthenucggtffrrghtthgvrhhn peeigeffjeejgfelvdelfeehteeiueeutefhteeigefgfedttdeffeelhfdtjeffkeenuc fkphepledurddvgedtrdduvdegrdduledtnecuufhprghmkfhppfgvthifohhrkhepledu rddvgedtrdduvdegrdduledtnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpe hmrghilhhfrhhomhepgihtohhuqhhhsehmmhdrshht X-ME-Proxy: Received: from mercury.lan (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id 736B6328005E; Fri, 11 Sep 2020 07:48:02 -0400 (EDT) Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited From: xtouqh@mm.st To: Gleb Smirnoff References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> Cc: current@freebsd.org, net@freebsd.org Message-ID: <29ab7449-0a0f-d64e-9664-8a19d21ac1d9@mm.st> Date: Fri, 11 Sep 2020 14:47:59 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4BnvNb2hRPz4DhZ X-Spamd-Bar: ++++++++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=mm.st header.s=fm1 header.b=gFTaaRsm; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=SeHutgVc; dmarc=pass (policy=none) header.from=mm.st; spf=pass (mx1.freebsd.org: domain of xtouqh@mm.st designates 64.147.123.24 as permitted sender) smtp.mailfrom=xtouqh@mm.st X-Spamd-Result: default: False [10.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(0.00)[+ip4:64.147.123.24:c]; FREEMAIL_FROM(0.00)[mm.st]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[mm.st:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(0.00)[mm.st,none]; NEURAL_HAM_SHORT(-0.13)[-0.132]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.24:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[mm.st]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(5.00)[91.240.124.190:received]; R_DKIM_ALLOW(0.00)[mm.st:s=fm1,messagingengine.com:s=fm3]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; RECEIVED_SPAMHAUS_CSS(4.00)[91.240.124.190:received]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_MEDIUM(0.74)[0.736]; BAD_REP_POLICIES(0.10)[]; NEURAL_SPAM_LONG(1.00)[0.999]; FROM_NO_DN(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[64.147.123.24:from]; GREYLIST(0.00)[pass,body]; MAILMAN_DEST(0.00)[current,net] X-Spam: Yes X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 11:56:16 -0000 xtouqh@mm.st wrote: > Updating from latest CURRENT snapshot > (FreeBSD-13.0-CURRENT-amd64-20200910-1544934ffb2) to r365620 broke the > bridges with igb (I350-T2) for me.  Booting to kernel.old and/or > commenting the entries in rc.conf helps. > > rc.conf: > ---- > cloned_interfaces="bridge0 bridge1 tap0 tap1 tap2 tap3" > ifconfig_em0="inet ..." > ifconfig_igb0="up" > ifconfig_igb1="up" > ifconfig_bridge0="addm igb0 addm tap0 addm tap1" > ifconfig_bridge1="addm igb1 addm tap2 addm tap3" > ---- > > NICs (em0 is on-board, igb0/igb1 is addon I350-T2 card): > ---- > em0: mem 0x92d00000-0x92d1ffff at > device 31.6 numa-domain 0 on pci0 > em0: Using 1024 TX descriptors and 1024 RX descriptors > em0: Using an MSI interrupt > em0: Ethernet address: e0:d5:5e:6c:aa:36 > em0: netmap queues/slots: TX 1/1024, RX 1/1024 > igb0: mem > 0xfbb00000-0xfbbfffff,0xfbc84000-0xfbc87fff at device 0.0 numa-domain 0 > on pci16 > igb0: Using 1024 TX descriptors and 1024 RX descriptors > igb0: Using 8 RX queues 8 TX queues > igb0: Using MSI-X interrupts with 9 vectors > igb0: Ethernet address: a0:36:9f:0a:cf:42 > igb0: netmap queues/slots: TX 8/1024, RX 8/1024 > igb1: mem > 0xfba00000-0xfbafffff,0xfbc80000-0xfbc83fff at device 0.1 numa-domain 0 > on pci16 > igb1: Using 1024 TX descriptors and 1024 RX descriptors > igb1: Using 8 RX queues 8 TX queues > igb1: Using MSI-X interrupts with 9 vectors > igb1: Ethernet address: a0:36:9f:0a:cf:43 > igb1: netmap queues/slots: TX 8/1024, RX 8/1024 > ---- > > panic: > ---- > panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan > 0xffffffff8157d9a0 with sleeping prohibited > cpuid = 16 > time = 1599808542 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffffe01ba658c40 > vpanic() at vpanic+0x182/frame 0xfffffe01ba658c90 > panic() at panic+0x43/frame 0xfffffe01ba658cf0 > sleepq_add() at sleepq_add+0x359/frame 0xfffffe01ba658d40 > _sleep() at _sleep+0x20c/frame 0xfffffe01ba658df0 > pause_sbt() at pause_sbt+0xfe/frame 0xfffffe01ba658e20 > e1000_reset_hw_82580() at e1000_reset_hw_82580+0x1c8/frame > 0xfffffe01ba658e60 > em_if_stop() at em_if_stop+0x1b/frame 0xfffffe01ba658e80 > iflib_stop() at iflib_stop+0xbd/frame 0xfffffe01ba658ed0 > iflib_if_ioctl() at iflib_if_ioctl+0x397/frame 0xfffffe01ba658f40 > bridge_mutecaps() at bridge_mutecaps+0x145/frame 0xfffffe01ba658fb0 > bridge_ioctl_add() at bridge_ioctl_add+0x468/frame 0xfffffe01ba659000 > bridge_ioctl() at bridge_ioctl+0x32b/frame 0xfffffe01ba6590d0 > in_control() at in_control+0x322/frame 0xfffffe01ba659180 > ifioctl() at ifioctl+0x3e8/frame 0xfffffe01ba659250 > kern_ioctl() at kern_ioctl+0x28e/frame 0xfffffe01ba6592c0 > sys_ioctl() at sys_ioctl+0x127/frame 0xfffffe01ba659390 > amd64_syscall() at amd64_syscall+0x140/frame 0xfffffe01ba6594b0 > fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ba6594b0 > --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8004b4aba, rsp = > 0x7fffffffe2b8, rbp = 0x7fffffffe360 --- > Uptime: 14s > Dumping 3794 out of 97961 > MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% > ---- Gleb, is this result of r365504? If yes, what are the possible fixes? From owner-freebsd-net@freebsd.org Fri Sep 11 12:09:04 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E46533D801F for ; Fri, 11 Sep 2020 12:09:04 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4BnvgN5B1mz4GBv for ; Fri, 11 Sep 2020 12:09:04 +0000 (UTC) (envelope-from hps@selasky.org) Received: by mailman.nyi.freebsd.org (Postfix) id B00283D8125; Fri, 11 Sep 2020 12:09:04 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AFB3A3D801E; Fri, 11 Sep 2020 12:09:04 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnvgM6BvYz4G8b; Fri, 11 Sep 2020 12:09:03 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [178.17.145.105]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id E7C8226010D; Fri, 11 Sep 2020 14:09:00 +0200 (CEST) Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited To: xtouqh@mm.st, Gleb Smirnoff Cc: current@freebsd.org, net@freebsd.org References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> <29ab7449-0a0f-d64e-9664-8a19d21ac1d9@mm.st> From: Hans Petter Selasky Message-ID: Date: Fri, 11 Sep 2020 14:08:31 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: <29ab7449-0a0f-d64e-9664-8a19d21ac1d9@mm.st> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4BnvgM6BvYz4G8b X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 2a01:4f8:c17:6c4b::2 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.63 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; ARC_NA(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.987]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.35)[-0.347]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; FREEMAIL_TO(0.00)[mm.st,FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[current,net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 12:09:05 -0000 On 2020-09-11 13:47, xtouqh@mm.st wrote: > xtouqh@mm.st wrote: >> Updating from latest CURRENT snapshot >> (FreeBSD-13.0-CURRENT-amd64-20200910-1544934ffb2) to r365620 broke the >> bridges with igb (I350-T2) for me.  Booting to kernel.old and/or >> commenting the entries in rc.conf helps. >> >> rc.conf: >> ---- >> cloned_interfaces="bridge0 bridge1 tap0 tap1 tap2 tap3" >> ifconfig_em0="inet ..." >> ifconfig_igb0="up" >> ifconfig_igb1="up" >> ifconfig_bridge0="addm igb0 addm tap0 addm tap1" >> ifconfig_bridge1="addm igb1 addm tap2 addm tap3" >> ---- >> >> NICs (em0 is on-board, igb0/igb1 is addon I350-T2 card): >> ---- >> em0: mem 0x92d00000-0x92d1ffff >> at device 31.6 numa-domain 0 on pci0 >> em0: Using 1024 TX descriptors and 1024 RX descriptors >> em0: Using an MSI interrupt >> em0: Ethernet address: e0:d5:5e:6c:aa:36 >> em0: netmap queues/slots: TX 1/1024, RX 1/1024 >> igb0: mem >> 0xfbb00000-0xfbbfffff,0xfbc84000-0xfbc87fff at device 0.0 numa-domain >> 0 on pci16 >> igb0: Using 1024 TX descriptors and 1024 RX descriptors >> igb0: Using 8 RX queues 8 TX queues >> igb0: Using MSI-X interrupts with 9 vectors >> igb0: Ethernet address: a0:36:9f:0a:cf:42 >> igb0: netmap queues/slots: TX 8/1024, RX 8/1024 >> igb1: mem >> 0xfba00000-0xfbafffff,0xfbc80000-0xfbc83fff at device 0.1 numa-domain >> 0 on pci16 >> igb1: Using 1024 TX descriptors and 1024 RX descriptors >> igb1: Using 8 RX queues 8 TX queues >> igb1: Using MSI-X interrupts with 9 vectors >> igb1: Ethernet address: a0:36:9f:0a:cf:43 >> igb1: netmap queues/slots: TX 8/1024, RX 8/1024 >> ---- >> >> panic: >> ---- >> panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan >> 0xffffffff8157d9a0 with sleeping prohibited >> cpuid = 16 >> time = 1599808542 >> KDB: stack backtrace: >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame >> 0xfffffe01ba658c40 >> vpanic() at vpanic+0x182/frame 0xfffffe01ba658c90 >> panic() at panic+0x43/frame 0xfffffe01ba658cf0 >> sleepq_add() at sleepq_add+0x359/frame 0xfffffe01ba658d40 >> _sleep() at _sleep+0x20c/frame 0xfffffe01ba658df0 >> pause_sbt() at pause_sbt+0xfe/frame 0xfffffe01ba658e20 >> e1000_reset_hw_82580() at e1000_reset_hw_82580+0x1c8/frame >> 0xfffffe01ba658e60 >> em_if_stop() at em_if_stop+0x1b/frame 0xfffffe01ba658e80 >> iflib_stop() at iflib_stop+0xbd/frame 0xfffffe01ba658ed0 >> iflib_if_ioctl() at iflib_if_ioctl+0x397/frame 0xfffffe01ba658f40 >> bridge_mutecaps() at bridge_mutecaps+0x145/frame 0xfffffe01ba658fb0 >> bridge_ioctl_add() at bridge_ioctl_add+0x468/frame 0xfffffe01ba659000 >> bridge_ioctl() at bridge_ioctl+0x32b/frame 0xfffffe01ba6590d0 >> in_control() at in_control+0x322/frame 0xfffffe01ba659180 >> ifioctl() at ifioctl+0x3e8/frame 0xfffffe01ba659250 >> kern_ioctl() at kern_ioctl+0x28e/frame 0xfffffe01ba6592c0 >> sys_ioctl() at sys_ioctl+0x127/frame 0xfffffe01ba659390 >> amd64_syscall() at amd64_syscall+0x140/frame 0xfffffe01ba6594b0 >> fast_syscall_common() at fast_syscall_common+0xf8/frame >> 0xfffffe01ba6594b0 >> --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8004b4aba, rsp = >> 0x7fffffffe2b8, rbp = 0x7fffffffe360 --- >> Uptime: 14s >> Dumping 3794 out of 97961 >> MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% >> ---- > Hi, I think this is another variant of: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=232362 --HPS From owner-freebsd-net@freebsd.org Fri Sep 11 12:10:35 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CABE03D8079 for ; Fri, 11 Sep 2020 12:10:35 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bnvj74FqMz4GS5 for ; Fri, 11 Sep 2020 12:10:35 +0000 (UTC) (envelope-from hps@selasky.org) Received: by mailman.nyi.freebsd.org (Postfix) id 91C6B3D8396; Fri, 11 Sep 2020 12:10:35 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 904143D7FAB; Fri, 11 Sep 2020 12:10:35 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bnvj65ybJz4GPr; Fri, 11 Sep 2020 12:10:34 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2020.home.selasky.org (unknown [178.17.145.105]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 6E70E26010D; Fri, 11 Sep 2020 14:10:33 +0200 (CEST) Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited From: Hans Petter Selasky To: xtouqh@mm.st, Gleb Smirnoff Cc: current@freebsd.org, net@freebsd.org References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> <29ab7449-0a0f-d64e-9664-8a19d21ac1d9@mm.st> Message-ID: <112aa4f5-4915-816c-edc3-d171e6c23885@selasky.org> Date: Fri, 11 Sep 2020 14:10:04 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.10.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bnvj65ybJz4GPr X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of hps@selasky.org designates 2a01:4f8:c17:6c4b::2 as permitted sender) smtp.mailfrom=hps@selasky.org X-Spamd-Result: default: False [-2.63 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+a:mail.turbocat.net:c]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[selasky.org]; NEURAL_HAM_LONG(-0.99)[-0.987]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.35)[-0.353]; NEURAL_HAM_MEDIUM(-0.99)[-0.991]; FREEMAIL_TO(0.00)[mm.st,FreeBSD.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[current,net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 12:10:35 -0000 On 2020-09-11 14:08, Hans Petter Selasky wrote: > I think this is another variant of: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=232362 Also adding this one for the record: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240609 --HPS From owner-freebsd-net@freebsd.org Fri Sep 11 12:22:48 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 315F43D8A19 for ; Fri, 11 Sep 2020 12:22:48 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BnvzC6Xvtz4HQj for ; Fri, 11 Sep 2020 12:22:47 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: by mailman.nyi.freebsd.org (Postfix) id D9BB93D8B3A; Fri, 11 Sep 2020 12:22:47 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D8F7C3D88E1; Fri, 11 Sep 2020 12:22:47 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from wout1-smtp.messagingengine.com (wout1-smtp.messagingengine.com [64.147.123.24]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnvzC0PB6z4H5h; Fri, 11 Sep 2020 12:22:46 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 9956C9FB; Fri, 11 Sep 2020 08:22:44 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Fri, 11 Sep 2020 08:22:44 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mm.st; h=subject :to:cc:references:from:message-id:date:mime-version:in-reply-to :content-type:content-transfer-encoding; s=fm1; bh=GcRkbP2vMoPT7 5V44On5QGpbJ3lQJo2kP+BrRGVu8Fc=; b=BynY5pFOXm5F74ToaFceeR327nm2y 6m5pG9xDn3mE9/yFNkrQXVh+dWuJen4PldAjy+tn3nYCWv+cW/eZkR5+1ZQj0USL P0Omg8YUpO9PXch4GzCVEwdEeWpAX9VzYe83I+N6JLkQMuiBvhbbcnHLCSKe2vkx WQDlUAcj14M8LBLx4twBkOj8eptQc+JDUS9N0V9EC5tmT/QiEWF4DnF31dU9UmrO utzxOQVBJKY6cs8VMHygGCquKC+Qt6+gLzyJBIEti6c+qZNrqHCNbAUE+I76DIFP iIyopUPdIa25SAQ+v0O42EaTy6oUT83HXQNjjHTCRIs7YJe9Zo29PUyOQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=GcRkbP2vMoPT75V44On5QGpbJ3lQJo2kP+BrRGVu8 Fc=; b=nTt5kBd7FxhUTxB36MWXuL6fXQDl7cT6F50+RAIP/Qbs1ew/N8erbgSN/ j1aa28jqVV+i3xq0E1SZmp3HemRzOmwT4Vy8yCzvJSoVD7yDP4LqhMEozfcnQ2e+ C8sO7l2OQOgak9i7h0PskPbbZTjy8YvGfqoSuZVhgWCvzXzIBypPGshAUah51w2s yhjVew9x2vyFRGpGmEksSz36Cz2KjD2ObdaIMU326a/XR1LMEug7o0ggupE/H0Fc 6YP8pE7uz0MD4A7fhFaHuAccpRn/wW+d+gQED1YtjyvKWMtLLrY14Zs1KobNiE94 c7y07pqlql57newjQ3lFh6j4mKngQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudehledgheegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefuvfhfhffkffgfgggjtgfgsehtje ertddtfeejnecuhfhrohhmpeigthhouhhqhhesmhhmrdhsthenucggtffrrghtthgvrhhn peehgeevgeejudevffdvvdeiudevuefggedtueduvdeugeetueelkedufeetffejtdenuc ffohhmrghinhepfhhrvggvsghsugdrohhrghenucfkphepledurddvgedtrdduvdegrddu ledtnecuufhprghmkfhppfgvthifohhrkhepledurddvgedtrdduvdegrdduledtnecuve hluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepgihtohhuqhhh sehmmhdrshht X-ME-Proxy: Received: from mercury.lan (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id B4CBF328005A; Fri, 11 Sep 2020 08:22:42 -0400 (EDT) Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited To: Hans Petter Selasky , Gleb Smirnoff Cc: current@freebsd.org, net@freebsd.org References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> <29ab7449-0a0f-d64e-9664-8a19d21ac1d9@mm.st> <112aa4f5-4915-816c-edc3-d171e6c23885@selasky.org> From: xtouqh@mm.st Message-ID: <082da1c0-ecb3-b8cc-7220-61b5c70ea71b@mm.st> Date: Fri, 11 Sep 2020 15:22:41 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <112aa4f5-4915-816c-edc3-d171e6c23885@selasky.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4BnvzC0PB6z4H5h X-Spamd-Bar: +++++++++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=mm.st header.s=fm1 header.b=BynY5pFO; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=nTt5kBd7; dmarc=pass (policy=none) header.from=mm.st; spf=pass (mx1.freebsd.org: domain of xtouqh@mm.st designates 64.147.123.24 as permitted sender) smtp.mailfrom=xtouqh@mm.st X-Spamd-Result: default: False [11.22 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(0.00)[+ip4:64.147.123.24:c]; FREEMAIL_FROM(0.00)[mm.st]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[mm.st:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(0.00)[mm.st,none]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.24:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[mm.st]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(5.00)[91.240.124.190:received]; R_DKIM_ALLOW(0.00)[mm.st:s=fm1,messagingengine.com:s=fm3]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; RECEIVED_SPAMHAUS_CSS(4.00)[91.240.124.190:received]; NEURAL_SPAM_SHORT(0.40)[0.400]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_MEDIUM(0.93)[0.935]; BAD_REP_POLICIES(0.10)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.99)[0.989]; FROM_NO_DN(0.00)[]; RWL_MAILSPIKE_VERYGOOD(0.00)[64.147.123.24:from]; GREYLIST(0.00)[pass,meta]; MAILMAN_DEST(0.00)[current,net] X-Spam: Yes X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 12:22:48 -0000 Hans Petter Selasky wrote: > On 2020-09-11 14:08, Hans Petter Selasky wrote: >> I think this is another variant of: >> >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=232362 > > Also adding this one for the record: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240609 I see, looks like the problem was masked by some change, and unmasked by r365504. So the workaround is running without INVARIANTS (i.e. GENERIC-NODEBUG) for the moment? From owner-freebsd-net@freebsd.org Fri Sep 11 16:33:21 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B3C4A3DFC7B for ; Fri, 11 Sep 2020 16:33:21 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp1XK3FJRz4YVS for ; Fri, 11 Sep 2020 16:33:21 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: by mailman.nyi.freebsd.org (Postfix) id 6DB843DFA1B; Fri, 11 Sep 2020 16:33:21 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6D6823DFD07; Fri, 11 Sep 2020 16:33:21 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2085.outbound.protection.outlook.com [40.107.237.85]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp1XJ4YVJz4YY2; Fri, 11 Sep 2020 16:33:20 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cFyr1wv+8Qi474N4+8t8YsKqlOHvtNQQGTCswkx73ZLGWZthpm7+c9W1mWUIJ6Xs5rspPbiRligGMBZo4/FZOBoB3uSMscZudQcNxkBAGARAJss/yWk3OBvvZmJCm3vYNAxqLRX/+qPDq+jfzGCEsf+LRYu09+8w2dhvfTwOtLQRFHnG0lsn8anWipUrERvmWH7ua5oVHttuQE/dTt2SYyEdpPSVTj/1+RyssAv7InQ6rvNGTHBfmt7BRY7iNeEzp8FMNkiVNdwOlLFww2j+kKtpWqat7vBaxojguWKkfWm8gz0ls5ck4HzTCW6xHoDC8dHhuSsJ7iHQT/qhh1rpfQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/DO9tNeVZlrJcRLIw3D8uqakPBntha175vMiNeH3S3c=; b=nF6BYiH6Xlr1MMwulbRH1xmBfZ95qYjE2bPIaQFYX5qM56vdkcHZbNdbAJQkf2EawFRurqFp8CCP1cNlsDNwdm6pXgSM5V89hDdY4WuRng08iqTS0yUdQ6/DqIYThMG7E1oVLdv0kBF/XyMjDTJJ39NKI+FebgftYINbVK5Gw/K+u/1NNJ2+vqXk2wdcdMrNMHUso7LAVuUMkuRd3L4h09jUGLHxzVHYxb4yxl3IF3Z5SEoyqVEjmmIFu5nPMIoUc+ovykqeBFALq1MiOcrkvSyVwk0CXqxPXNTxSEyqXpEzGarVTCIOaiAwRWYLK9YMayx8pWSWle5tbOxLqwkZSQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netapp.com; dmarc=pass action=none header.from=netapp.com; dkim=pass header.d=netapp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=/DO9tNeVZlrJcRLIw3D8uqakPBntha175vMiNeH3S3c=; b=qjnhWVJUDndaZo3q+JPhsUr70ypIqHy7RptcUbgkyhuflNOW9i9DrcwOPzEYnRBZ8GB8yXnLvZZ7cgINKe0K80Mg15HGpBHVIo8F++nnVxjoP8cdHK2qK/uZ1tYfL4/voUdSfgnZq2EWVDCIenao6pQ2+mBR9Q0pO8QFAHM93UA= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (2603:10b6:803:51::24) by SN6PR06MB3904.namprd06.prod.outlook.com (2603:10b6:805:1b::27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.17; Fri, 11 Sep 2020 16:33:18 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::84a9:fc74:7eed:ca3a]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::84a9:fc74:7eed:ca3a%7]) with mapi id 15.20.3370.017; Fri, 11 Sep 2020 16:33:18 +0000 From: "Scheffenegger, Richard" To: "net@FreeBSD.org" , "transport@freebsd.org" Subject: Socket option to configure Ethernet PCP / CoS per-flow Thread-Topic: Socket option to configure Ethernet PCP / CoS per-flow Thread-Index: AdaIV6Ig8St2MdM0SrW3cDX5AzmWpw== Date: Fri, 11 Sep 2020 16:33:18 +0000 Message-ID: Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [217.70.211.11] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: b4c33195-ffb0-4dba-dad9-08d8567063db x-ms-traffictypediagnostic: SN6PR06MB3904: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:5236; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: I/cQiVSwJ1a5+ifkSbFUYJGlUp8He2p8TWL98sazuE8wYmYZXidjjx+z9JWQ1ZSifNnl6n+SPwa3i4QgQaqC+hEmtxwgq7yQWMdzUf4TdB5QYK8zshYNqq97Rbx6cYXIr6OINVD1qYS3YldqCwIRgaShuKECgfPy5h/WkYYq0iPv//mpTJDzsIySSgTbs0L6qwkmbmJT3TZ6dYogPhwlpdA50kC/QZT/YsmiFbN/uuIlMJkjrufPAH/z5EkVnqayDLpbs/0Wq/nmYJr6e/NoDMe14I4RnKgyx8j9CVIVjUEFwMkCmkBTxY/7r5z9b1jgsUf5GIm+7bBOcuURDE6poA== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN4PR0601MB3728.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39860400002)(346002)(366004)(396003)(376002)(136003)(9686003)(33656002)(316002)(2906002)(55016002)(450100002)(186003)(6506007)(66946007)(66476007)(71200400001)(26005)(52536014)(8676002)(66446008)(86362001)(110136005)(7696005)(8936002)(66556008)(478600001)(5660300002)(76116006)(64756008); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: VUMjkYWRO1F4sWXLU2FEEbGfuYksehMC2aP9lhzbvWQT9t1IJCfQCNKhYsnUGxeJBWktLP+3mfWDltVjhWnnAWc6tRdQq3ySXicVx4/IqfGRG1EMUFMYDA6XJ//q7xk3qQl9JYPdo3CMp5yIpp9j16HPJNvHZZWcK6AsdXOFrMrXxDq8SH+GLGlSsvjf82LR8mFnly7rn1T2TSYsTcUetX2y/7N/p6lJxx0RbWV8Xvk+0Gio4b3SJ3CfNjAocwyIJ63SZl4A9jD/yw1TjBvU5QUJmpBjVvY69wDC3eCWoBRmKUTg0wGaunLMGdJdJW9FRMKx4oN35Lt+28V3RWKCkljJJ9n2kG1Gfw8LO1OnPMiwM/5Hc3zdWLxS0tCgm3xQbPn1MhYG3jxPFwTptlrpULc5PnBbUKRstzQz3SuuaQQPtC92pYH85YJNwcm6jCQMIwZ9SrE7431RKd/hWGwa8RGsaDSWu7YVUwh3KG41NznSeWtOd37y0H0kAy5Yo3HkQy3FfScEZZsGotishIZoy0JnSQQMrxb+3tropo9qW+SwOyoxs+I6B36HB8xxIXjNnYPT7kGyw83X7arm582DJSYp3ADi5m7CepqoWj4NJ/h6jaNkBkQf2Dr4qaF5DtF614UboZcFLPxi46RU1auewQ== x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN4PR0601MB3728.namprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: b4c33195-ffb0-4dba-dad9-08d8567063db X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Sep 2020 16:33:18.3394 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: OnBstEG7eS2VhR1R05rgAhOUI7cKhmRcYrHpnZZj8BvbcGbw08UAmoS470TAT4MHnpRLeJPj3UOKmKsNAMcT1g== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR06MB3904 X-Rspamd-Queue-Id: 4Bp1XJ4YVJz4YY2 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-onmicrosoft-com header.b=qjnhWVJU; dmarc=none; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.237.85 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-3.95 / 15.00]; NEURAL_HAM_MEDIUM(-0.98)[-0.978]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-onmicrosoft-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[netapp.com]; NEURAL_HAM_LONG(-1.02)[-1.017]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.107.237.85:from]; NEURAL_HAM_SHORT(-0.45)[-0.452]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[net,transport]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.237.85:from] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 16:33:21 -0000 Hi, Currently, upstream head has only an IOCTL API to set up interface-wide def= ault PCP marking: #define SIOCGVLANPCP SIOCGLANPCP /* Get VLAN PCP */ #define SIOCSVLANPCP SIOCSLANPCP /* Set VLAN PCP */ And the interface is via ifconfig pcp . However, while this allows all traffic sent via a specific interface to be = marked with a PCP (priority code point), it defeats the purpose of PFC (pri= ority flow control) which works by individually pausing different queues of= an interface, provided there is an actual differentiation of traffic into = those various classes. Internally, we have added a socket option (SO_VLAN_PCP) to change the PCP s= pecifically for traffic associated with that socket, to be marked different= ly from whatever the interface default is (unmarked, or the default PCP). Does the community see value in having such a socket option widely availabl= e? (Linux currently doesn't seem to have a per-socket option either, only a= per-interface IOCTL API). Best regards, Richard Scheffenegger From owner-freebsd-net@freebsd.org Fri Sep 11 16:51:15 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2080C3E006D for ; Fri, 11 Sep 2020 16:51:15 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp1wy6D4qz4Ypy for ; Fri, 11 Sep 2020 16:51:14 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: by mailman.nyi.freebsd.org (Postfix) id D54E83E0088; Fri, 11 Sep 2020 16:51:14 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D4FEC3DFF25; Fri, 11 Sep 2020 16:51:14 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from wout4-smtp.messagingengine.com (wout4-smtp.messagingengine.com [64.147.123.20]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp1wx73M2z4Ymd; Fri, 11 Sep 2020 16:51:13 +0000 (UTC) (envelope-from xtouqh@mm.st) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id C3B6B71B; Fri, 11 Sep 2020 12:45:12 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Fri, 11 Sep 2020 12:45:13 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mm.st; h=subject :to:cc:references:from:message-id:date:mime-version:in-reply-to :content-type:content-transfer-encoding; s=fm1; bh=/O8r4nMkoBJn7 pZuShBzIDZh7lv9zUSptLpl4gdOAek=; b=W5Tlk1pMKPNlEQKMVftB73zT9BDVN 6J/oPVcLtoPyFpZwPdrJTVWRcoA5k3uvqi+MIx8QF2DB+I91mOKEGnfTYpL2QhSr 9zt3JBjtHRwssr/9gfawwb1DMHltFNDs9xL3xyoGjCCiWw3r+POppqkRU/7nPXjz z3X0vrsprwCS4TCKbvMcLFNXXc/FVmxIs4BlBtsy632BiDEdDBs1Zz71TSRXxONI 54AfgMlPOOpERrLb/UcMDMNVF8izUUIlFk9UeFk7GXwEVkBCF4IhJFgp+xc233G6 1OWs2vvf/Wf/QPgQ7zKkQfc9uaAguXVLM4xwrzc4nUWrZOa21gcRhDEgg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=/O8r4nMkoBJn7pZuShBzIDZh7lv9zUSptLpl4gdOA ek=; b=qQsuSjM1ZLqxwskAb/w6HB8BLm4ykCCrDqHg4oUWH6WPGfbibRvX4ufc1 3i6k8FZ/7lg6mdkGVpSbKaH9kjpcZWyIrb4WSxSgtSE3YSxTLbdns9uwwT/ZvL0g a9ApIgXyfp7bAhRX3QeOps/qpBSODrBmjXX1crPkenaVdqTHkRdKIrBue8zpihQQ N9sk70CQ6gWtXZD+b83mAQvmheHJqnuny2NcDJ2rnF0rbXvU3ZMrAf5OSSFoG+QU SlnscBVKdnc31zC5m+XH6YDp8vMWAMxj2BZHMmrQikhGHiFhuvF1QjkDoim4lXGb oQoT4WzBsNo2Q0+Dtpkg5KDsVfvWg== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudehledguddtiecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepuffvfhfhkffffgggjggtgfesth ejredttdefheenucfhrhhomhepgihtohhuqhhhsehmmhdrshhtnecuggftrfgrthhtvghr nhepvdeihfeigeeitddtjeeihfetkeeghfduhfetueejueekjeefleduveffheevuefhne cukfhppeeluddrvdegtddruddvgedrudeltdenucfuphgrmhfkphfpvghtfihorhhkpeel uddrvdegtddruddvgedrudeltdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmh epmhgrihhlfhhrohhmpeigthhouhhqhhesmhhmrdhsth X-ME-Proxy: Received: from mercury.lan (unknown [91.240.124.190]) by mail.messagingengine.com (Postfix) with ESMTPA id A14783280064; Fri, 11 Sep 2020 12:45:11 -0400 (EDT) Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited To: Gleb Smirnoff Cc: current@freebsd.org, net@freebsd.org References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> <20200911161148.GP1269@FreeBSD.org> From: xtouqh@mm.st Message-ID: Date: Fri, 11 Sep 2020 19:45:09 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <20200911161148.GP1269@FreeBSD.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bp1wx73M2z4Ymd X-Spamd-Bar: +++++++++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=mm.st header.s=fm1 header.b=W5Tlk1pM; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=qQsuSjM1; dmarc=pass (policy=none) header.from=mm.st; spf=pass (mx1.freebsd.org: domain of xtouqh@mm.st designates 64.147.123.20 as permitted sender) smtp.mailfrom=xtouqh@mm.st X-Spamd-Result: default: False [11.50 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(0.00)[+ip4:64.147.123.20:c]; FREEMAIL_FROM(0.00)[mm.st]; RWL_MAILSPIKE_GOOD(0.00)[64.147.123.20:from]; RCVD_COUNT_THREE(0.00)[4]; DKIM_TRACE(0.00)[mm.st:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(0.00)[mm.st,none]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.20:from]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[mm.st]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; ARC_NA(0.00)[]; RECEIVED_SPAMHAUS_XBL(5.00)[91.240.124.190:received]; R_DKIM_ALLOW(0.00)[mm.st:s=fm1,messagingengine.com:s=fm3]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; RECEIVED_SPAMHAUS_CSS(4.00)[91.240.124.190:received]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.53)[0.533]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_MEDIUM(1.05)[1.054]; BAD_REP_POLICIES(0.10)[]; NEURAL_SPAM_LONG(1.01)[1.012]; FROM_NO_DN(0.00)[]; GREYLIST(0.00)[pass,body]; MAILMAN_DEST(0.00)[current,net] X-Spam: Yes X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 16:51:15 -0000 Gleb Smirnoff wrote: > Hi, > > can you please try out this patch? This is configuration event > and we should use sleepable lock to synchronize, not epoch. It didn't help, though I guess my problem is in if_bridge, not if_lagg which the patch modifies? > On Fri, Sep 11, 2020 at 10:47:41AM +0300, xtouqh@mm.st wrote: > x> Updating from latest CURRENT snapshot > x> (FreeBSD-13.0-CURRENT-amd64-20200910-1544934ffb2) to r365620 broke the > x> bridges with igb (I350-T2) for me. Booting to kernel.old and/or > x> commenting the entries in rc.conf helps. > x> > x> rc.conf: > x> ---- > x> cloned_interfaces="bridge0 bridge1 tap0 tap1 tap2 tap3" > x> ifconfig_em0="inet ..." > x> ifconfig_igb0="up" > x> ifconfig_igb1="up" > x> ifconfig_bridge0="addm igb0 addm tap0 addm tap1" > x> ifconfig_bridge1="addm igb1 addm tap2 addm tap3" > x> ---- > x> > x> NICs (em0 is on-board, igb0/igb1 is addon I350-T2 card): > x> ---- > x> em0: mem 0x92d00000-0x92d1ffff at > x> device 31.6 numa-domain 0 on pci0 > x> em0: Using 1024 TX descriptors and 1024 RX descriptors > x> em0: Using an MSI interrupt > x> em0: Ethernet address: e0:d5:5e:6c:aa:36 > x> em0: netmap queues/slots: TX 1/1024, RX 1/1024 > x> igb0: mem > x> 0xfbb00000-0xfbbfffff,0xfbc84000-0xfbc87fff at device 0.0 numa-domain 0 > x> on pci16 > x> igb0: Using 1024 TX descriptors and 1024 RX descriptors > x> igb0: Using 8 RX queues 8 TX queues > x> igb0: Using MSI-X interrupts with 9 vectors > x> igb0: Ethernet address: a0:36:9f:0a:cf:42 > x> igb0: netmap queues/slots: TX 8/1024, RX 8/1024 > x> igb1: mem > x> 0xfba00000-0xfbafffff,0xfbc80000-0xfbc83fff at device 0.1 numa-domain 0 > x> on pci16 > x> igb1: Using 1024 TX descriptors and 1024 RX descriptors > x> igb1: Using 8 RX queues 8 TX queues > x> igb1: Using MSI-X interrupts with 9 vectors > x> igb1: Ethernet address: a0:36:9f:0a:cf:43 > x> igb1: netmap queues/slots: TX 8/1024, RX 8/1024 > x> ---- > x> > x> panic: > x> ---- > x> panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan > x> 0xffffffff8157d9a0 with sleeping prohibited > x> cpuid = 16 > x> time = 1599808542 > x> KDB: stack backtrace: > x> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > x> 0xfffffe01ba658c40 > x> vpanic() at vpanic+0x182/frame 0xfffffe01ba658c90 > x> panic() at panic+0x43/frame 0xfffffe01ba658cf0 > x> sleepq_add() at sleepq_add+0x359/frame 0xfffffe01ba658d40 > x> _sleep() at _sleep+0x20c/frame 0xfffffe01ba658df0 > x> pause_sbt() at pause_sbt+0xfe/frame 0xfffffe01ba658e20 > x> e1000_reset_hw_82580() at e1000_reset_hw_82580+0x1c8/frame > x> 0xfffffe01ba658e60 > x> em_if_stop() at em_if_stop+0x1b/frame 0xfffffe01ba658e80 > x> iflib_stop() at iflib_stop+0xbd/frame 0xfffffe01ba658ed0 > x> iflib_if_ioctl() at iflib_if_ioctl+0x397/frame 0xfffffe01ba658f40 > x> bridge_mutecaps() at bridge_mutecaps+0x145/frame 0xfffffe01ba658fb0 > x> bridge_ioctl_add() at bridge_ioctl_add+0x468/frame 0xfffffe01ba659000 > x> bridge_ioctl() at bridge_ioctl+0x32b/frame 0xfffffe01ba6590d0 > x> in_control() at in_control+0x322/frame 0xfffffe01ba659180 > x> ifioctl() at ifioctl+0x3e8/frame 0xfffffe01ba659250 > x> kern_ioctl() at kern_ioctl+0x28e/frame 0xfffffe01ba6592c0 > x> sys_ioctl() at sys_ioctl+0x127/frame 0xfffffe01ba659390 > x> amd64_syscall() at amd64_syscall+0x140/frame 0xfffffe01ba6594b0 > x> fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ba6594b0 > x> --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8004b4aba, rsp = > x> 0x7fffffffe2b8, rbp = 0x7fffffffe360 --- > x> Uptime: 14s > x> Dumping 3794 out of 97961 > x> MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% > x> ---- From owner-freebsd-net@freebsd.org Fri Sep 11 16:54:36 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F0F103E01FE for ; Fri, 11 Sep 2020 16:54:36 +0000 (UTC) (envelope-from sthaug@nethelp.no) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp20r5XMhz4ZJl for ; Fri, 11 Sep 2020 16:54:36 +0000 (UTC) (envelope-from sthaug@nethelp.no) Received: by mailman.nyi.freebsd.org (Postfix) id BA9FB3E0363; Fri, 11 Sep 2020 16:54:36 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BA4E13E00D1; Fri, 11 Sep 2020 16:54:36 +0000 (UTC) (envelope-from sthaug@nethelp.no) Received: from bizet.nethelp.no (bizet.nethelp.no [195.1.209.33]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp20q4NCYz4ZTy; Fri, 11 Sep 2020 16:54:35 +0000 (UTC) (envelope-from sthaug@nethelp.no) Received: from localhost (bizet.nethelp.no [IPv6:2001:8c0:9e04:500::1]) by bizet.nethelp.no (Postfix) with ESMTP id 5B9B3E6047; Fri, 11 Sep 2020 18:54:32 +0200 (CEST) Date: Fri, 11 Sep 2020 18:54:32 +0200 (CEST) Message-Id: <20200911.185432.122001633.sthaug@nethelp.no> To: Richard.Scheffenegger@netapp.com Cc: net@FreeBSD.org, transport@freebsd.org Subject: Re: Socket option to configure Ethernet PCP / CoS per-flow From: sthaug@nethelp.no In-Reply-To: References: X-Mailer: Mew version 6.7 on Emacs 26 / Mule 6.0 (HANACHIRUSATO) Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bp20q4NCYz4ZTy X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of sthaug@nethelp.no designates 195.1.209.33 as permitted sender) smtp.mailfrom=sthaug@nethelp.no X-Spamd-Result: default: False [-0.72 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.96)[-0.963]; RCPT_COUNT_THREE(0.00)[3]; RWL_MAILSPIKE_GOOD(0.00)[195.1.209.33:from]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[nethelp.no]; NEURAL_SPAM_SHORT(0.11)[0.113]; NEURAL_HAM_LONG(-0.97)[-0.971]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_MED(-0.20)[195.1.209.33:from]; FROM_NO_DN(0.00)[]; MID_CONTAINS_FROM(1.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:2116, ipnet:195.1.0.0/16, country:NO]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[net,transport] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 16:54:37 -0000 > However, while this allows all traffic sent via a specific interface to be marked with a PCP (priority code point), it defeats the purpose of PFC (priority flow control) which works by individually pausing different queues of an interface, provided there is an actual differentiation of traffic into those various classes. > > Internally, we have added a socket option (SO_VLAN_PCP) to change the PCP specifically for traffic associated with that socket, to be marked differently from whatever the interface default is (unmarked, or the default PCP). > > Does the community see value in having such a socket option widely available? (Linux currently doesn't seem to have a per-socket option either, only a per-interface IOCTL API). I've been doing quite a bit of network testing using iperf3 and similar tools, and have wanted this type of functionality since the interface option became available. Having this on a socket level would make it possible to teach iperf3, ping and other tools to set PCP and facilitate/simplify testing of L2 networks. So the answer is a definite yes! This would be valuable. Steinar Haug, Nethelp consulting, sthaug@nethelp.no From owner-freebsd-net@freebsd.org Fri Sep 11 17:01:45 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C75233E05EE for ; Fri, 11 Sep 2020 17:01:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp2954y51z4b8w for ; Fri, 11 Sep 2020 17:01:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id A9F263E05ED; Fri, 11 Sep 2020 17:01:45 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A9BEB3E06C5 for ; Fri, 11 Sep 2020 17:01:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp29546f8z4b0s for ; Fri, 11 Sep 2020 17:01:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 7217826FD6 for ; Fri, 11 Sep 2020 17:01:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08BH1jY9046591 for ; Fri, 11 Sep 2020 17:01:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08BH1jPd046590 for net@FreeBSD.org; Fri, 11 Sep 2020 17:01:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 240609] iflib: Panic with INVARIANTS: sleeping in an epoch section (12.1-pre-QA) (vlan + lagg involved) Date: Fri, 11 Sep 2020 17:01:44 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-STABLE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: glebius@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: glebius@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 17:01:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D240609 --- Comment #6 from Gleb Smirnoff --- Created attachment 217889 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D217889&action= =3Dedit Suggested patch for lagg Here is patch (against head), that prevents lagg reconfiguration to use epo= ch and uses sleepable lock. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Fri Sep 11 17:15:46 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 385F83E0E0F for ; Fri, 11 Sep 2020 17:15:46 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp2TF6lfCz4bhw for ; Fri, 11 Sep 2020 17:15:45 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: by mailman.nyi.freebsd.org (Postfix) id E59793E100E; Fri, 11 Sep 2020 17:15:45 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E54163E0FC3; Fri, 11 Sep 2020 17:15:45 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2043.outbound.protection.outlook.com [40.107.92.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp2TD3sQ4z4blL; Fri, 11 Sep 2020 17:15:43 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=e6wEmEaAQOMK6EVaoPeQFqsv2uixdtaXSFi5hVjHMUZ+J0L4iaq3/do35cfgfOafuvKscNzFBiCxOmwasSRkkzqTthV1HX6iVtQp26WJOXVfHPPawg41SJ5B5oqFLfebC7Ud130UqKMQdPmqLCc1N0hEigynEBtorpIHrG5PfeLBJlX5PZm3FZZAW4mk+N32GZLSEWPu4KCgUqb5/h9QjOQmaJzM6qZxrFzVXw4WyftzBUzq9+UGvRt6fc5hl14eV/b2zha41nNCfcspSYrHxaaY66f54LKc+zX6u6g+YNxZv5CLIi0InF+sOukrlVZSWIpoIU0L9IIikARivSQJtw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=wIIlLi7zTFskA/vKFfjBPcbmSAIYjYFA+9WpC9gM9mQ=; b=MW3r/4x5T5p8Z8wYAzGnyuRxBzNDc3u2RT77t+lwPvsEUgOTzD2sHel3jvP3nlW9+7AoyrMepAjy3wyA2xsRh/iyCvtHIhHmH+GGCbLHLgraYBGFX8X4fctbkl+GZgyPIX7VYvkqyAQV+Ne03pPttc/XOQCsJqPCzvewXVhvyKGex451NmJfL6obzLLNIxt9BgMWFdA6TmFhYHtS/XQVD0rJRdjQMD65O2DEib/HJF8uqv0Or5SmqBDDNt/ZRVtmJwP+rCJtBgNcJ9RKxpftKVmntgfeMs7wnQq2w9Q+rp4tuh8p80aqWLYjtZ+u2i1ejHscBeIwl+Hz12sM4QFMEQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netapp.com; dmarc=pass action=none header.from=netapp.com; dkim=pass header.d=netapp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.onmicrosoft.com; s=selector1-netapp-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=wIIlLi7zTFskA/vKFfjBPcbmSAIYjYFA+9WpC9gM9mQ=; b=v/9pvVXtoDDo4cpV17XQ0KV/atW3kZHOiwsppauu/yrqB3d5T2De3IBjRgc3A26Twz9Cd8W+c0IkRMZtt9nBJB6E/KopXUUAt7+OgRGKP4IL51CaGy9X+mC6z0QA7WLloIcpS8x+KjAPmNXXG0s+W5ZFVXD3JF+j0tUHCL6xdSU= Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (2603:10b6:803:51::24) by SA0PR06MB7004.namprd06.prod.outlook.com (2603:10b6:806:bd::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16; Fri, 11 Sep 2020 17:15:43 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::84a9:fc74:7eed:ca3a]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::84a9:fc74:7eed:ca3a%7]) with mapi id 15.20.3370.017; Fri, 11 Sep 2020 17:15:43 +0000 From: "Scheffenegger, Richard" To: "sthaug@nethelp.no" CC: "net@FreeBSD.org" , "transport@freebsd.org" Subject: RE: Socket option to configure Ethernet PCP / CoS per-flow Thread-Topic: Socket option to configure Ethernet PCP / CoS per-flow Thread-Index: AdaIV6Ig8St2MdM0SrW3cDX5AzmWpwABJZYAAABYzLA= Date: Fri, 11 Sep 2020 17:15:42 +0000 Message-ID: References: <20200911.185432.122001633.sthaug@nethelp.no> In-Reply-To: <20200911.185432.122001633.sthaug@nethelp.no> Accept-Language: de-AT, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [217.70.211.11] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 9a5edaf1-261f-475a-223b-08d85676508c x-ms-traffictypediagnostic: SA0PR06MB7004: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: ducvOnf1QDLk/bM5xUZg6aAfYz5hQkbk5a9t5BExV1Z/VXOflkD2ss1VZ9y6g91Vq5eJ10Dzq+EUx2xDwRVAq1azTpjJh1/nMI8s/c8fWe9SgrznKLPjE8zMzIOW682XxN8tyOTR1LDqwbxRoCSEkd5BQQ2hSPZf/I4pD/d+YTEUXufCJ5LR8CthxX2sApmlzBgksmEjqn/iCT1Wp6GO7oBlmxjHbb9I8T9EECP4gO2yrM3yXE1elJvUlI8p40rbhHJ2Vg9E3OoKuwlQxo/wT0HUCQRsGDncRntDLtsXLO624UtTDGWsNUhoJT1dBdq1 x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN4PR0601MB3728.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(346002)(136003)(376002)(396003)(39860400002)(54906003)(76116006)(66446008)(478600001)(71200400001)(86362001)(2906002)(186003)(316002)(5660300002)(33656002)(6916009)(26005)(66946007)(66556008)(64756008)(7696005)(53546011)(6506007)(66476007)(8936002)(52536014)(4326008)(83380400001)(55016002)(8676002)(9686003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: UXp6yQNWSxIERgWRgxCjlwIo4VWwiR2000Fs+My2JC63DSHD7VCpLrzVvAMGlHOr5OmKCwKYqFjwRqw4TURAqWMYA58lcjdYDWxxLXWj65+MrDSu5AAz8uCfT8uNp+g1CGX+h6eGp9Ttb3vWrpV/LRfRHLUJAPSvPEyYlv9L18RpgDLN1i1RJ93HwoeUBZzr6aKy2H3H/twH/CZL7I5qmmcdh7iDiRgP3uDqN3z/jv4aty4kIcvdFGFqHROQV2NQtTvwbhngTtCpN3dntBqzMwmBqnQpU16azXxvVOlun6aUwW3qc64OLPQkW+Ta+RRZ6KMe3hh7IxNTDdQQ4AAUR3ZrCFP/IvHABVV4vObzVZQNAIlrj5mZggXeernKA7m7Prj4QPq86RZNTrxrKQ04C2B4HaxXCcn15mJR89DPAFbvIDo8TD/nw8YnTEs6TQPpgu96b1IFC+5YsW1+zqW2g5zqjejFXDJqm8fwMsHYuL/Mp8QRo8j4gpbWfozj5PRU4EuW9OLUpiq/cFicuZl4TNXlbGyjsZ3Sy0g0c/0/Ch7T1p4WyG8EODhyZbEwebJ+s+iXaSzypFPqIaU38jJRMWbh3Vp6x4UUFliWvLfWcOGvt4hemJ6Zt/gNQ/xtn9uyiixPRNidsFXnXfdS9haTUA== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN4PR0601MB3728.namprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9a5edaf1-261f-475a-223b-08d85676508c X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Sep 2020 17:15:42.8766 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: G615wrjUKL/ucoZC6ALnZzG/HtSW0MAaUMfGkkxPngyhOdIdVDzGdbCNcnUk/uai2AaknqwpBURi6MJske8pmQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA0PR06MB7004 X-Rspamd-Queue-Id: 4Bp2TD3sQ4z4blL X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.onmicrosoft.com header.s=selector1-netapp-onmicrosoft-com header.b=v/9pvVXt; dmarc=none; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.92.43 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-4.02 / 15.00]; NEURAL_HAM_MEDIUM(-0.98)[-0.977]; R_DKIM_ALLOW(-0.20)[netapp.onmicrosoft.com:s=selector1-netapp-onmicrosoft-com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; NEURAL_HAM_LONG(-1.00)[-1.004]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[netapp.com]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[netapp.onmicrosoft.com:+]; NEURAL_HAM_SHORT(-0.54)[-0.537]; RCVD_IN_DNSWL_NONE(0.00)[40.107.92.43:from]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[net,transport]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.92.43:from] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 17:15:46 -0000 Thank you for the quick feedback. On a related note - it just occurred to me, that the PCP functionality coul= d be extended to make more effective use of PFC (priority flow control) wit= hout explicitly managing it on an application level directly. Right now, PFC typically degenerates to good-old Flow control, as all traff= ic is handled just in the default class (0, or whatever is set up using the= IOCTL interface API). Typically, the different Ethernet classes come with a notion of prioritizat= ion between them - traffic in a "higher" class may be forwarded prior to tr= affic in a lower class. But that is not a strong requirement - using WRR wi= th 1/8th bandwidth "reserved" for each class in a switch, assigning flows t= o a random PCP value, PFC could work in a more scalable fashion - only bloc= king a fraction of traffic, that is actually queue building (has to go over= a lower bandwidth link, or a NIC excessively pausing its ingress), thus re= ducing the chance of the formation of congrestion trees... E.g. PCP runs from 0 (default) to 7;=20 Adding a socket option to explicitly assign traffic to one of these flows w= ould allow testing and configuring applications to make use of "real" prior= itization capabilities of modern switches. And what I was just pondering was a special interface level setting (e.g. 8= ), which results in a socket to pick a "random" value when created, to dist= ribute packets across all the queues available in hardware, allowing PFC to= no longer collapse in effect to old FC style "on"/"off" for all traffic...= =20 Perhaps someone here has experience with congestion tree formation in multi= -hop switching environments, and can comment if the above approach would be= feasible to address that FC issue? Richard Scheffenegger -----Original Message----- From: sthaug@nethelp.no =20 Sent: Freitag, 11. September 2020 18:55 To: Scheffenegger, Richard Cc: net@FreeBSD.org; transport@freebsd.org Subject: Re: Socket option to configure Ethernet PCP / CoS per-flow NetApp Security WARNING: This is an external email. Do not click links or o= pen attachments unless you recognize the sender and know the content is saf= e. > However, while this allows all traffic sent via a specific interface to b= e marked with a PCP (priority code point), it defeats the purpose of PFC (p= riority flow control) which works by individually pausing different queues = of an interface, provided there is an actual differentiation of traffic int= o those various classes. > > Internally, we have added a socket option (SO_VLAN_PCP) to change the PCP= specifically for traffic associated with that socket, to be marked differe= ntly from whatever the interface default is (unmarked, or the default PCP). > > Does the community see value in having such a socket option widely availa= ble? (Linux currently doesn't seem to have a per-socket option either, only= a per-interface IOCTL API). I've been doing quite a bit of network testing using iperf3 and similar too= ls, and have wanted this type of functionality since the interface option b= ecame available. Having this on a socket level would make it possible to te= ach iperf3, ping and other tools to set PCP and facilitate/simplify testing= of L2 networks. So the answer is a definite yes! This would be valuable. Steinar Haug, Nethelp consulting, sthaug@nethelp.no From owner-freebsd-net@freebsd.org Fri Sep 11 19:25:06 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0A60C3E36CC for ; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp5LT6Zm5z3V76 for ; Fri, 11 Sep 2020 19:25:05 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id DE8353E3730; Fri, 11 Sep 2020 19:25:05 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DE2993E35F1; Fri, 11 Sep 2020 19:25:05 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from cell.glebi.us (glebi.us [162.251.186.162]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "cell.glebi.us", Issuer "cell.glebi.us" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp5LT2SJBz3V2D; Fri, 11 Sep 2020 19:25:05 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from cell.glebi.us (localhost [127.0.0.1]) by cell.glebi.us (8.16.1/8.16.1) with ESMTPS id 08BGxQ3h066632 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 11 Sep 2020 09:59:26 -0700 (PDT) (envelope-from glebius@freebsd.org) Received: (from glebius@localhost) by cell.glebi.us (8.16.1/8.16.1/Submit) id 08BGxQFF066631; Fri, 11 Sep 2020 09:59:26 -0700 (PDT) (envelope-from glebius@freebsd.org) X-Authentication-Warning: cell.glebi.us: glebius set sender to glebius@freebsd.org using -f Date: Fri, 11 Sep 2020 09:59:26 -0700 From: Gleb Smirnoff To: xtouqh@mm.st Cc: current@freebsd.org, net@freebsd.org Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited Message-ID: <20200911165926.GR1269@FreeBSD.org> References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> <20200911161148.GP1269@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Bp5LT2SJBz3V2D X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:27348, ipnet:162.251.186.0/24, country:US] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 19:25:06 -0000 On Fri, Sep 11, 2020 at 07:45:09PM +0300, xtouqh@mm.st wrote: x> Gleb Smirnoff wrote: x> > Hi, x> > x> > can you please try out this patch? This is configuration event x> > and we should use sleepable lock to synchronize, not epoch. x> x> It didn't help, though I guess my problem is in if_bridge, not if_lagg x> which the patch modifies? Sorry, I was looking at PRs that were referenced in the later emails in the thread. -- Gleb Smirnoff From owner-freebsd-net@freebsd.org Fri Sep 11 19:25:06 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 74ED03E36CE for ; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp5LV2ZVbz3V9c for ; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 584BD3E36CD; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 57FEA3E3785; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from cell.glebi.us (glebi.us [162.251.186.162]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "cell.glebi.us", Issuer "cell.glebi.us" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp5LV18FKz3Txf; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from cell.glebi.us (localhost [127.0.0.1]) by cell.glebi.us (8.16.1/8.16.1) with ESMTPS id 08BH61Xq066700 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 11 Sep 2020 10:06:01 -0700 (PDT) (envelope-from glebius@freebsd.org) Received: (from glebius@localhost) by cell.glebi.us (8.16.1/8.16.1/Submit) id 08BH61Pq066699; Fri, 11 Sep 2020 10:06:01 -0700 (PDT) (envelope-from glebius@freebsd.org) X-Authentication-Warning: cell.glebi.us: glebius set sender to glebius@freebsd.org using -f Date: Fri, 11 Sep 2020 10:06:01 -0700 From: Gleb Smirnoff To: kp@freebsd.org Cc: xtouqh@mm.st, current@freebsd.org, net@freebsd.org Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited Message-ID: <20200911170601.GT1269@FreeBSD.org> References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> X-Rspamd-Queue-Id: 4Bp5LV18FKz3Txf X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:27348, ipnet:162.251.186.0/24, country:US] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 19:25:06 -0000 Kristof, can you please take a look? IMHO, the problem is that with r360345 the bridge_ioctl() is fully covered by epoch. IMHO, should be either more fine grained covered, or use internal locking, because some of the code downstream (driver ioctls) may sleep. On Fri, Sep 11, 2020 at 10:47:41AM +0300, xtouqh@mm.st wrote: x> Updating from latest CURRENT snapshot x> (FreeBSD-13.0-CURRENT-amd64-20200910-1544934ffb2) to r365620 broke the x> bridges with igb (I350-T2) for me. Booting to kernel.old and/or x> commenting the entries in rc.conf helps. x> x> rc.conf: x> ---- x> cloned_interfaces="bridge0 bridge1 tap0 tap1 tap2 tap3" x> ifconfig_em0="inet ..." x> ifconfig_igb0="up" x> ifconfig_igb1="up" x> ifconfig_bridge0="addm igb0 addm tap0 addm tap1" x> ifconfig_bridge1="addm igb1 addm tap2 addm tap3" x> ---- x> x> NICs (em0 is on-board, igb0/igb1 is addon I350-T2 card): x> ---- x> em0: mem 0x92d00000-0x92d1ffff at x> device 31.6 numa-domain 0 on pci0 x> em0: Using 1024 TX descriptors and 1024 RX descriptors x> em0: Using an MSI interrupt x> em0: Ethernet address: e0:d5:5e:6c:aa:36 x> em0: netmap queues/slots: TX 1/1024, RX 1/1024 x> igb0: mem x> 0xfbb00000-0xfbbfffff,0xfbc84000-0xfbc87fff at device 0.0 numa-domain 0 x> on pci16 x> igb0: Using 1024 TX descriptors and 1024 RX descriptors x> igb0: Using 8 RX queues 8 TX queues x> igb0: Using MSI-X interrupts with 9 vectors x> igb0: Ethernet address: a0:36:9f:0a:cf:42 x> igb0: netmap queues/slots: TX 8/1024, RX 8/1024 x> igb1: mem x> 0xfba00000-0xfbafffff,0xfbc80000-0xfbc83fff at device 0.1 numa-domain 0 x> on pci16 x> igb1: Using 1024 TX descriptors and 1024 RX descriptors x> igb1: Using 8 RX queues 8 TX queues x> igb1: Using MSI-X interrupts with 9 vectors x> igb1: Ethernet address: a0:36:9f:0a:cf:43 x> igb1: netmap queues/slots: TX 8/1024, RX 8/1024 x> ---- x> x> panic: x> ---- x> panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan x> 0xffffffff8157d9a0 with sleeping prohibited x> cpuid = 16 x> time = 1599808542 x> KDB: stack backtrace: x> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame x> 0xfffffe01ba658c40 x> vpanic() at vpanic+0x182/frame 0xfffffe01ba658c90 x> panic() at panic+0x43/frame 0xfffffe01ba658cf0 x> sleepq_add() at sleepq_add+0x359/frame 0xfffffe01ba658d40 x> _sleep() at _sleep+0x20c/frame 0xfffffe01ba658df0 x> pause_sbt() at pause_sbt+0xfe/frame 0xfffffe01ba658e20 x> e1000_reset_hw_82580() at e1000_reset_hw_82580+0x1c8/frame x> 0xfffffe01ba658e60 x> em_if_stop() at em_if_stop+0x1b/frame 0xfffffe01ba658e80 x> iflib_stop() at iflib_stop+0xbd/frame 0xfffffe01ba658ed0 x> iflib_if_ioctl() at iflib_if_ioctl+0x397/frame 0xfffffe01ba658f40 x> bridge_mutecaps() at bridge_mutecaps+0x145/frame 0xfffffe01ba658fb0 x> bridge_ioctl_add() at bridge_ioctl_add+0x468/frame 0xfffffe01ba659000 x> bridge_ioctl() at bridge_ioctl+0x32b/frame 0xfffffe01ba6590d0 x> in_control() at in_control+0x322/frame 0xfffffe01ba659180 x> ifioctl() at ifioctl+0x3e8/frame 0xfffffe01ba659250 x> kern_ioctl() at kern_ioctl+0x28e/frame 0xfffffe01ba6592c0 x> sys_ioctl() at sys_ioctl+0x127/frame 0xfffffe01ba659390 x> amd64_syscall() at amd64_syscall+0x140/frame 0xfffffe01ba6594b0 x> fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ba6594b0 x> --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8004b4aba, rsp = x> 0x7fffffffe2b8, rbp = 0x7fffffffe360 --- x> Uptime: 14s x> Dumping 3794 out of 97961 x> MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% x> ---- x> _______________________________________________ x> freebsd-current@freebsd.org mailing list x> https://lists.freebsd.org/mailman/listinfo/freebsd-current x> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" -- Gleb Smirnoff From owner-freebsd-net@freebsd.org Fri Sep 11 19:25:06 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E08423E35F4 for ; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp5LV5gNjz3V4T for ; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id C27593E3787; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C22853E3734; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from cell.glebi.us (glebi.us [162.251.186.162]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "cell.glebi.us", Issuer "cell.glebi.us" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp5LV4Gw1z3VGG; Fri, 11 Sep 2020 19:25:06 +0000 (UTC) (envelope-from glebius@freebsd.org) Received: from cell.glebi.us (localhost [127.0.0.1]) by cell.glebi.us (8.16.1/8.16.1) with ESMTPS id 08BGBnOQ066394 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 11 Sep 2020 09:11:49 -0700 (PDT) (envelope-from glebius@freebsd.org) Received: (from glebius@localhost) by cell.glebi.us (8.16.1/8.16.1/Submit) id 08BGBmfU066393; Fri, 11 Sep 2020 09:11:48 -0700 (PDT) (envelope-from glebius@freebsd.org) X-Authentication-Warning: cell.glebi.us: glebius set sender to glebius@freebsd.org using -f Date: Fri, 11 Sep 2020 09:11:48 -0700 From: Gleb Smirnoff To: xtouqh@mm.st Cc: current@freebsd.org, net@freebsd.org Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited Message-ID: <20200911161148.GP1269@FreeBSD.org> References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="EgVrEAR5UttbsTXg" Content-Disposition: inline In-Reply-To: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> X-Rspamd-Queue-Id: 4Bp5LV4Gw1z3VGG X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:27348, ipnet:162.251.186.0/24, country:US] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 19:25:06 -0000 --EgVrEAR5UttbsTXg Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi, can you please try out this patch? This is configuration event and we should use sleepable lock to synchronize, not epoch. On Fri, Sep 11, 2020 at 10:47:41AM +0300, xtouqh@mm.st wrote: x> Updating from latest CURRENT snapshot x> (FreeBSD-13.0-CURRENT-amd64-20200910-1544934ffb2) to r365620 broke the x> bridges with igb (I350-T2) for me. Booting to kernel.old and/or x> commenting the entries in rc.conf helps. x> x> rc.conf: x> ---- x> cloned_interfaces="bridge0 bridge1 tap0 tap1 tap2 tap3" x> ifconfig_em0="inet ..." x> ifconfig_igb0="up" x> ifconfig_igb1="up" x> ifconfig_bridge0="addm igb0 addm tap0 addm tap1" x> ifconfig_bridge1="addm igb1 addm tap2 addm tap3" x> ---- x> x> NICs (em0 is on-board, igb0/igb1 is addon I350-T2 card): x> ---- x> em0: mem 0x92d00000-0x92d1ffff at x> device 31.6 numa-domain 0 on pci0 x> em0: Using 1024 TX descriptors and 1024 RX descriptors x> em0: Using an MSI interrupt x> em0: Ethernet address: e0:d5:5e:6c:aa:36 x> em0: netmap queues/slots: TX 1/1024, RX 1/1024 x> igb0: mem x> 0xfbb00000-0xfbbfffff,0xfbc84000-0xfbc87fff at device 0.0 numa-domain 0 x> on pci16 x> igb0: Using 1024 TX descriptors and 1024 RX descriptors x> igb0: Using 8 RX queues 8 TX queues x> igb0: Using MSI-X interrupts with 9 vectors x> igb0: Ethernet address: a0:36:9f:0a:cf:42 x> igb0: netmap queues/slots: TX 8/1024, RX 8/1024 x> igb1: mem x> 0xfba00000-0xfbafffff,0xfbc80000-0xfbc83fff at device 0.1 numa-domain 0 x> on pci16 x> igb1: Using 1024 TX descriptors and 1024 RX descriptors x> igb1: Using 8 RX queues 8 TX queues x> igb1: Using MSI-X interrupts with 9 vectors x> igb1: Ethernet address: a0:36:9f:0a:cf:43 x> igb1: netmap queues/slots: TX 8/1024, RX 8/1024 x> ---- x> x> panic: x> ---- x> panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan x> 0xffffffff8157d9a0 with sleeping prohibited x> cpuid = 16 x> time = 1599808542 x> KDB: stack backtrace: x> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame x> 0xfffffe01ba658c40 x> vpanic() at vpanic+0x182/frame 0xfffffe01ba658c90 x> panic() at panic+0x43/frame 0xfffffe01ba658cf0 x> sleepq_add() at sleepq_add+0x359/frame 0xfffffe01ba658d40 x> _sleep() at _sleep+0x20c/frame 0xfffffe01ba658df0 x> pause_sbt() at pause_sbt+0xfe/frame 0xfffffe01ba658e20 x> e1000_reset_hw_82580() at e1000_reset_hw_82580+0x1c8/frame x> 0xfffffe01ba658e60 x> em_if_stop() at em_if_stop+0x1b/frame 0xfffffe01ba658e80 x> iflib_stop() at iflib_stop+0xbd/frame 0xfffffe01ba658ed0 x> iflib_if_ioctl() at iflib_if_ioctl+0x397/frame 0xfffffe01ba658f40 x> bridge_mutecaps() at bridge_mutecaps+0x145/frame 0xfffffe01ba658fb0 x> bridge_ioctl_add() at bridge_ioctl_add+0x468/frame 0xfffffe01ba659000 x> bridge_ioctl() at bridge_ioctl+0x32b/frame 0xfffffe01ba6590d0 x> in_control() at in_control+0x322/frame 0xfffffe01ba659180 x> ifioctl() at ifioctl+0x3e8/frame 0xfffffe01ba659250 x> kern_ioctl() at kern_ioctl+0x28e/frame 0xfffffe01ba6592c0 x> sys_ioctl() at sys_ioctl+0x127/frame 0xfffffe01ba659390 x> amd64_syscall() at amd64_syscall+0x140/frame 0xfffffe01ba6594b0 x> fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe01ba6594b0 x> --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8004b4aba, rsp = x> 0x7fffffffe2b8, rbp = 0x7fffffffe360 --- x> Uptime: 14s x> Dumping 3794 out of 97961 x> MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% x> ---- x> _______________________________________________ x> freebsd-current@freebsd.org mailing list x> https://lists.freebsd.org/mailman/listinfo/freebsd-current x> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" -- Gleb Smirnoff --EgVrEAR5UttbsTXg Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="lagg_register_vlan-sleeps.diff" Index: if_lagg.c =================================================================== --- if_lagg.c (revision 364434) +++ if_lagg.c (working copy) @@ -476,10 +476,10 @@ lagg_register_vlan(void *arg, struct ifnet *ifp, u if (ifp->if_softc != arg) /* Not our event */ return; - LAGG_RLOCK(); + sx_slock(&sc->sc_sx); CK_SLIST_FOREACH(lp, &sc->sc_ports, lp_entries) EVENTHANDLER_INVOKE(vlan_config, lp->lp_ifp, vtag); - LAGG_RUNLOCK(); + sx_sunlock(&sc->sc_sx); } /* @@ -495,10 +495,10 @@ lagg_unregister_vlan(void *arg, struct ifnet *ifp, if (ifp->if_softc != arg) /* Not our event */ return; - LAGG_RLOCK(); + sx_slock(&sc->sc_sx); CK_SLIST_FOREACH(lp, &sc->sc_ports, lp_entries) EVENTHANDLER_INVOKE(vlan_unconfig, lp->lp_ifp, vtag); - LAGG_RUNLOCK(); + sx_sunlock(&sc->sc_sx); } static int --EgVrEAR5UttbsTXg-- From owner-freebsd-net@freebsd.org Fri Sep 11 19:59:29 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B15713E4C06 for ; Fri, 11 Sep 2020 19:59:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp6693pVQz3XD7 for ; Fri, 11 Sep 2020 19:59:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 826313E4B8C; Fri, 11 Sep 2020 19:59:29 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8095F3E4B0E for ; Fri, 11 Sep 2020 19:59:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp6692v2sz3XSn for ; Fri, 11 Sep 2020 19:59:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4850B9498 for ; Fri, 11 Sep 2020 19:59:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08BJxThB040659 for ; Fri, 11 Sep 2020 19:59:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08BJxT4R040658 for net@FreeBSD.org; Fri, 11 Sep 2020 19:59:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 249253] missing nd6 Neighbor Advertisement on carp failover Date: Fri, 11 Sep 2020 19:59:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 19:59:29 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249253 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Fri Sep 11 21:18:04 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5A8C23E67ED for ; Fri, 11 Sep 2020 21:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp7rr1r3Fz3crQ for ; Fri, 11 Sep 2020 21:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 3EEA93E67EC; Fri, 11 Sep 2020 21:18:04 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3EADD3E6C36 for ; Fri, 11 Sep 2020 21:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp7rr11M3z3crP for ; Fri, 11 Sep 2020 21:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 068889E4C for ; Fri, 11 Sep 2020 21:18:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08BLI3eJ029296 for ; Fri, 11 Sep 2020 21:18:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08BLI3Pm029295 for net@FreeBSD.org; Fri, 11 Sep 2020 21:18:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 248579] accept(2): IPv4 connections fail (IPv6 connections succeed) with dual IPv4/IPv6 TCP servers Date: Fri, 11 Sep 2020 21:18:03 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tuexen@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Works As Intended X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 21:18:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D248579 Michael Tuexen changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Works As Intended Status|Open |Closed --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-net@freebsd.org Fri Sep 11 22:19:42 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2F49F3E81BD for ; Fri, 11 Sep 2020 22:19:42 +0000 (UTC) (envelope-from mgrooms@shrew.net) Received: from mx2.shrew.net (mx2.shrew.net [38.97.5.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp9Cx2j3pz3gkV for ; Fri, 11 Sep 2020 22:19:41 +0000 (UTC) (envelope-from mgrooms@shrew.net) Received: from mail.shrew.net (mail.shrew.prv [10.24.10.20]) by mx2.shrew.net (8.15.2/8.15.2) with ESMTP id 08BMJY9K024274 for ; Fri, 11 Sep 2020 17:19:34 -0500 (CDT) (envelope-from mgrooms@shrew.net) Received: from [10.22.200.30] (unknown [136.49.68.36]) by mail.shrew.net (Postfix) with ESMTPSA id 467B9198D70 for ; Fri, 11 Sep 2020 17:19:29 -0500 (CDT) Subject: Re: Socket option to configure Ethernet PCP / CoS per-flow To: freebsd-net@freebsd.org References: <20200911.185432.122001633.sthaug@nethelp.no> From: Matthew Grooms Message-ID: <5db84c2c-701a-c93a-34d1-f326525a1f8e@shrew.net> Date: Fri, 11 Sep 2020 17:19:36 -0500 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.2 (mx2.shrew.net [10.24.10.11]); Fri, 11 Sep 2020 17:19:34 -0500 (CDT) X-Rspamd-Queue-Id: 4Bp9Cx2j3pz3gkV X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mgrooms@shrew.net designates 38.97.5.132 as permitted sender) smtp.mailfrom=mgrooms@shrew.net X-Spamd-Result: default: False [-2.36 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.92)[-0.917]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[shrew.net]; NEURAL_HAM_SHORT(-0.37)[-0.365]; NEURAL_HAM_MEDIUM(-0.78)[-0.776]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:174, ipnet:38.0.0.0/8, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net]; RECEIVED_SPAMHAUS_PBL(0.00)[136.49.68.36:received] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 22:19:42 -0000 On 9/11/2020 12:15 PM, Scheffenegger, Richard wrote: > Thank you for the quick feedback. > > On a related note - it just occurred to me, that the PCP functionality could be extended to make more effective use of PFC (priority flow control) without explicitly managing it on an application level directly. > > Right now, PFC typically degenerates to good-old Flow control, as all traffic is handled just in the default class (0, or whatever is set up using the IOCTL interface API). > > Typically, the different Ethernet classes come with a notion of prioritization between them - traffic in a "higher" class may be forwarded prior to traffic in a lower class. But that is not a strong requirement - using WRR with 1/8th bandwidth "reserved" for each class in a switch, assigning flows to a random PCP value, PFC could work in a more scalable fashion - only blocking a fraction of traffic, that is actually queue building (has to go over a lower bandwidth link, or a NIC excessively pausing its ingress), thus reducing the chance of the formation of congrestion trees... > > E.g. PCP runs from 0 (default) to 7; > > Adding a socket option to explicitly assign traffic to one of these flows would allow testing and configuring applications to make use of "real" prioritization capabilities of modern switches. > > And what I was just pondering was a special interface level setting (e.g. 8), which results in a socket to pick a "random" value when created, to distribute packets across all the queues available in hardware, allowing PFC to no longer collapse in effect to old FC style "on"/"off" for all traffic... > > Perhaps someone here has experience with congestion tree formation in multi-hop switching environments, and can comment if the above approach would be feasible to address that FC issue? > > > Richard Scheffenegger Hey There Richard, I live in Austin where we are fortunate enough to have Google Fiber. And while I love the service, I hate the idea of being forced to use the Google Fiber black box as my edge device. But get full use of the service, you have to set VLAN + PCP values appropriately or you hit a Google imposed traffic shaping bottleneck. In any case, I was able to do this using pf as the packet classifier. You simply write a rule to match the traffic and assign the desired value. Perhaps this may be a way to accomplish what you're trying to do without having to add a new socket option. Have a look at the pf.conf man page and search for 'set prio'. I assume ipfw has an equivalent feature as well ...      set prio priority | (priority, priority)            Packets matching this rule will be assigned a specific queueing            priority.  Priorities are assigned as integers 0 through 7.  If the            packet is transmitted on a vlan(4) interface, the queueing priority            will be written as the priority code point in the 802.1Q VLAN            header.  If two priorities are given, packets which have a TOS of            lowdelay and TCP ACKs with no data payload will be assigned to the            second one. Hope this helps, -Matthew From owner-freebsd-net@freebsd.org Fri Sep 11 22:41:39 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8CF1F3E8D15 for ; Fri, 11 Sep 2020 22:41:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bp9jH3Hxrz3ycB for ; Fri, 11 Sep 2020 22:41:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 712643E8C3D; Fri, 11 Sep 2020 22:41:39 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 70F0F3E8C98 for ; Fri, 11 Sep 2020 22:41:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp9jH2VCPz3yyL for ; Fri, 11 Sep 2020 22:41:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 39FF4B355 for ; Fri, 11 Sep 2020 22:41:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08BMfdpm023916 for ; Fri, 11 Sep 2020 22:41:39 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08BMfd1K023915 for net@FreeBSD.org; Fri, 11 Sep 2020 22:41:39 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 249261] Kernel ignores RTAX_IFP if an exact RTAX_IFA match is found Date: Fri, 11 Sep 2020 22:41:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 22:41:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249261 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat Sep 12 00:42:25 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 646F93EB279; Sat, 12 Sep 2020 00:42:25 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "gate2.funkthat.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpDNc53Vxz45nR; Sat, 12 Sep 2020 00:42:21 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (localhost [127.0.0.1]) by gold.funkthat.com (8.15.2/8.15.2) with ESMTPS id 08C0gILN007193 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 11 Sep 2020 17:42:19 -0700 (PDT) (envelope-from jmg@gold.funkthat.com) Received: (from jmg@localhost) by gold.funkthat.com (8.15.2/8.15.2/Submit) id 08C0gIke007192; Fri, 11 Sep 2020 17:42:18 -0700 (PDT) (envelope-from jmg) Date: Fri, 11 Sep 2020 17:42:18 -0700 From: John-Mark Gurney To: freebsd-net@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: CFT: major update to if_ure Message-ID: <20200912004218.GC4213@funkthat.com> Mail-Followup-To: freebsd-net@FreeBSD.org, freebsd-current@FreeBSD.org References: <20200725231318.GO4213@funkthat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200725231318.GO4213@funkthat.com> X-Operating-System: FreeBSD 11.3-STABLE amd64 X-PGP-Fingerprint: D87A 235F FB71 1F3F 55B7 ED9B D5FF 5A51 C0AC 3D65 X-Files: The truth is out there X-URL: https://www.funkthat.com/ X-Resume: https://www.funkthat.com/~jmg/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? User-Agent: Mutt/1.6.1 (2016-04-27) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (gold.funkthat.com [127.0.0.1]); Fri, 11 Sep 2020 17:42:19 -0700 (PDT) X-Rspamd-Queue-Id: 4BpDNc53Vxz45nR X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of jmg@gold.funkthat.com has no SPF policy when checking 208.87.223.18) smtp.mailfrom=jmg@gold.funkthat.com X-Spamd-Result: default: False [0.37 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[jmg]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[funkthat.com]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.27)[0.267]; NEURAL_HAM_LONG(-0.20)[-0.197]; NEURAL_HAM_MEDIUM(-0.90)[-0.899]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[jmg@funkthat.com,jmg@gold.funkthat.com]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:32354, ipnet:208.87.216.0/21, country:US]; FROM_NEQ_ENVFROM(0.00)[jmg@funkthat.com,jmg@gold.funkthat.com]; MAILMAN_DEST(0.00)[freebsd-net,freebsd-current]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 00:42:25 -0000 John-Mark Gurney wrote this message on Sat, Jul 25, 2020 at 16:13 -0700: > Hello, > > I'd like people who have ure (RealTek) based USB devices to test > review D25809[0]. > > This update adds support for: > - HW VLAN tagging > - HW checksum offload for IPv4 and IPv6 > - tx and rx aggreegation (for full gige speeds) > - multiple transactions > > In my testing, I am able to get 900-950Mbps depending upon > TCP or UDP, which is a significant improvement over the previous > 91Mbps (~8kint/sec*1500bytes/packet*1packet/int). > > Thanks. > > [0] https://reviews.freebsd.org/D25809 This has now landed in: https://reviews.freebsd.org/rS365648 Let me know if there are any regressions. Thanks. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-net@freebsd.org Sat Sep 12 09:39:59 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3EA163D1ABE for ; Sat, 12 Sep 2020 09:39:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BpSJv11vGz4dnR for ; Sat, 12 Sep 2020 09:39:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 232603D1E11; Sat, 12 Sep 2020 09:39:59 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 22F033D1ABD for ; Sat, 12 Sep 2020 09:39:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpSJv08klz4dcH for ; Sat, 12 Sep 2020 09:39:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id DCBC412ACE for ; Sat, 12 Sep 2020 09:39:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08C9dwVq076029 for ; Sat, 12 Sep 2020 09:39:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08C9dw8n076028 for net@FreeBSD.org; Sat, 12 Sep 2020 09:39:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 249261] Kernel ignores RTAX_IFP if an exact RTAX_IFA match is found Date: Sat, 12 Sep 2020 09:39:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: Unspecified X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: melifaro@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: melifaro@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 09:39:59 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249261 Alexander V. Chernikov changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|net@FreeBSD.org |melifaro@FreeBSD.org CC| |melifaro@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat Sep 12 11:22:25 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8EC303D4395 for ; Sat, 12 Sep 2020 11:22:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4BpVb53HGRz3Wh4 for ; Sat, 12 Sep 2020 11:22:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 708053D40EA; Sat, 12 Sep 2020 11:22:25 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 704423D40E9 for ; Sat, 12 Sep 2020 11:22:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpVb52RdRz3WZW for ; Sat, 12 Sep 2020 11:22:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3313B1425D for ; Sat, 12 Sep 2020 11:22:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08CBMPiQ087110 for ; Sat, 12 Sep 2020 11:22:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08CBMP51087104 for net@FreeBSD.org; Sat, 12 Sep 2020 11:22:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 227033] vxlan(4) does not work with vni larger than 65535 Date: Sat, 12 Sep 2020 11:22:24 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: sergey@akhmatov.ru X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 11:22:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D227033 Sergey Akhmatov changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |sergey@akhmatov.ru --- Comment #1 from Sergey Akhmatov --- Can confirm: the bug is still there in 12-STABLE (r364973) I can see transmitted packets encapsulated in vxlan with correct VNI > 6553= 5. It seems that receiving host can't decapsulate such packets. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat Sep 12 15:42:32 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D287B3DB2A4 for ; Sat, 12 Sep 2020 15:42:32 +0000 (UTC) (envelope-from gbe@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpcMD59Fnz4692 for ; Sat, 12 Sep 2020 15:42:32 +0000 (UTC) (envelope-from gbe@freebsd.org) Received: from localhost (p4fd3acce.dip0.t-ipconnect.de [79.211.172.206]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: gbe) by smtp.freebsd.org (Postfix) with ESMTPSA id 287DC10B81 for ; Sat, 12 Sep 2020 15:42:32 +0000 (UTC) (envelope-from gbe@freebsd.org) Date: Sat, 12 Sep 2020 17:42:31 +0200 From: Gordon Bergling To: freebsd-net@freebsd.org Subject: IPv6 behind NAT Message-ID: <20200912154231.GA27224@lion.0xfce3.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Url: X-Operating-System: FreeBSD 12.2-STABLE amd64 X-Host-Uptime: 5:39PM up 21:02, 3 users, load averages: 0.21, 0.29, 0.26 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 15:42:32 -0000 Hi, does anyone know if it is possible to create an IPv6 tunnel via a tunnelbroker, Hurricane Electric for example, if the system is behind a NAT connection? -- Gordon From owner-freebsd-net@freebsd.org Sat Sep 12 16:11:17 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3C55B3DBCCC for ; Sat, 12 Sep 2020 16:11:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Bpd0P0qDVz47Xc for ; Sat, 12 Sep 2020 16:11:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 1C1A23DBCCB; Sat, 12 Sep 2020 16:11:17 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1BE593DBEBC for ; Sat, 12 Sep 2020 16:11:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bpd0P01R8z47jq for ; Sat, 12 Sep 2020 16:11:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D9AE2176EC for ; Sat, 12 Sep 2020 16:11:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 08CGBGlF088353 for ; Sat, 12 Sep 2020 16:11:16 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 08CGBGcP088350 for net@FreeBSD.org; Sat, 12 Sep 2020 16:11:16 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 249275] New netgraph nodetype: ng_antispoof Date: Sat, 12 Sep 2020 16:11:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 16:11:17 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D249275 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |net@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-net@freebsd.org Sat Sep 12 16:11:35 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6952F3DC215 for ; Sat, 12 Sep 2020 16:11:35 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (mx1.sbone.de [IPv6:2a01:4f8:13b:39f::9f:25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.sbone.de", Issuer "SBone.DE" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bpd0k52n0z4819; Sat, 12 Sep 2020 16:11:34 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:31::2013:587]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id A5BE08D4A176; Sat, 12 Sep 2020 16:11:26 +0000 (UTC) Received: from content-filter.sbone.de (content-filter.sbone.de [IPv6:fde9:577b:c1a9:31::2013:2742]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 3AE03E707D6; Sat, 12 Sep 2020 16:11:26 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:31::2013:587]) by content-filter.sbone.de (content-filter.sbone.de [fde9:577b:c1a9:31::2013:2742]) (amavisd-new, port 10024) with ESMTP id A9vqQ1lN3uz5; Sat, 12 Sep 2020 16:11:25 +0000 (UTC) Received: from [127.0.0.1] (unknown [IPv6:fde9:577b:c1a9:4902:d9cf:6b52:e7b0:5bd8]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 299CEE707D0; Sat, 12 Sep 2020 16:11:24 +0000 (UTC) From: "Bjoern A. Zeeb" To: "Gordon Bergling" Cc: freebsd-net@freebsd.org Subject: Re: IPv6 behind NAT Date: Sat, 12 Sep 2020 16:11:24 +0000 X-Mailer: MailMate (2.0BETAr6151) Message-ID: <7CBF59D0-6A1C-45B3-A877-669D2B9A40C5@lists.zabbadoz.net> In-Reply-To: <20200912154231.GA27224@lion.0xfce3.net> References: <20200912154231.GA27224@lion.0xfce3.net> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4Bpd0k52n0z4819 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of bzeeb-lists@lists.zabbadoz.net designates 2a01:4f8:13b:39f::9f:25 as permitted sender) smtp.mailfrom=bzeeb-lists@lists.zabbadoz.net X-Spamd-Result: default: False [-2.71 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a01:4f8:13b:39f::9f:25]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[zabbadoz.net]; NEURAL_HAM_LONG(-1.02)[-1.022]; NEURAL_HAM_MEDIUM(-1.01)[-1.010]; NEURAL_HAM_SHORT(-0.37)[-0.374]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 16:11:35 -0000 On 12 Sep 2020, at 15:42, Gordon Bergling wrote: > Hi, > > does anyone know if it is possible to create an IPv6 tunnel via a > tunnelbroker, > Hurricane Electric for example, if the system is behind a NAT > connection? See https://ipv6.he.net/certification/faq.php Search for the section labeled “Tunnel Broker” and read the notes. /bz From owner-freebsd-net@freebsd.org Sat Sep 12 22:07:20 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 998B13E400B for ; Sat, 12 Sep 2020 22:07:20 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 4BpmvD3cYkz4YtM for ; Sat, 12 Sep 2020 22:07:20 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id 790D93E4009; Sat, 12 Sep 2020 22:07:20 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 776A33E3D15; Sat, 12 Sep 2020 22:07:20 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpmvD2GmKz4Yqx; Sat, 12 Sep 2020 22:07:20 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 16DED138BE; Sat, 12 Sep 2020 22:07:20 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id 8552043F5A; Sun, 13 Sep 2020 00:07:18 +0200 (CEST) From: "Kristof Provost" To: "Gleb Smirnoff" Cc: xtouqh@mm.st, current@freebsd.org, net@freebsd.org Subject: Re: bridge/igb panic: sleepq_add: td 0xfffffe01bbce5300 to sleep on wchan 0xffffffff8157d9a0 with sleeping prohibited Date: Sun, 13 Sep 2020 00:07:14 +0200 X-Mailer: MailMate (1.13.2r5673) Message-ID: <3891457F-A600-48C0-B9D1-C2259251FB42@FreeBSD.org> In-Reply-To: <20200911170601.GT1269@FreeBSD.org> References: <8172451b-81ea-aacb-02bd-b5005d18646d@mm.st> <20200911170601.GT1269@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 22:07:20 -0000 On 11 Sep 2020, at 19:06, Gleb Smirnoff wrote: > Kristof, > > can you please take a look? IMHO, the problem is that with r360345 > the bridge_ioctl() is fully covered by epoch. IMHO, should be either > more fine grained covered, or use internal locking, because some of > the code downstream (driver ioctl) may sleep. > How does https://reviews.freebsd.org/D26418 look? Best regards, Kristof