From owner-freebsd-net@freebsd.org Wed Apr 14 00:47:29 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E6C345F3CA5 for ; Wed, 14 Apr 2021 00:47:29 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: from mail-yb1-xb36.google.com (mail-yb1-xb36.google.com [IPv6:2607:f8b0:4864:20::b36]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FKkMj23kNz3rCp for ; Wed, 14 Apr 2021 00:47:28 +0000 (UTC) (envelope-from kevin.bowling@kev009.com) Received: by mail-yb1-xb36.google.com with SMTP id k73so13923551ybf.3 for ; Tue, 13 Apr 2021 17:47:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kev009.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=Jbxf/AdRltDJFFGJFc4T9zoT0wHzgSnEA/yVcf7Chnw=; b=d8bDW7LfGDKfBWfJLaoMPTvLUi9ZkaNx9JXqvVNhM94QLyDHC8MJ9A/uMDskRa8/Zo OwPtNvwRruJfMhy0wv+eJxbztZGra4HK26koULcdngN6PxIKD9d32jPOtGAoYiKaLgDe CZ/sHKUwJYqZv+u0XuZGbfynpNLMjpcA/KiGg= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Jbxf/AdRltDJFFGJFc4T9zoT0wHzgSnEA/yVcf7Chnw=; b=o8XoMwtZeO/xFp+4th4Mt+/ygk0qlXkFsAFZ4swn7q1FkUF9ok9v4JaNb+P2vcfRRR PY2WnfXww9eFKqNp59CvGMn8SVF8F/5BFFRqW6e29MsNHyCQyN7e7I/0ieY8luQELKbJ FHvhXQNH9aD/5aGpLbkznEcXplC3qQHAeP/WJ+Zx6VWOEDdZdiH1URevEe6fi0GlMdVw giw5T6GjouqrfXnuUaKA2kTeXRtRkZnfcn4Lxz3Ofx6qYIUZUkT7IfM541TTb+7euUSJ 1vCFJ2YzUYpb6x5E1tjFME9AdEiVO3SMu3if+esHiXPtqgYGWhnZmEhrJ+JtgQj3iLv1 UGuQ== X-Gm-Message-State: AOAM530ZP7dTQ19otA4EMGJQTR27nTY0hUWeKojgzVNK88F90FyPcVQa 5LfmhSwj91ju2U9txmgW2ST56CNujM6Flm1AjNTd5RIGy6hsBw== X-Google-Smtp-Source: ABdhPJzB7tHXjtXIilrZwIJ55ZsJjh5DZ3Yw+f1TLJTUC2LiD62zTiUGosi1frG5rx5XGXDuKBw9LnRe7nredsTrM1c= X-Received: by 2002:a25:aa49:: with SMTP id s67mr17095287ybi.330.1618361248018; Tue, 13 Apr 2021 17:47:28 -0700 (PDT) MIME-Version: 1.0 References: <8923AD0B-1E58-4F7C-AEF5-E9A30D3F9F2C@gmail.com> In-Reply-To: From: Kevin Bowling Date: Tue, 13 Apr 2021 17:47:17 -0700 Message-ID: Subject: Re: All transmits on txq0 on an ix interface - why no balancing? To: Phil Rosenthal Cc: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= , FreeBSD Net Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4FKkMj23kNz3rCp X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none (invalid DKIM record) header.d=kev009.com header.s=google header.b=d8bDW7Lf; dmarc=none; spf=pass (mx1.freebsd.org: domain of kevin.bowling@kev009.com designates 2607:f8b0:4864:20::b36 as permitted sender) smtp.mailfrom=kevin.bowling@kev009.com X-Spamd-Result: default: False [-2.27 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-0.97)[-0.971]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; DMARC_NA(0.00)[kev009.com]; SPAMHAUS_ZRD(0.00)[2607:f8b0:4864:20::b36:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[kev009.com:~]; NEURAL_HAM_SHORT(-1.00)[-0.996]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::b36:from]; R_DKIM_PERMFAIL(0.00)[kev009.com:s=google]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-net]; RBL_DBL_DONT_QUERY_IPS(0.00)[2607:f8b0:4864:20::b36:from] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Apr 2021 00:47:30 -0000 On Tue, Apr 13, 2021 at 5:37 PM Phil Rosenthal wrote: > > > On Apr 13, 2021, at 8:22 PM, Kevin Bowling w= rote: > > > > On Tue, Apr 13, 2021 at 5:11 PM Phil Rosenthal wro= te: > >> > >>> On Apr 13, 2021, at 8:07 PM, Olivier Cochard-Labb=C3=A9 wrote: > >>> > >>> Are you exiting through a tunnel interface (GRE, GIF, PPPoE, IPsec, O= penVPN, etc.) ? > >> No. > >> > >> I am running PF/Altq for NAT and Traffic shaping. > > > > ALTQ is the problem in this situation. Try without it and see if you > > get proper distribution. > > Yep, proper distribution with altq disabled. > > That's pretty unfortunate, though ... It means that I'm forced to deal wi= th the Comcast's buffer management which allows for more buffer bloat and i= s less deterministic about what packets get dropped. > > I'm assuming that this won't get fixed due to PF generally not being main= tained these days -- is there any other solution for shaping with active qu= eue management (preferably RED) on FreeBSD to use instead of altq? Dummynet= obviously has problems of it's own. pf in FreeBSD is pretty well maintained. altq currently has no maintainer (at least that I am aware of). It's a difficult problem, altq needs to "learn" a lot about multithreading. I'm not aware of anyone working on it, although Patrick Kelsey (pkelsey@) may be worth a ping (IIRC he might have looked at this problem a bit, I'd bet he could do it if he has time and some entity can sponsor the work). > In any event - thanks for your help. > -Phil