From owner-freebsd-stable@freebsd.org Thu Sep 17 00:49:39 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 52CA73F696E for ; Thu, 17 Sep 2020 00:49:39 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: from mail-wm1-f52.google.com (mail-wm1-f52.google.com [209.85.128.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BsJJd66lkz4VsG for ; Thu, 17 Sep 2020 00:49:37 +0000 (UTC) (envelope-from jtubnor@gmail.com) Received: by mail-wm1-f52.google.com with SMTP id w2so296467wmi.1 for ; Wed, 16 Sep 2020 17:49:37 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=2jnLcbnAySgKpO95dWXK/VG9g6GFXSxv15dLmJR7sRA=; b=OIqAJDMluzX4OuxB737cankM0bGw3SA8OLbUGf0L9u3/VbdkmCnnWrKM94CRIg7YYC sKhmlzeZKqtOs1WniVVANaWYJBiDtyDJOhXjG16g9nkqRFQiSYSm+vCE6LzAam6xaNzL b/NEFbJxApSP3wmmSYs1Tu9FAe/Nd6gpRw8WCEA1eicwbfLFRFKr5r55amqWNswVHOTi NVouMYB0HOub7OM3q4rHQS9dLl2WL4lFXfHpCbtWBMo60KtEwP7erVt0zC6EtRGRfcJa gQq+ZdvgP4oHKmkG56YHJXR8++v/1IEYhPSVAhTsYz2etUSK8+yKtuyOTTlccX9gbbEw dexQ== X-Gm-Message-State: AOAM531HRq81HOSiFUtMkVpucmCceWIBPcoFPHhwghgSPxGh/++zfP+D xvLEm9SbX048dzQ4DG3AGJkn9nkds8DrGZTAmIM023ZqVPQ= X-Google-Smtp-Source: ABdhPJzvLkza+yKzIjf8VkgPlHo4pRgmIUAY3R2vZmPpIXVpuj3hDP4XmkrqofdeRFqrm+DyjHV7LNQUnyFV8gLTdGA= X-Received: by 2002:a1c:39c4:: with SMTP id g187mr7004469wma.126.1600303776010; Wed, 16 Sep 2020 17:49:36 -0700 (PDT) MIME-Version: 1.0 From: Jason Tubnor Date: Thu, 17 Sep 2020 10:49:24 +1000 Message-ID: Subject: Fragmentation of em(4) traffic (potentially others) when using vlanhwtag 12.2-BETA1 To: freebsd-stable X-Rspamd-Queue-Id: 4BsJJd66lkz4VsG X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of jtubnor@gmail.com designates 209.85.128.52 as permitted sender) smtp.mailfrom=jtubnor@gmail.com X-Spamd-Result: default: False [-1.23 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.50)[-0.496]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; SH_EMAIL_DBL_DONT_QUERY_IPS(0.00)[0.0.5.200:email,0.0.0.0:email]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[tubnor.net]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.87)[-0.865]; TO_DN_ALL(0.00)[]; DBL_PROHIBIT(0.00)[0.0.5.200:email,0.0.0.0:email]; RCVD_IN_DNSWL_NONE(0.00)[209.85.128.52:from]; NEURAL_SPAM_SHORT(0.14)[0.135]; FORGED_SENDER(0.30)[jason@tubnor.net,jtubnor@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.128.52:from]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_NEQ_ENVFROM(0.00)[jason@tubnor.net,jtubnor@gmail.com]; MAILMAN_DEST(0.00)[freebsd-stable] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Sep 2020 00:49:39 -0000 Hi, Doing some edge case testing with 12.2-BETA1, I have come across fragmentation issues when vlanhwtag is enabled on the em(4) network device (device listed below), causing IPSec traffic moving through a bhyve 'router-on-a-stick' to tank on send. When you disable (-vlanhwtag), this issue goes away and full speed send is possible. Here is a snip of the traffic leaving for the internet after traversing several VLANs through a bhyve router with vlanhwtag enabled: 10:09:54.173412 Dest.443 > Source.60901: . ack 12384 win 492 (DF) 10:09:54.173936 Source.60901 > Dest.443: . 38413:39873(1460) ack 3837 win 1027 (frag 20228:1480@0+) 10:09:54.173937 Source > Dest: (frag 20228:1420@1480) pciconf -vlbc em0@pci0:0:25:0: class=0x020000 card=0x308617aa chip=0x15028086 rev=0x04 hdr=0x00 vendor = 'Intel Corporation' device = '82579LM Gigabit Network Connection (Lewisville)' class = network subclass = ethernet bar [10] = type Memory, range 32, base 0xf7d00000, size 131072, enabled bar [14] = type Memory, range 32, base 0xf7d39000, size 4096, enabled bar [18] = type I/O Port, range 32, base 0xf080, size 32, enabled cap 01[c8] = powerspec 2 supports D0 D3 current D0 cap 05[d0] = MSI supports 1 message, 64 bit enabled with 1 message cap 13[e0] = PCI Advanced Features: FLR TP Happy to provide further information if required and perform testing to make sure the 12.2 release is polished. Thanks, Jason.