From owner-freebsd-xen@freebsd.org Fri May 7 09:56:13 2021 Return-Path: Delivered-To: freebsd-xen@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 038B55FF2DD for ; Fri, 7 May 2021 09:56:13 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from esa6.hc3370-68.iphmx.com (esa6.hc3370-68.iphmx.com [216.71.155.175]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.hc3370-68.iphmx.com", Issuer "HydrantID SSL CA G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fc5SC6mG0z3wPn for ; Fri, 7 May 2021 09:56:11 +0000 (UTC) (envelope-from roger.pau@citrix.com) IronPort-SDR: rK8dBQIBKsCgnPHt/XyvsLX/XqtbDzBxlCpod+7Cgbg7VdJClks7d55W6cg/HQPCWBRx+w1JeQ /teNeI52ua8cKGSbCf2OMLkAQJBOQ8Eky7ItS81ZEgdjZCBVSmvuZrpfYwuBvbqagOVo3bOK9P FLCmpZKFzbTek3QXOcJde0ALcW9tz4+StSAmiIVBVXs0U690OvGIv30fxcZGuUYvEtCHr3FN16 KK3VMhuLXDfwFD9nYLcPmx1zRTZAwE01YwXFQ37ADGRAIM4fKhZS7TdLMH2cm4Mu2eIMW9BVfR ObM= X-SBRS: 5.1 X-MesageID: 43399156 X-Ironport-Server: esa6.hc3370-68.iphmx.com X-Remote-IP: 162.221.158.21 X-Policy: $RELAYED IronPort-HdrOrdr: A9a23:fSi3cK6glULZc2Hp/APXwDLXdLJyesId70hD6qkQc3FomwKj9/ xG/c5rsSMc7Qx6ZJhOo7+90cW7L080lqQFhLX5X43SPzUO0VHARO1fBOPZqAEIcBeOlNK1u5 0AT0B/YueAcGSTj6zBkXWF+wBL+qj5zEiq792usUuEVWtRGsZdB58SMHfhLqVxLjM2Y6YRJd 6nyedsgSGvQngTZtTTPAh+YwCSz+e77a4PeHQ9dmYa1DU= X-IronPort-AV: E=Sophos;i="5.82,280,1613451600"; d="scan'208";a="43399156" ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QPwVVbuff/NOttfTsBPKf/JdEi0aj7/YeD8MajS7YLzXWKfgRe21Nkgv8oX2ii1ol4NMhbQBjcAyMU2iG1hh4+qLm39CvN+bN/KXUp2atNnddONwdEv5mb+w8t7gXHRKzA9ul00u+wGL4LJNHq0WVfoMR8rilQWFTpo/osaKgc/OO6925Q0U95YhsgfiCkkviMVJwX8f92sLk8HG85w8AAa6ANWsRJtBoSUhFzrHR48irgiebktNSc/oOKlFCu3lgpvRxuhJlnPbun1vZGdgJizC9Gl9i2WvbdT6uBPNHIZMleKL1USwT78kB73VT7VP2YoS7HLQs6yTPAv9gS75dQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=aJtMzu/mgK6xwaq9R1/0nqmTBgxOhAMPagBkKma6JIk=; b=MkszlVtn0lEA+95olZP/8xvYyqThgdc+212xoL74aetLr+s/TplDvUIqWaDl3gsl8CYHpbQGdzCt2p/ZgiOeWTpUjC96A3VmqUZogss/FWlw22Nmpo+LNGn2rTNwINAnsdBmuH89oHiZiSW7+jRD35imgZadTUQQLf5yeLleYpOy4a5ALZVxbp3Uyn7hQo6nPThz4eyuYNEoK48Y8wJ8jhdp3wOyKf59MM8ttNojQuwruaYwzqevWqnWiFxuP88j1gEfAwLxgxe4h0fwMq1OZ7U+LjfMEfNS7l4JMWbBxB/R/Bh0T5QBk2CSZCovKU4T+lkiIPzRCw8h2ud0xBTioA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=citrix.com; dmarc=pass action=none header.from=citrix.com; dkim=pass header.d=citrix.com; arc=none Date: Fri, 7 May 2021 11:55:56 +0200 From: Roger Pau =?utf-8?B?TW9ubsOp?= To: Brian Buhrow CC: Subject: Re: Issue with packet framing on xnb(4) connections and NetBSD domus Message-ID: References: <202103170823.12H8Nkuo014508@nfbcal.org> Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <202103170823.12H8Nkuo014508@nfbcal.org> X-ClientProxiedBy: AM9P195CA0026.EURP195.PROD.OUTLOOK.COM (2603:10a6:20b:21f::31) To DS7PR03MB5608.namprd03.prod.outlook.com (2603:10b6:5:2c9::18) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 5ca09368-7cc0-4f1e-5e58-08d9113e518a X-MS-TrafficTypeDiagnostic: DS7PR03MB5463: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8882; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: fcBNsmQNnfIiCWE2LOWcExBQn5c4q5oX8sD6OcnEq8vrHKWH9qADUenDu85rSP8TGAo1OViE7e33mQxl7qx0oYxEs0JgUXQ7hXHNzV9TMqaHNoo2MeVp8oSSpBDwR5mx6BVyodCbwySjFMkvQQvM3CJwGnaLiLTYdx3x/fu5O8/PX8ky/T5o74vBgbDQxvuu8b1ER/m7X1nfiy2dJnmz3EjhBpnhB6UX+JacsoAMvukJTZlIdZkamoOqQtjBNnndcc9TNbJC6yhqVzB0XQe7UO/9ZD1aF20KLYrlxV9sYV4t4x4HAtsJR4168QDbeyXSSHXKFsJ/xxMUjgArNejoHfsGVIwyWgfvdYsDCoO8DyqHxZ2qE2b4rSUgvwnzLNt85tk4rR7M72DB33DI5QP5+alW48gL5msYxBGoJkK3C49oIFCn9ArqzHf1ZKLXDIJtkvZV407zt1KE+4vaWK/9aaB3rDaR35cUmmkG+QE5lHfvQqGpmlzbIUBHtHUYvLg95EmSRfoEwliJJ1hkbqj8UyIKqfoeVLS7OQzklw5a3FDq7vzgJVUNezqN1lPSEtEk1RTMk3H5Y4tILBo0Q1VrAENUxMoeHYOHtA9LfuYMRGA= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DS7PR03MB5608.namprd03.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(7916004)(376002)(136003)(366004)(396003)(39860400002)(346002)(16526019)(186003)(26005)(6666004)(6496006)(86362001)(6916009)(8676002)(33716001)(38100700002)(8936002)(85182001)(9686003)(6486002)(66556008)(4326008)(66946007)(2906002)(66476007)(83380400001)(316002)(956004)(478600001)(5660300002); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData: =?utf-8?B?dkJhOXY3QURFVVFsYkF4aS9UT1JZUnVBUEJQckJ5ejVxTzU3aTRReWlhRy9l?= =?utf-8?B?T0Q0V2loU21CcUZGUHo2TFhaOFNVTnBJN3k5engxZVhEdEZtK2RGTUtCWlcy?= =?utf-8?B?OHA2cW5QcUlteE14YjYwNXlYWGZ0dEd6bkoxeEJkZ1d1ZzRGazFJY0Z6WUpB?= =?utf-8?B?MFdObU9xbjJpaWp2cC9uQTJBMWJZRmFZUVpReDFjK0x2TUpUeUE0Z29ES2JN?= =?utf-8?B?cUxaTjdlM0gzeTUxR0kzV3ZQZi9jaEZrT0gxWlVLNnVYMGVZY3BneUtVdG5G?= =?utf-8?B?TEZ6MUU4MDFJaW52RHBtck1rQTV3am0rcS9pakpwOThaKzdoUTBDM1JmaVNO?= =?utf-8?B?aTNnREVWMkxzKzZoTExJRDQ1bWk0RytQZEx0VHBqWDVGdXJ4TWZXNndobjVh?= =?utf-8?B?ZE1vOEhoWFJOZVpSeGJoaDBwaGQ5K09UV0c1bTR0cGVBblI5K0VPTmR1clhq?= =?utf-8?B?aExIT05pZHZwcDhSZkllcVZ4TnFuWmltTXRUWGJBNHZuNTFEUW9sak8vWmM3?= =?utf-8?B?ZEJwd2FNczk2YnZCTG9IU0ZOak1kWUptNWs2SzdadGpHN3RpVnl4QzBGdVZU?= =?utf-8?B?RVdFVWJWQWlONVN0Uk5WamlDQmxpRUVVV1c0WlpVYU1YMFFzUWhSMHhGTTh6?= =?utf-8?B?ZkJ5WGY4Tmg5WW1WWHVUQUFUOGxMb2hTd0h2d01sdXJ5WHZiTXFDRXV6S0Zk?= =?utf-8?B?bVdFNDNjeisvOEptN0hYRnBJQjZVeUVyR1BROE9CK0hxNjB5OHhsSkloK0lX?= =?utf-8?B?VFdKN1ErbGxsanh5ZkZUVkI2ZmtwdEp2d0hTcGZ0Umh0ZkxpOFZqWi9tWDRL?= =?utf-8?B?ZVpZU21jY2RqYmpWRjNUdXE3QkJJR2lrK3dQWTVUSllpSFFSNmFNMElwalNU?= =?utf-8?B?V1hSNFhrNnBiMXU3WjMzUTFPZzZZUFpqZ0RZS1hYZFJHNHN3UjBPYy84RVF4?= =?utf-8?B?WWlMZndwT1BkdllLZmNyaGNNRGlITi9lY0xYMkNmOWRIeGhWRVdzWUpDVEtD?= =?utf-8?B?Tjh0MStxbXNNRy9JR0R6WUZmSnZGUG9WaEZPbUkwY1IyYVN3ekFmNEhNTnBk?= =?utf-8?B?SXFUYUE5NXRlR0xCak9nTm1adDFsTk5JdDUzb3F4aGhSbS9XaHVvWlVTaElZ?= =?utf-8?B?UE5Tc1kwTXVtaHBXR1JBZmpmcDYvSW8vWXFXYTcxVkZyWGZoOWxSU1QvQXZR?= =?utf-8?B?MmllbU9xbUpOck1VRTRJbUtIbmJZNFhCdWhJUHJ5YmRhTXJNdlByVmZkVmts?= =?utf-8?B?b1Y2QnA4ZDRneHFwUXBoNnZUaXdDZWtITy9iRUJXdmRYMXVaYnFiVy9EYUdY?= =?utf-8?B?NS9hN3d3MndmMVBVc1RvMGt6cXNaSDVCTDF2ZlF5NkRXcFlwR04wa2tQa0dQ?= =?utf-8?B?QzNHK3BmejZkZjFmZjhGREtGeXZWaHVPSGpYSGIyYzZWMTFMQ1IzSmo3czlH?= =?utf-8?B?YTFBb3NnQXdPSkRXaGhOMmJyRGs3NzNzYmJjTGRzTWZ2U0hMY01DVk93cU5E?= =?utf-8?B?a2F4S2JJTkIrTHQwSFNoM3lLWUJJNFB3dnJlVXFtQmJXVlo4dUtvc0g2QmM2?= =?utf-8?B?dmdaV2tlREh5MDhFT3RobmozQlU0RzloWnBCVDZEb0I1bURvSnFtY2hoODVJ?= =?utf-8?B?Skw1ajFKTldZWWhPQ3IzZ1QvS1NJalZkUHpLZEViUUVSb1MrWUhqdTF6OWVw?= =?utf-8?B?eEpvN25kajNoZmsvYkx3T1FjVk9MNnpFY0tua1BsdzhtRytLaEwvRUF6SXlu?= =?utf-8?Q?NJKAbFOIg3xob4g0XXUcxnX/RksaN1c163AdPEA?= X-MS-Exchange-CrossTenant-Network-Message-Id: 5ca09368-7cc0-4f1e-5e58-08d9113e518a X-MS-Exchange-CrossTenant-AuthSource: DS7PR03MB5608.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 May 2021 09:56:00.5433 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 335836de-42ef-43a2-b145-348c2ee9ca5b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: eFmvzwBMppRWbA8gx4nuUbOfmeI36fyjWCOc2wl7LnfgZ3D7IktHX28mlMH+m8Ptag0MmIfNdvXKZBdrma//Zg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR03MB5463 X-OriginatorOrg: citrix.com X-Rspamd-Queue-Id: 4Fc5SC6mG0z3wPn X-Spamd-Bar: ----- X-Spamd-Result: default: False [-6.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[citrix.com:s=securemail,citrix.onmicrosoft.com:s=selector2-citrix-onmicrosoft-com]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; DWL_DNSWL_LOW(-1.00)[citrix.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[citrix.com:+,citrix.onmicrosoft.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[citrix.com,reject]; RCVD_IN_DNSWL_MED(-0.20)[216.71.155.175:from]; R_SPF_NA(0.00)[no SPF record]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:16417, ipnet:216.71.154.0/23, country:US]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MAILMAN_DEST(0.00)[freebsd-xen] X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 May 2021 09:56:13 -0000 On Wed, Mar 17, 2021 at 01:23:46AM -0700, Brian Buhrow wrote: > hello. I've noticed that on my Xen server, running FreeBSD-12.2/Xen-4.14.0, I see a lot > of messages like the following from my NetBSD-5 and NetBSD-current domu's: > xennet0: discarding oversize frame (len=1518) > > They happen when network traffic is heavy and when traffic is coming from a physical switch in > the same vlan as the domu's. Since I don't think packets are actually oversized on the wire, > the Cisco switch managing this network does not report any giant packets, I think this is a > software problem either on the NetBSD domu's, or the FreeBSD dom0. Since I've been running > these same NetBSD domu setups on a machine where NetBSD is the dom0, I think this is an issue > with the xnb(4) or netback.c driver. Specifically, it looks like it concatinates multiple > packets together before notifying the domu that there is traffic available. Perhaps that is by > design, since I cannot reproduce the issue on a FreeBSD-domu running on the same FreeBSD-dom0 > machine. In either case, while things are usable, it creates a very noisy log on the > NetBSD-domu machines. Does the xnb(4) driver forward multiple packets to the domu front ends > and set the length of the message to the sum of the lengths of all the packets it's forwarding, > leaving it to the domu front end driver to separate the packets on reception? Is there a > parameter that can be set on a per-domu basis to say whether you want > multiple-packets-per-transfer or not from the dom0? I think this is an issue with FreeBSD netback as it doesn't properly handle frontends that don't understand some of the features implemented in the FreeBSD backend and are enabled unconditionally. Could you paste the output of `xenstore-ls -fp` from dom0 when one of those NetBSD domUs is running? Thanks, Roger.