From nobody Fri Sep 13 14:54:39 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4X4y5J3JY3z5V0YS for ; Fri, 13 Sep 2024 14:54:44 +0000 (UTC) (envelope-from cryintothebluesky@gmail.com) Received: from mail-wr1-x430.google.com (mail-wr1-x430.google.com [IPv6:2a00:1450:4864:20::430]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4X4y5J1NkZz4fnv for ; Fri, 13 Sep 2024 14:54:44 +0000 (UTC) (envelope-from cryintothebluesky@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-wr1-x430.google.com with SMTP id ffacd0b85a97d-374b25263a3so769367f8f.0 for ; Fri, 13 Sep 2024 07:54:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1726239282; x=1726844082; darn=freebsd.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=66VqBt6WHHM6i8VQZMZmoxGW2+WZBcBvDn8DSAYPBAg=; b=EzidUWTygPRbpmzkn8wRkqiSmdB4YoVw1jpw15lKMFvBzxuZSb1c1LpdNPs/hJc8Q5 DEbSzBFctHVkcZG9mRlCa/jT8VxxRD8KLrfZf2iKWNcdOl4aiCe+w631+3gRBUgPk7Ri gkn4iNv5z8UZ5uWEboG2C2zjGAmX4prrLddAGseYB81Qs0k20o7WBsAwOE+8tn1eY119 g2ekzNWBtuDdYxpARFKqxxH1lovcA/vA6FSHAarWvl6F8AVRADBjY7cvfK3fDy+GgrJ4 Dsv319YSMJIlrjXApmmi+RCrGo/rDdRh2V4T1yomd09TGKlDsZNkvCiRL6JzB1tr8Hem LECQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726239282; x=1726844082; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=66VqBt6WHHM6i8VQZMZmoxGW2+WZBcBvDn8DSAYPBAg=; b=F/NF5dZrcHcyVxwoh7xrdbYTdhaP2tF7/G3ruHTVTg7CEak2GJS25Qr/jj22tYWMm7 XEKP+PQ+vKXm62d1Vp4oWAStcRmUDi15vjGG8LvGmhwpyiDffOQbPExlzUT7c+RW+atZ rjowaJCh890+SZNK7sfBNRJn28b3V9W74pCHyWUSnsR1+DAKB9Jv3s2YNIx/H8S6SD2K MLpEO++F3paXZVcUJ8tlzRsBdrBlgpBCTe/7R14IZgFewCj6bOgZOd6a9X7FRJ7yjn84 /cHLwYvfrdo9gQrKkq8quVT77s3W50z/i3QfFg9T2LQG5BcB0LdTwhuxWI+d2MNJjgpa nj+g== X-Gm-Message-State: AOJu0Yz4Bbdze6jSv6QJtjmOVaHh6V7SU9N8rbz3unVMD6PPLtmnskUz F5OFOU0ofNA5c2q11eImAltIO2vSY3PozpMsyOmurH5r9iHonOJF/WZ4zw== X-Google-Smtp-Source: AGHT+IEm9vpaacu4DVGv2FY97gFDCrnpWjFMZH1p1onh2NTEd8pVSfF/w0pL5SfJayJRADuzA36pFQ== X-Received: by 2002:a5d:4cc6:0:b0:374:c3f7:6af1 with SMTP id ffacd0b85a97d-378d61e28e7mr1899209f8f.15.1726239281737; Fri, 13 Sep 2024 07:54:41 -0700 (PDT) Received: from z600.home.lan (29.129.159.143.dyn.plus.net. [143.159.129.29]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-42d9b15abc5sm28229525e9.17.2024.09.13.07.54.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 13 Sep 2024 07:54:40 -0700 (PDT) Date: Fri, 13 Sep 2024 15:54:39 +0100 From: Sad Clouds To: Mark Saad Cc: freebsd-net@freebsd.org Subject: Re: Performance issues with vnet jails + epair + bridge Message-Id: <20240913155439.1e171a88bd01ce9b97558a90@gmail.com> In-Reply-To: <39B2C95D-1E4F-4133-8923-AD305DFA9435@longcount.org> References: <20240913100938.3eac55c9fbd976fa72d58bb5@gmail.com> <39B2C95D-1E4F-4133-8923-AD305DFA9435@longcount.org> X-Mailer: Sylpheed 3.8.0beta1 (GTK+ 2.24.33; x86_64-pc-linux-gnu) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4X4y5J1NkZz4fnv On Fri, 13 Sep 2024 08:08:02 -0400 Mark Saad wrote: > Sad > Can you go back a bit you mentioned there is a RPi in the mix ? Some of the raspberries have their nic usb attached under the covers . Which will kill the total speed of things. > > Can you cobble together a diagram of what you have on either end ? Hello, I'm not sending data across the network, only between the host and the jails. I'm trying to evaluate how FreeBSD handles TCP data locally within a single host. I understand that vnet jails will have more overhead, compared to a shared TCP/IP stack via localhost. So I'm trying to measure it and see where the bottlenecks are. The Raspberry Pi 4 host has a single vnet jail, exchanging data with the host via epair(4) and if_bridge(4) interfaces. I don't really know what topology FreeBSD is using to represent all this so can't draw any diagrams, but I think all data flows through the kernel internally and never leaves the physical network interface.