From owner-freebsd-net@freebsd.org Tue Jul 23 08:51:28 2019 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0DACFA3F00 for ; Tue, 23 Jul 2019 08:51:28 +0000 (UTC) (envelope-from Stefan.Erl@dlr.de) Received: from mailin.dlr.de (mailin.dlr.de [194.94.201.12]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mailin.dlr.de", Issuer "DFN-Verein Global Issuing CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 374C486F9A for ; Tue, 23 Jul 2019 08:51:25 +0000 (UTC) (envelope-from Stefan.Erl@dlr.de) IronPort-SDR: e684PS9HZQ8gIRTe53c29m14FNBO0RNZ90JAO/c91pLVvRVhj3MAQlEJxhgCSudqg+hhX5YhDK 2czk0znskAnQ== IronPort-PHdr: =?us-ascii?q?9a23=3A9nAijxQpLA/Krn8BJLBH5WlP2Npsv+yvbD5Q0Y?= =?us-ascii?q?Iujvd0So/mwa69YRaN2/xhgRfzUJnB7Loc0qyK6vqmBjxLucjJmUtBWaQEbw?= =?us-ascii?q?UCh8QSkl5oK+++Imq/EsTXaTcnFt9JTl5v8iLzG0FUHMHjew+a+SXqvnYdFR?= =?us-ascii?q?rlKAV6OPn+FJLMgMSrzeCy/IDYbxlViDanbr5+MQu6oR/Tu8QVjoduNqc8wQ?= =?us-ascii?q?bVr3VVfOhb2XlmLk+JkRbm4cew8p9j8yBOtP8k6sVNT6b0cbkmQLJBFDgpPH?= =?us-ascii?q?w768PttRnYUAuA/WAcXXkMkhpJGAfK8hf3VYrsvyTgt+p93C6aPdDqTb0xRD?= =?us-ascii?q?+v4btnRAPuhSwaMTMy7WPZhdFqjK9DoByvuQFxw5Labo+WNfpxYqzTctwBSG?= =?us-ascii?q?pdR8ZcUzBNDp+gY4cRCecKIOZWr5P6p1sLtRazAhSiBP/xxT9GnHD227c23e?= =?us-ascii?q?s7EQHCxwEvAtYOsG7OoNroKqgfSOa4x7TLwzXbd/5axCvx5JLVfh0irvyAR6?= =?us-ascii?q?98fMTSxEU1Cg/Jk02cpZH5Mz+Py+gAsGeW4/B9We+hiGMrsR99rzigy8s0l4?= =?us-ascii?q?XEh4YYxkra+Sh5z4s5P9+1RFRlbdOkDZddsTyROZFsTcM4WW5ovT43yrgBuZ?= =?us-ascii?q?GmYicH0I8nxxvDa/yfdIiI/w7jWP6RIThmgHJlf6qyiRi0/0auxePyVsm63l?= =?us-ascii?q?FJoCRCiNfAqm0B2RPS5cWZUPd9/0Gh2SqV1w/J8O1LPEQ0lbDBJ5E83LE8jp?= =?us-ascii?q?sTsULdES/qgEj6kbOael859uWr5OnreKjqq5GfOoNulw3yL7wimsmlDuQ5Ng?= =?us-ascii?q?gOUXKb+eO51LD74EP5XKtFjvMsnanfqpzUKt4bpqqiDgBI1oYj8QyzACq439?= =?us-ascii?q?gAh3kIMEpFeA6bj4juI1zOLur4AumhjFu3izdk2unKPrv/DZXRNXXDnq3hcq?= =?us-ascii?q?hj5EFH0wo80MpT55VOCrEOc7rPXRqlusbVAxUiP0myzvrPBs9w24kFVSSIGK?= =?us-ascii?q?DPY43ItlrdstkzLueFYsk4ojLVJ/w/ofLj2yxq0WQBdLWkiMNEIEuzGe5rdh?= =?us-ascii?q?2U?= X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A2E+BQAPyTZd/wuKuApmghmCcIFMmTW?= =?us-ascii?q?YAIF7CQEBAQEBAQEBATcBAYRAAoMWNAkOAQMBAQUBAQEBBgEBAoYTgjoigzB?= =?us-ascii?q?RASoUQiYBBBuxSoo9gTSNdYERRoIXhREoS4JwgiYEqmMHAoE5jCiIYY0yili?= =?us-ascii?q?mfYIRcYM8kQWNTIEwgSEBAQ?= X-IronPort-AV: E=Sophos;i="5.64,298,1559512800"; d="scan'208";a="19969656" From: To: Subject: Dummynet, pipes and VNET jails Thread-Topic: Dummynet, pipes and VNET jails Thread-Index: AdVBMr5nfahih/hhTMSUOPFskLRUpg== Date: Tue, 23 Jul 2019 08:50:13 +0000 Message-ID: Accept-Language: de-DE, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-tm-snts-smtp: 7A77B9C2AF0D6B6B9044E21F2A372A70F8855B3FC59FBCE481FF33E8C481119E2000:8 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Rspamd-Queue-Id: 374C486F9A X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of Stefan.Erl@dlr.de designates 194.94.201.12 as permitted sender) smtp.mailfrom=Stefan.Erl@dlr.de X-Spamd-Result: default: False [-2.21 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.992,0]; IP_SCORE(-0.25)[ipnet: 194.94.0.0/15(-1.25), asn: 680(-0.01), country: DE(-0.01)]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[dlr.de]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; NEURAL_SPAM_SHORT(0.55)[0.545,0]; RCVD_IN_DNSWL_MED(-0.20)[12.201.94.194.list.dnswl.org : 127.0.8.2]; MX_GOOD(-0.01)[mailin.dlr.de]; FROM_NO_DN(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:680, ipnet:194.94.0.0/15, country:DE]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Jul 2019 08:51:28 -0000 Hi all, I have a problem with ipfw/dummynet, pipes and VNET jails using FreeBSD 12.= 0 release. Packets are lost in the pipe when any impairments are configured. I set up several VNET jails and connected them via epairs, in order to=20 do tests with different network and routing configurations. On some jails, = I want to run dummynet with pipes to add delay to the packets. Whenever I configure a pipe with zero delay, everything works. As soon as I add any = delay (or loss, bw limit), the packets enter the pipe, but never exit it, and nev= er appear on the target Jail. A simple test setup I've set up is the following: (JailB is configured for IP forwarding) --------- --------- --------- | JailA |-----| JailB |-----| JailC | --------- --------- --------- JailA: ping JailC JailB:=20 ipfw flush ifpw add 10000 pipe 1 ip from JailA to any ipfw config pipe 1 delay 0ms =09 This works fine, packets arrive at JailC. "ipfw show" shows increasing counters for rules 10000 and 65535 (allow ip from any to any) =09 Then, if I add some delay: =09 ipfw config pipe 1 delay 10ms =09 Packets are lost in JailB, don't arrive at JailC. "ipfw show" shows increasing counters only for rule 10000, but not for 65535. =09 IPFW and dummynet are compiled into the kernel, with kern.hz=3D1000 and=20 IPFW_DEFAULT_TO_ACCEPT option. Dummynet pipes on the Jail ethernet interfac= e outside a jail seem to work fine. I've found some threads from 2010 saying that there are some problems with dummynet and VNET jails. Are these still existing, is something else wrong,= or am I missing something? Regards, Stefan