From owner-freebsd-virtualization@freebsd.org Sun Mar 19 15:57:02 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0C77D13E2A for ; Sun, 19 Mar 2017 15:57:02 +0000 (UTC) (envelope-from gkirouac@myriade.ca) Received: from alt32.smtp-out.videotron.ca (alt32.smtp-out.videotron.ca [24.53.0.21]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id BC7D4371 for ; Sun, 19 Mar 2017 15:57:02 +0000 (UTC) (envelope-from gkirouac@myriade.ca) Received: from [192.168.1.7] ([173.176.154.36]) by Videotron with SMTP id pcxucPn09WjC4pcxvcm9la; Sun, 19 Mar 2017 11:41:55 -0400 X-Authority-Analysis: v=2.1 cv=FfyXvMK6 c=1 sm=1 tr=0 a=GNb01QND/Z/0MjE/DBRVKg==:117 a=GNb01QND/Z/0MjE/DBRVKg==:17 a=L9H7d07YOLsA:10 a=9cW_t1CCXrUA:10 a=s5jvgZ67dGcA:10 a=IkcTkHD0fZMA:10 a=6I5d2MoRAAAA:8 a=n6MYwUk4AAAA:8 a=s9oXJcMGAAAA:8 a=YlZzGGXpjj-NK5EVXH4A:9 a=QEXdDO2ut3YA:10 a=IjZwj45LgO3ly-622nXo:22 a=Pq_6N41bls4alRN90ikP:22 a=cNNliUDrGJfcKjVfkxUC:22 To: freebsd-virtualization@freebsd.org From: Gilles Kirouac Subject: Docker hello-world no such file Message-ID: Date: Sun, 19 Mar 2017 11:41:50 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-CMAE-Envelope: MS4wfFxn4FmyTERQXxX2Muivy8rIzyMcHH+6PeRWy22pRBBiMaxTdu8k2NGJVV3B31Ny4Lt22v9OW+6vmJOca46sZTNA+4MUcEplfSRa1oO2NRELQkeJRvye IUzVGIKM+4DDPjlphb22tJhiVJU1felYPoFvM3tB0YLXwzTp66kdcSNU8H1827/aOiKzO7Gqc6fNTg== X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Mar 2017 15:57:03 -0000 Using Xeon processor 5120 with PAE, but not EPT(Extended Page Tables). I installed Docker on FreeBSD according to: https://wiki.freebsd.org/Docker (except changed zroot for dkroot because of conflict) then attempted my first steps as suggested here https://docs.docker.com/engine/getstarted/step_one/#step-3-verify-your-in= stallation $ docker version Client version: 1.7.0-dev Client API version: 1.19 Go version (client): go1.7.4 Git commit (client): 582db78 OS/Arch (client): freebsd/amd64 Server version: 1.7.0-dev Server API version: 1.19 Go version (server): go1.7.4 Git commit (server): 582db78 OS/Arch (server): freebsd/amd64 $ docker run hello-world Unable to find image 'hello-world:latest' locally latest: Pulling from hello-world 50a54e1f9180: Pull complete 7a5a2d73abce: Pull complete Digest: sha256:7820f4620e6cf3e795643fac2f6b09e7fd0a29e7e5c4eee6aac9ba0bedca158c Status: Downloaded newer image for hello-world:latest jail: exec /hello: No such file or directory <=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D jail: /hello: failed $ docker ps -a CONTAINER ID IMAGE COMMAND =20 CREATED STATUS PORTS NAMES 96d08db2bfcc hello-world "/hello" 7 minutes ago Exited (1) 7 minutes ago cranky_rosalind In /var/log/docker.log, among a lot of messages and after a new attempt, I found this warning: Warning: could not change group /var/run/docker.sock to docker: Group docker not found $ groups gilles wheel FreeBSD S5004.localdomain 11.0-RELEASE-p8 FreeBSD 11.0-RELEASE-p8 #0: Wed Feb 22 06:12:04 UTC 2017 =20 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 with all patches available. ~ Gilles From owner-freebsd-virtualization@freebsd.org Sun Mar 19 21:00:07 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AF24DD120A2 for ; Sun, 19 Mar 2017 21:00:07 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8D0B01BB1 for ; Sun, 19 Mar 2017 21:00:07 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v2JL01Y6070714 for ; Sun, 19 Mar 2017 21:00:07 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201703192100.v2JL01Y6070714@kenobi.freebsd.org> From: bugzilla-noreply@FreeBSD.org To: freebsd-virtualization@FreeBSD.org Subject: Problem reports for freebsd-virtualization@FreeBSD.org that need special attention Date: Sun, 19 Mar 2017 21:00:07 +0000 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Mar 2017 21:00:07 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 212820 | FreeBSD 10-STABLE from latest HEAD and 11-RELEASE 1 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Mon Mar 20 06:13:32 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9548D14767 for ; Mon, 20 Mar 2017 06:13:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D850914F2 for ; Mon, 20 Mar 2017 06:13:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v2K6DWRX059676 for ; Mon, 20 Mar 2017 06:13:32 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 216814] BRAS at FreeBSD 11.0p7 reboots/crash some days (mpd5 vmware esxi 6.0.0) Date: Mon, 20 Mar 2017 06:13:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bugs-freebsd-org@bekreyev.ru X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Not A Bug X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Mar 2017 06:13:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216814 Konstantin V Bekreyev changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Not A Bug Status|New |Closed --- Comment #4 from Konstantin V Bekreyev --- Yes, when I added more memory than 4Gb - uptime looks well. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Mon Mar 20 22:41:43 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C2EE3D14A37 for ; Mon, 20 Mar 2017 22:41:43 +0000 (UTC) (envelope-from vincent@up4.com) Received: from smtp69.iad3a.emailsrvr.com (smtp69.iad3a.emailsrvr.com [173.203.187.69]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9F505F71 for ; Mon, 20 Mar 2017 22:41:43 +0000 (UTC) (envelope-from vincent@up4.com) Received: from smtp33.relay.iad3a.emailsrvr.com (localhost [127.0.0.1]) by smtp33.relay.iad3a.emailsrvr.com (SMTP Server) with ESMTP id 4961354F9 for ; Mon, 20 Mar 2017 18:32:30 -0400 (EDT) X-Auth-ID: vincent@up4.tv Received: by smtp33.relay.iad3a.emailsrvr.com (Authenticated sender: vincent-AT-up4.tv) with ESMTPSA id 100BE5726 for ; Mon, 20 Mar 2017 18:32:30 -0400 (EDT) X-Sender-Id: vincent@up4.tv Received: from [192.168.1.10] ([UNAVAILABLE]. [69.55.244.81]) (using TLSv1 with cipher DHE-RSA-AES256-SHA) by 0.0.0.0:465 (trex/5.7.12); Mon, 20 Mar 2017 18:32:30 -0400 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: tap on lagg ? From: Vincent Olivier In-Reply-To: Date: Mon, 20 Mar 2017 18:32:29 -0400 Content-Transfer-Encoding: quoted-printable Message-Id: <03551266-4EFD-4BAA-B200-932B62CCA988@up4.com> References: <11A193E5-555F-4733-B192-49A5FEDCFDEA@up4.com> <66637AFA-D092-4EBB-B998-1BB2B2EE2CB4@up4.com> <1207dbb0-ec86-34fd-9a74-68d70b3b7892@osfux.nl> <41619106-86D6-40EF-B84E-DC98A1B54FCD@up4.com> To: FreeBSD virtualization X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Mar 2017 22:41:43 -0000 Hello, Sorry for waiting so long. I don=E2=80=99t know if i=E2=80=99m doing it = right but I tried =C2=AB -vlanhwtag =C2=BB all the interfaces and I=E2=80= =99m still having problems. Namely (as I didn=E2=80=99t have this = information before) that all participating interfaces in the bridge = itself are in promiscuous mode (and, if that is related) I cannot ssh = into the host machine from any bhyve virtual machine. My goal is to be = able to ssh and mount host nfs exports onto the VMs. Doing a =C2=AB = -promisc =C2=BB on all the interfaces won=E2=80=99t change anything. Can = someone help? Pleas find below a ifconfig dump. Regards, Vincent igb0: flags=3D8943 = metric 0 mtu 1500 = options=3D6403ab ether 54:a0:50:88:88:c6 nd6 options=3D29 media: Ethernet 1000baseT status: active igb1: flags=3D8943 = metric 0 mtu 1500 = options=3D6403ab ether 54:a0:50:88:88:c6 nd6 options=3D29 media: Ethernet 1000baseT status: active igb2: flags=3D8943 = metric 0 mtu 1500 = options=3D6403ab ether 54:a0:50:88:88:c6 nd6 options=3D29 media: Ethernet 1000baseT status: active igb3: flags=3D8943 = metric 0 mtu 1500 = options=3D6403ab ether 54:a0:50:88:88:c6 nd6 options=3D29 media: Ethernet 1000baseT status: active cxl0: flags=3D8802 metric 0 mtu 1500 = options=3Dec07bb ether 00:07:43:37:47:70 nd6 options=3D29 media: Ethernet none status: no carrier cxl1: flags=3D8843 metric 0 mtu = 9000 = options=3Dec07bb ether 00:07:43:37:47:78 inet 192.168.11.5 netmask 0xffffff00 broadcast 192.168.11.255=20 nd6 options=3D29 media: Ethernet 10Gbase-Twinax status: active lo0: flags=3D8049 metric 0 mtu 16384 options=3D600003 inet6 ::1 prefixlen 128=20 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x7=20 inet 127.0.0.1 netmask 0xff000000=20 nd6 options=3D21 groups: lo=20 lagg0: flags=3D8943 = metric 0 mtu 1500 = options=3D6403ab ether 54:a0:50:88:88:c6 inet 192.168.1.23 netmask 0xffffff00 broadcast 192.168.1.255=20 nd6 options=3D29 media: Ethernet autoselect status: active groups: lagg=20 laggproto lacp lagghash l2,l3,l4 laggport: igb0 flags=3D1c laggport: igb1 flags=3D1c laggport: igb2 flags=3D1c laggport: igb3 flags=3D0<> bridge0: flags=3D8843 metric 0 = mtu 1500 description: vm-lan1g ether 02:f7:d6:01:1a:00 nd6 options=3D1 groups: bridge=20 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: tap1 flags=3D143 ifmaxaddr 0 port 11 priority 128 path cost 2000000 member: tap0 flags=3D143 ifmaxaddr 0 port 10 priority 128 path cost 2000000 member: lagg0 flags=3D143 ifmaxaddr 0 port 8 priority 128 path cost 6666 tap0: flags=3D8943 = metric 0 mtu 1500 description: vmnet-unifi-0-lan1g options=3D80000 ether 00:bd:b9:51:fa:00 nd6 options=3D29 media: Ethernet autoselect status: active groups: tap=20 Opened by PID 1523 tap1: flags=3D8943 = metric 0 mtu 1500 description: vmnet-docker-0-lan1g options=3D80000 ether 00:bd:41:36:d7:01 nd6 options=3D29 media: Ethernet autoselect status: active groups: tap=20 Opened by PID 16378 > Le 7 f=C3=A9vr. 2017 =C3=A0 03:53, Ruben a =C3=A9crit = : >=20 > Hi Vincent, >=20 >> Didn=E2=80=99t try it it with disabling the tso/lro/vlanhwtagging = features. Will try again with those disabled. >>=20 >>=20 >>> I have no experience in comparable setups without the vlan "layer" = though. >>=20 >> My setup didn=E2=80=99t involve vlans, only this: tap <=E2=80=94> = bridge <=E2=80=94> lagg <=E2=80=94> igb0, igb1, igb2, igb3 >>=20 >> Do you think that could be it? I have no need for a vlan here, = though=E2=80=A6 >>=20 >>=20 >>> What seems to be your predicament? >> The tap would fail to =C2=AB up =C2=BB with an error message (that I = forgot to note). >=20 > I haven't had any trouble "upping" taps (even with the offloading > features enabled) but since I mostly use the >=20 > net.link.tap.up_on_open=3D1 >=20 > sysctl setting I can't say I have manually upped them a lot (and = didn't > look at logfiles that much since stuff just worked). >=20 >=20 >>=20 >>=20 >> I will try to do it again with the aforementioned features disabled = (but without a vlan layer) and report back here. >=20 > Im curious about your findings! >=20 > Regards, >=20 > Ruben From owner-freebsd-virtualization@freebsd.org Tue Mar 21 13:55:21 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0369D16F1C for ; Tue, 21 Mar 2017 13:55:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 84F2012A8 for ; Tue, 21 Mar 2017 13:55:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v2LDtLLZ084526 for ; Tue, 21 Mar 2017 13:55:21 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 216759] [kern] Memory speed with small blocks (1K) up to 35 times slower than host system (under QEMU emulation, but not only) Date: Tue, 21 Mar 2017 13:55:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: hellrider8881@yahoo.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Mar 2017 13:55:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216759 --- Comment #16 from deJong --- I have tested the patch set and unfortunately it made no difference root@testbsd11:~ # sysctl kern.timecounter.choice kern.timecounter.choice: TSC-low(-100) i8254(0) ACPI-fast(900) HPET(950) dummy(-1000000) root@testbsd11:~ # sysbench --num-threads=3D1 --test=3Dmemory --memory-total-size=3D1G --memory-block-size=3D1K run sysbench 0.4.12: multi-threaded system evaluation benchmark Running the test with following options: Number of threads: 1 Doing memory operations speed test Memory block size: 1K Memory transfer size: 1024M Memory operations type: write Memory scope type: global Threads started! Done. Operations performed: 1048576 (34976.80 ops/sec) 1024.00 MB transferred (34.16 MB/sec) Test execution summary: total time: 29.9792s total number of events: 1048576 total time taken by event execution: 21.9685 per-request statistics: min: 0.02ms avg: 0.02ms max: 22.21ms approx. 95 percentile: 0.01ms Threads fairness: events (avg/stddev): 1048576.0000/0.00 execution time (avg/stddev): 21.9685/0.00 So either the problem is somewhere else or these patches does not apply to = this situation, it would be good if someone can confirm or deny this. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Mar 21 15:28:35 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 55EC6D16B8F for ; Tue, 21 Mar 2017 15:28:35 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CFF35AE2 for ; Tue, 21 Mar 2017 15:28:34 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [78.138.80.135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id v2LFSV8t097848; Tue, 21 Mar 2017 16:28:31 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (titan.inop.mo1.omnilan.net [IPv6:2001:a60:f0bb:1::3:1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 1E60562C; Tue, 21 Mar 2017 16:28:31 +0100 (CET) Message-ID: <58D1469E.30504@omnilan.de> Date: Tue, 21 Mar 2017 16:28:30 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Vincent Olivier CC: FreeBSD virtualization Subject: Re: tap on lagg ? References: <11A193E5-555F-4733-B192-49A5FEDCFDEA@up4.com> <66637AFA-D092-4EBB-B998-1BB2B2EE2CB4@up4.com> <1207dbb0-ec86-34fd-9a74-68d70b3b7892@osfux.nl> <41619106-86D6-40EF-B84E-DC98A1B54FCD@up4.com> <03551266-4EFD-4BAA-B200-932B62CCA988@up4.com> In-Reply-To: <03551266-4EFD-4BAA-B200-932B62CCA988@up4.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: ACL 119 matched, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [78.138.80.130]); Tue, 21 Mar 2017 16:28:31 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: 78.138.80.135; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Mar 2017 15:28:35 -0000 Bezüglich Vincent Olivier's Nachricht vom 20.03.2017 23:32 (localtime): > Hello, > > Sorry for waiting so long. I don’t know if i’m doing it right but I tried « -vlanhwtag » all the interfaces and I’m still having problems. Namely (as I didn’t have this information before) that all participating interfaces in the bridge itself are in promiscuous mode (and, if that is related) I cannot ssh into the host machine from any bhyve virtual machine. My goal is to be able to ssh and mount host nfs exports onto the VMs. Doing a « -promisc » on all the interfaces won’t change anything. Can someone help? Pleas find below a ifconfig dump. I'd go for tcpdump. First, check that routing is no issue. In your constellation I guess VMs Ips are in the 192.168.1.0/24 network, correct? Else make sure your default gateway does routing/deflection/icmp-redirection. Then watch 'tcpdump -n -e - s 150 -i bridge0' on the host and the like inside your VM (vtnet?) Start with ping and check if ARP is working. Also 'arp -a' on host and VM provides fundamentally information to find the problem. If ARP and icmp (ping) work but TCP (ssh) not, it's PMTU or offloading related most likely. -harry From owner-freebsd-virtualization@freebsd.org Tue Mar 21 16:10:14 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D2440D16C5A for ; Tue, 21 Mar 2017 16:10:14 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 70FAD15D3 for ; Tue, 21 Mar 2017 16:10:14 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (mh0.gentlemail.de [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id v2LGACIg098562; Tue, 21 Mar 2017 17:10:12 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (titan.inop.mo1.omnilan.net [IPv6:2001:a60:f0bb:1::3:1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 618E4681; Tue, 21 Mar 2017 17:10:12 +0100 (CET) Message-ID: <58D15063.7010002@omnilan.de> Date: Tue, 21 Mar 2017 17:10:11 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Vincent Olivier CC: FreeBSD virtualization Subject: Re: tap on lagg ? References: <11A193E5-555F-4733-B192-49A5FEDCFDEA@up4.com> <66637AFA-D092-4EBB-B998-1BB2B2EE2CB4@up4.com> <1207dbb0-ec86-34fd-9a74-68d70b3b7892@osfux.nl> <41619106-86D6-40EF-B84E-DC98A1B54FCD@up4.com> <03551266-4EFD-4BAA-B200-932B62CCA988@up4.com> <58D1469E.30504@omnilan.de> <22E0CC61-1822-46CC-A43C-4B7A25844098@up4.com> In-Reply-To: <22E0CC61-1822-46CC-A43C-4B7A25844098@up4.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Tue, 21 Mar 2017 17:10:12 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Mar 2017 16:10:14 -0000 Bezüglich Vincent Olivier's Nachricht vom 21.03.2017 16:51 (localtime): > Hi, I can confirm that ping works but ssh and (I haven’t tried anything else, but I assume you are right) TCP as a whole doesn’t work. > > From there, I guess that, since I haven’t changed the MTU on the 1G interfaces (only on the 10G ones which are isolated from the 1G network). this leaves offloading. > > Should I disable it (which ones)? On all the physical interfaces or also on the lagg and maybe bridge? You seem to have the following problem: if_bridge(4) tries to disable TXCSUM on all members added. But you add if_lagg(4), which doesn't pass those requests to it's members, but simply ignores the request. So you need to manually -txcsum (-txcsum6), e.g. in rc.conf when you set them "up". Unofrtunately I don't know how offloading is implemented generally, nor how it works for if_igb(4), so I haven't thought about the reason yet, why you need to disable TXCSUM. Much more important, does it also affect TSO? I can't tell, maybe someone with more knowledge can jump in. -harry From owner-freebsd-virtualization@freebsd.org Tue Mar 21 19:04:41 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3BC49D16546 for ; Tue, 21 Mar 2017 19:04:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 10BDE830 for ; Tue, 21 Mar 2017 19:04:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v2LJ4eOd084066 for ; Tue, 21 Mar 2017 19:04:40 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 216759] [kern] Memory speed with small blocks (1K) up to 35 times slower than host system (under QEMU emulation, but not only) Date: Tue, 21 Mar 2017 19:04:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: andrew@azar-a.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Mar 2017 19:04:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216759 --- Comment #17 from andrew@azar-a.net --- (In reply to deJong from comment #16) It doesn't seem like the patchset is applied at all. > kern.timecounter.choice: TSC-low(-100) i8254(0) ACPI-fast(900) HPET(950) = dummy(-1000000) It should add kvmclock to that list which is obviously not there. Forcing TSC-low on KVM VM when the host trusts it more than HPET and ACPI-P= M is foolproof imo. It's obvious that the choice for this has been designed a long time ago and= has been programmed this way because back then TSC really sucked and any hyperv= isor except for programmed by VMWare loophole is penalised (don't know though wh= ich because xen requires more workarounds in the kernel and I don't really know= how bhyve runs it).. So obviously this part of code should be reworked if ((!smp_tsc && !tsc_is_invariant) || vm_guest) return (-100); X86_FEATURE_CONSTANT_TSC is not checked at all (this is from linux, but sti= ll BSD does not check that in any case in its TSC code (or I might be misreadi= ng the magic tsc_is_invariant variable)). And most of all the vm_guest check should go away. It's a terrible hack nowadays as this bug shows. I did not try this yet but maybe something like this will help if ((!smp_tsc && !tsc_is_invariant) || (vm_guest && vm_guest !=3D VM_GUEST_= KVM)) return (-100); --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-virtualization@freebsd.org Tue Mar 21 20:15:33 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 61291CD7B86 for ; Tue, 21 Mar 2017 20:15:33 +0000 (UTC) (envelope-from vincent@up4.com) Received: from smtp69.iad3a.emailsrvr.com (smtp69.iad3a.emailsrvr.com [173.203.187.69]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3C9B63CF for ; Tue, 21 Mar 2017 20:15:32 +0000 (UTC) (envelope-from vincent@up4.com) Received: from smtp9.relay.iad3a.emailsrvr.com (localhost [127.0.0.1]) by smtp9.relay.iad3a.emailsrvr.com (SMTP Server) with ESMTP id 1617D5868 for ; Tue, 21 Mar 2017 16:15:26 -0400 (EDT) X-Auth-ID: vincent@up4.tv Received: by smtp9.relay.iad3a.emailsrvr.com (Authenticated sender: vincent-AT-up4.tv) with ESMTPSA id D2737578C for ; Tue, 21 Mar 2017 16:15:25 -0400 (EDT) X-Sender-Id: vincent@up4.tv Received: from [192.168.1.10] ([UNAVAILABLE]. [69.55.244.81]) (using TLSv1 with cipher DHE-RSA-AES256-SHA) by 0.0.0.0:465 (trex/5.7.12); Tue, 21 Mar 2017 16:15:26 -0400 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: tap on lagg ? From: Vincent Olivier In-Reply-To: <58D15063.7010002@omnilan.de> Date: Tue, 21 Mar 2017 16:15:25 -0400 Content-Transfer-Encoding: quoted-printable Message-Id: References: <11A193E5-555F-4733-B192-49A5FEDCFDEA@up4.com> <66637AFA-D092-4EBB-B998-1BB2B2EE2CB4@up4.com> <1207dbb0-ec86-34fd-9a74-68d70b3b7892@osfux.nl> <41619106-86D6-40EF-B84E-DC98A1B54FCD@up4.com> <03551266-4EFD-4BAA-B200-932B62CCA988@up4.com> <58D1469E.30504@omnilan.de> <22E0CC61-1822-46CC-A43C-4B7A25844098@up4.com> <58D15063.7010002@omnilan.de> To: FreeBSD virtualization X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Mar 2017 20:15:33 -0000 Hi, So all in all, I added =C2=AB -vlanhwtag -txcsum -txcsum6 =C2=BB on all = 4 igb interfaces. They still all put themselves in promiscuous mode, = however. But TCPing the host from a VM now works. Please find the = relevant dmesg and ifconfig output below. But I=E2=80=99d still appreciate more background information on this. is = =C2=AB -vlanhwtag =C2=BB still required ? Should I expect a traffic = slowdown on these interfaces ? Will it bring the CPU to its knees ? Why = do I still get =C2=AB bridge0: error setting interface capabilities on = lagg0 =C2=BB ? Thanks! Vincent lagg0: link state changed to UP igb3: link state changed to UP igb1: link state changed to UP igb2: link state changed to UP bridge0: Ethernet address: 02:f7:d6:01:1a:00 bridge0: link state changed to UP igb0: promiscuous mode enabled igb1: promiscuous mode enabled igb2: promiscuous mode enabled igb3: promiscuous mode enabled lagg0: promiscuous mode enabled tap0: Ethernet address: 00:bd:29:bf:f8:00 bridge0: error setting interface capabilities on lagg0 tap0: promiscuous mode enabled tap0: link state changed to UP tap1: Ethernet address: 00:bd:1a:e6:f8:01 bridge0: error setting interface capabilities on lagg0 tap1: promiscuous mode enabled tap1: link state changed to UP igb0: flags=3D8943 = metric 0 mtu 1500 = options=3D2403a9 ether 54:a0:50:88:88:c6 nd6 options=3D29 media: Ethernet 1000baseT status: active igb1: flags=3D8943 = metric 0 mtu 1500 = options=3D2403a9 ether 54:a0:50:88:88:c6 nd6 options=3D29 media: Ethernet 1000baseT status: active igb2: flags=3D8943 = metric 0 mtu 1500 = options=3D2403a9 ether 54:a0:50:88:88:c6 nd6 options=3D29 media: Ethernet 1000baseT status: active igb3: flags=3D8943 = metric 0 mtu 1500 = options=3D2403a9 ether 54:a0:50:88:88:c6 nd6 options=3D29 media: Ethernet 1000baseT status: active cxl0: flags=3D8802 metric 0 mtu 1500 = options=3Dec07bb ether 00:07:43:37:47:70 nd6 options=3D29 media: Ethernet none status: no carrier cxl1: flags=3D8843 metric 0 mtu = 9000 = options=3Dec07bb ether 00:07:43:37:47:78 inet 192.168.11.5 netmask 0xffffff00 broadcast 192.168.11.255=20 nd6 options=3D29 media: Ethernet 10Gbase-Twinax status: active lo0: flags=3D8049 metric 0 mtu 16384 options=3D600003 inet6 ::1 prefixlen 128=20 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x7=20 inet 127.0.0.1 netmask 0xff000000=20 nd6 options=3D21 groups: lo=20 lagg0: flags=3D8943 = metric 0 mtu 1500 = options=3D2403a9 ether 54:a0:50:88:88:c6 inet 192.168.1.23 netmask 0xffffff00 broadcast 192.168.1.255=20 nd6 options=3D29 media: Ethernet autoselect status: active groups: lagg=20 laggproto lacp lagghash l2,l3,l4 laggport: igb0 flags=3D1c laggport: igb1 flags=3D1c laggport: igb2 flags=3D1c laggport: igb3 flags=3D0<> bridge0: flags=3D8843 metric 0 = mtu 1500 description: vm-lan1g ether 02:f7:d6:01:1a:00 nd6 options=3D1 groups: bridge=20 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: tap1 flags=3D143 ifmaxaddr 0 port 11 priority 128 path cost 2000000 member: tap0 flags=3D143 ifmaxaddr 0 port 10 priority 128 path cost 2000000 member: lagg0 flags=3D143 ifmaxaddr 0 port 8 priority 128 path cost 6666 tap0: flags=3D8943 = metric 0 mtu 1500 description: vmnet-docker-0-lan1g options=3D80000 ether 00:bd:29:bf:f8:00 nd6 options=3D29 media: Ethernet autoselect status: active groups: tap=20 Opened by PID 1417 tap1: flags=3D8943 = metric 0 mtu 1500 description: vmnet-unifi-0-lan1g options=3D80000 ether 00:bd:1a:e6:f8:01 nd6 options=3D29 media: Ethernet autoselect status: active groups: tap=20 Opened by PID 1698 > Le 21 mars 2017 =C3=A0 12:10, Harry Schmalzbauer = a =C3=A9crit : >=20 > Bez=C3=BCglich Vincent Olivier's Nachricht vom 21.03.2017 16:51 = (localtime): >> Hi, I can confirm that ping works but ssh and (I haven=E2=80=99t = tried anything else, but I assume you are right) TCP as a whole = doesn=E2=80=99t work. >>=20 >> =46rom there, I guess that, since I haven=E2=80=99t changed the MTU = on the 1G interfaces (only on the 10G ones which are isolated from the = 1G network). this leaves offloading. >>=20 >> Should I disable it (which ones)? On all the physical interfaces or = also on the lagg and maybe bridge? >=20 > You seem to have the following problem: > if_bridge(4) tries to disable TXCSUM on all members added. > But you add if_lagg(4), which doesn't pass those requests to it's > members, but simply ignores the request. > So you need to manually -txcsum (-txcsum6), e.g. in rc.conf when you = set > them "up". >=20 > Unofrtunately I don't know how offloading is implemented generally, = nor > how it works for if_igb(4), so I haven't thought about the reason yet, > why you need to disable TXCSUM. > Much more important, does it also affect TSO? > I can't tell, maybe someone with more knowledge can jump in. >=20 > -harry >=20 From owner-freebsd-virtualization@freebsd.org Wed Mar 22 11:28:15 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 54324D17E72 for ; Wed, 22 Mar 2017 11:28:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 379551682 for ; Wed, 22 Mar 2017 11:28:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v2MBSFGa068888 for ; Wed, 22 Mar 2017 11:28:15 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-virtualization@FreeBSD.org Subject: [Bug 216759] [kern] Memory speed with small blocks (1K) up to 35 times slower than host system (under QEMU emulation, but not only) Date: Wed, 22 Mar 2017 11:28:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: andrew@azar-a.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-virtualization@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: flagtypes.name attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Mar 2017 11:28:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216759 andrew@azar-a.net changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #181048| |maintainer-approval+ Flags| | --- Comment #18 from andrew@azar-a.net --- Created attachment 181048 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D181048&action= =3Dedit tsc.c patch to allow KVM hypervisor with host cpu to pass through the good = TSC This patch is not "correct" because it just whitelists Generic virtualizati= on (VM_GUEST_VM), however I don't see how it can be done correctly at this poi= nt of overall coding quality in tsc.c regarding virtualization. I guess a CPU_VENDOR_VIRTUAL should be considered as an option, so we can l= eave host pass-through CPU as a real host CPU and allow virtual CPUs like QEMU_X86_64 or whatever to be treated separately where all ifs and switches= are tested for stability of CPU TSC (that seems to be the Linux approach). --=20 You are receiving this mail because: You are the assignee for the bug.=