From owner-freebsd-current@freebsd.org Mon Feb 22 21:47:59 2016 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D9FF3AB04F1; Mon, 22 Feb 2016 21:47:58 +0000 (UTC) (envelope-from ultima1252@gmail.com) Received: from mail-vk0-x22c.google.com (mail-vk0-x22c.google.com [IPv6:2607:f8b0:400c:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 879841F88; Mon, 22 Feb 2016 21:47:58 +0000 (UTC) (envelope-from ultima1252@gmail.com) Received: by mail-vk0-x22c.google.com with SMTP id e185so143138010vkb.1; Mon, 22 Feb 2016 13:47:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=10odizUKmVzGCYfb95/P7kk2p8tg52fBuHAxUBBKwpU=; b=tCw9G6P0hiSSWVy8EKctsO8b9d2nZbIIrxfLYs27UJSHElpPb/aaMqoLXU4GPbFyub igl19u1t5oOfRcKQVAcrsLaUqo5Om4kUrD1Y5PgRudHFxwLurIa5E87mQb8KB+uqkNDa lUcpIBZNVMcPFNwnC+4IXqrhDjiTwb1ZuSJQ0G4bFohj+ADP7cyH3rTgfh9gIEjY8SpF 9gsxVFOjVxomJIYI8Uq1lEthGrhTDHZoaKHMZ4aQb/Zf6ZS0v9+MGpbdM/GPzP8lNZSK HkGyP7o3YYLmZo0nbt9eworxIcH0/CukAYUH9VrXZ1Wi7FeGnv8IXVIB9C1aXOEsBzd8 BcLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=10odizUKmVzGCYfb95/P7kk2p8tg52fBuHAxUBBKwpU=; b=Sx4jVI42AXP10MbCFdLB1kCpt4IgmaS6XUAq88BxJv0HgQB0pdWqz1H0wzK2ssLUEX O3yLxu7S1Vpen8KIGD6hLyYBpzYUXgo5c/G4fta1LXJK84qe3vLoALcXNbKAAaF4H7J1 qRyzm4qvAYLEEAetHU9/hvQaWhA9LaLBbKZS3yqbLNmTtdGT3SON5SzV22d6D3wagd4z MOjwN3aiXqIRUBj2Y+zOgExCyunq6Qj6YiHbVXDBddVlFOQRmGR79XDEYtZLO4+GgIJf OXyZUyuTCew1tVEUk1ghkzJVXvzwxBEeP/IUSTvpmVlIvRAVaLbIk8ezBGBu57KOPO9w QCGA== X-Gm-Message-State: AG10YOS7X26MZZBGuEp0r2JjRhrRQTsN3aUVSForcKuC9cFkO92in7ykLzfrzr29kx5O8nwmPvEft82XD7aUTw== MIME-Version: 1.0 X-Received: by 10.31.180.85 with SMTP id d82mr21468466vkf.83.1456177677339; Mon, 22 Feb 2016 13:47:57 -0800 (PST) Received: by 10.31.194.194 with HTTP; Mon, 22 Feb 2016 13:47:57 -0800 (PST) In-Reply-To: <56CB7F3D.2010607@multiplay.co.uk> References: <2A35EA60C3C77D438915767F458D656880942E9A@ORSMSX111.amr.corp.intel.com> <56CB7F3D.2010607@multiplay.co.uk> Date: Mon, 22 Feb 2016 16:47:57 -0500 Message-ID: Subject: Re: sr-iov issues, reset_hw() failed with error -100 From: Ultima To: Steven Hartland Cc: freebsd-current@freebsd.org, freebsd-virtualization@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Feb 2016 21:47:59 -0000 Yeah, dmesg does show 48. 12 Cores and 24 threads each. 48 total On Mon, Feb 22, 2016 at 4:35 PM, Steven Hartland wrote: > isn't that 48 cores (12 real 12 virtual) per CPU? > > > On 22/02/2016 21:26, Ultima wrote: > >> This system has 24 cores (e5-2670v3)x2 >> >> Ultima >> >> On Mon, Feb 22, 2016 at 3:53 PM, Pieper, Jeffrey E < >> jeffrey.e.pieper@intel.com> wrote: >> >> Just out of curiosity, how many cores does your system have? >>> >>> Jeff >>> >>> -----Original Message----- >>> From: owner-freebsd-current@freebsd.org [mailto: >>> owner-freebsd-current@freebsd.org] On Behalf Of Ultima >>> Sent: Monday, February 22, 2016 12:02 PM >>> To: Eric Joyner >>> Cc: freebsd-current@freebsd.org; freebsd-virtualization@freebsd.org >>> Subject: Re: sr-iov issues, reset_hw() failed with error -100 >>> >>> After reboot... >>> >>> ifconfig ix1 up >>> >>> dhclient ix1 >>> DHCPDISCOVER on ix1 to 255.255.255.255 port 67 interval 4 >>> DHCPOFFER from 192.168.1.1 >>> DHCPREQUEST on ix1 to 255.255.255.255 port 67 >>> DHCPACK from 192.168.1.1 >>> bound to 192.168.1.145 -- renewal in 21600 seconds. >>> >>> ix0 down >>> ping 192.168.1.1 >>> PING 192.168.1.1 (192.168.1.1): 56 data bytes >>> 64 bytes from 192.168.1.1: icmp_seq=0 ttl=64 time=0.149 ms >>> 64 bytes from 192.168.1.1: icmp_seq=1 ttl=64 time=0.171 ms >>> 64 bytes from 192.168.1.1: icmp_seq=2 ttl=64 time=0.167 ms >>> >>> iovctl -Cf /etc/iovctl.conf >>> >>> ping 192.168.1.1 >>> PING 192.168.1.1 (192.168.1.1): 56 data bytes >>> ^C >>> --- 192.168.1.1 ping statistics --- >>> 29 packets transmitted, 0 packets received, 100.0% packet loss >>> ifconfig ix1 up >>> ping 192.168.1.1 >>> PING 192.168.1.1 (192.168.1.1): 56 data bytes >>> ^C >>> --- 192.168.1.1 ping statistics --- >>> 12 packets transmitted, 0 packets received, 100.0% packet loss >>> >>> ix1 is no longer usable until a restart... >>> >>> iovctl -Dd ix1 >>> ifconfig ix1 up >>> ping 192.168.1.1 >>> PING 192.168.1.1 (192.168.1.1): 56 data bytes >>> ^C >>> --- 192.168.1.1 ping statistics --- >>> 9 packets transmitted, 0 packets received, 100.0% packet loss >>> >>> >>> >>> Is there anything else that maybe useful? >>> >>> here is my ifconfig at the end (after ifconfig ix0 up) >>> >>> >>> ix0: flags=8943 metric 0 >>> mtu 1500 >>> >>> >>> options=e400b9 >>> ether -Hidden- >>> inet 192.168.1.8 netmask 0xffffff00 broadcast 192.168.1.255 >>> inet 192.168.1.9 netmask 0xffffff00 broadcast 192.168.1.255 >>> nd6 options=29 >>> media: Ethernet autoselect (10Gbase-T ) >>> status: active >>> ix1: flags=8843 metric 0 mtu 1500 >>> >>> >>> options=e407bb >>> ether -Hidden- >>> inet 192.168.1.145 netmask 0xffffff00 broadcast 192.168.1.255 >>> nd6 options=29 >>> media: Ethernet autoselect (10Gbase-T ) >>> status: active >>> lo0: flags=8049 metric 0 mtu 16384 >>> options=600003 >>> inet6 ::1 prefixlen 128 >>> inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 >>> inet 127.0.0.1 netmask 0xff000000 >>> nd6 options=21 >>> groups: lo >>> bridge0: flags=8843 metric 0 mtu >>> 1500 >>> ether -Hidden- >>> nd6 options=9 >>> groups: bridge >>> id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 >>> maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 >>> root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 >>> member: ix0 flags=143 >>> ifmaxaddr 0 port 1 priority 128 path cost 2000 >>> member: epair0a flags=143 >>> ifmaxaddr 0 port 5 priority 128 path cost 2000 >>> epair0a: flags=8943 >>> metric >>> 0 mtu 1500 >>> options=8 >>> ether -Hidden- >>> inet6 fe80::ff:70ff:fe00:50a%epair0a prefixlen 64 scopeid 0x5 >>> nd6 options=21 >>> media: Ethernet 10Gbase-T (10Gbase-T ) >>> status: active >>> groups: epair >>> >>> On Mon, Feb 22, 2016 at 1:51 PM, Eric Joyner wrote: >>> >>> Did you do an ifconfig up on ix1 before loading the VF driver? >>>> >>>> On Sat, Feb 20, 2016 at 11:57 AM Ultima wrote: >>>> >>>> Decided to do some testing with iovctl to see how sr-iov is coming >>>>> >>>> along. >>> >>>> Currently when adding the vf's there are a couple errors, and the >>>>> >>>> network >>> >>>> no longer function after iovctl is started. My guess is the reset_hw() >>>>> call >>>>> that is failing. Any ideas why this call would fail? I tested this on >>>>> >>>> both >>> >>>> ports, ix1 is detached and unused for this test, however inserting a >>>>> >>>> cable >>> >>>> results in an unusable port. iovctl -Dd ix1 removes the vf's, however >>>>> functionality is still not restored without a system restart. >>>>> >>>>> FreeBSD S1 11.0-CURRENT FreeBSD 11.0-CURRENT #0 r295736: Wed Feb 17 >>>>> 21:17:28 EST 2016 root@S1:/usr/obj/usr/src/sys/MYKERNEL amd64 >>>>> >>>>> /boot/loader.conf >>>>> hw.ix.num_queues="4" >>>>> >>>>> /etc/iovctl.conf >>>>> PF { >>>>> device : ix1; >>>>> num_vfs : 31; >>>>> } >>>>> >>>>> DEFAULT { >>>>> passthrough : true; >>>>> } >>>>> VF-0 { >>>>> passthrough : false; >>>>> } >>>>> VF-1 { >>>>> passthrough : false; >>>>> } >>>>> >>>>> # iovctl -C -f /etc/iovctl.conf >>>>> >>>>> dmesg >>>>> ixv0: >>>> 1.4.6-k> at device 0.129 on pci12 >>>>> ixv0: Using MSIX interrupts with 2 vectors >>>>> ixv0: ixgbe_reset_hw() failed with error -100 >>>>> device_attach: ixv0 attach returned 5 >>>>> ixv0: >>>> 1.4.6-k> at device 0.131 on pci12 >>>>> ixv0: Using MSIX interrupts with 2 vectors >>>>> ixv0: ixgbe_reset_hw() failed with error -100 >>>>> device_attach: ixv0 attach returned 5 >>>>> pci12: at device 0.133 (no driver attached) >>>>> pci12: at device 0.135 (no driver attached) >>>>> pci12: at device 0.137 (no driver attached) >>>>> pci12: at device 0.139 (no driver attached) >>>>> pci12: at device 0.141 (no driver attached) >>>>> pci12: at device 0.143 (no driver attached) >>>>> pci12: at device 0.145 (no driver attached) >>>>> pci12: at device 0.147 (no driver attached) >>>>> pci12: at device 0.149 (no driver attached) >>>>> pci12: at device 0.151 (no driver attached) >>>>> pci12: at device 0.153 (no driver attached) >>>>> pci12: at device 0.155 (no driver attached) >>>>> pci12: at device 0.157 (no driver attached) >>>>> pci12: at device 0.159 (no driver attached) >>>>> pci12: at device 0.161 (no driver attached) >>>>> pci12: at device 0.163 (no driver attached) >>>>> pci12: at device 0.165 (no driver attached) >>>>> pci12: at device 0.167 (no driver attached) >>>>> pci12: at device 0.169 (no driver attached) >>>>> pci12: at device 0.171 (no driver attached) >>>>> pci12: at device 0.173 (no driver attached) >>>>> pci12: at device 0.175 (no driver attached) >>>>> pci12: at device 0.177 (no driver attached) >>>>> pci12: at device 0.179 (no driver attached) >>>>> pci12: at device 0.181 (no driver attached) >>>>> pci12: at device 0.183 (no driver attached) >>>>> pci12: at device 0.185 (no driver attached) >>>>> pci12: at device 0.187 (no driver attached) >>>>> pci12: at device 0.189 (no driver attached) >>>>> >>>>> pciconf -lv >>>>> ix1@pci0:129:0:1: class=0x020000 card=0x00001458 chip=0x15288086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'Ethernet Controller 10-Gigabit X540-AT2' >>>>> class = network >>>>> subclass = ethernet >>>>> none155@pci0:129:0:129: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> none156@pci0:129:0:131: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt0@pci0:129:0:133: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt1@pci0:129:0:135: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt2@pci0:129:0:137: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt3@pci0:129:0:139: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt4@pci0:129:0:141: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt5@pci0:129:0:143: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt6@pci0:129:0:145: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt7@pci0:129:0:147: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt8@pci0:129:0:149: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt9@pci0:129:0:151: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt10@pci0:129:0:153: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt11@pci0:129:0:155: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt12@pci0:129:0:157: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt13@pci0:129:0:159: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt14@pci0:129:0:161: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt15@pci0:129:0:163: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt16@pci0:129:0:165: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt17@pci0:129:0:167: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt18@pci0:129:0:169: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt19@pci0:129:0:171: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt20@pci0:129:0:173: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt21@pci0:129:0:175: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt22@pci0:129:0:177: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt23@pci0:129:0:179: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt24@pci0:129:0:181: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt25@pci0:129:0:183: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt26@pci0:129:0:185: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt27@pci0:129:0:187: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> ppt28@pci0:129:0:189: class=0x020000 card=0x00001458 chip=0x15158086 >>>>> rev=0x01 hdr=0x00 >>>>> vendor = 'Intel Corporation' >>>>> device = 'X540 Ethernet Controller Virtual Function' >>>>> class = network >>>>> subclass = ethernet >>>>> >>>>> Ultima >>>>> _______________________________________________ >>>>> freebsd-current@freebsd.org mailing list >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-current >>>>> To unsubscribe, send any mail to " >>>>> >>>> freebsd-current-unsubscribe@freebsd.org >>> >>>> " >>>>> >>>>> _______________________________________________ >>> freebsd-current@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-current >>> To unsubscribe, send any mail to " >>> freebsd-current-unsubscribe@freebsd.org" >>> >>> _______________________________________________ >> freebsd-current@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-current >> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org >> " >> > > _______________________________________________ > freebsd-current@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" >