From owner-freebsd-cloud@freebsd.org Mon Oct 31 20:44:44 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BCAF8C284E1 for ; Mon, 31 Oct 2016 20:44:44 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from vps-mail.nomadlogic.org (unknown [IPv6:2607:f2f8:a098::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8F26B138B for ; Mon, 31 Oct 2016 20:44:44 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from la-dgt-31327.usa.tribune.com (nat-192-187-90-113.nat.tribpub.com [192.187.90.113]) by vps-mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id ecaad39c TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO for ; Mon, 31 Oct 2016 13:44:43 -0700 (PDT) To: freebsd-cloud@freebsd.org From: Pete Wright Subject: xn0 systat no egress data? Message-ID: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> Date: Mon, 31 Oct 2016 13:44:43 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Oct 2016 20:44:44 -0000 hey all - this is regarding the following bug i've opened: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213814 tl;dr version is that on 11.0-RELEASE on EC2 when i invoke "systat -ifstat" the egress data flows for the xn0 device do not update. verified it works as expected on 10.3-RELEASE. tried reading through code but am pretty confused as to how xn0 is created and what code is used to update the sysctl MIBs. thoughts? -pete -- Pete Wright pete@nomadlogic.org nomadlogicLA From owner-freebsd-cloud@freebsd.org Mon Oct 31 21:08:24 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ADF28C28949 for ; Mon, 31 Oct 2016 21:08:24 +0000 (UTC) (envelope-from 010001581c924388-a19fb99f-c0fe-4955-ad58-ed8440f619ab-000000@amazonses.com) Received: from a8-237.smtp-out.amazonses.com (a8-237.smtp-out.amazonses.com [54.240.8.237]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 75AF1130D for ; Mon, 31 Oct 2016 21:08:24 +0000 (UTC) (envelope-from 010001581c924388-a19fb99f-c0fe-4955-ad58-ed8440f619ab-000000@amazonses.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=vnqrkfnvu6csdl6mwgk5t6ix3nnepx57; d=tarsnap.com; t=1477948097; h=Subject:To:References:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; bh=GJitR6JFhnGCfCaF674eccSd6MMIPUk5BMy5+07snp4=; b=h6TlPMsLo8jaIdXdKPJ5nFm/QYjrDVZkE1IqeKuTnkVgW0oQd3MTkGFvM47sLK8i 98c7IgQYrzClvpF3fT2kDCDY0Tu7YrzO9SPLwE/126l2OXIO2esbRJLWFuM1WluxFlP T2Ltss7Ij75Isdccqe6UmrcHK6I5R/IE/xsyodjk= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=6gbrjpgwjskckoa6a5zn6fwqkn67xbtw; d=amazonses.com; t=1477948097; h=Subject:To:References:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding:Feedback-ID; bh=GJitR6JFhnGCfCaF674eccSd6MMIPUk5BMy5+07snp4=; b=npqssFYN9MRJmiw707m9uk+MPsNgdakxjzRh43rPac1wydtNP/2p9fMsr9FiR9HV GLRh0VLrJC3jv2pomQkHs+Apmb0BwSq2Eq264pPsvf5a9k5sf3yWUlbdPcT+7J7Ve1R 6UDBIV3E2Yv0ZW8AkuuiBueoO+/RnGhoPUPxX7Ag= Subject: Re: xn0 systat no egress data? To: Pete Wright , freebsd-cloud@freebsd.org References: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> From: Colin Percival Message-ID: <010001581c924388-a19fb99f-c0fe-4955-ad58-ed8440f619ab-000000@email.amazonses.com> Date: Mon, 31 Oct 2016 21:08:17 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-SES-Outgoing: 2016.10.31-54.240.8.237 Feedback-ID: 1.us-east-1.Lv9FVjaNvvR5llaqfLoOVbo2VxOELl7cjN0AOyXnPlk=:AmazonSES X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Oct 2016 21:08:24 -0000 On 10/31/16 13:44, Pete Wright wrote: > hey all - this is regarding the following bug i've opened: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213814 > > tl;dr version is that on 11.0-RELEASE on EC2 when i invoke "systat -ifstat" > the egress data flows for the xn0 device do not update. verified it works as > expected on 10.3-RELEASE. tried reading through code but am pretty confused > as to how xn0 is created and what code is used to update the sysctl MIBs. I think this might be fixed by r308126. Can you try applying that patch and report back? -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid From owner-freebsd-cloud@freebsd.org Mon Oct 31 21:57:23 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2701EC28695 for ; Mon, 31 Oct 2016 21:57:23 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from vps-mail.nomadlogic.org (unknown [IPv6:2607:f2f8:a098::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0ED2F1F51 for ; Mon, 31 Oct 2016 21:57:22 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from la-dgt-31327.usa.tribune.com (nat-192-187-90-113.nat.tribpub.com [192.187.90.113]) by vps-mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 1c2781fe TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO; Mon, 31 Oct 2016 14:57:22 -0700 (PDT) Subject: Re: xn0 systat no egress data? To: Colin Percival , freebsd-cloud@freebsd.org References: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> <010001581c9246a1-331188e9-2263-4600-abb3-09efc7ea3026-000000@email.amazonses.com> From: Pete Wright Message-ID: Date: Mon, 31 Oct 2016 14:57:21 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: <010001581c9246a1-331188e9-2263-4600-abb3-09efc7ea3026-000000@email.amazonses.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Oct 2016 21:57:23 -0000 On 10/31/16 2:08 PM, Colin Percival wrote: > On 10/31/16 13:44, Pete Wright wrote: >> hey all - this is regarding the following bug i've opened: >> >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213814 >> >> tl;dr version is that on 11.0-RELEASE on EC2 when i invoke "systat -ifstat" >> the egress data flows for the xn0 device do not update. verified it works as >> expected on 10.3-RELEASE. tried reading through code but am pretty confused >> as to how xn0 is created and what code is used to update the sysctl MIBs. > > I think this might be fixed by r308126. Can you try applying that patch and > report back? hrm doesn't look like it has changed anything on my end. i applied this patch against the 11.0.1 svn source: https://svnweb.freebsd.org/base/head/sys/dev/xen/netfront/netfront.c?view=patch&r1=308126&r2=308125&pathrev=308126 then built/installed a kernel after applying this patch with no change. I don't think i need to rebuild world for this, right? Cheers! -pete -- Pete Wright pete@nomadlogic.org nomadlogicLA From owner-freebsd-cloud@freebsd.org Tue Nov 1 02:27:44 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91B08C29133 for ; Tue, 1 Nov 2016 02:27:44 +0000 (UTC) (envelope-from 010001581db69b85-14950ad2-77a2-49fa-976e-648c6f0d709e-000000@amazonses.com) Received: from a8-52.smtp-out.amazonses.com (a8-52.smtp-out.amazonses.com [54.240.8.52]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 57E561925 for ; Tue, 1 Nov 2016 02:27:44 +0000 (UTC) (envelope-from 010001581db69b85-14950ad2-77a2-49fa-976e-648c6f0d709e-000000@amazonses.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=vnqrkfnvu6csdl6mwgk5t6ix3nnepx57; d=tarsnap.com; t=1477967256; h=Subject:To:References:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; bh=nw107w+8+IE4O60QwEfwSezUwEaXOd1bcVeJUIFgo7s=; b=HKvVHtQJ+B7OokHMw+S8ocEgVU6bYKS3ZKj5WclHxKaeI14DDQMEbWzgI7E0lP1W 4YRlS1bCNqrVzHN7cMzzXkMdaS7pul1wSyZZL6vr6BN4/qWCXAf1pEcrZkW7Xc6wgiL joGukwT4BbmOetmH+FXhMdJa/IJvqWijcDxnAlm4= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=6gbrjpgwjskckoa6a5zn6fwqkn67xbtw; d=amazonses.com; t=1477967256; h=Subject:To:References:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding:Feedback-ID; bh=nw107w+8+IE4O60QwEfwSezUwEaXOd1bcVeJUIFgo7s=; b=APofCjH5KlbDdcZF5McKwx96jNAvQ3EMUc40JV8Fmx6kPtCBNXrjRZhV3b8lPIOS GgU6trco4mGGzuWhhsyVNIjeKX/GYoCgldrA2SljD3V0wjKBjZCH0mVnp32s/t2ny38 tWpFLdwasq7Ywdcmsi1zVbB7sPqKw6Sm2aBQ2NY8= Subject: Re: xn0 systat no egress data? To: Pete Wright , freebsd-cloud@freebsd.org, freebsd-xen@freebsd.org References: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> <010001581c9246a1-331188e9-2263-4600-abb3-09efc7ea3026-000000@email.amazonses.com> From: Colin Percival Message-ID: <010001581db69b85-14950ad2-77a2-49fa-976e-648c6f0d709e-000000@email.amazonses.com> Date: Tue, 1 Nov 2016 02:27:36 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-SES-Outgoing: 2016.11.01-54.240.8.52 Feedback-ID: 1.us-east-1.Lv9FVjaNvvR5llaqfLoOVbo2VxOELl7cjN0AOyXnPlk=:AmazonSES X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2016 02:27:44 -0000 On 10/31/16 14:57, Pete Wright wrote: > On 10/31/16 2:08 PM, Colin Percival wrote: >> On 10/31/16 13:44, Pete Wright wrote: >>> hey all - this is regarding the following bug i've opened: >>> >>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213814 >>> >>> tl;dr version is that on 11.0-RELEASE on EC2 when i invoke "systat -ifstat" >>> the egress data flows for the xn0 device do not update. verified it works as >>> expected on 10.3-RELEASE. tried reading through code but am pretty confused >>> as to how xn0 is created and what code is used to update the sysctl MIBs. >> >> I think this might be fixed by r308126. Can you try applying that patch and >> report back? > > hrm doesn't look like it has changed anything on my end. > > i applied this patch against the 11.0.1 svn source: > https://svnweb.freebsd.org/base/head/sys/dev/xen/netfront/netfront.c?view=patch&r1=308126&r2=308125&pathrev=308126 > > then built/installed a kernel after applying this patch with no change. I > don't think i need to rebuild world for this, right? Hmm, that should have worked. (Assuming you rebooted into the new kernel, of course.) I'm out of ideas... maybe someone on the -xen list will know more... -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid From owner-freebsd-cloud@freebsd.org Tue Nov 1 05:08:50 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 014B3C2C09D; Tue, 1 Nov 2016 05:08:50 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from vps-mail.nomadlogic.org (unknown [IPv6:2607:f2f8:a098::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D964811BE; Tue, 1 Nov 2016 05:08:49 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from LA-DGT-31327.local (cpe-23-242-83-219.socal.res.rr.com [23.242.83.219]) by vps-mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id b8fa0cec TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO; Mon, 31 Oct 2016 22:08:48 -0700 (PDT) Subject: Re: xn0 systat no egress data? To: Colin Percival , freebsd-cloud@freebsd.org, freebsd-xen@freebsd.org References: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> <010001581c9246a1-331188e9-2263-4600-abb3-09efc7ea3026-000000@email.amazonses.com> <010001581db69ef4-f72357af-3af3-4a9f-89f4-58da717d63aa-000000@email.amazonses.com> From: Pete Wright Message-ID: <733457ca-98b5-3645-073d-68ac71eb9efa@nomadlogic.org> Date: Mon, 31 Oct 2016 22:08:47 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: <010001581db69ef4-f72357af-3af3-4a9f-89f4-58da717d63aa-000000@email.amazonses.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2016 05:08:50 -0000 On 10/31/16 7:27 PM, Colin Percival wrote: > On 10/31/16 14:57, Pete Wright wrote: >> On 10/31/16 2:08 PM, Colin Percival wrote: >>> On 10/31/16 13:44, Pete Wright wrote: >>>> hey all - this is regarding the following bug i've opened: >>>> >>>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213814 >>>> >>>> tl;dr version is that on 11.0-RELEASE on EC2 when i invoke "systat -ifstat" >>>> the egress data flows for the xn0 device do not update. verified it works as >>>> expected on 10.3-RELEASE. tried reading through code but am pretty confused >>>> as to how xn0 is created and what code is used to update the sysctl MIBs. >>> >>> I think this might be fixed by r308126. Can you try applying that patch and >>> report back? >> >> hrm doesn't look like it has changed anything on my end. >> >> i applied this patch against the 11.0.1 svn source: >> https://svnweb.freebsd.org/base/head/sys/dev/xen/netfront/netfront.c?view=patch&r1=308126&r2=308125&pathrev=308126 >> >> then built/installed a kernel after applying this patch with no change. I >> don't think i need to rebuild world for this, right? > > Hmm, that should have worked. (Assuming you rebooted into the new kernel, > of course.) > > I'm out of ideas... maybe someone on the -xen list will know more... thanks Colin - I'll double check my work tomorrow morning and ping -xen if i'm still having issues. cheers, -pete -- Pete Wright pete@nomadlogic.org nomadlogicLA From owner-freebsd-cloud@freebsd.org Tue Nov 1 13:03:00 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D337AC2713A for ; Tue, 1 Nov 2016 13:03:00 +0000 (UTC) (envelope-from bradleythughes@fastmail.fm) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A882F19B7 for ; Tue, 1 Nov 2016 13:02:59 +0000 (UTC) (envelope-from bradleythughes@fastmail.fm) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.nyi.internal (Postfix) with ESMTP id 4BB0A209C6; Tue, 1 Nov 2016 09:02:58 -0400 (EDT) Received: from frontend1 ([10.202.2.160]) by compute2.internal (MEProxy); Tue, 01 Nov 2016 09:02:58 -0400 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=fastmail.fm; h= x-me-sender:x-sasl-enc:content-type:mime-version:subject:from :in-reply-to:date:cc:content-transfer-encoding:message-id :references:to; s=mesmtp; bh=Il83+PD8QmVHIwA3KfOeMlruOZ8=; b=jEn o35h992FTKzOC6DRwai9Ks2WB7/q/QnoqCfhatAUwY4rmJyFRRd2Nc56sKM1HwTW IztnM6tSscel8qrgmW+VQI+pu9JysTp9uULdkFMUo1Ur4aXupjtpm59OYCZKu5cI +h+TtJ0+hQubIt05qlv847hHu1tU7Odad+jqt8L0= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=x-me-sender:x-sasl-enc:content-type :mime-version:subject:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; s=smtpout; bh=Il83+PD8QmVHIwA3KfOeMlruOZ8=; b=sMVtxzCwUYA3QoTZsGnywE3ybe+e nt7cga6Y8szJsqzl/iIIbFUPwrqAdiUho19P2XjJpbXTYkFvea1NZIckINhmxc7o E5Vrd4QJTP0amvSr9Myf3psM309Nm36wpqSApTeZw9naxD8APAAzpPvEJjm5dy30 HA+5KCYL39jLvMw= X-ME-Sender: X-Sasl-enc: PHXoVCtp8BsgwE+oU2Qk21+M5UGz3MpMhgAk3QDupBVT 1478005377 Received: from [172.20.10.3] (2.150.48.180.tmi.telenormobil.no [2.150.48.180]) by mail.messagingengine.com (Postfix) with ESMTPA id 9FE0AF29D5; Tue, 1 Nov 2016 09:02:57 -0400 (EDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.1 \(3251\)) Subject: Re: xn0 systat no egress data? From: "Bradley T. Hughes" In-Reply-To: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> Date: Tue, 1 Nov 2016 14:02:55 +0100 Cc: freebsd-cloud@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <33AA44AE-3958-4010-9CB3-DCF4D39D3054@fastmail.fm> References: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> To: Pete Wright X-Mailer: Apple Mail (2.3251) X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2016 13:03:00 -0000 > On 31 Oct 2016, at 21:44, Pete Wright wrote: >=20 > hey all - this is regarding the following bug i've opened: >=20 > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D213814 >=20 > tl;dr version is that on 11.0-RELEASE on EC2 when i invoke "systat = -ifstat" the egress data flows for the xn0 device do not update. = verified it works as expected on 10.3-RELEASE. tried reading through = code but am pretty confused as to how xn0 is created and what code is = used to update the sysctl MIBs. FWIW, I see the same with the ixv0 device on a c4.large AWS EC2 = instance. I also commented on the PR in bugzilla with additional info. -- Bradley T. Hughes bradleythughes@fastmail.fm From owner-freebsd-cloud@freebsd.org Tue Nov 1 16:34:27 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DFBCFC2A7F2 for ; Tue, 1 Nov 2016 16:34:27 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from vps-mail.nomadlogic.org (unknown [IPv6:2607:f2f8:a098::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BEC2D19A7 for ; Tue, 1 Nov 2016 16:34:27 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from la-dgt-31327.usa.tribune.com (nat-192-187-90-113.nat.tribpub.com [192.187.90.113]) by vps-mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 66aa45a7 TLS version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO; Tue, 1 Nov 2016 09:34:26 -0700 (PDT) Subject: Re: xn0 systat no egress data? To: "Bradley T. Hughes" References: <8be5174c-fcd5-0e5b-921f-5cfc31e99c4f@nomadlogic.org> <33AA44AE-3958-4010-9CB3-DCF4D39D3054@fastmail.fm> Cc: freebsd-cloud@freebsd.org From: Pete Wright Message-ID: Date: Tue, 1 Nov 2016 09:34:24 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: <33AA44AE-3958-4010-9CB3-DCF4D39D3054@fastmail.fm> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Nov 2016 16:34:28 -0000 On 11/1/16 6:02 AM, Bradley T. Hughes wrote: > >> On 31 Oct 2016, at 21:44, Pete Wright wrote: >> >> hey all - this is regarding the following bug i've opened: >> >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213814 >> >> tl;dr version is that on 11.0-RELEASE on EC2 when i invoke "systat -ifstat" the egress data flows for the xn0 device do not update. verified it works as expected on 10.3-RELEASE. tried reading through code but am pretty confused as to how xn0 is created and what code is used to update the sysctl MIBs. > > FWIW, I see the same with the ixv0 device on a c4.large AWS EC2 instance. I also commented on the PR in bugzilla with additional info. > Thanks Bradley - I've also observed this behaviour on the ixv0 interfaces as well. I believe the patch is on the right track - i.e. I suspect the issue lies in the backend Xen device code. Hoping it's a trivial fix for someone more familiar with the plumbing of that code than me. Cheers! -pete -- Pete Wright pete@nomadlogic.org nomadlogicLA From owner-freebsd-cloud@freebsd.org Thu Nov 3 18:31:59 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5EDF1C2E35D for ; Thu, 3 Nov 2016 18:31:59 +0000 (UTC) (envelope-from newt0311@gmail.com) Received: from mail-ua0-x232.google.com (mail-ua0-x232.google.com [IPv6:2607:f8b0:400c:c08::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1D3531971 for ; Thu, 3 Nov 2016 18:31:59 +0000 (UTC) (envelope-from newt0311@gmail.com) Received: by mail-ua0-x232.google.com with SMTP id b35so46946783uaa.3 for ; Thu, 03 Nov 2016 11:31:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to; bh=WU8mRWbvNFjeZxH2yhQje5pZd2tTZ2nOoNsv2n69Uw8=; b=cp/2ZqjUAmxNk4moXDaGrsf5lBtpnYZTuH2QmD8b1uTqM5D+8BdN5sLCa3vJeJXwsq xtNTWtjI0LxwhKhmGyV5NYSLQM6aCuzViY8kLBlf1VTcEzObx1Q5AT0L/2oqtmTauJNq yzTPxb8lf4GuO8y5c6RLSGIUjZyudGUmfk2Rnle1l7opN/esSjt6Zf9yavCZqJyBcMOY m9jsM1snw6yQk2u1n/sLI5+4p/rTH3kpKlsx7CX0nfPHVHdKlCxqm+TXxICWzWn8bb/2 t/Lqf6AgSa7Z8JKwlqtHNZ6jEGBGshYGJjKtj9UHzgPd/FCIlArceXi2A1Xigd6ssQ9K ysRQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=WU8mRWbvNFjeZxH2yhQje5pZd2tTZ2nOoNsv2n69Uw8=; b=TZ8u07PynXIZp53g2nAdeRoi8zKtP92pLR7SQGsI6sQoqkdWG8aufDFNRjywENRzb6 Bpu3+7wvkfGRjShRORWPN2RX+5fs+l5Y/qAGA6DZk9zoYkiRVq89qFwgjRLX8AYVsu9V vEeRINgTzbp9B1ySt9DOEZNRY/NbD6+qSRqYVlGesykpmPyDdm/ywYjFCrqEbykCXU7V agmZC5SQF3SnpwfTN9+Esgs8uvYavWJ/++jdy3R5Wbb7LiUrwOgWop5frP1Mn61A7fm/ yYeFHTR8RCzCtF8wClo7UJSH1qqXuXpaXUNjs/1ujlstBd3bYbtEBwi1vMRKDdunHhKJ RSVA== X-Gm-Message-State: ABUngvfqDsEXGDh+s8jYdoV0GNnDKbx/RhQueAFeKSuFB5E5caHjp9LaV0wQNAd7G7QSqsd6ejuj9pMlXsHHzg== X-Received: by 10.159.49.27 with SMTP id m27mr8729425uab.178.1478197918026; Thu, 03 Nov 2016 11:31:58 -0700 (PDT) MIME-Version: 1.0 Received: by 10.103.69.19 with HTTP; Thu, 3 Nov 2016 11:31:37 -0700 (PDT) From: Prakhar Goel Date: Thu, 3 Nov 2016 14:31:37 -0400 Message-ID: Subject: FreeBSD images swap space on GCE To: freebsd-cloud@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Nov 2016 18:31:59 -0000 Hello, Something I came across recently: I'm using freebsd-11-0-release-amd64 from the freebsd-org-cloud-dev for some of my VMs. Under high memory pressure they seem to just lock up and become unresponsive. I've waited for up to ~15 minutes for them to revive with no luck. After a little debugging, I think I've narrowed the problem down to the swap space. By default, the VM seems to have a 1GB swap space setup on the root disk. GCE scales I/O linearly with the size of the disk and the size of the root disk is only 22GB. I think this leaves the root disk with too little I/O capacity to act as swap space (it's still enough for normal fs use apparently). When I was monitoring this in top, my memory-intensive processes would continue to work until the system ran out of RAM and then they'd just get stuck in "vmwait." To resolve the problem, I enabled extra space in an attached volume (standard persistent disk, 200GB size). As long as my new swap space was enabled *and the old swap space was disabled*, my applications were fine. Not sure what can be done to resolve this. The default swap setup just seems to cause problems so maybe remove it altogether and let users set up their own swap space on faster devices as needed? Thanks. PS. Is this the right place to send emails like this? Not sure myself. -- ________________________ Warm Regards Prakhar Goel From owner-freebsd-cloud@freebsd.org Thu Nov 3 19:50:36 2016 Return-Path: Delivered-To: freebsd-cloud@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6DA9CC2DEAF for ; Thu, 3 Nov 2016 19:50:36 +0000 (UTC) (envelope-from 010001582bbe15d7-f80d1269-699f-4570-b8e3-d66061c34d0b-000000@amazonses.com) Received: from a8-26.smtp-out.amazonses.com (a8-26.smtp-out.amazonses.com [54.240.8.26]) (using TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 30EDE1181 for ; Thu, 3 Nov 2016 19:50:35 +0000 (UTC) (envelope-from 010001582bbe15d7-f80d1269-699f-4570-b8e3-d66061c34d0b-000000@amazonses.com) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=vnqrkfnvu6csdl6mwgk5t6ix3nnepx57; d=tarsnap.com; t=1478202627; h=Subject:To:References:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; bh=3Ah8WHHfi/Gwp8i+Oo84o3bdUuTeL8Ce7O+vlH/Z8OE=; b=Ecb/INWjd1++8Vb0UYAy9TWpTThce3BrIXspioL3JvV2dKvEFYbOztBHCT65vmgV 0K6NqDjtLnMbWAHmqsJ6ngiGmlN+0vY1x18gQ9TE2GeOWkniyC+u7yAtLkWQArrubT9 c+zxNcF7JO9ZhRANYC7qXNqKl608sQRHlUHeNnCQ= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/simple; s=6gbrjpgwjskckoa6a5zn6fwqkn67xbtw; d=amazonses.com; t=1478202627; h=Subject:To:References:From:Message-ID:Date:MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding:Feedback-ID; bh=3Ah8WHHfi/Gwp8i+Oo84o3bdUuTeL8Ce7O+vlH/Z8OE=; b=KFMS3aAbFAQIqMe34j8G3vaZEEGMEOux4da/USERzGA/VIlhcdu/szVIK3as11PQ 6vVZ1GBv06tOtrv8lTzJuiz4JQwY61Prr1+Mp22F7B7Kz7HaFYDxlWGFhV55uchENXA ncxTgxTwdVF6vVaW7tTGQzhm5bpOw4mYbravJank= Subject: Re: FreeBSD images swap space on GCE To: Prakhar Goel , freebsd-cloud@freebsd.org References: From: Colin Percival Message-ID: <010001582bbe15d7-f80d1269-699f-4570-b8e3-d66061c34d0b-000000@email.amazonses.com> Date: Thu, 3 Nov 2016 19:50:27 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-SES-Outgoing: 2016.11.03-54.240.8.26 Feedback-ID: 1.us-east-1.Lv9FVjaNvvR5llaqfLoOVbo2VxOELl7cjN0AOyXnPlk=:AmazonSES X-BeenThere: freebsd-cloud@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "FreeBSD on cloud platforms \(EC2, GCE, Azure, etc.\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Nov 2016 19:50:36 -0000 On 11/03/16 11:31, Prakhar Goel wrote: > [GCE images have swap on the root disk, which is small and thus slow...] > > To resolve the problem, I enabled extra space in an attached volume > (standard persistent disk, 200GB size). As long as my new swap space > was enabled *and the old swap space was disabled*, my applications > were fine. > > Not sure what can be done to resolve this. The default swap setup just > seems to cause problems so maybe remove it altogether and let users > set up their own swap space on faster devices as needed? For the EC2 images, I don't have any swap in the image itself but if there are any ephemeral disks attached I grab a slice from them and configure it as swap. Quite apart from the question of performance, with instances having anywhere from 0.5 GB up to 1952 GB of RAM, it doesn't make much sense to have a fixed size of swap. > PS. Is this the right place to send emails like this? Not sure myself. Definitely the right place. -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid