From owner-freebsd-virtualization@freebsd.org Tue Aug 28 03:27:50 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D449610A0381 for ; Tue, 28 Aug 2018 03:27:49 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: from mail-wm0-x229.google.com (mail-wm0-x229.google.com [IPv6:2a00:1450:400c:c09::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4D1B570269 for ; Tue, 28 Aug 2018 03:27:49 +0000 (UTC) (envelope-from akgupt3@gmail.com) Received: by mail-wm0-x229.google.com with SMTP id b19-v6so319941wme.3 for ; Mon, 27 Aug 2018 20:27:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=m1lmhXyLOLGpdz1i1WOSTAbi3sfWl98m+stg6SX/nrA=; b=r53UQXXoitOdcPFXgz02qUyG5tAOCnpTQQS/hZI4AQXK6Y9ff2ScreY33PoboLi4A+ 0yufY+9HmraaXbwDOUlN2R5iR3OZEMM0JzjRofZKeasVxSZLdR8xNYXzR0gDpztvM+cd 7RYMafzwUmOdFb2g6R4yX8mHUGKNXmMvXPNRJalmRW3gM4Oq9MiviVMV7l+bMtXPFNaD o+YocxejnzF6cqOCPWN9J6CMiAUJD4dkgWgaN/D3el3ENJm5y7aTng0m851n5nmK0v0g bObqZ4FIa1woasYjITG8lYrICtGFGDxM4hQ9lSDe9xoJ9Ii0aL6wgaNYOouw+Sooq+XW eBGQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=m1lmhXyLOLGpdz1i1WOSTAbi3sfWl98m+stg6SX/nrA=; b=MQooVIdtpIFs8Ks+PUGxvfvcYq7tEehspi+pzPuiNkNWCBfdd04SFtIluT8WdYGJIA BLD/yik2gUNfaO9v1PmmtsTJyFeJHVZHopARZWddMHa5UOKTgwV5XuJylbRFkV13ElEe yUtv2mAVSSswsh59KHGJj4pGTnzZw/gqJWY/5cI6tX13yZmyT4LIDr5bhBogatojZfcz nHRd4s29aqfXLlUG3PdQxZYy9BoAxZBxYGyrrdJgxEupmATNEQ/avB5GX8k2LHINBcjK p6fAqC9BYZYzlL3fUBg5wHr/JXBRMVF1Dr2oalQ7wv6GykXn+dYn+EpG7mQCwsA2hgcB Or6w== X-Gm-Message-State: APzg51CCjP4xl3V3poC1bib3oZ9hncZ4GNx/9+ZvHWaJyjaFcpzLuPzJ yOCKGoIbkBkDXZkeoQJpV7TEmfrOP/QvdHR6xZo= X-Google-Smtp-Source: ANB0VdY3ls4MpuAZKNoEe46FMcJXRkWrQsv14hEePoJHo8Lp7Gdg9jNpVhHO0+H9BsVTYYAXXM3aN/9ZE2gfb34CWjk= X-Received: by 2002:a1c:6386:: with SMTP id x128-v6mr41051wmb.104.1535426867496; Mon, 27 Aug 2018 20:27:47 -0700 (PDT) MIME-Version: 1.0 References: <201808271519.w7RFJt5J011000@pdx.rh.CN85.dnsmgr.net> In-Reply-To: <201808271519.w7RFJt5J011000@pdx.rh.CN85.dnsmgr.net> From: Anish Date: Mon, 27 Aug 2018 20:27:36 -0700 Message-ID: Subject: Re: on bhyve statistics To: "Rodney W. Grimes" Cc: Fabian Freyer , "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Aug 2018 03:27:50 -0000 >> Currently, bhyve does not expose any of these statistics. All the stats > available through bhyvectl --get-stats seem to be coming from the VMM, > not from the userspace emulation. >That is correct, byhvectl is a diagnostics tool for getting information from the kernel/vmm module. bhyvectl provide stats related to processor vmx/svm from vmm.ko and is the first thing you want to run for performance regression. It will be nice to include it as part of bhyve perf tool/dashboard that you are intended to build. -Anish On Mon, Aug 27, 2018 at 8:20 AM Rodney W. Grimes < freebsd-rwg@pdx.rh.cn85.dnsmgr.net> wrote: > > Hi list, > > > > I'm currently looking at getting the libvirt prometheus exporter[1] to > > work with libvirt+bhyve. In its current state this doesn't work because > > at least one of the API calls exposed by libvirt isn't implemented by > > the libvirt bhyve driver - so I started looking at implementing it. > > > > The first API call in question is virDomainBlockStats[2], which returns > > statistics (number of read and written bytes and ops, respectively). > > > > Currently, bhyve does not expose any of these statistics. All the stats > > available through bhyvectl --get-stats seem to be coming from the VMM, > > not from the userspace emulation. > > That is correct, byhvectl is a diagnostics tool for getting > information from the kernel/vmm module. > > > OTOH, I did see that there are *some* > > stats being collected in bhyverun.c (see struct bhyvestats {...} > > stats;). I can't see how these are exposed though - a grep of /usr/src > > turned up no other uses. Which brings me to the following questions: > > > > - are the stats in struct bhyvestats {...} stats exposed or used in any > > non-obvious way? > > Not that I am aware of. > > > - architecturally, what would be the best ways to get stats out of the > > user-space emulations? Off of the top of my head, I could think of the > > following possibilities: > > - prometheus exporter > > - having some socket or pipe to request them > > - DTrace probes > > > > I wouldn't mind implementing any of the above, and so would like to know > > which of these (or other options) would be the most acceptable, and > > would appreciate some guidance. > > I differ to others on what may be the best way to do this. > > > CC'ing novel@ for the libvirt side, and grehan@ for the architectural > > bhyve questions. > > You should replace @grehan with @jhb,@tychon as Peter has moved on, > and John and Tycho are now the bhyve maintainers. I was going to > add them, and remove Peter, but I see no cc: anyway, so I am sure > that they are on the virtualization list though. > > > Fabian > > > > [1] https://github.com/kumina/libvirt_exporter > > [2] > https://libvirt.org/html/libvirt-libvirt-domain.html#virDomainBlockStats > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" > > -- > Rod Grimes > rgrimes@freebsd.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to " > freebsd-virtualization-unsubscribe@freebsd.org" >