From owner-freebsd-elastic@freebsd.org Sat Feb 22 00:26:19 2020 Return-Path: <owner-freebsd-elastic@freebsd.org> Delivered-To: freebsd-elastic@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C30CA248636 for <freebsd-elastic@mailman.nyi.freebsd.org>; Sat, 22 Feb 2020 00:26:19 +0000 (UTC) (envelope-from glewis@eyesbeyond.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 48PTdk48Fzz3CWb for <freebsd-elastic@freebsd.org>; Sat, 22 Feb 2020 00:26:18 +0000 (UTC) (envelope-from glewis@eyesbeyond.com) Received: by mailman.nyi.freebsd.org (Postfix) id 75063248635; Sat, 22 Feb 2020 00:26:18 +0000 (UTC) Delivered-To: elastic@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 74BA0248633 for <elastic@mailman.nyi.freebsd.org>; Sat, 22 Feb 2020 00:26:18 +0000 (UTC) (envelope-from glewis@eyesbeyond.com) Received: from resqmta-po-12v.sys.comcast.net (resqmta-po-12v.sys.comcast.net [IPv6:2001:558:fe16:19:96:114:154:171]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48PTdg6JDLz3CVV for <elastic@freebsd.org>; Sat, 22 Feb 2020 00:26:14 +0000 (UTC) (envelope-from glewis@eyesbeyond.com) Received: from resomta-po-14v.sys.comcast.net ([96.114.154.238]) by resqmta-po-12v.sys.comcast.net with ESMTP id 5IbTjbE8MeHaE5IcWjafWJ; Sat, 22 Feb 2020 00:26:12 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=comcastmailservice.net; s=20180828_2048; t=1582331172; bh=B9ykOsAASvPhwagXvi1L8KStj2+3h3aEGf4vMgx5J3c=; h=Received:Received:Received:Received:Date:From:To:Subject: Message-ID:MIME-Version:Content-Type; b=ThMci8uYUb7zLifOitW4SDh9beBv2t8TKapSvKkE1ZWVOtilO5kCrmpN7bXKzGGr7 p9DFVxGmbuo3WPZsiShoD9uR4fYXpLnrZPw8H/0LSX+Nlrx2oXa7mcycLbv+W4zsaN P/lYOfGffvq5ZDP5IwfH03VvOTakyaQZY1XN3uxTIqZzqEyEOM3q9sbUY4klRlSKkF QexLRR1KXLD40UA9DiRmcDjcEIY+zfq+wUTRimA8BcmJOqAcoNQ2eg6hmakdPwEJ2u WCn6ueqjaeL4gonox8h4TTW9e1fZcaKlmdlhzZaTxsl+SM+aP4QEFdGJHpwfngcrT0 hSztNoTxWFGGQ== Received: from misty.eyesbeyond.com ([24.16.127.181]) by resomta-po-14v.sys.comcast.net with ESMTPA id 5IcVjdPZ7jI1g5IcVjpA7L; Sat, 22 Feb 2020 00:26:12 +0000 X-Xfinity-VAAS: gggruggvucftvghtrhhoucdtuddrgedugedrkeehgddvvdcutefuodetggdotefrodftvfcurfhrohhfihhlvgemucevohhmtggrshhtqdftvghsihdpqfgfvfdppffquffrtefokffrnecuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenucfjughrpeffhffvuffkfhggtggujgesthdttddttddtvdenucfhrhhomhepifhrvghgucfnvgifihhsuceoghhlvgifihhssegvhigvshgsvgihohhnugdrtghomheqnecuffhomhgrihhnpehprghsthgvsghinhdrtghomhdpfhhrvggvsghsugdrohhrghdpvgihvghssggvhihonhgurdgtohhmnecukfhppedvgedrudeirdduvdejrddukedunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehhvghlohepmhhishhthidrvgihvghssggvhihonhgurdgtohhmpdhinhgvthepvdegrdduiedruddvjedrudekuddpmhgrihhlfhhrohhmpehglhgvfihishesvgihvghssggvhihonhgurdgtohhmpdhrtghpthhtohepphgruhhlghhouggrrhgusehgmhgrihhlrdgtohhmpdhrtghpthhtoheptddttddrfhgsshgusehquhhiphdrtgiipdhrtghpthhtohepvghlrghsthhitgesfhhrvggvsghsugdrohhrgh X-Xfinity-VMeta: sc=-100.00;st=legit Received: from misty.eyesbeyond.com (localhost.eyesbeyond.com [127.0.0.1]) by misty.eyesbeyond.com (8.15.2/8.15.2) with ESMTP id 01M0QBa3070097; Fri, 21 Feb 2020 16:26:11 -0800 (PST) (envelope-from glewis@eyesbeyond.com) X-Authentication-Warning: misty.eyesbeyond.com: Host localhost.eyesbeyond.com [127.0.0.1] claimed to be misty.eyesbeyond.com Received: (from glewis@localhost) by misty.eyesbeyond.com (8.15.2/8.15.2/Submit) id 01M0QA5j070096; Fri, 21 Feb 2020 16:26:10 -0800 (PST) (envelope-from glewis@eyesbeyond.com) X-Authentication-Warning: misty.eyesbeyond.com: glewis set sender to glewis@eyesbeyond.com using -f Date: Fri, 21 Feb 2020 16:26:10 -0800 From: Greg Lewis <glewis@eyesbeyond.com> To: Paul Godard <paulgodard@gmail.com> Cc: Miroslav Lachman <000.fbsd@quip.cz>, elastic@freebsd.org Subject: Re: Beats port update - 7.5.2 Message-ID: <20200222002610.GA70046@misty.eyesbeyond.com> References: <CA+8T5Q4djCk0Oqxi8Dds7L-49UHT9DhoBOWiOEq=CEoak96Pnw@mail.gmail.com> <cce8d2e4-69bd-08c3-64e9-7b365bc9a9f9@quip.cz> <CA+8T5Q6vh00ru-vfFwSuThc62uHj6mqZGyGy0b5Q3pWbnDP_TA@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <CA+8T5Q6vh00ru-vfFwSuThc62uHj6mqZGyGy0b5Q3pWbnDP_TA@mail.gmail.com> X-Rspamd-Queue-Id: 48PTdg6JDLz3CVV X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=comcastmailservice.net header.s=20180828_2048 header.b=ThMci8uY; dmarc=none; spf=none (mx1.freebsd.org: domain of glewis@eyesbeyond.com has no SPF policy when checking 2001:558:fe16:19:96:114:154:171) smtp.mailfrom=glewis@eyesbeyond.com X-Spamd-Result: default: False [0.46 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[comcastmailservice.net:s=20180828_2048]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[eyesbeyond.com]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[comcastmailservice.net:+]; RCVD_IN_DNSWL_NONE(0.00)[1.7.1.0.4.5.1.0.4.1.1.0.6.9.0.0.9.1.0.0.6.1.e.f.8.5.5.0.1.0.0.2.list.dnswl.org : 127.0.5.0]; HFILTER_HELO_5(3.00)[resqmta-po-12v.sys.comcast.net]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RECEIVED_SPAMHAUS_PBL(0.00)[181.127.16.24.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.10]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:7922, ipnet:2001:558::/29, country:US]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.24)[ipnet: 2001:558::/29(-0.50), asn: 7922(-0.66), country: US(-0.05)] X-BeenThere: freebsd-elastic@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Support of ElasticSearch-related ports <freebsd-elastic.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-elastic>, <mailto:freebsd-elastic-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-elastic/> List-Post: <mailto:freebsd-elastic@freebsd.org> List-Help: <mailto:freebsd-elastic-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-elastic>, <mailto:freebsd-elastic-request@freebsd.org?subject=subscribe> X-List-Received-Date: Sat, 22 Feb 2020 00:26:19 -0000 Sorry for the late response. IMO this shouldn't be an update but rather a new port named beats7. The current port should remain, but be renamed to beats6. This is the way all the other ELK ports are currently structured and having beats follow that pattern makes the most sense to me. -- Greg On Wed, Feb 12, 2020 at 07:18:39PM -0500, Paul Godard wrote: > Thanks for the feedback. I'm polishing up the port right now and will > submit a PR along with my poudriere testport logs shortly! > > Cheers, > Paul > > On Tue, Feb 11, 2020 at 5:49 PM Miroslav Lachman <000.fbsd@quip.cz> wrote: > > > Paul Godard wrote on 2020/02/11 23:35: > > > Hello maintainer(s)! > > > > > > I've been working on an update to the "beats" port for the past week or > > so. > > > I've upgraded it to version 7.5.2, and fixed a few things here and > > there. I > > > wanted to reach out to you as the maintainer(s) of the port to share my > > > work and/or understand why you might have kept the current port on > > version > > > 6.x. > > > > > > I've been mainly testing PacketBeat and MetricBeat (on FreeBSD 11.2 and > > > pfSense 2.4.4, which also happens to run FreeBSD 11.2), but also ensured > > > that HeartBeat and FileBeat are working. I've shared this development > > port > > > with a few other folks just to get better testing results (all of these > > > folks are testing this on pfSense 2.4.4 as well). Full disclosure, I > > > haven't had the time to test this properly on up-to-date builds of > > FreeBSD > > > such as 11.3 or 12.x (my goal is to run this on pfSense so I've been > > > focusing on FreeBSD 11.2 for that reason). I have compiled and packaged > > the > > > port on 11.3, but did not spend much time testing it other than ensuring > > > each beats application starts up and actually pushes data to ES. > > > > > > My high-level change log is as follows: > > > - Upgraded to 7.5.2 > > > - Fixed warnings at compile time (fixed bash to sh test conditions) > > > - Cleared up compile/package output (it was quite noisy, portlint doesn't > > > like this though) > > > - Fixed compile issue with PacketBeat (it's now compiling and working) > > > - Fixed packaged dashboards so that they can be installed using "setup > > > --dashboards" (depends on python 2.7 to achieve this during port > > building - > > > python isn't required to run packaged port however) > > > - Properly generate and include fields.yml for each beats in package > > > - Fixed memory and socket reporting in MetricBeats > > > - Updated all beats paths to regroup files as per Elastic's default > > > directory layout (but using the equivalent paths for FreeBSD) > > > - Changed default beats configs to remove unsupported processors (docker > > > and kubernetes) > > > > > > I'm still testing this port, but I feel like it's getting pretty close to > > > being ready for prime-time. I've posted my current SVN diff here if you > > > would like to take a peek at my changes: https://pastebin.com/PAQWpmKZ. > > > > > > Feel free to comment on my changes; I'm by no means an expert at these > > > ports (I'm learning though!). If you feel this is good enough to submit a > > > PR, let me know, I can take care of that once I'm comfortable with the > > > build. Or if you prefer to submit the PR with my SVN diff as the > > > maintainer(s), I have no problem with that either... > > > > Hello, > > > > first of all - I am not a maintainer. elastic@freebsd.org is a mailing > > list account and is supposed to be Elastic maintainers team but it is > > not much active. > > > > The best place to submit your patch for port upgrade is PR in bugzilla. > > > > Please submit it there: > > > > https://bugs.freebsd.org/bugzilla/enter_bug.cgi?product=Ports%20%26%20Packages&component=Individual%20Port%28s%29 > > > > If you tested it with poudriere testport attache log file too. > > > > I hope someone with commit bit will commit it soon. > > > > Thank you for your work in Beats upgrade to 7.5! > > > > Kind regards > > Miroslav Lachman > > -- Greg Lewis Email : glewis@eyesbeyond.com Eyes Beyond Web : http://www.eyesbeyond.com Information Technology FreeBSD : glewis@FreeBSD.org