From owner-freebsd-elastic@freebsd.org Tue Feb 11 22:36:13 2020 Return-Path: Delivered-To: freebsd-elastic@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C2C222459C6 for ; Tue, 11 Feb 2020 22:36:13 +0000 (UTC) (envelope-from paulgodard@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48HHgK3vrHz4lXH for ; Tue, 11 Feb 2020 22:36:13 +0000 (UTC) (envelope-from paulgodard@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 8412C2459C5; Tue, 11 Feb 2020 22:36:13 +0000 (UTC) Delivered-To: elastic@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 83D202459C4 for ; Tue, 11 Feb 2020 22:36:13 +0000 (UTC) (envelope-from paulgodard@gmail.com) Received: from mail-il1-x12a.google.com (mail-il1-x12a.google.com [IPv6:2607:f8b0:4864:20::12a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48HHgJ4Gskz4lXG for ; Tue, 11 Feb 2020 22:36:12 +0000 (UTC) (envelope-from paulgodard@gmail.com) Received: by mail-il1-x12a.google.com with SMTP id x2so4914671ila.9 for ; Tue, 11 Feb 2020 14:36:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=Sr3oO4Qd2DAHA1Mo9/STgUkyUPDpyNbUbOyEnd7ROjM=; b=vM3et7m6KxqIQl1Ga7MJzRi/2aJ2jofW6xI76NxXRvdWGHT9SDXVfuBvCoHVZdY7wF ugK9eVDomKDxBUq9wEb9/BWrG4hL8O80Y/ghdaFSa8ntrJLBFdkRCi/GlsY5U9LUuRzh 7IVtHB5oL2SCv7AFanmhLLfGfNJDvBm+FmJkM6DVRgMk1FSeHpKT2RQiuKvBYXXyJD6E ylJ7xS/Totut6qGwQg5h5mj8bUrdl2r5wCenp1gLiQEmCfE8gfVW/hWemhj3iai3T1Ng +P8hloX+6bStSwPcie1GnHOIdldwHzOrnUS5ig7pC07GcpBfMRs0OS63ZbUTmog6qnSU rQjg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Sr3oO4Qd2DAHA1Mo9/STgUkyUPDpyNbUbOyEnd7ROjM=; b=FI7O2+JaQJLSJO6uRyQ6OqPCPoF8u4O3M/JkNwHgD9JCYwyCLjWn8HiMZ+/6PX33uf q11UA5mgOzj1PMtYu9NJHICwZaaRlsAuXJCFnXXKFwcdO4zdMRR4ka22hvRKFsrR4WKN tRAdWxDQHJ5PaKO0Nx1tGafhsBLQRktRB+rY901G4fGW6k5oa0s/hGNJ3PP/ZUZgc6YM 41paZZ5dCeQy8n95qo5LOF9ZWIKtm7jQ6pZ1JtFZy1EX5DTRTWe6qpDXcM1WdVaHOkEx TrPcFkEfV4WVitjIB6dvSCZSlvuEOFO/SxDBoAxArsy1r76ewXqCNngIw9oPm2tbxEUX bNPA== X-Gm-Message-State: APjAAAUa6/265X3lZJLZEC9x362B34US0xi79HXAg+DkKBl78V7kEdVb EfaL0Xwn4GyT1mCjZ0uXlrF0ASy5To161RGzac5L6JG7 X-Google-Smtp-Source: APXvYqyXcwxyXhGisUuCo+NZmil/ZDv87h2+6fkORVCx8eXzqdcNX3kqxb7PS+sQDNvBMi8Q6ioysAdm9GAppfdU+0Y= X-Received: by 2002:a92:c50f:: with SMTP id r15mr8654365ilg.258.1581460570585; Tue, 11 Feb 2020 14:36:10 -0800 (PST) MIME-Version: 1.0 From: Paul Godard Date: Tue, 11 Feb 2020 17:35:59 -0500 Message-ID: Subject: Beats port update - 7.5.2 To: elastic@freebsd.org X-Rspamd-Queue-Id: 48HHgJ4Gskz4lXG X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=vM3et7m6; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of paulgodard@gmail.com designates 2607:f8b0:4864:20::12a as permitted sender) smtp.mailfrom=paulgodard@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[elastic@freebsd.org]; TO_DN_NONE(0.00)[]; IP_SCORE_FREEMAIL(0.00)[]; URI_COUNT_ODD(1.00)[3]; RCPT_COUNT_ONE(0.00)[1]; IP_SCORE(0.00)[ip: (-8.64), ipnet: 2607:f8b0::/32(-1.94), asn: 15169(-1.71), country: US(-0.05)]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[a.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-elastic@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Support of ElasticSearch-related ports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Feb 2020 22:36:13 -0000 Hello maintainer(s)! I've been working on an update to the "beats" port for the past week or so. I've upgraded it to version 7.5.2, and fixed a few things here and there. I wanted to reach out to you as the maintainer(s) of the port to share my work and/or understand why you might have kept the current port on version 6.x. I've been mainly testing PacketBeat and MetricBeat (on FreeBSD 11.2 and pfSense 2.4.4, which also happens to run FreeBSD 11.2), but also ensured that HeartBeat and FileBeat are working. I've shared this development port with a few other folks just to get better testing results (all of these folks are testing this on pfSense 2.4.4 as well). Full disclosure, I haven't had the time to test this properly on up-to-date builds of FreeBSD such as 11.3 or 12.x (my goal is to run this on pfSense so I've been focusing on FreeBSD 11.2 for that reason). I have compiled and packaged the port on 11.3, but did not spend much time testing it other than ensuring each beats application starts up and actually pushes data to ES. My high-level change log is as follows: - Upgraded to 7.5.2 - Fixed warnings at compile time (fixed bash to sh test conditions) - Cleared up compile/package output (it was quite noisy, portlint doesn't like this though) - Fixed compile issue with PacketBeat (it's now compiling and working) - Fixed packaged dashboards so that they can be installed using "setup --dashboards" (depends on python 2.7 to achieve this during port building - python isn't required to run packaged port however) - Properly generate and include fields.yml for each beats in package - Fixed memory and socket reporting in MetricBeats - Updated all beats paths to regroup files as per Elastic's default directory layout (but using the equivalent paths for FreeBSD) - Changed default beats configs to remove unsupported processors (docker and kubernetes) I'm still testing this port, but I feel like it's getting pretty close to being ready for prime-time. I've posted my current SVN diff here if you would like to take a peek at my changes: https://pastebin.com/PAQWpmKZ. Feel free to comment on my changes; I'm by no means an expert at these ports (I'm learning though!). If you feel this is good enough to submit a PR, let me know, I can take care of that once I'm comfortable with the build. Or if you prefer to submit the PR with my SVN diff as the maintainer(s), I have no problem with that either... Cheers, Paul