From owner-freebsd-elastic@freebsd.org Wed Mar 14 22:50:59 2018 Return-Path: Delivered-To: freebsd-elastic@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A8F60F4F904 for ; Wed, 14 Mar 2018 22:50:59 +0000 (UTC) (envelope-from feld@FreeBSD.org) Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com [66.111.4.25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5CAC07B1E3 for ; Wed, 14 Mar 2018 22:50:59 +0000 (UTC) (envelope-from feld@FreeBSD.org) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id B4C1A20CD2 for ; Wed, 14 Mar 2018 18:50:58 -0400 (EDT) Received: from web4 ([10.202.2.214]) by compute3.internal (MEProxy); Wed, 14 Mar 2018 18:50:58 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=kIeX8d UOR77QTpWH0cDbWrXU7SHA5GyfKPDhecJZirU=; b=b+wHnIFzd3uqN5AaekCaFN YTLFOsGEQyZYJyyzofmUhOB4q0UFbt+ucBcQF6mgUBnUWuXUhDCitSTjtXwGaz6u iP9IzcfqFiSElAunS5vfsRenYlbRubE99Wo+XNXoqPTz0I2MaCKwbu33oZoXyrUn s5YDRUoBcxNPgpoD27YnYN3cVFGYg0NGyykM+py7SPnW4L30jC4dJ1vXdrP4Qz8Y Vg2aEkYY1G+PHqkDF5YrbKNhycTmfDiJyaClzjPbLlGSwVSE4pgBGrt/FA88ES07 grD+hn+AdsB62o60F4Lv1/WBlFrlZiVxtG1EFXBO/s8MFC9W3PWjHhOnKOy2DWPg == X-ME-Sender: Received: by mailuser.nyi.internal (Postfix, from userid 99) id 95949BA43B; Wed, 14 Mar 2018 18:50:58 -0400 (EDT) Message-Id: <1521067858.2552269.1303508064.7EF8BB55@webmail.messagingengine.com> From: Mark Felder To: freebsd-elastic@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" X-Mailer: MessagingEngine.com Webmail Interface - ajax-54087d22 Subject: Re: Logstash 6.x plugins installation and updates In-Reply-To: Date: Wed, 14 Mar 2018 17:50:58 -0500 References: <1520368236.790950.1293860088.315C1855@webmail.messagingengine.com> X-BeenThere: freebsd-elastic@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Support of ElasticSearch-related ports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Mar 2018 22:50:59 -0000 On Tue, Mar 6, 2018, at 18:17, news via freebsd-elastic wrote: > On Tue, 06 Mar 2018 22:30:36 +0200, Mark Felder wrote: >=20 > > > > > > On Mon, Mar 5, 2018, at 11:03, news via freebsd-elastic wrote: > >> > >> the expr error is probably a syntax error because it's trying to use g= nu > >> expr and not the one we have on FreeBSD. > >> This seems to work now. I found and fixed the expr error. Not a GNU extensi= on -- just an error in jruby which has been fixed upstream, but logstash do= esn't bundle a version with this fixed. The update issue was an upstream bu= g which I've patched for us as well. root@elk:/usr/local/logstash # ./bin/logstash-plugin install x-pack Downloading file: https://artifacts.elastic.co/downloads/logstash-plugins/x= -pack/x-pack-6.2.2.zip Downloading [=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D] 100% Installing file: /tmp/studtmp-5dd043f3e10e926cdabe34b8c1870b8ea4c9f0b191590= 08f6b8c8ee90083/x-pack-6.2.2.zip Install successful root@elk:/usr/local/logstash # ./bin/logstash-plugin update Updating logstash-codec-cef, logstash-codec-collectd, logstash-codec-dots, = logstash-codec-edn, logstash-codec-edn_lines, logstash-codec-es_bulk, logst= ash-codec-fluent, logstash-codec-graphite, logstash-codec-json, logstash-co= dec-json_lines, logstash-codec-line, logstash-codec-msgpack, logstash-codec= -multiline, logstash-codec-netflow, logstash-codec-plain, logstash-codec-ru= bydebug, logstash-filter-aggregate, logstash-filter-anonymize, logstash-fil= ter-cidr, logstash-filter-clone, logstash-filter-csv, logstash-filter-date,= logstash-filter-de_dot, logstash-filter-dissect, logstash-filter-dns, logs= tash-filter-drop, logstash-filter-elasticsearch, logstash-filter-fingerprin= t, logstash-filter-geoip, logstash-filter-grok, logstash-filter-jdbc_static= , logstash-filter-jdbc_streaming, logstash-filter-json, logstash-filter-kv,= logstash-filter-metrics, logstash-filter-mutate, logstash-filter-ruby, log= stash-filter-sleep, logstash-filter-split, logstash-filter-syslog_pri, logs= tash-filter-throttle, logstash-filter-translate, logstash-filter-truncate, = logstash-filter-urldecode, logstash-filter-useragent, logstash-filter-xml, = logstash-input-beats, logstash-input-dead_letter_queue, logstash-input-elas= ticsearch, logstash-input-exec, logstash-input-file, logstash-input-ganglia= , logstash-input-gelf, logstash-input-generator, logstash-input-graphite, l= ogstash-input-heartbeat, logstash-input-http, logstash-input-http_poller, l= ogstash-input-imap, logstash-input-jdbc, logstash-input-kafka, logstash-inp= ut-pipe, logstash-input-rabbitmq, logstash-input-redis, logstash-input-s3, = logstash-input-snmptrap, logstash-input-sqs, logstash-input-stdin, logstash= -input-syslog, logstash-input-tcp, logstash-input-twitter, logstash-input-u= dp, logstash-input-unix, logstash-output-cloudwatch, logstash-output-csv, l= ogstash-output-elasticsearch, logstash-output-email, logstash-output-file, = logstash-output-graphite, logstash-output-http, logstash-output-kafka, logs= tash-output-lumberjack, logstash-output-nagios, logstash-output-null, logst= ash-output-pagerduty, logstash-output-pipe, logstash-output-rabbitmq, logst= ash-output-redis, logstash-output-s3, logstash-output-sns, logstash-output-= sqs, logstash-output-stdout, logstash-output-tcp, logstash-output-udp, logs= tash-output-webhdfs, x-pack Updated logstash-codec-fluent 3.1.5 to 3.2.0 Updated logstash-codec-netflow 3.11.0 to 3.11.2 Updated logstash-filter-dns 3.0.7 to 3.0.8 Updated logstash-filter-grok 4.0.2 to 4.0.3 Updated logstash-filter-kv 4.0.3 to 4.1.0 Updated logstash-filter-mutate 3.2.0 to 3.3.1 Updated logstash-input-beats 5.0.6 to 5.0.11 Updated logstash-input-exec 3.1.5 to 3.2.0 Updated logstash-input-jdbc 4.3.3 to 4.3.5 Updated logstash-input-syslog 3.2.4 to 3.4.0 Updated logstash-input-tcp 5.0.3 to 5.0.4 Updated logstash-output-elasticsearch 9.0.2 to 9.0.3 So at this point I think it's safe to say that Logstash on FreeBSD has fewe= r bugs than on their "supported" platforms. *smirk* Next up: backporting these fixes to elastic/kibana/logstash 5.x --=20 Mark Felder ports-secteam & portmgr member feld@FreeBSD.org