From owner-freebsd-elastic@freebsd.org Tue Nov 24 20:54:58 2020 Return-Path: Delivered-To: freebsd-elastic@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 208B84699E4 for ; Tue, 24 Nov 2020 20:54:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4Cgbr20FVZz3HV8 for ; Tue, 24 Nov 2020 20:54:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 086E9469BAD; Tue, 24 Nov 2020 20:54:58 +0000 (UTC) Delivered-To: elastic@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 08306469AD8 for ; Tue, 24 Nov 2020 20:54:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Cgbr16gljz3HXN for ; Tue, 24 Nov 2020 20:54:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id D82EC25478 for ; Tue, 24 Nov 2020 20:54:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0AOKsvA0026967 for ; Tue, 24 Nov 2020 20:54:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0AOKsv2R026966 for elastic@FreeBSD.org; Tue, 24 Nov 2020 20:54:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" From: bugzilla-noreply@freebsd.org To: elastic@FreeBSD.org Subject: maintainer-feedback requested: [Bug 251352] textproc/elasticsearch7: Update to 7.10.0 Date: Tue, 24 Nov 2020 20:54:58 +0000 X-Bugzilla-Type: request X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: elastic@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? Message-ID: In-Reply-To: References: X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-elastic@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Support of ElasticSearch-related ports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Nov 2020 20:54:58 -0000 Bugzilla Automation has asked freebsd-elastic (Nobod= y) for maintainer-feedback: Bug 251352: textproc/elasticsearch7: Update to 7.10.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D251352 --- Description --- Hi, please find the patch attached. Breaking changes Authentication * API key name should always be required for creation Network * Set specific keepalive options by default on supported platforms Breaking Java changes Machine Learning * Deprecate allow_no_jobs and allow_no_datafeeds in favor of allow_no_match Mapping * Pass SearchLookup supplier through to fielddataBuilder Deprecations Cluster Coordination * Deprecate and ignore join timeout Machine learning * Renames */inference* APIs to */trained_models* New features Aggregations * Add rate aggregation Features/Features * Add data tiers (hot, warm, cold, frozen) as custom node roles * Allocate newly created indices on data_hot tier nodes Features/ILM+SLM * ILM migrate data between tiers * ILM: add force-merge step to searchable snapshots action (issues: , Machine Learning * Implement AucRoc metric for classification Mapping * Introduce 64-bit unsigned long field type Search * Add search fields option to support high-level field retrieval (issues: , Enhancements Aggregations * Adds hard_bounds to histogram aggregations * Allocate slightly less per bucket * Improve reduction of terms aggregations * Speed up date_histogram by precomputing ranges Analysis * Support ignore_keywords flag for word delimiter graph token filter Authentication * Cache API key doc to reduce traffic to the security index (issues: , * Include authentication type for the authenticate response * Oidc additional client auth types * Warn about unlicensed realms if no auth token can be extracted Authorization * Add DEBUG logging for undefined role mapping field * Add more context to index access denied errors CRUD * Add configured indexing memory limit to node stats * Dedicated threadpool for system index writes Cluster Coordination * Add more useful toString on cluster state observers * Fail invalid incremental cluster state writes * Provide option to allow writes when master is down Distributed * Detect noop of update index settings * Thread safe clean up of LocalNodeModeListeners Features/CAT APIs * Adding Hit counts and Miss counts for QueryCache exposed through REST API Features/Features * Add aggregation list to node info * Adding new require_alias option to indexing requests Features/ILM+SLM * Move internal index templates to composable templates Features/Ingest * Add network from MaxMind Geo ASN database * Allow_duplicates option for append processor * Configurable output format for date processor * Enhance the ingest node simulate verbose output * Per processor description for verbose simulate * Preserve grok pattern ordering and add sort option Features/Java High Level REST Client * HLRC: UpdateByQuery API with wait_for_completion being false (issues: , Infra/Core * Add logstash system index APIs * Deprecate REST access to System Indices * Speed up Compression Logic by Pooling Resources * System index reads in separate threadpool (issues: , Infra/Logging * Do not create two loggers for DeprecationLogger * Header warning logging refactoring (issues: , * Write deprecation logs to a data stream (issues: , Infra/Packaging * Add UBI docker builds * Upgrade Centos version in Dockerfile to 8 Infra/Resiliency * Remove node from cluster when node locks broken (issues: , Infra/Scripting * Augment String with sha1 and sha256 * Converts casting and def support Machine Learning * Add a "verbose" option to the data frame analytics stats endpoint * Add new include flag to get trained models API for model training metadata * Add new feature_processors field for data frame analytics * Add new n_gram_encoding custom processor * During nightly maintenance delete jobs whose original deletion tasks were lost * Suspend persistence of trained model stats when ML upgrade mode is enabled * Calculate total feature importance to store with model metadata * Change outlier detection feature_influence format to array with nested objects , * Add timeouts to named pipe connections , Mapping * Add field type for version strings * Allow [null] values in [null_value] (issues: , * Allow metadata fields in the _source Network * Improve deserialization failure logging * Log and track open/close of transport connections Performance * Speed up empty highlighting many fields SQL * Add option to provide the delimiter for the CSV format * Implement DATE_PARSE function for parsing strings into DATE values * Implement FORMAT function Search * Avoid reloading _source for every inner hit * Cancel multisearch when http connection closed * Enable cancellation for msearch requests * Executes incremental reduce in the search thread pool (issues: , * Introduce point in time APIs in x-pack basic (issues: , * ParametrizedFieldMapper to run validators against default value * Add case insensitive flag for "term" family of queries * Add case insensitive support for regex queries * Tweak toXContent implementation of ParametrizedFieldMapper * Implement fields value fetching for the text, search_as_you_type and token_count field types * Make term/prefix/wildcard/regex query parsing more lenient, with respect to the case_insensitive flag Snapshot/Restore * Add repositories metering API * Clone Snapshot API * Determine shard size before allocating shards recovering from snapshots * Introduce index based snapshot blob cache for Searchable Snapshots * Validate snapshot UUID during restore Store * Report more details of unobtainable ShardLock Transform * Add support for missing bucket (issues: , Bug fixes Aggregations * Fix AOOBE when setting min_doc_count to 0 in significant_terms (issues: , * Make sure non-collecting aggs include sub-aggs * Composite aggregation must check live docs when the index is sorted * Fix broken parent and child aggregator Allocation * Fix scheduling of ClusterInfoService#refresh Authorization * Fix doc-update interceptor for indices with DLS and FLS * Report anonymous roles in authenticate response (issues: , , , * Add view_index_metadata privilege over metricbeat-* for monitoring agent CRUD * Propagate forceExecution when acquiring permit Cluster Coordination * Reduce allocations when persisting cluster state Distributed * Fix cluster health rest api wait_for_no_initializing_shards bug * Fix cluster health when closing Engine * Fix estimate size of translog operations Features/ILM+SLM * Fix ILM history index settings (issues: , * Ensure cancelled SLM jobs do not continue to run Features/Java Low Level REST Client * Handle non-default port in Cloud-Id Features/Stats * Remove sporadic min/max usage estimates from stats Features/Watcher * Correct the query dsl for watching elasticsearch version * Fix passing params to template or script failed in watcher Geo * Fix wrong NaN comparison Infra/Core * Throws IndexNotFoundException in TransportGetAction for unknown System indices * Handle missing logstash index exceptions * XPack Usage API should run on MANAGEMENT threads Infra/Packaging * Allow running the Docker image with a non-default group * Set the systemd initial timeout to 75 seconds Machine Learning * Adjusting inference processor to support foreach usage * Get data frame analytics jobs stats API can return multiple responses if more than one error * Do not mark the data frame analytics job as FAILED when a failure occurs after the node is shutdown * Improve handling of exception while starting data frame analytics process * Fix progress on resume after final training has completed for classification and regression. Previously, progress was shown stuck at zero for final training. * Avoid potential "Failed to compute quantile" and "No values added to quantile sketch" log errors training regression and classification models if there are features with mostly missing values * Correct the anomaly detection job model state min_version Mapping * Improve ignore_malformed handling for dates Network * Let isInetAddress utility understand the scope ID on ipv6 * Suppress noisy SSL exceptions Search * Allows nanosecond resolution in search_after * Consolidate validation for docvalue_fields * Correct how field retrieval handles multifields and copy_to * Apply boost only once for distance_feature query * Fixed NullPointerException in significant_text aggregation when field does not exist * Fix async search to retry updates on version conflict * Fix sorted query when date_nanos is used as the numeric_type Snapshot/Restore * Avoid listener call under SparseFileTracker#mutex * Ensure repo not in use for wildcard repo deletes * Fix Test Failure in testCorrectCountsForDoneShards * Minimize cache file locking during prewarming * Prevent snapshots to be mounted as system indices * Make Searchable Snapshot's CacheFile Lock less * Don't Generate an Index Setting History UUID unless it's supported SQL * Allow unescaped wildcard (*) in LIKE pattern * Validate integer paramete in string functions * Remove filter from field_caps requests Upgrades Infra/Packaging * Upgrade bundled JDK to 15.0.1 and switch to AdoptOpenJDK Store * Upgrade to Lucene-8.7.0 testport on 11.4, 12.1, 12.2 OK