From owner-freebsd-ports@freebsd.org Wed May 23 15:23:58 2018 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5B847F0C31F for ; Wed, 23 May 2018 15:23:58 +0000 (UTC) (envelope-from kpnemesis@gmail.com) Received: from mail-wm0-x22e.google.com (mail-wm0-x22e.google.com [IPv6:2a00:1450:400c:c09::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C90216FAC6 for ; Wed, 23 May 2018 15:23:57 +0000 (UTC) (envelope-from kpnemesis@gmail.com) Received: by mail-wm0-x22e.google.com with SMTP id t11-v6so10177330wmt.0 for ; Wed, 23 May 2018 08:23:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=zXOor2eJwg3bzvoyufgRkJkJHEuRclIArD3PLRJv+iI=; b=aYmmtUzoYGDXxUF5qEvpqjsXhp7cH+fcgxoc8q0rZp+gJcA9f9bJUB0yCbXXJcWhZO TyqYul4wUQmLZtxUMZkn+8qkVe2RinwKD7PIxFtIelsmLabLwg/3nmz1n6u03rpYb37T UcJ7dIgRS8u+6xzMphTHdtaqNtoF++sMEHOu6/VIC/tvoO5GGLOPKcUVvkveHH1jtdBl DScw/6NM0IpIHtlO3vOxniexKfa4XUzjoieqp0Is7GtJBthTHnrRD10WyyOhd8hqHg72 qmKrG+v8Yti+iFrHvLhIJlVHg9EgHd51Ziv/JyrJ+8fiM/+dGztGQRCWjTeWohsqfVLB g4Fw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=zXOor2eJwg3bzvoyufgRkJkJHEuRclIArD3PLRJv+iI=; b=qRQHHKvc+BELlirexGRmTxVeBB0OpAg+9kTFzbVcVJRs2FAbafF9mXbCThPlIg8JZl WrnrtRV274eq61penqHAINmF7AVK2KttnvIWSDCfCRanVKFyz0X/JbI2r1srVgJhVjV/ 8mIXRDjGWeIhcRILMc/blMI3yhGyfHJrb6A1zuYOLpLQH8BlBazuCEKbdgkIVnOBz9oR E/trlIuAFKsPpJEgWVtWLwhy4XqJiigziDxFnlHraEd390ofEriB2F8jlBGEqWP9tpjk s/oNF41hlOspGeJfHOE6Zm0HJDGfKvRLgoltDlmE7ZoKT4uYoHuKO22rnp2PYJ3i/HzM L0YA== X-Gm-Message-State: ALKqPwfz9wsX+cm8e0W0DV6grxb3/r6M1GI/hDP6zJwIWAebxx0wHZlf odd0MtLd3DNBzAIfRPV566YxWVMr6GnsabtUwW8= X-Google-Smtp-Source: AB8JxZqXQy8aaPuJG47RtYWonHqi9GN8ZwQBxSxRFrTkQnZd9TWESZEkXX+n9FvhFI6c6TqjsC1YkozXXFpj6xeDOWA= X-Received: by 2002:a50:f695:: with SMTP id d21-v6mr7570820edn.142.1527089036680; Wed, 23 May 2018 08:23:56 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a50:f114:0:0:0:0:0 with HTTP; Wed, 23 May 2018 08:23:36 -0700 (PDT) From: Kernel Panic Date: Wed, 23 May 2018 16:23:36 +0100 Message-ID: Subject: Logstash failing to process messages To: freebsd-ports@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.26 X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 May 2018 15:23:58 -0000 Hello, I'll just list the versions before I start: FreeBSD 11.1 Logstash 6.23 Elasticsearch 5.6.8 Kibana 5.6.8 The issue I'm having is that after a few days Logstash will stop processing any messages; I'm using the same config file that I used with Logstash 5.3.0 which worked without issue and was rock-solid. There's nothing in the Logstash log file apart from messages about a field in my Cisco logs being the wrong type and therefore failing to index, however this has always been the case. I have tried enabling the 'dead letter' feature in Logstash to process these Cisco logs but that just makes Logstash even more unstable. The Logstash service doesn't actually crash, it just stops processing messages and fails to respond to the restart command so I end up having to reboot the server. I should say though that Logstash continues to respond the the monitor API commands. I have tried updating all Logstash plugins however that has not fixed the issue. As I said, I never had any problems with Logstash 5.3.0 but the latest version (and version 5.6.8) just seem to become unstable after a few days. Any help is greatly appreciated.