Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 11 Jul 2021 10:38:39 -0400
From:      Vlad Markov <dvoich@optonline.net>
To:        freebsd-questions@freebsd.org
Subject:   Re: Analyzing Log files of very large size
Message-ID:  <20210711103839.61dfd4baafa38984f208b707@optonline.net>
In-Reply-To: <CAKgGyB_reF4eqz4pvQj7tFsOQEEB3WrFZa-91L%2BNChm=85h0-A@mail.gmail.com>
References:  <CAKgGyB_TJrLWSjcnc9491Gg0Q5CLqLdmWx2yga_Ez7-gE6YcKQ@mail.gmail.com> <E9C00664-DAC7-4F58-BCCA-CDD2654C9325@febras.net> <CAKgGyB_reF4eqz4pvQj7tFsOQEEB3WrFZa-91L%2BNChm=85h0-A@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Sun, 11 Jul 2021 19:43:41 +0530
KK CHN <kkchn.in@gmail.com> wrote:

> Yes, it is.
> 
> On Sun, Jul 11, 2021 at 6:02 PM Korolev Sergey <serejk@febras.net> wrote:
> 
> > Is it a plain text file?
> >
> > On 11 Jul 2021, at 22:13, KK CHN <kkchn.in@gmail.com> wrote:
> >
> > List,
> >
> > I am in a requirement to analyze large log files of sonic wall firewall
> > around 50 GB. for a suspect attack.
> >
> > What tools and solutions need to be deployed for handling this much large
> > files and pls enlighten me with your expertise and reference materials if
> > any.
> >
> > All are tcp / ip communications, DNS UDP transports ..
> >
> > Regards,
> > Kris
I used to use split to break up large log files into manageable pieces. From there it depends on how you work. At first we used grep then we moved on to using perl regex to analyze logs.

Vlad



-- 




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20210711103839.61dfd4baafa38984f208b707>