Date: Fri, 07 Apr 2017 21:34:17 -0400 From: Ernie Luzar <luzar722@gmail.com> To: Karl Young <karly@kipshouse.org> Cc: Tomasz Rola <rtomek@ceti.pl>, freebsd-questions@freebsd.org Subject: Re: Is there a database built into the base system Message-ID: <58E83E19.8010709@gmail.com> In-Reply-To: <20170407210629.GR2787@mailboy.kipshouse.net> References: <58E696BD.6050503@gmail.com> <69607026-F68C-4D9D-A826-3EFE9ECE12AB@mac.com> <58E69E59.6020108@gmail.com> <20170406210516.c63644064eb99f7b60dbd8f4@sohara.org> <58E6AFC0.2080404@gmail.com> <20170407001101.GA5885@tau1.ceti.pl> <20170407210629.GR2787@mailboy.kipshouse.net>
next in thread | previous in thread | raw e-mail | index | archive | help
Karl Young wrote: > Tomasz Rola(rtomek@ceti.pl)@2017.04.07 02:11:01 +0200: >> On Thu, Apr 06, 2017 at 05:14:40PM -0400, Ernie Luzar wrote: >> [...] >>> inbound source ip address hits my front door. Have 3 flat text files >>> containing about 2000 ip address having a record size of 30 bytes. >>> I am afraid I may be approaching the max file size that csh can handle. >>> Thinking of simple db where the 3 files are indexed and can be >>> read/written with out sequentially process all the records. At the >>> proof of concept stage. >> If I had problem processing 2000 records (or 60 kilobytes) on a >> machine less than 20 years old, I would definitely rethink my >> strategy/algorithm. >> >>> I have programmed in pear script before where I can open a file and >>> process a record sequentially where only the next record is >>> buffered. csh does not have that kind of file handling that I know >>> of.ave never used it because >>> >>> You have any suggestions? >> I understand you need to run this under base system (because you want >> no ports). I guess you need to do "man awk" - it seems to be the only >> language capable enough in such environment. Albeit if you are >> masochist, you can stay with csh or learn sh (and sort, cut and few >> other things). >> > > Ah, I thought there was perl and python in base system. If not, then I > second the awk recommendation. Awk is powerful enough, and should be > fast enough for what OP has described. > > But I wouldn't suggest to learn awk from man page. "The Awk Programming > Language", written by the inventors of Awk, is a lovely book and even has > a whole chapter on databases. > > And, it's available for free. > > https://archive.org/stream/pdfy-MgN0H1joIoDVoIC7/The_AWK_Programming_Language_djvu.txt > As the op I have been reading all the replies. I know that awk exists, but never used it because the man page is so hard to understand. I like this manual but this online version is hard to navigate. Does any one know if there is a pdf version available for download?
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?58E83E19.8010709>