Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 18 Oct 2002 19:48:53 -0700
From:      Mike Thompson <mike@atomz.com>
To:        Eric Anderson <anderson@centtech.com>
Cc:        freebsd-doc@freebsd.org
Subject:   Re: New search implementation
Message-ID:  <4.3.2.7.2.20021018190312.00a81360@pop.atomz.com>
In-Reply-To: <3DB0B805.AAE7C42F@centtech.com>
References:  <4.3.2.7.2.20021018174037.00af87e0@pop.atomz.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi Eric,

I actually hadn't read the threads related to using Atomz search on the 
FreeBSD.org web site until today.  Also, I wasn't aware that my emails to 
Michael Lucas were echoed to this email list.  I guess I should have 
guessed :-).  Hopefully I'm now caught up with regards to the thoughts and 
concerns around having Atomz Search be one of the search solutions for the 
FreeBSD.org web site.

In any case, I now see that you have a keen interest in search on the 
FreeBSD.org web site and I would certainly welcome your help since you 
certainly have a grasp of how to implement a search engine.  I'll create a 
login for you to the FreeBSD.org Atomz Search account so you can take a 
"look under the hood".  You should receive the email granting you access 
shortly.

I do want to say that it was never my intention to usurp your own work 
towards improving search on the FreeBSD.org web site.  I looked at your 
work at sprawler.com and feel what you have done so far is certainly a 
major step towards improving what the FreeBSD.org web site has today.  At 
Atomz we have used FreeBSD (starting with version 2.2.8) on most major 
systems at Atomz and we currently power search engines and content 
management with FreeBSD for more than 60,000 web sites around the world.  I 
thought it was about time we finally offered something back to the FreeBSD 
community that has clearly offered so much to Atomz and the search 
technology seemed like a good fit.  It is my full intention that 
FreeBSD.org web site can use the Atomz Search technology with no strings 
attached as long as Atomz and myself are around -- which hopefully will be 
a very long time indeed.

I look forward to working with you on improving search at FreBSD.org to the 
benefit of the entire FreeBSD community.

Mike Thompson


At 08:40 PM 10/18/02 -0500, Eric Anderson wrote:
>Since I've been doing lots of search stuff lately, I'd be willing to help with
>this in any way.  I'm not a committer (yet :D), but I don't think that's a
>requirement.  If the official @freebsd.org folks think it's alright, I'd be
>willing to peruse the logs and such to make sure things look right.  I'll also
>"babysit" this along with my own search efforts and make sure they all come
>together like they should if that sounds like a good thing.
>
>Comments anyone?
>
>Eric
>
>
>
>Mike Thompson wrote:
>
> > Hi everyone,
> >
> > As time permits I've been working on an Atomz Search implementation for the
> > FreeBSD.org web site.  As a co-founder of Atomz and someone who has really
> > benefited much from the FreeBSD project I thought it would be appropriate
> > to donate to the FreeBSD organization our search service which normally
> > sells for many $10,000's a year to large corporations.  Unfortunately, my
> > time is not a free as I would like, but the current results of my efforts
> > can be found at the following URL:
> >
> > http://www.atomz.com/freebsd/
> >
> > At this time I would like to start working with other people involved with
> > FreeBSD documentation project to help push this search project along.  Your
> > thoughts and comments are welcome, but some help would also be valuable.
> >
> > Some notes regarding what I have done so far are:
> >
> > 1. This is currently only for the FreeBSD.org English web pages.  It does
> > not include any of the foreign language portions of the site.  The foreign
> > language portions of the site would be relatively easy to implement, but I
> > would need help constructing search pages and templates from a native
> > speaker of the language.  Are there specific suggestions on what other
> > languages should be implemented and what would be the best way to go about
> > this?
> >
> > 2. The search implementation doesn't currently include the email list
> > archives.  With nearly a million messages to be indexed it will be a bit of
> > a project to implement.  I'll start looking into more into searching the
> > email archives once there is a general consensus that the basic search of
> > the other portions of the web site are looking pretty good.
> >
> > 3. The Atomz Search index will be updated nightly at 4 am PST.  This will
> > make sure that the index reflects any changes to the web site on a daily
> > basis.  The reindex time can be changed to another value if desired.
> >
> > 4. I'm open to hosting the search form at any location.  I placed it on our
> > www.atomz.com web site because the Atomz IT team makes sure that this site
> > stays up at all times and it can handle a pretty heavy traffic
> > loads.  However, we can move the search page to anywhere the FreeBSD
> > documentation team would like it.
> >
> > 5. I haven't spent a lot of time tweaking the Atomz Search options for the
> > site.  I would like to grant access to volunteers on the FreeBSD
> > documentation team access to the search account so that you can verify the
> > entire site is being properly indexed by looking at the crawl logs.  Also,
> > someone else may find options in Atomz Search that may be useful that I'm
> > currently overlooking.  I don't have a full understanding of how the
> > FreeBSD documentation project is organized.  Are there core people who
> > would be most appropriate for having access to the FreeBSD search engine or
> > is really a grass roots volunteer effort?
> >
> > 6. I'm open to any and all suggestions with regards to the search
> > implementation.  Atomz Search is a powerful search application and I would
> > bet we could handle most suggestions made about the search engine.
> >
> > I hope that the search engine continues to look interesting to the FreeBSD
> > documentation project.  I'm sorry I haven't been able to jump on this as
> > quickly as I had hoped, but like most other people having a day job in this
> > tough economy tends to take priority.
> >
> > Thanks,
> >
> > Mike Thompson
> > CTO/Co-Founder
> > Atomz Corp.
> > mike@atomz.com
> >
> > To Unsubscribe: send mail to majordomo@FreeBSD.org
> > with "unsubscribe freebsd-doc" in the body of the message


To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-doc" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4.3.2.7.2.20021018190312.00a81360>