Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 4 Mar 2001 22:54:38 +0100
From:      Wolfram Schneider <wosch@panke.de.freebsd.org>
To:        Nik Clayton <nik@FreeBSD.ORG>
Cc:        Jun Kuriyama <kuriyama@imgsrc.co.jp>, doc@FreeBSD.ORG
Subject:   Re: cvs commit: www/en Makefile
Message-ID:  <20010304225438.B1647@paula.panke.de.freebsd.org>
In-Reply-To: <20010301145623.A3225@canyon.nothing-going-on.org>; from nik@FreeBSD.ORG on Thu, Mar 01, 2001 at 02:56:23PM %2B0000
References:  <200102241031.f1OAVTZ82598@freefall.freebsd.org> <20010225064044.A68105@canyon.nothing-going-on.org> <20010227122027.A2079@paula.panke.de.freebsd.org> <7mwva9y48r.wl@waterblue.imgsrc.co.jp> <20010301145623.A3225@canyon.nothing-going-on.org>

next in thread | previous in thread | raw e-mail | index | archive | help
On 2001-03-01 14:56:23 +0000, Nik Clayton wrote:
> On Thu, Mar 01, 2001 at 11:04:52PM +0900, Jun Kuriyama wrote:
> > At Tue, 27 Feb 2001 12:20:27 +0100,
> > Wolfram Schneider wrote:
> > > This is confusing and not acceptable. A page which can
> > > be read on a web server will be read (Murphys Law). This will
> > > increase the robots load by several ten-thousend page views per day!
> > > In general, never use symlinks to directories on a web server.
> > 
> > I support Wolfram about this.  We should avoid symlinks as much as we
> > can.  This breaks search engine's result by returning same contents
> > with multiple URLs.
> 
> Way, way, way too late:
> 
>     http://www.freebsd.org/news/
>     http://www.freebsd.org/news/index.html
>     http://www.freebsd.org/news/news.html
> 
> and other examples (commercial/, copyright/, docproj/, gallery/,
> internal/, projects/, search/, security/).

This are symlinks to *FILES*. This is harmless. If we have 20
symlinks to files, and 20 robots per day, this would be 
additional 400 HTTP hits.

Search engines knowns how to deal with directory listings
(/news/ <-> /news.index.html) This is a common case.

A symlink to a directory is in practice a recursivly copy of
the directory and duplicate the contents. One symlink may
add serveral hundreds or thousands new files to the server!

-Wolfram

-- 
Wolfram Schneider <wosch@freebsd.org> http://wolfram.schneider.org

To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-doc" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20010304225438.B1647>