I use a host which allows Add On Domains. I can use my webspace to host more than one website. Here's an example of what I am trying to do.

The first site I hosted on my webspace was called 123.com

When I add on another domain (456.com) this is created as a subfolder in the root directory of 123.com

Both work fine. The urls would direct you to the correct pages. What I want to ensure is that you cannot access pages with a url 123.com/456

As "456" is a subfolder of "123" it must appear to search engines to be BOTH two separate sites and that their is a folder called "456" in the site 123.com

How can I ensure that a Search Engine which is spidering my website cannot see the path 123.com/456?

I know a robots.txt will help to guide the robot, but I am looking for a cast iron way to ENSURE that 123.com/456 is not accessible.

Any help/suggestions appreciated.

Alan Roberts, August 2005

Hi, the only thing I can think of myself is if you make the 456 domain point to a 456 sub domain, so the 456 info would be found at something like http://456.123.com with the 456 domain pointing at this address.

LeonStacey.co.uk, April 2006