|
Home > Archive > Commerce Server General > May 2005 > Allowing spiders to crawl site without cookies
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
Allowing spiders to crawl site without cookies
|
|
|
| The site I manage has cookie authentication. I'm looking for a way to allow
spiders into the site bypassing the cookie test that would send a typical
client to a cookies required page.
If anyone has done this or knows of a resouce that speaks to this I sure
could use the help to assist me in tackling this issue.
| |
| WenJun Zhang[msft] 2005-04-30, 7:54 am |
| Hi,
If you are using AuthManager instead of AuthFilter, this is not
required and cookieless authentication is supported. Please look at:
http://msdn.microsoft.com/library/d...ary/en-us/csvr2
002/htm/cs_se_authentication_kirz.asp
Thanks.
Best regards,
WenJun Zhang
Microsoft Online Partner Support
This posting is provided "AS IS" with no warranties, and confers no
rights.
| |
|
| Cookies are needed to conduct commerce on our site. What I'm looking for is a
method of excluding search engine spiders from this requirement while
requiring cookies for clients.
Is this even feasable using CS?
""WenJun Zhang[msft]"" wrote:
> Hi,
>
> If you are using AuthManager instead of AuthFilter, this is not
> required and cookieless authentication is supported. Please look at:
>
> http://msdn.microsoft.com/library/d...ary/en-us/csvr2
> 002/htm/cs_se_authentication_kirz.asp
>
> Thanks.
>
> Best regards,
>
> WenJun Zhang
> Microsoft Online Partner Support
>
> This posting is provided "AS IS" with no warranties, and confers no
> rights
| |
| WenJun Zhang[msft] 2005-05-03, 7:51 am |
| For controling search engine spiders' behavior, please refer to the
following FAQ about robots.txt.
The Web Robots FAQ...
http://www.robotstxt.org/wc/faq.html
Best regards,
WenJun Zhang
Microsoft Online Partner Support
This posting is provided "AS IS" with no warranties, and confers no
rights.
|
|
|
|
|