Commerce Server General - Commerce Server and search engines??

Author

Commerce Server and search engines??

Dean J Garrett

2006-02-14, 5:51 pm

Is there a specific method or strategy for allowing a Commerce Server site
to
be indexed by a search engine such as Google or Yahoo? Given that most of
the
content in a Commerce Server site is database driven, how could a crawler
reach a product page for example, in order to index its content? Any clues
would be appreciated.

Thanks!!

Joe Wasson [MSFT]

2006-02-17, 10:50 pm

Generally all of your products are exposed on the site through the same
links the user uses to view them. So the crawler gets to your page and
sees the link for "Products" then "Books" then "A Good Book" and will load
that page into the search engine.

For the Commerce Server 2006 Starter Site we are also adding URL Rewriting.
The product and category browse pages work by having a link like
"http://localhost/StarterSite/Products.aspx?CatalogName=Books&ProductID=0-20
1-63361-2" That will still be crawled by search engines, but it won't be
as friendly. The rewritten url would be
"http://localhost/StarterSite/Products/Books/PID-0-201-63361-2/A Good
Book.aspx"

But basically, if your site doesn't use anything fancy (like having the
user select a list of categories from a drop-down list) then the browser
should be able to follow all of the links on the site to find all of the
products.

-joe

This posting is provided "AS IS" with no warranties, and confers no rights.
--------------------
From: "Dean J Garrett" <info@amuletc.com>
Subject: Commerce Server and search engines??
Date: Tue, 14 Feb 2006 10:09:49 -0800

Is there a specific method or strategy for allowing a Commerce Server site
to
be indexed by a search engine such as Google or Yahoo? Given that most of
the
content in a Commerce Server site is database driven, how could a crawler
reach a product page for example, in order to index its content? Any clues
would be appreciated.

Thanks!!

Pascal

2006-02-17, 10:50 pm

Is it possible that if the URL is too long or contains too many parameter
after the "?" then Google won't bother indexing the link? It appears like the
section of my site with long URLs are not indexed but that could be just a
coincidence!?!

"Joe Wasson [MSFT]" wrote:

> Generally all of your products are exposed on the site through the same
> links the user uses to view them. So the crawler gets to your page and
> sees the link for "Products" then "Books" then "A Good Book" and will load
> that page into the search engine.
>
> For the Commerce Server 2006 Starter Site we are also adding URL Rewriting.
> The product and category browse pages work by having a link like
> "http://localhost/StarterSite/Products.aspx?CatalogName=Books&ProductID=0-20
> 1-63361-2" That will still be crawled by search engines, but it won't be
> as friendly. The rewritten url would be
> "http://localhost/StarterSite/Products/Books/PID-0-201-63361-2/A Good
> Book.aspx"
>
> But basically, if your site doesn't use anything fancy (like having the
> user select a list of categories from a drop-down list) then the browser
> should be able to follow all of the links on the site to find all of the
> products.
>
> -joe
>
> This posting is provided "AS IS" with no warranties, and confers no rights.
> --------------------
> From: "Dean J Garrett" <info@amuletc.com>
> Subject: Commerce Server and search engines??
> Date: Tue, 14 Feb 2006 10:09:49 -0800
>
> Is there a specific method or strategy for allowing a Commerce Server site
> to
> be indexed by a search engine such as Google or Yahoo? Given that most of
> the
> content in a Commerce Server site is database driven, how could a crawler
> reach a product page for example, in order to index its content? Any clues
> would be appreciated.
>
> Thanks!!
>
>
>
>

Joe Wasson [MSFT]

2006-02-20, 5:52 pm

I think that both of those situations are negative conditions for the
crawler. I don't have the specifics, though.

-joe

This posting is provided "AS IS" with no warranties, and confers no rights.
--------------------
From: =?Utf-8?B?UGFzY2Fs?= <Pascal@discussions.microsoft.com>
Subject: RE: Commerce Server and search engines??
Date: Thu, 16 Feb 2006 16:56:27 -0800

Is it possible that if the URL is too long or contains too many parameter
after the "?" then Google won't bother indexing the link? It appears like
the
section of my site with long URLs are not indexed but that could be just a
coincidence!?!

"Joe Wasson [MSFT]" wrote:

> Generally all of your products are exposed on the site through the same
> links the user uses to view them. So the crawler gets to your page and
> sees the link for "Products" then "Books" then "A Good Book" and will
load
> that page into the search engine.
>
> For the Commerce Server 2006 Starter Site we are also adding URL
Rewriting.
> The product and category browse pages work by having a link like
>
"http://localhost/StarterSite/Products.aspx?CatalogName=Books&ProductID=0-20
> 1-63361-2" That will still be crawled by search engines, but it won't be
> as friendly. The rewritten url would be
> "http://localhost/StarterSite/Products/Books/PID-0-201-63361-2/A Good
> Book.aspx"
>
> But basically, if your site doesn't use anything fancy (like having the
> user select a list of categories from a drop-down list) then the browser
> should be able to follow all of the links on the site to find all of the
> products.
>
> -joe
>
> This posting is provided "AS IS" with no warranties, and confers no
rights.
> --------------------
> From: "Dean J Garrett" <info@amuletc.com>
> Subject: Commerce Server and search engines??
> Date: Tue, 14 Feb 2006 10:09:49 -0800
>
> Is there a specific method or strategy for allowing a Commerce Server
site
> to
> be indexed by a search engine such as Google or Yahoo? Given that most of
> the
> content in a Commerce Server site is database driven, how could a crawler
> reach a product page for example, in order to index its content? Any clues
> would be appreciated.
>
> Thanks!!
>
>
>
>