Forum Moderators: open

Message Too Old, No Replies

Submit all pages?

         

brnm98105

10:14 pm on Sep 25, 2008 (gmt 0)

10+ Year Member



I have a question, If I have a main site with several types of products should i submit each product page to a search engine? Or will the search engines eventually get to it after it indexes all my pages?

eg

index.html -
index/product-type1/dog-food.html
index/product-type2/cat-toys.html
index/product-type2/dog-houses.html
index/product-type2/fish-tanks.html

Any help would be appreciated.

buckworks

10:20 pm on Sep 25, 2008 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



It's not necessary to submit pages individually. If your site navigation is spider-friendly and well-organized, the search engines will find all your pages on their own.

If fact, if other sites start linking to you, it's not necessary to actively submit anything at all to the search engines. They'll find you by following the links.

jdMorgan

10:25 pm on Sep 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Search engine submission has been a dead topic for many years (note that the WebmasterWorld forum on this subject is deprecated), because there is no longer any need to submit URLs to search engines; All of them use crawlers that follow links to discover pages.

The current approach is to get links to your pages from relevant sites, and let the search engines find you that way.

You can also create and submit a SiteMap file (or files, if your site is very large) through the top search engines' "Webmaster Tools" pages -- The name varies, but most now have a facility for submitting SiteMaps. Some of them also support "auto discovery" of SiteMaps -- You add a directive to your robots.txt file, telling the search engines the URL of your master SiteMap file, and the search engines will do the rest.

Jim

Ajaxunion

4:32 am on Sep 26, 2008 (gmt 0)

10+ Year Member



All the pages must be linked for the search engine to find it. If the pages are not linked then the crawler cannot get to it. You do not need to submit to the search engine but it will not hurt to do so. Like JDMorgan said: "submit a sitemap" thats a good way to get noticed by google.