search engines ?

bluebeary

is this site spidered by google, yahoo or any other search engines at all ?

they dont show up on the online list

esuhl

Are you sure...? http://www.google.com/search?q=money+saving+expert http://uk.search.yahoo.com/search?p=money+saving+expert

bluebeary

no which is why im asking, i dont see any spidering occuring on the online list

Former_MSE_Joe

Hello bluebeary,

There could be many factors that are preventing us showing up in your search queries. Google has recently altered its search algorithm that tailors a search result more specifically to your previous searches. There may have been a stored result on your Google account or browser Cache that is preventing MoneySavingExpert from appearing.

esuhl

bluebeary wrote: »

no which is why im asking, i dont see any spidering occuring on the online list

What is the "online list" that you're referring to, and how are you determining whether "spidering" (i.e. page indexing) has occurred?

Former_MSE_Joe

Hello oesuhl,

Each Google search creates a tiny record relating to the query performed; this is then stored either by cache, cookie or on your Google account known as "Search history".

You are able to turn this feature off via your browser or your Google account, but as quoted from Google; "it reduces the Quality of results provided by Google".

Indexing occurs as and when Google believes there is new, relative content available for it to achieve. Our robots.txt file does not specify a status/command for Google crawlers, and so by default; it will be allowed to 'crawl' the site.

I hope this has brief explanation has helped. If you wish to know any more information, please do not hesitate to ask.

As just noted by another member of staff, the 'Online box' - located at http://forums.moneysavingexpert.com/online.php that displays all online users will not show search engines that are indexing/crawling the site. This may be the result of this setting being turned off.