Comments on: Interview with David Jenyns

By: Leslie

Leslie — Sat, 20 Feb 2010 22:20:23 +0000

Yes, this is true, and damn strange too. How much of this is differences across data centers vs. variations in result serving across the Google TLDs is unclear to me. Have not had a need to do more than notice the phenom.

By: Andy Beard

Andy Beard — Sat, 20 Feb 2010 18:08:33 +0000

Note: there is a difference between the number of pages a site: query returns from Google.com and the rest of the world such as Google.co.uk

By: Jay Roweson

Jay Roweson — Fri, 12 Feb 2010 20:47:31 +0000

Thanks for the reply Leslie.

I was using the site:website.com search in Google to check how many pages were indexed and basing it off that

I guess I need more links to get all these pages indexed, but then the question becomes how to get so many links?

Thanks again!

By: Leslie

Leslie — Fri, 12 Feb 2010 17:59:40 +0000

“Indexed by Google” is not entirely easy to measure, so I would not be so sure that you are correct about that. If Yahoo is showing them in a site: query then it is likely that Google has loaded them as well and is just not calling them important enough to list in the result count (which is at best an approximation anyway). Checking for spidering in your server logs is also a great way to know just how much of your site is getting loaded by Google.

In general, lack of indexing is either (1) a broken linking structure where the pages simply can not be found — look at your server logs for spider visits or (2) not enough inbound links or PageRank accumulated in the deeper pages so while actually indexed, they do not get treated as first class citizens in search results (this is the supplemental results effect).

By: Jay Roweson

Jay Roweson — Fri, 12 Feb 2010 05:40:15 +0000

This is so frustrating…

I have a 1,000 page website and only 300 of those pages are indexed.

I submitted a site-map + pinged all the pages – but only 300 are being indexed by Google.

What should I do?

PS: Am I really supposed to bookmark 1,000 pages…

Seriously, any advice would be much appreciated, I am very frustrated!