So what’s cached?

If you visit google.com and find your website, you can click on cached link. That will open new window and at the top it will tell you last time spiders actually visited that page.

If they visited the page like a year ago – something is not very well with that page. They should come often, like every 1-2 weeks.

So how to index first of all internal pages and then get spiders to crawl theM regularly?

First of all any page you have on your website should be linked at least one time from some other page.

The content of the page – if it’s a duplicate content of something already on your website or external website – make content unique and relevant to your site.

Meta tags, make them unique – unique meta title and description at least, descriptive to the page.

Create xml sitemap and submit it to Google. Create website sitemap and list all pages neatly and organized.

Remember here you are not trying to trick search engines, whatever you do you must input quality factors, your visitors in mind.

Those are the most common things why your pages are not indexed.

Let spiders move from page to page easily so they find all your pages. A website sitemap helps a lot.

You can also get backlinks to the pages that are not indexed. Probably the best way from articles so link to inner pages as well in bio section, sometimes.

Indexing internal pages is a matter of allowing spiders to reach them, showing spiders the content is worth indexing and valuable for users and telling spiders that other people or websites like the content (they are linking to it) by getting backlinks.

Adding fresh content on your website is the reason why your website cached copy is fresh. If it’s old, like a year ago that spiders last visited your website you have to add more fresh content.

Nothing special here, no hidden secrets, if your website is not having quality for your visitor why do spiders have to index or visit it regularly anyway?

Spiders come to see if you have anything new on your site.

Pinging blog is a way to call them if you add something new on your blog… always ping if you add new posts something spiders will see. Don’t call them if you just added a new picture.

I ping after posting always. There are many free pinging tools to use.

All blogs have an rss or atom feed too, which you can add to the pinging too. I also ping my content not just the blog. If I add really useful content that I think spiders should see quickly, I ping the page as well. Not just the blog.

That helps generate spider activity!

I indexed 150 websites in a week – brand new websites! This was a scriptlance.com project – the sites were not mine.

Years ago all I did online was work as a freelancer.

150 websites in a week! So one website should be far easier to get indexed. Right?

So what I did?

First and foremost the concept was to get spiders to visit these 150 websites as quickly as possible AND several times a day!

To get spiders visit the sites very fast – you can simple use Content Crooner service and submit one article a day – they submit your website to thousands of directories. That’s why spiders find your new site quickly.

Put your link in the bio of the article. Use anchor text.

Second submit your website to high pagerank websites – like Digg.com I’ve placed a list of these top sites in my other blog post… High Pagerank One Way Links For You!

Do article marketing submission daily… and within 5 days your new site is indexed. Yes, that alone is enough.

The high pagerank websites sort of give your website a boost… doing them is like a bonus.

Pretty easy.

*Use original article for submission – that way all article directories accept it – plus other webmasters who like it places them on their website (bonus).

*One submission everyday, just fill the form one time everyday with article title, description, etc. Brain-dead easy.

I would do that alone if it’s just ONE website you have… and after 5 days use the list of high pagerank websites – and submit the site there as well. That guarantees solid inclusion in Google and other search engine index.

So it’s all offpage – no really need to do anything in particular on your website. Spiders will find your website from article directories – and since you have a lot of backlinks they find your website often and quickly… that’s why they index it.

Test it out!

Here’s another one of my blog posts: How To Index 4000 Pages Of Your Website? That’s not about indexing the website – the homepage… but in that case it’s a 4000 page website, a big site and owner wants to index all the 4000 pages.

It is not same thing and there are different techniques rather than the ones used to index a website with few pages (indexing homepage).

Please leave your comments.