Comments on: Create robots.txt file for better SEO

By: Fernandez

Fernandez — Wed, 10 Jun 2009 06:58:40 +0000

I have blogger account. And its not possible to edit the robots.txt file in blogger account. Is it possible to create a seperate robots.txt file for a blog?

By: Jack Thomas

Jack Thomas — Sun, 17 May 2009 03:13:39 +0000

I never knew that robots.txt file is such a useful thing for SEO. But its a nice idea and I think it will definitely help in our SEO works.

By: Srinivas

Srinivas — Sun, 17 May 2009 00:16:08 +0000

Thats The real Problem .. Just becoz everybody Writes we don’t know who to follow.. i just moved from blogger to wordpress.. lets See How it goes..

By: denz

denz — Tue, 12 May 2009 16:18:34 +0000

Nice idea, then this will add up my knowledge about SEO optimization again. Thank bro, just keep it up and enjoy!

By: Ali Hussain

Ali Hussain — Tue, 10 Feb 2009 14:37:32 +0000

I really don’t mess with robots.txt. I use an online robot.txt maker. It helps alot. Also there are many wordpress robot.txt plugins

By: CBSE

CBSE — Wed, 04 Feb 2009 19:14:47 +0000

I am also sufering from the same problem for my site http://www.icbse.com

When i search for the keywords for my site in google then the login and the other non-needed pages appears.

But after reading this article i will soon add the robots.txt in my site.

Thanks for sharing the best article.

By: Atniz

Atniz — Fri, 23 Jan 2009 04:50:08 +0000

No body wants our wp-admin login page to get index. It will just make our blog look more visible for the attackers. I think sitemap file should be installed when a new blog installation period and it should come together with wordpress not as another plugin. I use google sitemap and so far so good.

By: Jade

Jade — Thu, 01 Jan 2009 04:23:41 +0000

This is a great source of info. I am hoping to improve my seo on my sites too. I will be hanging out in your site alot the coming days.

By: Arun Basil Lal

Arun Basil Lal — Mon, 15 Dec 2008 17:44:37 +0000

Hello John,

Title is important on SEO, but not the most important. In proper SEO, the key things are:
* Title
* Keyword Density (Percentage of the keyword in the total post)
* Image parameters like Image title, Alternate text etc
* Non indexing of duplicate contetn on tag pages etc.
* Proper links (nofollow for non relevant links)
* First 160 characters must describe the post. plus proper description tag etc.

Use the All in one SEo pack, its comprehensive + Google Sitemap Generator plugin
That should do. My friend, Mani is a professional SEO expert. His blog dailyseoblog.com has lots of tips.

Hope you find the info useful.
Arun.

By: Arun Basil Lal

Arun Basil Lal — Mon, 15 Dec 2008 17:43:25 +0000

There is another easy way for those who dont like to edit code directly, Use the Google-Sitemap Generator plugin. There is an option to create Robots.txt file. The file redirects the google bot to the sitemap and sitemap will have only the relevant links.

with this plugin, my contents are indexed within 36-48 hours.
Hope that helps someone.
Arun