robots.txt and it function - Joomla! Forum - community, help and support


hi every body
my site indexed search engine nice ranking (content & images)while in html.. not indexing after changing joomla (2.5) ,,i modified robots.txt still not indexing , lots of blocking url in google web master tools ,,i think must of robots.txt ,,so question : happened if totally remove robots.txt server site... make problem ?.i of site indexed,,,,and no non indexed content in site
with thanks
best regards
ariyagalley

you don't need file.

google's john mueller confirmed in google webmaster help:

"i recommend going bit further, , perhaps removing robots.txt file completely. general idea behind blocking of pages crawling prevent them being indexed. however, that's not necessary -- websites can still crawled, indexed , ranked fine pages terms of service or shipping information indexed (sometimes that's useful user :-))."

link thread/post:

http://productforums.google.com/forum/# ... oke2mhpivk





Comments

Popular posts from this blog

How to change text Component easybook reloaded *newbee* - Joomla! Forum - community, help and support

After Effect warning: A problem occurred when processing OpenGL commands

Preconditions Failed. - Joomla! Forum - community, help and support