|
Spiders and Search Engines |
|
|
|
Help - JEvents is generating heavy search engine crawling activity. What can I do?
Its a tricky one - one commonly used option is to change robots.txt to include :
User-agent: *
Disallow: /component/option,com_events/
The problem is that Joomla 1.0.x sets the robots meta tag in such a way that we can't change it. JEvents 1.5 will allow
you to set a min and max year for the calendar which will help.
Look at http://de.wikipedia.org/robots.txt how wikipedia handles undesired spider access.
|
