Forum Google Spiders - Blog/Calender
 

Hey All,

In previous versions we had to block out the spiders from the Blog and Calender sections of the vBulletin software. As they would crawl on it for days and not get anywhere.

My question is, has this been fixed in the newest versions?

Quote:
User-agent: *
Disallow: /calendar.php
Disallow: /blog.php

Can I remove the blocks?