![]() |
Vbulletin and archive.org Hi, I've noticed that, since I've migrated from phpBB to Vbulletin (1.5 years ago), archive.org stopped crawling mi site. What do you think is causing this? I've read something related to this on archive.org: "In all cases, ensure that your site's 'robots.txt' rules and in-page META robots directives do not tell crawlers to avoid your site." Is this related to this? How did you solve it? Thanks |
الساعة الآن 07:26 PM |
Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Content Relevant URLs by vBSEO 3.5.2 TranZ By
Almuhajir