Tag Archives: .htaccess
Blocking Semalt Web Crawler
The Semalt.com web crawler is useless. The services they claim to provide (if you pay) offer no better analysis on your website than the free ones you’re already using. Semalt also uses a persistent web crawler, which inflates your web statistics, ignores Robots.txt protocols, and even ignores their own Website […]
Recent Comments