Tag Archives: .htaccess

Blocking Semalt Web Crawler

Blocking Semalt Web Crawler

The Semalt.com web crawler is useless. The services they claim to provide (if you pay) offer no better analysis on your website than the free ones you’re already using. Semalt also uses a persistent web crawler, which inflates your web statistics, ignores Robots.txt protocols, and even ignores their own Website […]

Posted in: Web Development

Tagged: , , , ,


Block Visitors From Viewing Directory Indexes

Block Visitors From Viewing Directory Indexes

Adding blank index.htm files to all your website directories in effort to keep nosy visitors from viewing all the files in a directory is an annoying chore. You have to check each directory and upload an extra file per directory, so you end up wasting time. Fortunately, there is an […]

Posted in: Web Development

Tagged: , , , , , , , , , , ,