Content distribution network Cloudflare is making it simpler for customers who have had enough of badly behaved bots to block them from their website. It’s long been possible to prevent well-behaved bots from crawling your corporate website by adding a “robots.txt” file listing who’s welcome and who isn’t — and content distribution networks such as Cloudflare offer visual interfaces to simplify the creation of such files.

Source: ComputerWorld