Reddit updated its robots.txt file to block all search engines. The file tells all web crawlers that they are not allowed to index the site, together with an explanatory message. Reddit believes in an ...