News:

Dear forum visitors, if the support forum is not available, please try again a few minutes later. Thanks!

Main Menu
Support-Forum

Quick Question - Why need to block crawlers, search?

Started by zzzzk, 03.03.2016 22:50:57

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

zzzzk

Hello, quick question.  You have the option to block crawlers, search engines. You also have the option to use a recaptcha.  I can see the need for this in user registration or forms.  (spammers or false accounts).   However, why would this be needed for jdownloads for files such as music or docs?  Do crawlers, search engines actually download the files? Is it needed for security?  Thank you :-\
  •  

ColinM

Hi
There maybe many reasons why you want to block crawlers from indexing your Downloads. The three principle reasons are privacy, security, and excessive traffic.
Most people do not block the crawlers but there are some 'bad' ones.
The following article might be helpfull
http://blog.kualo.com/understanding-and-controlling-web-crawlers-and-bots/

Colin
PS I meant to edit this post to correct a spelling error but mistakenly clicked on the wrong one
Colin M
  •