[Netarchivesuite-curator] BnF NAS update for October

[peter.stirling at bnf.fr]

Hello all,

We are currently running a trial broad crawl to check the servers' 
configuration - everything seems to be working fine. We should have 40 
crawlers working with 10 threads each during the day and 30 threads during 
the night as we have to be careful in our use of the bandwidth. 

Each year, we adjust the budget per domain depending on the overall 
maximum volume allocated to the broad crawl. This year, we will allow up 
to 3,500 URLs per domain.

The harvest should be launched on October 10th.

Best regards,
The BnF digital legal deposit team

Exposition  URDLA : 38 ans d’estampes contemporaines  - du 4 octobre au 27 novembre 2016 - BnF - François-Mitterrand Avant d'imprimer, pensez à l'environnement. 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://ml.sbforge.org/pipermail/netarchivesuite-curator/attachments/20161005/357c86a4/attachment.html>