[Netarchivesuite-users] CRAWL ENDING - Finished - Ended by operator

aponb at gmx.at aponb at gmx.at
Fri Jun 6 09:10:43 CEST 2008


>
> settings.harvester.harvesting.heritrix.inactivityTimeout
> settings.harvester.harvesting.heritrix.noresponseTimeout
>
> The feature was added because we often saw inactive harvesters blocking
> up our queues, and thus receiving no new requests.
>
> We run our harvesters with a timeout of half an hour (1800 seconds), if
> you wish to turn the feature off, just insert a very large number.
>
> Looking at our default distributed settings.xml it seems the default
> setting is as low as 100 seconds. That is a poor choice, we should
> certainly up this default setting!
>   
Thanks for the quick hint!
I used the default settings in this job. I will change it!



More information about the NetarchiveSuite-users mailing list