[Netarchivesuite-users] Politeness level in Heritrix? (disposition.*)

[Peter Svanberg]

I asked in Slack and got poited out what levels are default in Heritrix: (default followed by our usage, from NAS-default?)

disposition.delayFactor 5.0  1.0
disposition.maxDelayMs= 30000 1000
disposition.minDelayMs= 3000  300
disposition.respectCrawlDelayUpToSeconds= 300 3
disposition.maxPerHostBandwidthUsageKbSec= 0 0

Quite different! What are you using? About like us or in between? How much does this affect crawl speed? Pretty much, I would guess as for the first three.



[KB Logo]<https://www.kb.se/>

Peter Svanberg
teknisk handläggare
Insamling och metadata
Insamling 1

Kungliga biblioteket
Box 5039, 102 41 Stockholm
Besöksadress: Karlavägen 96, Stockholm
010-709 32 78
Peter.Svanberg at kb.se
www.kb.se<https://www.kb.se/>


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://ml.sbforge.org/pipermail/netarchivesuite-users/attachments/20220111/8f30b4ae/attachment.html>