<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Mangal;
panose-1:0 0 4 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
tt
{mso-style-priority:99;
font-family:"Courier New";}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.E-postmall21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.pl-s1
{mso-style-name:pl-s1;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1988892892;
mso-list-type:hybrid;
mso-list-template-ids:-1473973854 69009425 69009433 69009435 69009423 69009433 69009435 69009423 69009433 69009435;}
@list l0:level1
{mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="SV" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Hi Sara,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">This was interesting! Lost of questions:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-18.0pt;mso-list:l0 level1 lfo2"><![if !supportLists]><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><span style="mso-list:Ignore">1)<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Have you used positive values on objects max?<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-18.0pt;mso-list:l0 level1 lfo2"><![if !supportLists]><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><span style="mso-list:Ignore">2)<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Have you changed
</span><span class="pl-s1"><span lang="EN-GB" style="font-size:9.0pt;font-family:Consolas;color:#24292F;background:white">settings.harvester.scheduler.jobGen.objectLimitIsSetByQuotaEnforcer
</span></span><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">or is it
</span><span class="pl-s1"><span lang="EN-GB" style="font-size:9.0pt;font-family:Consolas;color:#24292F;background:white">true</span></span><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">
?<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-18.0pt;mso-list:l0 level1 lfo2"><![if !supportLists]><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><span style="mso-list:Ignore">3)<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">What is your value on
</span><i><span lang="EN-GB" style="font-family:"Calibri",sans-serif">settings.harvester.harvesting.harvestReport.class</span></i><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> ?
</span><span style="font-size:9.0pt;font-family:Consolas;color:#24292F;background:white">BnfHarvestReport</span> or
<span style="font-size:9.0pt;font-family:Consolas;color:#24292F;background:white">
LegacyHarvestReport</span><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">The template examples in NAS have both frontier and quotaenforcer, but with this comment.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:18.0pt"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">## Can be used instead of the QuotaEnforcer module. In this case the following line should
look <o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:18.0pt"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">## like: frontier.queueTotalBudget=%{FRONTIER_QUEUE_TOTAL_BUDGET_PLACEHOLDER}<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:18.0pt"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">## instead of: frontier.queueTotalBudget=<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-left:18.0pt"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-left:18.0pt"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">frontier.queueTotalBudget=%{FRONTIER_QUEUE_TOTAL_BUDGET_PLACEHOLDER}<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">(Somewhat later:) Now I see, your statement makes me understand the handling in
</span><i><span lang="EN-GB" style="font-family:"Calibri",sans-serif">configureQuotaEnforcer():</span></i><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> it makes it possible to have both,
by setting the value of the one that shouldn’t be used to infinity.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">But you must have False in (2) and
</span><span lang="EN-GB" style="font-size:9.0pt;font-family:Consolas;color:#24292F;background:white">BnfHarvestReport</span><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"> in (3) above,
or else I’m puzzled again. </span><span lang="EN-GB" style="font-size:11.0pt;font-family:Wingdings;color:#1F497D;mso-fareast-language:EN-US">J</span><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">-----<br>
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">Peter</span><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><br>
<br>
</span><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif">Från:</span></b><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> NetarchiveSuite-users <<a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org">netarchivesuite-users-bounces@ml.sbforge.org</a>>
<b>För </b><a href="mailto:sara.aubry@bnf.fr">sara.aubry@bnf.fr</a><br>
<b>Skickat:</b> den 30 augusti 2022 14:02<br>
<b>Till:</b> <a href="mailto:netarchivesuite-users@ml.sbforge.org">netarchivesuite-users@ml.sbforge.org</a><br>
<b>Ämne:</b> Re: [Netarchivesuite-users] Limit both number of bytes and number of objects per domain<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">Hi Peter,</span><span lang="EN-GB"><br>
<br>
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">I can't technically answer your question but QuotaEnforcer and
</span><tt><span lang="EN-GB">queueTotalBudget </span></tt><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">are two different processors and have not been implemented in Heritrix to work together.</span><span lang="EN-GB"><br>
<br>
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">At BnF, we are using </span><tt><span lang="EN-GB">queueTotalBudget</span></tt><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">to manage queues by
number of URLs.</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">Here is what we have in our profiles :</span><span lang="EN-GB"><br>
<br>
</span><tt><span lang="EN-GB"> <!-- FRONTIER (START)</span></tt><span lang="EN-GB" style="font-family:"Courier New""><br>
<tt> Record of all URIs discovered and queued-for-collection</tt><br>
<tt> --></tt><br>
<tt> <bean id="frontier" class="org.archive.crawler.frontier.BdbFrontier"></tt><br>
<tt> <property name="maxRetries" value="10" /></tt><br>
<tt> <property name="retryDelaySeconds" value="60" /></tt><br>
<tt> <property name="recoveryLogEnabled" value="false" /></tt><br>
<tt> <property name="balanceReplenishAmount" value="1000" /></tt><br>
<tt> <property name="errorPenaltyAmount" value="1" /></tt><br>
<tt> <!-- NETARCHIVESUITE Placeholder FRONTIER_QUEUE_TOTAL_BUDGET_PLACEHOLDER --></tt><br>
<tt> <property name="queueTotalBudget" value="%{FRONTIER_QUEUE_TOTAL_BUDGET_PLACEHOLDER}" /></tt><br>
<tt> <property name="snoozeLongMs" value="300000" /></tt><br>
<tt> <property name="extract404s" value="false" /></tt><br>
<tt> </bean></tt><br>
<tt> <!-- FRONTIER (END) --></tt></span><span lang="EN-GB"><br>
<br>
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">And we have no place holder for the quotaEnforcer.</span><span lang="EN-GB"><br>
<br>
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">Best,</span><span lang="EN-GB"><br>
<br>
</span><span lang="EN-GB" style="font-size:10.0pt;font-family:"Arial",sans-serif">Sara</span><span lang="EN-GB"><br>
<br>
<br>
<br>
<br>
</span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">De : </span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">"Peter Svanberg" <</span><a href="mailto:Peter.Svanberg@kb.se"><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">Peter.Svanberg@kb.se</span></a><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">></span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">A : </span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">"</span><a href="mailto:netarchivesuite-users@ml.sbforge.org"><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">netarchivesuite-users@ml.sbforge.org</span></a><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">"
<</span><a href="mailto:netarchivesuite-users@ml.sbforge.org"><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">netarchivesuite-users@ml.sbforge.org</span></a><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">></span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Date : </span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">30/08/2022 13:41</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Objet : </span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">Re: [Netarchivesuite-users] Limit both number of bytes and number
of objects per domain</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Envoyé par : </span><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">"NetarchiveSuite-users" <</span><a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org"><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">netarchivesuite-users-bounces@ml.sbforge.org</span></a><span lang="EN-GB" style="font-size:7.5pt;font-family:"Arial",sans-serif">></span><span lang="EN-GB"><o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="" style="color:#A0A0A0" align="center">
</div>
<p class="MsoNormal"><span lang="EN-GB"><br>
<br>
<br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif;color:#004080">Sorry, I mixed it up, alt. 3 edited below. So I suppose now that alt. 3 is true. And that the value of
<i>frontier.queueTotalBudget</i> is irrelevant if you use <i>quotaenforcer</i>, i.e. if
<i><ref bean="quotaenforcer"/></i> is among the fetchProcessors.processors. True?</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif;color:#004080"> </span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif;color:#004080">But there is a rumour that you should decide between byte and object limit – true or false?</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif;color:#004080"> </span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif;color:#004080">Regards,</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Arial",sans-serif">-----<br>
Peter Svanberg</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif;color:#004080"><br>
</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif;color:#004080"> </span><span lang="EN-GB"><br>
</span><b><span lang="EN-GB" style="font-family:"Calibri",sans-serif">Från:</span></b><span lang="EN-GB" style="font-family:"Calibri",sans-serif"> NetarchiveSuite-users <</span><a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org"><span lang="EN-GB" style="font-family:"Calibri",sans-serif">netarchivesuite-users-bounces@ml.sbforge.org</span></a><span lang="EN-GB" style="font-family:"Calibri",sans-serif">>
<b>För </b>Peter Svanberg<b><br>
Skickat:</b> den 29 augusti 2022 14:20<b><br>
Till:</b> </span><a href="mailto:netarchivesuite-users@ml.sbforge.org"><span lang="EN-GB" style="font-family:"Calibri",sans-serif">netarchivesuite-users@ml.sbforge.org</span></a><b><span lang="EN-GB" style="font-family:"Calibri",sans-serif"><br>
Ämne:</span></b><span lang="EN-GB" style="font-family:"Calibri",sans-serif"> [Netarchivesuite-users] Limit both number of bytes and number of objects per domain</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif"> </span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif">Could someone please explain this handling?</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif"> </span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif">In a snapshot we want to limit both number of bytes and number of objects per domain. If you give positive values in GUI for new snapshot harvest, what is recommended?</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif"> </span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif">1. You should not. Why not?</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif">2. You must change
<i>settings.harvester.scheduler.jobGen.objectLimitIsSetByQuotaEnforcer</i>to false and change<i><br>
settings.harvester.harvesting.harvestReport.class</i> to <i>dk.netarkivet.harvester.harvesting.report.BnfHarvestReport</i>(which doesn’t assume annotations in crawl log).</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif">3. You can keep
<i>settings.harvester.scheduler.jobGen.objectLimitIsSetByQuotaEnforcer</i>as true and it works …? Even though
<span style="color:#004080">FRONTIER_QUEUE_TOTAL_BUDGET_PLACEHOLDER (and hence frontier.queueTotalBudget) is set to infinity?</span><i><s>QUOTA_ENFORCER_GROUP_MAX_FETCH_SUCCES_PLACEHOLDER</s></i><s>in template (and hence
<i>quotaenforcer.groupMaxFetchSuccesses</i>) is set to infinity</s> (in <i>configureQuotaEnforcer()</i>)?</span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif"> </span><span lang="EN-GB"><br>
</span><span style="font-family:"Calibri",sans-serif">Regards,</span><br>
<span style="font-family:"Calibri",sans-serif"> </span><br>
<span style="font-family:"Calibri",sans-serif"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="0" style="width:295.5pt;border-collapse:collapse">
<tbody>
<tr style="height:6.0pt">
<td width="113" style="width:84.75pt;border:solid black 1.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
</td>
<td width="281" style="width:210.75pt;border:solid black 1.0pt;border-left:none;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><b><span lang="EN-GB" style="font-family:"Arial",sans-serif;mso-fareast-language:EN-US">Peter Svanberg</span></b><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><b><span lang="EN-GB" style="font-family:"Arial",sans-serif;mso-fareast-language:EN-US">Technical officer
</span></b><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><span lang="EN-GB" style="font-family:"Arial",sans-serif;mso-fareast-language:EN-US">Aquisitions and Metadata Department<br>
Film, Games, Sheet Music and Web Unit</span><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><span lang="EN-GB" style="font-family:"Arial",sans-serif;mso-fareast-language:EN-US"> </span><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><b><span lang="EN-GB" style="font-family:"Arial",sans-serif;mso-fareast-language:EN-US">National Library of Sweden</span></b><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><span lang="EN-GB" style="font-family:"Arial",sans-serif;mso-fareast-language:EN-US">PO Box 5039, SE-102 41 Stockholm</span><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><span lang="EN-GB" style="font-family:"Arial",sans-serif;mso-fareast-language:EN-US">Visits: Karlavägen 96, Stockholm</span><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><span lang="EN-GB" style="font-family:"Arial",sans-serif;mso-fareast-language:EN-US">+46 10-709 32 78</span><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><span style="mso-fareast-language:EN-US"><a href="mailto:Peter.Svanberg@kb.se"><span lang="EN-GB" style="font-family:"Arial",sans-serif;color:#0082BF">Peter.Svanberg@kb.se</span></a></span><span lang="EN-GB" style="mso-fareast-language:EN-US"><br>
</span><span style="mso-fareast-language:EN-US"><a href="https://www.kb.se/"><span lang="EN-GB" style="font-family:"Arial",sans-serif">www.kb.se</span></a></span><span lang="EN-GB" style="mso-fareast-language:EN-US"><o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
<p style="margin-bottom:12.0pt"><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif"> </span><span lang="EN-GB"><br>
</span><span lang="EN-GB" style="font-family:"Calibri",sans-serif"> </span><tt><span lang="EN-GB" style="font-size:10.0pt">_______________________________________________</span></tt><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New""><br>
<tt>NetarchiveSuite-users mailing list</tt><br>
</span><a href="mailto:NetarchiveSuite-users@ml.sbforge.org"><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New"">NetarchiveSuite-users@ml.sbforge.org</span></a><span lang="EN-GB" style="font-size:10.0pt;font-family:"Courier New""><br>
</span><a href="https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users"><tt><span lang="EN-GB" style="font-size:10.0pt">https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users</span></tt></a><span lang="EN-GB" style="font-family:"Arial",sans-serif"><o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-family:"Arial",sans-serif">
<hr size="2" width="100%" align="center">
</span></div>
<p><span style="font-family:"Arial",sans-serif">Samedi 17 et dimanche 18 septembre 2022 :
<strong><span style="font-family:"Arial",sans-serif">la BnF fête la réouverture du site Richelieu</span></strong>, après douze ans de travaux de rénovation et de modernisation, avec
</span><a href="https://www.bnf.fr/fr/agenda/richelieu-le-reveil-reouverture"><b><span style="font-family:"Arial",sans-serif">un parcours de visite</span></b></a><span style="font-family:"Arial",sans-serif"> en compagnie d’artistes et comédiens l'après-midi,
et </span><a href="https://www.bnf.fr/fr/agenda/richelieu-le-reveil-performances-et-lectures"><b><span style="font-family:"Arial",sans-serif">des événements et performances</span></b></a><span style="font-family:"Arial",sans-serif"> la soirée.
<o:p></o:p></span></p>
<p><strong><span lang="EN-GB" style="font-family:"Arial",sans-serif;color:green">Avant d'imprimer, pensez à l'environnement.</span></strong><span lang="EN-GB" style="font-family:"Arial",sans-serif;color:green"><o:p></o:p></span></p>
</div>
</body>
</html>