<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">Hi Sara,<br>
<br>
I forgot to mention that the problems were coming up with our
daily crawls. The intention was to deploy 5.3.1, waiting for some
daily crawls, before starting the broad crawl.<br>
<br>
Thanks for your settings and for telling how your broad crawl will
work!<br>
<br>
</div>
<blockquote type="cite"
cite="mid:OF74B7DE86.006FBEFA-ONC125814E.002A7EF9-C125814E.002AF2DF@LocalDomain"><font
size="2" face="Arial">Hi Andreas,</font><br>
<br>
<font size="2" face="Arial">Are your problems coming up because
you just
launched a broad crawl?</font><br>
<br>
<font size="2" face="Arial">At BnF, we are still running 5.3.0
with default
settings on these parameters:</font><br>
<font size="2" face="Arial">settings.harvester.harvesting.sendReadyInterval
on 30s <br>
settings.harvester.harvesting.sendReadyDelay on 1000ms</font><br>
<br>
<font size="2" face="Arial">We are currently testing 5.3.1 on very
small
crawls (working well)</font><br>
<font size="2" face="Arial">and we will start bigger crawls next
week.
I'll let you know</font><br>
<font size="2" face="Arial">how it goes.</font><br>
<br>
<font size="2" face="Arial">Sara </font><br>
<br>
<br>
<br>
<br>
<font color="#5f5f5f" size="1" face="sans-serif">De :
</font><font size="1" face="sans-serif"><a class="moz-txt-link-rfc2396E" href="mailto:aponb@gmx.at"><aponb@gmx.at></a></font><br>
<font color="#5f5f5f" size="1" face="sans-serif">A :
</font><font size="1" face="sans-serif"><a class="moz-txt-link-rfc2396E" href="mailto:netarchivesuite-devel@ml.sbforge.org"><netarchivesuite-devel@ml.sbforge.org></a></font><br>
<font color="#5f5f5f" size="1" face="sans-serif">Date :
</font><font size="1" face="sans-serif">28/06/2017 11:43</font><br>
<font color="#5f5f5f" size="1" face="sans-serif">Objet :
</font><font size="1" face="sans-serif">[Netarchivesuite-devel]
Multiple jobs submitted simultaneously under 5.3.1</font><br>
<font color="#5f5f5f" size="1" face="sans-serif">Envoyé par :
</font><font size="1" face="sans-serif">Netarchivesuite-devel
<a class="moz-txt-link-rfc2396E" href="mailto:netarchivesuite-devel-bounces@ml.sbforge.org"><netarchivesuite-devel-bounces@ml.sbforge.org></a></font><br>
<hr noshade="noshade"><br>
<br>
<br>
<tt><font size="2">If was running Nas Version on 5.3.1 in
production
and did get a huge <br>
number of jobs with the same Configurations submitted. This
must be the
<br>
behavior of </font></tt><a
href="https://sbforge.org/jira/browse/NAS-2614"
moz-do-not-send="true"><tt><font size="2">https://sbforge.org/jira/browse/NAS-2614</font></tt></a><tt><font
size="2">which was fixed for <br>
Version 5.3.1 - the strange thing is, that I had not any
problems in <br>
Version 5.3.0.<br>
<br>
Is anyone experiencing the same issue?<br>
As suggested I set
settings.harvester.harvesting.sendReadyInterval to <br>
300 and I am using
settings.harvester.harvesting.sendReadyDelay with <br>
value 300<br>
<br>
Also the HarvestJobManagerApplication dies with OutOfMemory
Exception,
<br>
even when started with parameter -Xmx4096m<br>
<br>
20:28:11.823 ERROR d.n.c.lifecycle.PeriodicTaskExecutor - Task
threw <br>
exception: java.lang.OutOfMemoryError: Java heap space<br>
java.util.concurrent.ExecutionException:
java.lang.OutOfMemoryError: <br>
Java heap space<br>
at
java.util.concurrent.FutureTask.report(FutureTask.java:122)
<br>
~[na:1.8.0_77]<br>
at
java.util.concurrent.FutureTask.get(FutureTask.java:192)
<br>
~[na:1.8.0_77]<br>
at <br>
dk.netarkivet.common.lifecycle.PeriodicTaskExecutor.checkExecution(PeriodicTaskExecutor.java:171)
<br>
[common-core-5.3.1.jar:UNKNOWN_REVISION]<br>
at <br>
dk.netarkivet.common.lifecycle.PeriodicTaskExecutor.access$500(PeriodicTaskExecutor.java:47)
<br>
[common-core-5.3.1.jar:UNKNOWN_REVISION]<br>
at <br>
dk.netarkivet.common.lifecycle.PeriodicTaskExecutor$1.run(PeriodicTaskExecutor.java:152)
<br>
[common-core-5.3.1.jar:UNKNOWN_REVISION]<br>
<br>
Do you have any thoughts on this?<br>
Regards<br>
a.<br>
<br>
_______________________________________________<br>
Netarchivesuite-devel mailing list<br>
<a class="moz-txt-link-abbreviated" href="mailto:Netarchivesuite-devel@ml.sbforge.org">Netarchivesuite-devel@ml.sbforge.org</a><br>
</font></tt><a
href="https://ml.sbforge.org/mailman/listinfo/netarchivesuite-devel"
moz-do-not-send="true"><tt><font size="2">https://ml.sbforge.org/mailman/listinfo/netarchivesuite-devel</font></tt></a><tt><font
size="2"><br>
</font></tt><br>
<font face="sans-serif">
<hr>
<p>Expositions :<br>
<strong><em><a
href="http://www.bnf.fr/fr/evenements_et_culture/anx_expositions/f.monde_topor.html"
moz-do-not-send="true">Le monde selon Topor</a></em></strong>
- jusqu'au 16 juillet 2017 - BnF - François-Mitterrand<br>
<strong><em><a
href="http://www.bnf.fr/fr/evenements_et_culture/anx_expositions/f.bibliotheque_la_nuit.html"
moz-do-not-send="true">La bibliothèque, la nuit –
Bibliothèques mythiques en réalité virtuelle </a></em></strong>
- jusqu'au 13 août 2017 - BnF - François-Mitterrand</p>
<p style="color:#008000"><strong>Avant d'imprimer, pensez à
l'environnement.</strong></p>
</font>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Netarchivesuite-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Netarchivesuite-devel@ml.sbforge.org">Netarchivesuite-devel@ml.sbforge.org</a>
<a class="moz-txt-link-freetext" href="https://ml.sbforge.org/mailman/listinfo/netarchivesuite-devel">https://ml.sbforge.org/mailman/listinfo/netarchivesuite-devel</a>
</pre>
</blockquote>
<p><br>
</p>
</body>
</html>