<font size=2 face="sans-serif">Hello Peter,</font><br><br><font size=2 face="sans-serif">On BnF side, we can have network downtimes
that can last more than half a day.</font><br><font size=2 face="sans-serif">We don't restart neither the NAS applications,
nor the broker. Unpausing the jobs works fine..</font><br><font size=2 face="sans-serif">We just make sure the next capture dates
on the harvests are consistent when reactivate them.</font><br><br><font size=2 face="sans-serif">Best,</font><br><br><font size=2 face="sans-serif">Sara</font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">De :
</font><font size=1 face="sans-serif">"Tue Hejlskov
Larsen" <tlr@kb.dk></font><br><font size=1 color=#5f5f5f face="sans-serif">A :
</font><font size=1 face="sans-serif">"netarchivesuite-users@ml.sbforge.org"
<netarchivesuite-users@ml.sbforge.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date :
</font><font size=1 face="sans-serif">30/08/2024 13:43</font><br><font size=1 color=#5f5f5f face="sans-serif">Objet :
</font><font size=1 face="sans-serif">Re: [Netarchivesuite-users]
Preparing for and handling planned network outage during broad crawl</font><br><font size=1 color=#5f5f5f face="sans-serif">Envoyé par :
</font><font size=1 face="sans-serif">"NetarchiveSuite-users"
<netarchivesuite-users-bounces@ml.sbforge.org></font><br><hr noshade><br><br><br><font size=3 color=#004080 face="Calibri">Normally we only have planned
network downtime < 15 min. If the network down time is unprepared
and takes longer the below description is a realistic JMS broker message
scenario - at our site</font><br><font size=3 color=#004080 face="Calibri"> </font><br><font size=3 color=#004080 face="Calibri">Best regards</font><br><font size=3 color=#004080 face="Calibri">Tue</font><br><font size=3 color=#004080 face="Calibri"> </font><br><font size=3 face="Calibri"><b>From:</b> NetarchiveSuite-users <netarchivesuite-users-bounces@ml.sbforge.org>
<b>On Behalf Of </b>Peter Svanberg<b><br>Sent:</b> Friday, August 30, 2024 1:29 PM<b><br>To:</b> netarchivesuite-users@ml.sbforge.org<b><br>Subject:</b> Re: [Netarchivesuite-users] Preparing for and handling planned
network outage during broad crawl</font><br><font size=3 face="Times New Roman"> </font><br><font size=3 color=#004080 face="Calibri">Hello Tue and Sara!</font><br><font size=3 color=#004080 face="Calibri"> </font><br><font size=3 color=#004080 face="Calibri">Sara confirms my draft plan.</font><br><font size=3 color=#004080 face="Calibri">1. Pause
all ongoing jobs, so far in advance that there is no risk of jobs being
in post-processing.</font><br><font size=3 color=#004080 face="Calibri">2. Deactivate/postpone
start of selective jobs.</font><br><font size=3 color=#004080 face="Calibri">3. After
outage: unpause all paused jobs. (Much clicking … maybe can be scripted.)</font><br><font size=3 color=#004080 face="Calibri"> </font><br><font size=3 color=#004080 face="Calibri">But what happens then? The
unpaused jobs continue and post-processing works?</font><br><font size=3 color=#004080 face="Calibri"> </font><br><font size=3 color=#004080 face="Calibri">And if that works, does the
queue handling and connections between the main server and all harvester
instances remain so new jobs are created, or must something be restarted?</font><br><font size=3 color=#004080 face="Calibri"> </font><br><font size=3 color=#004080 face="Calibri">Tue, did you describe what
happens if you do no preparing?</font><br><font size=3 color=#004080 face="Calibri"> </font><br><font size=3 color=#004080 face="Calibri">Best regards<br>Peter</font><br><font size=3 color=#004080 face="Calibri"> </font><br><font size=3 face="Calibri"><b>Från:</b> NetarchiveSuite-users <</font><a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org"><font size=3 color=blue face="Calibri"><u>netarchivesuite-users-bounces@ml.sbforge.org</u></font></a><font size=3 face="Calibri">>
<b>För </b></font><a href=mailto:sara.aubry@bnf.fr><font size=3 color=blue face="Calibri"><u>sara.aubry@bnf.fr</u></font></a><font size=3 face="Calibri"><b><br>Skickat:</b> den 29 augusti 2024 10:42<b><br>Till:</b> </font><a href="mailto:netarchivesuite-users@ml.sbforge.org"><font size=3 color=blue face="Calibri"><u>netarchivesuite-users@ml.sbforge.org</u></font></a><font size=3 face="Calibri"><b><br>Ämne:</b> Re: [Netarchivesuite-users] Preparing for and handling planned
network outage during broad crawl</font><br><font size=3 face="Times New Roman"> </font><br><font size=3 face="Arial">Hello Peter,</font><font size=3 face="Times New Roman"><br></font><font size=3 face="Arial"><br>Planned network outage is a lot easier to handle than unexpected ones!</font><font size=3 face="Times New Roman"><br></font><font size=3 face="Arial"><br>At BnF, we paused all running jobs until we have the confirmation everything
is back to normal. We already did this during broad crawls so for more
than 60 cralwers.<br>The challenge is to make sure you have no new job to start, so we temporarily
desactivate the Selective harvests.<br>If we have jobs at a post-processing stage that we cannot paused, we stop
the HarvestController by putting a shutdown.txt file in the job directory..
</font><font size=3 face="Times New Roman"><br></font><font size=3 face="Arial"><br>Best,</font><font size=3 face="Times New Roman"><br></font><font size=3 face="Arial"><br>Sara</font><font size=3 face="Times New Roman"><br><br><br></font><font size=3 color=#5f5f5f face="Arial"><br>De : </font><font size=3 face="Arial">"Tue
Hejlskov Larsen" <</font><a href=mailto:tlr@kb.dk><font size=3 color=blue face="Arial"><u>tlr@kb.dk</u></font></a><font size=3 face="Arial">></font><font size=3 color=#5f5f5f face="Arial"><br>A : </font><font size=3 face="Arial">"</font><a href="mailto:netarchivesuite-users@ml.sbforge.org"><font size=3 color=blue face="Arial"><u>netarchivesuite-users@ml.sbforge.org</u></font></a><font size=3 face="Arial">"
<</font><a href="mailto:netarchivesuite-users@ml.sbforge.org"><font size=3 color=blue face="Arial"><u>netarchivesuite-users@ml.sbforge.org</u></font></a><font size=3 face="Arial">></font><font size=3 color=#5f5f5f face="Arial"><br>Date : </font><font size=3 face="Arial">29/08/2024
08:42</font><font size=3 color=#5f5f5f face="Arial"><br>Objet : </font><font size=3 face="Arial">Re:
[Netarchivesuite-users] Preparing for and handling planned network outage
during broad crawl</font><font size=3 color=#5f5f5f face="Arial"><br>Envoyé par : </font><font size=3 face="Arial">"NetarchiveSuite-users"
<</font><a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org"><font size=3 color=blue face="Arial"><u>netarchivesuite-users-bounces@ml.sbforge.org</u></font></a><font size=3 face="Arial">></font><div align=center><hr noshade></div><br><font size=3 face="Times New Roman"><br><br></font><font size=3 color=#004080 face="Calibri"><br>Hello Peter,<br> <br>It depends on your max messages queues settings in the Open JMs broker
properties and how long time there is no network. Our installation breaks
down if it loose the network connection more than an 10 – 30 min..dependend
on what’a running <br>If the message queues hIt the maximum there is normally no other way than
restart the whole platform and all running harvesterjobs needs to be restarted.
<br>You can try to restart the GUI it will try to empty the JMS queues. And
sometimes - after the network is ok again - and you have patience and wait
2-3 hours the broker will tries to resolve the messages queues and succeded
to do it last time.<br> <br>Best regards<br>Tue<br> </font><font size=3 face="Calibri"><b><br>From:</b> NetarchiveSuite-users <</font><a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org"><font size=3 color=blue face="Calibri"><u>netarchivesuite-users-bounces@ml.sbforge.org</u></font></a><font size=3 face="Calibri">>
<b>On Behalf Of </b>Peter Svanberg<b><br>Sent:</b> Wednesday, August 28, 2024 6:01 PM<b><br>To:</b> </font><a href="mailto:netarchivesuite-users@ml.sbforge.org"><font size=3 color=blue face="Calibri"><u>netarchivesuite-users@ml.sbforge.org</u></font></a><font size=3 face="Calibri"><b><br>Subject:</b> [Netarchivesuite-users] Preparing for and handling planned
network outage during broad crawl<br> <br>Hello!<br> <br>There will be network service work at our site next weekend (7-8 Aug.).
No figures on outage but they will change hardware so probably many minutes,
maybe hours. Our current broad crawl pass is perhaps not finished then.
How do you minimize the consequences in NAS?<br> <br>Pause all running jobs before and unpause them after? That would minimize
the effects of the ongoing crawls.<br> <br>But what will happen with the other processes and connections? Will the
processes have to be restarted? And also the unpaused jobs, when they are
ready, to make them reconnect? (I'm guessing wildly/groping blindly …)
Anyone have experience?<br> <br> </font><p><table width=394 style="border-collapse:collapse;"><tr height=8><td width=113 style="border-style:solid;border-color:#000000;border-width:0px 3px 0px 0px;padding:0px 0px;"><td width=278 style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 3px;padding:0px 0px;"><font size=3 face="Arial"><b>Peter
Svanberg<br>Technical officer </b><br>Aquisitions and Metadata Department<br>Film, Games, Sheet Music and Web Unit<br> <b><br>National Library of Sweden</b><br>PO Box 5039, SE-102 41 Stockholm<br>Visits: Karlavägen 96, Stockholm<br>+46 10-709 32 78</font><font size=3 color=blue face="Times New Roman"><u><br></u></font><a href=mailto:Peter.Svanberg@kb.se><font size=3 color=#0082bf face="Arial"><u>Peter.Svanberg@kb.se</u></font></a><font size=3 color=blue face="Times New Roman"><u><br></u></font><a href=https://www.kb.se/><font size=3 color=blue face="Arial"><u>www.kb.se</u></font></a></table><p><font size=3 face="Calibri"><br> <br> </font><font size=3 face="Courier New">_______________________________________________<br>NetarchiveSuite-users mailing list</font><font size=3 color=blue face="Courier New"><u><br></u></font><a href="mailto:NetarchiveSuite-users@ml.sbforge.org"><font size=3 color=blue face="Courier New"><u>NetarchiveSuite-users@ml.sbforge.org</u></font></a><font size=3 color=blue face="Times New Roman"><u><br></u></font><a href="https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users"><font size=3 color=blue face="Courier New"><u>https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users</u></font></a><div align=center><hr></div><p><font size=3 face="Arial">Venez découvrir le </font><a href="https://www.bnf.fr/fr/le-musee-de-la-bnf"><font size=3 color=blue face="Arial"><b><u>le
musée de la BnF à Richelieu</u></b></font></a><font size=3 face="Arial">.</font><p><font size=3 color=#008000 face="Arial"><b>Avant d'imprimer, pensez
à l'environnement.</b></font><tt><font size=2>_______________________________________________<br>NetarchiveSuite-users mailing list<br>NetarchiveSuite-users@ml.sbforge.org<br></font></tt><a href="https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users"><tt><font size=2>https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users</font></tt></a><tt><font size=2><br></font></tt><p><font face="sans-serif"><hr />
<p>Venez découvrir le <strong><a href="https://www.bnf.fr/fr/le-musee-de-la-bnf">le musée de la BnF à Richelieu</a></strong>.</p>
<p style="color:#008000"><strong>Avant d'imprimer, pensez à l'environnement.</strong></p></font>