<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
tt
{mso-style-priority:99;
font-family:"Courier New";}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:#1F497D;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1508709992;
mso-list-type:hybrid;
mso-list-template-ids:-2099466556 69009423 69009433 69009435 69009423 69009433 69009435 69009423 69009433 69009435;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DA" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Normally we only have planned network downtime < 15 min. If the network down time is unprepared and takes longer the
below description is a realistic JMS broker message scenario - at our site<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Best regards<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">Tue<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> NetarchiveSuite-users <netarchivesuite-users-bounces@ml.sbforge.or</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">g>
<b>On Behalf Of </b>Peter Svanberg<br>
<b>Sent:</b> Friday, August 30, 2024 1:29 PM<br>
<b>To:</b> netarchivesuite-users@ml.sbforge.org<br>
<b>Subject:</b> Re: [Netarchivesuite-users] Preparing for and handling planned network outage during broad crawl<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">Hello Tue and Sara!<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">Sara confirms my draft plan.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-18.0pt;mso-list:l0 level1 lfo2"><![if !supportLists]><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080"><span style="mso-list:Ignore">1.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">Pause all ongoing jobs, so far in advance that there is no risk of jobs being in post-processing.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-18.0pt;mso-list:l0 level1 lfo2"><![if !supportLists]><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080"><span style="mso-list:Ignore">2.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">Deactivate/postpone start of selective jobs.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="text-indent:-18.0pt;mso-list:l0 level1 lfo2"><![if !supportLists]><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080"><span style="mso-list:Ignore">3.<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">After outage: unpause all paused jobs. (Much clicking … maybe can be scripted.)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">But what happens then? The unpaused jobs continue and post-processing works?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">And if that works, does the queue handling and connections between the main server and all harvester instances remain so new jobs are created, or must something be
restarted?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">Tue, did you describe what happens if you do no preparing?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">Best regards</span><span lang="EN-US"><br>
</span><span lang="EN-US" style="font-family:"Calibri",sans-serif;color:#004080">Peter<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">Från:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> NetarchiveSuite-users <<a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org">netarchivesuite-users-bounces@ml.sbforge.org</a>>
<b>För </b><a href="mailto:sara.aubry@bnf.fr">sara.aubry@bnf.fr</a><br>
<b>Skickat:</b> den 29 augusti 2024 10:42<br>
<b>Till:</b> <a href="mailto:netarchivesuite-users@ml.sbforge.org">netarchivesuite-users@ml.sbforge.org</a><br>
<b>Ämne:</b> Re: [Netarchivesuite-users] Preparing for and handling planned network outage during broad crawl<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="SV" style="font-size:10.0pt;font-family:"Arial",sans-serif">Hello Peter,</span><span lang="SV"><br>
<br>
</span><span lang="SV" style="font-size:10.0pt;font-family:"Arial",sans-serif">Planned network outage is a lot easier to handle than unexpected ones!</span><span lang="SV"><br>
<br>
</span><span lang="SV" style="font-size:10.0pt;font-family:"Arial",sans-serif">At BnF, we paused all running jobs until we have the confirmation everything is back to normal. We already did this during broad crawls so for more than 60 cralwers.</span><span lang="SV"><br>
</span><span lang="SV" style="font-size:10.0pt;font-family:"Arial",sans-serif">The challenge is to make sure you have no new job to start, so we temporarily desactivate the Selective harvests.</span><span lang="SV"><br>
</span><span lang="SV" style="font-size:10.0pt;font-family:"Arial",sans-serif">If we have jobs at a post-processing stage that we cannot paused, we stop the HarvestController by putting a shutdown.txt file in the job directory.. </span><span lang="SV"><br>
<br>
</span><span lang="SV" style="font-size:10.0pt;font-family:"Arial",sans-serif">Best,</span><span lang="SV"><br>
<br>
</span><span lang="SV" style="font-size:10.0pt;font-family:"Arial",sans-serif">Sara</span><span lang="SV"><br>
<br>
<br>
<br>
</span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">De : </span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif">"Tue Hejlskov Larsen" <<a href="mailto:tlr@kb.dk">tlr@kb.dk</a>></span><span lang="SV"><br>
</span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">A : </span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif">"<a href="mailto:netarchivesuite-users@ml.sbforge.org">netarchivesuite-users@ml.sbforge.org</a>"
<<a href="mailto:netarchivesuite-users@ml.sbforge.org">netarchivesuite-users@ml.sbforge.org</a>></span><span lang="SV"><br>
</span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Date : </span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif">29/08/2024 08:42</span><span lang="SV"><br>
</span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Objet : </span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif">Re: [Netarchivesuite-users] Preparing for and handling planned network outage
during broad crawl</span><span lang="SV"><br>
</span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Envoyé par : </span><span lang="SV" style="font-size:7.5pt;font-family:"Arial",sans-serif">"NetarchiveSuite-users" <<a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org">netarchivesuite-users-bounces@ml.sbforge.org</a>></span><span lang="SV"><o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span lang="SV">
<hr size="3" width="100%" noshade="" style="color:#A0A0A0" align="center">
</span></div>
<p class="MsoNormal"><span lang="SV"><br>
<br>
<br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080">Hello Peter,</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080"> </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080">It depends on your max messages queues settings in the Open JMs broker properties and how long time there is no network. Our installation breaks down if it loose the network connection
more than an 10 – 30 min..dependend on what’a running </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080">If the message queues hIt the maximum there is normally no other way than restart the whole platform and all running harvesterjobs needs to be restarted.
</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080">You can try to restart the GUI it will try to empty the JMS queues. And sometimes - after the network is ok again - and you have patience and wait 2-3 hours the broker will tries
to resolve the messages queues and succeded to do it last time.</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080"> </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080">Best regards</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080">Tue</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif;color:#004080"> </span><span lang="SV"><br>
</span><b><span lang="SV" style="font-family:"Calibri",sans-serif">From:</span></b><span lang="SV" style="font-family:"Calibri",sans-serif"> NetarchiveSuite-users <<a href="mailto:netarchivesuite-users-bounces@ml.sbforge.org">netarchivesuite-users-bounces@ml.sbforge.org</a>>
<b>On Behalf Of </b>Peter Svanberg<b><br>
Sent:</b> Wednesday, August 28, 2024 6:01 PM<b><br>
To:</b> <a href="mailto:netarchivesuite-users@ml.sbforge.org">netarchivesuite-users@ml.sbforge.org</a><b><br>
Subject:</b> [Netarchivesuite-users] Preparing for and handling planned network outage during broad crawl</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif"> </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif">Hello!</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif"> </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif">There will be network service work at our site next weekend (7-8 Aug.). No figures on outage but they will change hardware so probably many minutes, maybe hours. Our current broad crawl pass is
perhaps not finished then. How do you minimize the consequences in NAS?</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif"> </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif">Pause all running jobs before and unpause them after? That would minimize the effects of the ongoing crawls.</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif"> </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif">But what will happen with the other processes and connections? Will the processes have to be restarted? And also the unpaused jobs, when they are ready, to make them reconnect? (I'm guessing wildly/groping
blindly …) Anyone have experience?</span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif"> </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif"> </span><span lang="SV"><o:p></o:p></span></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="0" style="width:295.5pt;border-collapse:collapse">
<tbody>
<tr style="height:4.8pt">
<td width="113" style="width:84.75pt;border:solid black 1.0pt;padding:0cm 0cm 0cm 0cm;height:4.8pt">
</td>
<td width="281" style="width:210.75pt;border:solid black 1.0pt;border-left:none;padding:0cm 0cm 0cm 0cm;height:4.8pt">
<p class="MsoNormal"><b><span style="font-family:"Arial",sans-serif">Peter Svanberg</span></b><br>
<b><span style="font-family:"Arial",sans-serif">Technical officer </span></b><br>
<span style="font-family:"Arial",sans-serif">Aquisitions and Metadata Department<br>
Film, Games, Sheet Music and Web Unit</span><br>
<span style="font-family:"Arial",sans-serif"> </span><br>
<b><span style="font-family:"Arial",sans-serif">National Library of Sweden</span></b><br>
<span style="font-family:"Arial",sans-serif">PO Box 5039, SE-102 41 Stockholm</span><br>
<span style="font-family:"Arial",sans-serif">Visits: Karlavägen 96, Stockholm</span><br>
<span style="font-family:"Arial",sans-serif">+46 10-709 32 78</span><br>
<a href="mailto:Peter.Svanberg@kb.se"><span style="font-family:"Arial",sans-serif;color:#0082BF">Peter.Svanberg@kb.se</span></a><br>
<a href="https://www.kb.se/"><span style="font-family:"Arial",sans-serif">www.kb.se</span></a><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p style="margin-bottom:12.0pt"><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif"> </span><span lang="SV"><br>
</span><span lang="SV" style="font-family:"Calibri",sans-serif"> </span><tt><span lang="SV" style="font-size:10.0pt">_______________________________________________</span></tt><span lang="SV" style="font-size:10.0pt;font-family:"Courier New""><br>
<tt>NetarchiveSuite-users mailing list</tt><br>
<tt><a href="mailto:NetarchiveSuite-users@ml.sbforge.org">NetarchiveSuite-users@ml.sbforge.org</a></tt><br>
</span><span lang="SV"><a href="https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users"><tt><span style="font-size:10.0pt">https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users</span></tt></a></span><span lang="SV" style="font-family:"Arial",sans-serif"><o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span lang="SV" style="font-family:"Arial",sans-serif">
<hr size="3" width="100%" align="center">
</span></div>
<p><span lang="SV" style="font-family:"Arial",sans-serif">Venez découvrir le <strong>
<span style="font-family:"Arial",sans-serif"><a href="https://www.bnf.fr/fr/le-musee-de-la-bnf">le musée de la BnF à Richelieu</a></span></strong>.<o:p></o:p></span></p>
<p><strong><span lang="SV" style="font-family:"Arial",sans-serif;color:green">Avant d'imprimer, pensez à l'environnement.</span></strong><span lang="SV" style="font-family:"Arial",sans-serif;color:green"><o:p></o:p></span></p>
</div>
</body>
</html>