<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" dir="ltr" style="font-size: 12pt; color: rgb(0, 0, 0); font-family: Calibri, Helvetica, sans-serif, EmojiFont, "Apple Color Emoji", "Segoe UI Emoji", NotoColorEmoji, "Segoe UI Symbol", "Android Emoji", EmojiSymbols;">
<p>Hello Peter</p>
<p><br>
</p>
<p>For a couple years ago we had similar problems with to high volumen of messages/communicaton between harvesters and HarvestJobManager and the GUIApplication. The GUI hang and messageques where overloaded with too mutch trafic. We lowered the number of calls,
minimized retries, and delayed answers and repsonses in the settings files and perhaps also in the code. The last thing did Colin - i don't remeber where in the code.</p>
<p><br>
</p>
<p>I have attached relevant common snips from our GUIApplication, HarvestJobManager and and broadcrawl Harvester settings files.</p>
<p><br>
</p>
<p>If the trick is hided in the NAS code section for default values i need to investigate that further together with Colin.</p>
<p><br>
</p>
<p>Which options do you use for your imqcmd listning?</p>
<p>Normally I only use the <span style="font-size: 12pt;">imqcmd list dst to see if there are something wrong with the JMS queues. </span></p>
<p><br>
</p>
<p>Best regards</p>
<p>Tue</p>
<div><br>
</div>
<div><br>
</div>
<div>
<div> <jms></div>
<div> ..</div>
<div></div>
<div> <retries>10</retries></div>
<div> ..</div>
<div></div>
<div> </jms></div>
<div></div>
<div style="font-family:Calibri,Helvetica,sans-serif,EmojiFont,"Apple Color Emoji","Segoe UI Emoji",NotoColorEmoji,"Segoe UI Symbol","Android Emoji",EmojiSymbols; font-size:16px">
..</div>
<div style="font-family:Calibri,Helvetica,sans-serif,EmojiFont,"Apple Color Emoji","Segoe UI Emoji",NotoColorEmoji,"Segoe UI Symbol","Android Emoji",EmojiSymbols; font-size:16px">
<div> <jmx></div>
<div> ..</div>
<div></div>
<div> <timeout>120</timeout></div>
<div> ..</div>
<div> </jmx></div>
</div>
<div></div>
<div> <span style="font-size:12pt">..</span></div>
<div><span style="font-size:12pt">
<div> <monitor></div>
<div> ..</div>
<div></div>
<div> <jmxProxyTimeout>500</jmxProxyTimeout></div>
<div> ..</div>
<div></div>
<div> <reregisterDelay>10</reregisterDelay></div>
<div> </monitor></div>
<div> </div>
<div> <heritrix></div>
<div><span style="font-size: 12pt;"> <inactivityTimeout>1800</inactivityTimeout></span><br>
</div>
<div> <noresponseTimeout>1800</noresponseTimeout></div>
<div> <crawlLoopWaitTime>60</crawlLoopWaitTime></div>
<div><span style="font-size: 12pt;"> ..</span></div>
<div><span style="font-size: 12pt;"></heritrix></span><br>
</div>
<div> <frontier></div>
<div> <!-- 2 minutes --></div>
<div> <frontierReportWaitTime>120</frontierReportWaitTime></div>
<div>..</div>
<div></div>
<div> </frontier></div>
<div><br>
</div>
<div>
<div>
<div><br>
</div>
<div><br>
</div>
<div>
<div></div>
<br>
</div>
<div><br>
</div>
<br>
</div>
<br>
</div>
<br>
</span></div>
<div><span style="font-size:12pt"><br>
</span></div>
<div style="color:rgb(0,0,0)">
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>Fra:</b> NetarchiveSuite-users <netarchivesuite-users-bounces@ml.sbforge.org> på vegne af Peter Svanberg <Peter.Svanberg@kb.se><br>
<b>Sendt:</b> 8. november 2023 14:04<br>
<b>Til:</b> netarchivesuite-users@ml.sbforge.org<br>
<b>Emne:</b> [Netarchivesuite-users] Messaging (openmq) problems: looping (?) messages, > 6000 per second in and out</font>
<div> </div>
</div>
<div>
<div class="WordSection1">
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB">We have recurring problems (in July in both test and production and now just in test) with lots of messaging in the queue for sending HarvesterRegistrationResponse.</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB"> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB">Over 6000 messages per second (see below) in both directions, figures which are normally 0.</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB"> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB">Is cured by stopping all harvesters, restarting openq on the admin server and then starting harvesters.</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB"> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB">Anyone else have had this? Any hints on what it could be? Or if we should debug in some way before we restart?
</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB"> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB">Currently the openmq process gets 120 % CPU while the NAS processes get less than 1 % now and then. I suppose this indicates that something is looping internally in the openmq process. But why …?</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB"> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">Displaying destination metrics where:</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New""> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">-----------------------------------------------</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">Destination Name Destination Type</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">-----------------------------------------------</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">PLIKT_COMMON_HCHAN_VAL_RESP Queue</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New""> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">On the broker specified by:</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New""> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">-------------------------</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">Host Primary Port</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">-------------------------</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">localhost 7676</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New""> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">----------------------------------------------------------------------------------</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">Msgs/sec Msg Bytes/sec Msg Count Total Msg Bytes (k) Largest</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">In Out In Out Current Peak Avg Current Peak Avg Msg (k)</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">----------------------------------------------------------------------------------</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">0 0 0 0 9 16 10 6 12 8 < 1</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">5848 5847 4650296 4649825 10 16 10 7 12 8 < 1</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">5920 5921 4707657 4707976 10 16 10 7 12 8 < 1</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">5818 5817 4626266 4625949 12 16 10 9 12 8 < 1</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">5784 5784 4599286 4599763 8 16 10 6 12 8 < 1</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">5970 5969 4747221 4746267 15 16 10 11 12 8 < 1</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Courier New"">5830 5831 4635982 4636777 10 16 10 7 12 8 < 1</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB"> </span></p>
<table class="MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:0cm 0cm 0cm 0cm">
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<a href="https://www.kb.se/" style="color:rgb(5,99,193); text-decoration:underline"><span style="font-size:9.0pt; font-family:"Arial",sans-serif; color:blue; text-decoration:none"><img border="0" width="113" height="170" id="_x0000_i1025" alt="KB Logo" style="width: 1.177in; height: 1.7708in; user-select: none;" src="https://signaturloggor.kb.se/png/Outlook%20logo%20m%d0%a4rkbl%d0%96.png"></span></a><span style="font-size:9.0pt; font-family:"Arial",sans-serif; color:black"></span></p>
</td>
<td style="padding:0cm 0cm 0cm 5.25pt">
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<b><span lang="EN-GB" style="font-size:9.0pt; font-family:"Arial",sans-serif; color:black">Peter Svanberg</span></b><span lang="EN-GB" style="font-size:9.0pt; font-family:"Arial",sans-serif; color:black"></span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<b><span lang="EN-GB" style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black">Technical officer
</span></b><span lang="EN-GB" style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black"></span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black">Aquisitions and Metadata Department<br>
Film, Games, Sheet Music and Web Unit</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:9.0pt; font-family:"Arial",sans-serif; color:black"> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<b><span lang="EN-GB" style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black">National Library of Sweden</span></b><span lang="EN-GB" style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black"></span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span lang="EN-GB" style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black">PO Box 5039, SE-102 41 Stockholm</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black">Visits: Karlavägen 96, Stockholm</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black">+46 10-709 32 78</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black">Peter.Svanberg@kb.se</span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span style="font-size:8.0pt; font-family:"Arial",sans-serif; color:black"><a href="https://www.kb.se/" style="color:rgb(5,99,193); text-decoration:underline"><span style="color:blue">www.kb.se</span></a></span></p>
</td>
</tr>
</tbody>
</table>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
<span style=""> </span></p>
<p style="margin:0cm 0cm 0.0001pt; font-size:11pt; font-family:Calibri,sans-serif">
</p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>