<font size=2 face="sans-serif">Hello Miguel,</font><br><br><font size=2 face="sans-serif">What version of the broker do you use?
</font><br><br><font size=2 face="sans-serif">I cannot explain what happened to your
broker, but we once had similar problems which occurred during our snapshot
crawl. It turned out that the version we used then, Message Queue 5.1,
was unstable in a NAS environment. We changed to Open Message Queue 4.5.2
and we never had problems again. So maybe this will help you, too.</font><br><br><font size=2 face="sans-serif">Although OpenMQ 4.5.2 is rather old
now, it perfectly does its job and there are no issues of incompatibility
with NAS at all. </font><br><br><font size=2 face="sans-serif">We use this configuration:</font><br><font size=2 face="sans-serif">imq.jms.min_threads=10</font><br><font size=2 face="sans-serif">imq.instanceconfig.version=300</font><br><font size=2 face="sans-serif">imq.autocreate.destination.maxNumProducers=-1</font><br><font size=2 face="sans-serif">imq.jms.tcp.port=33700</font><br><font size=2 face="sans-serif">imq.autocreate.queue.maxNumActiveConsumers=100</font><br><font size=2 face="sans-serif">imq.jms.max_threads=1000</font><br><br><font size=2 face="sans-serif">and JVM parameters: -Xms512m -Xmx2048m
-Xss512k</font><br><br><font size=2 face="sans-serif">So, -Xms24g in your config is really
heavy! Are you sure you need that much?</font><br><br><font size=2 face="sans-serif">Regards,</font><br><font size=2 face="sans-serif"> Bert</font><br><font size=2 face="sans-serif">-- <br>Ingénieur de production pour l'archivage de l'internet<br>Département des systèmes d'information<br>Bibliothèque nationale de France<br>Quai François-Mauriac<br>75706 Paris Cedex 13<br>Tél. : 01 53 79 45 58</font><br><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">De :
</font><font size=1 face="sans-serif">"PE-BDH-002"
<pebdh002@bne.es></font><br><font size=1 color=#5f5f5f face="sans-serif">A :
</font><font size=1 face="sans-serif">"'netarchivesuite-users@ml.sbforge.org'"
<netarchivesuite-users@ml.sbforge.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Cc :
</font><font size=1 face="sans-serif">"Monzón,
Fernando" <f.monzon@bne.es></font><br><font size=1 color=#5f5f5f face="sans-serif">Date :
</font><font size=1 face="sans-serif">06/05/2021 12:26</font><br><font size=1 color=#5f5f5f face="sans-serif">Objet :
</font><font size=1 face="sans-serif">[Netarchivesuite-users]
NAS - Problems with Broker</font><br><font size=1 color=#5f5f5f face="sans-serif">Envoyé par :
</font><font size=1 face="sans-serif">"NetarchiveSuite-users"
<netarchivesuite-users-bounces@ml.sbforge.org></font><br><hr noshade><br><br><br><font size=3 face="Calibri">Hi!</font><br><font size=3 face="Calibri">I’m Miguel Soleto, from the National Library
of Spain. I will try to explain the problems We are having with the Broker.</font><br><font size=3 face="Calibri">First, this is the architecture of our
installation (each module on a different machine). NAS Version: 5.4.2:</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">4
BitArchives.</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">1
Aggregator.</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">2
Indexers.</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">3
OpenWayback.</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">1
Broker.</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">1
Postgresql database (1 Master and 1 Slave).</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">1
IndexServerApplication and 1 ViewerProxyApplication.</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">1
GUIApplication, 1 ArcRepositoryApplication, 1 BitarchiveMonitorApplication
and 1 HarvestJobManagerApplication.</font><br><font size=3 face="Symbol">· </font><font size=3 face="Calibri">110
Spiders, Working 80, the other 30 doing nothing.</font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">Here are the issues We are experiencing:
</font><br><font size=3 face="Calibri">This Sunday (2nd May), the Broker seemed
to work, but no Jobs were running. With a ps command on the machine, We
saw the Java process of the Broker, but We had lots of “Connection refused”
on the logs of the GUIApplication. After that, We killed the Java process
(Broker machine) and a few minutes later, it seemed to be OK again.</font><br><font size=3 face="Calibri">This Tuesday, the Java process of the Broker
died with no apparent reason. In that moment, We realized that the file
“config.properties” were overwritten, and every line on that file was
commented, except for the last one: </font><br><font size=3 face="Calibri">#Last Update:</font><br><font size=3 face="Calibri">#Tue May 04 09:22:52 CEST 2021 </font><br><font size=3 face="Calibri"><b>imq.instanceconfig.version=300</b></font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">After that, We re-launched the Java process
again, and everything were OK.</font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">Yesterday, We had the same problem: the
Broker died with apparently no reason.</font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">On the GUIApplication logs, We have the
error code “C4056”. I have searched for that code, and this is what Oracle
says: <b>Cause A Message Queue client received a GOOD_BYE message from
broker. </b></font><br><font size=3 face="Calibri"><b> </b></font><br><font size=3 face="Calibri">So, We are worried about the performance
of the Broker, beacuse when It dies, all the platform stops working. We
had a BASH script on the Broker machine that looks for the process: if
It isn’t running, It send us an e-mail. </font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">Has anyone had a problem like this? Any
idea about what is happening in our NAS installation? May be a memory problem,
or just too much conections for the Broker? Should I send our “default.properties”
file to you? Any guide or documentation about the config.properties or
default.properties parameters?</font><br><font size=3 face="Calibri">The Broker process is configured with this
parameters: -Xms24g -Xmx24g -Xss192m -XX:MaxGCPauseMillis=5000.</font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">Thank you all!</font><br><font size=3 face="Calibri">Best regards,</font><br><font size=3 face="Calibri">Miguel.</font><p><hr><font size=1>Este mensaje y cualquier fichero adjunto están dirigidos
únicamente a sus destinatarios y contiene información confidencial. Si
usted ha recibido este correo electrónico por error, le informamos que
no puede realizar ninguna revisión, alteración, impresión, copia, transmisión,
difusión ni utilización alguna de este mensaje ni de cualquier fichero
adjunto que pudiese contener. La realización de cualquiera de los actos
indicados está expresamente prohibida por las Normas que regulan estas
materias. Por todo ello se solicita que, en caso de existir error en la
recepción de este mensaje, se lo notifique al remitente respondiendo a
este e-mail y elimine el mensaje y su contenido inmediatamente. La Biblioteca
Nacional de España se reserva las acciones legales que le correspondan
en el caso de que se infrinja lo indicado anteriormente.</font><font size=3></font><hr><font size=1>The information in this e-mail and any attachments is
confidential and it is intended for the addressee only. If you have received
this e-mail in error, you are notified that any revision, amendment, print,
copy, disclosure, distribution or use of the contents is unauthorized.
Carrying out any of the above actions, is expressly banned by rules governing
this matter. Hence we request that if you are not the intended recipient,
please notify the sender answering this e-mail, and delete the message
and any attachments. The National Library of Spain reserves itself the
right to take the appropriate legal actions in the event of the above mentioned
matter is being infringed.</font><font size=3> </font><hr><tt><font size=2>_______________________________________________<br>NetarchiveSuite-users mailing list<br>NetarchiveSuite-users@ml.sbforge.org<br></font></tt><a href="https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users"><tt><font size=2>https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users</font></tt></a><tt><font size=2><br></font></tt><p><font face="sans-serif"><hr />
<p>En raison des directives gouvernementales liées à la situation sanitaire, les expositions restent fermées jusqu'à nouvelle consigne. Les manifestations culturelles ne peuvent pas accueillir de public mais sont en grande partie <a href="https://www.bnf.fr/fr/actualites/retrouvez-les-conferences-de-janvier-2021-en-ligne">diffusées en ligne</a>.</p>
<p>La bibliothèque tous publics est ouverte du mardi au vendredi de 10 h à 17 h.<br />
Les bibliothèques de recherche sont ouvertes, sur le site François-Mitterrand, le lundi de 14 h à 17 h et du mardi au vendredi de 10 h à 17 h, et, sur les sites Richelieu, Arsenal et Opéra, de 10 h à 17 h du lundi au vendredi. <a href="https://www.bnf.fr/fr/reouverture-des-salles-de-lecture-de-la-bnf-modalites-dacces">Consulter les modalités d'accès</a></p>
<p style="color:#008000"><strong>Avant d'imprimer, pensez à l'environnement.</strong></p></font>