<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p>Hi!</p>
<p><br>
</p>
<p>That's hard to diagnose exactly because the unix sort command gives return code 2 for all errors. What you can try to do is run the same sort command by hand, something like</p>
<p><br>
</p>
<p>sort <all the files in batchOutputDir> -o <span style="font-size: 12pt;">aggregator_tempdir/temp.index</span><span style="font-size: 12pt;"> </span><span style="font-size: 12pt;">-T </span><span style="font-size: 12pt;">aggregator_tempdir</span></p>
<p><br>
</p>
<p>then you should be able to see the actual cause of the error. My guess is that you have one of</p>
<p>i) a drive that is too full to write to</p>
<p>ii) an error in your write permissions</p>
<p>iii) a problem with too many files to be sorted at once</p>
<p><br>
</p>
<p>cheers,</p>
<p>Colin</p>
<p><br>
</p>
<div id="Signature">
<div name="divtagdefaultwrapper" style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:; margin:0">
<div>--</div>
<div>Colin Rosenthal PhD</div>
<div>Senior IT Consultant</div>
<div>Royal Danish Library (Aarhus)</div>
</div>
</div>
<br>
<br>
<div style="color: rgb(0, 0, 0);">
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> NetarchiveSuite-users <netarchivesuite-users-bounces@ml.sbforge.org> on behalf of García Arratia, Juan Carlos <juancarlos.garcia@bne.es><br>
<b>Sent:</b> Friday, December 13, 2019 11:24 AM<br>
<b>To:</b> netarchivesuite-users@ml.sbforge.org<br>
<b>Cc:</b> Serrano Benavente, Nuria; Archivoweb<br>
<b>Subject:</b> [Netarchivesuite-users] Problem wih IndexAggregator</font>
<div> </div>
</div>
<div>
<div style="">
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN" style="font-size:10.0pt; font-family:"Courier New"">For some time we have problems with the Application Aggregator. Therefore we do not have the updated Openwayback indexes and the collections made do not appear.
</span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN" style="font-size:10.0pt; font-family:"Courier New"">This message appears in the logs:</span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:10.0pt; font-family:"Courier New""> </span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">“[AggregatorThread] ERROR dk.netarkivet.wayback.aggregator.IndexAggregator - Failed to sort index files, sort exited with return code 2”</span><span lang="EN-US"></span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US"> </span></p>
<pre style="margin: 0cm 0cm 0.0001pt; font-size: 10pt; font-family: "Courier New";"><span lang="EN">The configuration we have is as follows:</span><span lang="EN-US"></span></pre>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Symbol; color:black"><span style="">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">settings_AggregatorApplication.xml:</span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"><aggregator></span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> <indexFileInputDir>batchOutputDir</indexFileInputDir></span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> <indexFileOutputDir>indexDir</indexFileOutputDir></span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> <tempAggregatorDir>aggregator_tempdir</tempAggregatorDir></span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> <aggregationInterval><b>2400000</b></aggregationInterval></span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> <maxIntermediateIndexFileSize><b>2048576</b></maxIntermediateIndexFileSize></span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> <maxMainIndexFileSize><b>304857600</b></maxMainIndexFileSize></span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"></aggregator></span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> </span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Symbol; color:black"><span style="">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">File size:</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"><span style="">o<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">-rw-rw-r-- 1 netarchive netarchive
<b>79356293120</b> dic 11 22:58 wayback.index</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"><span style="">o<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">-rw-rw-r-- 1 netarchive netarchive
<b>1279525993</b> dic 13 06:55 wayback_intermediate.index</span></p>
<p style="background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> </span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Symbol; color:black"><span style="">·<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">Server:</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"><span style="">o<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">Java version:
</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Wingdings; color:black"><span style="">§<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">openjdk version "<b>1.8.0_131</b>"</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Wingdings; color:black"><span style="">§<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">OpenJDK Runtime Environment (build 1.8.0_131-b12)</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Wingdings; color:black"><span style="">§<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">OpenJDK 64-Bit Server VM (build 25.131-b12, mixed mode)</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"><span style="">o<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">Memory:</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Wingdings; color:black"><span style="">§<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">MemTotal:
<b>131903488</b> kB</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Wingdings; color:black"><span style="">§<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">MemFree:
<b>48043984</b> kB</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Wingdings; color:black"><span style="">§<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">MemAvailable:
<b>128086540</b> kB</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"><span style="">o<span style="font:7.0pt "Times New Roman"">
</span></span></span><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">File system:</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Wingdings; color:black"><span style="">§<span style="font:7.0pt "Times New Roman"">
</span></span></span><b><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">76 GB</span></b><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> usados</span></p>
<p style="text-indent: -18pt; background: white; margin: 0cm 0cm 0.0001pt 36pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="font-size:9.0pt; font-family:Wingdings; color:black"><span style="">§<span style="font:7.0pt "Times New Roman"">
</span></span></span><b><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black">75 GB</span></b><span lang="EN-US" style="font-size:9.0pt; font-family:"Courier New"; color:black"> disponibles</span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
Regards</p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Un saludo </span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">-------------------------------------------------------------------------
</span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Juan Carlos García Arratia </span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Jefe de Servicio de Tecnologías de la Información</span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Biblioteca Nacional de España </span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Paseo de Recoletos 20-22 </span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">28071 Madrid </span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Tlfno: 91 580 78 19</span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Fax: 91 516 89 07</span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">e-mail: jcgarcia@bne.es </span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">------------------------------------------------------------------------</span></p>
<p style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
</div>
<hr width="100%">
<font size="1">Este mensaje y cualquier fichero adjunto están dirigidos únicamente a sus destinatarios y contiene información confidencial. Si usted ha recibido este correo electrónico por error, le informamos que no puede realizar ninguna revisión, alteración,
impresión, copia, transmisión, difusión ni utilización alguna de este mensaje ni de cualquier fichero adjunto que pudiese contener. La realización de cualquiera de los actos indicados está expresamente prohibida por las Normas que regulan estas materias. Por
todo ello se solicita que, en caso de existir error en la recepción de este mensaje, se lo notifique al remitente respondiendo a este e-mail y elimine el mensaje y su contenido inmediatamente. La Biblioteca Nacional de España se reserva las acciones legales
que le correspondan en el caso de que se infrinja lo indicado anteriormente.</font>
<hr width="100%">
<font size="1">The information in this e-mail and any attachments is confidential and it is intended for the addressee only. If you have received this e-mail in error, you are notified that any revision, amendment, print, copy, disclosure, distribution or use
of the contents is unauthorized. Carrying out any of the above actions, is expressly banned by rules governing this matter. Hence we request that if you are not the intended recipient, please notify the sender answering this e-mail, and delete the message
and any attachments. The National Library of Spain reserves itself the right to take the appropriate legal actions in the event of the above mentioned matter is being infringed.</font>
<hr width="100%">
</div>
</div>
</div>
</body>
</html>