<font size=2 face="sans-serif">Hi Miguel,</font><br><br><font size=2 face="sans-serif">The limit of opened files you have defined
on your system is probably too low.</font><br><font size=2 face="sans-serif">See </font><a href=https://linuxcommand.org/lc3_man_pages/ulimith.html><font size=2 face="sans-serif">https://linuxcommand.org/lc3_man_pages/ulimith.html</font></a><br><br><font size=2 face="sans-serif">At BnF, we set it to unlimited for the
harvest controllers (and never had any issue).</font><br><font size=2 face="sans-serif">But you could at least double the number
you have set.</font><br><br><font size=2 face="sans-serif">Sara </font><br><br><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">De :
</font><font size=1 face="sans-serif">"Soleto Ruiz de
Clavijo, Miguel" <miguel.soleto@externos.bne.es></font><br><font size=1 color=#5f5f5f face="sans-serif">A :
</font><font size=1 face="sans-serif">"'netarchivesuite-users@ml.sbforge.org'"
<netarchivesuite-users@ml.sbforge.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Cc :
</font><font size=1 face="sans-serif">"García
Arratia, Juan Carlos" <juancarlos.garcia@bne.es>, "Monzón,
Fernando" <f.monzon@bne.es></font><br><font size=1 color=#5f5f5f face="sans-serif">Date :
</font><font size=1 face="sans-serif">20/09/2021 09:42</font><br><font size=1 color=#5f5f5f face="sans-serif">Objet :
</font><font size=1 face="sans-serif">[Netarchivesuite-users]
Problem with a spider</font><br><font size=1 color=#5f5f5f face="sans-serif">Envoyé par :
</font><font size=1 face="sans-serif">"NetarchiveSuite-users"
<netarchivesuite-users-bounces@ml.sbforge.org></font><br><hr noshade><br><br><br><font size=3 face="Calibri">Hi!</font><br><font size=3 face="Calibri">I’m Miguel Soleto, from the National Library
of Spain. We have had a problem this weekend with a spider. Although the
spider was working, We can’t see anything on the interface. Here is what
I’ve seen on the log (heritrix3_err.log):</font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri"><i>2021-09-20 07:02:37.245 INFO thread-21
org.archive.crawler.reporting.StatisticsTracker.writeReportFile() wrote
report: /netarchive/BNE/harvester_high/71215_1632093369236/heritrix3/./jobs/71215_1632093369236/20210919231620/reports/processors-report.txt</i></font><br><font size=3 face="Calibri"><i>2021-09-20 07:02:37.245 GRAVE thread-21
org.archive.crawler.reporting.StatisticsTracker.writeReportFile() Unable
to write /netarchive/BNE/harvester_high/71215_1632093369236/heritrix3/./jobs/71215_1632093369236/20210919231620/reports/frontier-summary-report.txt
at the end of crawl.</i></font><br><font size=3 face="Calibri"><i>java.io.FileNotFoundException: /netarchive/BNE/harvester_high/71215_1632093369236/heritrix3/./jobs/71215_1632093369236/20210919231620/reports/frontier-summary-report.txt
(</i></font><font size=3 color=red face="Calibri"><i>Demasiados ficheros
abiertos</i></font><font size=3 face="Calibri"><i>)</i></font><br><font size=3 face="Calibri"><i>
at java.io.FileOutputStream.open0(Native Method)</i></font><br><font size=3 face="Calibri"><i>
at java.io.FileOutputStream.open(FileOutputStream.java:270)</i></font><br><font size=3 face="Calibri"><i>
at java.io.FileOutputStream.<init>(FileOutputStream.java:213)</i></font><br><font size=3 face="Calibri"><i>
at java.io.FileOutputStream.<init>(FileOutputStream.java:162)</i></font><br><font size=3 face="Calibri"><i>
at java.io.FileWriter.<init>(FileWriter.java:90)</i></font><br><font size=3 face="Calibri"><i>
at org.archive.crawler.reporting.StatisticsTracker.writeReportFile(StatisticsTracker.java:897)</i></font><br><font size=3 face="Calibri"><i>
at org.archive.crawler.reporting.StatisticsTracker.dumpReports(StatisticsTracker.java:926)</i></font><br><font size=3 face="Calibri"><i>
at org.archive.crawler.reporting.StatisticsTracker.stop(StatisticsTracker.java:342)</i></font><br><font size=3 face="Calibri"><i>
at org.springframework.context.support.DefaultLifecycleProcessor.doStop(DefaultLifecycleProcessor.java:236)</i></font><br><font size=3 face="Calibri"><i>
at org.springframework.context.support.DefaultLifecycleProcessor.doStop(DefaultLifecycleProcessor.java:213)</i></font><br><font size=3 face="Calibri"><i>
at org.springframework.context.support.DefaultLifecycleProcessor.doStop(DefaultLifecycleProcessor.java:213)</i></font><br><font size=3 face="Calibri"><i>
at org.springframework.context.support.DefaultLifecycleProcessor.doStop(DefaultLifecycleProcessor.java:213)</i></font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">In red “Demasiados ficheros abiertos”,
which means “Too much open files”. </font><br><font size=3 face="Calibri">Does anyone have had a problem like this?
Is there a way to avoid this?</font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">Thank you all!</font><br><font size=3 face="Calibri"> </font><br><font size=3 face="Calibri">Best Regards.</font><p><hr><font size=1>Este mensaje y cualquier fichero adjunto están dirigidos
únicamente a sus destinatarios y contiene información confidencial. Si
usted ha recibido este correo electrónico por error, le informamos que
no puede realizar ninguna revisión, alteración, impresión, copia, transmisión,
difusión ni utilización alguna de este mensaje ni de cualquier fichero
adjunto que pudiese contener. La realización de cualquiera de los actos
indicados está expresamente prohibida por las Normas que regulan estas
materias. Por todo ello se solicita que, en caso de existir error en la
recepción de este mensaje, se lo notifique al remitente respondiendo a
este e-mail y elimine el mensaje y su contenido inmediatamente. La Biblioteca
Nacional de España se reserva las acciones legales que le correspondan
en el caso de que se infrinja lo indicado anteriormente.</font><font size=3></font><hr><font size=1>The information in this e-mail and any attachments is
confidential and it is intended for the addressee only. If you have received
this e-mail in error, you are notified that any revision, amendment, print,
copy, disclosure, distribution or use of the contents is unauthorized.
Carrying out any of the above actions, is expressly banned by rules governing
this matter. Hence we request that if you are not the intended recipient,
please notify the sender answering this e-mail, and delete the message
and any attachments. The National Library of Spain reserves itself the
right to take the appropriate legal actions in the event of the above mentioned
matter is being infringed.</font><font size=3> </font><hr><tt><font size=2>_______________________________________________<br>NetarchiveSuite-users mailing list<br>NetarchiveSuite-users@ml.sbforge.org<br></font></tt><a href="https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users"><tt><font size=2>https://ml.sbforge.org/mailman/listinfo/netarchivesuite-users</font></tt></a><tt><font size=2><br></font></tt><p><font face="sans-serif"><hr />
<p><strong><a href="https://www.bnf.fr/fr/agenda">Découvrez toute la programmation culturelle de la rentrée à la BnF</a><br /><a href="https://www.bnf.fr/fr/pass-bnf-lecture-culture">Pass BnF lecture/culture</a> : bibliothèques, expositions, conférences, concerts en illimité pour 15 € / an</strong> – <strong><a href="https://inscriptionbilletterie.bnf.fr/">Acheter en ligne</a></strong></p>
<p style="color:#008000"><strong>Avant d'imprimer, pensez à l'environnement.</strong></p></font>