[Netarchivesuite-curator] BnF NAS update for September

auriane.quoix at bnf.fr auriane.quoix at bnf.fr
Mon Sep 1 17:53:13 CEST 2025


Dear all,

We're resuming the preparations for our 2025 broad crawl, after the summer 
break. Several works are underway such as the update of the NAS and 
Heritrix versions, the setup of the Icelandic JS extractor and the HTTP 2 
fetch module.

During July, an IT incident affected our entire production activity. All 
our crawls were interrupted, and some had to be restarted. This was the 
case for the Auction houses and the biannual harvests, which were delayed. 
So the Auction houses harvest ran between mid-June and early August, and 
the biannual harvest between mid-July and mid-August. 88,579,685 URLs and 
1.50 TiB of data were archived for the Auction houses harvest and 
106,307,921 as well as 4.94 TiB for the biannual crawl.

Best regards,

The BnF digital legal deposit team

Venez découvrir le  le musée de la BnF à Richelieu . Avant d'imprimer, pensez à l'environnement. 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://ml.sbforge.org/pipermail/netarchivesuite-curator/attachments/20250901/3a5aea76/attachment.html>


More information about the Netarchivesuite-curator mailing list