[Netarchivesuite-curator] BnF NAS update for May

auriane.quoix at bnf.fr auriane.quoix at bnf.fr
Tue May 5 11:06:20 CEST 2026


Dear all,

In mid-March, we launched a new internal harvesting workshop about 
Browsertrix. We finally decided to extend the tests stage in order to 
focus on angles we were unable to fully explore:
- the harvest settings and behaviors
- the scalability: to test the harvest of several hundreds of accounts 
simultaneously
- the harvest scheduling: daily, weekly, etc.
- the harvest organization
- to quantify the time required for the harvest monitoring part
The tests will go on until June 4th.

In early April, we were conducting tests to launch our next Videos 
harvest. We tried different settings to reduce blocking issues and we 
finally launched the crawl the week of April 27th. Unfortunately, the 
harvest had to be paused due to these blockages.

Last week, we launched a special blog crawl with a new system: 4 queues 
are opened at the same time, one per blogging platform, and the blogs in 
each queue are archived one by one. This concerns the eklablog, overblog, 
canalblog, and centerblog platforms. We hope we will shorten the crawl 
period this way.

Finally, we started the first steps of the preparation of our broad crawl 
in order to obtain the different domains lists to archive.

Best regards,

The BnF digital legal deposit team
Exposition  Cartes imaginaires. Inventer des mondes  du 24 mars au 19 juillet 2026 à François-Mitterrand Avant d'imprimer, pensez à l'environnement. 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://ml.sbforge.org/pipermail/netarchivesuite-curator/attachments/20260505/f46ad467/attachment.html>


More information about the Netarchivesuite-curator mailing list