[Netarchivesuite-curator] BnF NAS update for May
auriane.quoix at bnf.fr
auriane.quoix at bnf.fr
Tue May 5 11:06:20 CEST 2026
Dear all,
In mid-March, we launched a new internal harvesting workshop about
Browsertrix. We finally decided to extend the tests stage in order to
focus on angles we were unable to fully explore:
- the harvest settings and behaviors
- the scalability: to test the harvest of several hundreds of accounts
simultaneously
- the harvest scheduling: daily, weekly, etc.
- the harvest organization
- to quantify the time required for the harvest monitoring part
The tests will go on until June 4th.
In early April, we were conducting tests to launch our next Videos
harvest. We tried different settings to reduce blocking issues and we
finally launched the crawl the week of April 27th. Unfortunately, the
harvest had to be paused due to these blockages.
Last week, we launched a special blog crawl with a new system: 4 queues
are opened at the same time, one per blogging platform, and the blogs in
each queue are archived one by one. This concerns the eklablog, overblog,
canalblog, and centerblog platforms. We hope we will shorten the crawl
period this way.
Finally, we started the first steps of the preparation of our broad crawl
in order to obtain the different domains lists to archive.
Best regards,
The BnF digital legal deposit team
Exposition Cartes imaginaires. Inventer des mondes du 24 mars au 19 juillet 2026 à François-Mitterrand Avant d'imprimer, pensez à l'environnement.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://ml.sbforge.org/pipermail/netarchivesuite-curator/attachments/20260505/f46ad467/attachment.html>
More information about the Netarchivesuite-curator
mailing list