<font size=2 face="Verdana">Dear all,<br><br>Last week, we launched our "Auction house" crawl, which concerns
French auction houses websites. About 200 websites had been selected. Last
year, we had been blacklisted by large auction sites. So we set up a specific
harvest system for auction.fr where many websites are hosted. We added
filters on all the other jobs in progress before starting the harvest and
we created a special queue management to group the URLs of all hosts which
belong to a website into one particular queue. This makes it possible to
avoid sending too many requests at the same time as well as to limit the
harvest to 100 000 URLs per website.<br></font><br><font size=2 face="Verdana">The LIFRANUM crawl carried out in partnership
with researchers from the Jean Moulin University Lyon 3 and the Lumière
University Lyon 2 is about to be launched.</font><br><font size=2 face="Verdana">The project aims to identify and map the
corpus of digital French-speaking literature (sites, blogs, social networks).
About 1100 sites will be crawled for this harvest with a specific budget
of 15 000 URLs. The harvest should last about 1 or 2 weeks.<br><br>Finally, we are continuing the preparations for our 2022 broad crawl.</font><br><br><br><font size=2 face="Verdana">Best regards,<br><br>The BnF digital legal deposit team</font><br><font face="sans-serif"><hr />
<p>Expositions <strong><em><a href="https://www.bnf.fr/fr/agenda/laventure-champollion">L'aventure Champollion. Dans le secret des hiéroglyphes</a></em></strong> – Jusqu'au 24 juillet 2022 | François-Mitterrand – <strong><em><a href="https://www.bnf.fr/fr/agenda/visages-de-lexploration-au-xixe-siecle">Visages de l’exploration au XIX<sup>e</sup> siècle. Du mythe à l’histoire </a></em></strong> – Du 10 mai au 21 août 2022 | François-Mitterrand</p>
<p style="color:#008000"><strong>Avant d'imprimer, pensez à l'environnement.</strong></p></font>