adbar/trafilatura: trafilatura-0.7.0

20210 citationsJournal Articlegreen Open Access

Authors

Adrien Barbaresi · Berlin-Brandenburg Academy of Sciences and Humanities

LukasBBAW

Vincent Barbaresi · International Data Group (Sweden)

Phong Thanh Nguyen

Ellie Lockhart · Film Independent

A. Paul · Santa Ana College

François Schmidts · Maine School Administrative District 1

Raphael Geronimi

Abstract

customizable configuration file to parametrize extraction and downloads better handling of feeds and sitemaps additional CLI options: crytographic hash for file name, use Internet Archive as backup more precise extraction faster downloads: <code>requests</code> replaced with bare <code>urllib3</code> and custom decoding consolidation: bug fixes and improvements, many thanks to the issues reporters!

Topics & Keywords

Business and Management Studies Education and Digital Technologies

Publication Details

Published in: Zenodo (CERN European Organization for Nuclear Research)

DOI: 10.5281/zenodo.4415650

Command Palette

adbar/trafilatura: trafilatura-0.7.0

Authors

Abstract

Topics & Keywords

Publication Details