explosion/spaCy: v2.3.2: Improved Korean tokenizer speed, experimental character-based pretraining and bug fixes

20201 citationsJournal Articlegreen Open Access

Authors

Ines Montani · Gezhouba Explosive (China)

Matthew Honnibal · Gezhouba Explosive (China)

Honnibal, Matthew · Gezhouba Explosive (China)

Landeghem, Sofie Van · Gezhouba Explosive (China)

Abstract

✨ New features and improvements Improve Korean tokenizer speed. Add experimental character-based pretraining. 🔴 Bug fixes Fix issue #5728: Fix French lemmatizer. Fix issue #5729: Fix lemmatizer for python 2.7. Fix issue #5751: Fix meta serialization in train CLI. 👥 Contributors Thanks to @graue70, @mikeizbicki, @jbesomi, @gandersen101 and @DeNeutoy for the pull requests and contributions.

Topics & Keywords

Software Testing and Debugging Techniques Smart Agriculture and AI

Publication Details

Published in: Zenodo (CERN European Organization for Nuclear Research)

DOI: 10.5281/zenodo.3942128

Command Palette

explosion/spaCy: v2.3.2: Improved Korean tokenizer speed, experimental character-based pretraining and bug fixes

Authors

Abstract

Topics & Keywords

Publication Details