Training the default perceptron tagger with bigger corpus
Author: alvationsCreated Mar 2, 2016Updated Aug 27, 2026
Labelsgood first issuecorpusenhancementnice ideamodel
The default pickle for the PerceptronTagger is nice but it's a little too small for realistic usage:
>>> from nltk import PerceptronTagger
>>> len(PerceptronTagger(load=True).tagdict)
1549Would it be possible to retrain a model on something like the full Penn TreeBank or BNC? Is the model then releasable on NLTK?
Source: nltk/nltk