`nlp.pipe(n_process>1)` 使用 floret-mode 向量的任何管道 (例如 sv_core_news_lg) 时会发生 [E018]/[E871] 错误
Traceback (most recent call last): File "repro.py", line 17, in docs = list(nlp.pipe(texts, batch_size=40, n_process=2)) File "…/spacy/language.py", line 1622, in pipe for doc in docs: File "…/spacy/language.py", line 1688, in _multiprocessing_pipe ... File "…/spacy/language.py", line 2410, in _apply_pipes byte_docs = [(doc.to_bytes(), doc._context, None) for doc in docs] File "…/spacy/util.py", line 1714, in _pipe yield from proc.pipe(docs, **kwargs) File "spacy/pipeline/transition_parser.pyx", line 245, in pipe File "…/spacy/util.py", line 1661, in minibatch batch = list(itertools.islice(items, int(batch_size))) File "…/spacy/util.py", line 1714, in _pipe yield from proc.pipe(docs, **kwargs) [... repeated _pipe/minibatch frames through the chained pipeline components ...] File "spacy/pipeline/trainable_pipe.pyx", line 75, in spacy.pipeline.trainable_pipe.TrainablePipe.pipe File "…/spacy/pipeline/tok2vec.py", line 121, in predict tokvecs = self.model.predict(docs) File "…/thinc/model.py", line 334, in predict return self._func(self, X, is_train=False)[0] File "…/thinc/layers/chain.py", line 54, in forward Y, inc_layer_grad = layer(X, is_train=is_train) File "…/thinc/model.py", line 310, in call …
内容来源: explosion/spaCy