100+ Chinese Word Vectors 数百种预训练的中文词向量
中文词向量 此项目提供了使用不同表示(密集和稀疏)、上下文特征(词、ngram、字符等)和语料库训练的 100 多个中文词向量(嵌入)。用户可以轻松获取具有不同属性的预训练向量,并将其用于下游任务。此外,我们还提供了中文类比推理数据集 CA8 和一个评估工具包,供用户评估其词向量的质量。参考 请在使用这些嵌入和 CA8 数据集时引用论文。Shen Li, Zhe Zhao, Renfen Hu, Wensi Li, Tao Liu, Xiaoyong Du, Analogical Reasoning on Chinese Morphological and Semantic Relations , ACL 2018. @InProceedings{P18-2023, author = "Li, Shen and Zhao, Zhe and Hu, Renfen and Li, Wensi and Liu, Tao and Du, Xiaoyong", title = "Analogical Reasoning on Chinese Morphological and Semantic Relations", booktitle = "Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)", year = "2018", publisher = "Association for Computational Linguistics", pages = "138--143", location = "Melbourne, Australia", url = "http://aclweb.org/anthology/P18-2023" } 详细分析了中文词向量的内在和外在评估之间的关系,见论文:Qiu Yuanyuan, Li Hongzheng, Li Shen, Jiang Yingdi, Hu Renfen, Yang Lijiao. Revisiting Correlations between Intrinsic and Extrinsic Evaluations of Word Embeddings . Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data. Springer, Cham, 2018. 209-221. (CCL & NLP-NABD 2018 Best Paper) @incollection{qiu2018revisiting, title={Revisiting Correlations between Intrinsic and Extrinsic Evaluations of Word Embeddings}, author={Qiu, Yuanyuan and Li, Hongzheng and Li, Shen and Jiang, Yingdi and Hu, Renfen and Yang, Lijiao}, booktitle={Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data}, pages={209--221}, year={2018}, publisher={Springer} } 格式 预训练向量文件采用文本格式。每行包含一个词和其向量。每个值以空格分隔。…
暂无开放 Issues,或尚未同步最近议题。