模型优化问题
Author: arcralCreated Aug 17, 2020Updated Jul 9, 2021
Labelsfeature request
Describe the feature and the current behavior/state. 我想问一下是否可以考虑使用tensorflow-lite或者openvino作为推理后端,这样的话可以避免依赖整个tensorflow或pytorch库,也能提高加载速度,对于gpu资源不是很丰富的用户也更加友好,能够提升桌面cpu端的推理速度。 如果使用transformer的话,是否可以使用模型蒸馏减少堆叠层数(例如, DistilBert),同样能提升推理速度
Will this change the current api? How? no
Who will benefit with this feature? everyone who use this
Are you willing to contribute it (Yes/No): 可以做,但是可能没有足够的资源做
System information
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
- Python version:
- HanLP version: v2.0.0-alpha.0
Any other info no
- I've carefully completed this form.
Source: hankcs/HanLP