#1535·HanLP

模型优化问题

Author: arcralCreated Aug 17, 2020Updated Jul 9, 2021
Labelsfeature request

Describe the feature and the current behavior/state. 我想问一下是否可以考虑使用tensorflow-lite或者openvino作为推理后端,这样的话可以避免依赖整个tensorflow或pytorch库,也能提高加载速度,对于gpu资源不是很丰富的用户也更加友好,能够提升桌面cpu端的推理速度。 如果使用transformer的话,是否可以使用模型蒸馏减少堆叠层数(例如, DistilBert),同样能提升推理速度

Will this change the current api? How? no

Who will benefit with this feature? everyone who use this

Are you willing to contribute it (Yes/No): 可以做,但是可能没有足够的资源做

System information

  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
  • Python version:
  • HanLP version: v2.0.0-alpha.0

Any other info no

  • I've carefully completed this form.