bert-serving-start runing——The terminal keeps getting stuck while loading the model.

Author: shenshaoweiCreated Oct 26, 2024Updated Oct 26, 2024

when i run bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2 the requirements: tensorflow:1.15.0 bert-serving-start:1.10.0

(orfd) F:\已做项目\ORFD>bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2
2024-10-26 18:37:05.473317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
usage: D:\Anaconda3\envs\orfd\Scripts\bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2
                 ARG   VALUE
__________________________________________________
           ckpt_name = bert_model.ckpt
         config_name = bert_config.json
                cors = *
                 cpu = False
          device_map = []
       do_lower_case = True
  fixed_embed_length = False
                fp16 = False
 gpu_memory_fraction = 0.5
       graph_tmp_dir = None
    http_max_connect = 10
           http_port = None
        mask_cls_sep = False
      max_batch_size = 256
         max_seq_len = 25
           model_dir = /ORFD/bert/cased_L-12_H-768_A-12/
no_position_embeddings = False
    no_special_token = False
          num_worker = 2
       pooling_layer = [-2]
    pooling_strategy = REDUCE_MEAN
                port = 5555
            port_out = 5556
       prefetch_size = 10
 priority_batch_size = 16
show_tokens_to_client = False
     tuned_model_dir = None
             verbose = False
                 xla = False

I:VENTILATOR:freeze, optimize and export graph, could take a while...
2024-10-26 18:37:13.000498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
WARNING:tensorflow:From D:\Anaconda3\envs\orfd\lib\site-packages\bert_serving\server\helper.py:186: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

WARNING:tensorflow:From D:\Anaconda3\envs\orfd\lib\site-packages\bert_serving\server\helper.py:186: The name tf.logging.ERROR is deprecated. Please use tf.compat.v1.logging.ERROR instead.

I:GRAPHOPT:model config: /ORFD/bert/cased_L-12_H-768_A-12/bert_config.json
I:GRAPHOPT:checkpoint: /ORFD/bert/cased_L-12_H-768_A-12/bert_model.ckpt

bert-serving-start runing——The terminal keeps getting stuck while loading the model. how can i solve this bug??Then pressing Ctrl+C doesn't work to exit either.