Can't pickle <function cli at 0x105140a60>: it's not the same object as pyspider.run.cli
- pyspider version: 0.3.10 & 0.4.0
- Operating system: macos 14.0 (M1)
- Start up command: pyspider
Can't pickle <function cli at 0x105140a60>: it's not the same object as pyspider.run.cli
$ pyspider
Traceback (most recent call last): File "/Users/haibing6/Library/Python/3.9/bin/pyspider", line 8, in sys.exit(main()) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/pyspider/run.py", line 839, in main cli() File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/click/core.py", line 1130, in call return self.main(*args, **kwargs) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/click/core.py", line 1055, in main rv = self.invoke(ctx) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/click/core.py", line 1635, in invoke rv = super().invoke(ctx) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/click/core.py", line 1404, in invoke return ctx.invoke(self.callback, **ctx.params) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/click/core.py", line 760, in invoke return __callback(*args, **kwargs) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/click/decorators.py", line 26, in new_func return f(get_current_context(), *args, **kwargs) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/pyspider/run.py", line 177, in cli ctx.invoke(all) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/click/core.py", line 760, in invoke return __callback(*args, **kwargs) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/click/decorators.py", line 26, in new_func return f(get_current_context(), *args, **kwargs) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/pyspider/run.py", line 531, in all threads.append(run_in(ctx.invoke, phantomjs, **phantomjs_config)) File "/Users/haibing6/Library/Python/3.9/lib/python/site-packages/pyspider/libs/utils.py", line 68, in run_in_subprocess thread.start() File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/multiprocessing/process.py", line 121, in start self._popen = self._Popen(self) File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/multiprocessing/context.py", line 224, in _Popen return _default_context.get_context().Process._Popen(process_obj) File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/multiprocessing/context.py", line 284, in _Popen return Popen(process_obj) File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 32, in init super().init(process_obj) File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_fork.py", line 19, in init self._launch(process_obj) File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 47, in _launch reduction.dump(process_obj, fp) File "/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/lib/python3.9/multiprocessing/reduction.py", line 60, in dump ForkingPickler(file, protocol).dump(obj) _pickle.PicklingError: Can't pickle <function cli at 0x105140a60>: it's not the same object as pyspider.run.cli
How to resolve this issue?
Source: binux/pyspider