spark scala 如何在集群上调用 tf 模型,有成功验证的同学可以一起交流一下

作者: shuaidan0412创建于 2021年7月9日更新于 2021年7月9日

堆栈跟踪: ExitCodeException exitCode=134: /bin/bash: line 1: 16828 Aborted LD_LIBRARY_PATH="/usr/lib/hadoop-current/lib/native::/usr/lib/hadoop-current/lib/native:/usr/lib/bigboot-current/lib::/opt/apps/ecm/service/hadoop/2.8.5-1.4.2/package/hadoop-2.8.5-1.4.2/lib/native:/usr/lib/hadoop-current/lib/native:/usr/lib/bigboot-current/lib::/opt/apps/ecm/service/hadoop/2.8.5-1.4.2/package/hadoop-2.8.5-1.4.2/lib/native:/opt/apps/ecm/service/hadoop/2.8.5-1.4.2/package/hadoop-2.8.5-1.4.2/lib/native" /usr/lib/jvm/java-1.8.0/bin/java -server -Xmx1024m '-Dlog4j.ignoreTCL=true' -Djava.io.tmpdir=/mnt/disk1/yarn/usercache/hadoop/appcache/application_1625746977028_0206/container_1625746977028_0206_01_000002/tmp '-Dspark.history.ui.port=18080' '-Dspark.driver.port=41638' '-Dspark.shuffle.service.port=7337' -Dspark.yarn.app.container.log.dir=/mnt/disk2/log/hadoop-yarn/containers/application_1625746977028_0206/container_1625746977028_0206_01_000002 -Dspark.logger.appender=rolling -XX:OnOutOfMemoryError='kill %p' org.apache.spark.executor.CoarseGrainedExecutorBackend --driver-url spark://[email protected]:41638 --executor-id 1 --hostname emr-worker-3.cluster-230630 --cores 1 --app-id application_1625746977028_0206 --user-class-path file:/mnt/disk1/yarn/usercache/hadoop/appcache/application_1625746977028_0206/container_1625746977028_0206_01_000002/__app__.jar > /mnt/disk2/log/hadoop-yarn/containers/application_1625746977028_0206/container_1625746977028_0206_01_000002/stdout 2> /mnt/disk2/log/hadoop-yarn/containers/application_1625746977028_0206/container_1625746977028_0206_01_000002/stderr

内容来源: lyhue1991/eat_tensorflow2_in_30_days