Diagnostics: File file:/private/tmp/spark-d4ebd819-e623-47c3-b008-2a4df8019758/__spark_libs__6824092

spark伪分布式模式 on-yarn出现一下错误

Diagnostics: File file:/private/tmp/spark-d4ebd819-e623-47c3-b008-2a4df8019758/__spark_libs__6824092999244734377.zip does not exist

java.io.FileNotFoundException: File file:/private/tmp/spark-d4ebd819-e623-47c3-b008-2a4df8019758/__spark_libs__6824092999244734377.zip does not exist

遇到这种错误，一个可能的原因是HADOOP_CONF_DIR配置错误。

先确保spark能找到这个环境变量，一般写在spark-env.sh中。

分析过程 https://stackoverflow.com/questions/40905224/spark-shell-spark-libs-zip-does-not-exist

spark排错记录

相关

标签