我正在尝试在我的iMac上安装apache-spark,使用这两页上的说明:
https://medium.com/macoclock/how-to-install-apache-pyspark-on-macbook-pro-4a9249f0d823
https://www.freecodecamp.org/news/installing - scala -和- apache -火星- - mac os - 837 ae57d283f/
安装过程中,无法运行
brew cask install java
所以我输入
brew install java
我想我已经安装好了所有的东西,包括apache-spark。但是当我运行spark-shell或pyspark命令时,我一直遇到以下错误:
spark-shell:
/usr/local/Cellar/apache-spark/3.0.1/libexec/bin/spark-shell:第60行:/usr/local/Cellar/apache-spark/2.0.1/libexecexport/bin/spark-submit: No such file or directory
pyspark:
/usr/local/Cellar/apache-spark/3.0.1/libexec/bin/pyspark: line 24:/usr/local/Cellar/apache-spark/2.0.1/libexecexport/bin/load-spark-env.sh:没有这样的文件或目录/usr/local/cellar/apache-spark/3.0.1/libexec/bin/pyspark:第68行:/usr/local/cellar/apache-spark/2.0.1/libexecexport/bin/spark-submit:没有这样的文件或目录/usr/local/cellar/apache-spark/3.0.1/libexec/bin/pyspark:第68行:exec:/usr/local/cellar/apache-spark/2.0.1/libexecexport/bin/spark-submit: cannot execute: No such file or directory
我的iMac正在运行Big Sur 11.1版本。谢谢你的帮助。
原来我没有安装JDK。安装JDK后,问题解决。