Spark集群的不同启动模式
1、Yarn-Client
spark-submit \
–master spark://SparkMaster:7077 \
–executor-memory 1g \
–total-executor-cores 2 \
–class MySpark \
MyFirstProject.jar
yarn-client可以在终端看到交互结果
2、 Yarn-Cluster
spark-submit \
–master yarn-cluster \
–executor-memory 1g \
–total-executor-cores 2 \
–class MySpark \
MyFirstProject.jar
yarn-cluster不能在终端看到结果，要在http://sparkmaster:8088/cluster，点左侧的FINISHED，找到执行的ApplicationID -> Logs -> stdout
关注公众号“大模型全栈程序员”回复“小程序”获取1000个小程序打包源码。更多免费资源在http://www.gitweixin.com/?p=2627
