How to set Spark recovery to Zookeeper

Question

Hi. I want to set a recovery system for my Spark application. I have a Zookeeper running for this purpose. Now, I want to know how to set Zookeeper as the recovery setting for the Spark application. Please help

Answer 1

There is a property of Spark which lets you set the recovery mode. To set Zookeeper as the recovery mode, try the below commands:

val sc = new SparkContext(new SparkConf())

./bin/spark-submit <all your existing options> --spark.deploy.recoveryMode=ZOOKEEPER