As a spark developer, you might need to add numerous configuration parameters to run your Apache Spark application with optimal settings. If you look at the number of configuration options available in the spark-submit command, you would definitely appreciate, the kind of optimisations you could do.
There is a simple tool, just to build this spark-submit command at Gigahex. Gigahex is an upcoming platform for monitoring and receiving alerts for Spark based application.
Here's the video tutorial.
Top comments (0)