loading...
Cover image for spark-submit command builder with live preview

spark-submit command builder with live preview

shadamez profile image Shad Amez Updated on ・1 min read

As a spark developer, you might need to add numerous configuration parameters to run your Apache Spark application with optimal settings. If you look at the number of configuration options available in the spark-submit command, you would definitely appreciate, the kind of optimisations you could do.

There is a simple tool, just to build this spark-submit command at Gigahex. Gigahex is an upcoming platform for monitoring and receiving alerts for Spark based application.

Here's the video tutorial.

Discussion

pic
Editor guide