During implementation of your components as a microservice, you can come to an idea to use Apache Spark for data retrieval. I will describe ideas how to do this in this post.Read more
Here is an overview, what is hidden behind spark interpreter in Apache Zeppelin.Read more
Remote submit is a powerful feature of Apache Spark. Why it is needed? For example, you can experiment with different versions of Spark, independent of what you have in the cluster. Or if you have no direct access to cluster you can start your spark jobs remotely.
Tuning spark parameters is not a trivial task. In this short post I will explain how to tune some of the important parameters.