During implementation of your components as a microservice, you can come to an idea to use Apache Spark for data retrieval. I will describe ideas how to do this in this post.
Read moreTag: spark
Apache Zeppelin: behind spark interpreter
Here is an overview, what is hidden behind spark interpreter in Apache Zeppelin.
Read moreRemote submit of spark jobs
Remote submit is a powerful feature of Apache Spark. Why it is needed? For example, you can experiment with different versions of Spark, independent of what you have in the cluster. Or if you have no direct access to cluster you can start your spark jobs remotely.
Read more
Tuning spark parameters
Tuning spark parameters is not a trivial task. In this short post I will explain how to tune some of the important parameters.
Read more