Discuss the role of Spark driver in Spark application?
Answer Posted / Prashant Katiyar
The Spark Driver program is responsible for coordinating an application, creating necessary executors, and managing tasks. It is the main process that launches the entire Spark application. The Driver program reads the input data (if any), creates RDDs, and applies transformations on them. It then partitions the data, schedules tasks across worker nodes, and collects results from executors. The Driver program also handles fault tolerance by managing re-execution of failed tasks.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers