No, it's not necessary to install Spark on all nodes in a YARN cluster

When running Spark applications, is it necessary to install Spark on all the nodes of YARN cluster?

Question Posted / Mukesh Singh Laspal

1 Answers
348 Views
I also Faced
E-Mail Answers

Answer Posted / Mukesh Singh Laspal

No, it's not necessary to install Spark on all nodes in a YARN cluster. Instead, you only need to install Spark on the nodes that will run the application's executor processes. The resource manager (usually a YARN NodeManager) and the application master manage the distribution of tasks among these executors.

Is This Answer Correct ?

0 Yes

0 No

Post New Answer View All Answers

Please Help Members By Posting Answers For Below Questions

What is meant by Transformation? Give some examples.

328

Explain how RDDs work with Scala in Spark

355

List the advantage of Parquet file in Apache Spark?

474

What is the latest version of spark?

288