When using Apache Spark with YARN (Yet Another Resource Negotiator), you on

Is it necessary to install spark on all the nodes of a YARN cluster while running Apache Spark on YARN ?

Question Posted / Swadesh Kumar Niranjan

1 Answers
366 Views
I also Faced
E-Mail Answers

Answer Posted / Swadesh Kumar Niranjan

When using Apache Spark with YARN (Yet Another Resource Negotiator), you only need to install Spark's dependency libraries on the worker nodes (nodes that run executors). The master node, which runs the application master, must have Spark installed. It is not necessary to install Spark itself on all worker nodes.

Is This Answer Correct ?

0 Yes

0 No

Post New Answer View All Answers

Please Help Members By Posting Answers For Below Questions

Explain how RDDs work with Scala in Spark

355

What is meant by Transformation? Give some examples.

328

What is the latest version of spark?

287

List the advantage of Parquet file in Apache Spark?

473