1. Categories >> Software >> Big Data >> Hadoop >> Apache Spark
  2. Suggest New Category

Is it necessary to install spark on all the nodes of a YARN cluster while running Apache Spark on YARN ?

Question Posted / meghnath


Is it necessary to install spark on all the nodes of a YARN cluster while running Apache Spark on Y..

Answer / Swadesh Kumar Niranjan

When using Apache Spark with YARN (Yet Another Resource Negotiator), you only need to install Spark's dependency libraries on the worker nodes (nodes that run executors). The master node, which runs the application master, must have Spark installed. It is not necessary to install Spark itself on all worker nodes.

Is This Answer Correct ?    0 Yes 0 No

Post New Answer

More Apache Spark Interview Questions

What is apache spark used for?

1 Answers  

How Spark uses Akka?

1 Answers  

What is executor spark?

1 Answers  

What are the advantage of spark?

1 Answers  

Is spark based on hadoop?

1 Answers  

Explain pipe() operation. How it writes the result to the standard output?

1 Answers  

Explain distnct(),union(),intersection() and substract() transformation in Spark?

1 Answers  

What is aggregatebykey spark?

1 Answers  

What do we mean by Paraquet?

1 Answers  

Explain about the different types of trformations on dstreams?

1 Answers  

What is aws spark?

1 Answers  

What purpose would an engineer use spark?

1 Answers  

For more Apache Spark Interview Questions Click Here
Categories