Answer / Sudhir Kumar Singh

In Apache Spark, the Driver is the main program that creates a SparkContext, specifies the dataset and operations to be performed on it, and coordinates the execution of tasks across multiple nodes. Executors are worker processes that run on each node, execute the tasks assigned by the driver, and return the results back to the driver.

What is the difference between Caching and Persistence in Apache Spark?

1 Answers  

---

What is spark parallelize?

1 Answers  

---

Do you need to install Spark on all nodes of Yarn cluster while running Spark on Yarn?

1 Answers  

---

What is parallelize in spark?

1 Answers  

---

Name a few commonly used spark ecosystems?

1 Answers  

---

Explain briefly what is Action in Apache Spark? How is final result generated using an action?

1 Answers  

---

Why is there a need for broadcast variables when working with Apache Spark?

1 Answers  

---

Describe the run-time architecture of Spark?

1 Answers  

---

What are common uses of Apache Spark?

1 Answers  

---

What is a shuffle block in spark?

1 Answers  

---

What is spark submit?

1 Answers  

---

Where is rdd stored?

1 Answers  

---