"Spark's runtime architecture consists of a Driver Program (Java

Explain the run-time architecture of Spark?

Question Posted / Anjali Nayak

1 Answers
315 Views
I also Faced
E-Mail Answers

Answer Posted / Anjali Nayak

"Spark's runtime architecture consists of a Driver Program (Java or Scala code) that submits tasks to the Cluster Manager (YARN, Mesos, or Standalone). The Cluster Manager then allocates resources for executors. Each Executor runs multiple tasks concurrently and manages memory and storage through RDDs (Resilient Distributed Datasets). Spark uses DAG (Directed Acyclic Graph) scheduler to optimize task execution."

Is This Answer Correct ?

0 Yes

0 No

Post New Answer View All Answers

Please Help Members By Posting Answers For Below Questions

List the advantage of Parquet file in Apache Spark?

474

What is meant by Transformation? Give some examples.

328

Explain how RDDs work with Scala in Spark

355

What is the latest version of spark?

288