adspace


What is the use of spark driver, where it gets executed on the cluster?

Answer Posted / Soni Chauhan

The Spark Driver is a process that starts the application and manages the entire execution. It creates an application-level interface for Spark programs, schedules tasks across workers in the cluster, and manages resources like memory and disk space. The driver program runs on the master node (usually the local machine when running locally), not on the worker nodes.

Is This Answer Correct ?    0 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is meant by Transformation? Give some examples.

382


What is the latest version of spark?

338


List the advantage of Parquet file in Apache Spark?

523


Explain how RDDs work with Scala in Spark

407