What is the use of spark driver, where it gets executed on the cluster?
Answer Posted / Soni Chauhan
The Spark Driver is a process that starts the application and manages the entire execution. It creates an application-level interface for Spark programs, schedules tasks across workers in the cluster, and manages resources like memory and disk space. The driver program runs on the master node (usually the local machine when running locally), not on the worker nodes.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers