What happens when we submit a spark job?



What happens when we submit a spark job?..

Answer / Pankaj Kumar Tripathi

When a Spark job is submitted, it is broken down into smaller tasks and distributed across the cluster. Each task is executed by a worker node, which runs an executor process. The driver program coordinates the execution of these tasks, keeps track of their progress, and handles communication between the driver and executors.

Is This Answer Correct ?    0 Yes 0 No

Post New Answer

More Apache Spark Interview Questions

Why does spark skip stages?

1 Answers  


What does a Spark Engine do?

1 Answers  


Why is Transformation lazy in Spark?

1 Answers  


Describe the distnct(),union(),intersection() and substract() transformation in Apache Spark RDD?

1 Answers  


What is scala and spark?

1 Answers  


Explain the operation reduce() in Spark?

1 Answers  


What are features of apache spark?

1 Answers  


Why do we use spark?

1 Answers  


What is spark written?

1 Answers  


Explain first() operation in Apache Spark RDD?

1 Answers  


What is sparkconf spark?

1 Answers  


What is a "Spark Executor"?

1 Answers  


Categories