What is driver and executor in spark?
Answer / Sudhir Kumar Singh
In Apache Spark, the Driver is the main program that creates a SparkContext, specifies the dataset and operations to be performed on it, and coordinates the execution of tasks across multiple nodes. Executors are worker processes that run on each node, execute the tasks assigned by the driver, and return the results back to the driver.
| Is This Answer Correct ? | 0 Yes | 0 No |
Is it possible to run Apache Spark on Apache Mesos?
Does spark need hadoop?
What is lineage graph in Apache Spark?
What are the various levels of persistence in Apache Spark?
Is spark sql faster than hive?
What are the file formats supported by spark?
What is difference between rdd and dataframe?
Why do people use spark?
Does spark require hadoop?
What is the use of spark sql?
What exactly is spark?
Is it possible to run Spark and Mesos along with Hadoop?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)