Interested to Buy Any Domain ? << Click Here >> for more details...
What is driver memory and executor memory in spark?
- 1 Answers
- 348 Views
- I also Faced
- E-Mail Answers
Answer / Dharmendra Yadav
"Driver memory" refers to the amount of RAM allocated for the Spark application's driver program, which manages tasks and data distribution. On the other hand, "Executor memory" denotes the memory available to each worker node (executor) that processes tasks concurrently in a Spark cluster. This memory is used to store intermediate results and cached data.n
| Is This Answer Correct ? | 0 Yes | 0 No |
Did edmond berger invent the spark plug?
What can I do with my m&s sparks points?
What is a partition in spark?
What is javardd?
What is the default partition in spark?
Which are the various data sources available in spark sql?
How is RDD in Spark different from Distributed Storage Management?
What is the difference between persist() and cache()?
What is Spark.executor.memory in a Spark Application?
On what all basis can you differentiate rdd, dataframe, and dataset?
Define a worker node?
What is aws spark?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
