What is executor memory and driver memory in spark?
Answer / Ankitdoharey
Executor memory is the amount of RAM allocated to each worker node (executor) in a Spark cluster. Driver memory, on the other hand, refers to the amount of memory reserved for the main application that runs on the driver program.
| Is This Answer Correct ? | 0 Yes | 0 No |
Why is BlinkDB used?
What are the ways in which one can know that the given operation is transformation or action?
Explain the operation transformation and action in Apache Spark RDD?
In what ways sparksession different from sparkcontext?
Explain key features of Spark
What is dag spark?
Why do we need apache spark?
Does spark require hadoop?
How to identify that given operation is transformation/action in your program?
What are the differences between Caching and Persistence method in Apache Spark?
When we create an rdd, does it bring the data and load it into the memory?
What are broadcast variables in Apache Spark? Why do we need them?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)