What is executor memory and driver memory in spark?
Answer / Ankitdoharey
Executor memory is the amount of RAM allocated to each worker node (executor) in a Spark cluster. Driver memory, on the other hand, refers to the amount of memory reserved for the main application that runs on the driver program.
| Is This Answer Correct ? | 0 Yes | 0 No |
Explain Catalyst framework?
What is spark lineage?
Can we do real-time processing using spark sql?
What are the roles of the file system in any framework?
Explain about the major libraries that constitute the Spark Ecosystem?
What do we mean by Partitions or slices?
What is executor memory in a spark application?
How tasks are created in spark?
Name the languages which are supported by apache spark and which one is most popular?
What is in memory in spark?
Explain how RDDs work with Scala in Spark
How Spark uses Hadoop?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)