What is in memory in spark?
Answer / Vivek Kishor
In Apache Spark, data is stored in-memory through RDDs (Resilient Distributed Datasets) and DataFrames/DataSets. This allows for faster processing as the data does not need to be constantly read from disk.
| Is This Answer Correct ? | 0 Yes | 0 No |
To use Spark on an existing Hadoop Cluster, do we need to install Spark on all nodes of Hadoop?
In how many ways RDDs can be created? Explain.
What is difference between hive and spark?
What is difference between spark and mapreduce?
Which serialization libraries are supported in spark?
Is spark sql a database?
Can you do real-time processing with Spark SQL?
What are common spark ecosystems?
How do I download spark?
Name a few commonly used spark ecosystems?
What is a "Parquet" in Spark?
What is executor memory in a spark application?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)