Interested to Buy Any Domain ? << Click Here >> for more details...
What are the differences between Caching and Persistence method in Apache Spark?
- 1 Answers
- 323 Views
- I also Faced
- E-Mail Answers
Answer / Rjeev Saxena
Caching and Persistence are methods used to keep data in memory for faster access. However, they differ in their approach and use case.n1) Caching: It is a default persistence method used in Spark which stores RDDs in memory of executors. Data is only cached when an action is triggered.n2) Persistence: This allows users to persist data across actions using the `persist()` or `checkpoint()` functions. Unlike caching, persisted RDDs can survive shuffle operations.
| Is This Answer Correct ? | 0 Yes | 0 No |
How do you process big data with spark?
What are the components of spark?
How does reducebykey work in spark?
What is dataframe api?
What is coalesce in spark?
Explain Spark SQL caching and uncaching?
What is RDD in Apache Spark? How are they computed in Spark? what are the various ways in which it can create?
Who is the founder of spark?
Can you explain spark sql?
What operations does rdd support?
What do you understand by the parquet file?
What is spark checkpointing?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
