Caching and Persistence are methods used to keep data in memory for faster

What are the differences between Caching and Persistence method in Apache Spark?

Question Posted / Rjeev Saxena

1 Answers
324 Views
I also Faced
E-Mail Answers

Answer Posted / Rjeev Saxena

Caching and Persistence are methods used to keep data in memory for faster access. However, they differ in their approach and use case.n1) Caching: It is a default persistence method used in Spark which stores RDDs in memory of executors. Data is only cached when an action is triggered.n2) Persistence: This allows users to persist data across actions using the `persist()` or `checkpoint()` functions. Unlike caching, persisted RDDs can survive shuffle operations.

Is This Answer Correct ?

0 Yes

0 No

Post New Answer View All Answers

Please Help Members By Posting Answers For Below Questions

Explain how RDDs work with Scala in Spark

355

What is the latest version of spark?

288

List the advantage of Parquet file in Apache Spark?

474

What is meant by Transformation? Give some examples.

328