Answer / Ravita Rani

"Cache and Persist() are used to keep RDDs (Resilient Distributed Datasets) in memory for faster access. However, there is a key difference between them. Cache keeps an RDD in memory of the same JVM that created it. If the RDD is created on a different Executor, it won't be cached unless you use Persist(). The Persist() function allows you to specify whether the data should be kept only in memory (MEMORY), on disk and memory (MEMORY_ONLY_SER) or off-heap memory (OFFHEAP).".

What are the limitations of Spark?

1 Answers  

---

Which serialization libraries are supported in spark?

1 Answers  

---

Is there a module to implement sql in spark?

1 Answers  

---

What is executor spark?

1 Answers  

---

Why do we use spark?

1 Answers  

---

Who invented spark?

1 Answers  

---

How to save RDD?

1 Answers  

---

How is transformation on rdd different from action?

1 Answers  

---

Does Apache Spark provide check pointing?

1 Answers  

---

What is difference between spark and mapreduce?

1 Answers  

---

Explain the flatMap() transformation in Apache Spark?

1 Answers  

---

How can we create RDD in Apache Spark?

1 Answers  

---