Answer / Rajeshwar Prasad

Cache and Persist are methods used for data caching in Apache Spark, but they behave slightly differently. Cache discards data after a certain period of time unless it's being actively used or persisted again. Persist, on the other hand, allows you to specify levels of persistence (e.g., MEMORY_ONLY, MEMORY_AND_DISK, etc.) and keeps the data in memory or on disk based on your preference.

Explain the key features of Spark.

1 Answers  

---

When to use coalesce and repartition in spark?

1 Answers  

---

What is sc parallelize?

1 Answers  

---

How to create an rdd?

1 Answers  

---

Can you explain spark mllib?

1 Answers  

---

What is the key difference between textfile and wholetextfile method?

1 Answers  

---

Name commonly-used Spark Ecosystems

1 Answers  

---

Explain first() operation in Apache Spark RDD?

1 Answers  

---

In a very huge text file, you want to just check if a particular keyword exists. How would you do this using Spark?

1 Answers  

---

Is apache spark a framework?

1 Answers  

---

What are the disadvantages of using Spark?

1 Answers  

---

What is RDD lineage graph? How does it enable fault-tolerance in Spark?

1 Answers  

---