Answer / Gagan Gunjan

"MLlib is the machine learning library provided with Apache Spark. It contains scalable algorithms for regression, classification, clustering, collaborative filtering, and more. MLLib supports various data structures like vectors, matrices, and data frames, making it easy to perform complex machine learning tasks in a distributed environment.".

Define Partitions?

1 Answers  

---

Which storage level does the cache () function use?

1 Answers  

---

On what all basis can you differentiate rdd, dataframe, and dataset?

1 Answers  

---

Explain the various Transformation on Apache Spark RDD like distinct(), union(), intersection(), and subtract()?

1 Answers  

---

How does spark program work?

1 Answers  

---

Explain the default level of parallelism in Apache Spark

1 Answers  

---

What is shuffle spill in spark?

1 Answers  

---

Why do we use spark?

1 Answers  

---

What is graphx spark?

1 Answers  

---

What are the abstractions of Apache Spark?

1 Answers  

---

What is the reason behind Transformation being a lazy operation in Apache Spark RDD? How is it useful?

1 Answers  

---

What do you understand by Pair RDD?

1 Answers  

---