Answer / Yogendra Pal Singh

In Apache Spark, a "Stage" represents a collection of tasks that process the same dataset. A stage can be thought of as a unit of work that can run on one worker node at a time. On the other hand, a "Task" is the smallest unit of work that gets executed by workers in Spark. Each task performs some operation on a subset of data.

Can you explain accumulators in apache spark?

1 Answers  

---

How do we represent data in Spark?

1 Answers  

---

What is sparkconf spark?

1 Answers  

---

Explain leftOuterJoin() and rightOuterJoin() operation in Apache Spark?

1 Answers  

---

What is the difference between Spark Transform in DStream and map ?

1 Answers  

---

What is the difference between dataframe and dataset in spark?

1 Answers  

---

Explain Spark coalesce() operation?

1 Answers  

---

What is a "Spark Executor"?

1 Answers  

---

What are the disadvantages of using Spark?

1 Answers  

---

Explain transformation in rdd. How is lazy evaluation helpful in reducing the complexity of the system?

1 Answers  

---

What is Spark MLlib?

1 Answers  

---

Explain keys() operation in Apache spark?

1 Answers  

---