Answer / Madhulika Kumari

External Shuffle Service (ESS) is a feature in Spark that allows for offloading the shuffle process to other services like HDFS or S3, reducing memory usage on the worker nodes.

Can you explain how to minimize data transfers while working with Spark?

1 Answers  

---

Explain a scenario where you will be using spark streaming.

1 Answers  

---

What is catalyst query optimizer in apache spark?

1 Answers  

---

What is spark etl?

1 Answers  

---

What are the transformations in spark?

1 Answers  

---

What are spark stages?

1 Answers  

---

Define the level of parallelism and its need in spark streaming?

1 Answers  

---

Why is spark popular?

1 Answers  

---

Explain coalesce operation in Apache Spark?

1 Answers  

---

What operations does rdd support?

1 Answers  

---

What are the types of transformation in RDD in Apache Spark?

1 Answers  

---

Can you explain broadcast variables?

1 Answers  

---