Answer / Tanuj Kumar

Catalyst is the query optimizer for Spark SQL that takes a logical plan of operations and transforms it into an efficient execution plan. It uses cost-based optimization, rule-based optimization, and operator subclasses to achieve this.

Which storage level does the cache () function use?

1 Answers  

---

List out the various advantages of dataframe over rdd in apache spark?

1 Answers  

---

Can you explain spark graphx?

1 Answers  

---

What are benefits of Spark over MapReduce?

1 Answers  

---

What is client mode in spark?

1 Answers  

---

Explain the difference between Spark SQL and Hive.

1 Answers  

---

When to use spark sql?

1 Answers  

---

What is sparkContext?

1 Answers  

---

Explain Spark map() transformation?

1 Answers  

---

What is apache spark written in?

1 Answers  

---

What are the optimization techniques in spark?

1 Answers  

---

What is Spark DataFrames?

1 Answers  

---