Answer / Naseem Ahmad

There are two main categories of transformations for DStreams in Apache Spark: (1) Basic Transformations: These include map, filter, flatMap, reduceByKey, and join. They allow users to perform various operations on the data, such as applying a function to each element, filtering out unwanted elements, combining key-value pairs, or joining two DStreams based on some condition. (2) Complex Transformations: These are higher-level transformations that build upon basic transformations, such as window functions, triggers, and aggregations. They allow users to process streaming data in a more sophisticated manner, like grouping data by time windows or processing data based on event timestamps.

Describe the run-time architecture of Spark?

1 Answers  

---

Explain the difference between Spark SQL and Hive.

1 Answers  

---

What is executor in spark?

1 Answers  

---

On what all basis can you differentiate rdd, dataframe, and dataset?

1 Answers  

---

What is difference between scala and spark?

1 Answers  

---

Can we do real-time processing using spark sql?

1 Answers  

---

List the languages supported by Apache Spark?

1 Answers  

---

Compare Spark vs Hadoop MapReduce

1 Answers  

---

How does spark rdd work?

1 Answers  

---

What is apache spark in big data?

1 Answers  

---

What is Spark Driver?

1 Answers  

---

What are the disadvantages of using Apache Spark over Hadoop MapReduce?

1 Answers  

---