Answer / Pranai Toppo

Apache Spark processes streaming data using Spark Streaming, a module that enables scalable, high-throughput, fault-tolerant stream processing of live data streams. It extends the core Spark API to enable batch and stream processing of live data. The basic unit of data in Spark Streaming is Discretized Stream (DStream), which is an ordered sequence of RDDs (Resilient Distributed Datasets). Each RDD represents a snapshot of data taken at some point in time, and the system creates a new RDD every batch interval. By default, Spark Streaming processes data in micro-batch increments, accumulating incoming data into RDDs before applying transformations.

What is difference between dataset and dataframe?

1 Answers  

---

Is spark streaming real time?

1 Answers  

---

What is javardd?

1 Answers  

---

Explain benefits of lazy evaluation in RDD in Apache Spark?

1 Answers  

---

Is the following approach correct? Is the sqrt Of Sum Of Sq a valid reducer?

1 Answers  

---

Why do we need spark?

1 Answers  

---

Why should I use spark?

1 Answers  

---

What is speculative execution in spark?

1 Answers  

---

Can you define rdd?

1 Answers  

---

How do I clear my spark cache?

1 Answers  

---

What port does spark use?

1 Answers  

---

How do you process big data with spark?

1 Answers  

---