Golgappa.net | Golgappa.org | BagIndia.net | BodyIndia.Com | CabIndia.net | CarsBikes.net | CarsBikes.org | CashIndia.net | ConsumerIndia.net | CookingIndia.net | DataIndia.net | DealIndia.net | EmailIndia.net | FirstTablet.com | FirstTourist.com | ForsaleIndia.net | IndiaBody.Com | IndiaCab.net | IndiaCash.net | IndiaModel.net | KidForum.net | OfficeIndia.net | PaysIndia.com | RestaurantIndia.net | RestaurantsIndia.net | SaleForum.net | SellForum.net | SoldIndia.com | StarIndia.net | TomatoCab.com | TomatoCabs.com | TownIndia.com
Interested to Buy Any Domain ? << Click Here >> for more details...

How is the processing of streaming data achieved in Apache Spark? Explain.

Answer Posted / Pranai Toppo

Apache Spark processes streaming data using Spark Streaming, a module that enables scalable, high-throughput, fault-tolerant stream processing of live data streams. It extends the core Spark API to enable batch and stream processing of live data. The basic unit of data in Spark Streaming is Discretized Stream (DStream), which is an ordered sequence of RDDs (Resilient Distributed Datasets). Each RDD represents a snapshot of data taken at some point in time, and the system creates a new RDD every batch interval. By default, Spark Streaming processes data in micro-batch increments, accumulating incoming data into RDDs before applying transformations.

Is This Answer Correct ?    0 Yes 0 No



Post New Answer       View All Answers


Please Help Members By Posting Answers For Below Questions

What is the latest version of spark?

288


Explain how RDDs work with Scala in Spark

355


List the advantage of Parquet file in Apache Spark?

474


What is meant by Transformation? Give some examples.

328