Interested to Buy Any Domain ? << Click Here >> for more details...
Explain apache spark streaming? How is the processing of streaming data achieved in apache spark?
- 1 Answers
- 320 Views
- I also Faced
- E-Mail Answers
Answer / Nitin Gupta
Apache Spark Streaming is an extension of Apache Spark that allows for real-time data processing. It enables users to process live data streams from various sources like Kafka, Twitter, or custom input sources. The processing of streaming data in Spark involves: (1) creating a DStream (DataStream), which represents the continuous stream; (2) applying transformations and actions on the DStream (e.g., map, filter, reduce); (3) receiving the results as batches at specified intervals.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is Directed Acyclic Graph(DAG)?
explain the concept of RDD (Resilient Distributed Dataset). Also, state how you can create RDDs in Apache Spark.
How to explain Bigdatadeveloper projects
When creating an RDD, what goes on internally?
Define the run-time architecture of Spark?
What is executor memory in spark?
List various commonly used machine learning algorithm?
What is the latest version of spark?
How do I download spark?
What is the use of dataframe in spark?
How do you set up a spark?
What is transformation in spark?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
