Interested to Buy Any Domain ? << Click Here >> for more details...
What is RDD lineage graph? How does it enable fault-tolerance in Spark?
- 1 Answers
- 333 Views
- I also Faced
- E-Mail Answers
Answer / Abhik Das
{"rdd lineage graph": "A directed acyclic graph (DAG) that represents the ancestry of Resilient Distributed Datasets (RDDs) in Apache Spark. Each RDD has a parent RDD, and together they form a lineage graph that tracks the data flow through transformations and actions.nnThe RDD lineage graph enables fault-tolerance by allowing Spark to recompute missing or failed parts of a job using the saved RDDs and their dependencies in the lineage graph."}
| Is This Answer Correct ? | 0 Yes | 0 No |
What is the default level of parallelism in apache spark?
What is spark checkpointing?
Why is transformation lazy operation in Apache Spark RDD? How is it useful?
What are the various functions of Spark Core?
Explain fullOuterJoin() operation in Apache Spark?
What are the types of transformation in RDD in Apache Spark?
Explain Spark map() transformation?
Can you define rdd lineage?
Is it possible to run Spark and Mesos along with Hadoop?
What is the point of apache spark?
What are the features of apache spark?
How many partitions are created by default in Apache Spark RDD?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
