Interested to Buy Any Domain ? << Click Here >> for more details...
Does Apache Spark provide checkpoints?
- 1 Answers
- 306 Views
- I also Faced
- E-Mail Answers
Answer / Satish Kumar Agrahari
Yes, Apache Spark provides checkpointing as a mechanism to save the intermediate state of RDDs during a long-running job. Checkpoints help in fault tolerance by ensuring that when a task fails, it can be restarted from the most recent saved state instead of recomputing all previous stages.nCheckpoints are stored on HDFS or local file systems and can be enabled using Spark's checkpointing configuration options.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is hadoop spark?
Can you do real-time processing with Spark SQL?
What is pair rdd in spark?
How many ways can you create rdd in spark?
How does Apache Spark handles accumulated Metadata?
What are the disadvantages of using Apache Spark over Hadoop MapReduce?
What are the roles of the file system in any framework?
What is PageRank in Spark?
What is spark rdd?
What do you understand by the parquet file?
Explain the top() and takeordered() operation?
Is it necessary to start Hadoop to run any Apache Spark Application ?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
