What is write ahead log(journaling) in Spark?
Answer / Kundan Kumar Vats
Write Ahead Log (WAL), also known as journaling, is a data persistence strategy used by Spark to ensure durability of data operations. It logs all changes to the data before they are applied, so that in case of a failure, the system can recover and apply the same changes again.
| Is This Answer Correct ? | 0 Yes | 0 No |
Explain transformation in rdd. How is lazy evaluation helpful in reducing the complexity of the system?
What is scala spark?
What port does spark use?
How can apache spark be used alongside hadoop?
Which is better hadoop or spark?
What is spark lineage?
What are Paired RDD?
Do we need hadoop for spark?
Is there an api for implementing graphs in spark?
What do you understand by worker node?
How do I optimize my spark code?
List various commonly used machine learning algorithm?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)