What happens if rdd partition is lost due to worker node failure?
Answer Posted / Anurag Chaturvedi
When an RDD partition is lost due to a worker node failure, Spark will recompute the missing data by resending the tasks that were executing on the failed worker node to another available worker. This process may cause a delay in task completion but ensures data integrity and availability.
| Is This Answer Correct ? | 0 Yes | 0 No |
Post New Answer View All Answers