Answer / Sadhana Dubey

RDD (Resilient Distributed Dataset) is an immutable distributed collection of objects that provides fault-tolerant parallel processing for large datasets in Apache Spark. It serves as the fundamental data structure for performing computations in Spark. RDDs can be created from various sources such as local files, HDFS files, or even other RDDs using Spark's API (Application Programming Interface). Some ways to create RDDs include textFile(path), wholeTextFiles(path), and parallelize(iterable) in Scala, SparkSession.textFile(path), SparkSession.wholeTextFiles(path), and SparkSession.parallelize(iterable) in Java and Python respectively.

What is the difference between map and flatmap?

1 Answers  

---

Explain about trformations and actions in the context of rdds?

1 Answers  

---

Does Hoe Spark handle monitoring and logging in Standalone mode?

1 Answers  

---

How do you parse data in xml? Which kind of class do you use with java to parse data?

1 Answers  

---

What does rdd stand for?

1 Answers  

---

Is spark used for machine learning?

1 Answers  

---

What are the ways to launch Apache Spark over YARN?

1 Answers  

---

Explain sum(), max(), min() operation in Apache Spark?

1 Answers  

---

Describe coalesce() operation. When can you coalesce to a larger number of partitions? Explain.

1 Answers  

---

Can a spark cause a fire?

1 Answers  

---

In a given spark program, how will you identify whether a given operation is Transformation or Action ?

1 Answers  

---

Explain the difference between Spark SQL and Hive.

1 Answers  

---