Answer / Sudheer Kumar

An Executor is a worker process in Apache Spark that runs tasks assigned by the Driver Program (the main application). When an application is submitted to a Spark cluster, the Driver Program creates one or more Executors on available nodes and distributes the task to each of them for processing. The Executor processes the tasks using the Java Virtual Machine (JVM) or Python interpreter, depending on the language used in the application.

Explain SparkContext in Apache Spark?

1 Answers  

---

How to identify that given operation is transformation/action in your program?

1 Answers  

---

What is transformation in spark?

1 Answers  

---

What is RDD in Apache Spark? How are they computed in Spark? what are the various ways in which it can create?

1 Answers  

---

Difference between groupByKey vs reduceByKey in Apache Spark?

1 Answers  

---

Name types of Cluster Managers in Spark.

1 Answers  

---

What is the bottom layer of abstraction in the Spark Streaming API ?

1 Answers  

---

How Spark uses Hadoop?

1 Answers  

---

List various commonly used machine learning algorithm?

1 Answers  

---

What is a partition in spark?

1 Answers  

---

Write the command to start and stop the spark in an interactive shell?

1 Answers  

---

Can you explain benefits of spark over mapreduce?

1 Answers  

---