What does the Spark Engine do?

321

---

How Spark uses Akka?

317

---

How Spark handles monitoring and logging in Standalone mode?

336

---

What is Hadoop serialization?

694

---

Explain a simple Map/Reduce problem.

716

---

Data Engineer Given a list of followers in the format:123, 345234, 678345, 123…Where column one is the ID of the follower and column two is the ID of the followee. Find all mutual following pairs (the pair 123, 345 in the example above). How would you use Map/Reduce to solve the problem when the list does not fit in memory?

742

---

How would you use Map/Reduce to split a very large graph into smaller pieces and parallelize the computation of edges according to the fast/dynamic change of data?

690

---

Write a Hive UDF that returns a sentiment score. For example, if good = 1, bad = -1, and average = 0, then a review of a restaurant states "Good food, bad service," your score might be 1 - 1 = 0.

680

---

Explain how RDDs work with Scala in Spark

341

---

Define HRegionServer in HBase

157

---

What is the use of shutdown command?

210

---

What is HBase HMaster?

360

---

What is the function of HMaster?

255

---

Suppose that your data is stored in collections, for instance, some binary data, message data or metadata is all keyed on the same value. Will you use HBase for this?

158

---

Explian the Limitations of HBase?

187

---