Hadoop Interview Questions, Answers for Freshers and Experienced asked in various Company Job Interviews

Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)

Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)

Hadoop Interview Questions

Questions Answers Views Company eMail

Explain a simple Map/Reduce problem.

Capital One,

679

Data Engineer Given a list of followers in the format:123, 345234, 678345, 123â€¦Where column one is the ID of the follower and column two is the ID of the followee. Find all mutual following pairs (the pair 123, 345 in the example above). How would you use Map/Reduce to solve the problem when the list does not fit in memory?

Twitter,

712

How would you use Map/Reduce to split a very large graph into smaller pieces and parallelize the computation of edges according to the fast/dynamic change of data?

Twitter,

651

Write a Hive UDF that returns a sentiment score. For example, if good = 1, bad = -1, and average = 0, then a review of a restaurant states "Good food, bad service," your score might be 1 - 1 = 0.

LinkedIn,

642

Explain how RDDs work with Scala in Spark

Capital One,

331

Define HRegionServer in HBase

155

What is the use of shutdown command?

204

What is HBase HMaster?

356

What is the function of HMaster?

247

Suppose that your data is stored in collections, for instance, some binary data, message data or metadata is all keyed on the same value. Will you use HBase for this?

156

Explian the Limitations of HBase?

185

State some applications of HBase?

167

What is a Column family in hbase?

191

Discuss about the different tombstone markers used for deletion purposes in HBase.?

181

Explain the Scope operators used in hbase?

178

Un-Answered Questions { Hadoop }

What is the significance of ‘IF EXISTS” clause while dropping a table?

658

Can rdd be shared between sparkcontexts?

272

Can Apache Kafka be used without Zookeeper?

977

Explain the term Cluster?

101

How can you configur the log cleaner?

521

What is the local repository and where it is useful while using ambari environment?

What is the use of cassandra cql collection?

Discuss and explain the various types of partitioners in cassandra?

Name the most common Input Formats defined in Hadoop? Which one is default?

441

How does hdfs provides good throughput?

What is cluster in Cassandra?

Difference Between Apache Sqoop vs Flume?

What are the steps to submit a Hadoop job?

872

What is Hadoop HDFS – Hadoop Distributed File System?

What is Derby database?

862

For More Un-Answered { Hadoop } Questions Click Here