Hadoop Interview Questions, Answers for Freshers and Experienced asked in various Company Job Interviews

Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)

Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)

Hadoop Interview Questions

Questions Answers Views Company eMail

Explain a simple Map/Reduce problem.

Capital One,

786

Data Engineer Given a list of followers in the format:123, 345234, 678345, 123â€¦Where column one is the ID of the follower and column two is the ID of the followee. Find all mutual following pairs (the pair 123, 345 in the example above). How would you use Map/Reduce to solve the problem when the list does not fit in memory?

Twitter,

786

How would you use Map/Reduce to split a very large graph into smaller pieces and parallelize the computation of edges according to the fast/dynamic change of data?

Twitter,

730

Write a Hive UDF that returns a sentiment score. For example, if good = 1, bad = -1, and average = 0, then a review of a restaurant states "Good food, bad service," your score might be 1 - 1 = 0.

LinkedIn,

732

Explain how RDDs work with Scala in Spark

Capital One,

350

Define HRegionServer in HBase

161

What is the use of shutdown command?

214

What is HBase HMaster?

362

What is the function of HMaster?

272

Suppose that your data is stored in collections, for instance, some binary data, message data or metadata is all keyed on the same value. Will you use HBase for this?

162

Explian the Limitations of HBase?

199

State some applications of HBase?

173

What is a Column family in hbase?

200

Discuss about the different tombstone markers used for deletion purposes in HBase.?

191

Explain the Scope operators used in hbase?

186

Un-Answered Questions { Hadoop }

Which one is the master node in HDFS? Can it be commodity hardware?

What Is Difference Between Mapreduce and Pig ?

677

What is the best method for Storing Objects in Cassandra ?

Can we write map reduce program in other than java programming language. How?

525

What is atom in pig?

584

Explain how can we change the split size if our commodity hardware has less storage space?

688

How Facebook Uses Hadoop, Hive and Hbase ?

766

What mechanism does hadoop framework provides to synchronize changes made in distribution cache during runtime of the application?

714

Difference Between Hadoop and HDFS?

What are the befefits of nosql over relational database?

Compare Hadoop and Spark?

341

What are the side effects of not running a secondary name node?

485

Is impala production ready?

Explain the term commitlog?

What is the use of dataframe in spark?

306

For More Un-Answered { Hadoop } Questions Click Here