Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407) Data Engineer Given a list of followers in the format:123, 345234, 678345, 123…Where column one is the ID of the follower and column two is the ID of the followee. Find all mutual following pairs (the pair 123, 345 in the example above). How would you use Map/Reduce to solve the problem when the list does not fit in memory?
714How would you use Map/Reduce to split a very large graph into smaller pieces and parallelize the computation of edges according to the fast/dynamic change of data?
653Write a Hive UDF that returns a sentiment score. For example, if good = 1, bad = -1, and average = 0, then a review of a restaurant states "Good food, bad service," your score might be 1 - 1 = 0.
645Suppose that your data is stored in collections, for instance, some binary data, message data or metadata is all keyed on the same value. Will you use HBase for this?
156
What is mapper in map reduce?
What is Rack awareness?
Why do we need Pig?
Differentiate between FileSink and FileRollSink?
How one can change Replication factor when Data is already stored in HDFS
What are the different types of Znodes?
How can you send some messages in kafka?
How do sparks work?
What is a TaskInstance?
Mention what are the type of database does Hive support ?
What is hadoop? Name the main components of a hadoop application?
What are the tools that are we needed or helps to build ambari?
What is the design architecture of Cassandra?
Explain Apache Kafka Use Cases?
What is cqlsh?