Explain about trformations and actions in the context of rdds?
Answer / Anoop Dwivedi
"Transformations in Apache Spark RDDs create new RDDs from existing ones by applying various operations like map(), filter(), groupByKey(), etc. They are lazy evaluations, meaning they do not execute until an action is triggered. Actions on the other hand, compute a result and return a value, such as count(), collect(), saveAsTextFile(), etc."
| Is This Answer Correct ? | 0 Yes | 0 No |
Explain about the major libraries that constitute the Spark Ecosystem?
What is hadoop spark?
What is pregel api?
What are broadcast variables in Apache Spark? Why do we need them?
What is pagerank?
What is pair rdd?
What role does worker node play in Apache Spark Cluster? And what is the need to register a worker node with the driver program?
How do sparks work?
What is heap memory in spark?
What is the use of spark sql?
List the benefits of Spark over MapReduce.
What is the difference between spark and apache spark?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)