Explain transformation and action in RDD in Apache Spark?
Answer / Pratibha Gangwar
In Apache Spark, transformations are operations that create a new RDD from an existing one without executing the computation immediately. Examples of transformations include map(), filter(), reduce(), join(), groupByKey(), and sortBy(). Actions, on the other hand, trigger the execution of previously defined transformations and produce a result in the driver program. Examples of actions are count(), collect(), saveAsTextFile(), and foreach(). Transformations in Spark are lazy evaluations, while actions are eager evaluations.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is hive on spark?
What is cluster in apache spark?
Is cache an action in spark?
What is skew data?
What is aggregatebykey spark?
Do we need to install scala for spark?
What is spark good for?
Explain mappartitions() and mappartitionswithindex()?
explain the key features of Apache Spark?
How does rdd work in spark?
What is the use of spark sql?
What happens to rdd when one of the nodes on which it is distributed goes down?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)