In a given spark program, how will you identify whether a given operation is Transformation or Action ?
Answer / Ajay Kumar Dewabansi
Transformation operations in Spark return a new DataFrame/RDD without triggering physical execution. They can be chained together and only an action operation triggers the actual data processing. Examples of transformations include map, filter, and groupBy. An example of an action is count.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is spark vcores?
Explain coalesce operation in Apache Spark?
Can I install spark on windows?
What is the future of apache spark?
What is the difference between hive and spark?
What is RDD Lineage?
Why is there a need for broadcast variables when working with Apache Spark?
How is machine learning implemented in spark?
Explain the operations of Apache Spark RDD?
Which the fundamental data structure of Spark
When we create an rdd, does it bring the data and load it into the memory?
Explain keys() operation in Apache spark?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)