What happens when an action is executed in spark?
Answer / Pawan Chaubey
When an action is executed in Apache Spark, the system creates a logical plan to represent the computation as a series of operations. The logical plan is then optimized by various transformations (e.g., rule-based optimization, cost-based optimization). After optimization, the physical execution plan is generated and executed on one or more worker nodes in the cluster. The final result is returned back to the driver program.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is a pipelinedrdd?
What is write ahead log(journaling)?
What is in memory processing in spark?
What is spark checkpointing?
What are the various modes in which Spark runs on YARN? (Local vs Client vs Cluster Mode)
Name three data source available in SparkSQL
Is a distributed machine learning framework on top of spark?
What is a Sparse Vector?
What happens when you submit spark job?
What is apache spark core?
Who is the founder of spark?
Explain SparkContext in Apache Spark?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)