Who creates dag in spark?
Answer / Sameer Panwar
In Apache Spark, Directed Acyclic Graphs (DAGs) are created automatically by the scheduler to represent the data-flow dependencies between tasks. The scheduler takes care of creating and managing these DAGs based on the given set of tasks and their interdependencies.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is the difference between python and spark?
Why does the picture of Spark come into existence?
Does spark use tez?
How does broadcast join work in spark?
What is spark execution engine?
Is spark written in java?
How do I optimize my spark code?
What is hive on spark?
Explain the difference between Spark SQL and Hive.
What is coarsegrainedexecutorbackend?
Does spark use mapreduce?
What is project tungsten in spark?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)