Interested to Buy Any Domain ? << Click Here >> for more details...
What is the need for Spark DAG?
- 1 Answers
- 321 Views
- I also Faced
- E-Mail Answers
Answer / Ankur Jain
The Directed Acyclic Graph (DAG) is crucial in Apache Spark as it allows efficient scheduling and execution of tasks. Each edge in the graph represents a dependency between two operations, with the source operation being computed before the target operation. By analyzing the dependencies in the DAG, Spark can optimize the order of task execution to minimize data shuffling and improve performance.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is the key difference between textfile and wholetextfile method?
How spark works on hadoop?
What is spark slang for?
What is javardd spark?
In a very huge text file, you want to just check if a particular keyword exists. How would you do this using Spark?
What is SparkSession in Apache Spark? Why is it needed?
Does Apache Spark provide check pointing?
What port does spark use?
What is the difference between coalesce and repartition in spark?
What is amazon spark?
What is dag spark?
What causes breaker to spark?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
