What is executor memory and driver memory in spark?
Answer / Ankitdoharey
Executor memory is the amount of RAM allocated to each worker node (executor) in a Spark cluster. Driver memory, on the other hand, refers to the amount of memory reserved for the main application that runs on the driver program.
| Is This Answer Correct ? | 0 Yes | 0 No |
What file systems Spark support?
How many types of Transformation are there?
What do you mean by Persistence?
What is external shuffle service in spark?
Are sparks dangerous?
What is the FlatMap Transformation in Apache Spark RDD?
How is the processing of streaming data achieved in Apache Spark? Explain.
Can you define yarn?
What is PageRank in Spark?
What is the difference between dataframe and dataset in spark?
How many ways we can create rdd?
Why is BlinkDB used?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)