Is bigger than spark driver maxresultsize?
Answer / Somesh Ghoshal
It is not recommended to have a dataset larger than the Spark Driver's maxResultSize. If it is, an exception will be thrown. You can set the maxResultSize configuration property to adjust the limit.
| Is This Answer Correct ? | 0 Yes | 0 No |
Where does spark plug get power?
What are the different input sources for Spark Streaming?
What is the use of map transformation?
What is the standalone mode in spark cluster?
How Spark uses Hadoop?
What are the types of transformation in RDD in Apache Spark?
What is Apache Spark? What is the reason behind the evolution of this framework?
What do you understand by Transformations in Spark?
What is SparkSession in Apache Spark? Why is it needed?
What exactly is apache spark?
Explain accumulators in apache spark.
Does spark replace hadoop?
Apache Hadoop (394)
MapReduce (354)
Apache Hive (345)
Apache Pig (225)
Apache Spark (991)
Apache HBase (164)
Apache Flume (95)
Apache Impala (72)
Apache Cassandra (392)
Apache Mahout (35)
Apache Sqoop (82)
Apache ZooKeeper (65)
Apache Ambari (93)
Apache HCatalog (34)
Apache HDFS Hadoop Distributed File System (214)
Apache Kafka (189)
Apache Avro (26)
Apache Presto (15)
Apache Tajo (26)
Hadoop General (407)