Interested to Buy Any Domain ? << Click Here >> for more details...
Explain textFile Vs wholeTextFile in Spark?
- 1 Answers
- 448 Views
- I also Faced
- E-Mail Answers
Answer / Nishant Pratap Singh
textFile reads a text file line by line, while wholeTextFiles loads the entire content of all files in a given directory into memory as a single string for each file. This makes textFile faster for reading small files but less efficient for large ones due to multiple passes over the data.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is pipelined rdd?
What is spark catalyst?
Explain how can spark be connected to apache mesos?
Is spark better than mapreduce?
What language is apache spark?
What is rdd map?
What is application master in spark?
What is the use of checkpoints in spark?
Name the Spark Library which allows reliable file sharing at memory speed across different cluster frameworks.
What is a spark rdd?
Explain the RDD properties?
What is sparkContext?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
