Interested to Buy Any Domain ? << Click Here >> for more details...
List out the difference between textFile and wholeTextFile in Apache Spark?
- 1 Answers
- 420 Views
- I also Faced
- E-Mail Answers
Answer / Joginder
textFile: It is used to read large text files that are splittable, i.e., files which can be split into smaller pieces for processing parallelly. Each line of the file becomes a separate record.nwholeTextFiles: It is used to read large un-splittable text files as a single document instead of splitting them into multiple lines. This method avoids the overhead of splitting and reading small chunks, improving performance on certain use cases.
| Is This Answer Correct ? | 0 Yes | 0 No |
What is the use of rdd in spark?
Why do we use persist () on links rdd?
What is setmaster in spark?
Define a worker node?
What is spark rdd?
Can you use Spark to access and analyse data stored in Cassandra databases?
What is mlib in apache spark?
Can you define yarn?
Does spark require hdfs?
How does apache spark engine work?
Can we install spark on windows?
Explain various level of persistence in Apache Spark?
-
Apache Hadoop (394) - MapReduce (354)
- Apache Hive (345)
- Apache Pig (225)
- Apache Spark (991)
- Apache HBase (164)
- Apache Flume (95)
- Apache Impala (72)
- Apache Cassandra (392)
- Apache Mahout (35)
- Apache Sqoop (82)
- Apache ZooKeeper (65)
- Apache Ambari (93)
- Apache HCatalog (34)
- Apache HDFS Hadoop Distributed File System (214)
- Apache Kafka (189)
- Apache Avro (26)
- Apache Presto (15)
- Apache Tajo (26)
- Hadoop General (407)
